2024-03-27T07:02:29.753 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-27T07:02:29.753 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643 --verbose --name rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643/orig.config.yaml 2024-03-27T07:02:29.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T07:02:29.909 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643 branch: wip-rishabh-testing-20240326.131558 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} email: null first_in_suite: false job_id: '7625643' kernel: client: sha1: distro flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240326.131558 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240326.131558 sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6931 sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 sleep_before_teardown: 0 subset: 80/512 suite: fs suite_branch: wip-rishabh-testing-20240326.131558 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHyKlwU/8vvEDZtASdJ4Z26yxTjuFDOYQJM5ICIsrgU2p4lObqJHeUiTGw8f7134y4IxYMGRqlK6m/UGwlME0Y= smithi149.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwO3e74ntGnFJH7U6cLrL18uKEQunj4yHCQHZJkQMVaPL8jM8XqT7xHaYA1TU2YsLjO5XNm1pvbXxepJnKo0RU= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAKuhnMdEzyYcOF9V83N/kvSsxbGZLUl1g72HhH6DSjVxQ01Zw6GmIJqxSQJfl9wIMAnNfloX/GKIpHmlkwz5OM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/blogbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-27_05:27:11 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-27T07:02:29.909 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa; will attempt to use it 2024-03-27T07:02:29.910 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks 2024-03-27T07:02:29.910 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-27T07:02:29.912 INFO:teuthology.task.internal:Checking packages... 2024-03-27T07:02:29.935 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '155268c4e432a12433aa833f174f9fe3b1016ae0' 2024-03-27T07:02:29.935 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-27T07:02:29.935 INFO:teuthology.packaging:ref: None 2024-03-27T07:02:29.935 INFO:teuthology.packaging:tag: None 2024-03-27T07:02:29.935 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240326.131558 2024-03-27T07:02:29.935 INFO:teuthology.packaging:sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:02:29.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240326.131558 2024-03-27T07:02:30.164 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2478.g155268c4 2024-03-27T07:02:30.166 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-27T07:02:30.173 INFO:teuthology.task.internal:no buildpackages task found 2024-03-27T07:02:30.173 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-27T07:02:30.227 INFO:teuthology.task.internal:Saving configuration 2024-03-27T07:02:30.248 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-27T07:02:30.271 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T07:02:30.297 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 06:57:02.410070', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHyKlwU/8vvEDZtASdJ4Z26yxTjuFDOYQJM5ICIsrgU2p4lObqJHeUiTGw8f7134y4IxYMGRqlK6m/UGwlME0Y='} 2024-03-27T07:02:30.317 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 06:57:02.407114', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwO3e74ntGnFJH7U6cLrL18uKEQunj4yHCQHZJkQMVaPL8jM8XqT7xHaYA1TU2YsLjO5XNm1pvbXxepJnKo0RU='} 2024-03-27T07:02:30.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 06:57:02.408524', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAKuhnMdEzyYcOF9V83N/kvSsxbGZLUl1g72HhH6DSjVxQ01Zw6GmIJqxSQJfl9wIMAnNfloX/GKIpHmlkwz5OM='} 2024-03-27T07:02:30.339 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-27T07:02:30.355 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-27T07:02:30.355 INFO:teuthology.task.internal:roles: ubuntu@smithi149.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-27T07:02:30.355 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-27T07:02:30.355 INFO:teuthology.run_tasks:Running task console_log... 2024-03-27T07:02:30.455 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f36dfe2d160>, signals=[15]) 2024-03-27T07:02:30.456 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-27T07:02:30.462 INFO:teuthology.task.internal:Opening connections... 2024-03-27T07:02:30.462 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T07:02:30.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T07:02:30.554 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi149.front.sepia.ceph.com 2024-03-27T07:02:30.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T07:02:30.644 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-03-27T07:02:30.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T07:02:30.736 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-27T07:02:30.743 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-03-27T07:02:30.761 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-03-27T07:02:30.761 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-03-27T07:02:30.817 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-03-27T07:02:30.817 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-03-27T07:02:30.817 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-03-27T07:02:30.817 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-03-27T07:02:30.817 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-03-27T07:02:30.817 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-03-27T07:02:30.818 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T07:02:30.818 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-03-27T07:02:30.818 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-03-27T07:02:30.818 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T07:02:30.818 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-03-27T07:02:30.818 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T07:02:30.818 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T07:02:30.818 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T07:02:30.819 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-03-27T07:02:30.846 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2024-03-27T07:02:30.863 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2024-03-27T07:02:30.863 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2024-03-27T07:02:30.920 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="CentOS Stream" 2024-03-27T07:02:30.920 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="9" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:ID="centos" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="rhel fedora" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="9" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el9" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:LOGO="fedora-logo-icon" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://centos.org/" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T07:02:30.921 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T07:02:30.922 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2024-03-27T07:02:30.946 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-03-27T07:02:30.963 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-03-27T07:02:30.963 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T07:02:31.020 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T07:02:31.021 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T07:02:31.021 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-03-27T07:02:31.045 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-27T07:02:31.056 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-27T07:02:31.149 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-27T07:02:31.150 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-03-27T07:02:31.152 DEBUG:teuthology.orchestra.run.smithi149:> test '!' -e /home/ubuntu/cephtest 2024-03-27T07:02:31.154 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-03-27T07:02:31.171 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-27T07:02:31.181 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-27T07:02:31.181 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-03-27T07:02:31.209 DEBUG:teuthology.orchestra.run.smithi149:> test -z $(ls -A /var/lib/ceph) 2024-03-27T07:02:31.211 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-03-27T07:02:31.297 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-27T07:02:31.372 INFO:teuthology.run_tasks:Running task kernel... 2024-03-27T07:02:31.387 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-03-27T07:02:31.387 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-03-27T07:02:31.387 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-03-27T07:02:31.387 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-27T07:02:31.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T07:02:31.404 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-03-27T07:02:31.461 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-361.el9.x86_64 2024-03-27T07:02:31.462 INFO:teuthology.task.kernel:Running kernel on smithi082: 5.14.0-361.el9.x86_64 2024-03-27T07:02:31.462 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum install -y kernel 2024-03-27T07:02:33.602 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-27T07:02:35.035 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2024-03-27T07:02:36.045 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-27T07:02:37.868 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-03-27T07:02:42.436 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 6.1 MB 00:01 2024-03-27T07:02:43.986 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-03-27T07:02:46.829 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 21 MB 00:02 2024-03-27T07:02:51.861 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-03-27T07:02:54.001 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-27T07:02:54.002 INFO:teuthology.orchestra.run.smithi082.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-27T07:02:54.095 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-03-27T07:02:54.104 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-03-27T07:02:54.104 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-03-27T07:02:54.104 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-03-27T07:02:54.104 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-03-27T07:02:54.104 INFO:teuthology.orchestra.run.smithi082.stdout: kernel x86_64 5.14.0-432.el9 baseos 66 k 2024-03-27T07:02:54.104 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-03-27T07:02:54.104 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core x86_64 5.14.0-432.el9 baseos 15 M 2024-03-27T07:02:54.104 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules x86_64 5.14.0-432.el9 baseos 33 M 2024-03-27T07:02:54.104 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core x86_64 5.14.0-432.el9 baseos 27 M 2024-03-27T07:02:54.104 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:02:54.105 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-03-27T07:02:54.105 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-03-27T07:02:54.105 INFO:teuthology.orchestra.run.smithi082.stdout:Install 4 Packages 2024-03-27T07:02:54.105 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:02:54.105 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 76 M 2024-03-27T07:02:54.105 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 123 M 2024-03-27T07:02:54.105 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-03-27T07:02:54.488 INFO:teuthology.orchestra.run.smithi082.stdout:(1/4): kernel-5.14.0-432.el9.x86_64.rpm 203 kB/s | 66 kB 00:00 2024-03-27T07:02:56.788 INFO:teuthology.orchestra.run.smithi082.stdout:(2/4): kernel-modules-core-5.14.0-432.el9.x86_6 12 MB/s | 27 MB 00:02 2024-03-27T07:02:57.537 INFO:teuthology.orchestra.run.smithi082.stdout:(3/4): kernel-modules-5.14.0-432.el9.x86_64.rpm 9.9 MB/s | 33 MB 00:03 2024-03-27T07:03:02.521 INFO:teuthology.orchestra.run.smithi082.stdout:(4/4): kernel-core-5.14.0-432.el9.x86_64.rpm 1.8 MB/s | 15 MB 00:08 2024-03-27T07:03:02.521 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-03-27T07:03:02.521 INFO:teuthology.orchestra.run.smithi082.stdout:Total 9.0 MB/s | 76 MB 00:08 2024-03-27T07:03:03.187 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-03-27T07:03:03.565 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-03-27T07:03:03.565 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-03-27T07:03:04.557 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-03-27T07:03:04.557 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-03-27T07:03:07.015 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-03-27T07:03:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-core-5.14.0-432.el9.x86_64 1/4 2024-03-27T07:03:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-27T07:03:10.630 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-27T07:03:10.773 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-27T07:03:15.456 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-27T07:03:15.498 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : kernel-5.14.0-432.el9.x86_64 4/4 2024-03-27T07:03:20.242 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-27T07:03:49.362 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 4/4 2024-03-27T07:03:49.362 INFO:teuthology.orchestra.run.smithi082.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-27T07:03:49.362 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:03:49.406 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 4/4 2024-03-27T07:03:49.835 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: kernel-5.14.0-432.el9.x86_64 4/4 2024-03-27T07:03:49.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-5.14.0-432.el9.x86_64 1/4 2024-03-27T07:03:49.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-27T07:03:49.835 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-27T07:03:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-27T07:03:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:03:50.254 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-03-27T07:03:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-5.14.0-432.el9.x86_64 2024-03-27T07:03:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-core-5.14.0-432.el9.x86_64 2024-03-27T07:03:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-5.14.0-432.el9.x86_64 2024-03-27T07:03:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: kernel-modules-core-5.14.0-432.el9.x86_64 2024-03-27T07:03:50.254 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:03:50.254 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-03-27T07:03:50.586 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-03-27T07:03:50.729 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-27T07:03:50.729 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-27T07:03:50.729 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-432.el9.x86_64 2024-03-27T07:03:50.729 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-27T07:03:50.729 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-27T07:03:50.730 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-03-27T07:03:50.730 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=None, version=distro) 2024-03-27T07:03:50.730 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q kernel | sort -rV | head -n 1 2024-03-27T07:03:50.809 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-27T07:03:50.810 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-27T07:03:50.810 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-03-27T07:03:50.849 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-03-27T07:03:50.850 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-03-27T07:03:50.850 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-03-27T07:03:50.850 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 68.el9 2024-03-27T07:03:50.850 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-03-27T07:03:50.850 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-27T07:03:50.850 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-03-27T07:03:50.850 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8264254 2024-03-27T07:03:50.850 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-03-27T07:03:50.850 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-27T07:03:50.850 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:03:50.851 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-03-27T07:03:50.852 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-27T07:03:50.852 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 5.14.0-432.el9.x86_64 2024-03-27T07:03:50.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-27T07:03:51.512 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-03-27T07:03:52.860 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-27T07:03:52.893 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-03-27T07:03:52.895 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-03-27T07:03:52.910 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.aYHhpMjF2I 2024-03-27T07:03:52.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aYHhpMjF2I 2024-03-27T07:03:52.979 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.aYHhpMjF2I 2024-03-27T07:03:53.117 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.aYHhpMjF2I is 6KB 2024-03-27T07:03:53.166 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.aYHhpMjF2I 2024-03-27T07:03:53.181 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-03-27T07:03:53.244 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-27T07:03:53.245 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-27T07:03:53.245 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-27T07:03:53.245 INFO:teuthology.orchestra.run.smithi082.stdout:15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64.conf 2024-03-27T07:03:53.246 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64 2024-03-27T07:03:53.402 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-03-27T07:04:23.404 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-27T07:04:23.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-27T07:04:23.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T07:04:41.758 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-27T07:04:50.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-27T07:04:50.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T07:04:53.823 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-27T07:05:05.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-27T07:05:05.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T07:05:24.254 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-03-27T07:05:39.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-27T07:05:39.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T07:05:39.574 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-03-27T07:05:39.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-27T07:05:39.970 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-432.el9.x86_64"... 2024-03-27T07:05:39.971 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-03-27T07:05:39.985 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-432.el9.x86_64 2024-03-27T07:05:39.985 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-432.el9.x86_64 vs 5.14.0-432.el9.x86_64 2024-03-27T07:05:39.985 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-27T07:05:39.985 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-27T07:05:40.986 DEBUG:teuthology.parallel:result is None 2024-03-27T07:05:40.987 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-27T07:05:40.995 INFO:teuthology.task.internal:Creating test directory... 2024-03-27T07:05:40.995 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-27T07:05:40.998 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-27T07:05:41.001 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-27T07:05:41.019 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-27T07:05:41.069 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-27T07:05:41.115 INFO:teuthology.task.internal:Creating archive directory... 2024-03-27T07:05:41.116 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-27T07:05:41.118 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-27T07:05:41.120 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-27T07:05:41.227 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-27T07:05:41.234 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-27T07:05:41.234 DEBUG:teuthology.orchestra.run.smithi149:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-27T07:05:41.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T07:05:41.250 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-27T07:05:41.266 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T07:05:41.267 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-27T07:05:41.269 DEBUG:teuthology.orchestra.run.smithi149:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-27T07:05:41.293 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-27T07:05:41.334 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T07:05:41.348 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T07:05:41.351 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T07:05:41.372 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T07:05:41.382 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T07:05:41.388 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T07:05:41.390 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-27T07:05:41.398 INFO:teuthology.task.internal:Configuring sudo... 2024-03-27T07:05:41.399 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-27T07:05:41.401 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-27T07:05:41.404 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-27T07:05:41.454 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-27T07:05:41.527 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-27T07:05:41.527 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-27T07:05:41.529 DEBUG:teuthology.orchestra.run.smithi149:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-27T07:05:41.531 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-27T07:05:41.547 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T07:05:41.620 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T07:05:41.665 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T07:05:41.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T07:05:41.781 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:05:41.781 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-27T07:05:41.845 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T07:05:41.887 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T07:05:41.943 DEBUG:teuthology.orchestra.run.smithi149:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T07:05:42.026 DEBUG:teuthology.orchestra.run.smithi149:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T07:05:42.070 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:05:42.070 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-27T07:05:42.138 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T07:05:42.184 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T07:05:42.239 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T07:05:42.325 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T07:05:42.369 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:05:42.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-27T07:05:42.438 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-03-27T07:05:42.440 DEBUG:teuthology.orchestra.run.smithi149:> sudo service rsyslog restart 2024-03-27T07:05:42.442 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-03-27T07:05:42.489 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T07:05:42.516 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T07:05:42.520 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T07:05:42.919 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-27T07:05:42.927 INFO:teuthology.task.internal:Starting timer... 2024-03-27T07:05:42.927 INFO:teuthology.run_tasks:Running task pcp... 2024-03-27T07:05:42.978 INFO:teuthology.run_tasks:Running task selinux... 2024-03-27T07:05:43.039 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-03-27T07:05:43.040 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-03-27T07:05:43.118 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-03-27T07:05:43.120 DEBUG:teuthology.orchestra.run.smithi149:> sudo service auditd rotate 2024-03-27T07:05:43.177 INFO:teuthology.orchestra.run.smithi149.stdout:Rotating logs: 2024-03-27T07:05:43.179 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-03-27T07:05:43.253 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-03-27T07:05:43.254 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-27T07:05:43.255 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-03-27T07:05:43.292 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-03-27T07:05:43.292 DEBUG:teuthology.orchestra.run.smithi149:> /usr/sbin/getenforce 2024-03-27T07:05:43.311 INFO:teuthology.orchestra.run.smithi149.stdout:Permissive 2024-03-27T07:05:43.311 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-03-27T07:05:43.334 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-03-27T07:05:43.335 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi149.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2024-03-27T07:05:43.335 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T07:05:43.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T07:05:43.363 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T07:05:43.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T07:05:43.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T07:05:43.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T07:05:43.423 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-27T07:05:43.423 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-03-27T07:05:43.761 DEBUG:teuthology.orchestra.run.smithi149:> sudo /usr/sbin/setenforce permissive 2024-03-27T07:05:43.804 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-03-27T07:05:43.854 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-27T07:05:43.864 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-27T07:05:43.881 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-27T07:05:43.882 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi149.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-27T07:10:34.452 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi149.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-03-27T07:10:34.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-27T07:10:34.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T07:10:34.542 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-03-27T07:10:34.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-03-27T07:10:34.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-27T07:10:34.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T07:10:34.717 DEBUG:teuthology.orchestra.run.smithi149:> true 2024-03-27T07:10:34.790 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2024-03-27T07:10:34.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-27T07:10:34.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T07:10:34.879 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-03-27T07:10:34.945 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-03-27T07:10:34.945 INFO:teuthology.run_tasks:Running task clock... 2024-03-27T07:10:34.955 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-27T07:10:34.956 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-27T07:10:34.956 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T07:10:34.959 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-27T07:10:34.959 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T07:10:34.961 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-27T07:10:34.961 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T07:10:34.990 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-27T07:10:34.991 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-27T07:10:35.008 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-27T07:10:35.008 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-27T07:10:35.017 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-27T07:10:35.034 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-27T07:10:35.037 INFO:teuthology.orchestra.run.smithi149.stderr:sudo: ntpd: command not found 2024-03-27T07:10:35.038 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-03-27T07:10:35.051 INFO:teuthology.orchestra.run.smithi149.stdout:506 Cannot talk to daemon 2024-03-27T07:10:35.052 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-03-27T07:10:35.064 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-03-27T07:10:35.067 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-27T07:10:35.069 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-27T07:10:35.078 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-03-27T07:10:35.084 INFO:teuthology.orchestra.run.smithi149.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-27T07:10:35.085 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-27T07:10:35.095 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-27T07:10:35.111 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-27T07:10:35.128 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-03-27T07:10:35.132 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T07:10:35.132 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-03-27T07:10:35.132 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.132 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.132 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.132 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.137 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-03-27T07:10:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T07:10:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-03-27T07:10:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.155 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-03-27T07:10:35.158 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T07:10:35.158 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-03-27T07:10:35.158 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.158 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.159 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.159 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T07:10:35.159 INFO:teuthology.run_tasks:Running task install... 2024-03-27T07:10:35.167 DEBUG:teuthology.task.install:project ceph 2024-03-27T07:10:35.167 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0'}} 2024-03-27T07:10:35.168 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0'} 2024-03-27T07:10:35.168 INFO:teuthology.task.install:Using flavor: default 2024-03-27T07:10:35.173 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-27T07:10:35.174 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-27T07:10:35.174 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'tag': None, 'wait_for_package': False} 2024-03-27T07:10:35.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:10:35.176 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'tag': None, 'wait_for_package': False} 2024-03-27T07:10:35.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:10:35.178 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'tag': None, 'wait_for_package': False} 2024-03-27T07:10:35.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:10:35.329 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/ 2024-03-27T07:10:35.329 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2478.g155268c4 2024-03-27T07:10:35.406 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/ 2024-03-27T07:10:35.407 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2478.g155268c4 2024-03-27T07:10:35.414 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/ 2024-03-27T07:10:35.414 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2478.g155268c4 2024-03-27T07:10:35.449 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-27T07:10:35.449 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:10:35.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-27T07:10:35.478 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-27T07:10:35.478 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/155268c4e432a12433aa833f174f9fe3b1016ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-27T07:10:35.516 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-27T07:10:35.516 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:10:35.516 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-27T07:10:35.543 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-27T07:10:35.544 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/155268c4e432a12433aa833f174f9fe3b1016ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-27T07:10:35.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-27T07:10:35.549 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-27T07:10:35.549 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:10:35.549 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-27T07:10:35.577 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-27T07:10:35.577 DEBUG:teuthology.orchestra.run.smithi149:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/155268c4e432a12433aa833f174f9fe3b1016ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-27T07:10:35.614 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-27T07:10:35.627 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-27T07:10:35.645 DEBUG:teuthology.orchestra.run.smithi149:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-27T07:10:35.694 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-27T07:10:35.696 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-03-27T07:10:35.696 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-03-27T07:10:35.726 DEBUG:teuthology.orchestra.run.smithi149:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-27T07:10:35.760 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-03-27T07:10:35.762 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-03-27T07:10:35.793 INFO:teuthology.orchestra.run.smithi149.stdout:check_obsoletes = 1 2024-03-27T07:10:35.795 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum clean all 2024-03-27T07:10:35.930 INFO:teuthology.orchestra.run.smithi153.stdout:74 files removed 2024-03-27T07:10:35.957 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-27T07:10:36.004 INFO:teuthology.orchestra.run.smithi082.stdout:74 files removed 2024-03-27T07:10:36.030 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-27T07:10:36.031 INFO:teuthology.orchestra.run.smithi149.stdout:74 files removed 2024-03-27T07:10:36.057 DEBUG:teuthology.orchestra.run.smithi149:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-27T07:10:36.776 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 158 kB/s | 83 kB 00:00 2024-03-27T07:10:36.793 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 179 kB/s | 83 kB 00:00 2024-03-27T07:10:36.933 INFO:teuthology.orchestra.run.smithi149.stdout:ceph packages for x86_64 145 kB/s | 83 kB 00:00 2024-03-27T07:10:37.092 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 42 kB/s | 12 kB 00:00 2024-03-27T07:10:37.244 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-03-27T07:10:37.292 INFO:teuthology.orchestra.run.smithi149.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-03-27T07:10:37.551 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-03-27T07:10:37.620 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-03-27T07:10:37.751 INFO:teuthology.orchestra.run.smithi149.stdout:ceph source packages 4.4 kB/s | 1.9 kB 00:00 2024-03-27T07:10:38.021 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-27T07:10:38.080 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-27T07:10:38.737 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - AppStream 7.0 MB/s | 6.7 MB 00:00 2024-03-27T07:10:39.472 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-03-27T07:10:39.521 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2024-03-27T07:10:40.187 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2024-03-27T07:10:40.296 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-03-27T07:10:40.738 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.0 MB 00:00 2024-03-27T07:10:42.553 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.0 MB 00:02 2024-03-27T07:10:44.438 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 19 MB 00:03 2024-03-27T07:10:44.456 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-03-27T07:10:48.489 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-03-27T07:10:48.730 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.1 MB 00:00 2024-03-27T07:10:50.098 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-03-27T07:10:50.205 INFO:teuthology.orchestra.run.smithi149.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 16 kB 00:00 2024-03-27T07:10:50.891 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 30 MB/s | 21 MB 00:00 2024-03-27T07:10:51.868 INFO:teuthology.orchestra.run.smithi149.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-27T07:10:55.749 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-03-27T07:10:56.882 INFO:teuthology.orchestra.run.smithi149.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-03-27T07:10:58.105 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T07:10:58.106 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T07:10:58.123 INFO:teuthology.orchestra.run.smithi153.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-27T07:10:58.123 INFO:teuthology.orchestra.run.smithi153.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-27T07:10:58.123 INFO:teuthology.orchestra.run.smithi153.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-27T07:10:58.123 INFO:teuthology.orchestra.run.smithi153.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-27T07:10:58.125 INFO:teuthology.orchestra.run.smithi153.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-27T07:10:58.128 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-27T07:10:58.129 INFO:teuthology.orchestra.run.smithi153.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-27T07:10:58.209 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-03-27T07:10:58.233 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2024-03-27T07:10:58.233 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-03-27T07:10:58.233 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2024-03-27T07:10:58.233 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-03-27T07:10:58.233 INFO:teuthology.orchestra.run.smithi153.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-27T07:10:58.233 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:19.0.0-2478.g155268c4.el9 ceph 6.6 k 2024-03-27T07:10:58.233 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.4 M 2024-03-27T07:10:58.233 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 890 k 2024-03-27T07:10:58.233 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2478.g155268c4.el9 ceph 145 k 2024-03-27T07:10:58.233 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:19.0.0-2478.g155268c4.el9 ceph 1.5 M 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 141 k 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 3.5 M 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 7.4 M 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 49 k 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 9.8 M 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:19.0.0-2478.g155268c4.el9 ceph 48 M 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 264 k 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 762 k 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 221 k 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell x86_64 2:19.0.0-2478.g155268c4.el9 ceph 27 k 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 18 k 2024-03-27T07:10:58.234 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 32 k 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 746 k 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 127 k 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:19.0.0-2478.g155268c4.el9 ceph 162 k 2024-03-27T07:10:58.235 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:19.0.0-2478.g155268c4.el9 ceph 320 k 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 298 k 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 99 k 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 85 k 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 170 k 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-27T07:10:58.236 INFO:teuthology.orchestra.run.smithi153.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.4 M 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-27T07:10:58.237 INFO:teuthology.orchestra.run.smithi153.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 21 M 2024-03-27T07:10:58.238 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 34 k 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:19.0.0-2478.g155268c4.el9 ceph 2.4 M 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 249 k 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:19.0.0-2478.g155268c4.el9 ceph 4.7 M 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 17 M 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 16 k 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:19.0.0-2478.g155268c4.el9 ceph 25 k 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-27T07:10:58.239 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:19.0.0-2478.g155268c4.el9 ceph 163 k 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 501 k 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.1 M 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-27T07:10:58.240 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-27T07:10:58.241 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 45 k 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 134 k 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-27T07:10:58.242 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-27T07:10:58.243 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-27T07:10:58.244 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-27T07:10:58.245 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-27T07:10:58.246 INFO:teuthology.orchestra.run.smithi153.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-27T07:10:58.247 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-27T07:10:58.247 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-27T07:10:58.247 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-03-27T07:10:58.247 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-27T07:10:58.247 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:10:58.247 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-03-27T07:10:58.247 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================================ 2024-03-27T07:10:58.247 INFO:teuthology.orchestra.run.smithi153.stdout:Install 150 Packages 2024-03-27T07:10:58.247 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 24 Packages 2024-03-27T07:10:58.247 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:10:58.248 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 227 M 2024-03-27T07:10:58.248 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-03-27T07:10:58.619 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-03-27T07:10:59.288 INFO:teuthology.orchestra.run.smithi149.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T07:10:59.289 INFO:teuthology.orchestra.run.smithi149.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T07:10:59.292 INFO:teuthology.orchestra.run.smithi153.stdout:(1/174): ceph-19.0.0-2478.g155268c4.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-03-27T07:10:59.302 INFO:teuthology.orchestra.run.smithi149.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-27T07:10:59.303 INFO:teuthology.orchestra.run.smithi149.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-27T07:10:59.304 INFO:teuthology.orchestra.run.smithi149.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-27T07:10:59.305 INFO:teuthology.orchestra.run.smithi149.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-27T07:10:59.307 INFO:teuthology.orchestra.run.smithi149.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-27T07:10:59.310 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-27T07:10:59.311 INFO:teuthology.orchestra.run.smithi149.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-27T07:10:59.391 INFO:teuthology.orchestra.run.smithi149.stdout:Dependencies resolved. 2024-03-27T07:10:59.411 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2024-03-27T07:10:59.411 INFO:teuthology.orchestra.run.smithi149.stdout: Package Arch Version Repository Size 2024-03-27T07:10:59.411 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2024-03-27T07:10:59.411 INFO:teuthology.orchestra.run.smithi149.stdout:Installing: 2024-03-27T07:10:59.411 INFO:teuthology.orchestra.run.smithi149.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-27T07:10:59.411 INFO:teuthology.orchestra.run.smithi149.stdout: ceph x86_64 2:19.0.0-2478.g155268c4.el9 ceph 6.6 k 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.4 M 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 890 k 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2478.g155268c4.el9 ceph 145 k 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr x86_64 2:19.0.0-2478.g155268c4.el9 ceph 1.5 M 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 141 k 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 3.5 M 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 7.4 M 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 49 k 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 9.8 M 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test x86_64 2:19.0.0-2478.g155268c4.el9 ceph 48 M 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 264 k 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 762 k 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 221 k 2024-03-27T07:10:59.412 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-shell x86_64 2:19.0.0-2478.g155268c4.el9 ceph 27 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 18 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 32 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 746 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 127 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-27T07:10:59.413 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs x86_64 2:19.0.0-2478.g155268c4.el9 ceph 162 k 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados x86_64 2:19.0.0-2478.g155268c4.el9 ceph 320 k 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 298 k 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 99 k 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 85 k 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 170 k 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrading: 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-27T07:10:59.414 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: librados2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.4 M 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-27T07:10:59.415 INFO:teuthology.orchestra.run.smithi149.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout:Installing dependencies: 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 21 M 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 34 k 2024-03-27T07:10:59.416 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds x86_64 2:19.0.0-2478.g155268c4.el9 ceph 2.4 M 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 249 k 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon x86_64 2:19.0.0-2478.g155268c4.el9 ceph 4.7 M 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 17 M 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 16 k 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux x86_64 2:19.0.0-2478.g155268c4.el9 ceph 25 k 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-27T07:10:59.417 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite x86_64 2:19.0.0-2478.g155268c4.el9 ceph 163 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 501 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.1 M 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-27T07:10:59.418 INFO:teuthology.orchestra.run.smithi149.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-27T07:10:59.419 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 45 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 134 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-27T07:10:59.420 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-27T07:10:59.421 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-27T07:10:59.422 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-27T07:10:59.423 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-27T07:10:59.424 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-27T07:10:59.425 INFO:teuthology.orchestra.run.smithi149.stdout:Installing weak dependencies: 2024-03-27T07:10:59.425 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-27T07:10:59.425 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:10:59.425 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction Summary 2024-03-27T07:10:59.425 INFO:teuthology.orchestra.run.smithi149.stdout:============================================================================================ 2024-03-27T07:10:59.425 INFO:teuthology.orchestra.run.smithi149.stdout:Install 150 Packages 2024-03-27T07:10:59.425 INFO:teuthology.orchestra.run.smithi149.stdout:Upgrade 24 Packages 2024-03-27T07:10:59.425 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:10:59.426 INFO:teuthology.orchestra.run.smithi149.stdout:Total download size: 227 M 2024-03-27T07:10:59.426 INFO:teuthology.orchestra.run.smithi149.stdout:Downloading Packages: 2024-03-27T07:10:59.801 INFO:teuthology.orchestra.run.smithi153.stdout:(2/174): ceph-fuse-19.0.0-2478.g155268c4.el9.x8 1.7 MB/s | 890 kB 00:00 2024-03-27T07:10:59.909 INFO:teuthology.orchestra.run.smithi153.stdout:(3/174): ceph-base-19.0.0-2478.g155268c4.el9.x8 5.3 MB/s | 5.4 MB 00:01 2024-03-27T07:10:59.935 INFO:teuthology.orchestra.run.smithi153.stdout:(4/174): ceph-immutable-object-cache-19.0.0-247 1.1 MB/s | 145 kB 00:00 2024-03-27T07:11:00.216 INFO:teuthology.orchestra.run.smithi149.stdout:(1/174): ceph-19.0.0-2478.g155268c4.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-03-27T07:11:00.235 INFO:teuthology.orchestra.run.smithi153.stdout:(5/174): ceph-mgr-19.0.0-2478.g155268c4.el9.x86 5.0 MB/s | 1.5 MB 00:00 2024-03-27T07:11:00.536 INFO:teuthology.orchestra.run.smithi153.stdout:(6/174): ceph-mds-19.0.0-2478.g155268c4.el9.x86 3.8 MB/s | 2.4 MB 00:00 2024-03-27T07:11:00.666 INFO:teuthology.orchestra.run.smithi149.stdout:(2/174): ceph-fuse-19.0.0-2478.g155268c4.el9.x8 1.9 MB/s | 890 kB 00:00 2024-03-27T07:11:00.779 INFO:teuthology.orchestra.run.smithi149.stdout:(3/174): ceph-immutable-object-cache-19.0.0-247 1.3 MB/s | 145 kB 00:00 2024-03-27T07:11:01.217 INFO:teuthology.orchestra.run.smithi149.stdout:(4/174): ceph-base-19.0.0-2478.g155268c4.el9.x8 4.1 MB/s | 5.4 MB 00:01 2024-03-27T07:11:01.284 INFO:teuthology.orchestra.run.smithi149.stdout:(5/174): ceph-mds-19.0.0-2478.g155268c4.el9.x86 4.6 MB/s | 2.4 MB 00:00 2024-03-27T07:11:01.386 INFO:teuthology.orchestra.run.smithi153.stdout:(7/174): ceph-mon-19.0.0-2478.g155268c4.el9.x86 4.1 MB/s | 4.7 MB 00:01 2024-03-27T07:11:01.526 INFO:teuthology.orchestra.run.smithi149.stdout:(6/174): ceph-mgr-19.0.0-2478.g155268c4.el9.x86 4.8 MB/s | 1.5 MB 00:00 2024-03-27T07:11:01.976 INFO:teuthology.orchestra.run.smithi149.stdout:(7/174): ceph-mon-19.0.0-2478.g155268c4.el9.x86 6.8 MB/s | 4.7 MB 00:00 2024-03-27T07:11:02.436 INFO:teuthology.orchestra.run.smithi153.stdout:(8/174): ceph-common-19.0.0-2478.g155268c4.el9. 5.8 MB/s | 21 MB 00:03 2024-03-27T07:11:02.544 INFO:teuthology.orchestra.run.smithi153.stdout:(9/174): ceph-selinux-19.0.0-2478.g155268c4.el9 233 kB/s | 25 kB 00:00 2024-03-27T07:11:02.645 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-03-27T07:11:03.518 INFO:teuthology.orchestra.run.smithi149.stdout:(8/174): ceph-radosgw-19.0.0-2478.g155268c4.el9 6.4 MB/s | 9.8 MB 00:01 2024-03-27T07:11:03.618 INFO:teuthology.orchestra.run.smithi149.stdout:(9/174): ceph-selinux-19.0.0-2478.g155268c4.el9 252 kB/s | 25 kB 00:00 2024-03-27T07:11:03.761 INFO:teuthology.orchestra.run.smithi153.stdout:(10/174): ceph-radosgw-19.0.0-2478.g155268c4.el 4.1 MB/s | 9.8 MB 00:02 2024-03-27T07:11:03.962 INFO:teuthology.orchestra.run.smithi153.stdout:(11/174): ceph-osd-19.0.0-2478.g155268c4.el9.x8 4.9 MB/s | 17 MB 00:03 2024-03-27T07:11:04.003 INFO:teuthology.orchestra.run.smithi153.stdout:(12/174): cephfs-mirror-19.0.0-2478.g155268c4.e 916 kB/s | 221 kB 00:00 2024-03-27T07:11:04.054 INFO:teuthology.orchestra.run.smithi153.stdout:(13/174): cephfs-shell-19.0.0-2478.g155268c4.el 295 kB/s | 27 kB 00:00 2024-03-27T07:11:04.112 INFO:teuthology.orchestra.run.smithi153.stdout:(14/174): libcephfs-devel-19.0.0-2478.g155268c4 292 kB/s | 32 kB 00:00 2024-03-27T07:11:04.221 INFO:teuthology.orchestra.run.smithi153.stdout:(15/174): libcephsqlite-19.0.0-2478.g155268c4.e 1.5 MB/s | 163 kB 00:00 2024-03-27T07:11:04.296 INFO:teuthology.orchestra.run.smithi153.stdout:(16/174): libcephfs2-19.0.0-2478.g155268c4.el9. 3.0 MB/s | 746 kB 00:00 2024-03-27T07:11:04.320 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-03-27T07:11:04.338 INFO:teuthology.orchestra.run.smithi153.stdout:(17/174): librados-devel-19.0.0-2478.g155268c4. 1.1 MB/s | 127 kB 00:00 2024-03-27T07:11:04.718 INFO:teuthology.orchestra.run.smithi149.stdout:(10/174): ceph-osd-19.0.0-2478.g155268c4.el9.x8 5.3 MB/s | 17 MB 00:03 2024-03-27T07:11:04.730 INFO:teuthology.orchestra.run.smithi153.stdout:(18/174): libradosstriper1-19.0.0-2478.g155268c 1.1 MB/s | 501 kB 00:00 2024-03-27T07:11:04.827 INFO:teuthology.orchestra.run.smithi149.stdout:(11/174): cephfs-mirror-19.0.0-2478.g155268c4.e 2.0 MB/s | 221 kB 00:00 2024-03-27T07:11:04.847 INFO:teuthology.orchestra.run.smithi153.stdout:(19/174): python3-ceph-argparse-19.0.0-2478.g15 387 kB/s | 45 kB 00:00 2024-03-27T07:11:04.910 INFO:teuthology.orchestra.run.smithi149.stdout:(12/174): cephfs-shell-19.0.0-2478.g155268c4.el 325 kB/s | 27 kB 00:00 2024-03-27T07:11:04.955 INFO:teuthology.orchestra.run.smithi153.stdout:(20/174): python3-ceph-common-19.0.0-2478.g1552 1.2 MB/s | 134 kB 00:00 2024-03-27T07:11:05.002 INFO:teuthology.orchestra.run.smithi149.stdout:(13/174): libcephfs-devel-19.0.0-2478.g155268c4 346 kB/s | 32 kB 00:00 2024-03-27T07:11:05.047 INFO:teuthology.orchestra.run.smithi153.stdout:(21/174): python3-cephfs-19.0.0-2478.g155268c4. 1.7 MB/s | 162 kB 00:00 2024-03-27T07:11:05.185 INFO:teuthology.orchestra.run.smithi149.stdout:(14/174): libcephfs2-19.0.0-2478.g155268c4.el9. 4.0 MB/s | 746 kB 00:00 2024-03-27T07:11:05.214 INFO:teuthology.orchestra.run.smithi153.stdout:(22/174): python3-rados-19.0.0-2478.g155268c4.e 1.9 MB/s | 320 kB 00:00 2024-03-27T07:11:05.269 INFO:teuthology.orchestra.run.smithi149.stdout:(15/174): libcephsqlite-19.0.0-2478.g155268c4.e 1.9 MB/s | 163 kB 00:00 2024-03-27T07:11:05.369 INFO:teuthology.orchestra.run.smithi149.stdout:(16/174): librados-devel-19.0.0-2478.g155268c4. 1.2 MB/s | 127 kB 00:00 2024-03-27T07:11:05.373 INFO:teuthology.orchestra.run.smithi153.stdout:(23/174): python3-rbd-19.0.0-2478.g155268c4.el9 1.8 MB/s | 298 kB 00:00 2024-03-27T07:11:05.481 INFO:teuthology.orchestra.run.smithi153.stdout:(24/174): python3-rgw-19.0.0-2478.g155268c4.el9 918 kB/s | 99 kB 00:00 2024-03-27T07:11:05.544 INFO:teuthology.orchestra.run.smithi149.stdout:(17/174): libradosstriper1-19.0.0-2478.g155268c 2.8 MB/s | 501 kB 00:00 2024-03-27T07:11:05.572 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-03-27T07:11:05.573 INFO:teuthology.orchestra.run.smithi153.stdout:(25/174): rbd-fuse-19.0.0-2478.g155268c4.el9.x8 930 kB/s | 85 kB 00:00 2024-03-27T07:11:06.116 INFO:teuthology.orchestra.run.smithi153.stdout:(26/174): librgw2-19.0.0-2478.g155268c4.el9.x86 2.9 MB/s | 5.1 MB 00:01 2024-03-27T07:11:06.216 INFO:teuthology.orchestra.run.smithi153.stdout:(27/174): rbd-nbd-19.0.0-2478.g155268c4.el9.x86 1.7 MB/s | 170 kB 00:00 2024-03-27T07:11:06.220 INFO:teuthology.orchestra.run.smithi149.stdout:(18/174): ceph-common-19.0.0-2478.g155268c4.el9 3.3 MB/s | 21 MB 00:06 2024-03-27T07:11:06.324 INFO:teuthology.orchestra.run.smithi153.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2478.g 313 kB/s | 34 kB 00:00 2024-03-27T07:11:06.328 INFO:teuthology.orchestra.run.smithi149.stdout:(19/174): python3-ceph-argparse-19.0.0-2478.g15 417 kB/s | 45 kB 00:00 2024-03-27T07:11:06.433 INFO:teuthology.orchestra.run.smithi153.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2478.g155268c 1.3 MB/s | 141 kB 00:00 2024-03-27T07:11:06.445 INFO:teuthology.orchestra.run.smithi149.stdout:(20/174): python3-ceph-common-19.0.0-2478.g1552 1.1 MB/s | 134 kB 00:00 2024-03-27T07:11:06.587 INFO:teuthology.orchestra.run.smithi149.stdout:(21/174): librgw2-19.0.0-2478.g155268c4.el9.x86 4.9 MB/s | 5.1 MB 00:01 2024-03-27T07:11:06.612 INFO:teuthology.orchestra.run.smithi149.stdout:(22/174): python3-cephfs-19.0.0-2478.g155268c4. 970 kB/s | 162 kB 00:00 2024-03-27T07:11:06.697 INFO:teuthology.orchestra.run.smithi149.stdout:(23/174): python3-rados-19.0.0-2478.g155268c4.e 2.9 MB/s | 320 kB 00:00 2024-03-27T07:11:06.721 INFO:teuthology.orchestra.run.smithi149.stdout:(24/174): python3-rbd-19.0.0-2478.g155268c4.el9 2.7 MB/s | 298 kB 00:00 2024-03-27T07:11:06.758 INFO:teuthology.orchestra.run.smithi153.stdout:(30/174): rbd-mirror-19.0.0-2478.g155268c4.el9. 2.6 MB/s | 3.1 MB 00:01 2024-03-27T07:11:06.788 INFO:teuthology.orchestra.run.smithi149.stdout:(25/174): python3-rgw-19.0.0-2478.g155268c4.el9 1.1 MB/s | 99 kB 00:00 2024-03-27T07:11:06.831 INFO:teuthology.orchestra.run.smithi149.stdout:(26/174): rbd-fuse-19.0.0-2478.g155268c4.el9.x8 783 kB/s | 85 kB 00:00 2024-03-27T07:11:06.931 INFO:teuthology.orchestra.run.smithi149.stdout:(27/174): rbd-nbd-19.0.0-2478.g155268c4.el9.x86 1.7 MB/s | 170 kB 00:00 2024-03-27T07:11:07.056 INFO:teuthology.orchestra.run.smithi149.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2478.g 271 kB/s | 34 kB 00:00 2024-03-27T07:11:07.190 INFO:teuthology.orchestra.run.smithi149.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2478.g155268c 1.0 MB/s | 141 kB 00:00 2024-03-27T07:11:07.382 INFO:teuthology.orchestra.run.smithi149.stdout:(30/174): rbd-mirror-19.0.0-2478.g155268c4.el9. 5.2 MB/s | 3.1 MB 00:00 2024-03-27T07:11:07.774 INFO:teuthology.orchestra.run.smithi149.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2478.g15526 6.1 MB/s | 3.5 MB 00:00 2024-03-27T07:11:07.800 INFO:teuthology.orchestra.run.smithi153.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2478.g15526 2.6 MB/s | 3.5 MB 00:01 2024-03-27T07:11:07.899 INFO:teuthology.orchestra.run.smithi149.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2478.g15 1.9 MB/s | 249 kB 00:00 2024-03-27T07:11:07.925 INFO:teuthology.orchestra.run.smithi153.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2478.g15 1.9 MB/s | 249 kB 00:00 2024-03-27T07:11:08.016 INFO:teuthology.orchestra.run.smithi149.stdout:(33/174): ceph-mgr-rook-19.0.0-2478.g155268c4.e 423 kB/s | 49 kB 00:00 2024-03-27T07:11:08.025 INFO:teuthology.orchestra.run.smithi153.stdout:(33/174): ceph-mgr-rook-19.0.0-2478.g155268c4.e 493 kB/s | 49 kB 00:00 2024-03-27T07:11:08.166 INFO:teuthology.orchestra.run.smithi149.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2478.g1 110 kB/s | 16 kB 00:00 2024-03-27T07:11:08.185 INFO:teuthology.orchestra.run.smithi153.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2478.g1 104 kB/s | 16 kB 00:00 2024-03-27T07:11:08.283 INFO:teuthology.orchestra.run.smithi149.stdout:(35/174): ceph-volume-19.0.0-2478.g155268c4.el9 2.2 MB/s | 264 kB 00:00 2024-03-27T07:11:08.368 INFO:teuthology.orchestra.run.smithi153.stdout:(35/174): ceph-volume-19.0.0-2478.g155268c4.el9 1.4 MB/s | 264 kB 00:00 2024-03-27T07:11:08.466 INFO:teuthology.orchestra.run.smithi149.stdout:(36/174): cephadm-19.0.0-2478.g155268c4.el9.noa 4.1 MB/s | 762 kB 00:00 2024-03-27T07:11:08.575 INFO:teuthology.orchestra.run.smithi149.stdout:(37/174): cephfs-top-19.0.0-2478.g155268c4.el9. 169 kB/s | 18 kB 00:00 2024-03-27T07:11:08.635 INFO:teuthology.orchestra.run.smithi153.stdout:(36/174): cephadm-19.0.0-2478.g155268c4.el9.noa 2.8 MB/s | 762 kB 00:00 2024-03-27T07:11:08.700 INFO:teuthology.orchestra.run.smithi149.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 5.2 MB/s | 662 kB 00:00 2024-03-27T07:11:08.744 INFO:teuthology.orchestra.run.smithi153.stdout:(37/174): cephfs-top-19.0.0-2478.g155268c4.el9. 168 kB/s | 18 kB 00:00 2024-03-27T07:11:08.784 INFO:teuthology.orchestra.run.smithi149.stdout:(39/174): ceph-mgr-diskprediction-local-19.0.0- 5.3 MB/s | 7.4 MB 00:01 2024-03-27T07:11:08.826 INFO:teuthology.orchestra.run.smithi149.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 7.2 MB/s | 920 kB 00:00 2024-03-27T07:11:08.851 INFO:teuthology.orchestra.run.smithi149.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-03-27T07:11:08.876 INFO:teuthology.orchestra.run.smithi149.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-03-27T07:11:08.893 INFO:teuthology.orchestra.run.smithi149.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 767 kB/s | 32 kB 00:00 2024-03-27T07:11:08.911 INFO:teuthology.orchestra.run.smithi153.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 662 kB 00:00 2024-03-27T07:11:08.985 INFO:teuthology.orchestra.run.smithi149.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-03-27T07:11:08.994 INFO:teuthology.orchestra.run.smithi153.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 920 kB 00:00 2024-03-27T07:11:09.002 INFO:teuthology.orchestra.run.smithi149.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 158 kB/s | 17 kB 00:00 2024-03-27T07:11:09.019 INFO:teuthology.orchestra.run.smithi149.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 302 kB/s | 10 kB 00:00 2024-03-27T07:11:09.037 INFO:teuthology.orchestra.run.smithi153.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-03-27T07:11:09.044 INFO:teuthology.orchestra.run.smithi149.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-03-27T07:11:09.061 INFO:teuthology.orchestra.run.smithi149.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-27T07:11:09.095 INFO:teuthology.orchestra.run.smithi153.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2024-03-27T07:11:09.103 INFO:teuthology.orchestra.run.smithi149.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-27T07:11:09.137 INFO:teuthology.orchestra.run.smithi149.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2024-03-27T07:11:09.162 INFO:teuthology.orchestra.run.smithi149.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 806 kB/s | 46 kB 00:00 2024-03-27T07:11:09.196 INFO:teuthology.orchestra.run.smithi149.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-03-27T07:11:09.204 INFO:teuthology.orchestra.run.smithi153.stdout:(42/174): ceph-mgr-diskprediction-local-19.0.0- 3.0 MB/s | 7.4 MB 00:02 2024-03-27T07:11:09.221 INFO:teuthology.orchestra.run.smithi149.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-03-27T07:11:09.229 INFO:teuthology.orchestra.run.smithi153.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 236 kB/s | 32 kB 00:00 2024-03-27T07:11:09.246 INFO:teuthology.orchestra.run.smithi149.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-03-27T07:11:09.263 INFO:teuthology.orchestra.run.smithi149.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 828 kB/s | 34 kB 00:00 2024-03-27T07:11:09.302 INFO:teuthology.orchestra.run.smithi153.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 238 kB/s | 17 kB 00:00 2024-03-27T07:11:09.378 INFO:teuthology.orchestra.run.smithi153.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-03-27T07:11:09.403 INFO:teuthology.orchestra.run.smithi153.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 101 kB/s | 10 kB 00:00 2024-03-27T07:11:09.437 INFO:teuthology.orchestra.run.smithi153.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-27T07:11:09.462 INFO:teuthology.orchestra.run.smithi153.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 748 kB/s | 44 kB 00:00 2024-03-27T07:11:09.472 INFO:teuthology.orchestra.run.smithi149.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2024-03-27T07:11:09.496 INFO:teuthology.orchestra.run.smithi153.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-27T07:11:09.506 INFO:teuthology.orchestra.run.smithi149.stdout:(57/174): protobuf-3.14.0-13.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2024-03-27T07:11:09.530 INFO:teuthology.orchestra.run.smithi153.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 578 kB 00:00 2024-03-27T07:11:09.533 INFO:teuthology.orchestra.run.smithi149.stdout:(58/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-27T07:11:09.558 INFO:teuthology.orchestra.run.smithi153.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 805 kB/s | 46 kB 00:00 2024-03-27T07:11:09.580 INFO:teuthology.orchestra.run.smithi153.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-27T07:11:09.622 INFO:teuthology.orchestra.run.smithi153.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2024-03-27T07:11:09.690 INFO:teuthology.orchestra.run.smithi149.stdout:(59/174): python3-babel-2.9.1-2.el9.noarch.rpm 32 MB/s | 5.8 MB 00:00 2024-03-27T07:11:09.715 INFO:teuthology.orchestra.run.smithi149.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 135 kB/s | 24 kB 00:00 2024-03-27T07:11:09.731 INFO:teuthology.orchestra.run.smithi153.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2024-03-27T07:11:09.748 INFO:teuthology.orchestra.run.smithi153.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 273 kB/s | 34 kB 00:00 2024-03-27T07:11:09.757 INFO:teuthology.orchestra.run.smithi149.stdout:(61/174): python3-jsonpointer-2.0-4.el9.noarch. 436 kB/s | 18 kB 00:00 2024-03-27T07:11:09.782 INFO:teuthology.orchestra.run.smithi149.stdout:(62/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2024-03-27T07:11:09.807 INFO:teuthology.orchestra.run.smithi149.stdout:(63/174): python3-markupsafe-1.1.1-12.el9.x86_6 635 kB/s | 32 kB 00:00 2024-03-27T07:11:09.815 INFO:teuthology.orchestra.run.smithi153.stdout:(56/174): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-03-27T07:11:09.923 INFO:teuthology.orchestra.run.smithi153.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-03-27T07:11:09.949 INFO:teuthology.orchestra.run.smithi153.stdout:(58/174): python3-attrs-20.3.0-7.el9.noarch.rpm 596 kB/s | 78 kB 00:00 2024-03-27T07:11:10.058 INFO:teuthology.orchestra.run.smithi149.stdout:(64/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2024-03-27T07:11:10.083 INFO:teuthology.orchestra.run.smithi149.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 790 kB/s | 217 kB 00:00 2024-03-27T07:11:10.103 INFO:teuthology.orchestra.run.smithi149.stdout:(66/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 174 kB 00:00 2024-03-27T07:11:10.128 INFO:teuthology.orchestra.run.smithi149.stdout:(67/174): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 69 kB 00:00 2024-03-27T07:11:10.145 INFO:teuthology.orchestra.run.smithi149.stdout:(68/174): python3-prettytable-0.7.2-27.el9.noar 989 kB/s | 41 kB 00:00 2024-03-27T07:11:10.159 INFO:teuthology.orchestra.run.smithi153.stdout:(59/174): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 5.8 MB 00:00 2024-03-27T07:11:10.171 INFO:teuthology.orchestra.run.smithi149.stdout:(69/174): python3-protobuf-3.14.0-13.el9.noarch 5.5 MB/s | 238 kB 00:00 2024-03-27T07:11:10.182 INFO:teuthology.orchestra.run.smithi153.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 104 kB/s | 24 kB 00:00 2024-03-27T07:11:10.196 INFO:teuthology.orchestra.run.smithi149.stdout:(70/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-27T07:11:10.208 INFO:teuthology.orchestra.run.smithi153.stdout:(61/174): python3-jsonpointer-2.0-4.el9.noarch. 373 kB/s | 18 kB 00:00 2024-03-27T07:11:10.221 INFO:teuthology.orchestra.run.smithi149.stdout:(71/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-27T07:11:10.233 INFO:teuthology.orchestra.run.smithi153.stdout:(62/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-27T07:11:10.238 INFO:teuthology.orchestra.run.smithi149.stdout:(72/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-27T07:11:10.255 INFO:teuthology.orchestra.run.smithi149.stdout:(73/174): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-03-27T07:11:10.258 INFO:teuthology.orchestra.run.smithi153.stdout:(63/174): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2024-03-27T07:11:10.401 INFO:teuthology.orchestra.run.smithi153.stdout:(64/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2024-03-27T07:11:10.434 INFO:teuthology.orchestra.run.smithi153.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-03-27T07:11:10.459 INFO:teuthology.orchestra.run.smithi153.stdout:(66/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 174 kB 00:00 2024-03-27T07:11:10.485 INFO:teuthology.orchestra.run.smithi153.stdout:(67/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-27T07:11:10.510 INFO:teuthology.orchestra.run.smithi153.stdout:(68/174): python3-prettytable-0.7.2-27.el9.noar 822 kB/s | 41 kB 00:00 2024-03-27T07:11:10.514 INFO:teuthology.orchestra.run.smithi149.stdout:(74/174): python3-toml-0.10.2-6.el9.noarch.rpm 150 kB/s | 39 kB 00:00 2024-03-27T07:11:10.535 INFO:teuthology.orchestra.run.smithi153.stdout:(69/174): python3-protobuf-3.14.0-13.el9.noarch 4.7 MB/s | 238 kB 00:00 2024-03-27T07:11:10.561 INFO:teuthology.orchestra.run.smithi153.stdout:(70/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-27T07:11:10.586 INFO:teuthology.orchestra.run.smithi153.stdout:(71/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-27T07:11:10.611 INFO:teuthology.orchestra.run.smithi153.stdout:(72/174): python3-pytz-2021.1-5.el9.noarch.rpm 951 kB/s | 47 kB 00:00 2024-03-27T07:11:10.636 INFO:teuthology.orchestra.run.smithi153.stdout:(73/174): python3-requests-oauthlib-1.3.0-12.el 854 kB/s | 43 kB 00:00 2024-03-27T07:11:10.646 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 5.3 kB/s | 1.7 kB 00:00 2024-03-27T07:11:10.739 INFO:teuthology.orchestra.run.smithi149.stdout:(75/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-03-27T07:11:10.756 INFO:teuthology.orchestra.run.smithi149.stdout:(76/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 171 kB/s | 41 kB 00:00 2024-03-27T07:11:10.807 INFO:teuthology.orchestra.run.smithi149.stdout:(77/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 300 kB 00:00 2024-03-27T07:11:10.812 INFO:teuthology.orchestra.run.smithi153.stdout:(74/174): python3-toml-0.10.2-6.el9.noarch.rpm 223 kB/s | 39 kB 00:00 2024-03-27T07:11:10.832 INFO:teuthology.orchestra.run.smithi149.stdout:(78/174): uuid-1.6.2-55.el9.x86_64.rpm 749 kB/s | 56 kB 00:00 2024-03-27T07:11:10.857 INFO:teuthology.orchestra.run.smithi149.stdout:(79/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-27T07:11:10.874 INFO:teuthology.orchestra.run.smithi149.stdout:(80/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-27T07:11:10.916 INFO:teuthology.orchestra.run.smithi149.stdout:(81/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-27T07:11:10.941 INFO:teuthology.orchestra.run.smithi149.stdout:(82/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-03-27T07:11:10.975 INFO:teuthology.orchestra.run.smithi149.stdout:(83/174): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-03-27T07:11:11.000 INFO:teuthology.orchestra.run.smithi149.stdout:(84/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-27T07:11:11.034 INFO:teuthology.orchestra.run.smithi149.stdout:(85/174): python3-pycparser-2.20-6.el9.noarch.r 2.1 MB/s | 124 kB 00:00 2024-03-27T07:11:11.045 INFO:teuthology.orchestra.run.smithi153.stdout:(75/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-03-27T07:11:11.059 INFO:teuthology.orchestra.run.smithi149.stdout:(86/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 187 kB 00:00 2024-03-27T07:11:11.070 INFO:teuthology.orchestra.run.smithi153.stdout:(76/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 161 kB/s | 41 kB 00:00 2024-03-27T07:11:11.096 INFO:teuthology.orchestra.run.smithi153.stdout:(77/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2024-03-27T07:11:11.121 INFO:teuthology.orchestra.run.smithi153.stdout:(78/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-27T07:11:11.146 INFO:teuthology.orchestra.run.smithi153.stdout:(79/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-27T07:11:11.172 INFO:teuthology.orchestra.run.smithi153.stdout:(80/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 878 kB/s | 44 kB 00:00 2024-03-27T07:11:11.197 INFO:teuthology.orchestra.run.smithi153.stdout:(81/174): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-27T07:11:11.222 INFO:teuthology.orchestra.run.smithi153.stdout:(82/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-27T07:11:11.256 INFO:teuthology.orchestra.run.smithi153.stdout:(83/174): python3-cryptography-36.0.1-4.el9.x86 20 MB/s | 1.1 MB 00:00 2024-03-27T07:11:11.282 INFO:teuthology.orchestra.run.smithi153.stdout:(84/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-27T07:11:11.307 INFO:teuthology.orchestra.run.smithi153.stdout:(85/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-27T07:11:11.332 INFO:teuthology.orchestra.run.smithi153.stdout:(86/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-03-27T07:11:11.491 INFO:teuthology.orchestra.run.smithi153.stdout:(87/174): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-03-27T07:11:11.583 INFO:teuthology.orchestra.run.smithi153.stdout:(88/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-03-27T07:11:11.591 INFO:teuthology.orchestra.run.smithi149.stdout:(87/174): ceph-test-19.0.0-2478.g155268c4.el9.x 6.0 MB/s | 48 MB 00:07 2024-03-27T07:11:11.616 INFO:teuthology.orchestra.run.smithi153.stdout:(89/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-03-27T07:11:11.642 INFO:teuthology.orchestra.run.smithi153.stdout:(90/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-03-27T07:11:11.693 INFO:teuthology.orchestra.run.smithi149.stdout:(88/174): jq-1.6-16.el9.x86_64.rpm 284 kB/s | 187 kB 00:00 2024-03-27T07:11:11.718 INFO:teuthology.orchestra.run.smithi149.stdout:(89/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-03-27T07:11:11.744 INFO:teuthology.orchestra.run.smithi149.stdout:(90/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-03-27T07:11:11.769 INFO:teuthology.orchestra.run.smithi149.stdout:(91/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-03-27T07:11:11.817 INFO:teuthology.orchestra.run.smithi153.stdout:(91/174): elfutils-libelf-devel-0.190-2.el9.x86 107 kB/s | 21 kB 00:00 2024-03-27T07:11:11.842 INFO:teuthology.orchestra.run.smithi153.stdout:(92/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 127 kB/s | 25 kB 00:00 2024-03-27T07:11:11.944 INFO:teuthology.orchestra.run.smithi149.stdout:(92/174): elfutils-libelf-devel-0.190-2.el9.x86 95 kB/s | 21 kB 00:00 2024-03-27T07:11:11.993 INFO:teuthology.orchestra.run.smithi153.stdout:(93/174): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-03-27T07:11:11.994 INFO:teuthology.orchestra.run.smithi149.stdout:(93/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 102 kB/s | 25 kB 00:00 2024-03-27T07:11:12.054 INFO:teuthology.orchestra.run.smithi153.stdout:(94/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 18 MB/s | 4.1 MB 00:00 2024-03-27T07:11:12.087 INFO:teuthology.orchestra.run.smithi153.stdout:(95/174): postgresql-contrib-13.14-1.el9.x86_64 9.5 MB/s | 911 kB 00:00 2024-03-27T07:11:12.112 INFO:teuthology.orchestra.run.smithi153.stdout:(96/174): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-03-27T07:11:12.154 INFO:teuthology.orchestra.run.smithi153.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-03-27T07:11:12.246 INFO:teuthology.orchestra.run.smithi153.stdout:(98/174): postgresql-server-13.14-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-03-27T07:11:12.280 INFO:teuthology.orchestra.run.smithi153.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-03-27T07:11:12.305 INFO:teuthology.orchestra.run.smithi153.stdout:(100/174): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-03-27T07:11:12.330 INFO:teuthology.orchestra.run.smithi153.stdout:(101/174): qatlib-service-24.02.0-1.el9.x86_64. 716 kB/s | 36 kB 00:00 2024-03-27T07:11:12.364 INFO:teuthology.orchestra.run.smithi153.stdout:(102/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 804 kB/s | 47 kB 00:00 2024-03-27T07:11:12.390 INFO:teuthology.orchestra.run.smithi153.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-03-27T07:11:12.411 INFO:teuthology.orchestra.run.smithi149.stdout:(94/174): postgresql-contrib-13.14-1.el9.x86_64 2.3 MB/s | 911 kB 00:00 2024-03-27T07:11:12.453 INFO:teuthology.orchestra.run.smithi149.stdout:(95/174): postgresql-13.14-1.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-03-27T07:11:12.473 INFO:teuthology.orchestra.run.smithi153.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-03-27T07:11:12.590 INFO:teuthology.orchestra.run.smithi153.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.2 MB/s | 863 kB 00:00 2024-03-27T07:11:12.654 INFO:teuthology.orchestra.run.smithi149.stdout:(96/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 5.0 MB/s | 4.1 MB 00:00 2024-03-27T07:11:12.712 INFO:teuthology.orchestra.run.smithi149.stdout:(97/174): postgresql-private-libs-13.14-1.el9.x 444 kB/s | 133 kB 00:00 2024-03-27T07:11:12.849 INFO:teuthology.orchestra.run.smithi153.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.4 MB/s | 548 kB 00:00 2024-03-27T07:11:12.924 INFO:teuthology.orchestra.run.smithi153.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-03-27T07:11:12.958 INFO:teuthology.orchestra.run.smithi153.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 841 kB/s | 309 kB 00:00 2024-03-27T07:11:12.971 INFO:teuthology.orchestra.run.smithi149.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 775 kB/s | 245 kB 00:00 2024-03-27T07:11:13.033 INFO:teuthology.orchestra.run.smithi153.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 347 kB/s | 26 kB 00:00 2024-03-27T07:11:13.079 INFO:teuthology.orchestra.run.smithi149.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 722 kB/s | 248 kB 00:00 2024-03-27T07:11:13.087 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T07:11:13.087 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T07:11:13.102 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-27T07:11:13.103 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-27T07:11:13.104 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-27T07:11:13.105 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-27T07:11:13.107 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-27T07:11:13.108 INFO:teuthology.orchestra.run.smithi153.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 648 kB/s | 49 kB 00:00 2024-03-27T07:11:13.110 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-27T07:11:13.111 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-27T07:11:13.191 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-03-27T07:11:13.213 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-03-27T07:11:13.213 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-03-27T07:11:13.213 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-03-27T07:11:13.213 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-03-27T07:11:13.213 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-27T07:11:13.213 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-2478.g155268c4.el9 ceph 6.6 k 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.4 M 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 890 k 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2478.g155268c4.el9 ceph 145 k 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-2478.g155268c4.el9 ceph 1.5 M 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 141 k 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 3.5 M 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 7.4 M 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 49 k 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 9.8 M 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-2478.g155268c4.el9 ceph 48 M 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 264 k 2024-03-27T07:11:13.214 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 762 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 221 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-2478.g155268c4.el9 ceph 27 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 18 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 32 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 746 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 127 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-27T07:11:13.215 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-2478.g155268c4.el9 ceph 162 k 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-2478.g155268c4.el9 ceph 320 k 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 298 k 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 99 k 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 85 k 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 170 k 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-27T07:11:13.216 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.4 M 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T07:11:13.217 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-27T07:11:13.218 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 21 M 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 34 k 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-2478.g155268c4.el9 ceph 2.4 M 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 249 k 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-2478.g155268c4.el9 ceph 4.7 M 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 17 M 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 16 k 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-2478.g155268c4.el9 ceph 25 k 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-27T07:11:13.219 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-27T07:11:13.220 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-27T07:11:13.220 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-27T07:11:13.220 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-27T07:11:13.220 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-27T07:11:13.220 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-27T07:11:13.220 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-2478.g155268c4.el9 ceph 163 k 2024-03-27T07:11:13.220 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-27T07:11:13.220 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-27T07:11:13.221 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-27T07:11:13.221 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-27T07:11:13.221 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-27T07:11:13.221 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 501 k 2024-03-27T07:11:13.221 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-27T07:11:13.221 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.1 M 2024-03-27T07:11:13.222 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-27T07:11:13.222 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-27T07:11:13.222 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-27T07:11:13.222 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-27T07:11:13.222 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-27T07:11:13.222 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-27T07:11:13.223 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-27T07:11:13.223 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-27T07:11:13.223 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-27T07:11:13.223 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-27T07:11:13.223 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-27T07:11:13.223 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-27T07:11:13.224 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-27T07:11:13.224 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-27T07:11:13.224 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-27T07:11:13.224 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-27T07:11:13.224 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-27T07:11:13.224 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-27T07:11:13.224 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 45 k 2024-03-27T07:11:13.224 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 134 k 2024-03-27T07:11:13.225 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-27T07:11:13.225 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-27T07:11:13.225 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-27T07:11:13.225 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-27T07:11:13.225 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-27T07:11:13.225 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-27T07:11:13.225 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-27T07:11:13.226 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-27T07:11:13.226 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-27T07:11:13.226 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-27T07:11:13.226 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-27T07:11:13.226 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-27T07:11:13.226 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-27T07:11:13.226 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-27T07:11:13.226 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-27T07:11:13.229 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-27T07:11:13.229 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-27T07:11:13.229 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-27T07:11:13.229 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-27T07:11:13.229 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-27T07:11:13.230 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-27T07:11:13.230 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-27T07:11:13.230 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-27T07:11:13.230 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-27T07:11:13.230 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-27T07:11:13.231 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-27T07:11:13.231 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-27T07:11:13.231 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-27T07:11:13.231 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-27T07:11:13.231 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-27T07:11:13.231 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-27T07:11:13.231 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-27T07:11:13.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-27T07:11:13.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-27T07:11:13.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-27T07:11:13.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-27T07:11:13.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-27T07:11:13.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-27T07:11:13.232 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-27T07:11:13.233 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-03-27T07:11:13.234 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-27T07:11:13.235 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:11:13.235 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-03-27T07:11:13.235 INFO:teuthology.orchestra.run.smithi082.stdout:============================================================================================ 2024-03-27T07:11:13.235 INFO:teuthology.orchestra.run.smithi082.stdout:Install 150 Packages 2024-03-27T07:11:13.235 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 24 Packages 2024-03-27T07:11:13.235 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:11:13.236 INFO:teuthology.orchestra.run.smithi153.stdout:(111/174): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-03-27T07:11:13.236 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 227 M 2024-03-27T07:11:13.236 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-03-27T07:11:13.250 INFO:teuthology.orchestra.run.smithi153.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 474 kB/s | 67 kB 00:00 2024-03-27T07:11:13.293 INFO:teuthology.orchestra.run.smithi153.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-03-27T07:11:13.296 INFO:teuthology.orchestra.run.smithi149.stdout:(100/174): qatlib-service-24.02.0-1.el9.x86_64. 166 kB/s | 36 kB 00:00 2024-03-27T07:11:13.321 INFO:teuthology.orchestra.run.smithi149.stdout:(101/174): qatlib-24.02.0-1.el9.x86_64.rpm 630 kB/s | 221 kB 00:00 2024-03-27T07:11:13.376 INFO:teuthology.orchestra.run.smithi153.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-03-27T07:11:13.418 INFO:teuthology.orchestra.run.smithi153.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 838 kB 00:00 2024-03-27T07:11:13.443 INFO:teuthology.orchestra.run.smithi153.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 649 kB/s | 43 kB 00:00 2024-03-27T07:11:13.485 INFO:teuthology.orchestra.run.smithi153.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 480 kB/s | 32 kB 00:00 2024-03-27T07:11:13.511 INFO:teuthology.orchestra.run.smithi153.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2024-03-27T07:11:13.522 INFO:teuthology.orchestra.run.smithi149.stdout:(102/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 211 kB/s | 47 kB 00:00 2024-03-27T07:11:13.561 INFO:teuthology.orchestra.run.smithi153.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-03-27T07:11:13.586 INFO:teuthology.orchestra.run.smithi153.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-03-27T07:11:13.637 INFO:teuthology.orchestra.run.smithi153.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-03-27T07:11:13.647 INFO:teuthology.orchestra.run.smithi149.stdout:(103/174): postgresql-server-13.14-1.el9.x86_64 4.9 MB/s | 5.8 MB 00:01 2024-03-27T07:11:13.662 INFO:teuthology.orchestra.run.smithi153.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 469 kB/s | 35 kB 00:00 2024-03-27T07:11:13.664 INFO:teuthology.orchestra.run.smithi149.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-03-27T07:11:13.689 INFO:teuthology.orchestra.run.smithi149.stdout:(105/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 255 kB/s | 94 kB 00:00 2024-03-27T07:11:13.712 INFO:teuthology.orchestra.run.smithi153.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-03-27T07:11:13.779 INFO:teuthology.orchestra.run.smithi153.stdout:(124/174): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-03-27T07:11:13.804 INFO:teuthology.orchestra.run.smithi153.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-03-27T07:11:13.839 INFO:teuthology.orchestra.run.smithi149.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-03-27T07:11:13.846 INFO:teuthology.orchestra.run.smithi153.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-03-27T07:11:13.871 INFO:teuthology.orchestra.run.smithi153.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 264 kB/s | 18 kB 00:00 2024-03-27T07:11:13.905 INFO:teuthology.orchestra.run.smithi153.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 396 kB/s | 23 kB 00:00 2024-03-27T07:11:13.930 INFO:teuthology.orchestra.run.smithi153.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-03-27T07:11:13.975 INFO:teuthology.orchestra.run.smithi153.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 285 kB/s | 20 kB 00:00 2024-03-27T07:11:13.997 INFO:teuthology.orchestra.run.smithi082.stdout:(1/174): ceph-19.0.0-2478.g155268c4.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-03-27T07:11:14.042 INFO:teuthology.orchestra.run.smithi153.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 9.2 MB/s | 1.0 MB 00:00 2024-03-27T07:11:14.067 INFO:teuthology.orchestra.run.smithi153.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2024-03-27T07:11:14.089 INFO:teuthology.orchestra.run.smithi149.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2024-03-27T07:11:14.109 INFO:teuthology.orchestra.run.smithi153.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-03-27T07:11:14.132 INFO:teuthology.orchestra.run.smithi149.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-03-27T07:11:14.134 INFO:teuthology.orchestra.run.smithi153.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-03-27T07:11:14.157 INFO:teuthology.orchestra.run.smithi149.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 661 kB/s | 309 kB 00:00 2024-03-27T07:11:14.184 INFO:teuthology.orchestra.run.smithi153.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-27T07:11:14.199 INFO:teuthology.orchestra.run.smithi149.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-03-27T07:11:14.209 INFO:teuthology.orchestra.run.smithi153.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-03-27T07:11:14.224 INFO:teuthology.orchestra.run.smithi149.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 724 kB/s | 49 kB 00:00 2024-03-27T07:11:14.268 INFO:teuthology.orchestra.run.smithi153.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-03-27T07:11:14.274 INFO:teuthology.orchestra.run.smithi149.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 893 kB/s | 67 kB 00:00 2024-03-27T07:11:14.293 INFO:teuthology.orchestra.run.smithi153.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-03-27T07:11:14.316 INFO:teuthology.orchestra.run.smithi149.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-03-27T07:11:14.335 INFO:teuthology.orchestra.run.smithi153.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-03-27T07:11:14.369 INFO:teuthology.orchestra.run.smithi153.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-03-27T07:11:14.402 INFO:teuthology.orchestra.run.smithi153.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 884 kB/s | 59 kB 00:00 2024-03-27T07:11:14.416 INFO:teuthology.orchestra.run.smithi149.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.8 MB/s | 838 kB 00:00 2024-03-27T07:11:14.436 INFO:teuthology.orchestra.run.smithi153.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2024-03-27T07:11:14.458 INFO:teuthology.orchestra.run.smithi149.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-03-27T07:11:14.470 INFO:teuthology.orchestra.run.smithi153.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 762 kB/s | 51 kB 00:00 2024-03-27T07:11:14.492 INFO:teuthology.orchestra.run.smithi149.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 576 kB/s | 43 kB 00:00 2024-03-27T07:11:14.512 INFO:teuthology.orchestra.run.smithi153.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-27T07:11:14.534 INFO:teuthology.orchestra.run.smithi149.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 427 kB/s | 32 kB 00:00 2024-03-27T07:11:14.545 INFO:teuthology.orchestra.run.smithi153.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-27T07:11:14.596 INFO:teuthology.orchestra.run.smithi153.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-03-27T07:11:14.610 INFO:teuthology.orchestra.run.smithi149.stdout:(118/174): libarrow-9.0.0-10.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-03-27T07:11:14.621 INFO:teuthology.orchestra.run.smithi153.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-03-27T07:11:14.627 INFO:teuthology.orchestra.run.smithi149.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 111 kB/s | 15 kB 00:00 2024-03-27T07:11:14.652 INFO:teuthology.orchestra.run.smithi149.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-03-27T07:11:14.671 INFO:teuthology.orchestra.run.smithi153.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-27T07:11:14.694 INFO:teuthology.orchestra.run.smithi149.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-03-27T07:11:14.719 INFO:teuthology.orchestra.run.smithi149.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-03-27T07:11:14.738 INFO:teuthology.orchestra.run.smithi149.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 420 kB/s | 35 kB 00:00 2024-03-27T07:11:14.739 INFO:teuthology.orchestra.run.smithi082.stdout:(2/174): ceph-base-19.0.0-2478.g155268c4.el9.x8 4.6 MB/s | 5.4 MB 00:01 2024-03-27T07:11:14.746 INFO:teuthology.orchestra.run.smithi153.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-03-27T07:11:14.770 INFO:teuthology.orchestra.run.smithi149.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-03-27T07:11:14.772 INFO:teuthology.orchestra.run.smithi082.stdout:(3/174): ceph-fuse-19.0.0-2478.g155268c4.el9.x8 1.1 MB/s | 890 kB 00:00 2024-03-27T07:11:14.811 INFO:teuthology.orchestra.run.smithi149.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-03-27T07:11:14.839 INFO:teuthology.orchestra.run.smithi082.stdout:(4/174): ceph-immutable-object-cache-19.0.0-247 1.4 MB/s | 145 kB 00:00 2024-03-27T07:11:14.845 INFO:teuthology.orchestra.run.smithi149.stdout:(126/174): python3-grpcio-1.46.7-10.el9.x86_64. 16 MB/s | 2.0 MB 00:00 2024-03-27T07:11:14.863 INFO:teuthology.orchestra.run.smithi149.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-03-27T07:11:14.879 INFO:teuthology.orchestra.run.smithi149.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-03-27T07:11:15.567 INFO:teuthology.orchestra.run.smithi082.stdout:(5/174): ceph-mgr-19.0.0-2478.g155268c4.el9.x86 5.8 MB/s | 1.5 MB 00:00 2024-03-27T07:11:15.569 INFO:teuthology.orchestra.run.smithi149.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 344 kB/s | 23 kB 00:00 2024-03-27T07:11:15.569 INFO:teuthology.orchestra.run.smithi149.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 289 kB/s | 19 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 857 kB/s | 79 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(134/174): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 244 kB/s | 16 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-27T07:11:15.570 INFO:teuthology.orchestra.run.smithi149.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 781 kB/s | 59 kB 00:00 2024-03-27T07:11:15.571 INFO:teuthology.orchestra.run.smithi149.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-03-27T07:11:15.571 INFO:teuthology.orchestra.run.smithi149.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 608 kB/s | 51 kB 00:00 2024-03-27T07:11:15.571 INFO:teuthology.orchestra.run.smithi149.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-03-27T07:11:15.571 INFO:teuthology.orchestra.run.smithi149.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-03-27T07:11:15.571 INFO:teuthology.orchestra.run.smithi149.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.5 MB/s | 427 kB 00:00 2024-03-27T07:11:15.571 INFO:teuthology.orchestra.run.smithi149.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-03-27T07:11:15.571 INFO:teuthology.orchestra.run.smithi149.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-03-27T07:11:15.571 INFO:teuthology.orchestra.run.smithi149.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-03-27T07:11:15.571 INFO:teuthology.orchestra.run.smithi149.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-03-27T07:11:15.698 INFO:teuthology.orchestra.run.smithi082.stdout:(6/174): ceph-mon-19.0.0-2478.g155268c4.el9.x86 7.8 MB/s | 4.7 MB 00:00 2024-03-27T07:11:15.747 INFO:teuthology.orchestra.run.smithi149.stdout:(152/174): NetworkManager-1.47.2-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-03-27T07:11:15.811 INFO:teuthology.orchestra.run.smithi149.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 28 MB/s | 1.8 MB 00:00 2024-03-27T07:11:15.845 INFO:teuthology.orchestra.run.smithi149.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 1.2 MB/s | 42 kB 00:00 2024-03-27T07:11:15.887 INFO:teuthology.orchestra.run.smithi149.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.8 MB/s | 248 kB 00:00 2024-03-27T07:11:15.922 INFO:teuthology.orchestra.run.smithi153.stdout:(150/174): librbd1-19.0.0-2478.g155268c4.el9.x8 2.7 MB/s | 3.1 MB 00:01 2024-03-27T07:11:15.928 INFO:teuthology.orchestra.run.smithi149.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-03-27T07:11:15.962 INFO:teuthology.orchestra.run.smithi149.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 1.1 MB/s | 36 kB 00:00 2024-03-27T07:11:15.963 INFO:teuthology.orchestra.run.smithi153.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-03-27T07:11:15.996 INFO:teuthology.orchestra.run.smithi149.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 5.7 MB/s | 192 kB 00:00 2024-03-27T07:11:16.038 INFO:teuthology.orchestra.run.smithi149.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 6.0 MB/s | 256 kB 00:00 2024-03-27T07:11:16.080 INFO:teuthology.orchestra.run.smithi149.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 551 kB/s | 23 kB 00:00 2024-03-27T07:11:16.122 INFO:teuthology.orchestra.run.smithi149.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.5 MB/s | 108 kB 00:00 2024-03-27T07:11:16.122 INFO:teuthology.orchestra.run.smithi153.stdout:(152/174): librados2-19.0.0-2478.g155268c4.el9. 2.3 MB/s | 3.4 MB 00:01 2024-03-27T07:11:16.164 INFO:teuthology.orchestra.run.smithi149.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.6 MB/s | 155 kB 00:00 2024-03-27T07:11:16.206 INFO:teuthology.orchestra.run.smithi149.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 3.2 MB/s | 136 kB 00:00 2024-03-27T07:11:16.248 INFO:teuthology.orchestra.run.smithi149.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-03-27T07:11:16.290 INFO:teuthology.orchestra.run.smithi149.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 689 kB/s | 29 kB 00:00 2024-03-27T07:11:16.348 INFO:teuthology.orchestra.run.smithi149.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 21 MB/s | 1.2 MB 00:00 2024-03-27T07:11:16.381 INFO:teuthology.orchestra.run.smithi082.stdout:(7/174): ceph-mds-19.0.0-2478.g155268c4.el9.x86 1.5 MB/s | 2.4 MB 00:01 2024-03-27T07:11:16.407 INFO:teuthology.orchestra.run.smithi149.stdout:(167/174): librados2-19.0.0-2478.g155268c4.el9. 3.5 MB/s | 3.4 MB 00:00 2024-03-27T07:11:16.456 INFO:teuthology.orchestra.run.smithi153.stdout:(153/174): NetworkManager-1.47.2-1.el9.x86_64.r 4.7 MB/s | 2.3 MB 00:00 2024-03-27T07:11:16.465 INFO:teuthology.orchestra.run.smithi149.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 18 MB/s | 2.2 MB 00:00 2024-03-27T07:11:16.507 INFO:teuthology.orchestra.run.smithi149.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 11 MB/s | 465 kB 00:00 2024-03-27T07:11:16.514 INFO:teuthology.orchestra.run.smithi153.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 725 kB/s | 42 kB 00:00 2024-03-27T07:11:16.573 INFO:teuthology.orchestra.run.smithi153.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-03-27T07:11:16.615 INFO:teuthology.orchestra.run.smithi153.stdout:(156/174): NetworkManager-libnm-1.47.2-1.el9.x8 3.7 MB/s | 1.8 MB 00:00 2024-03-27T07:11:16.616 INFO:teuthology.orchestra.run.smithi149.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 287 kB/s | 31 kB 00:00 2024-03-27T07:11:16.640 INFO:teuthology.orchestra.run.smithi153.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-03-27T07:11:16.666 INFO:teuthology.orchestra.run.smithi149.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 8.8 MB/s | 2.3 MB 00:00 2024-03-27T07:11:16.674 INFO:teuthology.orchestra.run.smithi153.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 623 kB/s | 36 kB 00:00 2024-03-27T07:11:16.699 INFO:teuthology.orchestra.run.smithi153.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 3.2 MB/s | 192 kB 00:00 2024-03-27T07:11:16.700 INFO:teuthology.orchestra.run.smithi149.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-03-27T07:11:16.750 INFO:teuthology.orchestra.run.smithi153.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 461 kB/s | 23 kB 00:00 2024-03-27T07:11:16.775 INFO:teuthology.orchestra.run.smithi153.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.5 MB/s | 256 kB 00:00 2024-03-27T07:11:16.825 INFO:teuthology.orchestra.run.smithi149.stdout:(173/174): librbd1-19.0.0-2478.g155268c4.el9.x8 2.3 MB/s | 3.1 MB 00:01 2024-03-27T07:11:16.831 INFO:teuthology.orchestra.run.smithi082.stdout:(8/174): ceph-common-19.0.0-2478.g155268c4.el9. 6.3 MB/s | 21 MB 00:03 2024-03-27T07:11:16.859 INFO:teuthology.orchestra.run.smithi153.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 998 kB/s | 108 kB 00:00 2024-03-27T07:11:16.884 INFO:teuthology.orchestra.run.smithi153.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 155 kB 00:00 2024-03-27T07:11:16.898 INFO:teuthology.orchestra.run.smithi082.stdout:(9/174): ceph-selinux-19.0.0-2478.g155268c4.el9 378 kB/s | 25 kB 00:00 2024-03-27T07:11:16.917 INFO:teuthology.orchestra.run.smithi153.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-03-27T07:11:16.942 INFO:teuthology.orchestra.run.smithi149.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 270 kB/s | 74 kB 00:00 2024-03-27T07:11:16.942 INFO:teuthology.orchestra.run.smithi153.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-03-27T07:11:16.949 INFO:teuthology.orchestra.run.smithi149.stdout:-------------------------------------------------------------------------------- 2024-03-27T07:11:16.949 INFO:teuthology.orchestra.run.smithi149.stdout:Total 13 MB/s | 227 MB 00:17 2024-03-27T07:11:16.976 INFO:teuthology.orchestra.run.smithi153.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 490 kB/s | 29 kB 00:00 2024-03-27T07:11:17.143 INFO:teuthology.orchestra.run.smithi153.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 6.0 MB/s | 1.2 MB 00:00 2024-03-27T07:11:17.319 INFO:teuthology.orchestra.run.smithi153.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 6.3 MB/s | 2.2 MB 00:00 2024-03-27T07:11:17.410 INFO:teuthology.orchestra.run.smithi153.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.0 MB/s | 465 kB 00:00 2024-03-27T07:11:17.469 INFO:teuthology.orchestra.run.smithi153.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 533 kB/s | 31 kB 00:00 2024-03-27T07:11:17.514 INFO:teuthology.orchestra.run.smithi153.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 6.2 MB/s | 2.3 MB 00:00 2024-03-27T07:11:17.527 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction check 2024-03-27T07:11:17.574 INFO:teuthology.orchestra.run.smithi082.stdout:(10/174): ceph-osd-19.0.0-2478.g155268c4.el9.x8 9.0 MB/s | 17 MB 00:01 2024-03-27T07:11:17.594 INFO:teuthology.orchestra.run.smithi153.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 893 kB/s | 74 kB 00:00 2024-03-27T07:11:17.649 INFO:teuthology.orchestra.run.smithi082.stdout:(11/174): cephfs-mirror-19.0.0-2478.g155268c4.e 2.9 MB/s | 221 kB 00:00 2024-03-27T07:11:17.661 INFO:teuthology.orchestra.run.smithi153.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.6 MB/s | 1.1 MB 00:00 2024-03-27T07:11:17.699 INFO:teuthology.orchestra.run.smithi082.stdout:(12/174): cephfs-shell-19.0.0-2478.g155268c4.el 543 kB/s | 27 kB 00:00 2024-03-27T07:11:17.758 INFO:teuthology.orchestra.run.smithi082.stdout:(13/174): libcephfs-devel-19.0.0-2478.g155268c4 545 kB/s | 32 kB 00:00 2024-03-27T07:11:17.803 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction check succeeded. 2024-03-27T07:11:17.803 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction test 2024-03-27T07:11:17.875 INFO:teuthology.orchestra.run.smithi082.stdout:(14/174): libcephfs2-19.0.0-2478.g155268c4.el9. 6.3 MB/s | 746 kB 00:00 2024-03-27T07:11:17.942 INFO:teuthology.orchestra.run.smithi082.stdout:(15/174): libcephsqlite-19.0.0-2478.g155268c4.e 2.4 MB/s | 163 kB 00:00 2024-03-27T07:11:17.992 INFO:teuthology.orchestra.run.smithi082.stdout:(16/174): librados-devel-19.0.0-2478.g155268c4. 2.5 MB/s | 127 kB 00:00 2024-03-27T07:11:18.075 INFO:teuthology.orchestra.run.smithi082.stdout:(17/174): libradosstriper1-19.0.0-2478.g155268c 5.9 MB/s | 501 kB 00:00 2024-03-27T07:11:18.617 INFO:teuthology.orchestra.run.smithi082.stdout:(18/174): librgw2-19.0.0-2478.g155268c4.el9.x86 9.5 MB/s | 5.1 MB 00:00 2024-03-27T07:11:18.659 INFO:teuthology.orchestra.run.smithi082.stdout:(19/174): python3-ceph-argparse-19.0.0-2478.g15 1.1 MB/s | 45 kB 00:00 2024-03-27T07:11:18.710 INFO:teuthology.orchestra.run.smithi082.stdout:(20/174): python3-ceph-common-19.0.0-2478.g1552 2.6 MB/s | 134 kB 00:00 2024-03-27T07:11:18.760 INFO:teuthology.orchestra.run.smithi082.stdout:(21/174): python3-cephfs-19.0.0-2478.g155268c4. 3.2 MB/s | 162 kB 00:00 2024-03-27T07:11:18.827 INFO:teuthology.orchestra.run.smithi082.stdout:(22/174): python3-rados-19.0.0-2478.g155268c4.e 4.7 MB/s | 320 kB 00:00 2024-03-27T07:11:18.885 INFO:teuthology.orchestra.run.smithi082.stdout:(23/174): python3-rbd-19.0.0-2478.g155268c4.el9 5.0 MB/s | 298 kB 00:00 2024-03-27T07:11:18.936 INFO:teuthology.orchestra.run.smithi082.stdout:(24/174): python3-rgw-19.0.0-2478.g155268c4.el9 1.9 MB/s | 99 kB 00:00 2024-03-27T07:11:18.994 INFO:teuthology.orchestra.run.smithi082.stdout:(25/174): rbd-fuse-19.0.0-2478.g155268c4.el9.x8 1.4 MB/s | 85 kB 00:00 2024-03-27T07:11:19.336 INFO:teuthology.orchestra.run.smithi082.stdout:(26/174): rbd-mirror-19.0.0-2478.g155268c4.el9. 9.0 MB/s | 3.1 MB 00:00 2024-03-27T07:11:19.387 INFO:teuthology.orchestra.run.smithi082.stdout:(27/174): rbd-nbd-19.0.0-2478.g155268c4.el9.x86 3.3 MB/s | 170 kB 00:00 2024-03-27T07:11:19.437 INFO:teuthology.orchestra.run.smithi082.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2478.g 679 kB/s | 34 kB 00:00 2024-03-27T07:11:19.495 INFO:teuthology.orchestra.run.smithi082.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2478.g155268c 2.4 MB/s | 141 kB 00:00 2024-03-27T07:11:19.536 INFO:teuthology.orchestra.run.smithi153.stdout:(174/174): ceph-test-19.0.0-2478.g155268c4.el9. 2.8 MB/s | 48 MB 00:16 2024-03-27T07:11:19.541 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-03-27T07:11:19.541 INFO:teuthology.orchestra.run.smithi153.stdout:Total 11 MB/s | 227 MB 00:21 2024-03-27T07:11:19.564 INFO:teuthology.orchestra.run.smithi149.stdout:Transaction test succeeded. 2024-03-27T07:11:19.564 INFO:teuthology.orchestra.run.smithi149.stdout:Running transaction 2024-03-27T07:11:19.862 INFO:teuthology.orchestra.run.smithi082.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2478.g15526 9.7 MB/s | 3.5 MB 00:00 2024-03-27T07:11:20.107 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-03-27T07:11:20.378 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-03-27T07:11:20.379 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-03-27T07:11:20.579 INFO:teuthology.orchestra.run.smithi082.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-03-27T07:11:20.638 INFO:teuthology.orchestra.run.smithi082.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2478.g15 4.2 MB/s | 249 kB 00:00 2024-03-27T07:11:20.696 INFO:teuthology.orchestra.run.smithi082.stdout:(33/174): ceph-mgr-rook-19.0.0-2478.g155268c4.e 848 kB/s | 49 kB 00:00 2024-03-27T07:11:20.755 INFO:teuthology.orchestra.run.smithi082.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2478.g1 281 kB/s | 16 kB 00:00 2024-03-27T07:11:20.822 INFO:teuthology.orchestra.run.smithi082.stdout:(35/174): ceph-volume-19.0.0-2478.g155268c4.el9 3.9 MB/s | 264 kB 00:00 2024-03-27T07:11:20.914 INFO:teuthology.orchestra.run.smithi082.stdout:(36/174): cephadm-19.0.0-2478.g155268c4.el9.noa 8.1 MB/s | 762 kB 00:00 2024-03-27T07:11:20.964 INFO:teuthology.orchestra.run.smithi082.stdout:(37/174): cephfs-top-19.0.0-2478.g155268c4.el9. 364 kB/s | 18 kB 00:00 2024-03-27T07:11:21.073 INFO:teuthology.orchestra.run.smithi082.stdout:(38/174): ceph-radosgw-19.0.0-2478.g155268c4.el 2.1 MB/s | 9.8 MB 00:04 2024-03-27T07:11:21.232 INFO:teuthology.orchestra.run.smithi082.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 662 kB 00:00 2024-03-27T07:11:21.265 INFO:teuthology.orchestra.run.smithi082.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 4.7 MB/s | 920 kB 00:00 2024-03-27T07:11:21.307 INFO:teuthology.orchestra.run.smithi082.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2024-03-27T07:11:21.332 INFO:teuthology.orchestra.run.smithi082.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.5 MB/s | 307 kB 00:00 2024-03-27T07:11:21.357 INFO:teuthology.orchestra.run.smithi082.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 637 kB/s | 32 kB 00:00 2024-03-27T07:11:21.474 INFO:teuthology.orchestra.run.smithi082.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-03-27T07:11:21.499 INFO:teuthology.orchestra.run.smithi082.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 121 kB/s | 17 kB 00:00 2024-03-27T07:11:21.525 INFO:teuthology.orchestra.run.smithi082.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-03-27T07:11:21.550 INFO:teuthology.orchestra.run.smithi082.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-27T07:11:21.576 INFO:teuthology.orchestra.run.smithi082.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 880 kB/s | 44 kB 00:00 2024-03-27T07:11:21.601 INFO:teuthology.orchestra.run.smithi082.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-27T07:11:21.626 INFO:teuthology.orchestra.run.smithi082.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-03-27T07:11:21.651 INFO:teuthology.orchestra.run.smithi082.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 938 kB/s | 46 kB 00:00 2024-03-27T07:11:21.677 INFO:teuthology.orchestra.run.smithi082.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-27T07:11:21.702 INFO:teuthology.orchestra.run.smithi082.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-27T07:11:21.727 INFO:teuthology.orchestra.run.smithi082.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-27T07:11:21.753 INFO:teuthology.orchestra.run.smithi082.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 686 kB/s | 34 kB 00:00 2024-03-27T07:11:22.195 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-03-27T07:11:22.196 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-03-27T07:11:22.220 INFO:teuthology.orchestra.run.smithi082.stdout:(56/174): ceph-test-19.0.0-2478.g155268c4.el9.x 9.0 MB/s | 48 MB 00:05 2024-03-27T07:11:22.286 INFO:teuthology.orchestra.run.smithi082.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 8.5 MB/s | 4.7 MB 00:00 2024-03-27T07:11:22.320 INFO:teuthology.orchestra.run.smithi082.stdout:(58/174): protobuf-3.14.0-13.el9.x86_64.rpm 1.8 MB/s | 1.0 MB 00:00 2024-03-27T07:11:22.337 INFO:teuthology.orchestra.run.smithi082.stdout:(59/174): python3-attrs-20.3.0-7.el9.noarch.rpm 678 kB/s | 78 kB 00:00 2024-03-27T07:11:22.362 INFO:teuthology.orchestra.run.smithi082.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 592 kB/s | 24 kB 00:00 2024-03-27T07:11:22.479 INFO:teuthology.orchestra.run.smithi082.stdout:(61/174): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 5.8 MB 00:00 2024-03-27T07:11:22.504 INFO:teuthology.orchestra.run.smithi082.stdout:(62/174): python3-jsonpointer-2.0-4.el9.noarch. 108 kB/s | 18 kB 00:00 2024-03-27T07:11:22.529 INFO:teuthology.orchestra.run.smithi082.stdout:(63/174): python3-mako-1.1.4-6.el9.noarch.rpm 879 kB/s | 144 kB 00:00 2024-03-27T07:11:22.554 INFO:teuthology.orchestra.run.smithi082.stdout:(64/174): python3-markupsafe-1.1.1-12.el9.x86_6 422 kB/s | 32 kB 00:00 2024-03-27T07:11:22.580 INFO:teuthology.orchestra.run.smithi082.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.3 MB/s | 217 kB 00:00 2024-03-27T07:11:22.680 INFO:teuthology.orchestra.run.smithi082.stdout:(66/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-27T07:11:22.705 INFO:teuthology.orchestra.run.smithi082.stdout:(67/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2024-03-27T07:11:22.730 INFO:teuthology.orchestra.run.smithi082.stdout:(68/174): python3-packaging-20.9-5.el9.noarch.r 466 kB/s | 69 kB 00:00 2024-03-27T07:11:22.747 INFO:teuthology.orchestra.run.smithi082.stdout:(69/174): python3-prettytable-0.7.2-27.el9.noar 622 kB/s | 41 kB 00:00 2024-03-27T07:11:22.781 INFO:teuthology.orchestra.run.smithi082.stdout:(70/174): python3-protobuf-3.14.0-13.el9.noarch 4.7 MB/s | 238 kB 00:00 2024-03-27T07:11:22.806 INFO:teuthology.orchestra.run.smithi082.stdout:(71/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-27T07:11:22.831 INFO:teuthology.orchestra.run.smithi082.stdout:(72/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2024-03-27T07:11:22.857 INFO:teuthology.orchestra.run.smithi082.stdout:(73/174): python3-requests-oauthlib-1.3.0-12.el 866 kB/s | 43 kB 00:00 2024-03-27T07:11:22.882 INFO:teuthology.orchestra.run.smithi082.stdout:(74/174): python3-pytz-2021.1-5.el9.noarch.rpm 633 kB/s | 47 kB 00:00 2024-03-27T07:11:23.049 INFO:teuthology.orchestra.run.smithi082.stdout:(75/174): python3-toml-0.10.2-6.el9.noarch.rpm 204 kB/s | 39 kB 00:00 2024-03-27T07:11:23.207 INFO:teuthology.orchestra.run.smithi082.stdout:(76/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-03-27T07:11:23.232 INFO:teuthology.orchestra.run.smithi082.stdout:(77/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 118 kB/s | 41 kB 00:00 2024-03-27T07:11:23.258 INFO:teuthology.orchestra.run.smithi082.stdout:(78/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 300 kB 00:00 2024-03-27T07:11:23.283 INFO:teuthology.orchestra.run.smithi082.stdout:(79/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-27T07:11:23.308 INFO:teuthology.orchestra.run.smithi082.stdout:(80/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 838 kB/s | 63 kB 00:00 2024-03-27T07:11:23.333 INFO:teuthology.orchestra.run.smithi082.stdout:(81/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 586 kB/s | 44 kB 00:00 2024-03-27T07:11:23.359 INFO:teuthology.orchestra.run.smithi082.stdout:(82/174): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-27T07:11:23.384 INFO:teuthology.orchestra.run.smithi082.stdout:(83/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-27T07:11:23.418 INFO:teuthology.orchestra.run.smithi082.stdout:(84/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-27T07:11:23.443 INFO:teuthology.orchestra.run.smithi082.stdout:(85/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-27T07:11:23.543 INFO:teuthology.orchestra.run.smithi082.stdout:(86/174): python3-pycparser-2.20-6.el9.noarch.r 793 kB/s | 124 kB 00:00 2024-03-27T07:11:23.593 INFO:teuthology.orchestra.run.smithi082.stdout:(87/174): python3-urllib3-1.26.5-5.el9.noarch.r 1.0 MB/s | 187 kB 00:00 2024-03-27T07:11:23.719 INFO:teuthology.orchestra.run.smithi082.stdout:(88/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-03-27T07:11:23.744 INFO:teuthology.orchestra.run.smithi082.stdout:(89/174): jq-1.6-16.el9.x86_64.rpm 934 kB/s | 187 kB 00:00 2024-03-27T07:11:23.786 INFO:teuthology.orchestra.run.smithi082.stdout:(90/174): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-03-27T07:11:23.811 INFO:teuthology.orchestra.run.smithi082.stdout:(91/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-03-27T07:11:23.995 INFO:teuthology.orchestra.run.smithi082.stdout:(92/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 122 kB/s | 25 kB 00:00 2024-03-27T07:11:24.020 INFO:teuthology.orchestra.run.smithi082.stdout:(93/174): elfutils-libelf-devel-0.190-2.el9.x86 78 kB/s | 21 kB 00:00 2024-03-27T07:11:24.187 INFO:teuthology.orchestra.run.smithi082.stdout:(94/174): postgresql-contrib-13.14-1.el9.x86_64 5.3 MB/s | 911 kB 00:00 2024-03-27T07:11:24.220 INFO:teuthology.orchestra.run.smithi082.stdout:(95/174): postgresql-13.14-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-03-27T07:11:24.279 INFO:teuthology.orchestra.run.smithi082.stdout:(96/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 8.8 MB/s | 4.1 MB 00:00 2024-03-27T07:11:24.304 INFO:teuthology.orchestra.run.smithi082.stdout:(97/174): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-03-27T07:11:24.354 INFO:teuthology.orchestra.run.smithi082.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-03-27T07:11:24.380 INFO:teuthology.orchestra.run.smithi082.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-03-27T07:11:24.421 INFO:teuthology.orchestra.run.smithi082.stdout:(100/174): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-03-27T07:11:24.447 INFO:teuthology.orchestra.run.smithi082.stdout:(101/174): qatlib-service-24.02.0-1.el9.x86_64. 536 kB/s | 36 kB 00:00 2024-03-27T07:11:24.497 INFO:teuthology.orchestra.run.smithi082.stdout:(102/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-03-27T07:11:24.522 INFO:teuthology.orchestra.run.smithi082.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-03-27T07:11:24.639 INFO:teuthology.orchestra.run.smithi082.stdout:(104/174): postgresql-server-13.14-1.el9.x86_64 14 MB/s | 5.8 MB 00:00 2024-03-27T07:11:24.664 INFO:teuthology.orchestra.run.smithi082.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-03-27T07:11:24.831 INFO:teuthology.orchestra.run.smithi082.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.7 MB/s | 863 kB 00:00 2024-03-27T07:11:24.898 INFO:teuthology.orchestra.run.smithi082.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-03-27T07:11:24.940 INFO:teuthology.orchestra.run.smithi082.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-03-27T07:11:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:(109/174): grpc-data-1.46.7-10.el9.noarch.rpm 145 kB/s | 19 kB 00:00 2024-03-27T07:11:24.999 INFO:teuthology.orchestra.run.smithi082.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 443 kB/s | 26 kB 00:00 2024-03-27T07:11:25.058 INFO:teuthology.orchestra.run.smithi082.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-03-27T07:11:25.083 INFO:teuthology.orchestra.run.smithi082.stdout:(112/174): liboath-2.6.7-2.el9.x86_64.rpm 414 kB/s | 49 kB 00:00 2024-03-27T07:11:25.150 INFO:teuthology.orchestra.run.smithi082.stdout:(113/174): libarrow-9.0.0-10.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-03-27T07:11:25.175 INFO:teuthology.orchestra.run.smithi082.stdout:(114/174): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-03-27T07:11:25.267 INFO:teuthology.orchestra.run.smithi082.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-03-27T07:11:25.293 INFO:teuthology.orchestra.run.smithi082.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 370 kB/s | 43 kB 00:00 2024-03-27T07:11:25.326 INFO:teuthology.orchestra.run.smithi082.stdout:(117/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.4 MB/s | 838 kB 00:00 2024-03-27T07:11:25.351 INFO:teuthology.orchestra.run.smithi082.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 256 kB/s | 15 kB 00:00 2024-03-27T07:11:25.376 INFO:teuthology.orchestra.run.smithi082.stdout:(119/174): python3-cachetools-4.2.4-1.el9.noarc 295 kB/s | 32 kB 00:00 2024-03-27T07:11:25.402 INFO:teuthology.orchestra.run.smithi082.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-03-27T07:11:25.427 INFO:teuthology.orchestra.run.smithi082.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-03-27T07:11:25.452 INFO:teuthology.orchestra.run.smithi082.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-03-27T07:11:25.477 INFO:teuthology.orchestra.run.smithi082.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 468 kB/s | 35 kB 00:00 2024-03-27T07:11:25.503 INFO:teuthology.orchestra.run.smithi082.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-03-27T07:11:25.536 INFO:teuthology.orchestra.run.smithi082.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-03-27T07:11:25.562 INFO:teuthology.orchestra.run.smithi082.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-03-27T07:11:25.620 INFO:teuthology.orchestra.run.smithi082.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-03-27T07:11:25.645 INFO:teuthology.orchestra.run.smithi082.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-03-27T07:11:25.671 INFO:teuthology.orchestra.run.smithi082.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-03-27T07:11:25.696 INFO:teuthology.orchestra.run.smithi082.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-03-27T07:11:25.729 INFO:teuthology.orchestra.run.smithi082.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 337 kB/s | 20 kB 00:00 2024-03-27T07:11:25.755 INFO:teuthology.orchestra.run.smithi082.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 792 kB/s | 46 kB 00:00 2024-03-27T07:11:25.797 INFO:teuthology.orchestra.run.smithi082.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-03-27T07:11:25.822 INFO:teuthology.orchestra.run.smithi082.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-03-27T07:11:25.847 INFO:teuthology.orchestra.run.smithi082.stdout:(135/174): python3-more-itertools-8.12.0-2.el9. 671 kB/s | 79 kB 00:00 2024-03-27T07:11:25.872 INFO:teuthology.orchestra.run.smithi082.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-27T07:11:25.898 INFO:teuthology.orchestra.run.smithi082.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-03-27T07:11:25.923 INFO:teuthology.orchestra.run.smithi082.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-27T07:11:25.948 INFO:teuthology.orchestra.run.smithi082.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-03-27T07:11:25.973 INFO:teuthology.orchestra.run.smithi082.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-03-27T07:11:25.999 INFO:teuthology.orchestra.run.smithi082.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-27T07:11:26.046 INFO:teuthology.orchestra.run.smithi082.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 604 kB/s | 59 kB 00:00 2024-03-27T07:11:26.074 INFO:teuthology.orchestra.run.smithi082.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-03-27T07:11:26.099 INFO:teuthology.orchestra.run.smithi082.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-03-27T07:11:26.126 INFO:teuthology.orchestra.run.smithi082.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.9 MB/s | 230 kB 00:00 2024-03-27T07:11:26.150 INFO:teuthology.orchestra.run.smithi082.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-27T07:11:26.175 INFO:teuthology.orchestra.run.smithi082.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-03-27T07:11:26.201 INFO:teuthology.orchestra.run.smithi082.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-03-27T07:11:26.226 INFO:teuthology.orchestra.run.smithi082.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-27T07:11:26.293 INFO:teuthology.orchestra.run.smithi082.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-03-27T07:11:26.443 INFO:teuthology.orchestra.run.smithi082.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.5 MB/s | 321 kB 00:00 2024-03-27T07:11:26.651 INFO:teuthology.orchestra.run.smithi082.stdout:(152/174): NetworkManager-1.47.2-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-03-27T07:11:26.710 INFO:teuthology.orchestra.run.smithi082.stdout:(153/174): librados2-19.0.0-2478.g155268c4.el9. 6.7 MB/s | 3.4 MB 00:00 2024-03-27T07:11:26.761 INFO:teuthology.orchestra.run.smithi082.stdout:(154/174): NetworkManager-libnm-1.47.2-1.el9.x8 17 MB/s | 1.8 MB 00:00 2024-03-27T07:11:26.783 INFO:teuthology.orchestra.run.smithi149.stdout: Preparing : 1/1 2024-03-27T07:11:26.802 INFO:teuthology.orchestra.run.smithi082.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.9 MB/s | 248 kB 00:00 2024-03-27T07:11:26.828 INFO:teuthology.orchestra.run.smithi082.stdout:(156/174): NetworkManager-team-1.47.2-1.el9.x86 359 kB/s | 42 kB 00:00 2024-03-27T07:11:26.853 INFO:teuthology.orchestra.run.smithi082.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-03-27T07:11:26.878 INFO:teuthology.orchestra.run.smithi082.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 727 kB/s | 36 kB 00:00 2024-03-27T07:11:26.887 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-27T07:11:26.903 INFO:teuthology.orchestra.run.smithi082.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 192 kB 00:00 2024-03-27T07:11:26.922 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-27T07:11:26.937 INFO:teuthology.orchestra.run.smithi082.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 695 kB/s | 23 kB 00:00 2024-03-27T07:11:26.952 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T07:11:26.962 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T07:11:26.962 INFO:teuthology.orchestra.run.smithi082.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-03-27T07:11:26.988 INFO:teuthology.orchestra.run.smithi082.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-27T07:11:27.002 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-27T07:11:27.013 INFO:teuthology.orchestra.run.smithi082.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-03-27T07:11:27.038 INFO:teuthology.orchestra.run.smithi082.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 136 kB 00:00 2024-03-27T07:11:27.055 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-27T07:11:27.063 INFO:teuthology.orchestra.run.smithi082.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 64 kB 00:00 2024-03-27T07:11:27.088 INFO:teuthology.orchestra.run.smithi082.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 572 kB/s | 29 kB 00:00 2024-03-27T07:11:27.089 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-27T07:11:27.114 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-27T07:11:27.156 INFO:teuthology.orchestra.run.smithi082.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 32 MB/s | 2.2 MB 00:00 2024-03-27T07:11:27.157 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-27T07:11:27.189 INFO:teuthology.orchestra.run.smithi082.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-03-27T07:11:27.239 INFO:teuthology.orchestra.run.smithi082.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 27 MB/s | 2.3 MB 00:00 2024-03-27T07:11:27.265 INFO:teuthology.orchestra.run.smithi082.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 6.0 MB/s | 465 kB 00:00 2024-03-27T07:11:27.290 INFO:teuthology.orchestra.run.smithi082.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 618 kB/s | 31 kB 00:00 2024-03-27T07:11:27.332 INFO:teuthology.orchestra.run.smithi082.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-03-27T07:11:27.477 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-27T07:11:27.499 INFO:teuthology.orchestra.run.smithi082.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 357 kB/s | 74 kB 00:00 2024-03-27T07:11:27.532 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T07:11:27.549 INFO:teuthology.orchestra.run.smithi082.stdout:(174/174): librbd1-19.0.0-2478.g155268c4.el9.x8 2.4 MB/s | 3.1 MB 00:01 2024-03-27T07:11:27.553 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-03-27T07:11:27.553 INFO:teuthology.orchestra.run.smithi082.stdout:Total 16 MB/s | 227 MB 00:14 2024-03-27T07:11:27.635 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T07:11:27.666 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T07:11:27.759 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T07:11:27.789 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T07:11:27.828 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-27T07:11:28.005 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-27T07:11:28.062 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-27T07:11:28.090 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T07:11:28.101 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-03-27T07:11:28.209 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T07:11:28.233 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T07:11:28.296 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T07:11:28.328 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-27T07:11:28.351 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T07:11:28.366 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T07:11:28.380 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-03-27T07:11:28.380 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-03-27T07:11:28.568 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T07:11:28.599 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T07:11:28.630 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-27T07:11:28.736 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-27T07:11:28.869 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T07:11:28.927 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T07:11:28.998 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T07:11:29.030 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-03-27T07:11:29.053 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T07:11:29.131 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-27T07:11:29.232 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-27T07:11:29.268 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T07:11:29.379 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-27T07:11:29.389 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T07:11:29.399 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T07:11:29.439 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-27T07:11:29.471 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-27T07:11:29.508 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-27T07:11:29.528 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-27T07:11:29.534 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-27T07:11:29.570 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-27T07:11:29.576 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-27T07:11:29.602 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-27T07:11:29.644 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-27T07:11:29.645 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-27T07:11:29.698 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-27T07:11:29.745 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-27T07:11:29.809 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-27T07:11:29.844 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-27T07:11:29.888 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-27T07:11:29.929 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-27T07:11:29.956 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-27T07:11:29.973 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-27T07:11:30.025 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-27T07:11:30.035 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T07:11:30.061 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 39/198 2024-03-27T07:11:30.104 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 40/198 2024-03-27T07:11:30.133 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 41/198 2024-03-27T07:11:30.138 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T07:11:30.169 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T07:11:30.201 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-27T07:11:30.256 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-27T07:11:30.259 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T07:11:30.290 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T07:11:30.329 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-27T07:11:30.329 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-27T07:11:30.415 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-03-27T07:11:30.417 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-03-27T07:11:30.462 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-27T07:11:30.516 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-27T07:11:30.517 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-27T07:11:30.571 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-27T07:11:30.599 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T07:11:30.719 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T07:11:30.742 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T07:11:30.806 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T07:11:30.854 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-27T07:11:30.877 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T07:11:30.892 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T07:11:31.031 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-27T07:11:31.084 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T07:11:31.111 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-27T07:11:31.116 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T07:11:31.155 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-27T07:11:31.190 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-27T07:11:31.232 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T07:11:31.242 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T07:11:31.261 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-27T07:11:31.272 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-27T07:11:31.312 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-27T07:11:31.351 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 53/198 2024-03-27T07:11:31.358 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T07:11:31.380 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-27T07:11:31.402 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T07:11:31.464 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T07:11:31.527 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T07:11:31.600 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-27T07:11:31.787 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-27T07:11:31.820 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T07:11:31.849 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-27T07:11:31.893 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-27T07:11:32.028 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-27T07:11:32.071 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-27T07:11:32.120 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-27T07:11:32.126 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-27T07:11:32.198 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-27T07:11:32.229 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-27T07:11:32.238 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-27T07:11:32.265 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-27T07:11:32.275 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-27T07:11:32.292 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-27T07:11:32.321 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-27T07:11:32.328 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-27T07:11:32.358 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-27T07:11:32.401 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-27T07:11:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-27T07:11:32.457 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-27T07:11:32.502 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-27T07:11:32.566 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-27T07:11:32.601 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-27T07:11:32.620 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-27T07:11:32.645 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-27T07:11:32.677 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-27T07:11:32.705 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-27T07:11:32.752 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-27T07:11:32.775 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-27T07:11:32.794 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-27T07:11:32.810 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 39/198 2024-03-27T07:11:32.824 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-27T07:11:32.853 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 40/198 2024-03-27T07:11:32.857 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-27T07:11:32.882 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 41/198 2024-03-27T07:11:32.950 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-27T07:11:32.951 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-27T07:11:32.990 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-27T07:11:33.005 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-27T07:11:33.030 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-27T07:11:33.056 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-27T07:11:33.078 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-27T07:11:33.083 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-27T07:11:33.153 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-27T07:11:33.211 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-27T07:11:33.266 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-27T07:11:33.289 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-27T07:11:33.396 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-27T07:11:33.465 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-27T07:11:33.521 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-27T07:11:33.577 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-27T07:11:33.763 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-27T07:11:33.784 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-27T07:11:33.811 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-27T07:11:33.861 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-27T07:11:33.940 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-27T07:11:33.949 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-27T07:11:33.981 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T07:11:33.983 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-27T07:11:33.990 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T07:11:34.016 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-27T07:11:34.021 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-27T07:11:34.047 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-27T07:11:34.062 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-27T07:11:34.074 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-27T07:11:34.099 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 53/198 2024-03-27T07:11:34.109 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-27T07:11:34.137 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-27T07:11:34.148 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-27T07:11:34.180 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-27T07:11:34.210 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-27T07:11:34.287 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-27T07:11:34.320 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-27T07:11:34.354 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-27T07:11:34.378 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-27T07:11:34.395 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-27T07:11:34.430 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-27T07:11:34.518 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-27T07:11:34.561 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-27T07:11:34.600 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-27T07:11:34.623 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-27T07:11:34.644 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-27T07:11:34.667 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-27T07:11:34.676 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-27T07:11:34.723 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-27T07:11:34.817 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-27T07:11:34.820 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-27T07:11:34.869 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-27T07:11:34.886 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-27T07:11:34.949 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-27T07:11:35.030 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-27T07:11:35.061 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-27T07:11:35.098 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-27T07:11:35.145 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-27T07:11:35.180 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-27T07:11:35.223 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-27T07:11:35.266 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-27T07:11:35.408 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-27T07:11:35.454 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-27T07:11:35.484 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-27T07:11:35.526 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-27T07:11:35.596 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-27T07:11:35.620 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-27T07:11:35.641 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-27T07:11:35.659 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-27T07:11:35.675 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-27T07:11:35.699 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-27T07:11:35.723 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-27T07:11:35.725 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-27T07:11:35.749 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-27T07:11:35.803 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-27T07:11:35.822 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-27T07:11:35.834 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-27T07:11:35.951 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-27T07:11:36.012 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-27T07:11:36.041 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-27T07:11:36.058 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-27T07:11:36.099 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-27T07:11:36.126 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-27T07:11:36.148 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-27T07:11:36.202 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-27T07:11:36.397 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-27T07:11:36.445 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-27T07:11:36.575 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-27T07:11:36.627 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-27T07:11:36.658 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-27T07:11:36.697 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-27T07:11:36.734 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-27T07:11:36.759 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-27T07:11:36.777 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-27T07:11:36.816 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-27T07:11:36.847 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-27T07:11:36.862 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-27T07:11:36.877 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-27T07:11:36.954 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-27T07:11:36.988 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-27T07:11:37.021 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-27T07:11:37.071 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-27T07:11:37.113 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-27T07:11:37.203 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-27T07:11:37.293 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-27T07:11:37.344 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-27T07:11:37.376 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-27T07:11:37.423 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-27T07:11:37.521 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-27T07:11:37.539 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-03-27T07:11:37.577 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-27T07:11:37.636 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-27T07:11:37.671 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-27T07:11:37.700 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T07:11:37.710 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T07:11:37.759 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-27T07:11:37.822 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-27T07:11:37.855 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-27T07:11:37.881 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-27T07:11:37.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-27T07:11:38.069 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-27T07:11:38.158 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-27T07:11:38.189 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-27T07:11:38.221 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-27T07:11:38.248 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-27T07:11:38.252 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-27T07:11:38.315 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T07:11:38.316 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-27T07:11:38.358 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-27T07:11:38.392 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-27T07:11:38.418 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T07:11:38.439 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-27T07:11:38.449 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T07:11:38.519 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-27T07:11:38.524 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T07:11:38.554 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T07:11:38.558 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-27T07:11:38.559 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-27T07:11:38.590 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-27T07:11:38.595 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T07:11:38.668 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T07:11:38.699 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 125/198 2024-03-27T07:11:38.736 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-27T07:11:38.736 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-27T07:11:38.765 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-27T07:11:38.769 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-27T07:11:38.826 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-27T07:11:38.842 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-27T07:11:38.854 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T07:11:38.957 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T07:11:38.980 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T07:11:39.057 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T07:11:39.093 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-27T07:11:39.115 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T07:11:39.130 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T07:11:39.193 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-27T07:11:39.223 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T07:11:39.277 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T07:11:39.300 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 129/198 2024-03-27T07:11:39.314 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T07:11:39.390 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T07:11:39.420 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-27T07:11:39.487 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-27T07:11:39.603 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-27T07:11:39.615 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-27T07:11:39.738 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T07:11:39.798 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T07:11:39.893 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T07:11:39.949 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T07:11:40.155 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T07:11:40.263 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-27T07:11:40.356 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-27T07:11:40.396 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-27T07:11:40.423 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-27T07:11:40.458 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-27T07:11:40.533 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-27T07:11:40.587 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-27T07:11:40.626 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-27T07:11:40.690 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-27T07:11:40.725 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-27T07:11:40.768 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-27T07:11:40.802 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-27T07:11:40.830 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-27T07:11:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-27T07:11:40.898 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-27T07:11:40.914 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-27T07:11:40.934 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 39/198 2024-03-27T07:11:40.945 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-27T07:11:40.976 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-27T07:11:40.977 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 40/198 2024-03-27T07:11:41.004 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-27T07:11:41.006 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 41/198 2024-03-27T07:11:41.074 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-27T07:11:41.121 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-27T07:11:41.194 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-27T07:11:41.317 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-27T07:11:41.335 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-27T07:11:41.342 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T07:11:41.390 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-27T07:11:41.433 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T07:11:41.464 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 125/198 2024-03-27T07:11:41.500 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-27T07:11:41.905 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-27T07:11:41.965 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-27T07:11:41.966 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T07:11:41.976 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-27T07:11:41.995 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T07:11:42.005 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T07:11:42.054 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-27T07:11:42.066 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T07:11:42.089 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 129/198 2024-03-27T07:11:42.097 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T07:11:42.107 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T07:11:42.150 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-27T07:11:42.203 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-27T07:11:42.241 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 53/198 2024-03-27T07:11:42.272 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-27T07:11:42.541 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T07:11:42.552 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-27T07:11:42.584 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T07:11:42.690 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T07:11:42.690 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-27T07:11:42.690 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-27T07:11:42.690 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:11:42.718 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T07:11:42.770 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-27T07:11:42.865 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-27T07:11:42.909 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-27T07:11:43.343 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-27T07:11:43.396 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-27T07:11:43.445 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-27T07:11:43.515 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-27T07:11:43.546 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-27T07:11:43.583 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-27T07:11:43.629 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-27T07:11:43.665 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-27T07:11:43.733 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-27T07:11:43.775 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-27T07:11:43.907 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-27T07:11:43.948 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-27T07:11:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-27T07:11:44.019 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-27T07:11:44.113 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-27T07:11:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-27T07:11:44.185 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-27T07:11:44.210 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-27T07:11:44.227 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-27T07:11:44.302 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-27T07:11:44.367 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T07:11:44.403 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T07:11:44.426 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-27T07:11:44.525 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-27T07:11:44.577 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-27T07:11:44.625 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-27T07:11:44.681 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-27T07:11:44.862 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-27T07:11:44.906 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-27T07:11:44.943 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T07:11:44.980 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T07:11:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-27T07:11:45.061 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T07:11:45.061 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-27T07:11:45.061 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-27T07:11:45.061 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:11:45.071 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-27T07:11:45.089 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T07:11:45.103 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-27T07:11:45.134 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-27T07:11:45.162 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-27T07:11:45.196 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-27T07:11:45.235 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-27T07:11:45.266 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-27T07:11:45.296 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-27T07:11:45.372 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-27T07:11:45.407 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-27T07:11:45.441 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-27T07:11:45.473 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-27T07:11:45.508 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-27T07:11:45.595 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-27T07:11:45.686 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-27T07:11:45.730 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-27T07:11:45.762 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-27T07:11:45.809 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-27T07:11:45.906 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-27T07:11:45.963 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-27T07:11:46.693 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-27T07:11:46.744 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-27T07:11:46.781 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-27T07:11:46.829 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-27T07:11:46.908 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-27T07:11:46.940 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-27T07:11:47.120 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-27T07:11:47.330 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-27T07:11:47.486 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-27T07:11:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-27T07:11:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-27T07:11:49.441 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-27T07:11:49.548 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-27T07:11:49.578 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-27T07:11:49.611 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-27T07:11:49.637 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-27T07:11:49.939 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-27T07:11:49.967 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T07:11:50.057 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T07:11:50.080 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 125/198 2024-03-27T07:11:50.117 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-27T07:11:50.574 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-27T07:11:50.604 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T07:11:50.674 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T07:11:50.697 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 129/198 2024-03-27T07:11:52.867 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T07:11:52.910 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T07:11:53.450 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T07:11:53.488 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T07:11:53.576 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T07:11:53.576 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-27T07:11:53.576 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-27T07:11:53.576 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:11:53.615 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T07:11:54.343 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T07:11:54.343 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /sys 2024-03-27T07:11:54.343 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /proc 2024-03-27T07:11:54.343 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /mnt 2024-03-27T07:11:54.343 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /var/tmp 2024-03-27T07:11:54.344 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /home 2024-03-27T07:11:54.344 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /root 2024-03-27T07:11:54.344 INFO:teuthology.orchestra.run.smithi149.stdout:skipping the directory /tmp 2024-03-27T07:11:54.344 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:11:54.508 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T07:11:54.523 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T07:11:54.524 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:11:54.524 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-27T07:11:54.524 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:11:55.994 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T07:11:56.020 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T07:11:56.020 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:11:56.020 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-27T07:11:56.020 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T07:11:56.020 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T07:11:56.021 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:11:56.253 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T07:11:56.276 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T07:11:56.276 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:11:56.276 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-27T07:11:56.276 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T07:11:56.276 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T07:11:56.277 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:11:56.720 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T07:11:56.743 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T07:11:56.743 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:11:56.744 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-27T07:11:56.744 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T07:11:56.744 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T07:11:56.744 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:11:56.749 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T07:11:56.749 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-03-27T07:11:56.750 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-03-27T07:11:56.750 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-03-27T07:11:56.750 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-03-27T07:11:56.750 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-03-27T07:11:56.750 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-03-27T07:11:56.750 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-03-27T07:11:56.750 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:11:56.839 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-27T07:11:56.928 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T07:11:56.943 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T07:11:56.943 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:11:56.943 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-27T07:11:56.944 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:11:57.291 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T07:11:57.321 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T07:11:57.353 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 139/198 2024-03-27T07:11:57.413 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 140/198 2024-03-27T07:11:57.444 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T07:11:58.414 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T07:11:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T07:11:58.440 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:11:58.440 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-27T07:11:58.440 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T07:11:58.440 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T07:11:58.440 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:11:58.477 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T07:11:58.513 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T07:11:58.664 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T07:11:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T07:11:58.687 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:11:58.687 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-27T07:11:58.687 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T07:11:58.687 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T07:11:58.687 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:11:59.132 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T07:11:59.155 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T07:11:59.155 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:11:59.155 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-27T07:11:59.155 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T07:11:59.155 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T07:11:59.155 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:11:59.242 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-27T07:11:59.474 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T07:11:59.513 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T07:11:59.613 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T07:11:59.644 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T07:11:59.674 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T07:11:59.706 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 139/198 2024-03-27T07:11:59.766 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 140/198 2024-03-27T07:11:59.775 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 144/198 2024-03-27T07:11:59.807 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T07:11:59.821 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T07:11:59.830 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T07:11:59.830 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:11:59.830 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-27T07:11:59.830 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T07:11:59.830 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T07:11:59.830 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:11:59.874 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T07:11:59.885 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T07:11:59.930 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 147/198 2024-03-27T07:12:00.800 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-27T07:12:00.834 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T07:12:00.857 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T07:12:00.858 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:00.858 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-27T07:12:00.858 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T07:12:00.858 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T07:12:00.858 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:12:00.860 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T07:12:00.890 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T07:12:00.902 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T07:12:00.924 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T07:12:00.924 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:00.924 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-27T07:12:00.924 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:12:00.978 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T07:12:01.000 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T07:12:01.000 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:01.000 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-27T07:12:01.000 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T07:12:01.000 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T07:12:01.000 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:12:01.303 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T07:12:01.326 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T07:12:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-27T07:12:01.326 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T07:12:01.327 INFO:teuthology.orchestra.run.smithi149.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T07:12:01.327 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:12:01.859 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T07:12:01.882 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T07:12:01.983 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T07:12:02.153 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 144/198 2024-03-27T07:12:02.184 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T07:12:02.207 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T07:12:02.207 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:02.207 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-27T07:12:02.207 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T07:12:02.207 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T07:12:02.207 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:12:02.251 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T07:12:02.262 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T07:12:02.307 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 147/198 2024-03-27T07:12:03.183 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-27T07:12:03.212 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T07:12:03.235 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T07:12:03.235 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:03.235 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-27T07:12:03.235 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T07:12:03.235 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T07:12:03.235 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:12:03.279 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T07:12:03.301 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T07:12:03.301 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:03.301 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-27T07:12:03.301 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:12:03.346 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T07:12:03.369 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T07:12:03.369 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:03.369 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-27T07:12:03.369 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T07:12:03.369 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T07:12:03.369 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:12:03.680 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T07:12:03.703 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T07:12:03.703 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:03.703 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-27T07:12:03.703 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T07:12:03.703 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T07:12:03.703 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:12:04.950 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T07:12:04.950 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-03-27T07:12:04.950 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-03-27T07:12:04.950 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-03-27T07:12:04.950 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-03-27T07:12:04.950 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-03-27T07:12:04.950 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-03-27T07:12:04.950 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-03-27T07:12:04.950 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:05.128 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T07:12:05.147 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T07:12:05.147 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:05.147 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-27T07:12:05.147 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:05.785 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T07:12:05.824 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 154/198 2024-03-27T07:12:05.855 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 155/198 2024-03-27T07:12:05.891 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-27T07:12:06.073 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 157/198 2024-03-27T07:12:06.184 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-27T07:12:06.224 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 159/198 2024-03-27T07:12:06.263 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-27T07:12:06.332 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-27T07:12:06.375 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-27T07:12:06.400 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 163/198 2024-03-27T07:12:06.432 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-27T07:12:06.462 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-27T07:12:06.508 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-27T07:12:06.569 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-27T07:12:06.607 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T07:12:06.611 INFO:teuthology.orchestra.run.smithi149.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-27T07:12:06.632 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T07:12:06.632 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:06.632 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-27T07:12:06.632 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T07:12:06.632 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T07:12:06.633 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:06.857 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T07:12:06.880 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T07:12:06.880 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:06.880 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-27T07:12:06.880 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T07:12:06.880 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T07:12:06.880 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:07.158 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T07:12:07.201 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T07:12:07.222 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T07:12:07.316 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T07:12:07.338 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T07:12:07.338 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:07.338 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-27T07:12:07.338 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T07:12:07.339 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T07:12:07.339 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-27T07:12:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T07:12:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T07:12:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 139/198 2024-03-27T07:12:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 140/198 2024-03-27T07:12:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T07:12:08.054 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 170/198 2024-03-27T07:12:08.121 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-27T07:12:08.162 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-27T07:12:08.176 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T07:12:08.218 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 154/198 2024-03-27T07:12:08.243 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-27T07:12:08.248 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 155/198 2024-03-27T07:12:08.275 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-27T07:12:08.283 INFO:teuthology.orchestra.run.smithi149.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-27T07:12:08.308 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-27T07:12:08.342 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-27T07:12:08.368 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-27T07:12:08.368 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T07:12:08.456 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T07:12:08.457 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 157/198 2024-03-27T07:12:08.486 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-27T07:12:08.486 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T07:12:08.571 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T07:12:08.574 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-27T07:12:08.597 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-27T07:12:08.614 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 159/198 2024-03-27T07:12:08.630 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-27T07:12:08.653 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-27T07:12:08.663 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-27T07:12:08.688 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-27T07:12:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-27T07:12:08.722 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-27T07:12:08.757 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-27T07:12:08.761 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-27T07:12:08.782 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 163/198 2024-03-27T07:12:08.793 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-27T07:12:08.814 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-27T07:12:08.818 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-27T07:12:08.844 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-27T07:12:08.844 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-27T07:12:08.869 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-27T07:12:08.894 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-27T07:12:08.898 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-27T07:12:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T07:12:08.901 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T07:12:08.950 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-27T07:12:08.993 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-27T07:12:09.056 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T07:12:09.089 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T07:12:09.089 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T07:12:09.091 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T07:12:09.155 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T07:12:09.180 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-27T07:12:09.213 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-27T07:12:09.240 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-27T07:12:09.266 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-27T07:12:09.329 INFO:teuthology.orchestra.run.smithi149.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T07:12:09.541 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T07:12:09.582 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T07:12:09.602 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T07:12:10.047 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T07:12:10.083 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T07:12:10.182 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T07:12:10.337 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 144/198 2024-03-27T07:12:10.377 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T07:12:10.400 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T07:12:10.400 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:10.400 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-27T07:12:10.400 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T07:12:10.400 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T07:12:10.401 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:10.436 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T07:12:10.443 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 170/198 2024-03-27T07:12:10.446 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T07:12:10.487 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 147/198 2024-03-27T07:12:10.526 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-27T07:12:10.567 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-27T07:12:10.650 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-27T07:12:10.689 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-27T07:12:10.713 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-27T07:12:10.739 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-27T07:12:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-27T07:12:10.765 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T07:12:10.853 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T07:12:10.883 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-27T07:12:10.883 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T07:12:10.968 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T07:12:10.994 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-27T07:12:11.035 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-27T07:12:11.061 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-27T07:12:11.085 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-27T07:12:11.119 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-27T07:12:11.158 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-27T07:12:11.190 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-27T07:12:11.215 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-27T07:12:11.241 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-27T07:12:11.266 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-27T07:12:11.291 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-27T07:12:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T07:12:11.298 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T07:12:11.345 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-27T07:12:11.371 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T07:12:11.394 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T07:12:11.394 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:11.394 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-27T07:12:11.394 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T07:12:11.394 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T07:12:11.395 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:11.439 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T07:12:11.461 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T07:12:11.461 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:11.461 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-27T07:12:11.461 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:11.477 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T07:12:11.477 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T07:12:11.506 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T07:12:11.528 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T07:12:11.529 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:11.529 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-27T07:12:11.529 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T07:12:11.529 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T07:12:11.529 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:11.552 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T07:12:11.577 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-27T07:12:11.608 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-27T07:12:11.628 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-27T07:12:11.662 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-27T07:12:11.734 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T07:12:11.841 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T07:12:11.863 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T07:12:11.863 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T07:12:11.863 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-27T07:12:11.863 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T07:12:11.863 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T07:12:11.863 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T07:12:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 1/198 2024-03-27T07:12:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2/198 2024-03-27T07:12:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 3/198 2024-03-27T07:12:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 4/198 2024-03-27T07:12:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2478.g15526 5/198 2024-03-27T07:12:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 6/198 2024-03-27T07:12:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 7/198 2024-03-27T07:12:14.817 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 8/198 2024-03-27T07:12:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 9/198 2024-03-27T07:12:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T07:12:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T07:12:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T07:12:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 13/198 2024-03-27T07:12:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 14/198 2024-03-27T07:12:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 15/198 2024-03-27T07:12:14.818 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 17/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 18/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 19/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 20/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 21/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 22/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 23/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 24/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 25/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 26/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 27/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 28/198 2024-03-27T07:12:14.819 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 29/198 2024-03-27T07:12:14.820 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 30/198 2024-03-27T07:12:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 31/198 2024-03-27T07:12:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 32/198 2024-03-27T07:12:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 33/198 2024-03-27T07:12:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 34/198 2024-03-27T07:12:14.835 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 35/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 36/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 37/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 38/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 39/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-27T07:12:14.836 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-27T07:12:14.837 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-27T07:12:14.838 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-27T07:12:14.839 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-27T07:12:14.840 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-27T07:12:14.841 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-27T07:12:14.842 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-27T07:12:14.843 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-27T07:12:14.844 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-27T07:12:14.845 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-27T07:12:14.846 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-27T07:12:14.847 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-27T07:12:14.848 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-27T07:12:14.848 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-27T07:12:16.319 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T07:12:16.360 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 154/198 2024-03-27T07:12:16.391 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 155/198 2024-03-27T07:12:16.419 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-27T07:12:16.612 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 157/198 2024-03-27T07:12:16.726 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-27T07:12:16.766 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 159/198 2024-03-27T07:12:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-27T07:12:16.875 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-27T07:12:16.910 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-27T07:12:16.943 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 163/198 2024-03-27T07:12:16.983 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-27T07:12:17.013 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-27T07:12:17.095 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-27T07:12:17.160 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-27T07:12:17.195 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-27T07:12:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T07:12:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 1/198 2024-03-27T07:12:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2/198 2024-03-27T07:12:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 3/198 2024-03-27T07:12:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 4/198 2024-03-27T07:12:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2478.g15526 5/198 2024-03-27T07:12:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 6/198 2024-03-27T07:12:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 7/198 2024-03-27T07:12:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 8/198 2024-03-27T07:12:17.247 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 9/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 13/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 14/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 15/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 17/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 18/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 19/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 20/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 21/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 22/198 2024-03-27T07:12:17.248 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 23/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 24/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 25/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 26/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 27/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 28/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 29/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 30/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 31/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 32/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 33/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 34/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 35/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 36/198 2024-03-27T07:12:17.249 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 37/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 38/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 39/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-27T07:12:17.250 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-27T07:12:17.251 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-27T07:12:17.252 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-27T07:12:17.253 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-27T07:12:17.254 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-27T07:12:17.255 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-27T07:12:17.256 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-27T07:12:17.257 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-27T07:12:17.258 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-27T07:12:17.259 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-27T07:12:17.260 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-27T07:12:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-27T07:12:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-27T07:12:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-27T07:12:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-27T07:12:17.261 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-27T07:12:17.847 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T07:12:17.887 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T07:12:17.906 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T07:12:17.970 INFO:teuthology.orchestra.run.smithi149.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-27T07:12:17.970 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:12:17.970 INFO:teuthology.orchestra.run.smithi149.stdout:Upgraded: 2024-03-27T07:12:17.970 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:17.970 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:17.970 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:17.970 INFO:teuthology.orchestra.run.smithi149.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:17.970 INFO:teuthology.orchestra.run.smithi149.stdout: acl-2.3.1-4.el9.x86_64 2024-03-27T07:12:17.970 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-27T07:12:17.971 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout:Installed: 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: automake-1.16.2-8.el9.noarch 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: bison-3.7.4-5.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.972 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-grafana-dashboards-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-immutable-object-cache-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.973 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: flex-2.6.4-9.el9.x86_64 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-27T07:12:17.974 INFO:teuthology.orchestra.run.smithi149.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: jq-1.6-16.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-27T07:12:17.975 INFO:teuthology.orchestra.run.smithi149.stdout: librados-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: lua-5.4.4-4.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-27T07:12:17.976 INFO:teuthology.orchestra.run.smithi149.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-13.14-1.el9.x86_64 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-27T07:12:17.977 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-argparse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-27T07:12:17.978 INFO:teuthology.orchestra.run.smithi149.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-27T07:12:17.979 INFO:teuthology.orchestra.run.smithi149.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-ply-3.11-14.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-27T07:12:17.980 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-27T07:12:17.981 INFO:teuthology.orchestra.run.smithi149.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: re2-1:20211101-3.el9.x86_64 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-27T07:12:17.982 INFO:teuthology.orchestra.run.smithi149.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-27T07:12:17.983 INFO:teuthology.orchestra.run.smithi149.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-27T07:12:17.983 INFO:teuthology.orchestra.run.smithi149.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-27T07:12:17.983 INFO:teuthology.orchestra.run.smithi149.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-27T07:12:17.983 INFO:teuthology.orchestra.run.smithi149.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-27T07:12:17.983 INFO:teuthology.orchestra.run.smithi149.stdout: 2024-03-27T07:12:17.983 INFO:teuthology.orchestra.run.smithi149.stdout:Complete! 2024-03-27T07:12:18.500 DEBUG:teuthology.parallel:result is None 2024-03-27T07:12:18.715 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 170/198 2024-03-27T07:12:18.790 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-27T07:12:18.831 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-27T07:12:18.919 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-27T07:12:18.952 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-27T07:12:18.977 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-27T07:12:19.003 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-27T07:12:19.029 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-27T07:12:19.029 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T07:12:19.125 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T07:12:19.155 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-27T07:12:19.155 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T07:12:19.231 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T07:12:19.258 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-27T07:12:19.299 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-27T07:12:19.325 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-27T07:12:19.350 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-27T07:12:19.385 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-27T07:12:19.422 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-27T07:12:19.454 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-27T07:12:19.496 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-27T07:12:19.522 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-27T07:12:19.547 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-27T07:12:19.572 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-27T07:12:19.579 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T07:12:19.579 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T07:12:19.767 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T07:12:19.767 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T07:12:19.850 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T07:12:19.875 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-27T07:12:19.907 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-27T07:12:19.934 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-27T07:12:19.959 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-27T07:12:20.025 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T07:12:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-27T07:12:20.124 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: acl-2.3.1-4.el9.x86_64 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-27T07:12:20.125 INFO:teuthology.orchestra.run.smithi153.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-27T07:12:20.126 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: automake-1.16.2-8.el9.noarch 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: bison-3.7.4-5.el9.x86_64 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:20.127 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.128 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: flex-2.6.4-9.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-27T07:12:20.129 INFO:teuthology.orchestra.run.smithi153.stdout: jq-1.6-16.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-27T07:12:20.130 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: lua-5.4.4-4.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-27T07:12:20.131 INFO:teuthology.orchestra.run.smithi153.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-13.14-1.el9.x86_64 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-27T07:12:20.132 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-27T07:12:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-27T07:12:20.134 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-27T07:12:20.135 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-27T07:12:20.136 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.137 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: re2-1:20211101-3.el9.x86_64 2024-03-27T07:12:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-27T07:12:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-27T07:12:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-27T07:12:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-27T07:12:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-27T07:12:20.138 INFO:teuthology.orchestra.run.smithi153.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-27T07:12:20.139 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:12:20.139 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-03-27T07:12:20.642 DEBUG:teuthology.parallel:result is None 2024-03-27T07:12:25.369 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T07:12:25.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 1/198 2024-03-27T07:12:25.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2/198 2024-03-27T07:12:25.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 3/198 2024-03-27T07:12:25.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 4/198 2024-03-27T07:12:25.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2478.g15526 5/198 2024-03-27T07:12:25.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 6/198 2024-03-27T07:12:25.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 7/198 2024-03-27T07:12:25.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 8/198 2024-03-27T07:12:25.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 9/198 2024-03-27T07:12:25.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 13/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 14/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 15/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 17/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 18/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 19/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 20/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 21/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 22/198 2024-03-27T07:12:25.371 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 23/198 2024-03-27T07:12:25.372 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 24/198 2024-03-27T07:12:25.372 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 25/198 2024-03-27T07:12:25.372 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 26/198 2024-03-27T07:12:25.372 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 27/198 2024-03-27T07:12:25.389 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 28/198 2024-03-27T07:12:25.389 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 29/198 2024-03-27T07:12:25.389 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 30/198 2024-03-27T07:12:25.389 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 31/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 32/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 33/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 34/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 35/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 36/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 37/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 38/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 39/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-27T07:12:25.390 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-27T07:12:25.391 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-27T07:12:25.392 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-27T07:12:25.393 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-27T07:12:25.394 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-27T07:12:25.395 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-27T07:12:25.396 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-27T07:12:25.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-27T07:12:25.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-27T07:12:25.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-27T07:12:25.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-27T07:12:25.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-27T07:12:25.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-27T07:12:25.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-27T07:12:25.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-27T07:12:25.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-27T07:12:25.397 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-27T07:12:25.398 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-27T07:12:25.399 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-27T07:12:25.400 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-27T07:12:25.401 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-27T07:12:25.402 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-27T07:12:28.435 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: acl-2.3.1-4.el9.x86_64 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-27T07:12:28.436 INFO:teuthology.orchestra.run.smithi082.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-27T07:12:28.437 INFO:teuthology.orchestra.run.smithi082.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:28.438 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.439 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-27T07:12:28.440 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.6-16.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.441 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-27T07:12:28.442 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.14-1.el9.x86_64 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-27T07:12:28.443 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-27T07:12:28.444 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-27T07:12:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-27T07:12:28.446 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-27T07:12:28.447 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.448 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.449 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T07:12:28.449 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-03-27T07:12:28.449 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-27T07:12:28.449 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-27T07:12:28.449 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-27T07:12:28.449 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-27T07:12:28.449 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-27T07:12:28.449 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-27T07:12:28.449 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:12:28.450 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-03-27T07:12:28.913 DEBUG:teuthology.parallel:result is None 2024-03-27T07:12:28.914 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:12:29.071 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-27T07:12:29.092 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-2478.g155268c4.el9 2024-03-27T07:12:29.092 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2478.g155268c4.el9 2024-03-27T07:12:29.093 INFO:teuthology.task.install:The correct ceph version 19.0.0-2478.g155268c4 is installed. 2024-03-27T07:12:29.094 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:12:29.326 DEBUG:teuthology.orchestra.run.smithi149:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-27T07:12:29.352 INFO:teuthology.orchestra.run.smithi149.stdout:19.0.0-2478.g155268c4.el9 2024-03-27T07:12:29.352 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2478.g155268c4.el9 2024-03-27T07:12:29.352 INFO:teuthology.task.install:The correct ceph version 19.0.0-2478.g155268c4 is installed. 2024-03-27T07:12:29.354 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:12:29.594 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-27T07:12:29.619 INFO:teuthology.orchestra.run.smithi153.stdout:19.0.0-2478.g155268c4.el9 2024-03-27T07:12:29.620 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2478.g155268c4.el9 2024-03-27T07:12:29.620 INFO:teuthology.task.install:The correct ceph version 19.0.0-2478.g155268c4 is installed. 2024-03-27T07:12:29.622 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-27T07:12:29.622 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:12:29.622 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-27T07:12:29.653 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:12:29.654 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-27T07:12:29.689 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:12:29.689 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-27T07:12:29.723 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-27T07:12:29.723 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:12:29.724 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-03-27T07:12:29.751 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-27T07:12:29.820 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:12:29.820 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/daemon-helper 2024-03-27T07:12:29.851 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-27T07:12:29.921 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:12:29.921 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-03-27T07:12:29.952 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-27T07:12:30.022 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-27T07:12:30.023 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:12:30.023 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-27T07:12:30.050 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-27T07:12:30.117 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:12:30.117 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-27T07:12:30.145 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-27T07:12:30.213 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:12:30.213 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-27T07:12:30.243 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-27T07:12:30.315 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-27T07:12:30.315 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:12:30.316 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-03-27T07:12:30.343 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-27T07:12:30.410 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:12:30.410 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/usr/bin/stdin-killer 2024-03-27T07:12:30.438 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-27T07:12:30.506 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:12:30.507 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-03-27T07:12:30.538 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-27T07:12:30.609 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-27T07:12:30.906 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-03-27T07:12:30.907 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:12:30.907 INFO:tasks.cephadm:Cluster fsid is 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:12:30.908 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-27T07:12:30.908 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.82', 'mon.b': '172.21.15.149', 'mon.c': '172.21.15.153'} 2024-03-27T07:12:30.908 INFO:tasks.cephadm:First mon is mon.a on smithi082 2024-03-27T07:12:30.908 INFO:tasks.cephadm:First mgr is x 2024-03-27T07:12:30.909 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-27T07:12:30.909 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-03-27T07:12:30.938 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname $(hostname -s) 2024-03-27T07:12:30.966 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname $(hostname -s) 2024-03-27T07:12:30.998 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-03-27T07:12:30.999 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:12:31.136 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77988/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2478-g155268c4', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2478.g155268c4'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-26 19:55:12.154042', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240326.131558', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-27T07:12:31.360 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-rishabh-testing-20240326.131558, sha1 155268c4e432a12433aa833f174f9fe3b1016ae0 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:12:31.362 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/x86_64/flavors/default/cephadm 2024-03-27T07:12:31.362 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-27T07:12:32.390 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 781299 Mar 27 07:12 /home/ubuntu/cephtest/cephadm 2024-03-27T07:12:32.390 DEBUG:teuthology.orchestra.run.smithi149:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-27T07:12:33.270 INFO:teuthology.orchestra.run.smithi149.stdout:-rw-r--r--. 1 ubuntu ubuntu 781299 Mar 27 07:12 /home/ubuntu/cephtest/cephadm 2024-03-27T07:12:33.270 DEBUG:teuthology.orchestra.run.smithi153:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-27T07:12:34.176 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r--. 1 ubuntu ubuntu 781299 Mar 27 07:12 /home/ubuntu/cephtest/cephadm 2024-03-27T07:12:34.177 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-27T07:12:34.195 DEBUG:teuthology.orchestra.run.smithi149:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-27T07:12:34.214 DEBUG:teuthology.orchestra.run.smithi153:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-27T07:12:34.251 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 on all hosts... 2024-03-27T07:12:34.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 pull 2024-03-27T07:12:34.254 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 pull 2024-03-27T07:12:34.257 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 pull 2024-03-27T07:12:35.108 INFO:teuthology.orchestra.run.smithi149.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0... 2024-03-27T07:12:35.245 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0... 2024-03-27T07:12:35.431 INFO:teuthology.orchestra.run.smithi153.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0... 2024-03-27T07:13:04.280 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:13:04.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T07:13:04.281 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801", 2024-03-27T07:13:04.281 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-03-27T07:13:04.281 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772" 2024-03-27T07:13:04.281 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:13:04.281 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:13:07.602 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-03-27T07:13:07.603 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T07:13:07.603 INFO:teuthology.orchestra.run.smithi149.stdout: "image_id": "b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801", 2024-03-27T07:13:07.603 INFO:teuthology.orchestra.run.smithi149.stdout: "repo_digests": [ 2024-03-27T07:13:07.603 INFO:teuthology.orchestra.run.smithi149.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772" 2024-03-27T07:13:07.603 INFO:teuthology.orchestra.run.smithi149.stdout: ] 2024-03-27T07:13:07.603 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-03-27T07:13:13.919 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-27T07:13:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T07:13:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: "image_id": "b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801", 2024-03-27T07:13:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: "repo_digests": [ 2024-03-27T07:13:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772" 2024-03-27T07:13:13.919 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-03-27T07:13:13.919 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-27T07:13:13.943 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-03-27T07:13:13.979 DEBUG:teuthology.orchestra.run.smithi149:> sudo mkdir -p /etc/ceph 2024-03-27T07:13:14.012 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph 2024-03-27T07:13:14.041 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-03-27T07:13:14.072 DEBUG:teuthology.orchestra.run.smithi149:> sudo chmod 777 /etc/ceph 2024-03-27T07:13:14.103 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /etc/ceph 2024-03-27T07:13:14.130 INFO:tasks.cephadm:Writing seed config... 2024-03-27T07:13:14.131 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-03-27T07:13:14.131 INFO:tasks.cephadm: override: [client] debug client = 20 2024-03-27T07:13:14.131 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-27T07:13:14.131 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-03-27T07:13:14.131 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-03-27T07:13:14.131 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-03-27T07:13:14.132 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-03-27T07:13:14.133 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-27T07:13:14.134 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-03-27T07:13:14.135 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:13:14.135 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-27T07:13:14.158 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 604548c2-ec09-11ee-95d0-87774f69a715 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-03-27T07:13:14.159 DEBUG:teuthology.orchestra.run.smithi082:mon.a> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.a.service 2024-03-27T07:13:14.202 DEBUG:teuthology.orchestra.run.smithi082:mgr.x> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.x.service 2024-03-27T07:13:14.245 INFO:tasks.cephadm:Bootstrapping... 2024-03-27T07:13:14.245 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 -v bootstrap --fsid 604548c2-ec09-11ee-95d0-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.82 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-27T07:13:14.440 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-03-27T07:13:14.440 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0', '-v', 'bootstrap', '--fsid', '604548c2-ec09-11ee-95d0-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.82', '--skip-admin-label'] 2024-03-27T07:13:14.441 INFO:teuthology.orchestra.run.smithi082.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-27T07:13:14.441 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying podman|docker is present... 2024-03-27T07:13:14.466 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-27T07:13:14.466 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying lvm2 is present... 2024-03-27T07:13:14.466 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying time synchronization is in place... 2024-03-27T07:13:14.474 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-27T07:13:14.474 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-27T07:13:14.479 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-27T07:13:14.480 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-27T07:13:14.486 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-03-27T07:13:14.492 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-03-27T07:13:14.492 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-03-27T07:13:14.492 INFO:teuthology.orchestra.run.smithi082.stdout:Repeating the final host check... 2024-03-27T07:13:14.515 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-27T07:13:14.515 INFO:teuthology.orchestra.run.smithi082.stdout:podman (/bin/podman) version 4.9.4 is present 2024-03-27T07:13:14.515 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl is present 2024-03-27T07:13:14.515 INFO:teuthology.orchestra.run.smithi082.stdout:lvcreate is present 2024-03-27T07:13:14.521 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-27T07:13:14.521 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-27T07:13:14.527 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-27T07:13:14.527 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-27T07:13:14.533 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-03-27T07:13:14.541 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-03-27T07:13:14.541 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-03-27T07:13:14.541 INFO:teuthology.orchestra.run.smithi082.stdout:Host looks OK 2024-03-27T07:13:14.541 INFO:teuthology.orchestra.run.smithi082.stdout:Cluster fsid: 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:13:14.541 INFO:teuthology.orchestra.run.smithi082.stdout:Acquiring lock 139721446236848 on /run/cephadm/604548c2-ec09-11ee-95d0-87774f69a715.lock 2024-03-27T07:13:14.541 INFO:teuthology.orchestra.run.smithi082.stdout:Lock 139721446236848 acquired on /run/cephadm/604548c2-ec09-11ee-95d0-87774f69a715.lock 2024-03-27T07:13:14.541 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 3300 ... 2024-03-27T07:13:14.541 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 6789 ... 2024-03-27T07:13:14.542 INFO:teuthology.orchestra.run.smithi082.stdout:Base mon IP(s) is [172.21.15.82:3300, 172.21.15.82:6789], mon addrv is [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-03-27T07:13:14.544 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.82 metric 100 2024-03-27T07:13:14.544 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.82 metric 100 2024-03-27T07:13:14.547 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-27T07:13:14.548 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-03-27T07:13:14.548 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1779sec hoplimit 64 pref medium 2024-03-27T07:13:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-27T07:13:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-27T07:13:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-27T07:13:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-03-27T07:13:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-03-27T07:13:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-27T07:13:14.550 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-03-27T07:13:14.551 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-03-27T07:13:14.551 INFO:teuthology.orchestra.run.smithi082.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-27T07:13:14.551 INFO:teuthology.orchestra.run.smithi082.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-27T07:13:14.551 INFO:teuthology.orchestra.run.smithi082.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0... 2024-03-27T07:13:15.552 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 2024-03-27T07:13:15.552 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0... 2024-03-27T07:13:15.552 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Getting image source signatures 2024-03-27T07:13:15.552 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:e605917547793151c989dc0ed66d07767a9fed5a2365fd05914b705e7a7b6e21 2024-03-27T07:13:15.552 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:11da15500eca1f826c328eb3265caa30b0a3730510e2a32023084d6fe9cee20c 2024-03-27T07:13:15.552 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying config sha256:b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 2024-03-27T07:13:15.552 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-27T07:13:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:ceph: stdout ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev) 2024-03-27T07:13:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph version: ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev) 2024-03-27T07:13:16.422 INFO:teuthology.orchestra.run.smithi082.stdout:Extracting ceph user uid/gid from container image... 2024-03-27T07:13:17.235 INFO:teuthology.orchestra.run.smithi082.stdout:stat: stdout 167 167 2024-03-27T07:13:17.235 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial keys... 2024-03-27T07:13:18.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQANxwNmeSttIRAAps163YMFh6No0WcQwLSAcg== 2024-03-27T07:13:19.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQAOxwNmLexUGhAAm+LsAYd30LWw1m5PU6xqDA== 2024-03-27T07:13:20.030 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQAPxwNm5yzSFhAAeo0YCNvlQcYXkch+SBy3+w== 2024-03-27T07:13:20.030 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial monmap... 2024-03-27T07:13:21.076 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-27T07:13:21.076 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-27T07:13:21.076 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:13:21.076 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-27T07:13:21.076 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool for a [v2:172.21.15.82:3300,v1:172.21.15.82:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-27T07:13:21.076 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = quincy 2024-03-27T07:13:21.077 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: set fsid to 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:13:21.077 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-27T07:13:21.077 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:13:21.077 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mon... 2024-03-27T07:13:22.006 INFO:teuthology.orchestra.run.smithi082.stdout:create mon.a on 2024-03-27T07:13:22.212 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-27T07:13:22.344 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-27T07:13:22.505 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-604548c2-ec09-11ee-95d0-87774f69a715.target → /etc/systemd/system/ceph-604548c2-ec09-11ee-95d0-87774f69a715.target. 2024-03-27T07:13:22.506 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-604548c2-ec09-11ee-95d0-87774f69a715.target → /etc/systemd/system/ceph-604548c2-ec09-11ee-95d0-87774f69a715.target. 2024-03-27T07:13:22.746 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.a 2024-03-27T07:13:22.746 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.a.service: Unit ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.a.service not loaded. 2024-03-27T07:13:22.911 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-604548c2-ec09-11ee-95d0-87774f69a715.target.wants/ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.a.service → /etc/systemd/system/ceph-604548c2-ec09-11ee-95d0-87774f69a715@.service. 2024-03-27T07:13:23.471 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-27T07:13:23.471 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-03-27T07:13:23.478 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-27T07:13:23.478 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-27T07:13:23.478 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-03-27T07:13:23.478 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-03-27T07:13:23.479 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon to start... 2024-03-27T07:13:23.479 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon... 2024-03-27T07:13:24.572 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout cluster: 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout id: 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout services: 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.56869s) 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout data: 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-27T07:13:24.573 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pgs: 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.943+0000 7f7761dc8700 1 Processor -- start 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.943+0000 7f7761dc8700 1 -- start start 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.943+0000 7f7761dc8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c10af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.944+0000 7f7761dc8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f775c07be60 con 0x7f775c108b50 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.944+0000 7f775b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c10af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.944+0000 7f775b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c10af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38516/0 (socket says 172.21.15.82:38516) 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.944+0000 7f775b7fe700 1 -- 172.21.15.82:0/4246029364 learned_addr learned my addr 172.21.15.82:0/4246029364 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.944+0000 7f775b7fe700 1 -- 172.21.15.82:0/4246029364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c10b480 con 0x7f775c108b50 2024-03-27T07:13:24.574 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.944+0000 7f775b7fe700 1 --2- 172.21.15.82:0/4246029364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c10af40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f774c0098a0 tx=0x7f774c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d6f280043dc8d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.944+0000 7f775a7fc700 1 -- 172.21.15.82:0/4246029364 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c004160 con 0x7f775c108b50 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.945+0000 7f775a7fc700 1 -- 172.21.15.82:0/4246029364 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c004300 con 0x7f775c108b50 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.945+0000 7f775a7fc700 1 -- 172.21.15.82:0/4246029364 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c0036a0 con 0x7f775c108b50 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.945+0000 7f7761dc8700 1 -- 172.21.15.82:0/4246029364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 msgr2=0x7f775c10af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.945+0000 7f7761dc8700 1 --2- 172.21.15.82:0/4246029364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c10af40 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f774c0098a0 tx=0x7f774c009bb0 comp rx=0 tx=0).stop 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.945+0000 7f7761dc8700 1 -- 172.21.15.82:0/4246029364 shutdown_connections 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.945+0000 7f7761dc8700 1 --2- 172.21.15.82:0/4246029364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c10af40 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.945+0000 7f7761dc8700 1 -- 172.21.15.82:0/4246029364 >> 172.21.15.82:0/4246029364 conn(0x7f775c102580 msgr2=0x7f775c1049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.945+0000 7f7761dc8700 1 -- 172.21.15.82:0/4246029364 shutdown_connections 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.945+0000 7f7761dc8700 1 -- 172.21.15.82:0/4246029364 wait complete. 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.946+0000 7f7761dc8700 1 Processor -- start 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.946+0000 7f7761dc8700 1 -- start start 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.946+0000 7f7761dc8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c19b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.946+0000 7f7761dc8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f775c10b8f0 con 0x7f775c108b50 2024-03-27T07:13:24.575 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.946+0000 7f775b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c19b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.946+0000 7f775b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c19b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38522/0 (socket says 172.21.15.82:38522) 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.946+0000 7f775b7fe700 1 -- 172.21.15.82:0/1315056131 learned_addr learned my addr 172.21.15.82:0/1315056131 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.947+0000 7f775b7fe700 1 -- 172.21.15.82:0/1315056131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c19bcc0 con 0x7f775c108b50 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.947+0000 7f775b7fe700 1 --2- 172.21.15.82:0/1315056131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c19b780 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f774c000c00 tx=0x7f774c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.947+0000 7f7758ff9700 1 -- 172.21.15.82:0/1315056131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c003db0 con 0x7f775c108b50 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.947+0000 7f7758ff9700 1 -- 172.21.15.82:0/1315056131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c011630 con 0x7f775c108b50 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.947+0000 7f7758ff9700 1 -- 172.21.15.82:0/1315056131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f774c011950 con 0x7f775c108b50 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.947+0000 7f7761dc8700 1 -- 172.21.15.82:0/1315056131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c19bf50 con 0x7f775c108b50 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.947+0000 7f7761dc8700 1 -- 172.21.15.82:0/1315056131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c19ec40 con 0x7f775c108b50 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.947+0000 7f7758ff9700 1 -- 172.21.15.82:0/1315056131 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f774c011af0 con 0x7f775c108b50 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.947+0000 7f7758ff9700 1 -- 172.21.15.82:0/1315056131 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f774c01c450 con 0x7f775c108b50 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.948+0000 7f7761dc8700 1 -- 172.21.15.82:0/1315056131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775c069740 con 0x7f775c108b50 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:23.950+0000 7f7758ff9700 1 -- 172.21.15.82:0/1315056131 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f774c032020 con 0x7f775c108b50 2024-03-27T07:13:24.576 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.021+0000 7f7761dc8700 1 -- 172.21.15.82:0/1315056131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f775c02deb0 con 0x7f775c108b50 2024-03-27T07:13:24.577 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.022+0000 7f7758ff9700 1 -- 172.21.15.82:0/1315056131 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7f774c004260 con 0x7f775c108b50 2024-03-27T07:13:24.577 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.023+0000 7f7761dc8700 1 -- 172.21.15.82:0/1315056131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 msgr2=0x7f775c19b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:24.577 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.023+0000 7f7761dc8700 1 --2- 172.21.15.82:0/1315056131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c19b780 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f774c000c00 tx=0x7f774c004750 comp rx=0 tx=0).stop 2024-03-27T07:13:24.577 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.023+0000 7f7761dc8700 1 -- 172.21.15.82:0/1315056131 shutdown_connections 2024-03-27T07:13:24.577 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.023+0000 7f7761dc8700 1 --2- 172.21.15.82:0/1315056131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f775c108b50 0x7f775c19b780 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:24.577 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.023+0000 7f7761dc8700 1 -- 172.21.15.82:0/1315056131 >> 172.21.15.82:0/1315056131 conn(0x7f775c102580 msgr2=0x7f775c1048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:24.577 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.023+0000 7f7761dc8700 1 -- 172.21.15.82:0/1315056131 shutdown_connections 2024-03-27T07:13:24.577 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.023+0000 7f7761dc8700 1 -- 172.21.15.82:0/1315056131 wait complete. 2024-03-27T07:13:24.577 INFO:teuthology.orchestra.run.smithi082.stdout:mon is available 2024-03-27T07:13:24.577 INFO:teuthology.orchestra.run.smithi082.stdout:Assimilating anything we can from ceph.conf... 2024-03-27T07:13:25.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:25 smithi082 ceph-mon[31791]: from='client.? 172.21.15.82:0/4206226992' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-27T07:13:28.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:28.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-03-27T07:13:28.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:13:28.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-03-27T07:13:28.777 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-27T07:13:28.778 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.997+0000 7f8d46ed1700 1 Processor -- start 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.998+0000 7f8d46ed1700 1 -- start start 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.998+0000 7f8d46ed1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d40108950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.998+0000 7f8d46ed1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d40108f20 con 0x7f8d40108530 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.998+0000 7f8d44c6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d40108950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.998+0000 7f8d44c6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d40108950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38524/0 (socket says 172.21.15.82:38524) 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.998+0000 7f8d44c6d700 1 -- 172.21.15.82:0/2625846558 learned_addr learned my addr 172.21.15.82:0/2625846558 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.998+0000 7f8d44c6d700 1 -- 172.21.15.82:0/2625846558 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d40107190 con 0x7f8d40108530 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.998+0000 7f8d44c6d700 1 --2- 172.21.15.82:0/2625846558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d40108950 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8d340098a0 tx=0x7f8d34009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3367c63cf6713ca9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.999+0000 7f8d3f7fe700 1 -- 172.21.15.82:0/2625846558 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d34004160 con 0x7f8d40108530 2024-03-27T07:13:28.779 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.999+0000 7f8d3f7fe700 1 -- 172.21.15.82:0/2625846558 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d34004300 con 0x7f8d40108530 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.999+0000 7f8d3f7fe700 1 -- 172.21.15.82:0/2625846558 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d340036a0 con 0x7f8d40108530 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.999+0000 7f8d46ed1700 1 -- 172.21.15.82:0/2625846558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 msgr2=0x7f8d40108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.999+0000 7f8d46ed1700 1 --2- 172.21.15.82:0/2625846558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d40108950 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f8d340098a0 tx=0x7f8d34009bb0 comp rx=0 tx=0).stop 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.999+0000 7f8d46ed1700 1 -- 172.21.15.82:0/2625846558 shutdown_connections 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.999+0000 7f8d46ed1700 1 --2- 172.21.15.82:0/2625846558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d40108950 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.999+0000 7f8d46ed1700 1 -- 172.21.15.82:0/2625846558 >> 172.21.15.82:0/2625846558 conn(0x7f8d40101d20 msgr2=0x7f8d40104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.999+0000 7f8d46ed1700 1 -- 172.21.15.82:0/2625846558 shutdown_connections 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:24.999+0000 7f8d46ed1700 1 -- 172.21.15.82:0/2625846558 wait complete. 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.000+0000 7f8d46ed1700 1 Processor -- start 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.000+0000 7f8d46ed1700 1 -- start start 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.000+0000 7f8d46ed1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d4019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.000+0000 7f8d46ed1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d401076c0 con 0x7f8d40108530 2024-03-27T07:13:28.780 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.000+0000 7f8d44c6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d4019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.000+0000 7f8d44c6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d4019a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38536/0 (socket says 172.21.15.82:38536) 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.000+0000 7f8d44c6d700 1 -- 172.21.15.82:0/4206226992 learned_addr learned my addr 172.21.15.82:0/4206226992 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.000+0000 7f8d44c6d700 1 -- 172.21.15.82:0/4206226992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4019ac60 con 0x7f8d40108530 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.000+0000 7f8d44c6d700 1 --2- 172.21.15.82:0/4206226992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d4019a720 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8d34000c00 tx=0x7f8d34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.001+0000 7f8d3dffb700 1 -- 172.21.15.82:0/4206226992 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d34003db0 con 0x7f8d40108530 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.001+0000 7f8d3dffb700 1 -- 172.21.15.82:0/4206226992 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d34011630 con 0x7f8d40108530 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.001+0000 7f8d46ed1700 1 -- 172.21.15.82:0/4206226992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4019aef0 con 0x7f8d40108530 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.001+0000 7f8d3dffb700 1 -- 172.21.15.82:0/4206226992 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d34011950 con 0x7f8d40108530 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.001+0000 7f8d46ed1700 1 -- 172.21.15.82:0/4206226992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4019dbe0 con 0x7f8d40108530 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.001+0000 7f8d3dffb700 1 -- 172.21.15.82:0/4206226992 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8d3401a460 con 0x7f8d40108530 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.001+0000 7f8d3dffb700 1 -- 172.21.15.82:0/4206226992 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8d3401b780 con 0x7f8d40108530 2024-03-27T07:13:28.781 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.002+0000 7f8d46ed1700 1 -- 172.21.15.82:0/4206226992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d40069740 con 0x7f8d40108530 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.004+0000 7f8d3dffb700 1 -- 172.21.15.82:0/4206226992 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8d34031020 con 0x7f8d40108530 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.071+0000 7f8d46ed1700 1 -- 172.21.15.82:0/4206226992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f8d4002de80 con 0x7f8d40108530 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.074+0000 7f8d3dffb700 1 -- 172.21.15.82:0/4206226992 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f8d3401b980 con 0x7f8d40108530 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.075+0000 7f8d3dffb700 1 -- 172.21.15.82:0/4206226992 <== mon.0 v2:172.21.15.82:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d3401ad50 con 0x7f8d40108530 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.075+0000 7f8d46ed1700 1 -- 172.21.15.82:0/4206226992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 msgr2=0x7f8d4019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.075+0000 7f8d46ed1700 1 --2- 172.21.15.82:0/4206226992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d4019a720 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f8d34000c00 tx=0x7f8d34004750 comp rx=0 tx=0).stop 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.075+0000 7f8d46ed1700 1 -- 172.21.15.82:0/4206226992 shutdown_connections 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.075+0000 7f8d46ed1700 1 --2- 172.21.15.82:0/4206226992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d40108530 0x7f8d4019a720 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.075+0000 7f8d46ed1700 1 -- 172.21.15.82:0/4206226992 >> 172.21.15.82:0/4206226992 conn(0x7f8d40101d20 msgr2=0x7f8d40191300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.076+0000 7f8d46ed1700 1 -- 172.21.15.82:0/4206226992 shutdown_connections 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:25.076+0000 7f8d46ed1700 1 -- 172.21.15.82:0/4206226992 wait complete. 2024-03-27T07:13:28.782 INFO:teuthology.orchestra.run.smithi082.stdout:Generating new minimal ceph.conf... 2024-03-27T07:13:32.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:31 smithi082 ceph-mon[31791]: from='client.? 172.21.15.82:0/2466413467' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:13:35.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.795+0000 7f0816133700 1 Processor -- start 2024-03-27T07:13:35.871 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.795+0000 7f0816133700 1 -- start start 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.795+0000 7f0816133700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f0810108500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.795+0000 7f0816133700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0810108ad0 con 0x7f08101080e0 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.796+0000 7f080f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f0810108500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.796+0000 7f080f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f0810108500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38270/0 (socket says 172.21.15.82:38270) 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.796+0000 7f080f7fe700 1 -- 172.21.15.82:0/3540158538 learned_addr learned my addr 172.21.15.82:0/3540158538 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.796+0000 7f080f7fe700 1 -- 172.21.15.82:0/3540158538 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0810109290 con 0x7f08101080e0 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.796+0000 7f080f7fe700 1 --2- 172.21.15.82:0/3540158538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f0810108500 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0800009e80 tx=0x7f080000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeb8390346710c84 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.796+0000 7f080e7fc700 1 -- 172.21.15.82:0/3540158538 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0800017070 con 0x7f08101080e0 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.796+0000 7f080e7fc700 1 -- 172.21.15.82:0/3540158538 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f080000b8c0 con 0x7f08101080e0 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.796+0000 7f080e7fc700 1 -- 172.21.15.82:0/3540158538 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08000045c0 con 0x7f08101080e0 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.797+0000 7f0816133700 1 -- 172.21.15.82:0/3540158538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 msgr2=0x7f0810108500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.797+0000 7f0816133700 1 --2- 172.21.15.82:0/3540158538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f0810108500 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0800009e80 tx=0x7f080000b330 comp rx=0 tx=0).stop 2024-03-27T07:13:35.872 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.797+0000 7f0816133700 1 -- 172.21.15.82:0/3540158538 shutdown_connections 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.797+0000 7f0816133700 1 --2- 172.21.15.82:0/3540158538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f0810108500 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.797+0000 7f0816133700 1 -- 172.21.15.82:0/3540158538 >> 172.21.15.82:0/3540158538 conn(0x7f0810103700 msgr2=0x7f0810105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.797+0000 7f0816133700 1 -- 172.21.15.82:0/3540158538 shutdown_connections 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.797+0000 7f0816133700 1 -- 172.21.15.82:0/3540158538 wait complete. 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.797+0000 7f0816133700 1 Processor -- start 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f0816133700 1 -- start start 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f0816133700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f081007db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f0816133700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f081010c640 con 0x7f08101080e0 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f080f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f081007db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f080f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f081007db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38276/0 (socket says 172.21.15.82:38276) 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f080f7fe700 1 -- 172.21.15.82:0/2466413467 learned_addr learned my addr 172.21.15.82:0/2466413467 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f080f7fe700 1 -- 172.21.15.82:0/2466413467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081007e0a0 con 0x7f08101080e0 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f080f7fe700 1 --2- 172.21.15.82:0/2466413467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f081007db60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0800009e50 tx=0x7f080000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f080cff9700 1 -- 172.21.15.82:0/2466413467 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0800020020 con 0x7f08101080e0 2024-03-27T07:13:35.873 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f080cff9700 1 -- 172.21.15.82:0/2466413467 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0800003b50 con 0x7f08101080e0 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f0816133700 1 -- 172.21.15.82:0/2466413467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081007c290 con 0x7f08101080e0 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f080cff9700 1 -- 172.21.15.82:0/2466413467 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0800017040 con 0x7f08101080e0 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.798+0000 7f0816133700 1 -- 172.21.15.82:0/2466413467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f081007c7d0 con 0x7f08101080e0 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.799+0000 7f080cff9700 1 -- 172.21.15.82:0/2466413467 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0800023020 con 0x7f08101080e0 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.799+0000 7f080cff9700 1 -- 172.21.15.82:0/2466413467 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f080000f050 con 0x7f08101080e0 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.799+0000 7f0816133700 1 -- 172.21.15.82:0/2466413467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0810069740 con 0x7f08101080e0 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.802+0000 7f080cff9700 1 -- 172.21.15.82:0/2466413467 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f080002a020 con 0x7f08101080e0 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.869+0000 7f0816133700 1 -- 172.21.15.82:0/2466413467 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f081007ca20 con 0x7f08101080e0 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.869+0000 7f080cff9700 1 -- 172.21.15.82:0/2466413467 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f0800003d00 con 0x7f08101080e0 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.870+0000 7f0816133700 1 -- 172.21.15.82:0/2466413467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 msgr2=0x7f081007db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.870+0000 7f0816133700 1 --2- 172.21.15.82:0/2466413467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f081007db60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0800009e50 tx=0x7f080000bd30 comp rx=0 tx=0).stop 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.870+0000 7f0816133700 1 -- 172.21.15.82:0/2466413467 shutdown_connections 2024-03-27T07:13:35.874 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.870+0000 7f0816133700 1 --2- 172.21.15.82:0/2466413467 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08101080e0 0x7f081007db60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:35.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.870+0000 7f0816133700 1 -- 172.21.15.82:0/2466413467 >> 172.21.15.82:0/2466413467 conn(0x7f0810103700 msgr2=0x7f0810104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:35.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.870+0000 7f0816133700 1 -- 172.21.15.82:0/2466413467 shutdown_connections 2024-03-27T07:13:35.875 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:31.870+0000 7f0816133700 1 -- 172.21.15.82:0/2466413467 wait complete. 2024-03-27T07:13:35.875 INFO:teuthology.orchestra.run.smithi082.stdout:Restarting the monitor... 2024-03-27T07:13:36.159 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:35 smithi082 systemd[1]: Stopping Ceph mon.a for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:13:36.424 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:36 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[31786]: 2024-03-27T07:13:36.158+0000 7f8f9f344700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:13:36.424 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:36 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[31786]: 2024-03-27T07:13:36.158+0000 7f8f9f344700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-27T07:13:36.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:36 smithi082 podman[32050]: 2024-03-27 07:13:36.424395532 +0000 UTC m=+0.388682632 container died e01bc6d53c59af25293a80367b5dd7f54edaa2dfdf11a55980e7adbc89654769 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-27T07:13:37.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:36 smithi082 podman[32050]: 2024-03-27 07:13:36.800255186 +0000 UTC m=+0.764542330 container cleanup e01bc6d53c59af25293a80367b5dd7f54edaa2dfdf11a55980e7adbc89654769 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-03-27T07:13:37.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:36 smithi082 bash[32050]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a 2024-03-27T07:13:37.360 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 podman[32064]: 2024-03-27 07:13:37.026059007 +0000 UTC m=+0.602103006 container remove e01bc6d53c59af25293a80367b5dd7f54edaa2dfdf11a55980e7adbc89654769 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0) 2024-03-27T07:13:37.360 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.a.service: Deactivated successfully. 2024-03-27T07:13:37.360 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 systemd[1]: Stopped Ceph mon.a for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:13:37.360 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 systemd[1]: Starting Ceph mon.a for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:13:37.575 INFO:teuthology.orchestra.run.smithi082.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-27T07:13:37.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 podman[32158]: 2024-03-27 07:13:37.360170827 +0000 UTC m=+0.101963495 container create 08307e622ef7c77f8bf2bf7650cb34ae4cda8cccac45c8389970ad8f38076622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-03-27T07:13:37.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 podman[32158]: 2024-03-27 07:13:37.276036102 +0000 UTC m=+0.017828783 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:13:37.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 podman[32158]: 2024-03-27 07:13:37.520949166 +0000 UTC m=+0.262741834 container init 08307e622ef7c77f8bf2bf7650cb34ae4cda8cccac45c8389970ad8f38076622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-27T07:13:37.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 podman[32158]: 2024-03-27 07:13:37.523707223 +0000 UTC m=+0.265499891 container start 08307e622ef7c77f8bf2bf7650cb34ae4cda8cccac45c8389970ad8f38076622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:13:37.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: set uid:gid to 167:167 (ceph:ceph) 2024-03-27T07:13:37.640 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev), process ceph-mon, pid 2 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: pidfile_write: ignore empty --pid-file 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: load: jerasure load: lrc 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: RocksDB version: 7.9.2 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Git sha 0 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Compile date 2024-03-26 18:55:08 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: DB SUMMARY 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: DB Session ID: 8C5TQPB6UHB0AG3R0GBY 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: CURRENT file: CURRENT 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: IDENTITY file: IDENTITY 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105644 ; 2024-03-27T07:13:37.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.error_if_exists: 0 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.create_if_missing: 0 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.paranoid_checks: 1 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.env: 0x5560842f7c60 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.fs: PosixFileSystem 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.info_log: 0x5560868f9ae0 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_file_opening_threads: 16 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.statistics: (nil) 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.use_fsync: 0 2024-03-27T07:13:37.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_log_file_size: 0 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.keep_log_file_num: 1000 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.recycle_log_file_num: 0 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.allow_fallocate: 1 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.allow_mmap_reads: 0 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.allow_mmap_writes: 0 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.use_direct_reads: 0 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.create_missing_column_families: 0 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.db_log_dir: 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.wal_dir: 2024-03-27T07:13:37.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.advise_random_on_open: 1 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.db_write_buffer_size: 0 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.write_buffer_manager: 0x5560868ca1e0 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.rate_limiter: (nil) 2024-03-27T07:13:37.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.wal_recovery_mode: 2 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.enable_thread_tracking: 0 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.enable_pipelined_write: 0 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.unordered_write: 0 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.row_cache: None 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.wal_filter: None 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.allow_ingest_behind: 0 2024-03-27T07:13:37.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.two_write_queues: 0 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.manual_wal_flush: 0 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.wal_compression: 0 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.atomic_flush: 0 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.log_readahead_size: 0 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.best_efforts_recovery: 0 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.allow_data_in_errors: 0 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.db_host_id: __hostname__ 2024-03-27T07:13:37.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_background_jobs: 2 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_background_compactions: -1 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_subcompactions: 1 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_total_wal_size: 0 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_open_files: -1 2024-03-27T07:13:37.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bytes_per_sync: 0 2024-03-27T07:13:37.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-27T07:13:37.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-27T07:13:37.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_readahead_size: 0 2024-03-27T07:13:37.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_background_flushes: -1 2024-03-27T07:13:37.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Compression algorithms supported: 2024-03-27T07:13:37.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-27T07:13:37.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: kZSTD supported: 0 2024-03-27T07:13:37.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: kXpressCompression supported: 0 2024-03-27T07:13:37.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: kLZ4HCCompression supported: 1 2024-03-27T07:13:37.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: kZlibCompression supported: 1 2024-03-27T07:13:37.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: kSnappyCompression supported: 1 2024-03-27T07:13:37.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: kLZ4Compression supported: 1 2024-03-27T07:13:37.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: kBZip2Compression supported: 0 2024-03-27T07:13:37.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-27T07:13:37.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-27T07:13:37.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-27T07:13:37.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.merge_operator: 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_filter: None 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_filter_factory: None 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.sst_partitioner_factory: None 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5560868f9cc0) 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-03-27T07:13:37.651 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_type: 0 2024-03-27T07:13:37.652 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_index_type: 0 2024-03-27T07:13:37.652 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_shortening: 1 2024-03-27T07:13:37.652 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-27T07:13:37.652 INFO:journalctl@ceph.mon.a.smithi082.stdout: checksum: 4 2024-03-27T07:13:37.652 INFO:journalctl@ceph.mon.a.smithi082.stdout: no_block_cache: 0 2024-03-27T07:13:37.652 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache: 0x5560868fd090 2024-03-27T07:13:37.652 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-03-27T07:13:37.652 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_options: 2024-03-27T07:13:37.652 INFO:journalctl@ceph.mon.a.smithi082.stdout: capacity : 536870912 2024-03-27T07:13:37.652 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_shard_bits : 4 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: strict_capacity_limit : 0 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_compressed: (nil) 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: persistent_cache: (nil) 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size: 4096 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size_deviation: 10 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_restart_interval: 16 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_block_restart_interval: 1 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: metadata_block_size: 4096 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: partition_filters: 0 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: use_delta_encoding: 1 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: filter_policy: bloomfilter 2024-03-27T07:13:37.653 INFO:journalctl@ceph.mon.a.smithi082.stdout: whole_key_filtering: 1 2024-03-27T07:13:37.654 INFO:journalctl@ceph.mon.a.smithi082.stdout: verify_compression: 0 2024-03-27T07:13:37.654 INFO:journalctl@ceph.mon.a.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-03-27T07:13:37.654 INFO:journalctl@ceph.mon.a.smithi082.stdout: format_version: 5 2024-03-27T07:13:37.654 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_index_compression: 1 2024-03-27T07:13:37.654 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_align: 0 2024-03-27T07:13:37.654 INFO:journalctl@ceph.mon.a.smithi082.stdout: max_auto_readahead_size: 262144 2024-03-27T07:13:37.654 INFO:journalctl@ceph.mon.a.smithi082.stdout: prepopulate_block_cache: 0 2024-03-27T07:13:37.654 INFO:journalctl@ceph.mon.a.smithi082.stdout: initial_auto_readahead_size: 8192 2024-03-27T07:13:37.654 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-03-27T07:13:37.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.write_buffer_size: 33554432 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_write_buffer_number: 2 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compression: NoCompression 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bottommost_compression: Disabled 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.prefix_extractor: nullptr 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.num_levels: 7 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-27T07:13:37.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compression_opts.level: 32767 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compression_opts.strategy: 0 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-27T07:13:37.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-27T07:13:37.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compression_opts.enabled: false 2024-03-27T07:13:37.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-27T07:13:37.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-27T07:13:37.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-27T07:13:37.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-27T07:13:37.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.target_file_size_base: 67108864 2024-03-27T07:13:37.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-27T07:13:37.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-27T07:13:37.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-27T07:13:37.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.arena_block_size: 1048576 2024-03-27T07:13:37.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-27T07:13:37.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-27T07:13:37.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.disable_auto_compactions: 0 2024-03-27T07:13:37.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-27T07:13:37.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-27T07:13:37.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-27T07:13:37.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-27T07:13:37.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-27T07:13:37.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.inplace_update_support: 0 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.bloom_locality: 0 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.max_successive_merges: 0 2024-03-27T07:13:37.660 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.paranoid_file_checks: 0 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.force_consistency_checks: 1 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.report_bg_io_stats: 0 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.ttl: 2592000 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.enable_blob_files: false 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.min_blob_size: 0 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.blob_file_size: 268435456 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-27T07:13:37.661 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.blob_file_starting_level: 0 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6e8ab91d-6533-417e-b40b-ddb6d4ad643f 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711523617553234, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711523617554187, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100699, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98593, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14298, "raw_average_key_size": 49, "raw_value_size": 90861, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711523617, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6e8ab91d-6533-417e-b40b-ddb6d4ad643f", "db_session_id": "8C5TQPB6UHB0AG3R0GBY", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711523617554270, "job": 1, "event": "recovery_finished"} 2024-03-27T07:13:37.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5560869ec000 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: DB pointer 0x5560869d6000 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** DB Stats ** 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-27T07:13:37.663 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: L0 2/0 100.20 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 159.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: Sum 2/0 100.20 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 159.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 159.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-27T07:13:37.664 INFO:journalctl@ceph.mon.a.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 159.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative compaction: 0.00 GB write, 32.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-27T07:13:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval compaction: 0.00 GB write, 32.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache BinnedLRUCache@0x5560868fd090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: starting mon.a rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: mon.a@-1(???) e1 preinit fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: mon.a@-1(???).mds e1 new map 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: mon.a@-1(???).mds e1 print_map 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout: e1 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-27T07:13:37.666 INFO:journalctl@ceph.mon.a.smithi082.stdout: legacy client fscid: -1 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout: No filesystems configured 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 bash[32158]: 08307e622ef7c77f8bf2bf7650cb34ae4cda8cccac45c8389970ad8f38076622 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 systemd[1]: Started Ceph mon.a for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: monmap epoch 1 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:13:37.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: last_changed 2024-03-27T07:13:20.384938+0000 2024-03-27T07:13:37.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: created 2024-03-27T07:13:20.384938+0000 2024-03-27T07:13:37.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: min_mon_release 19 (squid) 2024-03-27T07:13:37.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: election_strategy: 1 2024-03-27T07:13:37.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-03-27T07:13:37.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: fsmap 2024-03-27T07:13:37.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: osdmap e1: 0 total, 0 up, 0 in 2024-03-27T07:13:37.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:37 smithi082 ceph-mon[32178]: mgrmap e1: no daemons active 2024-03-27T07:13:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.081+0000 7f3677ccf700 1 Processor -- start 2024-03-27T07:13:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.081+0000 7f3677ccf700 1 -- start start 2024-03-27T07:13:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.081+0000 7f3677ccf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f36701084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:38.684 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.081+0000 7f3677ccf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3670108aa0 con 0x7f36701080b0 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.082+0000 7f3675a6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f36701084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.082+0000 7f3675a6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f36701084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35396/0 (socket says 172.21.15.82:35396) 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.082+0000 7f3675a6b700 1 -- 172.21.15.82:0/3255653853 learned_addr learned my addr 172.21.15.82:0/3255653853 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.082+0000 7f3675a6b700 1 -- 172.21.15.82:0/3255653853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36701092b0 con 0x7f36701080b0 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.082+0000 7f3675a6b700 1 --2- 172.21.15.82:0/3255653853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f36701084d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f366c009e80 tx=0x7f366c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8a541b6706c474 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.082+0000 7f3674a69700 1 -- 172.21.15.82:0/3255653853 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f366c017070 con 0x7f36701080b0 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.082+0000 7f3674a69700 1 -- 172.21.15.82:0/3255653853 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f366c00b8c0 con 0x7f36701080b0 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.082+0000 7f3674a69700 1 -- 172.21.15.82:0/3255653853 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f366c0045c0 con 0x7f36701080b0 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.083+0000 7f3677ccf700 1 -- 172.21.15.82:0/3255653853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 msgr2=0x7f36701084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.083+0000 7f3677ccf700 1 --2- 172.21.15.82:0/3255653853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f36701084d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f366c009e80 tx=0x7f366c00b330 comp rx=0 tx=0).stop 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.083+0000 7f3677ccf700 1 -- 172.21.15.82:0/3255653853 shutdown_connections 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.083+0000 7f3677ccf700 1 --2- 172.21.15.82:0/3255653853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f36701084d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:38.685 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.083+0000 7f3677ccf700 1 -- 172.21.15.82:0/3255653853 >> 172.21.15.82:0/3255653853 conn(0x7f3670103670 msgr2=0x7f3670105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.083+0000 7f3677ccf700 1 -- 172.21.15.82:0/3255653853 shutdown_connections 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.083+0000 7f3677ccf700 1 -- 172.21.15.82:0/3255653853 wait complete. 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3677ccf700 1 Processor -- start 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3677ccf700 1 -- start start 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3677ccf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f367019bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3677ccf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f367010c660 con 0x7f36701080b0 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3675a6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f367019bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3675a6b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f367019bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35400/0 (socket says 172.21.15.82:35400) 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3675a6b700 1 -- 172.21.15.82:0/518801795 learned_addr learned my addr 172.21.15.82:0/518801795 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3675a6b700 1 -- 172.21.15.82:0/518801795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367019c520 con 0x7f36701080b0 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3675a6b700 1 --2- 172.21.15.82:0/518801795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f367019bfe0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f366c0072a0 tx=0x7f366c00bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:38.686 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3666ffd700 1 -- 172.21.15.82:0/518801795 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f366c020020 con 0x7f36701080b0 2024-03-27T07:13:38.687 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3666ffd700 1 -- 172.21.15.82:0/518801795 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f366c003b50 con 0x7f36701080b0 2024-03-27T07:13:38.687 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.084+0000 7f3666ffd700 1 -- 172.21.15.82:0/518801795 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f366c017040 con 0x7f36701080b0 2024-03-27T07:13:38.687 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.085+0000 7f3677ccf700 1 -- 172.21.15.82:0/518801795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367019c7b0 con 0x7f36701080b0 2024-03-27T07:13:38.687 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.085+0000 7f3677ccf700 1 -- 172.21.15.82:0/518801795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f367019f4a0 con 0x7f36701080b0 2024-03-27T07:13:38.687 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.085+0000 7f3666ffd700 1 -- 172.21.15.82:0/518801795 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f366c023020 con 0x7f36701080b0 2024-03-27T07:13:38.687 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.085+0000 7f3666ffd700 1 -- 172.21.15.82:0/518801795 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f366c00f050 con 0x7f36701080b0 2024-03-27T07:13:38.687 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.086+0000 7f3677ccf700 1 -- 172.21.15.82:0/518801795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3670063c70 con 0x7f36701080b0 2024-03-27T07:13:38.687 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.088+0000 7f3666ffd700 1 -- 172.21.15.82:0/518801795 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f366c02a020 con 0x7f36701080b0 2024-03-27T07:13:38.687 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.154+0000 7f3677ccf700 1 -- 172.21.15.82:0/518801795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f367019fab0 con 0x7f36701080b0 2024-03-27T07:13:38.687 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.156+0000 7f3666ffd700 1 -- 172.21.15.82:0/518801795 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f366c003d00 con 0x7f36701080b0 2024-03-27T07:13:38.688 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.157+0000 7f3677ccf700 1 -- 172.21.15.82:0/518801795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 msgr2=0x7f367019bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:38.688 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.157+0000 7f3677ccf700 1 --2- 172.21.15.82:0/518801795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f367019bfe0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f366c0072a0 tx=0x7f366c00bd50 comp rx=0 tx=0).stop 2024-03-27T07:13:38.688 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.157+0000 7f3677ccf700 1 -- 172.21.15.82:0/518801795 shutdown_connections 2024-03-27T07:13:38.688 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.157+0000 7f3677ccf700 1 --2- 172.21.15.82:0/518801795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36701080b0 0x7f367019bfe0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:38.688 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.157+0000 7f3677ccf700 1 -- 172.21.15.82:0/518801795 >> 172.21.15.82:0/518801795 conn(0x7f3670103670 msgr2=0x7f36701040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:38.688 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.157+0000 7f3677ccf700 1 -- 172.21.15.82:0/518801795 shutdown_connections 2024-03-27T07:13:38.688 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:38.157+0000 7f3677ccf700 1 -- 172.21.15.82:0/518801795 wait complete. 2024-03-27T07:13:38.688 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-27T07:13:38.710 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-27T07:13:38.710 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mgr... 2024-03-27T07:13:38.711 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-27T07:13:38.711 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-27T07:13:38.958 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.x 2024-03-27T07:13:38.958 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.x.service: Unit ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.x.service not loaded. 2024-03-27T07:13:39.107 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-604548c2-ec09-11ee-95d0-87774f69a715.target.wants/ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-604548c2-ec09-11ee-95d0-87774f69a715@.service. 2024-03-27T07:13:39.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:39 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/518801795' entity='client.admin' 2024-03-27T07:13:39.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:39 smithi082 podman[32392]: 2024-03-27 07:13:39.346441908 +0000 UTC m=+0.123445441 container create 80c360a9ab6e37db9bd960294010a5a961564d0880d6eaf62f9dc32094ef149e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:13:39.654 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-27T07:13:39.654 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-03-27T07:13:39.660 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-27T07:13:39.660 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-27T07:13:39.660 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-03-27T07:13:39.660 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-03-27T07:13:39.668 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-27T07:13:39.668 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-03-27T07:13:39.675 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-27T07:13:39.675 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-27T07:13:39.675 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-03-27T07:13:39.675 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-27T07:13:39.675 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr to start... 2024-03-27T07:13:39.676 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr... 2024-03-27T07:13:39.799 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:39 smithi082 podman[32392]: 2024-03-27 07:13:39.557019539 +0000 UTC m=+0.334023029 container init 80c360a9ab6e37db9bd960294010a5a961564d0880d6eaf62f9dc32094ef149e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5) 2024-03-27T07:13:39.799 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:39 smithi082 podman[32392]: 2024-03-27 07:13:39.559528791 +0000 UTC m=+0.336532279 container start 80c360a9ab6e37db9bd960294010a5a961564d0880d6eaf62f9dc32094ef149e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-27T07:13:39.800 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:39 smithi082 bash[32392]: 80c360a9ab6e37db9bd960294010a5a961564d0880d6eaf62f9dc32094ef149e 2024-03-27T07:13:39.800 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:39 smithi082 systemd[1]: Started Ceph mgr.x for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:13:40.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:40 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/897803444' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-27T07:13:40.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:40 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:40.117+0000 7f11b7868200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T07:13:40.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:40 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:40.215+0000 7f11b7868200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T07:13:41.186 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:40 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:40.870+0000 7f11b7868200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T07:13:41.187 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:40 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:40.963+0000 7f11b7868200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T07:13:41.187 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:41.103+0000 7f11b7868200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T07:13:41.480 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:41.198+0000 7f11b7868200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T07:13:41.481 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:41.280+0000 7f11b7868200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T07:13:41.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:41.494 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "604548c2-ec09-11ee-95d0-87774f69a715", 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-03-27T07:13:41.495 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-27T07:13:41.496 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:41.497 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:41.498 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-03-27T07:13:23.455610+0000", 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.101+0000 7f1afff28700 1 Processor -- start 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.101+0000 7f1afff28700 1 -- start start 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.101+0000 7f1afff28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af810af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.101+0000 7f1afff28700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1af807be60 con 0x7f1af8108b50 2024-03-27T07:13:41.499 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.102+0000 7f1afdcc4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af810af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.102+0000 7f1afdcc4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af810af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35438/0 (socket says 172.21.15.82:35438) 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.102+0000 7f1afdcc4700 1 -- 172.21.15.82:0/3339244789 learned_addr learned my addr 172.21.15.82:0/3339244789 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.103+0000 7f1afdcc4700 1 -- 172.21.15.82:0/3339244789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af810b480 con 0x7f1af8108b50 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.103+0000 7f1afdcc4700 1 --2- 172.21.15.82:0/3339244789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af810af40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1af40098a0 tx=0x7f1af4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179a9514ecf930ef server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.103+0000 7f1afccc2700 1 -- 172.21.15.82:0/3339244789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af4004160 con 0x7f1af8108b50 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.103+0000 7f1afccc2700 1 -- 172.21.15.82:0/3339244789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1af4004300 con 0x7f1af8108b50 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.103+0000 7f1afccc2700 1 -- 172.21.15.82:0/3339244789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af4011b50 con 0x7f1af8108b50 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 -- 172.21.15.82:0/3339244789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 msgr2=0x7f1af810af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 --2- 172.21.15.82:0/3339244789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af810af40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1af40098a0 tx=0x7f1af4009bb0 comp rx=0 tx=0).stop 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 -- 172.21.15.82:0/3339244789 shutdown_connections 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 --2- 172.21.15.82:0/3339244789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af810af40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:41.500 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 -- 172.21.15.82:0/3339244789 >> 172.21.15.82:0/3339244789 conn(0x7f1af8102580 msgr2=0x7f1af81049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 -- 172.21.15.82:0/3339244789 shutdown_connections 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 -- 172.21.15.82:0/3339244789 wait complete. 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 Processor -- start 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 -- start start 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af819e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.104+0000 7f1afff28700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1af810c4a0 con 0x7f1af8108b50 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1afdcc4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af819e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1afdcc4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af819e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35444/0 (socket says 172.21.15.82:35444) 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1afdcc4700 1 -- 172.21.15.82:0/897803444 learned_addr learned my addr 172.21.15.82:0/897803444 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1afdcc4700 1 -- 172.21.15.82:0/897803444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af819e7e0 con 0x7f1af8108b50 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1afdcc4700 1 --2- 172.21.15.82:0/897803444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af819e2a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1af4011670 tx=0x7f1af4011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:41.501 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1aeeffd700 1 -- 172.21.15.82:0/897803444 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af40039c0 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1aeeffd700 1 -- 172.21.15.82:0/897803444 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1af4011e50 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1afff28700 1 -- 172.21.15.82:0/897803444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af819ea70 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1aeeffd700 1 -- 172.21.15.82:0/897803444 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1af401a5c0 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1afff28700 1 -- 172.21.15.82:0/897803444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af81a1760 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1aeeffd700 1 -- 172.21.15.82:0/897803444 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1af401ac00 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.105+0000 7f1aeeffd700 1 -- 172.21.15.82:0/897803444 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1af4019700 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.106+0000 7f1afff28700 1 -- 172.21.15.82:0/897803444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1af8069740 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.108+0000 7f1aeeffd700 1 -- 172.21.15.82:0/897803444 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1af4003b60 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.181+0000 7f1afff28700 1 -- 172.21.15.82:0/897803444 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1af81a1930 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.182+0000 7f1aeeffd700 1 -- 172.21.15.82:0/897803444 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f1af40199a0 con 0x7f1af8108b50 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.183+0000 7f1afff28700 1 -- 172.21.15.82:0/897803444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 msgr2=0x7f1af819e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.183+0000 7f1afff28700 1 --2- 172.21.15.82:0/897803444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af819e2a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1af4011670 tx=0x7f1af4011b60 comp rx=0 tx=0).stop 2024-03-27T07:13:41.502 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.183+0000 7f1afff28700 1 -- 172.21.15.82:0/897803444 shutdown_connections 2024-03-27T07:13:41.503 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.183+0000 7f1afff28700 1 --2- 172.21.15.82:0/897803444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1af8108b50 0x7f1af819e2a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:41.503 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.183+0000 7f1afff28700 1 -- 172.21.15.82:0/897803444 >> 172.21.15.82:0/897803444 conn(0x7f1af8102580 msgr2=0x7f1af8103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:41.503 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.183+0000 7f1afff28700 1 -- 172.21.15.82:0/897803444 shutdown_connections 2024-03-27T07:13:41.503 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:40.183+0000 7f1afff28700 1 -- 172.21.15.82:0/897803444 wait complete. 2024-03-27T07:13:41.503 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (1/15)... 2024-03-27T07:13:41.747 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:41.550+0000 7f11b7868200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T07:13:41.747 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:41.661+0000 7f11b7868200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T07:13:41.747 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:41.746+0000 7f11b7868200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T07:13:42.014 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:41.840+0000 7f11b7868200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T07:13:42.014 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:42 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:42.013+0000 7f11b7868200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T07:13:43.436 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:42 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:42.973+0000 7f11b7868200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T07:13:43.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:43 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:43.103+0000 7f11b7868200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T07:13:43.738 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:43 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:43.454+0000 7f11b7868200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T07:13:43.739 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:43 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:43.548+0000 7f11b7868200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T07:13:43.993 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:43 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:43.746+0000 7f11b7868200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:13:43.993 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:43 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:43.935+0000 7f11b7868200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T07:13:44.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:44 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1459947397' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-27T07:13:44.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:44.226+0000 7f11b7868200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:13:44.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:44.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-27T07:13:44.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "604548c2-ec09-11ee-95d0-87774f69a715", 2024-03-27T07:13:44.597 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-03-27T07:13:44.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-27T07:13:44.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-27T07:13:44.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-27T07:13:44.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:44.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-27T07:13:44.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-27T07:13:44.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-03-27T07:13:44.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:44.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-27T07:13:44.598 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-27T07:13:44.599 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-27T07:13:44.600 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-27T07:13:44.607 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-27T07:13:44.607 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-27T07:13:44.607 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:44.608 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-27T07:13:44.609 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-03-27T07:13:23.455610+0000", 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.902+0000 7f5536d2a700 1 Processor -- start 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.902+0000 7f5536d2a700 1 -- start start 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.903+0000 7f5536d2a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553010af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.903+0000 7f5536d2a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f553007be60 con 0x7f5530108b60 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.903+0000 7f5534ac6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553010af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.903+0000 7f5534ac6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553010af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35448/0 (socket says 172.21.15.82:35448) 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.903+0000 7f5534ac6700 1 -- 172.21.15.82:0/2031282471 learned_addr learned my addr 172.21.15.82:0/2031282471 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:44.610 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.903+0000 7f5534ac6700 1 -- 172.21.15.82:0/2031282471 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553010b490 con 0x7f5530108b60 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.903+0000 7f5534ac6700 1 --2- 172.21.15.82:0/2031282471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553010af50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55240098a0 tx=0x7f5524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a1ea7025c92524 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.903+0000 7f552f7fe700 1 -- 172.21.15.82:0/2031282471 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5524004160 con 0x7f5530108b60 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.903+0000 7f552f7fe700 1 -- 172.21.15.82:0/2031282471 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5524004300 con 0x7f5530108b60 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.903+0000 7f552f7fe700 1 -- 172.21.15.82:0/2031282471 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5524011b50 con 0x7f5530108b60 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.904+0000 7f5536d2a700 1 -- 172.21.15.82:0/2031282471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 msgr2=0x7f553010af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.904+0000 7f5536d2a700 1 --2- 172.21.15.82:0/2031282471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553010af50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f55240098a0 tx=0x7f5524009bb0 comp rx=0 tx=0).stop 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.904+0000 7f5536d2a700 1 -- 172.21.15.82:0/2031282471 shutdown_connections 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.904+0000 7f5536d2a700 1 --2- 172.21.15.82:0/2031282471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553010af50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.904+0000 7f5536d2a700 1 -- 172.21.15.82:0/2031282471 >> 172.21.15.82:0/2031282471 conn(0x7f5530102570 msgr2=0x7f5530104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.904+0000 7f5536d2a700 1 -- 172.21.15.82:0/2031282471 shutdown_connections 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.904+0000 7f5536d2a700 1 -- 172.21.15.82:0/2031282471 wait complete. 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.905+0000 7f5536d2a700 1 Processor -- start 2024-03-27T07:13:44.611 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.905+0000 7f5536d2a700 1 -- start start 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.905+0000 7f5536d2a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553019c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.905+0000 7f5536d2a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f553010c4b0 con 0x7f5530108b60 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.905+0000 7f5534ac6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553019c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.905+0000 7f5534ac6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553019c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35454/0 (socket says 172.21.15.82:35454) 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.905+0000 7f5534ac6700 1 -- 172.21.15.82:0/1459947397 learned_addr learned my addr 172.21.15.82:0/1459947397 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.905+0000 7f5534ac6700 1 -- 172.21.15.82:0/1459947397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553019c5f0 con 0x7f5530108b60 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.905+0000 7f5534ac6700 1 --2- 172.21.15.82:0/1459947397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553019c0b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5524009fb0 tx=0x7f5524011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.905+0000 7f552dffb700 1 -- 172.21.15.82:0/1459947397 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55240038b0 con 0x7f5530108b60 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.906+0000 7f552dffb700 1 -- 172.21.15.82:0/1459947397 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5524011e50 con 0x7f5530108b60 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.906+0000 7f5536d2a700 1 -- 172.21.15.82:0/1459947397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553019c880 con 0x7f5530108b60 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.906+0000 7f552dffb700 1 -- 172.21.15.82:0/1459947397 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5524019420 con 0x7f5530108b60 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.906+0000 7f5536d2a700 1 -- 172.21.15.82:0/1459947397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553019f570 con 0x7f5530108b60 2024-03-27T07:13:44.612 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.906+0000 7f552dffb700 1 -- 172.21.15.82:0/1459947397 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5524019a60 con 0x7f5530108b60 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.906+0000 7f552dffb700 1 -- 172.21.15.82:0/1459947397 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5524024730 con 0x7f5530108b60 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.907+0000 7f5536d2a700 1 -- 172.21.15.82:0/1459947397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5530069740 con 0x7f5530108b60 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.909+0000 7f552dffb700 1 -- 172.21.15.82:0/1459947397 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5524043e50 con 0x7f5530108b60 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.981+0000 7f5536d2a700 1 -- 172.21.15.82:0/1459947397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f553019fab0 con 0x7f5530108b60 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.981+0000 7f552dffb700 1 -- 172.21.15.82:0/1459947397 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f5524032030 con 0x7f5530108b60 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.982+0000 7f5536d2a700 1 -- 172.21.15.82:0/1459947397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 msgr2=0x7f553019c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.982+0000 7f5536d2a700 1 --2- 172.21.15.82:0/1459947397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553019c0b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5524009fb0 tx=0x7f5524011bf0 comp rx=0 tx=0).stop 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.982+0000 7f5536d2a700 1 -- 172.21.15.82:0/1459947397 shutdown_connections 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.982+0000 7f5536d2a700 1 --2- 172.21.15.82:0/1459947397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5530108b60 0x7f553019c0b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.982+0000 7f5536d2a700 1 -- 172.21.15.82:0/1459947397 >> 172.21.15.82:0/1459947397 conn(0x7f5530102570 msgr2=0x7f55301030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.982+0000 7f5536d2a700 1 -- 172.21.15.82:0/1459947397 shutdown_connections 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:43.982+0000 7f5536d2a700 1 -- 172.21.15.82:0/1459947397 wait complete. 2024-03-27T07:13:44.613 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (2/15)... 2024-03-27T07:13:44.745 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:44.486+0000 7f11b7868200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T07:13:44.745 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:44.745+0000 7f11b7868200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T07:13:45.936 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:45 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:45.542+0000 7f11b7868200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T07:13:46.409 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:46.101+0000 7f11b7868200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T07:13:46.409 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:46.197+0000 7f11b7868200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T07:13:46.409 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:46.408+0000 7f11b7868200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: Activating manager daemon x 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: mgrmap e2: x(active, starting, since 0.00320749s) 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: from='mgr.14100 172.21.15.82:0/165999961' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: from='mgr.14100 172.21.15.82:0/165999961' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: from='mgr.14100 172.21.15.82:0/165999961' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: from='mgr.14100 172.21.15.82:0/165999961' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: from='mgr.14100 172.21.15.82:0/165999961' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: Manager daemon x is now available 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: from='mgr.14100 172.21.15.82:0/165999961' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: from='mgr.14100 172.21.15.82:0/165999961' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: from='mgr.14100 172.21.15.82:0/165999961' entity='mgr.x' 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: from='mgr.14100 172.21.15.82:0/165999961' entity='mgr.x' 2024-03-27T07:13:46.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:46 smithi082 ceph-mon[32178]: from='mgr.14100 172.21.15.82:0/165999961' entity='mgr.x' 2024-03-27T07:13:47.753 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:47 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1284512096' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-27T07:13:47.754 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:47 smithi082 ceph-mon[32178]: mgrmap e3: x(active, since 1.00631s) 2024-03-27T07:13:47.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:47.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-27T07:13:47.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "604548c2-ec09-11ee-95d0-87774f69a715", 2024-03-27T07:13:47.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-03-27T07:13:47.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-27T07:13:47.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-27T07:13:47.853 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-27T07:13:47.854 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-27T07:13:47.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:47.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-27T07:13:47.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:47.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-27T07:13:47.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-27T07:13:47.855 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-27T07:13:47.863 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-27T07:13:47.863 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-27T07:13:47.863 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-27T07:13:47.863 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:47.863 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-27T07:13:47.864 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-27T07:13:47.865 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-03-27T07:13:23.455610+0000", 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.174+0000 7f53bae85700 1 Processor -- start 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.174+0000 7f53bae85700 1 -- start start 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.174+0000 7f53bae85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b407c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.174+0000 7f53bae85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f53b407c8e0 con 0x7f53b407de60 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.174+0000 7f53b8c21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b407c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.174+0000 7f53b8c21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b407c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35548/0 (socket says 172.21.15.82:35548) 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.174+0000 7f53b8c21700 1 -- 172.21.15.82:0/3964152166 learned_addr learned my addr 172.21.15.82:0/3964152166 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:47.866 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.175+0000 7f53b8c21700 1 -- 172.21.15.82:0/3964152166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b407ca60 con 0x7f53b407de60 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.175+0000 7f53b8c21700 1 --2- 172.21.15.82:0/3964152166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b407c310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f53a80098a0 tx=0x7f53a8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575ec636c0d8684 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.175+0000 7f53b37fe700 1 -- 172.21.15.82:0/3964152166 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53a8004160 con 0x7f53b407de60 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.175+0000 7f53b37fe700 1 -- 172.21.15.82:0/3964152166 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53a8004300 con 0x7f53b407de60 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.175+0000 7f53b37fe700 1 -- 172.21.15.82:0/3964152166 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53a8011b50 con 0x7f53b407de60 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.175+0000 7f53bae85700 1 -- 172.21.15.82:0/3964152166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 msgr2=0x7f53b407c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.175+0000 7f53bae85700 1 --2- 172.21.15.82:0/3964152166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b407c310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f53a80098a0 tx=0x7f53a8009bb0 comp rx=0 tx=0).stop 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.175+0000 7f53bae85700 1 -- 172.21.15.82:0/3964152166 shutdown_connections 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.175+0000 7f53bae85700 1 --2- 172.21.15.82:0/3964152166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b407c310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.175+0000 7f53bae85700 1 -- 172.21.15.82:0/3964152166 >> 172.21.15.82:0/3964152166 conn(0x7f53b4103700 msgr2=0x7f53b4105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.176+0000 7f53bae85700 1 -- 172.21.15.82:0/3964152166 shutdown_connections 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.176+0000 7f53bae85700 1 -- 172.21.15.82:0/3964152166 wait complete. 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.176+0000 7f53bae85700 1 Processor -- start 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.176+0000 7f53bae85700 1 -- start start 2024-03-27T07:13:47.867 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.176+0000 7f53bae85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.176+0000 7f53bae85700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f53b410e670 con 0x7f53b407de60 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.176+0000 7f53b8c21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.176+0000 7f53b8c21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b419e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35560/0 (socket says 172.21.15.82:35560) 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.176+0000 7f53b8c21700 1 -- 172.21.15.82:0/1284512096 learned_addr learned my addr 172.21.15.82:0/1284512096 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.177+0000 7f53b8c21700 1 -- 172.21.15.82:0/1284512096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b419e790 con 0x7f53b407de60 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.177+0000 7f53b8c21700 1 --2- 172.21.15.82:0/1284512096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b419e250 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009fb0 tx=0x7f53a8011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.177+0000 7f53b1ffb700 1 -- 172.21.15.82:0/1284512096 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53a80038b0 con 0x7f53b407de60 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.177+0000 7f53bae85700 1 -- 172.21.15.82:0/1284512096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b419ea20 con 0x7f53b407de60 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.177+0000 7f53b1ffb700 1 -- 172.21.15.82:0/1284512096 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53a8011e50 con 0x7f53b407de60 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.177+0000 7f53b1ffb700 1 -- 172.21.15.82:0/1284512096 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53a8019420 con 0x7f53b407de60 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.177+0000 7f53bae85700 1 -- 172.21.15.82:0/1284512096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b41a1710 con 0x7f53b407de60 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.178+0000 7f53b1ffb700 1 -- 172.21.15.82:0/1284512096 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 2) ==== 46222+0+0 (secure 0 0 0) 0x7f53a8019720 con 0x7f53b407de60 2024-03-27T07:13:47.868 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.178+0000 7f53bae85700 1 -- 172.21.15.82:0/1284512096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b4069740 con 0x7f53b407de60 2024-03-27T07:13:47.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.178+0000 7f53b1ffb700 1 -- 172.21.15.82:0/1284512096 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f53a804d2b0 con 0x7f53b407de60 2024-03-27T07:13:47.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.180+0000 7f53b1ffb700 1 -- 172.21.15.82:0/1284512096 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f53a8019d40 con 0x7f53b407de60 2024-03-27T07:13:47.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.250+0000 7f53bae85700 1 -- 172.21.15.82:0/1284512096 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f53b41a18e0 con 0x7f53b407de60 2024-03-27T07:13:47.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.250+0000 7f53b1ffb700 1 -- 172.21.15.82:0/1284512096 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f53b41a18e0 con 0x7f53b407de60 2024-03-27T07:13:47.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.251+0000 7f53bae85700 1 -- 172.21.15.82:0/1284512096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 msgr2=0x7f53b419e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:47.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.251+0000 7f53bae85700 1 --2- 172.21.15.82:0/1284512096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b419e250 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009fb0 tx=0x7f53a8011bf0 comp rx=0 tx=0).stop 2024-03-27T07:13:47.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.251+0000 7f53bae85700 1 -- 172.21.15.82:0/1284512096 shutdown_connections 2024-03-27T07:13:47.869 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.251+0000 7f53bae85700 1 --2- 172.21.15.82:0/1284512096 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53b407de60 0x7f53b419e250 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:47.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.251+0000 7f53bae85700 1 -- 172.21.15.82:0/1284512096 >> 172.21.15.82:0/1284512096 conn(0x7f53b4103700 msgr2=0x7f53b4104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:47.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.251+0000 7f53bae85700 1 -- 172.21.15.82:0/1284512096 shutdown_connections 2024-03-27T07:13:47.870 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:47.251+0000 7f53bae85700 1 -- 172.21.15.82:0/1284512096 wait complete. 2024-03-27T07:13:47.870 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (3/15)... 2024-03-27T07:13:49.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:49 smithi082 ceph-mon[32178]: mgrmap e4: x(active, since 2s) 2024-03-27T07:13:50.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:50 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3301351201' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-27T07:13:51.200 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-27T07:13:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "604548c2-ec09-11ee-95d0-87774f69a715", 2024-03-27T07:13:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-03-27T07:13:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-27T07:13:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-27T07:13:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-27T07:13:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-27T07:13:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-27T07:13:51.201 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-27T07:13:51.202 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:51.203 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-27T07:13:51.203 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-27T07:13:51.203 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-27T07:13:51.212 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-27T07:13:51.213 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-03-27T07:13:23.455610+0000", 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-03-27T07:13:51.214 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.321+0000 7f8e68cb2700 1 Processor -- start 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.321+0000 7f8e68cb2700 1 -- start start 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.322+0000 7f8e68cb2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e641084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.322+0000 7f8e68cb2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e64108ac0 con 0x7f8e641080d0 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.322+0000 7f8e6259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e641084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.322+0000 7f8e6259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e641084f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37660/0 (socket says 172.21.15.82:37660) 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.322+0000 7f8e6259c700 1 -- 172.21.15.82:0/1219852502 learned_addr learned my addr 172.21.15.82:0/1219852502 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.322+0000 7f8e6259c700 1 -- 172.21.15.82:0/1219852502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e64109280 con 0x7f8e641080d0 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.322+0000 7f8e6259c700 1 --2- 172.21.15.82:0/1219852502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e641084f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009e80 tx=0x7f8e5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbdcb5727ea97c9c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.323+0000 7f8e6159a700 1 -- 172.21.15.82:0/1219852502 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c017070 con 0x7f8e641080d0 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.323+0000 7f8e6159a700 1 -- 172.21.15.82:0/1219852502 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e5c00b8c0 con 0x7f8e641080d0 2024-03-27T07:13:51.215 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.323+0000 7f8e6159a700 1 -- 172.21.15.82:0/1219852502 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c0045c0 con 0x7f8e641080d0 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.323+0000 7f8e68cb2700 1 -- 172.21.15.82:0/1219852502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 msgr2=0x7f8e641084f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.323+0000 7f8e68cb2700 1 --2- 172.21.15.82:0/1219852502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e641084f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009e80 tx=0x7f8e5c00b330 comp rx=0 tx=0).stop 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.323+0000 7f8e68cb2700 1 -- 172.21.15.82:0/1219852502 shutdown_connections 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.323+0000 7f8e68cb2700 1 --2- 172.21.15.82:0/1219852502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e641084f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.323+0000 7f8e68cb2700 1 -- 172.21.15.82:0/1219852502 >> 172.21.15.82:0/1219852502 conn(0x7f8e641036d0 msgr2=0x7f8e64105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.323+0000 7f8e68cb2700 1 -- 172.21.15.82:0/1219852502 shutdown_connections 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.323+0000 7f8e68cb2700 1 -- 172.21.15.82:0/1219852502 wait complete. 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.324+0000 7f8e68cb2700 1 Processor -- start 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.324+0000 7f8e68cb2700 1 -- start start 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.324+0000 7f8e68cb2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e6419c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.324+0000 7f8e68cb2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6410c630 con 0x7f8e641080d0 2024-03-27T07:13:51.216 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.324+0000 7f8e6259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e6419c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.324+0000 7f8e6259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e6419c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37672/0 (socket says 172.21.15.82:37672) 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.324+0000 7f8e6259c700 1 -- 172.21.15.82:0/3301351201 learned_addr learned my addr 172.21.15.82:0/3301351201 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.325+0000 7f8e6259c700 1 -- 172.21.15.82:0/3301351201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6419c5b0 con 0x7f8e641080d0 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.325+0000 7f8e6259c700 1 --2- 172.21.15.82:0/3301351201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e6419c070 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009e50 tx=0x7f8e5c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.325+0000 7f8e537fe700 1 -- 172.21.15.82:0/3301351201 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c020020 con 0x7f8e641080d0 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.325+0000 7f8e537fe700 1 -- 172.21.15.82:0/3301351201 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e5c003b50 con 0x7f8e641080d0 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.325+0000 7f8e68cb2700 1 -- 172.21.15.82:0/3301351201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6419c840 con 0x7f8e641080d0 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.325+0000 7f8e537fe700 1 -- 172.21.15.82:0/3301351201 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e5c017040 con 0x7f8e641080d0 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.325+0000 7f8e68cb2700 1 -- 172.21.15.82:0/3301351201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6419f530 con 0x7f8e641080d0 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.326+0000 7f8e537fe700 1 -- 172.21.15.82:0/3301351201 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 46455+0+0 (secure 0 0 0) 0x7f8e5c023020 con 0x7f8e641080d0 2024-03-27T07:13:51.217 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.326+0000 7f8e537fe700 1 --2- 172.21.15.82:0/3301351201 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f8e4c039380 0x7f8e4c03b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.326+0000 7f8e68cb2700 1 -- 172.21.15.82:0/3301351201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e64069740 con 0x7f8e641080d0 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.326+0000 7f8e537fe700 1 -- 172.21.15.82:0/3301351201 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8e5c00f050 con 0x7f8e641080d0 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.326+0000 7f8e61d9b700 1 --2- 172.21.15.82:0/3301351201 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f8e4c039380 0x7f8e4c03b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.327+0000 7f8e61d9b700 1 --2- 172.21.15.82:0/3301351201 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f8e4c039380 0x7f8e4c03b840 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8e58006fd0 tx=0x7f8e58006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.331+0000 7f8e537fe700 1 -- 172.21.15.82:0/3301351201 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8e5c053080 con 0x7f8e641080d0 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.613+0000 7f8e68cb2700 1 -- 172.21.15.82:0/3301351201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8e6419f700 con 0x7f8e641080d0 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.614+0000 7f8e537fe700 1 -- 172.21.15.82:0/3301351201 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f8e6419f700 con 0x7f8e641080d0 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.616+0000 7f8e68cb2700 1 -- 172.21.15.82:0/3301351201 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f8e4c039380 msgr2=0x7f8e4c03b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.616+0000 7f8e68cb2700 1 --2- 172.21.15.82:0/3301351201 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f8e4c039380 0x7f8e4c03b840 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8e58006fd0 tx=0x7f8e58006e40 comp rx=0 tx=0).stop 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.616+0000 7f8e68cb2700 1 -- 172.21.15.82:0/3301351201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 msgr2=0x7f8e6419c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.616+0000 7f8e68cb2700 1 --2- 172.21.15.82:0/3301351201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e6419c070 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009e50 tx=0x7f8e5c00bd30 comp rx=0 tx=0).stop 2024-03-27T07:13:51.218 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.616+0000 7f8e68cb2700 1 -- 172.21.15.82:0/3301351201 shutdown_connections 2024-03-27T07:13:51.219 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.616+0000 7f8e68cb2700 1 --2- 172.21.15.82:0/3301351201 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f8e4c039380 0x7f8e4c03b840 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:51.219 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.616+0000 7f8e68cb2700 1 --2- 172.21.15.82:0/3301351201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e641080d0 0x7f8e6419c070 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:51.219 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.616+0000 7f8e68cb2700 1 -- 172.21.15.82:0/3301351201 >> 172.21.15.82:0/3301351201 conn(0x7f8e641036d0 msgr2=0x7f8e64104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:51.219 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.617+0000 7f8e68cb2700 1 -- 172.21.15.82:0/3301351201 shutdown_connections 2024-03-27T07:13:51.219 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:50.617+0000 7f8e68cb2700 1 -- 172.21.15.82:0/3301351201 wait complete. 2024-03-27T07:13:51.219 INFO:teuthology.orchestra.run.smithi082.stdout:mgr is available 2024-03-27T07:13:52.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:51 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4241761091' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-27T07:13:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-03-27T07:13:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:13:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-27T07:13:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-27T07:13:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-27T07:13:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-27T07:13:52.344 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.644+0000 7ff3892eb700 1 Processor -- start 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.644+0000 7ff3892eb700 1 -- start start 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.644+0000 7ff3892eb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38410aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.644+0000 7ff3892eb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff38407bdc0 con 0x7ff384108c00 2024-03-27T07:13:52.345 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.645+0000 7ff382ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38410aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.645+0000 7ff382ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38410aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37680/0 (socket says 172.21.15.82:37680) 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.645+0000 7ff382ffd700 1 -- 172.21.15.82:0/1797993355 learned_addr learned my addr 172.21.15.82:0/1797993355 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.645+0000 7ff382ffd700 1 -- 172.21.15.82:0/1797993355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38410b530 con 0x7ff384108c00 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.645+0000 7ff382ffd700 1 --2- 172.21.15.82:0/1797993355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38410aff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0098a0 tx=0x7ff36c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8f6387cd653076 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.645+0000 7ff381ffb700 1 -- 172.21.15.82:0/1797993355 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff36c004160 con 0x7ff384108c00 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.645+0000 7ff381ffb700 1 -- 172.21.15.82:0/1797993355 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff36c004300 con 0x7ff384108c00 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.645+0000 7ff381ffb700 1 -- 172.21.15.82:0/1797993355 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff36c011b50 con 0x7ff384108c00 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.646+0000 7ff3892eb700 1 -- 172.21.15.82:0/1797993355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 msgr2=0x7ff38410aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.646+0000 7ff3892eb700 1 --2- 172.21.15.82:0/1797993355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38410aff0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0098a0 tx=0x7ff36c009bb0 comp rx=0 tx=0).stop 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.646+0000 7ff3892eb700 1 -- 172.21.15.82:0/1797993355 shutdown_connections 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.646+0000 7ff3892eb700 1 --2- 172.21.15.82:0/1797993355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38410aff0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.646+0000 7ff3892eb700 1 -- 172.21.15.82:0/1797993355 >> 172.21.15.82:0/1797993355 conn(0x7ff384102570 msgr2=0x7ff384104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.646+0000 7ff3892eb700 1 -- 172.21.15.82:0/1797993355 shutdown_connections 2024-03-27T07:13:52.346 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.646+0000 7ff3892eb700 1 -- 172.21.15.82:0/1797993355 wait complete. 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.646+0000 7ff3892eb700 1 Processor -- start 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff3892eb700 1 -- start start 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff3892eb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38419c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff3892eb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff38410c490 con 0x7ff384108c00 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff382ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38419c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff382ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38419c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37694/0 (socket says 172.21.15.82:37694) 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff382ffd700 1 -- 172.21.15.82:0/4241761091 learned_addr learned my addr 172.21.15.82:0/4241761091 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff382ffd700 1 -- 172.21.15.82:0/4241761091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38419c5d0 con 0x7ff384108c00 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff382ffd700 1 --2- 172.21.15.82:0/4241761091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38419c090 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009fb0 tx=0x7ff36c011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff37bfff700 1 -- 172.21.15.82:0/4241761091 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff36c0038b0 con 0x7ff384108c00 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff37bfff700 1 -- 172.21.15.82:0/4241761091 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff36c011e50 con 0x7ff384108c00 2024-03-27T07:13:52.347 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff3892eb700 1 -- 172.21.15.82:0/4241761091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38419c860 con 0x7ff384108c00 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff37bfff700 1 -- 172.21.15.82:0/4241761091 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff36c019420 con 0x7ff384108c00 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.647+0000 7ff3892eb700 1 -- 172.21.15.82:0/4241761091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38419f550 con 0x7ff384108c00 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.648+0000 7ff37bfff700 1 -- 172.21.15.82:0/4241761091 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 46455+0+0 (secure 0 0 0) 0x7ff36c01a430 con 0x7ff384108c00 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.648+0000 7ff37bfff700 1 --2- 172.21.15.82:0/4241761091 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff370039330 0x7ff37003b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.648+0000 7ff3892eb700 1 -- 172.21.15.82:0/4241761091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff384069740 con 0x7ff384108c00 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.648+0000 7ff37bfff700 1 -- 172.21.15.82:0/4241761091 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff36c04d690 con 0x7ff384108c00 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.649+0000 7ff3827fc700 1 --2- 172.21.15.82:0/4241761091 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff370039330 0x7ff37003b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.649+0000 7ff3827fc700 1 --2- 172.21.15.82:0/4241761091 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff370039330 0x7ff37003b7f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff374006fd0 tx=0x7ff374006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.653+0000 7ff37bfff700 1 -- 172.21.15.82:0/4241761091 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ff36c04d0b0 con 0x7ff384108c00 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.848+0000 7ff3892eb700 1 -- 172.21.15.82:0/4241761091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7ff38419f720 con 0x7ff384108c00 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.849+0000 7ff37bfff700 1 -- 172.21.15.82:0/4241761091 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+373 (secure 0 0 0) 0x7ff36c00fda0 con 0x7ff384108c00 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.851+0000 7ff3892eb700 1 -- 172.21.15.82:0/4241761091 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff370039330 msgr2=0x7ff37003b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:52.348 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.851+0000 7ff3892eb700 1 --2- 172.21.15.82:0/4241761091 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff370039330 0x7ff37003b7f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff374006fd0 tx=0x7ff374006e40 comp rx=0 tx=0).stop 2024-03-27T07:13:52.349 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.851+0000 7ff3892eb700 1 -- 172.21.15.82:0/4241761091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 msgr2=0x7ff38419c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:52.349 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.851+0000 7ff3892eb700 1 --2- 172.21.15.82:0/4241761091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38419c090 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009fb0 tx=0x7ff36c011bf0 comp rx=0 tx=0).stop 2024-03-27T07:13:52.349 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.851+0000 7ff3892eb700 1 -- 172.21.15.82:0/4241761091 shutdown_connections 2024-03-27T07:13:52.349 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.851+0000 7ff3892eb700 1 --2- 172.21.15.82:0/4241761091 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff370039330 0x7ff37003b7f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:52.349 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.851+0000 7ff3892eb700 1 --2- 172.21.15.82:0/4241761091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff384108c00 0x7ff38419c090 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:52.349 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.851+0000 7ff3892eb700 1 -- 172.21.15.82:0/4241761091 >> 172.21.15.82:0/4241761091 conn(0x7ff384102570 msgr2=0x7ff3841030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:52.349 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.851+0000 7ff3892eb700 1 -- 172.21.15.82:0/4241761091 shutdown_connections 2024-03-27T07:13:52.350 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:51.851+0000 7ff3892eb700 1 -- 172.21.15.82:0/4241761091 wait complete. 2024-03-27T07:13:52.350 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling cephadm module... 2024-03-27T07:13:53.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:53 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/182551864' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-27T07:13:53.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:53 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: ignoring --setuser ceph since I am not root 2024-03-27T07:13:53.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:53 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: ignoring --setgroup ceph since I am not root 2024-03-27T07:13:53.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.753+0000 7fdc82b6e700 1 Processor -- start 2024-03-27T07:13:53.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.753+0000 7fdc82b6e700 1 -- start start 2024-03-27T07:13:53.639 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.753+0000 7fdc82b6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c1073f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.753+0000 7fdc82b6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1079c0 con 0x7fdc7c106fd0 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.753+0000 7fdc8090a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c1073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.753+0000 7fdc8090a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c1073f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37696/0 (socket says 172.21.15.82:37696) 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.753+0000 7fdc8090a700 1 -- 172.21.15.82:0/1436031519 learned_addr learned my addr 172.21.15.82:0/1436031519 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.753+0000 7fdc8090a700 1 -- 172.21.15.82:0/1436031519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c1081d0 con 0x7fdc7c106fd0 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc8090a700 1 --2- 172.21.15.82:0/1436031519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c1073f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdc700098a0 tx=0x7fdc70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d435bae7d630293a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc7b7fe700 1 -- 172.21.15.82:0/1436031519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc70004160 con 0x7fdc7c106fd0 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc7b7fe700 1 -- 172.21.15.82:0/1436031519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdc70004300 con 0x7fdc7c106fd0 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc7b7fe700 1 -- 172.21.15.82:0/1436031519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc70011b50 con 0x7fdc7c106fd0 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc82b6e700 1 -- 172.21.15.82:0/1436031519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 msgr2=0x7fdc7c1073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc82b6e700 1 --2- 172.21.15.82:0/1436031519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c1073f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdc700098a0 tx=0x7fdc70009bb0 comp rx=0 tx=0).stop 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc82b6e700 1 -- 172.21.15.82:0/1436031519 shutdown_connections 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc82b6e700 1 --2- 172.21.15.82:0/1436031519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c1073f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:53.640 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc82b6e700 1 -- 172.21.15.82:0/1436031519 >> 172.21.15.82:0/1436031519 conn(0x7fdc7c1025b0 msgr2=0x7fdc7c1049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc82b6e700 1 -- 172.21.15.82:0/1436031519 shutdown_connections 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.754+0000 7fdc82b6e700 1 -- 172.21.15.82:0/1436031519 wait complete. 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.755+0000 7fdc82b6e700 1 Processor -- start 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.755+0000 7fdc82b6e700 1 -- start start 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.755+0000 7fdc82b6e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.755+0000 7fdc82b6e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c10b580 con 0x7fdc7c106fd0 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.755+0000 7fdc8090a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.755+0000 7fdc8090a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c19c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37708/0 (socket says 172.21.15.82:37708) 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.755+0000 7fdc8090a700 1 -- 172.21.15.82:0/182551864 learned_addr learned my addr 172.21.15.82:0/182551864 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.755+0000 7fdc8090a700 1 -- 172.21.15.82:0/182551864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c19c5b0 con 0x7fdc7c106fd0 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.756+0000 7fdc8090a700 1 --2- 172.21.15.82:0/182551864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c19c070 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdc70011670 tx=0x7fdc70011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.756+0000 7fdc79ffb700 1 -- 172.21.15.82:0/182551864 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc700039c0 con 0x7fdc7c106fd0 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.756+0000 7fdc79ffb700 1 -- 172.21.15.82:0/182551864 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdc70011e50 con 0x7fdc7c106fd0 2024-03-27T07:13:53.641 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.756+0000 7fdc82b6e700 1 -- 172.21.15.82:0/182551864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c19c840 con 0x7fdc7c106fd0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.756+0000 7fdc79ffb700 1 -- 172.21.15.82:0/182551864 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc7001a5c0 con 0x7fdc7c106fd0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.756+0000 7fdc82b6e700 1 -- 172.21.15.82:0/182551864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c19f530 con 0x7fdc7c106fd0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.757+0000 7fdc79ffb700 1 -- 172.21.15.82:0/182551864 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 46455+0+0 (secure 0 0 0) 0x7fdc70024430 con 0x7fdc7c106fd0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.757+0000 7fdc82b6e700 1 -- 172.21.15.82:0/182551864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc7c063c70 con 0x7fdc7c106fd0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.757+0000 7fdc79ffb700 1 --2- 172.21.15.82:0/182551864 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7fdc6c039380 0x7fdc6c03b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.757+0000 7fdc79ffb700 1 -- 172.21.15.82:0/182551864 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fdc7004d7e0 con 0x7fdc7c106fd0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.757+0000 7fdc7bfff700 1 --2- 172.21.15.82:0/182551864 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7fdc6c039380 0x7fdc6c03b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.758+0000 7fdc7bfff700 1 --2- 172.21.15.82:0/182551864 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7fdc6c039380 0x7fdc6c03b840 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc68006fd0 tx=0x7fdc68006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:52.762+0000 7fdc79ffb700 1 -- 172.21.15.82:0/182551864 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fdc7004d200 con 0x7fdc7c106fd0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.014+0000 7fdc82b6e700 1 -- 172.21.15.82:0/182551864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fdc7c19f700 con 0x7fdc7c106fd0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.066+0000 7fdc79ffb700 1 -- 172.21.15.82:0/182551864 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fdc7c19f700 con 0x7fdc7c106fd0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.067+0000 7fdc79ffb700 1 -- 172.21.15.82:0/182551864 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 5) ==== 46466+0+0 (secure 0 0 0) 0x7fdc70024720 con 0x7fdc7c106fd0 2024-03-27T07:13:53.642 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.069+0000 7fdc82b6e700 1 -- 172.21.15.82:0/182551864 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7fdc6c039380 msgr2=0x7fdc6c03b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:53.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.069+0000 7fdc82b6e700 1 --2- 172.21.15.82:0/182551864 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7fdc6c039380 0x7fdc6c03b840 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc68006fd0 tx=0x7fdc68006e40 comp rx=0 tx=0).stop 2024-03-27T07:13:53.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.069+0000 7fdc82b6e700 1 -- 172.21.15.82:0/182551864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 msgr2=0x7fdc7c19c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:53.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.069+0000 7fdc82b6e700 1 --2- 172.21.15.82:0/182551864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c19c070 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdc70011670 tx=0x7fdc70011b60 comp rx=0 tx=0).stop 2024-03-27T07:13:53.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.069+0000 7fdc82b6e700 1 -- 172.21.15.82:0/182551864 shutdown_connections 2024-03-27T07:13:53.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.069+0000 7fdc82b6e700 1 --2- 172.21.15.82:0/182551864 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7fdc6c039380 0x7fdc6c03b840 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:53.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.069+0000 7fdc82b6e700 1 --2- 172.21.15.82:0/182551864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdc7c106fd0 0x7fdc7c19c070 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:53.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.069+0000 7fdc82b6e700 1 -- 172.21.15.82:0/182551864 >> 172.21.15.82:0/182551864 conn(0x7fdc7c1025b0 msgr2=0x7fdc7c103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:53.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.069+0000 7fdc82b6e700 1 -- 172.21.15.82:0/182551864 shutdown_connections 2024-03-27T07:13:53.643 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:53.069+0000 7fdc82b6e700 1 -- 172.21.15.82:0/182551864 wait complete. 2024-03-27T07:13:53.720 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:53 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:53.621+0000 7f3dc4fc3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T07:13:53.720 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:53 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:53.719+0000 7f3dc4fc3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T07:13:54.312 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:54 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/182551864' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-27T07:13:54.312 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:54 smithi082 ceph-mon[32178]: mgrmap e5: x(active, since 6s) 2024-03-27T07:13:54.613 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:54 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:54.387+0000 7f3dc4fc3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T07:13:54.613 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:54 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:54.480+0000 7f3dc4fc3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T07:13:54.897 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:54 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:54.625+0000 7f3dc4fc3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T07:13:54.897 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:54 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:54.721+0000 7f3dc4fc3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T07:13:54.897 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:54 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:54.805+0000 7f3dc4fc3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T07:13:54.907 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-27T07:13:54.907 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-27T07:13:54.907 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-27T07:13:54.907 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-27T07:13:54.907 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-27T07:13:54.907 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-27T07:13:54.907 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.042+0000 7f5b00166700 1 Processor -- start 2024-03-27T07:13:54.907 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.042+0000 7f5b00166700 1 -- start start 2024-03-27T07:13:54.907 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.042+0000 7f5b00166700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af81073c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.042+0000 7f5b00166700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5af8107990 con 0x7f5af8106fa0 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.042+0000 7f5afdf02700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af81073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.042+0000 7f5afdf02700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af81073c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37740/0 (socket says 172.21.15.82:37740) 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.042+0000 7f5afdf02700 1 -- 172.21.15.82:0/4056683798 learned_addr learned my addr 172.21.15.82:0/4056683798 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.042+0000 7f5afdf02700 1 -- 172.21.15.82:0/4056683798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af81081a0 con 0x7f5af8106fa0 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.043+0000 7f5afdf02700 1 --2- 172.21.15.82:0/4056683798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af81073c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5af40098a0 tx=0x7f5af4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ae118e594f0ea2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.043+0000 7f5afcf00700 1 -- 172.21.15.82:0/4056683798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af4004160 con 0x7f5af8106fa0 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.043+0000 7f5afcf00700 1 -- 172.21.15.82:0/4056683798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5af4004300 con 0x7f5af8106fa0 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.043+0000 7f5afcf00700 1 -- 172.21.15.82:0/4056683798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af4011b50 con 0x7f5af8106fa0 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.043+0000 7f5b00166700 1 -- 172.21.15.82:0/4056683798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 msgr2=0x7f5af81073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.043+0000 7f5b00166700 1 --2- 172.21.15.82:0/4056683798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af81073c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5af40098a0 tx=0x7f5af4009bb0 comp rx=0 tx=0).stop 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.043+0000 7f5b00166700 1 -- 172.21.15.82:0/4056683798 shutdown_connections 2024-03-27T07:13:54.908 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.043+0000 7f5b00166700 1 --2- 172.21.15.82:0/4056683798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af81073c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.043+0000 7f5b00166700 1 -- 172.21.15.82:0/4056683798 >> 172.21.15.82:0/4056683798 conn(0x7f5af8102580 msgr2=0x7f5af81049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.044+0000 7f5b00166700 1 -- 172.21.15.82:0/4056683798 shutdown_connections 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.044+0000 7f5b00166700 1 -- 172.21.15.82:0/4056683798 wait complete. 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.044+0000 7f5b00166700 1 Processor -- start 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.044+0000 7f5b00166700 1 -- start start 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.044+0000 7f5b00166700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af819e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.044+0000 7f5b00166700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5af810b550 con 0x7f5af8106fa0 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.044+0000 7f5afdf02700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af819e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.044+0000 7f5afdf02700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af819e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37752/0 (socket says 172.21.15.82:37752) 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.044+0000 7f5afdf02700 1 -- 172.21.15.82:0/2113333031 learned_addr learned my addr 172.21.15.82:0/2113333031 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.045+0000 7f5afdf02700 1 -- 172.21.15.82:0/2113333031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af819e800 con 0x7f5af8106fa0 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.045+0000 7f5afdf02700 1 --2- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af819e2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5af4011670 tx=0x7f5af4011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.045+0000 7f5aeeffd700 1 -- 172.21.15.82:0/2113333031 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af40039c0 con 0x7f5af8106fa0 2024-03-27T07:13:54.909 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.045+0000 7f5aeeffd700 1 -- 172.21.15.82:0/2113333031 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5af4011e50 con 0x7f5af8106fa0 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.045+0000 7f5b00166700 1 -- 172.21.15.82:0/2113333031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af819ea90 con 0x7f5af8106fa0 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.045+0000 7f5aeeffd700 1 -- 172.21.15.82:0/2113333031 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5af401a5c0 con 0x7f5af8106fa0 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.045+0000 7f5b00166700 1 -- 172.21.15.82:0/2113333031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af81a1780 con 0x7f5af8106fa0 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.046+0000 7f5aeeffd700 1 -- 172.21.15.82:0/2113333031 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 46466+0+0 (secure 0 0 0) 0x7f5af4024430 con 0x7f5af8106fa0 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.046+0000 7f5b00166700 1 -- 172.21.15.82:0/2113333031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af8069740 con 0x7f5af8106fa0 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.046+0000 7f5aeeffd700 1 --2- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f5ae40393d0 0x7f5ae403b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.046+0000 7f5aeeffd700 1 -- 172.21.15.82:0/2113333031 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5af404d8f0 con 0x7f5af8106fa0 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.046+0000 7f5afd701700 1 -- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f5ae40393d0 msgr2=0x7f5ae403b890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1919860944 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.046+0000 7f5afd701700 1 --2- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f5ae40393d0 0x7f5ae403b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.051+0000 7f5aeeffd700 1 -- 172.21.15.82:0/2113333031 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f5af404d310 con 0x7f5af8106fa0 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.247+0000 7f5afd701700 1 -- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f5ae40393d0 msgr2=0x7f5ae403b890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1919860944 2024-03-27T07:13:54.910 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.247+0000 7f5afd701700 1 --2- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f5ae40393d0 0x7f5ae403b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.311+0000 7f5b00166700 1 -- 172.21.15.82:0/2113333031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f5af80008d0 con 0x7f5af8106fa0 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.311+0000 7f5aeeffd700 1 -- 172.21.15.82:0/2113333031 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f5af402d910 con 0x7f5af8106fa0 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.315+0000 7f5b00166700 1 -- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f5ae40393d0 msgr2=0x7f5ae403b890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.315+0000 7f5b00166700 1 --2- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f5ae40393d0 0x7f5ae403b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.315+0000 7f5b00166700 1 -- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 msgr2=0x7f5af819e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.315+0000 7f5b00166700 1 --2- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af819e2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5af4011670 tx=0x7f5af4011b60 comp rx=0 tx=0).stop 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.315+0000 7f5b00166700 1 -- 172.21.15.82:0/2113333031 shutdown_connections 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.315+0000 7f5b00166700 1 --2- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7f5ae40393d0 0x7f5ae403b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.315+0000 7f5b00166700 1 --2- 172.21.15.82:0/2113333031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5af8106fa0 0x7f5af819e2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.315+0000 7f5b00166700 1 -- 172.21.15.82:0/2113333031 >> 172.21.15.82:0/2113333031 conn(0x7f5af8102580 msgr2=0x7f5af8103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.315+0000 7f5b00166700 1 -- 172.21.15.82:0/2113333031 shutdown_connections 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:54.315+0000 7f5b00166700 1 -- 172.21.15.82:0/2113333031 wait complete. 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-03-27T07:13:54.911 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 5... 2024-03-27T07:13:55.183 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:55 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2113333031' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-27T07:13:55.183 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:55 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:55.077+0000 7f3dc4fc3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T07:13:55.436 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:55 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:55.192+0000 7f3dc4fc3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T07:13:55.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:55 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:55.282+0000 7f3dc4fc3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T07:13:55.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:55 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:55.378+0000 7f3dc4fc3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T07:13:55.889 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:55 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:55.553+0000 7f3dc4fc3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T07:13:56.936 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:56 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:56.503+0000 7f3dc4fc3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T07:13:56.937 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:56 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:56.631+0000 7f3dc4fc3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T07:13:57.247 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:56 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:56.960+0000 7f3dc4fc3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T07:13:57.247 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:57 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:57.050+0000 7f3dc4fc3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T07:13:57.248 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:57 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:57.246+0000 7f3dc4fc3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:13:57.686 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:57 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:57.431+0000 7f3dc4fc3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T07:13:57.973 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:57 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:57.715+0000 7f3dc4fc3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:13:57.973 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:57 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:57.972+0000 7f3dc4fc3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T07:13:58.291 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:58 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:58.207+0000 7f3dc4fc3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T07:13:59.436 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:59.005+0000 7f3dc4fc3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T07:13:59.882 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:59.570+0000 7f3dc4fc3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T07:13:59.883 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:59.666+0000 7f3dc4fc3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T07:13:59.883 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:13:59.882+0000 7f3dc4fc3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T07:14:00.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: Active manager daemon x restarted 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: Activating manager daemon x 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: osdmap e2: 0 total, 0 up, 0 in 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: mgrmap e6: x(active, starting, since 0.00345922s) 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: Manager daemon x is now available 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:00.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:13:59 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:14:01.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:00 smithi082 ceph-mon[32178]: Found migration_current of "None". Setting to last migration. 2024-03-27T07:14:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:00 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:14:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:00 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T07:14:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:00 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T07:14:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:00 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:00 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:00 smithi082 ceph-mon[32178]: mgrmap e7: x(active, since 1.00549s) 2024-03-27T07:14:01.455 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-27T07:14:01.455 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-27T07:14:01.455 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-27T07:14:01.455 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-27T07:14:01.455 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.282+0000 7ff07f2e3700 1 Processor -- start 2024-03-27T07:14:01.455 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.283+0000 7ff07f2e3700 1 -- start start 2024-03-27T07:14:01.455 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.283+0000 7ff07f2e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff0781067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.283+0000 7ff07f2e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff078106d80 con 0x7ff078106390 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.283+0000 7ff07d07f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff0781067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.283+0000 7ff07d07f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff0781067b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37766/0 (socket says 172.21.15.82:37766) 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.283+0000 7ff07d07f700 1 -- 172.21.15.82:0/3954621073 learned_addr learned my addr 172.21.15.82:0/3954621073 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.283+0000 7ff07d07f700 1 -- 172.21.15.82:0/3954621073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff078109320 con 0x7ff078106390 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.283+0000 7ff07d07f700 1 --2- 172.21.15.82:0/3954621073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff0781067b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff0740098a0 tx=0x7ff074009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87387a337cde03a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.284+0000 7ff06ffff700 1 -- 172.21.15.82:0/3954621073 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff074004160 con 0x7ff078106390 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.284+0000 7ff06ffff700 1 -- 172.21.15.82:0/3954621073 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff074004300 con 0x7ff078106390 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.284+0000 7ff06ffff700 1 -- 172.21.15.82:0/3954621073 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff074011b50 con 0x7ff078106390 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.284+0000 7ff07f2e3700 1 -- 172.21.15.82:0/3954621073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 msgr2=0x7ff0781067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.284+0000 7ff07f2e3700 1 --2- 172.21.15.82:0/3954621073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff0781067b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff0740098a0 tx=0x7ff074009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.284+0000 7ff07f2e3700 1 -- 172.21.15.82:0/3954621073 shutdown_connections 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.284+0000 7ff07f2e3700 1 --2- 172.21.15.82:0/3954621073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff0781067b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.284+0000 7ff07f2e3700 1 -- 172.21.15.82:0/3954621073 >> 172.21.15.82:0/3954621073 conn(0x7ff078101ce0 msgr2=0x7ff078104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.284+0000 7ff07f2e3700 1 -- 172.21.15.82:0/3954621073 shutdown_connections 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.285+0000 7ff07f2e3700 1 -- 172.21.15.82:0/3954621073 wait complete. 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.285+0000 7ff07f2e3700 1 Processor -- start 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.285+0000 7ff07f2e3700 1 -- start start 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.285+0000 7ff07f2e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff07819c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.285+0000 7ff07f2e3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff07810c6d0 con 0x7ff078106390 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.285+0000 7ff07d07f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff07819c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.285+0000 7ff07d07f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff07819c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37776/0 (socket says 172.21.15.82:37776) 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.285+0000 7ff07d07f700 1 -- 172.21.15.82:0/2172678 learned_addr learned my addr 172.21.15.82:0/2172678 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.286+0000 7ff07d07f700 1 -- 172.21.15.82:0/2172678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07819c610 con 0x7ff078106390 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.286+0000 7ff07d07f700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff07819c0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff074009fb0 tx=0x7ff074011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:01.457 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.286+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0740038b0 con 0x7ff078106390 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.286+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff074011e50 con 0x7ff078106390 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.286+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff074019550 con 0x7ff078106390 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.286+0000 7ff07f2e3700 1 -- 172.21.15.82:0/2172678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07819c8a0 con 0x7ff078106390 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.286+0000 7ff07f2e3700 1 -- 172.21.15.82:0/2172678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07819f590 con 0x7ff078106390 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.287+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 46466+0+0 (secure 0 0 0) 0x7ff074019800 con 0x7ff078106390 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.287+0000 7ff06e7fc700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 0x7ff06403b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.287+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 --> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff06403bfa0 con 0x7ff0640393d0 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.287+0000 7ff07c87e700 1 -- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 msgr2=0x7ff06403b890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1919860944 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.287+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff07404d6a0 con 0x7ff078106390 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.287+0000 7ff07c87e700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 0x7ff06403b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.488+0000 7ff07c87e700 1 -- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 msgr2=0x7ff06403b890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1919860944 2024-03-27T07:14:01.458 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.488+0000 7ff07c87e700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 0x7ff06403b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.889+0000 7ff07c87e700 1 -- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 msgr2=0x7ff06403b890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1919860944 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:55.889+0000 7ff07c87e700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 0x7ff06403b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:56.690+0000 7ff07c87e700 1 -- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 msgr2=0x7ff06403b890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1919860944 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:56.690+0000 7ff07c87e700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 0x7ff06403b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:58.291+0000 7ff07c87e700 1 -- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 msgr2=0x7ff06403b890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/1919860944 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:58.291+0000 7ff07c87e700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 0x7ff06403b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:59.897+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 6) ==== 46233+0+0 (secure 0 0 0) 0x7ff074019b40 con 0x7ff078106390 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:59.897+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 msgr2=0x7ff06403b890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:13:59.897+0000 7ff06e7fc700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 0x7ff06403b890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.898+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 7) ==== 46360+0+0 (secure 0 0 0) 0x7ff07404f350 con 0x7ff078106390 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.898+0000 7ff06e7fc700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7ff06403ccc0 0x7ff06403f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.898+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 --> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff07401fec0 con 0x7ff06403ccc0 2024-03-27T07:14:01.459 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.898+0000 7ff07c87e700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7ff06403ccc0 0x7ff06403f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.899+0000 7ff07c87e700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7ff06403ccc0 0x7ff06403f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff068003a10 tx=0x7ff0680092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.899+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 <== mgr.14120 v2:172.21.15.82:6800/3434341690 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7ff07401fec0 con 0x7ff06403ccc0 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 -- 172.21.15.82:0/2172678 --> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff078069740 con 0x7ff06403ccc0 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff06e7fc700 1 -- 172.21.15.82:0/2172678 <== mgr.14120 v2:172.21.15.82:6800/3434341690 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7ff078069740 con 0x7ff06403ccc0 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 -- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7ff06403ccc0 msgr2=0x7ff06403f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7ff06403ccc0 0x7ff06403f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff068003a10 tx=0x7ff0680092b0 comp rx=0 tx=0).stop 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 -- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 msgr2=0x7ff07819c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff07819c0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff074009fb0 tx=0x7ff074011bf0 comp rx=0 tx=0).stop 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 -- 172.21.15.82:0/2172678 shutdown_connections 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7ff06403ccc0 0x7ff06403f0b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff078106390 0x7ff07819c0d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 --2- 172.21.15.82:0/2172678 >> [v2:172.21.15.82:6800/1919860944,v1:172.21.15.82:6801/1919860944] conn(0x7ff0640393d0 0x7ff06403b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 -- 172.21.15.82:0/2172678 >> 172.21.15.82:0/2172678 conn(0x7ff078101ce0 msgr2=0x7ff078102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:01.460 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 -- 172.21.15.82:0/2172678 shutdown_connections 2024-03-27T07:14:01.461 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:00.906+0000 7ff07f2e3700 1 -- 172.21.15.82:0/2172678 wait complete. 2024-03-27T07:14:01.461 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 5 is available 2024-03-27T07:14:01.461 INFO:teuthology.orchestra.run.smithi082.stdout:Setting orchestrator backend to cephadm... 2024-03-27T07:14:02.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:01 smithi082 ceph-mon[32178]: [27/Mar/2024:07:14:00] ENGINE Bus STARTING 2024-03-27T07:14:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:01 smithi082 ceph-mon[32178]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-27T07:14:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:01 smithi082 ceph-mon[32178]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-27T07:14:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:01 smithi082 ceph-mon[32178]: [27/Mar/2024:07:14:00] ENGINE Serving on http://172.21.15.82:8765 2024-03-27T07:14:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:01 smithi082 ceph-mon[32178]: [27/Mar/2024:07:14:01] ENGINE Serving on https://172.21.15.82:7150 2024-03-27T07:14:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:01 smithi082 ceph-mon[32178]: [27/Mar/2024:07:14:01] ENGINE Bus STARTED 2024-03-27T07:14:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:01 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:14:02.568 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.845+0000 7f7dc24fe700 1 Processor -- start 2024-03-27T07:14:02.568 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.845+0000 7f7dc24fe700 1 -- start start 2024-03-27T07:14:02.568 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.845+0000 7f7dc24fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc1067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:02.568 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.845+0000 7f7dc24fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc106d80 con 0x7f7dbc106390 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.845+0000 7f7dbbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc1067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.845+0000 7f7dbbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc1067b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57230/0 (socket says 172.21.15.82:57230) 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.845+0000 7f7dbbfff700 1 -- 172.21.15.82:0/2025054267 learned_addr learned my addr 172.21.15.82:0/2025054267 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.846+0000 7f7dbbfff700 1 -- 172.21.15.82:0/2025054267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc106f00 con 0x7f7dbc106390 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.846+0000 7f7dbbfff700 1 --2- 172.21.15.82:0/2025054267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc1067b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0098a0 tx=0x7f7dac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3881243d6ae0af89 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.846+0000 7f7dbaffd700 1 -- 172.21.15.82:0/2025054267 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dac004160 con 0x7f7dbc106390 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.846+0000 7f7dbaffd700 1 -- 172.21.15.82:0/2025054267 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7dac004300 con 0x7f7dbc106390 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.846+0000 7f7dbaffd700 1 -- 172.21.15.82:0/2025054267 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dac011b50 con 0x7f7dbc106390 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.847+0000 7f7dc24fe700 1 -- 172.21.15.82:0/2025054267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 msgr2=0x7f7dbc1067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.847+0000 7f7dc24fe700 1 --2- 172.21.15.82:0/2025054267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc1067b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0098a0 tx=0x7f7dac009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.847+0000 7f7dc24fe700 1 -- 172.21.15.82:0/2025054267 shutdown_connections 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.847+0000 7f7dc24fe700 1 --2- 172.21.15.82:0/2025054267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc1067b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:02.569 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.847+0000 7f7dc24fe700 1 -- 172.21.15.82:0/2025054267 >> 172.21.15.82:0/2025054267 conn(0x7f7dbc101d90 msgr2=0x7f7dbc1041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.847+0000 7f7dc24fe700 1 -- 172.21.15.82:0/2025054267 shutdown_connections 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.847+0000 7f7dc24fe700 1 -- 172.21.15.82:0/2025054267 wait complete. 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.847+0000 7f7dc24fe700 1 Processor -- start 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.847+0000 7f7dc24fe700 1 -- start start 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7dc24fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7dc24fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc10a250 con 0x7f7dbc106390 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7dbbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7dbbfff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc19bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57244/0 (socket says 172.21.15.82:57244) 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7dbbfff700 1 -- 172.21.15.82:0/3462056920 learned_addr learned my addr 172.21.15.82:0/3462056920 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7dbbfff700 1 -- 172.21.15.82:0/3462056920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc19c530 con 0x7f7dbc106390 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7dbbfff700 1 --2- 172.21.15.82:0/3462056920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc19bff0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7dac000c00 tx=0x7f7dac011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7db97fa700 1 -- 172.21.15.82:0/3462056920 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dac003b20 con 0x7f7dbc106390 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7db97fa700 1 -- 172.21.15.82:0/3462056920 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7dac003cc0 con 0x7f7dbc106390 2024-03-27T07:14:02.570 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7db97fa700 1 -- 172.21.15.82:0/3462056920 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7dac024910 con 0x7f7dbc106390 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7dc24fe700 1 -- 172.21.15.82:0/3462056920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc19c820 con 0x7f7dbc106390 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.848+0000 7f7dc24fe700 1 -- 172.21.15.82:0/3462056920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc19f4b0 con 0x7f7dbc106390 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.849+0000 7f7db97fa700 1 -- 172.21.15.82:0/3462056920 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 7) ==== 46360+0+0 (secure 0 0 0) 0x7f7dac022020 con 0x7f7dbc106390 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.849+0000 7f7db97fa700 1 --2- 172.21.15.82:0/3462056920 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f7da40392b0 0x7f7da403b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.849+0000 7f7dc24fe700 1 -- 172.21.15.82:0/3462056920 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dbc063c70 con 0x7f7dbc106390 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.849+0000 7f7db97fa700 1 -- 172.21.15.82:0/3462056920 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7dac011e00 con 0x7f7dbc106390 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.849+0000 7f7dbb7fe700 1 --2- 172.21.15.82:0/3462056920 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f7da40392b0 0x7f7da403b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.850+0000 7f7dbb7fe700 1 --2- 172.21.15.82:0/3462056920 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f7da40392b0 0x7f7da403b770 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7db0006fd0 tx=0x7f7db0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.855+0000 7f7db97fa700 1 -- 172.21.15.82:0/3462056920 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7dac00b5a0 con 0x7f7dbc106390 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:01.958+0000 7f7db97fa700 1 -- 172.21.15.82:0/3462056920 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f7dac01acd0 con 0x7f7dbc106390 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.071+0000 7f7dc24fe700 1 -- 172.21.15.82:0/3462056920 --> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f7dbc19f680 con 0x7f7da40392b0 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.076+0000 7f7db97fa700 1 -- 172.21.15.82:0/3462056920 <== mgr.14120 v2:172.21.15.82:6800/3434341690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7dbc19f680 con 0x7f7da40392b0 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.079+0000 7f7dc24fe700 1 -- 172.21.15.82:0/3462056920 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f7da40392b0 msgr2=0x7f7da403b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:02.571 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.079+0000 7f7dc24fe700 1 --2- 172.21.15.82:0/3462056920 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f7da40392b0 0x7f7da403b770 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7db0006fd0 tx=0x7f7db0006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:02.572 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.079+0000 7f7dc24fe700 1 -- 172.21.15.82:0/3462056920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 msgr2=0x7f7dbc19bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:02.572 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.079+0000 7f7dc24fe700 1 --2- 172.21.15.82:0/3462056920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc19bff0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7dac000c00 tx=0x7f7dac011c10 comp rx=0 tx=0).stop 2024-03-27T07:14:02.572 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.079+0000 7f7dc24fe700 1 -- 172.21.15.82:0/3462056920 shutdown_connections 2024-03-27T07:14:02.572 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.079+0000 7f7dc24fe700 1 --2- 172.21.15.82:0/3462056920 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f7da40392b0 0x7f7da403b770 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:02.572 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.079+0000 7f7dc24fe700 1 --2- 172.21.15.82:0/3462056920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7dbc106390 0x7f7dbc19bff0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:02.572 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.079+0000 7f7dc24fe700 1 -- 172.21.15.82:0/3462056920 >> 172.21.15.82:0/3462056920 conn(0x7f7dbc101d90 msgr2=0x7f7dbc102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:02.572 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.079+0000 7f7dc24fe700 1 -- 172.21.15.82:0/3462056920 shutdown_connections 2024-03-27T07:14:02.572 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.079+0000 7f7dc24fe700 1 -- 172.21.15.82:0/3462056920 wait complete. 2024-03-27T07:14:03.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:02 smithi082 ceph-mon[32178]: mgrmap e8: x(active, since 2s) 2024-03-27T07:14:03.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:02 smithi082 ceph-mon[32178]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:03.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:02 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:03.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:02 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:14:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-27T07:14:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.961+0000 7f5db5f0c700 1 Processor -- start 2024-03-27T07:14:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.961+0000 7f5db5f0c700 1 -- start start 2024-03-27T07:14:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.961+0000 7f5db5f0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0106790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.961+0000 7f5db5f0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5db0106d60 con 0x7f5db0106370 2024-03-27T07:14:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.961+0000 7f5daf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0106790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.961+0000 7f5daf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0106790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57248/0 (socket says 172.21.15.82:57248) 2024-03-27T07:14:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.961+0000 7f5daf7fe700 1 -- 172.21.15.82:0/3657632554 learned_addr learned my addr 172.21.15.82:0/3657632554 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.962+0000 7f5daf7fe700 1 -- 172.21.15.82:0/3657632554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db0109300 con 0x7f5db0106370 2024-03-27T07:14:03.757 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.962+0000 7f5daf7fe700 1 --2- 172.21.15.82:0/3657632554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0106790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5da00098a0 tx=0x7f5da0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430247040900de7d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.962+0000 7f5dae7fc700 1 -- 172.21.15.82:0/3657632554 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5da0004160 con 0x7f5db0106370 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.962+0000 7f5dae7fc700 1 -- 172.21.15.82:0/3657632554 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5da0004300 con 0x7f5db0106370 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.962+0000 7f5dae7fc700 1 -- 172.21.15.82:0/3657632554 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5da0011b50 con 0x7f5db0106370 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.963+0000 7f5db5f0c700 1 -- 172.21.15.82:0/3657632554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 msgr2=0x7f5db0106790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.963+0000 7f5db5f0c700 1 --2- 172.21.15.82:0/3657632554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0106790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5da00098a0 tx=0x7f5da0009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.963+0000 7f5db5f0c700 1 -- 172.21.15.82:0/3657632554 shutdown_connections 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.963+0000 7f5db5f0c700 1 --2- 172.21.15.82:0/3657632554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0106790 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.963+0000 7f5db5f0c700 1 -- 172.21.15.82:0/3657632554 >> 172.21.15.82:0/3657632554 conn(0x7f5db0101d20 msgr2=0x7f5db0104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.963+0000 7f5db5f0c700 1 -- 172.21.15.82:0/3657632554 shutdown_connections 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.963+0000 7f5db5f0c700 1 -- 172.21.15.82:0/3657632554 wait complete. 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.963+0000 7f5db5f0c700 1 Processor -- start 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.963+0000 7f5db5f0c700 1 -- start start 2024-03-27T07:14:03.758 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5db5f0c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0108b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5db5f0c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5db010c6b0 con 0x7f5db0106370 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5daf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0108b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5daf7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0108b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57264/0 (socket says 172.21.15.82:57264) 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5daf7fe700 1 -- 172.21.15.82:0/2366811394 learned_addr learned my addr 172.21.15.82:0/2366811394 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5daf7fe700 1 -- 172.21.15.82:0/2366811394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db01090c0 con 0x7f5db0106370 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5daf7fe700 1 --2- 172.21.15.82:0/2366811394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0108b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009fb0 tx=0x7f5da0011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5dacff9700 1 -- 172.21.15.82:0/2366811394 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5da00038b0 con 0x7f5db0106370 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5dacff9700 1 -- 172.21.15.82:0/2366811394 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5da0011e50 con 0x7f5db0106370 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5db5f0c700 1 -- 172.21.15.82:0/2366811394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db01072b0 con 0x7f5db0106370 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5dacff9700 1 -- 172.21.15.82:0/2366811394 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5da0019550 con 0x7f5db0106370 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.964+0000 7f5db5f0c700 1 -- 172.21.15.82:0/2366811394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db01077f0 con 0x7f5db0106370 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.965+0000 7f5dacff9700 1 -- 172.21.15.82:0/2366811394 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f5da0019850 con 0x7f5db0106370 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.965+0000 7f5db5f0c700 1 -- 172.21.15.82:0/2366811394 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db0069740 con 0x7f5db0106370 2024-03-27T07:14:03.759 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.965+0000 7f5dacff9700 1 --2- 172.21.15.82:0/2366811394 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f5d98039380 0x7f5d9803b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.965+0000 7f5dacff9700 1 -- 172.21.15.82:0/2366811394 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5da004d950 con 0x7f5db0106370 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.966+0000 7f5daeffd700 1 --2- 172.21.15.82:0/2366811394 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f5d98039380 0x7f5d9803b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.966+0000 7f5daeffd700 1 --2- 172.21.15.82:0/2366811394 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f5d98039380 0x7f5d9803b840 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5da4006fd0 tx=0x7f5da4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:02.970+0000 7f5dacff9700 1 -- 172.21.15.82:0/2366811394 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f5da0003ac0 con 0x7f5db0106370 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.170+0000 7f5db5f0c700 1 -- 172.21.15.82:0/2366811394 --> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f5db0102fc0 con 0x7f5d98039380 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.171+0000 7f5dacff9700 1 -- 172.21.15.82:0/2366811394 <== mgr.14120 v2:172.21.15.82:6800/3434341690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f5db0102fc0 con 0x7f5d98039380 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.173+0000 7f5db5f0c700 1 -- 172.21.15.82:0/2366811394 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f5d98039380 msgr2=0x7f5d9803b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.173+0000 7f5db5f0c700 1 --2- 172.21.15.82:0/2366811394 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f5d98039380 0x7f5d9803b840 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5da4006fd0 tx=0x7f5da4006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.173+0000 7f5db5f0c700 1 -- 172.21.15.82:0/2366811394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 msgr2=0x7f5db0108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.173+0000 7f5db5f0c700 1 --2- 172.21.15.82:0/2366811394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0108b80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009fb0 tx=0x7f5da0011bf0 comp rx=0 tx=0).stop 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.173+0000 7f5db5f0c700 1 -- 172.21.15.82:0/2366811394 shutdown_connections 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.173+0000 7f5db5f0c700 1 --2- 172.21.15.82:0/2366811394 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f5d98039380 0x7f5d9803b840 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.173+0000 7f5db5f0c700 1 --2- 172.21.15.82:0/2366811394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5db0106370 0x7f5db0108b80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:03.760 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.173+0000 7f5db5f0c700 1 -- 172.21.15.82:0/2366811394 >> 172.21.15.82:0/2366811394 conn(0x7f5db0101d20 msgr2=0x7f5db01028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:03.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.173+0000 7f5db5f0c700 1 -- 172.21.15.82:0/2366811394 shutdown_connections 2024-03-27T07:14:03.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:03.173+0000 7f5db5f0c700 1 -- 172.21.15.82:0/2366811394 wait complete. 2024-03-27T07:14:03.761 INFO:teuthology.orchestra.run.smithi082.stdout:Generating ssh key... 2024-03-27T07:14:04.356 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-mon[32178]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:04.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: Generating public/private rsa key pair. 2024-03-27T07:14:04.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: Your identification has been saved in /tmp/tmp1z8uvs1v/key. 2024-03-27T07:14:04.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: Your public key has been saved in /tmp/tmp1z8uvs1v/key.pub. 2024-03-27T07:14:04.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: The key fingerprint is: 2024-03-27T07:14:04.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: SHA256:NibmaidTd9H31OH44sUjbQDK3AAgpQoDj50q/OsR58A ceph-604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:14:04.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: The key's randomart image is: 2024-03-27T07:14:04.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: +---[RSA 3072]----+ 2024-03-27T07:14:04.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: |. ..o... | 2024-03-27T07:14:04.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: |.+ .o . . . | 2024-03-27T07:14:04.687 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: |+ +. o +.. o o| 2024-03-27T07:14:04.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: |ooo +...o..o| 2024-03-27T07:14:04.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: |oo E .o S . .=o | 2024-03-27T07:14:04.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: |. . =o.+... o B.| 2024-03-27T07:14:04.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: | o o.. . . = .| 2024-03-27T07:14:04.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: | *.. . | 2024-03-27T07:14:04.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: | .+.+ | 2024-03-27T07:14:04.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: +----[SHA256]-----+ 2024-03-27T07:14:05.137 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.149+0000 7f2ea1bf2700 1 Processor -- start 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.149+0000 7f2ea1bf2700 1 -- start start 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.149+0000 7f2ea1bf2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c108500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.149+0000 7f2ea1bf2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c108ad0 con 0x7f2e9c1080e0 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.149+0000 7f2e9b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c108500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.149+0000 7f2e9b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c108500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57278/0 (socket says 172.21.15.82:57278) 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.149+0000 7f2e9b7fe700 1 -- 172.21.15.82:0/2542586310 learned_addr learned my addr 172.21.15.82:0/2542586310 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.150+0000 7f2e9b7fe700 1 -- 172.21.15.82:0/2542586310 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c109290 con 0x7f2e9c1080e0 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.150+0000 7f2e9b7fe700 1 --2- 172.21.15.82:0/2542586310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c108500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0098a0 tx=0x7f2e8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1752000bb3f8d1a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.150+0000 7f2e9a7fc700 1 -- 172.21.15.82:0/2542586310 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8c004160 con 0x7f2e9c1080e0 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.150+0000 7f2e9a7fc700 1 -- 172.21.15.82:0/2542586310 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e8c004300 con 0x7f2e9c1080e0 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.150+0000 7f2e9a7fc700 1 -- 172.21.15.82:0/2542586310 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8c011b50 con 0x7f2e9c1080e0 2024-03-27T07:14:05.138 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.150+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/2542586310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 msgr2=0x7f2e9c108500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.150+0000 7f2ea1bf2700 1 --2- 172.21.15.82:0/2542586310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c108500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0098a0 tx=0x7f2e8c009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.150+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/2542586310 shutdown_connections 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.150+0000 7f2ea1bf2700 1 --2- 172.21.15.82:0/2542586310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c108500 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.150+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/2542586310 >> 172.21.15.82:0/2542586310 conn(0x7f2e9c103700 msgr2=0x7f2e9c105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.151+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/2542586310 shutdown_connections 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.151+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/2542586310 wait complete. 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.151+0000 7f2ea1bf2700 1 Processor -- start 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.151+0000 7f2ea1bf2700 1 -- start start 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.151+0000 7f2ea1bf2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c19c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.151+0000 7f2ea1bf2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9c10c640 con 0x7f2e9c1080e0 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.152+0000 7f2e9b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c19c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.152+0000 7f2e9b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c19c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57292/0 (socket says 172.21.15.82:57292) 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.152+0000 7f2e9b7fe700 1 -- 172.21.15.82:0/3574641345 learned_addr learned my addr 172.21.15.82:0/3574641345 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:05.139 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.152+0000 7f2e9b7fe700 1 -- 172.21.15.82:0/3574641345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c19c5c0 con 0x7f2e9c1080e0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.152+0000 7f2e9b7fe700 1 --2- 172.21.15.82:0/3574641345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c19c080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c011850 tx=0x7f2e8c011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.152+0000 7f2e98ff9700 1 -- 172.21.15.82:0/3574641345 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8c003af0 con 0x7f2e9c1080e0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.152+0000 7f2e98ff9700 1 -- 172.21.15.82:0/3574641345 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e8c020070 con 0x7f2e9c1080e0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.152+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/3574641345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9c19c850 con 0x7f2e9c1080e0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.152+0000 7f2e98ff9700 1 -- 172.21.15.82:0/3574641345 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e8c0195a0 con 0x7f2e9c1080e0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.152+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/3574641345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e9c19f540 con 0x7f2e9c1080e0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.153+0000 7f2e98ff9700 1 -- 172.21.15.82:0/3574641345 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f2e8c019850 con 0x7f2e9c1080e0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.153+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/3574641345 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9c069740 con 0x7f2e9c1080e0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.153+0000 7f2e98ff9700 1 --2- 172.21.15.82:0/3574641345 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f2e84039420 0x7f2e8403b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.153+0000 7f2e98ff9700 1 -- 172.21.15.82:0/3574641345 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2e8c011e00 con 0x7f2e9c1080e0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.153+0000 7f2e9affd700 1 --2- 172.21.15.82:0/3574641345 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f2e84039420 0x7f2e8403b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.154+0000 7f2e9affd700 1 --2- 172.21.15.82:0/3574641345 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f2e84039420 0x7f2e8403b8e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2e90006fd0 tx=0x7f2e90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.158+0000 7f2e98ff9700 1 -- 172.21.15.82:0/3574641345 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2e8c019b40 con 0x7f2e9c1080e0 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.355+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/3574641345 --> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f2e9c1049c0 con 0x7f2e84039420 2024-03-27T07:14:05.140 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.581+0000 7f2e98ff9700 1 -- 172.21.15.82:0/3574641345 <== mgr.14120 v2:172.21.15.82:6800/3434341690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2e9c1049c0 con 0x7f2e84039420 2024-03-27T07:14:05.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.583+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/3574641345 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f2e84039420 msgr2=0x7f2e8403b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:05.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.583+0000 7f2ea1bf2700 1 --2- 172.21.15.82:0/3574641345 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f2e84039420 0x7f2e8403b8e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2e90006fd0 tx=0x7f2e90006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:05.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.583+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/3574641345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 msgr2=0x7f2e9c19c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:05.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.583+0000 7f2ea1bf2700 1 --2- 172.21.15.82:0/3574641345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c19c080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c011850 tx=0x7f2e8c011c10 comp rx=0 tx=0).stop 2024-03-27T07:14:05.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.584+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/3574641345 shutdown_connections 2024-03-27T07:14:05.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.584+0000 7f2ea1bf2700 1 --2- 172.21.15.82:0/3574641345 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f2e84039420 0x7f2e8403b8e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:05.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.584+0000 7f2ea1bf2700 1 --2- 172.21.15.82:0/3574641345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e9c1080e0 0x7f2e9c19c080 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:05.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.584+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/3574641345 >> 172.21.15.82:0/3574641345 conn(0x7f2e9c103700 msgr2=0x7f2e9c1042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:05.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.584+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/3574641345 shutdown_connections 2024-03-27T07:14:05.141 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:04.584+0000 7f2ea1bf2700 1 -- 172.21.15.82:0/3574641345 wait complete. 2024-03-27T07:14:05.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:05 smithi082 ceph-mon[32178]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:05.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:05 smithi082 ceph-mon[32178]: Generating ssh key... 2024-03-27T07:14:05.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:05 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:05.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:05 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:06.382 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6ct4Ld9K2U2Qle3FuUOHCFy7QFAaqYLW5kFQuDSrtrTJbfceASkA8HaYPEQzQ/JMDr5XTz7vs2m4aUtcrg7yq4fyX7Cg9qzGGb7wdXej7+usR9DtYF+L6Gp/RTPvOHugVQtcKV2bJOzOO1w7pAvGWIieq6w4Mb3jpw8lxmjg8zTcp3Mwp3ws5J2mrpLQnjicZpkI5YaE9bOm+FyfrebjuYxb2pZm23QX6rSvoqIYvpwFiCQHue4eml0iqexmNb5w1pGSF2JzW31ZbtaA7/uEhD+etHjayU8tti1PMc7Hv1zmuqX2cOMYEOGh5En/tUNjLtIk0prD6KAqBpo67pR0oCLfZ7E3l86xlEfOZQHhPZ6jGP6jxkng6xWaTUrUM9JiFu0hPDGcvctafGk/FStMYsQBTmROt0GfQdhT08zHAiAwozrYXIiw4/BWd/Ns3WASy27gdWrncw+AJp7sNuoCCo8NMmKeB5S318T9MFVQt74km76w7p2x1qQwlAh0bmWE= ceph-604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:14:06.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.540+0000 7f065303c700 1 Processor -- start 2024-03-27T07:14:06.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.540+0000 7f065303c700 1 -- start start 2024-03-27T07:14:06.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.540+0000 7f065303c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c10aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:06.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.540+0000 7f065303c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f064c07bdc0 con 0x7f064c108c00 2024-03-27T07:14:06.387 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.540+0000 7f0650dd8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c10aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.540+0000 7f0650dd8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c10aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57302/0 (socket says 172.21.15.82:57302) 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.540+0000 7f0650dd8700 1 -- 172.21.15.82:0/1774063405 learned_addr learned my addr 172.21.15.82:0/1774063405 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.541+0000 7f0650dd8700 1 -- 172.21.15.82:0/1774063405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c10b530 con 0x7f064c108c00 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.541+0000 7f0650dd8700 1 --2- 172.21.15.82:0/1774063405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c10aff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06400098a0 tx=0x7f0640009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9f7bf76c8d5255 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.541+0000 7f064b7fe700 1 -- 172.21.15.82:0/1774063405 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0640004160 con 0x7f064c108c00 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.541+0000 7f064b7fe700 1 -- 172.21.15.82:0/1774063405 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0640004300 con 0x7f064c108c00 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.541+0000 7f064b7fe700 1 -- 172.21.15.82:0/1774063405 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0640011b50 con 0x7f064c108c00 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 -- 172.21.15.82:0/1774063405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 msgr2=0x7f064c10aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 --2- 172.21.15.82:0/1774063405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c10aff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f06400098a0 tx=0x7f0640009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 -- 172.21.15.82:0/1774063405 shutdown_connections 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 --2- 172.21.15.82:0/1774063405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c10aff0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 -- 172.21.15.82:0/1774063405 >> 172.21.15.82:0/1774063405 conn(0x7f064c102570 msgr2=0x7f064c104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 -- 172.21.15.82:0/1774063405 shutdown_connections 2024-03-27T07:14:06.388 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 -- 172.21.15.82:0/1774063405 wait complete. 2024-03-27T07:14:06.389 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 Processor -- start 2024-03-27T07:14:06.389 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 -- start start 2024-03-27T07:14:06.389 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c108480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:06.392 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.542+0000 7f065303c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f064c10c490 con 0x7f064c108c00 2024-03-27T07:14:06.392 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.543+0000 7f0650dd8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:06.392 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.543+0000 7f0650dd8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57318/0 (socket says 172.21.15.82:57318) 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.543+0000 7f0650dd8700 1 -- 172.21.15.82:0/3044668349 learned_addr learned my addr 172.21.15.82:0/3044668349 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.543+0000 7f0650dd8700 1 -- 172.21.15.82:0/3044668349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c1089c0 con 0x7f064c108c00 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.543+0000 7f0650dd8700 1 --2- 172.21.15.82:0/3044668349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c108480 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0640011b60 tx=0x7f0640011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.543+0000 7f0649ffb700 1 -- 172.21.15.82:0/3044668349 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0640003970 con 0x7f064c108c00 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.543+0000 7f0649ffb700 1 -- 172.21.15.82:0/3044668349 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0640003b10 con 0x7f064c108c00 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.543+0000 7f0649ffb700 1 -- 172.21.15.82:0/3044668349 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0640024610 con 0x7f064c108c00 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.543+0000 7f065303c700 1 -- 172.21.15.82:0/3044668349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064c106bb0 con 0x7f064c108c00 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.543+0000 7f065303c700 1 -- 172.21.15.82:0/3044668349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064c1070f0 con 0x7f064c108c00 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.544+0000 7f0649ffb700 1 -- 172.21.15.82:0/3044668349 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f064001a9f0 con 0x7f064c108c00 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.544+0000 7f0649ffb700 1 --2- 172.21.15.82:0/3044668349 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f063c039420 0x7f063c03b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.544+0000 7f0649ffb700 1 -- 172.21.15.82:0/3044668349 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0640011e00 con 0x7f064c108c00 2024-03-27T07:14:06.393 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.544+0000 7f064bfff700 1 --2- 172.21.15.82:0/3044668349 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f063c039420 0x7f063c03b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.545+0000 7f065303c700 1 -- 172.21.15.82:0/3044668349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f064c069740 con 0x7f064c108c00 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.545+0000 7f064bfff700 1 --2- 172.21.15.82:0/3044668349 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f063c039420 0x7f063c03b8e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0638006fd0 tx=0x7f0638006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.550+0000 7f0649ffb700 1 -- 172.21.15.82:0/3044668349 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0640016260 con 0x7f064c108c00 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.785+0000 7f065303c700 1 -- 172.21.15.82:0/3044668349 --> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f064c107810 con 0x7f063c039420 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.786+0000 7f0649ffb700 1 -- 172.21.15.82:0/3044668349 <== mgr.14120 v2:172.21.15.82:6800/3434341690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f064c107810 con 0x7f063c039420 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.788+0000 7f065303c700 1 -- 172.21.15.82:0/3044668349 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f063c039420 msgr2=0x7f063c03b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.788+0000 7f065303c700 1 --2- 172.21.15.82:0/3044668349 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f063c039420 0x7f063c03b8e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0638006fd0 tx=0x7f0638006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.788+0000 7f065303c700 1 -- 172.21.15.82:0/3044668349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 msgr2=0x7f064c108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.788+0000 7f065303c700 1 --2- 172.21.15.82:0/3044668349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c108480 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0640011b60 tx=0x7f0640011c40 comp rx=0 tx=0).stop 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.789+0000 7f065303c700 1 -- 172.21.15.82:0/3044668349 shutdown_connections 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.789+0000 7f065303c700 1 --2- 172.21.15.82:0/3044668349 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f063c039420 0x7f063c03b8e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:06.394 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.789+0000 7f065303c700 1 --2- 172.21.15.82:0/3044668349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f064c108c00 0x7f064c108480 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:06.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.789+0000 7f065303c700 1 -- 172.21.15.82:0/3044668349 >> 172.21.15.82:0/3044668349 conn(0x7f064c102570 msgr2=0x7f064c1030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:06.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.789+0000 7f065303c700 1 -- 172.21.15.82:0/3044668349 shutdown_connections 2024-03-27T07:14:06.395 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:05.789+0000 7f065303c700 1 -- 172.21.15.82:0/3044668349 wait complete. 2024-03-27T07:14:06.395 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-27T07:14:06.395 INFO:teuthology.orchestra.run.smithi082.stdout:Adding key to root@localhost authorized_keys... 2024-03-27T07:14:06.395 INFO:teuthology.orchestra.run.smithi082.stdout:Adding host smithi082... 2024-03-27T07:14:06.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:06 smithi082 ceph-mon[32178]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:07.596 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:07 smithi082 ceph-mon[32178]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:08.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:08 smithi082 ceph-mon[32178]: Deploying cephadm binary to smithi082 2024-03-27T07:14:11.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Added host 'smithi082' with addr '172.21.15.82' 2024-03-27T07:14:11.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.798+0000 7f952deb6700 1 Processor -- start 2024-03-27T07:14:11.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.798+0000 7f952deb6700 1 -- start start 2024-03-27T07:14:11.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.798+0000 7f952deb6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f95281084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:11.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.798+0000 7f952deb6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9528108a90 con 0x7f95281080a0 2024-03-27T07:14:11.886 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.798+0000 7f95277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f95281084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:11.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.798+0000 7f95277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f95281084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57324/0 (socket says 172.21.15.82:57324) 2024-03-27T07:14:11.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.798+0000 7f95277fe700 1 -- 172.21.15.82:0/4194193738 learned_addr learned my addr 172.21.15.82:0/4194193738 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:11.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f95277fe700 1 -- 172.21.15.82:0/4194193738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95281092a0 con 0x7f95281080a0 2024-03-27T07:14:11.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f95277fe700 1 --2- 172.21.15.82:0/4194193738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f95281084c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f95180098a0 tx=0x7f9518009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44181fe9074ec0cc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:11.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f95267fc700 1 -- 172.21.15.82:0/4194193738 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9518004160 con 0x7f95281080a0 2024-03-27T07:14:11.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f95267fc700 1 -- 172.21.15.82:0/4194193738 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9518004300 con 0x7f95281080a0 2024-03-27T07:14:11.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f95267fc700 1 -- 172.21.15.82:0/4194193738 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9518011b50 con 0x7f95281080a0 2024-03-27T07:14:11.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f952deb6700 1 -- 172.21.15.82:0/4194193738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 msgr2=0x7f95281084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:11.887 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f952deb6700 1 --2- 172.21.15.82:0/4194193738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f95281084c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f95180098a0 tx=0x7f9518009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f952deb6700 1 -- 172.21.15.82:0/4194193738 shutdown_connections 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f952deb6700 1 --2- 172.21.15.82:0/4194193738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f95281084c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f952deb6700 1 -- 172.21.15.82:0/4194193738 >> 172.21.15.82:0/4194193738 conn(0x7f9528103660 msgr2=0x7f9528105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f952deb6700 1 -- 172.21.15.82:0/4194193738 shutdown_connections 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.799+0000 7f952deb6700 1 -- 172.21.15.82:0/4194193738 wait complete. 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.800+0000 7f952deb6700 1 Processor -- start 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.800+0000 7f952deb6700 1 -- start start 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.800+0000 7f952deb6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f952819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.800+0000 7f952deb6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f952810c650 con 0x7f95281080a0 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.800+0000 7f95277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f952819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:11.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.800+0000 7f95277fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f952819c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57340/0 (socket says 172.21.15.82:57340) 2024-03-27T07:14:11.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.800+0000 7f95277fe700 1 -- 172.21.15.82:0/1562207364 learned_addr learned my addr 172.21.15.82:0/1562207364 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:11.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.801+0000 7f95277fe700 1 -- 172.21.15.82:0/1562207364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952819c5b0 con 0x7f95281080a0 2024-03-27T07:14:11.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.801+0000 7f95277fe700 1 --2- 172.21.15.82:0/1562207364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f952819c070 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9518011670 tx=0x7f9518011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:11.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.801+0000 7f9524ff9700 1 -- 172.21.15.82:0/1562207364 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95180039c0 con 0x7f95281080a0 2024-03-27T07:14:11.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.801+0000 7f952deb6700 1 -- 172.21.15.82:0/1562207364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952819c840 con 0x7f95281080a0 2024-03-27T07:14:11.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.801+0000 7f9524ff9700 1 -- 172.21.15.82:0/1562207364 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9518011e50 con 0x7f95281080a0 2024-03-27T07:14:11.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.801+0000 7f9524ff9700 1 -- 172.21.15.82:0/1562207364 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f951801a5c0 con 0x7f95281080a0 2024-03-27T07:14:11.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.801+0000 7f952deb6700 1 -- 172.21.15.82:0/1562207364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952819f530 con 0x7f95281080a0 2024-03-27T07:14:11.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.802+0000 7f9524ff9700 1 -- 172.21.15.82:0/1562207364 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f951801a8c0 con 0x7f95281080a0 2024-03-27T07:14:11.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.802+0000 7f952deb6700 1 -- 172.21.15.82:0/1562207364 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9528063c70 con 0x7f95281080a0 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.802+0000 7f9524ff9700 1 --2- 172.21.15.82:0/1562207364 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f9510039380 0x7f951003b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.802+0000 7f9524ff9700 1 -- 172.21.15.82:0/1562207364 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f951804d9e0 con 0x7f95281080a0 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.802+0000 7f9526ffd700 1 --2- 172.21.15.82:0/1562207364 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f9510039380 0x7f951003b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.802+0000 7f9526ffd700 1 --2- 172.21.15.82:0/1562207364 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f9510039380 0x7f951003b840 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f951c006fd0 tx=0x7f951c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:06.807+0000 7f9524ff9700 1 -- 172.21.15.82:0/1562207364 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9518019c70 con 0x7f95281080a0 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:07.009+0000 7f952deb6700 1 -- 172.21.15.82:0/1562207364 --> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}) -- 0x7f9528104900 con 0x7f9510039380 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.278+0000 7f9524ff9700 1 -- 172.21.15.82:0/1562207364 <== mgr.14120 v2:172.21.15.82:6800/3434341690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f9528104900 con 0x7f9510039380 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.281+0000 7f952deb6700 1 -- 172.21.15.82:0/1562207364 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f9510039380 msgr2=0x7f951003b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.281+0000 7f952deb6700 1 --2- 172.21.15.82:0/1562207364 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f9510039380 0x7f951003b840 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f951c006fd0 tx=0x7f951c006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.281+0000 7f952deb6700 1 -- 172.21.15.82:0/1562207364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 msgr2=0x7f952819c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.281+0000 7f952deb6700 1 --2- 172.21.15.82:0/1562207364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f952819c070 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9518011670 tx=0x7f9518011b60 comp rx=0 tx=0).stop 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.281+0000 7f952deb6700 1 -- 172.21.15.82:0/1562207364 shutdown_connections 2024-03-27T07:14:11.890 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.281+0000 7f952deb6700 1 --2- 172.21.15.82:0/1562207364 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f9510039380 0x7f951003b840 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:11.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.281+0000 7f952deb6700 1 --2- 172.21.15.82:0/1562207364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95281080a0 0x7f952819c070 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:11.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.281+0000 7f952deb6700 1 -- 172.21.15.82:0/1562207364 >> 172.21.15.82:0/1562207364 conn(0x7f9528103660 msgr2=0x7f95281041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:11.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.281+0000 7f952deb6700 1 -- 172.21.15.82:0/1562207364 shutdown_connections 2024-03-27T07:14:11.891 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:11.281+0000 7f952deb6700 1 -- 172.21.15.82:0/1562207364 wait complete. 2024-03-27T07:14:11.891 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mon service... 2024-03-27T07:14:12.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:12 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:12.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:12 smithi082 ceph-mon[32178]: Added host smithi082 2024-03-27T07:14:12.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:12 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:14:13.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-27T07:14:13.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.316+0000 7f5734f38700 1 Processor -- start 2024-03-27T07:14:13.648 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.316+0000 7f5734f38700 1 -- start start 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.316+0000 7f5734f38700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f57301073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.316+0000 7f5734f38700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f57301079a0 con 0x7f5730106fb0 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.316+0000 7f572e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f57301073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.316+0000 7f572e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f57301073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60794/0 (socket says 172.21.15.82:60794) 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.316+0000 7f572e59c700 1 -- 172.21.15.82:0/1138590879 learned_addr learned my addr 172.21.15.82:0/1138590879 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.317+0000 7f572e59c700 1 -- 172.21.15.82:0/1138590879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57301081b0 con 0x7f5730106fb0 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.317+0000 7f572e59c700 1 --2- 172.21.15.82:0/1138590879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f57301073d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57200098a0 tx=0x7f5720009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33887bbdbcc73a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.317+0000 7f572dd9b700 1 -- 172.21.15.82:0/1138590879 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5720004160 con 0x7f5730106fb0 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.317+0000 7f572dd9b700 1 -- 172.21.15.82:0/1138590879 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5720004300 con 0x7f5730106fb0 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.317+0000 7f572dd9b700 1 -- 172.21.15.82:0/1138590879 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5720011b50 con 0x7f5730106fb0 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.317+0000 7f5734f38700 1 -- 172.21.15.82:0/1138590879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 msgr2=0x7f57301073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:13.649 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.317+0000 7f5734f38700 1 --2- 172.21.15.82:0/1138590879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f57301073d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57200098a0 tx=0x7f5720009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.318+0000 7f5734f38700 1 -- 172.21.15.82:0/1138590879 shutdown_connections 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.318+0000 7f5734f38700 1 --2- 172.21.15.82:0/1138590879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f57301073d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.318+0000 7f5734f38700 1 -- 172.21.15.82:0/1138590879 >> 172.21.15.82:0/1138590879 conn(0x7f5730102570 msgr2=0x7f5730104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.318+0000 7f5734f38700 1 -- 172.21.15.82:0/1138590879 shutdown_connections 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.318+0000 7f5734f38700 1 -- 172.21.15.82:0/1138590879 wait complete. 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.318+0000 7f5734f38700 1 Processor -- start 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.318+0000 7f5734f38700 1 -- start start 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f5734f38700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f573019c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f5734f38700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f573010b560 con 0x7f5730106fb0 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f572e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f573019c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f572e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f573019c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60806/0 (socket says 172.21.15.82:60806) 2024-03-27T07:14:13.650 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f572e59c700 1 -- 172.21.15.82:0/4278207726 learned_addr learned my addr 172.21.15.82:0/4278207726 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f572e59c700 1 -- 172.21.15.82:0/4278207726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573019c610 con 0x7f5730106fb0 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f572e59c700 1 --2- 172.21.15.82:0/4278207726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f573019c0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5720011670 tx=0x7f5720011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f5727fff700 1 -- 172.21.15.82:0/4278207726 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57200039c0 con 0x7f5730106fb0 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f5727fff700 1 -- 172.21.15.82:0/4278207726 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5720011e50 con 0x7f5730106fb0 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f5734f38700 1 -- 172.21.15.82:0/4278207726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573019c8a0 con 0x7f5730106fb0 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f5727fff700 1 -- 172.21.15.82:0/4278207726 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f572001a5c0 con 0x7f5730106fb0 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.319+0000 7f5734f38700 1 -- 172.21.15.82:0/4278207726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f573019f590 con 0x7f5730106fb0 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.320+0000 7f5727fff700 1 -- 172.21.15.82:0/4278207726 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f572001a8c0 con 0x7f5730106fb0 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.320+0000 7f5734f38700 1 -- 172.21.15.82:0/4278207726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5730063c70 con 0x7f5730106fb0 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.320+0000 7f5727fff700 1 --2- 172.21.15.82:0/4278207726 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f571c039380 0x7f571c03b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.320+0000 7f5727fff700 1 -- 172.21.15.82:0/4278207726 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f572004d8d0 con 0x7f5730106fb0 2024-03-27T07:14:13.651 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.320+0000 7f5725d9b700 1 --2- 172.21.15.82:0/4278207726 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f571c039380 0x7f571c03b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.321+0000 7f5725d9b700 1 --2- 172.21.15.82:0/4278207726 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f571c039380 0x7f571c03b840 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5718006fd0 tx=0x7f5718006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.325+0000 7f5727fff700 1 -- 172.21.15.82:0/4278207726 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f5720019c70 con 0x7f5730106fb0 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.545+0000 7f5734f38700 1 -- 172.21.15.82:0/4278207726 --> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f57300008d0 con 0x7f571c039380 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.553+0000 7f5727fff700 1 -- 172.21.15.82:0/4278207726 <== mgr.14120 v2:172.21.15.82:6800/3434341690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f57300008d0 con 0x7f571c039380 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.555+0000 7f5734f38700 1 -- 172.21.15.82:0/4278207726 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f571c039380 msgr2=0x7f571c03b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.555+0000 7f5734f38700 1 --2- 172.21.15.82:0/4278207726 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f571c039380 0x7f571c03b840 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5718006fd0 tx=0x7f5718006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.555+0000 7f5734f38700 1 -- 172.21.15.82:0/4278207726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 msgr2=0x7f573019c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.555+0000 7f5734f38700 1 --2- 172.21.15.82:0/4278207726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f573019c0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5720011670 tx=0x7f5720011b60 comp rx=0 tx=0).stop 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.555+0000 7f5734f38700 1 -- 172.21.15.82:0/4278207726 shutdown_connections 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.555+0000 7f5734f38700 1 --2- 172.21.15.82:0/4278207726 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f571c039380 0x7f571c03b840 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.555+0000 7f5734f38700 1 --2- 172.21.15.82:0/4278207726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5730106fb0 0x7f573019c0d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.555+0000 7f5734f38700 1 -- 172.21.15.82:0/4278207726 >> 172.21.15.82:0/4278207726 conn(0x7f5730102570 msgr2=0x7f5730103410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:13.652 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.555+0000 7f5734f38700 1 -- 172.21.15.82:0/4278207726 shutdown_connections 2024-03-27T07:14:13.653 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:12.555+0000 7f5734f38700 1 -- 172.21.15.82:0/4278207726 wait complete. 2024-03-27T07:14:13.653 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mgr service... 2024-03-27T07:14:13.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:13 smithi082 ceph-mon[32178]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:13 smithi082 ceph-mon[32178]: Saving service mon spec with placement count:5 2024-03-27T07:14:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:13 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:15.147 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.396+0000 7fa220485700 1 Processor -- start 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.396+0000 7fa220485700 1 -- start start 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.396+0000 7fa220485700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21807c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.396+0000 7fa220485700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa21807c8c0 con 0x7fa21807de90 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.396+0000 7fa21e221700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21807c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.396+0000 7fa21e221700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21807c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60816/0 (socket says 172.21.15.82:60816) 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.396+0000 7fa21e221700 1 -- 172.21.15.82:0/3121223709 learned_addr learned my addr 172.21.15.82:0/3121223709 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.396+0000 7fa21e221700 1 -- 172.21.15.82:0/3121223709 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21807ca40 con 0x7fa21807de90 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.397+0000 7fa21e221700 1 --2- 172.21.15.82:0/3121223709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21807c2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa2140098a0 tx=0x7fa214009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3ab7d7610d29d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.397+0000 7fa21d21f700 1 -- 172.21.15.82:0/3121223709 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa214004160 con 0x7fa21807de90 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.397+0000 7fa21d21f700 1 -- 172.21.15.82:0/3121223709 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa214004300 con 0x7fa21807de90 2024-03-27T07:14:15.148 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.397+0000 7fa21d21f700 1 -- 172.21.15.82:0/3121223709 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa214011b20 con 0x7fa21807de90 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.397+0000 7fa220485700 1 -- 172.21.15.82:0/3121223709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 msgr2=0x7fa21807c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.397+0000 7fa220485700 1 --2- 172.21.15.82:0/3121223709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21807c2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa2140098a0 tx=0x7fa214009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.398+0000 7fa220485700 1 -- 172.21.15.82:0/3121223709 shutdown_connections 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.398+0000 7fa220485700 1 --2- 172.21.15.82:0/3121223709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21807c2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.398+0000 7fa220485700 1 -- 172.21.15.82:0/3121223709 >> 172.21.15.82:0/3121223709 conn(0x7fa218103660 msgr2=0x7fa218105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.398+0000 7fa220485700 1 -- 172.21.15.82:0/3121223709 shutdown_connections 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.398+0000 7fa220485700 1 -- 172.21.15.82:0/3121223709 wait complete. 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.398+0000 7fa220485700 1 Processor -- start 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.398+0000 7fa220485700 1 -- start start 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa220485700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21819e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa220485700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa21810e700 con 0x7fa21807de90 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa21e221700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21819e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa21e221700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21819e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60820/0 (socket says 172.21.15.82:60820) 2024-03-27T07:14:15.149 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa21e221700 1 -- 172.21.15.82:0/2938457877 learned_addr learned my addr 172.21.15.82:0/2938457877 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa21e221700 1 -- 172.21.15.82:0/2938457877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21819e740 con 0x7fa21807de90 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa21e221700 1 --2- 172.21.15.82:0/2938457877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21819e200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa2140117e0 tx=0x7fa214011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa20b7fe700 1 -- 172.21.15.82:0/2938457877 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa214003bf0 con 0x7fa21807de90 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa220485700 1 -- 172.21.15.82:0/2938457877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21819e9d0 con 0x7fa21807de90 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa20b7fe700 1 -- 172.21.15.82:0/2938457877 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa21401a910 con 0x7fa21807de90 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa20b7fe700 1 -- 172.21.15.82:0/2938457877 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2140249a0 con 0x7fa21807de90 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.399+0000 7fa220485700 1 -- 172.21.15.82:0/2938457877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa21819ee30 con 0x7fa21807de90 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.400+0000 7fa20b7fe700 1 -- 172.21.15.82:0/2938457877 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7fa214022020 con 0x7fa21807de90 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.400+0000 7fa20b7fe700 1 --2- 172.21.15.82:0/2938457877 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fa204039380 0x7fa20403b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.400+0000 7fa20b7fe700 1 -- 172.21.15.82:0/2938457877 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa21404d760 con 0x7fa21807de90 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.401+0000 7fa21da20700 1 --2- 172.21.15.82:0/2938457877 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fa204039380 0x7fa20403b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:15.150 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.401+0000 7fa220485700 1 -- 172.21.15.82:0/2938457877 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa218063c70 con 0x7fa21807de90 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.401+0000 7fa21da20700 1 --2- 172.21.15.82:0/2938457877 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fa204039380 0x7fa20403b840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa20c006fd0 tx=0x7fa20c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.410+0000 7fa20b7fe700 1 -- 172.21.15.82:0/2938457877 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa214011e20 con 0x7fa21807de90 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.630+0000 7fa220485700 1 -- 172.21.15.82:0/2938457877 --> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fa218104810 con 0x7fa204039380 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.638+0000 7fa20b7fe700 1 -- 172.21.15.82:0/2938457877 <== mgr.14120 v2:172.21.15.82:6800/3434341690 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa218104810 con 0x7fa204039380 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.640+0000 7fa220485700 1 -- 172.21.15.82:0/2938457877 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fa204039380 msgr2=0x7fa20403b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.640+0000 7fa220485700 1 --2- 172.21.15.82:0/2938457877 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fa204039380 0x7fa20403b840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa20c006fd0 tx=0x7fa20c006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.640+0000 7fa220485700 1 -- 172.21.15.82:0/2938457877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 msgr2=0x7fa21819e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.640+0000 7fa220485700 1 --2- 172.21.15.82:0/2938457877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21819e200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa2140117e0 tx=0x7fa214011c10 comp rx=0 tx=0).stop 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.640+0000 7fa220485700 1 -- 172.21.15.82:0/2938457877 shutdown_connections 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.640+0000 7fa220485700 1 --2- 172.21.15.82:0/2938457877 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fa204039380 0x7fa20403b840 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.640+0000 7fa220485700 1 --2- 172.21.15.82:0/2938457877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa21807de90 0x7fa21819e200 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.640+0000 7fa220485700 1 -- 172.21.15.82:0/2938457877 >> 172.21.15.82:0/2938457877 conn(0x7fa218103660 msgr2=0x7fa218104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.640+0000 7fa220485700 1 -- 172.21.15.82:0/2938457877 shutdown_connections 2024-03-27T07:14:15.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:14.640+0000 7fa220485700 1 -- 172.21.15.82:0/2938457877 wait complete. 2024-03-27T07:14:15.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:15 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:15.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:15 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:15.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:15 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:16.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:16 smithi082 ceph-mon[32178]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:16.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:16 smithi082 ceph-mon[32178]: Saving service mgr spec with placement count:2 2024-03-27T07:14:16.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:16 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2060855542' entity='client.admin' 2024-03-27T07:14:16.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.560+0000 7f66cc830700 1 Processor -- start 2024-03-27T07:14:16.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.560+0000 7f66cc830700 1 -- start start 2024-03-27T07:14:16.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.560+0000 7f66cc830700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c810af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:16.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.560+0000 7f66cc830700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f66c807be40 con 0x7f66c8108b80 2024-03-27T07:14:16.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.561+0000 7f66c659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c810af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:16.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.561+0000 7f66c659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c810af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60830/0 (socket says 172.21.15.82:60830) 2024-03-27T07:14:16.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.561+0000 7f66c659c700 1 -- 172.21.15.82:0/3835136810 learned_addr learned my addr 172.21.15.82:0/3835136810 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:16.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.561+0000 7f66c659c700 1 -- 172.21.15.82:0/3835136810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c810b4b0 con 0x7f66c8108b80 2024-03-27T07:14:16.833 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.561+0000 7f66c659c700 1 --2- 172.21.15.82:0/3835136810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c810af70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009e80 tx=0x7f66c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c705ba977626d2ee server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.561+0000 7f66c559a700 1 -- 172.21.15.82:0/3835136810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c0017070 con 0x7f66c8108b80 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.561+0000 7f66c559a700 1 -- 172.21.15.82:0/3835136810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66c000b8c0 con 0x7f66c8108b80 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.561+0000 7f66c559a700 1 -- 172.21.15.82:0/3835136810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c00045c0 con 0x7f66c8108b80 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.562+0000 7f66cc830700 1 -- 172.21.15.82:0/3835136810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 msgr2=0x7f66c810af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.562+0000 7f66cc830700 1 --2- 172.21.15.82:0/3835136810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c810af70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009e80 tx=0x7f66c000b330 comp rx=0 tx=0).stop 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.562+0000 7f66cc830700 1 -- 172.21.15.82:0/3835136810 shutdown_connections 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.562+0000 7f66cc830700 1 --2- 172.21.15.82:0/3835136810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c810af70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.562+0000 7f66cc830700 1 -- 172.21.15.82:0/3835136810 >> 172.21.15.82:0/3835136810 conn(0x7f66c8102570 msgr2=0x7f66c8104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.562+0000 7f66cc830700 1 -- 172.21.15.82:0/3835136810 shutdown_connections 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.562+0000 7f66cc830700 1 -- 172.21.15.82:0/3835136810 wait complete. 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.562+0000 7f66cc830700 1 Processor -- start 2024-03-27T07:14:16.834 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66cc830700 1 -- start start 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66cc830700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c819c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66cc830700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f66c810c4c0 con 0x7f66c8108b80 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66c659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c819c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66c659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c819c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60834/0 (socket says 172.21.15.82:60834) 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66c659c700 1 -- 172.21.15.82:0/2060855542 learned_addr learned my addr 172.21.15.82:0/2060855542 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66c659c700 1 -- 172.21.15.82:0/2060855542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c819c5a0 con 0x7f66c8108b80 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66c659c700 1 --2- 172.21.15.82:0/2060855542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c819c060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009530 tx=0x7f66c0003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66bf7fe700 1 -- 172.21.15.82:0/2060855542 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c0020020 con 0x7f66c8108b80 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66bf7fe700 1 -- 172.21.15.82:0/2060855542 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f66c000bba0 con 0x7f66c8108b80 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66cc830700 1 -- 172.21.15.82:0/2060855542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c819c830 con 0x7f66c8108b80 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66bf7fe700 1 -- 172.21.15.82:0/2060855542 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c0017040 con 0x7f66c8108b80 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.563+0000 7f66cc830700 1 -- 172.21.15.82:0/2060855542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c819f520 con 0x7f66c8108b80 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.564+0000 7f66bf7fe700 1 -- 172.21.15.82:0/2060855542 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f66c0023020 con 0x7f66c8108b80 2024-03-27T07:14:16.835 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.564+0000 7f66bf7fe700 1 --2- 172.21.15.82:0/2060855542 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f66b4039420 0x7f66b403b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:16.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.564+0000 7f66bf7fe700 1 -- 172.21.15.82:0/2060855542 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f66c000f050 con 0x7f66c8108b80 2024-03-27T07:14:16.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.564+0000 7f66c5d9b700 1 --2- 172.21.15.82:0/2060855542 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f66b4039420 0x7f66b403b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:16.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.564+0000 7f66cc830700 1 -- 172.21.15.82:0/2060855542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c8069740 con 0x7f66c8108b80 2024-03-27T07:14:16.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.565+0000 7f66c5d9b700 1 --2- 172.21.15.82:0/2060855542 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f66b4039420 0x7f66b403b8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006fd0 tx=0x7f66b0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:16.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.569+0000 7f66bf7fe700 1 -- 172.21.15.82:0/2060855542 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f66c002a020 con 0x7f66c8108b80 2024-03-27T07:14:16.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.777+0000 7f66cc830700 1 -- 172.21.15.82:0/2060855542 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f66c819fa40 con 0x7f66c8108b80 2024-03-27T07:14:16.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.780+0000 7f66bf7fe700 1 -- 172.21.15.82:0/2060855542 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f66c002c300 con 0x7f66c8108b80 2024-03-27T07:14:16.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.782+0000 7f66cc830700 1 -- 172.21.15.82:0/2060855542 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f66b4039420 msgr2=0x7f66b403b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:16.836 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.782+0000 7f66cc830700 1 --2- 172.21.15.82:0/2060855542 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f66b4039420 0x7f66b403b8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006fd0 tx=0x7f66b0006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:16.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.782+0000 7f66cc830700 1 -- 172.21.15.82:0/2060855542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 msgr2=0x7f66c819c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:16.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.782+0000 7f66cc830700 1 --2- 172.21.15.82:0/2060855542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c819c060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009530 tx=0x7f66c0003d00 comp rx=0 tx=0).stop 2024-03-27T07:14:16.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.782+0000 7f66cc830700 1 -- 172.21.15.82:0/2060855542 shutdown_connections 2024-03-27T07:14:16.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.782+0000 7f66cc830700 1 --2- 172.21.15.82:0/2060855542 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f66b4039420 0x7f66b403b8e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:16.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.782+0000 7f66cc830700 1 --2- 172.21.15.82:0/2060855542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f66c8108b80 0x7f66c819c060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:16.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.782+0000 7f66cc830700 1 -- 172.21.15.82:0/2060855542 >> 172.21.15.82:0/2060855542 conn(0x7f66c8102570 msgr2=0x7f66c8103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:16.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.783+0000 7f66cc830700 1 -- 172.21.15.82:0/2060855542 shutdown_connections 2024-03-27T07:14:16.837 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:15.783+0000 7f66cc830700 1 -- 172.21.15.82:0/2060855542 wait complete. 2024-03-27T07:14:17.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:17 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:18.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.285+0000 7f56ea90b700 1 Processor -- start 2024-03-27T07:14:18.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.285+0000 7f56ea90b700 1 -- start start 2024-03-27T07:14:18.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.285+0000 7f56ea90b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e41089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:18.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.285+0000 7f56ea90b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56e4108f80 con 0x7f56e4108590 2024-03-27T07:14:18.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.285+0000 7f56e3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e41089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:18.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.285+0000 7f56e3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e41089b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60842/0 (socket says 172.21.15.82:60842) 2024-03-27T07:14:18.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.285+0000 7f56e3fff700 1 -- 172.21.15.82:0/1884095696 learned_addr learned my addr 172.21.15.82:0/1884095696 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:18.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.286+0000 7f56e3fff700 1 -- 172.21.15.82:0/1884095696 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e41071a0 con 0x7f56e4108590 2024-03-27T07:14:18.181 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.286+0000 7f56e3fff700 1 --2- 172.21.15.82:0/1884095696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e41089b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56d40098a0 tx=0x7f56d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f37f90b2ade156 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.286+0000 7f56e2ffd700 1 -- 172.21.15.82:0/1884095696 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d4004160 con 0x7f56e4108590 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.286+0000 7f56e2ffd700 1 -- 172.21.15.82:0/1884095696 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56d4004300 con 0x7f56e4108590 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.286+0000 7f56e2ffd700 1 -- 172.21.15.82:0/1884095696 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d4011b20 con 0x7f56e4108590 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.287+0000 7f56ea90b700 1 -- 172.21.15.82:0/1884095696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 msgr2=0x7f56e41089b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.287+0000 7f56ea90b700 1 --2- 172.21.15.82:0/1884095696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e41089b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56d40098a0 tx=0x7f56d4009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.287+0000 7f56ea90b700 1 -- 172.21.15.82:0/1884095696 shutdown_connections 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.287+0000 7f56ea90b700 1 --2- 172.21.15.82:0/1884095696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e41089b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.287+0000 7f56ea90b700 1 -- 172.21.15.82:0/1884095696 >> 172.21.15.82:0/1884095696 conn(0x7f56e4101d90 msgr2=0x7f56e41041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.287+0000 7f56ea90b700 1 -- 172.21.15.82:0/1884095696 shutdown_connections 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.287+0000 7f56ea90b700 1 -- 172.21.15.82:0/1884095696 wait complete. 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.288+0000 7f56ea90b700 1 Processor -- start 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.288+0000 7f56ea90b700 1 -- start start 2024-03-27T07:14:18.182 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.288+0000 7f56ea90b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e4192160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.288+0000 7f56ea90b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56e410b560 con 0x7f56e4108590 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.288+0000 7f56e3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e4192160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.288+0000 7f56e3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e4192160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60850/0 (socket says 172.21.15.82:60850) 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.288+0000 7f56e3fff700 1 -- 172.21.15.82:0/2385203298 learned_addr learned my addr 172.21.15.82:0/2385203298 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.288+0000 7f56e3fff700 1 -- 172.21.15.82:0/2385203298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e41926a0 con 0x7f56e4108590 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.289+0000 7f56e3fff700 1 --2- 172.21.15.82:0/2385203298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e4192160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f56d40117e0 tx=0x7f56d4011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.289+0000 7f56e17fa700 1 -- 172.21.15.82:0/2385203298 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d4003bf0 con 0x7f56e4108590 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.289+0000 7f56ea90b700 1 -- 172.21.15.82:0/2385203298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e4190890 con 0x7f56e4108590 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.289+0000 7f56e17fa700 1 -- 172.21.15.82:0/2385203298 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f56d401a910 con 0x7f56e4108590 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.289+0000 7f56ea90b700 1 -- 172.21.15.82:0/2385203298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e4190d50 con 0x7f56e4108590 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.289+0000 7f56e17fa700 1 -- 172.21.15.82:0/2385203298 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56d4024970 con 0x7f56e4108590 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.290+0000 7f56e17fa700 1 -- 172.21.15.82:0/2385203298 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f56d4022020 con 0x7f56e4108590 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.290+0000 7f56e17fa700 1 --2- 172.21.15.82:0/2385203298 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f56cc0393d0 0x7f56cc03b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.290+0000 7f56e17fa700 1 -- 172.21.15.82:0/2385203298 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f56d404dca0 con 0x7f56e4108590 2024-03-27T07:14:18.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.290+0000 7f56ea90b700 1 -- 172.21.15.82:0/2385203298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e4063c70 con 0x7f56e4108590 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.290+0000 7f56e37fe700 1 --2- 172.21.15.82:0/2385203298 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f56cc0393d0 0x7f56cc03b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.291+0000 7f56e37fe700 1 --2- 172.21.15.82:0/2385203298 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f56cc0393d0 0x7f56cc03b890 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f56d8006fd0 tx=0x7f56d8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.295+0000 7f56e17fa700 1 -- 172.21.15.82:0/2385203298 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f56d4020c10 con 0x7f56e4108590 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.500+0000 7f56ea90b700 1 -- 172.21.15.82:0/2385203298 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f56e4195e90 con 0x7f56e4108590 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.504+0000 7f56e17fa700 1 -- 172.21.15.82:0/2385203298 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f56d400b5a0 con 0x7f56e4108590 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.506+0000 7f56ea90b700 1 -- 172.21.15.82:0/2385203298 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f56cc0393d0 msgr2=0x7f56cc03b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.506+0000 7f56ea90b700 1 --2- 172.21.15.82:0/2385203298 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f56cc0393d0 0x7f56cc03b890 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f56d8006fd0 tx=0x7f56d8006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.506+0000 7f56ea90b700 1 -- 172.21.15.82:0/2385203298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 msgr2=0x7f56e4192160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.506+0000 7f56ea90b700 1 --2- 172.21.15.82:0/2385203298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e4192160 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f56d40117e0 tx=0x7f56d4011ba0 comp rx=0 tx=0).stop 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.506+0000 7f56ea90b700 1 -- 172.21.15.82:0/2385203298 shutdown_connections 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.506+0000 7f56ea90b700 1 --2- 172.21.15.82:0/2385203298 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f56cc0393d0 0x7f56cc03b890 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.506+0000 7f56ea90b700 1 --2- 172.21.15.82:0/2385203298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56e4108590 0x7f56e4192160 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.506+0000 7f56ea90b700 1 -- 172.21.15.82:0/2385203298 >> 172.21.15.82:0/2385203298 conn(0x7f56e4101d90 msgr2=0x7f56e4102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:18.184 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.506+0000 7f56ea90b700 1 -- 172.21.15.82:0/2385203298 shutdown_connections 2024-03-27T07:14:18.185 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:17.506+0000 7f56ea90b700 1 -- 172.21.15.82:0/2385203298 wait complete. 2024-03-27T07:14:18.185 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling the dashboard module... 2024-03-27T07:14:18.595 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:18 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2385203298' entity='client.admin' 2024-03-27T07:14:18.595 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:18 smithi082 ceph-mon[32178]: from='mgr.14120 172.21.15.82:0/4179522971' entity='mgr.x' 2024-03-27T07:14:19.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:19 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2493423490' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-27T07:14:19.936 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:19 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: ignoring --setuser ceph since I am not root 2024-03-27T07:14:19.937 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:19 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: ignoring --setgroup ceph since I am not root 2024-03-27T07:14:20.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.594+0000 7f1ae73aa700 1 Processor -- start 2024-03-27T07:14:20.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.594+0000 7f1ae73aa700 1 -- start start 2024-03-27T07:14:20.151 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.594+0000 7f1ae73aa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae01084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.594+0000 7f1ae73aa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae0108ac0 con 0x7f1ae01080d0 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.594+0000 7f1ae5146700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae01084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.594+0000 7f1ae5146700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae01084f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50884/0 (socket says 172.21.15.82:50884) 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.594+0000 7f1ae5146700 1 -- 172.21.15.82:0/1001716230 learned_addr learned my addr 172.21.15.82:0/1001716230 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.594+0000 7f1ae5146700 1 -- 172.21.15.82:0/1001716230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae01092d0 con 0x7f1ae01080d0 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.595+0000 7f1ae5146700 1 --2- 172.21.15.82:0/1001716230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae01084f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0098a0 tx=0x7f1adc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256d709cd2434c6d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.595+0000 7f1ad7fff700 1 -- 172.21.15.82:0/1001716230 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1adc004160 con 0x7f1ae01080d0 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.595+0000 7f1ad7fff700 1 -- 172.21.15.82:0/1001716230 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1adc004300 con 0x7f1ae01080d0 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.595+0000 7f1ad7fff700 1 -- 172.21.15.82:0/1001716230 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1adc011b20 con 0x7f1ae01080d0 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.596+0000 7f1ae73aa700 1 -- 172.21.15.82:0/1001716230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 msgr2=0x7f1ae01084f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.596+0000 7f1ae73aa700 1 --2- 172.21.15.82:0/1001716230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae01084f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0098a0 tx=0x7f1adc009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.596+0000 7f1ae73aa700 1 -- 172.21.15.82:0/1001716230 shutdown_connections 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.596+0000 7f1ae73aa700 1 --2- 172.21.15.82:0/1001716230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae01084f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:20.152 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.596+0000 7f1ae73aa700 1 -- 172.21.15.82:0/1001716230 >> 172.21.15.82:0/1001716230 conn(0x7f1ae0103670 msgr2=0x7f1ae0105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.596+0000 7f1ae73aa700 1 -- 172.21.15.82:0/1001716230 shutdown_connections 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.596+0000 7f1ae73aa700 1 -- 172.21.15.82:0/1001716230 wait complete. 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.596+0000 7f1ae73aa700 1 Processor -- start 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.596+0000 7f1ae73aa700 1 -- start start 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ae73aa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae0199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ae73aa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1ae007c0d0 con 0x7f1ae01080d0 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ae5146700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae0199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ae5146700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae0199e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50894/0 (socket says 172.21.15.82:50894) 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ae5146700 1 -- 172.21.15.82:0/2493423490 learned_addr learned my addr 172.21.15.82:0/2493423490 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ae5146700 1 -- 172.21.15.82:0/2493423490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ae019a340 con 0x7f1ae01080d0 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ae5146700 1 --2- 172.21.15.82:0/2493423490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae0199e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0117e0 tx=0x7f1adc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ad67fc700 1 -- 172.21.15.82:0/2493423490 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1adc003bf0 con 0x7f1ae01080d0 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ad67fc700 1 -- 172.21.15.82:0/2493423490 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1adc01a910 con 0x7f1ae01080d0 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ad67fc700 1 -- 172.21.15.82:0/2493423490 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1adc024970 con 0x7f1ae01080d0 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ae73aa700 1 -- 172.21.15.82:0/2493423490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ae019a5d0 con 0x7f1ae01080d0 2024-03-27T07:14:20.153 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.597+0000 7f1ae73aa700 1 -- 172.21.15.82:0/2493423490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ae019aa30 con 0x7f1ae01080d0 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.598+0000 7f1ad67fc700 1 -- 172.21.15.82:0/2493423490 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f1adc022020 con 0x7f1ae01080d0 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.598+0000 7f1ae73aa700 1 -- 172.21.15.82:0/2493423490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ae0063c70 con 0x7f1ae01080d0 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.598+0000 7f1ad67fc700 1 --2- 172.21.15.82:0/2493423490 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f1acc03d880 0x7f1acc03fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.598+0000 7f1ad67fc700 1 -- 172.21.15.82:0/2493423490 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1adc04d880 con 0x7f1ae01080d0 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.598+0000 7f1ae4945700 1 --2- 172.21.15.82:0/2493423490 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f1acc03d880 0x7f1acc03fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.599+0000 7f1ae4945700 1 --2- 172.21.15.82:0/2493423490 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f1acc03d880 0x7f1acc03fd40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0006fd0 tx=0x7f1ad0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.603+0000 7f1ad67fc700 1 -- 172.21.15.82:0/2493423490 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1adc0212c0 con 0x7f1ae01080d0 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:18.875+0000 7f1ae73aa700 1 -- 172.21.15.82:0/2493423490 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f1ae0063250 con 0x7f1ae01080d0 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.507+0000 7f1ad67fc700 1 -- 172.21.15.82:0/2493423490 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f1adc04d1d0 con 0x7f1ae01080d0 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.508+0000 7f1ad67fc700 1 -- 172.21.15.82:0/2493423490 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 9) ==== 46479+0+0 (secure 0 0 0) 0x7f1adc04fcc0 con 0x7f1ae01080d0 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.509+0000 7f1ae73aa700 1 -- 172.21.15.82:0/2493423490 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f1acc03d880 msgr2=0x7f1acc03fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.510+0000 7f1ae73aa700 1 --2- 172.21.15.82:0/2493423490 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f1acc03d880 0x7f1acc03fd40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0006fd0 tx=0x7f1ad0006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.510+0000 7f1ae73aa700 1 -- 172.21.15.82:0/2493423490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 msgr2=0x7f1ae0199e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:20.154 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.510+0000 7f1ae73aa700 1 --2- 172.21.15.82:0/2493423490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae0199e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0117e0 tx=0x7f1adc011ba0 comp rx=0 tx=0).stop 2024-03-27T07:14:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.510+0000 7f1ae73aa700 1 -- 172.21.15.82:0/2493423490 shutdown_connections 2024-03-27T07:14:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.510+0000 7f1ae73aa700 1 --2- 172.21.15.82:0/2493423490 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f1acc03d880 0x7f1acc03fd40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.510+0000 7f1ae73aa700 1 --2- 172.21.15.82:0/2493423490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae01080d0 0x7f1ae0199e00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.510+0000 7f1ae73aa700 1 -- 172.21.15.82:0/2493423490 >> 172.21.15.82:0/2493423490 conn(0x7f1ae0103670 msgr2=0x7f1ae0105a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.510+0000 7f1ae73aa700 1 -- 172.21.15.82:0/2493423490 shutdown_connections 2024-03-27T07:14:20.155 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:19.510+0000 7f1ae73aa700 1 -- 172.21.15.82:0/2493423490 wait complete. 2024-03-27T07:14:20.253 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:20.080+0000 7f1e9e7e6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T07:14:20.253 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:20.176+0000 7f1e9e7e6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T07:14:20.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:20 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2493423490' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-27T07:14:20.793 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:20 smithi082 ceph-mon[32178]: mgrmap e9: x(active, since 19s) 2024-03-27T07:14:21.082 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:20.844+0000 7f1e9e7e6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T07:14:21.082 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:20.938+0000 7f1e9e7e6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T07:14:21.082 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:21.081+0000 7f1e9e7e6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T07:14:21.360 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:21.177+0000 7f1e9e7e6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T07:14:21.361 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:21.260+0000 7f1e9e7e6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T07:14:21.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-27T07:14:21.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-27T07:14:21.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-27T07:14:21.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-27T07:14:21.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-27T07:14:21.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.518+0000 7f4e007cf700 1 Processor -- start 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.519+0000 7f4e007cf700 1 -- start start 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.519+0000 7f4e007cf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df810af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.519+0000 7f4e007cf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4df807be40 con 0x7f4df8108b80 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.519+0000 7f4dfe56b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df810af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.519+0000 7f4dfe56b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df810af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50924/0 (socket says 172.21.15.82:50924) 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.519+0000 7f4dfe56b700 1 -- 172.21.15.82:0/2152431038 learned_addr learned my addr 172.21.15.82:0/2152431038 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.519+0000 7f4dfe56b700 1 -- 172.21.15.82:0/2152431038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df810b4b0 con 0x7f4df8108b80 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.520+0000 7f4dfe56b700 1 --2- 172.21.15.82:0/2152431038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df810af70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4df40098a0 tx=0x7f4df4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4552b00d59ff5bd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.520+0000 7f4dfd569700 1 -- 172.21.15.82:0/2152431038 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4004160 con 0x7f4df8108b80 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.520+0000 7f4dfd569700 1 -- 172.21.15.82:0/2152431038 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4df4004300 con 0x7f4df8108b80 2024-03-27T07:14:21.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.520+0000 7f4dfd569700 1 -- 172.21.15.82:0/2152431038 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4011b20 con 0x7f4df8108b80 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.520+0000 7f4e007cf700 1 -- 172.21.15.82:0/2152431038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 msgr2=0x7f4df810af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.520+0000 7f4e007cf700 1 --2- 172.21.15.82:0/2152431038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df810af70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4df40098a0 tx=0x7f4df4009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.521+0000 7f4e007cf700 1 -- 172.21.15.82:0/2152431038 shutdown_connections 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.521+0000 7f4e007cf700 1 --2- 172.21.15.82:0/2152431038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df810af70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.521+0000 7f4e007cf700 1 -- 172.21.15.82:0/2152431038 >> 172.21.15.82:0/2152431038 conn(0x7f4df8102570 msgr2=0x7f4df8104990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.521+0000 7f4e007cf700 1 -- 172.21.15.82:0/2152431038 shutdown_connections 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.521+0000 7f4e007cf700 1 -- 172.21.15.82:0/2152431038 wait complete. 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.521+0000 7f4e007cf700 1 Processor -- start 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.521+0000 7f4e007cf700 1 -- start start 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.521+0000 7f4e007cf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df819c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.521+0000 7f4e007cf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4df810c4c0 con 0x7f4df8108b80 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.522+0000 7f4dfe56b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df819c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:21.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.522+0000 7f4dfe56b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df819c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50926/0 (socket says 172.21.15.82:50926) 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.522+0000 7f4dfe56b700 1 -- 172.21.15.82:0/3514356938 learned_addr learned my addr 172.21.15.82:0/3514356938 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.522+0000 7f4dfe56b700 1 -- 172.21.15.82:0/3514356938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df819c550 con 0x7f4df8108b80 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.522+0000 7f4dfe56b700 1 --2- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df819c010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4df4011b60 tx=0x7f4df4011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.522+0000 7f4def7fe700 1 -- 172.21.15.82:0/3514356938 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4003b60 con 0x7f4df8108b80 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.522+0000 7f4def7fe700 1 -- 172.21.15.82:0/3514356938 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4df401a910 con 0x7f4df8108b80 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.522+0000 7f4e007cf700 1 -- 172.21.15.82:0/3514356938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df819c7e0 con 0x7f4df8108b80 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.522+0000 7f4e007cf700 1 -- 172.21.15.82:0/3514356938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df819cc40 con 0x7f4df8108b80 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.523+0000 7f4def7fe700 1 -- 172.21.15.82:0/3514356938 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4024930 con 0x7f4df8108b80 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.523+0000 7f4e007cf700 1 -- 172.21.15.82:0/3514356938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df8069740 con 0x7f4df8108b80 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.524+0000 7f4def7fe700 1 -- 172.21.15.82:0/3514356938 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) ==== 46479+0+0 (secure 0 0 0) 0x7f4df4022020 con 0x7f4df8108b80 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.524+0000 7f4def7fe700 1 --2- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f4de4039030 0x7f4de403b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:21.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.524+0000 7f4def7fe700 1 -- 172.21.15.82:0/3514356938 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4df404d6e0 con 0x7f4df8108b80 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.524+0000 7f4dfdd6a700 1 -- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f4de4039030 msgr2=0x7f4de403b4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3434341690 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.524+0000 7f4dfdd6a700 1 --2- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f4de4039030 0x7f4de403b4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.533+0000 7f4def7fe700 1 -- 172.21.15.82:0/3514356938 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4df40193c0 con 0x7f4df8108b80 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.725+0000 7f4dfdd6a700 1 -- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f4de4039030 msgr2=0x7f4de403b4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3434341690 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.725+0000 7f4dfdd6a700 1 --2- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f4de4039030 0x7f4de403b4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.792+0000 7f4e007cf700 1 -- 172.21.15.82:0/3514356938 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f4df819f5f0 con 0x7f4df8108b80 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.792+0000 7f4def7fe700 1 -- 172.21.15.82:0/3514356938 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f4df4024c70 con 0x7f4df8108b80 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.796+0000 7f4e007cf700 1 -- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f4de4039030 msgr2=0x7f4de403b4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.796+0000 7f4e007cf700 1 --2- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f4de4039030 0x7f4de403b4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.796+0000 7f4e007cf700 1 -- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 msgr2=0x7f4df819c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.796+0000 7f4e007cf700 1 --2- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df819c010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4df4011b60 tx=0x7f4df4011c40 comp rx=0 tx=0).stop 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.796+0000 7f4e007cf700 1 -- 172.21.15.82:0/3514356938 shutdown_connections 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.796+0000 7f4e007cf700 1 --2- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7f4de4039030 0x7f4de403b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:21.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.796+0000 7f4e007cf700 1 --2- 172.21.15.82:0/3514356938 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4df8108b80 0x7f4df819c010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:21.375 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.796+0000 7f4e007cf700 1 -- 172.21.15.82:0/3514356938 >> 172.21.15.82:0/3514356938 conn(0x7f4df8102570 msgr2=0x7f4df8103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:21.375 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.796+0000 7f4e007cf700 1 -- 172.21.15.82:0/3514356938 shutdown_connections 2024-03-27T07:14:21.375 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:20.796+0000 7f4e007cf700 1 -- 172.21.15.82:0/3514356938 wait complete. 2024-03-27T07:14:21.375 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-03-27T07:14:21.375 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 9... 2024-03-27T07:14:21.612 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:21 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3514356938' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-27T07:14:21.612 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:21.532+0000 7f1e9e7e6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T07:14:21.936 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:21.646+0000 7f1e9e7e6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T07:14:21.937 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:21.735+0000 7f1e9e7e6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T07:14:21.937 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:21.833+0000 7f1e9e7e6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T07:14:22.404 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:22 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:22.010+0000 7f1e9e7e6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T07:14:23.427 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:22 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:22.961+0000 7f1e9e7e6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T07:14:23.427 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:23.092+0000 7f1e9e7e6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T07:14:23.428 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:23.425+0000 7f1e9e7e6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T07:14:23.686 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:23.515+0000 7f1e9e7e6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T07:14:24.184 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:23.711+0000 7f1e9e7e6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:14:24.184 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:23.896+0000 7f1e9e7e6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T07:14:24.436 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:24.182+0000 7f1e9e7e6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:14:24.806 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:24.439+0000 7f1e9e7e6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T07:14:24.806 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:24.676+0000 7f1e9e7e6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T07:14:25.936 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:25.478+0000 7f1e9e7e6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T07:14:26.362 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:26.047+0000 7f1e9e7e6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T07:14:26.362 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:26.145+0000 7f1e9e7e6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T07:14:26.362 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:14:26.361+0000 7f1e9e7e6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T07:14:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: Active manager daemon x restarted 2024-03-27T07:14:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: Activating manager daemon x 2024-03-27T07:14:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: osdmap e3: 0 total, 0 up, 0 in 2024-03-27T07:14:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: mgrmap e10: x(active, starting, since 0.00346418s) 2024-03-27T07:14:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:14:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-27T07:14:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-27T07:14:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-27T07:14:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-27T07:14:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: Manager daemon x is now available 2024-03-27T07:14:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:14:27.594 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T07:14:27.594 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T07:14:27.594 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:27 smithi082 ceph-mon[32178]: mgrmap e11: x(active, since 1.00579s) 2024-03-27T07:14:28.171 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-03-27T07:14:28.171 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-27T07:14:28.171 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-27T07:14:28.171 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-03-27T07:14:28.171 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.796+0000 7fca95cad700 1 Processor -- start 2024-03-27T07:14:28.171 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.796+0000 7fca95cad700 1 -- start start 2024-03-27T07:14:28.171 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.796+0000 7fca95cad700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca901084b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:28.171 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.796+0000 7fca95cad700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca90108a80 con 0x7fca90108090 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.796+0000 7fca8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca901084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.796+0000 7fca8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca901084b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50938/0 (socket says 172.21.15.82:50938) 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.796+0000 7fca8f7fe700 1 -- 172.21.15.82:0/937289282 learned_addr learned my addr 172.21.15.82:0/937289282 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.797+0000 7fca8f7fe700 1 -- 172.21.15.82:0/937289282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca90109290 con 0x7fca90108090 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.797+0000 7fca8f7fe700 1 --2- 172.21.15.82:0/937289282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca901084b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca840098a0 tx=0x7fca84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488350fa2866a73e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.797+0000 7fca8e7fc700 1 -- 172.21.15.82:0/937289282 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84004160 con 0x7fca90108090 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.797+0000 7fca8e7fc700 1 -- 172.21.15.82:0/937289282 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca84004300 con 0x7fca90108090 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.797+0000 7fca8e7fc700 1 -- 172.21.15.82:0/937289282 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84011b20 con 0x7fca90108090 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.798+0000 7fca95cad700 1 -- 172.21.15.82:0/937289282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 msgr2=0x7fca901084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.798+0000 7fca95cad700 1 --2- 172.21.15.82:0/937289282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca901084b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca840098a0 tx=0x7fca84009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.798+0000 7fca95cad700 1 -- 172.21.15.82:0/937289282 shutdown_connections 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.798+0000 7fca95cad700 1 --2- 172.21.15.82:0/937289282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca901084b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:28.172 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.798+0000 7fca95cad700 1 -- 172.21.15.82:0/937289282 >> 172.21.15.82:0/937289282 conn(0x7fca90103630 msgr2=0x7fca90105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.798+0000 7fca95cad700 1 -- 172.21.15.82:0/937289282 shutdown_connections 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.798+0000 7fca95cad700 1 -- 172.21.15.82:0/937289282 wait complete. 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.798+0000 7fca95cad700 1 Processor -- start 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.799+0000 7fca95cad700 1 -- start start 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.799+0000 7fca95cad700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca9019c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.799+0000 7fca95cad700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca9010c640 con 0x7fca90108090 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.799+0000 7fca8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca9019c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.799+0000 7fca8f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca9019c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50950/0 (socket says 172.21.15.82:50950) 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.799+0000 7fca8f7fe700 1 -- 172.21.15.82:0/2967670855 learned_addr learned my addr 172.21.15.82:0/2967670855 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.799+0000 7fca8f7fe700 1 -- 172.21.15.82:0/2967670855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9019c5f0 con 0x7fca90108090 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.799+0000 7fca8f7fe700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca9019c0b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fca84000c00 tx=0x7fca84011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.799+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84003b60 con 0x7fca90108090 2024-03-27T07:14:28.173 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.800+0000 7fca95cad700 1 -- 172.21.15.82:0/2967670855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9019c880 con 0x7fca90108090 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.800+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca8401a910 con 0x7fca90108090 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.800+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca84024930 con 0x7fca90108090 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.800+0000 7fca95cad700 1 -- 172.21.15.82:0/2967670855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9019cce0 con 0x7fca90108090 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.801+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) ==== 46479+0+0 (secure 0 0 0) 0x7fca84022020 con 0x7fca90108090 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.801+0000 7fca8cff9700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 0x7fca7803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.801+0000 7fca95cad700 1 -- 172.21.15.82:0/2967670855 --> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fca90069740 con 0x7fca78039480 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.801+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fca8404d690 con 0x7fca90108090 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.801+0000 7fca8effd700 1 -- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 msgr2=0x7fca7803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3434341690 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:21.801+0000 7fca8effd700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 0x7fca7803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:22.002+0000 7fca8effd700 1 -- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 msgr2=0x7fca7803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3434341690 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:22.002+0000 7fca8effd700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 0x7fca7803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:22.403+0000 7fca8effd700 1 -- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 msgr2=0x7fca7803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3434341690 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:22.403+0000 7fca8effd700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 0x7fca7803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T07:14:28.174 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:23.203+0000 7fca8effd700 1 -- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 msgr2=0x7fca7803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3434341690 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:23.203+0000 7fca8effd700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 0x7fca7803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:24.805+0000 7fca8effd700 1 -- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 msgr2=0x7fca7803b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3434341690 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:24.805+0000 7fca8effd700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 0x7fca7803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:26.377+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 10) ==== 46246+0+0 (secure 0 0 0) 0x7fca8401aac0 con 0x7fca90108090 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:26.377+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 msgr2=0x7fca7803b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:26.377+0000 7fca8cff9700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 0x7fca7803b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.378+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 11) ==== 46373+0+0 (secure 0 0 0) 0x7fca8404f550 con 0x7fca90108090 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.378+0000 7fca8cff9700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fca7803cd10 0x7fca7803f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.379+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fca90069740 con 0x7fca7803cd10 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.379+0000 7fca8effd700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fca7803cd10 0x7fca7803f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.380+0000 7fca8effd700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fca7803cd10 0x7fca7803f100 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fca80003a10 tx=0x7fca80009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.380+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7fca90069740 con 0x7fca7803cd10 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.392+0000 7fca95cad700 1 -- 172.21.15.82:0/2967670855 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fca901048a0 con 0x7fca7803cd10 2024-03-27T07:14:28.175 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.392+0000 7fca8cff9700 1 -- 172.21.15.82:0/2967670855 <== mgr.14152 v2:172.21.15.82:6800/3599330107 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fca901048a0 con 0x7fca7803cd10 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 -- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fca7803cd10 msgr2=0x7fca7803f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fca7803cd10 0x7fca7803f100 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fca80003a10 tx=0x7fca80009270 comp rx=0 tx=0).stop 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 -- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 msgr2=0x7fca9019c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca9019c0b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fca84000c00 tx=0x7fca84011c10 comp rx=0 tx=0).stop 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 -- 172.21.15.82:0/2967670855 shutdown_connections 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca90108090 0x7fca9019c0b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fca7803cd10 0x7fca7803f100 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 --2- 172.21.15.82:0/2967670855 >> [v2:172.21.15.82:6800/3434341690,v1:172.21.15.82:6801/3434341690] conn(0x7fca78039480 0x7fca7803b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 -- 172.21.15.82:0/2967670855 >> 172.21.15.82:0/2967670855 conn(0x7fca90103630 msgr2=0x7fca90104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 -- 172.21.15.82:0/2967670855 shutdown_connections 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:27.393+0000 7fca95cad700 1 -- 172.21.15.82:0/2967670855 wait complete. 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 9 is available 2024-03-27T07:14:28.176 INFO:teuthology.orchestra.run.smithi082.stdout:Generating a dashboard self-signed certificate... 2024-03-27T07:14:28.614 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:28 smithi082 ceph-mon[32178]: [27/Mar/2024:07:14:26] ENGINE Bus STARTING 2024-03-27T07:14:28.615 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:28 smithi082 ceph-mon[32178]: [27/Mar/2024:07:14:27] ENGINE Serving on http://172.21.15.82:8765 2024-03-27T07:14:28.615 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:28 smithi082 ceph-mon[32178]: [27/Mar/2024:07:14:27] ENGINE Serving on https://172.21.15.82:7150 2024-03-27T07:14:28.615 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:28 smithi082 ceph-mon[32178]: [27/Mar/2024:07:14:27] ENGINE Bus STARTED 2024-03-27T07:14:28.615 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:28 smithi082 ceph-mon[32178]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-27T07:14:28.615 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:28 smithi082 ceph-mon[32178]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-27T07:14:28.615 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:29.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.631+0000 7f9810655700 1 Processor -- start 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.631+0000 7f9810655700 1 -- start start 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.631+0000 7f9810655700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f98081067a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.631+0000 7f9810655700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9808106d70 con 0x7f9808106380 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.632+0000 7f980e3f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f98081067a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.632+0000 7f980e3f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f98081067a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55898/0 (socket says 172.21.15.82:55898) 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.632+0000 7f980e3f1700 1 -- 172.21.15.82:0/3284902031 learned_addr learned my addr 172.21.15.82:0/3284902031 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.632+0000 7f980e3f1700 1 -- 172.21.15.82:0/3284902031 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9808106ef0 con 0x7f9808106380 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.632+0000 7f980e3f1700 1 --2- 172.21.15.82:0/3284902031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f98081067a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97f80098a0 tx=0x7f97f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1770db0f86b89aad server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.632+0000 7f980d3ef700 1 -- 172.21.15.82:0/3284902031 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f8004160 con 0x7f9808106380 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.632+0000 7f980d3ef700 1 -- 172.21.15.82:0/3284902031 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97f8004300 con 0x7f9808106380 2024-03-27T07:14:29.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.632+0000 7f980d3ef700 1 -- 172.21.15.82:0/3284902031 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f8011b20 con 0x7f9808106380 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.633+0000 7f9810655700 1 -- 172.21.15.82:0/3284902031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 msgr2=0x7f98081067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.633+0000 7f9810655700 1 --2- 172.21.15.82:0/3284902031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f98081067a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97f80098a0 tx=0x7f97f8009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.633+0000 7f9810655700 1 -- 172.21.15.82:0/3284902031 shutdown_connections 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.633+0000 7f9810655700 1 --2- 172.21.15.82:0/3284902031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f98081067a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.633+0000 7f9810655700 1 -- 172.21.15.82:0/3284902031 >> 172.21.15.82:0/3284902031 conn(0x7f9808101ce0 msgr2=0x7f9808104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.633+0000 7f9810655700 1 -- 172.21.15.82:0/3284902031 shutdown_connections 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.633+0000 7f9810655700 1 -- 172.21.15.82:0/3284902031 wait complete. 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.634+0000 7f9810655700 1 Processor -- start 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.634+0000 7f9810655700 1 -- start start 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.634+0000 7f9810655700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f980819c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:29.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.634+0000 7f9810655700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f980810c630 con 0x7f9808106380 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.634+0000 7f980e3f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f980819c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.634+0000 7f980e3f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f980819c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55906/0 (socket says 172.21.15.82:55906) 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.634+0000 7f980e3f1700 1 -- 172.21.15.82:0/2675889313 learned_addr learned my addr 172.21.15.82:0/2675889313 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.634+0000 7f980e3f1700 1 -- 172.21.15.82:0/2675889313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980819c570 con 0x7f9808106380 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.634+0000 7f980e3f1700 1 --2- 172.21.15.82:0/2675889313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f980819c030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f97f8000c00 tx=0x7f97f8011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.635+0000 7f97ff7fe700 1 -- 172.21.15.82:0/2675889313 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f8003b60 con 0x7f9808106380 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.635+0000 7f9810655700 1 -- 172.21.15.82:0/2675889313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980819c860 con 0x7f9808106380 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.635+0000 7f97ff7fe700 1 -- 172.21.15.82:0/2675889313 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97f801a910 con 0x7f9808106380 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.635+0000 7f97ff7fe700 1 -- 172.21.15.82:0/2675889313 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97f8024930 con 0x7f9808106380 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.635+0000 7f9810655700 1 -- 172.21.15.82:0/2675889313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f980819f4f0 con 0x7f9808106380 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.636+0000 7f97ff7fe700 1 -- 172.21.15.82:0/2675889313 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 11) ==== 46373+0+0 (secure 0 0 0) 0x7f97f8022020 con 0x7f9808106380 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.636+0000 7f97ff7fe700 1 --2- 172.21.15.82:0/2675889313 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97f4039300 0x7f97f403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:29.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.636+0000 7f97ff7fe700 1 -- 172.21.15.82:0/2675889313 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f97f804d590 con 0x7f9808106380 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.636+0000 7f980dbf0700 1 --2- 172.21.15.82:0/2675889313 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97f4039300 0x7f97f403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.636+0000 7f9810655700 1 -- 172.21.15.82:0/2675889313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9808069740 con 0x7f9808106380 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.636+0000 7f980dbf0700 1 --2- 172.21.15.82:0/2675889313 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97f4039300 0x7f97f403b7c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9804006fd0 tx=0x7f9804006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.641+0000 7f97ff7fe700 1 -- 172.21.15.82:0/2675889313 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f97f8021d60 con 0x7f9808106380 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.852+0000 7f9810655700 1 -- 172.21.15.82:0/2675889313 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f9808102f50 con 0x7f97f4039300 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.896+0000 7f97ff7fe700 1 -- 172.21.15.82:0/2675889313 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 12) ==== 46479+0+0 (secure 0 0 0) 0x7f97f80193c0 con 0x7f9808106380 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.959+0000 7f97ff7fe700 1 -- 172.21.15.82:0/2675889313 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f9808102f50 con 0x7f97f4039300 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.961+0000 7f9810655700 1 -- 172.21.15.82:0/2675889313 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97f4039300 msgr2=0x7f97f403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.961+0000 7f9810655700 1 --2- 172.21.15.82:0/2675889313 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97f4039300 0x7f97f403b7c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9804006fd0 tx=0x7f9804006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.961+0000 7f9810655700 1 -- 172.21.15.82:0/2675889313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 msgr2=0x7f980819c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.961+0000 7f9810655700 1 --2- 172.21.15.82:0/2675889313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f980819c030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f97f8000c00 tx=0x7f97f8011c10 comp rx=0 tx=0).stop 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.961+0000 7f9810655700 1 -- 172.21.15.82:0/2675889313 shutdown_connections 2024-03-27T07:14:29.514 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.961+0000 7f9810655700 1 --2- 172.21.15.82:0/2675889313 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97f4039300 0x7f97f403b7c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:29.515 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.961+0000 7f9810655700 1 --2- 172.21.15.82:0/2675889313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9808106380 0x7f980819c030 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:29.515 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.961+0000 7f9810655700 1 -- 172.21.15.82:0/2675889313 >> 172.21.15.82:0/2675889313 conn(0x7f9808101ce0 msgr2=0x7f9808102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:29.515 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.961+0000 7f9810655700 1 -- 172.21.15.82:0/2675889313 shutdown_connections 2024-03-27T07:14:29.515 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:28.961+0000 7f9810655700 1 -- 172.21.15.82:0/2675889313 wait complete. 2024-03-27T07:14:29.515 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial admin user... 2024-03-27T07:14:30.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:29 smithi082 ceph-mon[32178]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:30.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:29 smithi082 ceph-mon[32178]: mgrmap e12: x(active, since 2s) 2024-03-27T07:14:30.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:30.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:30.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:31.422 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$a81rMcXnspPuOxOjJG8ePuds80VMSOuzkb0vYERcyIc0qZTG0n1Pa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711523670, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.958+0000 7f780e9f8700 1 Processor -- start 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.958+0000 7f780e9f8700 1 -- start start 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.958+0000 7f780e9f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f78081084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.958+0000 7f780e9f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7808108aa0 con 0x7f78081080b0 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.958+0000 7f7807fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f78081084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.958+0000 7f7807fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f78081084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55918/0 (socket says 172.21.15.82:55918) 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.958+0000 7f7807fff700 1 -- 172.21.15.82:0/3897149729 learned_addr learned my addr 172.21.15.82:0/3897149729 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.958+0000 7f7807fff700 1 -- 172.21.15.82:0/3897149729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78081092b0 con 0x7f78081080b0 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.959+0000 7f7807fff700 1 --2- 172.21.15.82:0/3897149729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f78081084d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77f80098a0 tx=0x7f77f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88651e0dab9defda server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.959+0000 7f7806ffd700 1 -- 172.21.15.82:0/3897149729 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f8004160 con 0x7f78081080b0 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.959+0000 7f7806ffd700 1 -- 172.21.15.82:0/3897149729 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77f8004300 con 0x7f78081080b0 2024-03-27T07:14:31.423 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.959+0000 7f7806ffd700 1 -- 172.21.15.82:0/3897149729 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f8011b20 con 0x7f78081080b0 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.959+0000 7f780e9f8700 1 -- 172.21.15.82:0/3897149729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 msgr2=0x7f78081084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.959+0000 7f780e9f8700 1 --2- 172.21.15.82:0/3897149729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f78081084d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77f80098a0 tx=0x7f77f8009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.960+0000 7f780e9f8700 1 -- 172.21.15.82:0/3897149729 shutdown_connections 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.960+0000 7f780e9f8700 1 --2- 172.21.15.82:0/3897149729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f78081084d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.960+0000 7f780e9f8700 1 -- 172.21.15.82:0/3897149729 >> 172.21.15.82:0/3897149729 conn(0x7f7808103630 msgr2=0x7f7808105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.960+0000 7f780e9f8700 1 -- 172.21.15.82:0/3897149729 shutdown_connections 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.960+0000 7f780e9f8700 1 -- 172.21.15.82:0/3897149729 wait complete. 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.960+0000 7f780e9f8700 1 Processor -- start 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.960+0000 7f780e9f8700 1 -- start start 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f780e9f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f780807db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f780e9f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f780810c660 con 0x7f78081080b0 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f7807fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f780807db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:31.424 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f7807fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f780807db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55920/0 (socket says 172.21.15.82:55920) 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f7807fff700 1 -- 172.21.15.82:0/621163074 learned_addr learned my addr 172.21.15.82:0/621163074 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f7807fff700 1 -- 172.21.15.82:0/621163074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780807e0a0 con 0x7f78081080b0 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f7807fff700 1 --2- 172.21.15.82:0/621163074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f780807db60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f77f80116a0 tx=0x7f77f8011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f78057fa700 1 -- 172.21.15.82:0/621163074 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f8003a40 con 0x7f78081080b0 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f780e9f8700 1 -- 172.21.15.82:0/621163074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780807c290 con 0x7f78081080b0 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f78057fa700 1 -- 172.21.15.82:0/621163074 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f77f8003be0 con 0x7f78081080b0 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f78057fa700 1 -- 172.21.15.82:0/621163074 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77f801a720 con 0x7f78081080b0 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.961+0000 7f780e9f8700 1 -- 172.21.15.82:0/621163074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f780807c750 con 0x7f78081080b0 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.962+0000 7f78057fa700 1 -- 172.21.15.82:0/621163074 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) ==== 46479+0+0 (secure 0 0 0) 0x7f77f801a9d0 con 0x7f78081080b0 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.962+0000 7f78057fa700 1 --2- 172.21.15.82:0/621163074 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f77f0039430 0x7f77f003b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.963+0000 7f78057fa700 1 -- 172.21.15.82:0/621163074 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f77f804dad0 con 0x7f78081080b0 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.963+0000 7f780e9f8700 1 -- 172.21.15.82:0/621163074 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7808069740 con 0x7f78081080b0 2024-03-27T07:14:31.425 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.963+0000 7f78077fe700 1 --2- 172.21.15.82:0/621163074 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f77f0039430 0x7f77f003b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.963+0000 7f78077fe700 1 --2- 172.21.15.82:0/621163074 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f77f0039430 0x7f77f003b8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f77fc006fd0 tx=0x7f77fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:29.968+0000 7f78057fa700 1 -- 172.21.15.82:0/621163074 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f77f804de20 con 0x7f78081080b0 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.198+0000 7f780e9f8700 1 -- 172.21.15.82:0/621163074 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f780807cdd0 con 0x7f77f0039430 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.422+0000 7f78057fa700 1 -- 172.21.15.82:0/621163074 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f780807cdd0 con 0x7f77f0039430 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.424+0000 7f780e9f8700 1 -- 172.21.15.82:0/621163074 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f77f0039430 msgr2=0x7f77f003b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.424+0000 7f780e9f8700 1 --2- 172.21.15.82:0/621163074 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f77f0039430 0x7f77f003b8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f77fc006fd0 tx=0x7f77fc006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.424+0000 7f780e9f8700 1 -- 172.21.15.82:0/621163074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 msgr2=0x7f780807db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.424+0000 7f780e9f8700 1 --2- 172.21.15.82:0/621163074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f780807db60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f77f80116a0 tx=0x7f77f8011ba0 comp rx=0 tx=0).stop 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.424+0000 7f780e9f8700 1 -- 172.21.15.82:0/621163074 shutdown_connections 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.424+0000 7f780e9f8700 1 --2- 172.21.15.82:0/621163074 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f77f0039430 0x7f77f003b8f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.424+0000 7f780e9f8700 1 --2- 172.21.15.82:0/621163074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f78081080b0 0x7f780807db60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.424+0000 7f780e9f8700 1 -- 172.21.15.82:0/621163074 >> 172.21.15.82:0/621163074 conn(0x7f7808103630 msgr2=0x7f78081041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:31.426 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.424+0000 7f780e9f8700 1 -- 172.21.15.82:0/621163074 shutdown_connections 2024-03-27T07:14:31.427 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:30.424+0000 7f780e9f8700 1 -- 172.21.15.82:0/621163074 wait complete. 2024-03-27T07:14:31.427 INFO:teuthology.orchestra.run.smithi082.stdout:Fetching dashboard port number... 2024-03-27T07:14:31.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:31 smithi082 ceph-mon[32178]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:31.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:32.586 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 8443 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.850+0000 7f7690156700 1 Processor -- start 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.850+0000 7f7690156700 1 -- start start 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.850+0000 7f7690156700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688109af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.850+0000 7f7690156700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f768810a0c0 con 0x7f76881096d0 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.850+0000 7f768def2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688109af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.850+0000 7f768def2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688109af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55926/0 (socket says 172.21.15.82:55926) 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.850+0000 7f768def2700 1 -- 172.21.15.82:0/434570240 learned_addr learned my addr 172.21.15.82:0/434570240 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.850+0000 7f768def2700 1 -- 172.21.15.82:0/434570240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f768810a240 con 0x7f76881096d0 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f768def2700 1 --2- 172.21.15.82:0/434570240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688109af0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76840098a0 tx=0x7f7684009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7a4f093dcd120f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f768cef0700 1 -- 172.21.15.82:0/434570240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7684004160 con 0x7f76881096d0 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f768cef0700 1 -- 172.21.15.82:0/434570240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7684004300 con 0x7f76881096d0 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f768cef0700 1 -- 172.21.15.82:0/434570240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7684011b20 con 0x7f76881096d0 2024-03-27T07:14:32.587 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f7690156700 1 -- 172.21.15.82:0/434570240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 msgr2=0x7f7688109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f7690156700 1 --2- 172.21.15.82:0/434570240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688109af0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f76840098a0 tx=0x7f7684009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f7690156700 1 -- 172.21.15.82:0/434570240 shutdown_connections 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f7690156700 1 --2- 172.21.15.82:0/434570240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688109af0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f7690156700 1 -- 172.21.15.82:0/434570240 >> 172.21.15.82:0/434570240 conn(0x7f7688101d90 msgr2=0x7f76881041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f7690156700 1 -- 172.21.15.82:0/434570240 shutdown_connections 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.851+0000 7f7690156700 1 -- 172.21.15.82:0/434570240 wait complete. 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.852+0000 7f7690156700 1 Processor -- start 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.852+0000 7f7690156700 1 -- start start 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.852+0000 7f7690156700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688108cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.852+0000 7f7690156700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f768810c6a0 con 0x7f76881096d0 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.852+0000 7f768def2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688108cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.852+0000 7f768def2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688108cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55938/0 (socket says 172.21.15.82:55938) 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.852+0000 7f768def2700 1 -- 172.21.15.82:0/3651500185 learned_addr learned my addr 172.21.15.82:0/3651500185 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:32.588 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.852+0000 7f768def2700 1 -- 172.21.15.82:0/3651500185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7688109230 con 0x7f76881096d0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.853+0000 7f768def2700 1 --2- 172.21.15.82:0/3651500185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688108cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76840117e0 tx=0x7f7684011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.853+0000 7f767effd700 1 -- 172.21.15.82:0/3651500185 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7684003bf0 con 0x7f76881096d0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.853+0000 7f767effd700 1 -- 172.21.15.82:0/3651500185 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f768401a910 con 0x7f76881096d0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.853+0000 7f7690156700 1 -- 172.21.15.82:0/3651500185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7688107420 con 0x7f76881096d0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.853+0000 7f767effd700 1 -- 172.21.15.82:0/3651500185 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76840249a0 con 0x7f76881096d0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.853+0000 7f7690156700 1 -- 172.21.15.82:0/3651500185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76881078e0 con 0x7f76881096d0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.854+0000 7f767effd700 1 -- 172.21.15.82:0/3651500185 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) ==== 46479+0+0 (secure 0 0 0) 0x7f7684022020 con 0x7f76881096d0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.854+0000 7f767cff9700 1 -- 172.21.15.82:0/3651500185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7688063c70 con 0x7f76881096d0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.854+0000 7f767effd700 1 --2- 172.21.15.82:0/3651500185 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7674039430 0x7f767403b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.854+0000 7f767effd700 1 -- 172.21.15.82:0/3651500185 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f768404d9f0 con 0x7f76881096d0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.854+0000 7f768d6f1700 1 --2- 172.21.15.82:0/3651500185 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7674039430 0x7f767403b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.854+0000 7f768d6f1700 1 --2- 172.21.15.82:0/3651500185 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7674039430 0x7f767403b8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7678006fd0 tx=0x7f7678006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:32.589 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:31.859+0000 7f767effd700 1 -- 172.21.15.82:0/3651500185 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7684011e20 con 0x7f76881096d0 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.057+0000 7f767cff9700 1 -- 172.21.15.82:0/3651500185 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f76881a3780 con 0x7f76881096d0 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.058+0000 7f767effd700 1 -- 172.21.15.82:0/3651500185 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f76881a3780 con 0x7f76881096d0 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.059+0000 7f767cff9700 1 -- 172.21.15.82:0/3651500185 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7674039430 msgr2=0x7f767403b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.060+0000 7f767cff9700 1 --2- 172.21.15.82:0/3651500185 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7674039430 0x7f767403b8f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7678006fd0 tx=0x7f7678006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.060+0000 7f767cff9700 1 -- 172.21.15.82:0/3651500185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 msgr2=0x7f7688108cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.060+0000 7f767cff9700 1 --2- 172.21.15.82:0/3651500185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688108cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f76840117e0 tx=0x7f7684011c10 comp rx=0 tx=0).stop 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.060+0000 7f767cff9700 1 -- 172.21.15.82:0/3651500185 shutdown_connections 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.060+0000 7f767cff9700 1 --2- 172.21.15.82:0/3651500185 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7674039430 0x7f767403b8f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.060+0000 7f767cff9700 1 --2- 172.21.15.82:0/3651500185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76881096d0 0x7f7688108cf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.060+0000 7f767cff9700 1 -- 172.21.15.82:0/3651500185 >> 172.21.15.82:0/3651500185 conn(0x7f7688101d90 msgr2=0x7f7688102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.060+0000 7f767cff9700 1 -- 172.21.15.82:0/3651500185 shutdown_connections 2024-03-27T07:14:32.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.060+0000 7f767cff9700 1 -- 172.21.15.82:0/3651500185 wait complete. 2024-03-27T07:14:32.593 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-27T07:14:32.593 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-03-27T07:14:32.600 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-27T07:14:32.600 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-03-27T07:14:32.600 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-03-27T07:14:32.600 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-27T07:14:32.602 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph Dashboard is now available at: 2024-03-27T07:14:32.602 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:32.602 INFO:teuthology.orchestra.run.smithi082.stdout: URL: https://smithi082.front.sepia.ceph.com:8443/ 2024-03-27T07:14:32.602 INFO:teuthology.orchestra.run.smithi082.stdout: User: admin 2024-03-27T07:14:32.602 INFO:teuthology.orchestra.run.smithi082.stdout: Password: rnrp9awlw0 2024-03-27T07:14:32.602 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:32.602 INFO:teuthology.orchestra.run.smithi082.stdout:Saving cluster configuration to /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config directory 2024-03-27T07:14:32.603 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling autotune for osd_memory_target 2024-03-27T07:14:32.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:32 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3651500185' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-27T07:14:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.973+0000 7fa4f4e8f700 1 Processor -- start 2024-03-27T07:14:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.973+0000 7fa4f4e8f700 1 -- start start 2024-03-27T07:14:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.973+0000 7fa4f4e8f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f007c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.973+0000 7fa4f4e8f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f007c8e0 con 0x7fa4f007deb0 2024-03-27T07:14:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.974+0000 7fa4ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f007c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.974+0000 7fa4ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f007c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55942/0 (socket says 172.21.15.82:55942) 2024-03-27T07:14:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.974+0000 7fa4ee59c700 1 -- 172.21.15.82:0/4266783378 learned_addr learned my addr 172.21.15.82:0/4266783378 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.974+0000 7fa4ee59c700 1 -- 172.21.15.82:0/4266783378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f007ca60 con 0x7fa4f007deb0 2024-03-27T07:14:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.974+0000 7fa4ee59c700 1 --2- 172.21.15.82:0/4266783378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f007c310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00098a0 tx=0x7fa4e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cb6092fd37ee3c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.974+0000 7fa4ed59a700 1 -- 172.21.15.82:0/4266783378 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4e0004160 con 0x7fa4f007deb0 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.974+0000 7fa4ed59a700 1 -- 172.21.15.82:0/4266783378 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4e0004300 con 0x7fa4f007deb0 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.974+0000 7fa4ed59a700 1 -- 172.21.15.82:0/4266783378 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4e0011b20 con 0x7fa4f007deb0 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.975+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4266783378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 msgr2=0x7fa4f007c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.975+0000 7fa4f4e8f700 1 --2- 172.21.15.82:0/4266783378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f007c310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00098a0 tx=0x7fa4e0009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.975+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4266783378 shutdown_connections 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.975+0000 7fa4f4e8f700 1 --2- 172.21.15.82:0/4266783378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f007c310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.975+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4266783378 >> 172.21.15.82:0/4266783378 conn(0x7fa4f0103670 msgr2=0x7fa4f0105a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.975+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4266783378 shutdown_connections 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.975+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4266783378 wait complete. 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.976+0000 7fa4f4e8f700 1 Processor -- start 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.976+0000 7fa4f4e8f700 1 -- start start 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.976+0000 7fa4f4e8f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.976+0000 7fa4f4e8f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f010e6f0 con 0x7fa4f007deb0 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.976+0000 7fa4ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:33.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.976+0000 7fa4ee59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f019e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55948/0 (socket says 172.21.15.82:55948) 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.976+0000 7fa4ee59c700 1 -- 172.21.15.82:0/4252913336 learned_addr learned my addr 172.21.15.82:0/4252913336 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.977+0000 7fa4ee59c700 1 -- 172.21.15.82:0/4252913336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f019e720 con 0x7fa4f007deb0 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.977+0000 7fa4ee59c700 1 --2- 172.21.15.82:0/4252913336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f019e1e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00117e0 tx=0x7fa4e0011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.977+0000 7fa4df7fe700 1 -- 172.21.15.82:0/4252913336 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4e0003bf0 con 0x7fa4f007deb0 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.977+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4252913336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f019e9b0 con 0x7fa4f007deb0 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.977+0000 7fa4df7fe700 1 -- 172.21.15.82:0/4252913336 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4e001a910 con 0x7fa4f007deb0 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.977+0000 7fa4df7fe700 1 -- 172.21.15.82:0/4252913336 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4e00249a0 con 0x7fa4f007deb0 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.977+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4252913336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f019ee10 con 0x7fa4f007deb0 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.978+0000 7fa4df7fe700 1 -- 172.21.15.82:0/4252913336 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7fa4e0022020 con 0x7fa4f007deb0 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.978+0000 7fa4df7fe700 1 --2- 172.21.15.82:0/4252913336 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4d8039470 0x7fa4d803b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.978+0000 7fa4df7fe700 1 -- 172.21.15.82:0/4252913336 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa4e004dbc0 con 0x7fa4f007deb0 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.978+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4252913336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f0063c70 con 0x7fa4f007deb0 2024-03-27T07:14:33.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.978+0000 7fa4edd9b700 1 --2- 172.21.15.82:0/4252913336 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4d8039470 0x7fa4d803b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.979+0000 7fa4edd9b700 1 --2- 172.21.15.82:0/4252913336 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4d8039470 0x7fa4d803b930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4006fd0 tx=0x7fa4e4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:32.983+0000 7fa4df7fe700 1 -- 172.21.15.82:0/4252913336 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa4e0011e20 con 0x7fa4f007deb0 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.179+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4252913336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fa4f01a1880 con 0x7fa4f007deb0 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.180+0000 7fa4df7fe700 1 -- 172.21.15.82:0/4252913336 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fa4e0032020 con 0x7fa4f007deb0 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.182+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4252913336 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4d8039470 msgr2=0x7fa4d803b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.182+0000 7fa4f4e8f700 1 --2- 172.21.15.82:0/4252913336 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4d8039470 0x7fa4d803b930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4006fd0 tx=0x7fa4e4006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.182+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4252913336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 msgr2=0x7fa4f019e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.182+0000 7fa4f4e8f700 1 --2- 172.21.15.82:0/4252913336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f019e1e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00117e0 tx=0x7fa4e0011c10 comp rx=0 tx=0).stop 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.182+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4252913336 shutdown_connections 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.182+0000 7fa4f4e8f700 1 --2- 172.21.15.82:0/4252913336 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4d8039470 0x7fa4d803b930 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.182+0000 7fa4f4e8f700 1 --2- 172.21.15.82:0/4252913336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4f007deb0 0x7fa4f019e1e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.182+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4252913336 >> 172.21.15.82:0/4252913336 conn(0x7fa4f0103670 msgr2=0x7fa4f01040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.182+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4252913336 shutdown_connections 2024-03-27T07:14:33.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:33.182+0000 7fa4f4e8f700 1 -- 172.21.15.82:0/4252913336 wait complete. 2024-03-27T07:14:33.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:33 smithi082 ceph-mon[32178]: mgrmap e13: x(active, since 6s) 2024-03-27T07:14:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.219+0000 7f85454a2700 1 Processor -- start 2024-03-27T07:14:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.219+0000 7f85454a2700 1 -- start start 2024-03-27T07:14:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.219+0000 7f85454a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854010af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.219+0000 7f85454a2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f854007be60 con 0x7f8540108b80 2024-03-27T07:14:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.219+0000 7f853effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854010af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.219+0000 7f853effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854010af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55962/0 (socket says 172.21.15.82:55962) 2024-03-27T07:14:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.219+0000 7f853effd700 1 -- 172.21.15.82:0/2090890272 learned_addr learned my addr 172.21.15.82:0/2090890272 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.220+0000 7f853effd700 1 -- 172.21.15.82:0/2090890272 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854010b4b0 con 0x7f8540108b80 2024-03-27T07:14:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.220+0000 7f853effd700 1 --2- 172.21.15.82:0/2090890272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854010af70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f85300098a0 tx=0x7f8530009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826959b11b5bd17a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.220+0000 7f853dffb700 1 -- 172.21.15.82:0/2090890272 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8530004160 con 0x7f8540108b80 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.220+0000 7f853dffb700 1 -- 172.21.15.82:0/2090890272 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8530004300 con 0x7f8540108b80 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.220+0000 7f853dffb700 1 -- 172.21.15.82:0/2090890272 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8530011b20 con 0x7f8540108b80 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.220+0000 7f85454a2700 1 -- 172.21.15.82:0/2090890272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 msgr2=0x7f854010af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.220+0000 7f85454a2700 1 --2- 172.21.15.82:0/2090890272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854010af70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f85300098a0 tx=0x7f8530009bb0 comp rx=0 tx=0).stop 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.221+0000 7f85454a2700 1 -- 172.21.15.82:0/2090890272 shutdown_connections 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.221+0000 7f85454a2700 1 --2- 172.21.15.82:0/2090890272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854010af70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.221+0000 7f85454a2700 1 -- 172.21.15.82:0/2090890272 >> 172.21.15.82:0/2090890272 conn(0x7f85401025b0 msgr2=0x7f85401049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.221+0000 7f85454a2700 1 -- 172.21.15.82:0/2090890272 shutdown_connections 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.221+0000 7f85454a2700 1 -- 172.21.15.82:0/2090890272 wait complete. 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.221+0000 7f85454a2700 1 Processor -- start 2024-03-27T07:14:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.221+0000 7f85454a2700 1 -- start start 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f85454a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854019bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f85454a2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f854010c510 con 0x7f8540108b80 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f853effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854019bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f853effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854019bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55966/0 (socket says 172.21.15.82:55966) 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f853effd700 1 -- 172.21.15.82:0/2823813937 learned_addr learned my addr 172.21.15.82:0/2823813937 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f853effd700 1 -- 172.21.15.82:0/2823813937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854019c510 con 0x7f8540108b80 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f853effd700 1 --2- 172.21.15.82:0/2823813937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854019bfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85300117e0 tx=0x7f8530011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f8527fff700 1 -- 172.21.15.82:0/2823813937 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8530003bf0 con 0x7f8540108b80 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f85454a2700 1 -- 172.21.15.82:0/2823813937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854019c7a0 con 0x7f8540108b80 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f8527fff700 1 -- 172.21.15.82:0/2823813937 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f853001a910 con 0x7f8540108b80 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f8527fff700 1 -- 172.21.15.82:0/2823813937 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8530024970 con 0x7f8540108b80 2024-03-27T07:14:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.222+0000 7f85454a2700 1 -- 172.21.15.82:0/2823813937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854019cc00 con 0x7f8540108b80 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.223+0000 7f8527fff700 1 -- 172.21.15.82:0/2823813937 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f8530022020 con 0x7f8540108b80 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.223+0000 7f85454a2700 1 -- 172.21.15.82:0/2823813937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8540063c70 con 0x7f8540108b80 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.223+0000 7f8527fff700 1 --2- 172.21.15.82:0/2823813937 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8528039470 0x7f852803b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.223+0000 7f8527fff700 1 -- 172.21.15.82:0/2823813937 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f853004db40 con 0x7f8540108b80 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.223+0000 7f853e7fc700 1 --2- 172.21.15.82:0/2823813937 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8528039470 0x7f852803b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.224+0000 7f853e7fc700 1 --2- 172.21.15.82:0/2823813937 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8528039470 0x7f852803b930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8534006fd0 tx=0x7f8534006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.228+0000 7f8527fff700 1 -- 172.21.15.82:0/2823813937 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8530011e20 con 0x7f8540108b80 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.537+0000 7f85454a2700 1 -- 172.21.15.82:0/2823813937 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f854019f5d0 con 0x7f8540108b80 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.540+0000 7f8527fff700 1 -- 172.21.15.82:0/2823813937 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f853000ba30 con 0x7f8540108b80 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.542+0000 7f85454a2700 1 -- 172.21.15.82:0/2823813937 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8528039470 msgr2=0x7f852803b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.542+0000 7f85454a2700 1 --2- 172.21.15.82:0/2823813937 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8528039470 0x7f852803b930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8534006fd0 tx=0x7f8534006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.542+0000 7f85454a2700 1 -- 172.21.15.82:0/2823813937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 msgr2=0x7f854019bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.542+0000 7f85454a2700 1 --2- 172.21.15.82:0/2823813937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854019bfd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85300117e0 tx=0x7f8530011c10 comp rx=0 tx=0).stop 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.542+0000 7f85454a2700 1 -- 172.21.15.82:0/2823813937 shutdown_connections 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.542+0000 7f85454a2700 1 --2- 172.21.15.82:0/2823813937 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8528039470 0x7f852803b930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.542+0000 7f85454a2700 1 --2- 172.21.15.82:0/2823813937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8540108b80 0x7f854019bfd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.542+0000 7f85454a2700 1 -- 172.21.15.82:0/2823813937 >> 172.21.15.82:0/2823813937 conn(0x7f85401025b0 msgr2=0x7f8540102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.542+0000 7f85454a2700 1 -- 172.21.15.82:0/2823813937 shutdown_connections 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-03-27T07:14:34.542+0000 7f85454a2700 1 -- 172.21.15.82:0/2823813937 wait complete. 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:Or, if you are only running a single cluster on this host: 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout: ceph telemetry on 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:For more information see: 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:Bootstrap complete. 2024-03-27T07:14:35.169 INFO:tasks.cephadm:Fetching config... 2024-03-27T07:14:35.169 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:14:35.169 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-27T07:14:35.184 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-27T07:14:35.185 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:14:35.185 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-27T07:14:35.239 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-27T07:14:35.239 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:14:35.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/keyring of=/dev/stdout 2024-03-27T07:14:35.307 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-27T07:14:35.307 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:14:35.307 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-27T07:14:35.362 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-27T07:14:35.362 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6ct4Ld9K2U2Qle3FuUOHCFy7QFAaqYLW5kFQuDSrtrTJbfceASkA8HaYPEQzQ/JMDr5XTz7vs2m4aUtcrg7yq4fyX7Cg9qzGGb7wdXej7+usR9DtYF+L6Gp/RTPvOHugVQtcKV2bJOzOO1w7pAvGWIieq6w4Mb3jpw8lxmjg8zTcp3Mwp3ws5J2mrpLQnjicZpkI5YaE9bOm+FyfrebjuYxb2pZm23QX6rSvoqIYvpwFiCQHue4eml0iqexmNb5w1pGSF2JzW31ZbtaA7/uEhD+etHjayU8tti1PMc7Hv1zmuqX2cOMYEOGh5En/tUNjLtIk0prD6KAqBpo67pR0oCLfZ7E3l86xlEfOZQHhPZ6jGP6jxkng6xWaTUrUM9JiFu0hPDGcvctafGk/FStMYsQBTmROt0GfQdhT08zHAiAwozrYXIiw4/BWd/Ns3WASy27gdWrncw+AJp7sNuoCCo8NMmKeB5S318T9MFVQt74km76w7p2x1qQwlAh0bmWE= ceph-604548c2-ec09-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-27T07:14:35.443 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6ct4Ld9K2U2Qle3FuUOHCFy7QFAaqYLW5kFQuDSrtrTJbfceASkA8HaYPEQzQ/JMDr5XTz7vs2m4aUtcrg7yq4fyX7Cg9qzGGb7wdXej7+usR9DtYF+L6Gp/RTPvOHugVQtcKV2bJOzOO1w7pAvGWIieq6w4Mb3jpw8lxmjg8zTcp3Mwp3ws5J2mrpLQnjicZpkI5YaE9bOm+FyfrebjuYxb2pZm23QX6rSvoqIYvpwFiCQHue4eml0iqexmNb5w1pGSF2JzW31ZbtaA7/uEhD+etHjayU8tti1PMc7Hv1zmuqX2cOMYEOGh5En/tUNjLtIk0prD6KAqBpo67pR0oCLfZ7E3l86xlEfOZQHhPZ6jGP6jxkng6xWaTUrUM9JiFu0hPDGcvctafGk/FStMYsQBTmROt0GfQdhT08zHAiAwozrYXIiw4/BWd/Ns3WASy27gdWrncw+AJp7sNuoCCo8NMmKeB5S318T9MFVQt74km76w7p2x1qQwlAh0bmWE= ceph-604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:14:35.460 DEBUG:teuthology.orchestra.run.smithi149:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6ct4Ld9K2U2Qle3FuUOHCFy7QFAaqYLW5kFQuDSrtrTJbfceASkA8HaYPEQzQ/JMDr5XTz7vs2m4aUtcrg7yq4fyX7Cg9qzGGb7wdXej7+usR9DtYF+L6Gp/RTPvOHugVQtcKV2bJOzOO1w7pAvGWIieq6w4Mb3jpw8lxmjg8zTcp3Mwp3ws5J2mrpLQnjicZpkI5YaE9bOm+FyfrebjuYxb2pZm23QX6rSvoqIYvpwFiCQHue4eml0iqexmNb5w1pGSF2JzW31ZbtaA7/uEhD+etHjayU8tti1PMc7Hv1zmuqX2cOMYEOGh5En/tUNjLtIk0prD6KAqBpo67pR0oCLfZ7E3l86xlEfOZQHhPZ6jGP6jxkng6xWaTUrUM9JiFu0hPDGcvctafGk/FStMYsQBTmROt0GfQdhT08zHAiAwozrYXIiw4/BWd/Ns3WASy27gdWrncw+AJp7sNuoCCo8NMmKeB5S318T9MFVQt74km76w7p2x1qQwlAh0bmWE= ceph-604548c2-ec09-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-27T07:14:35.505 INFO:teuthology.orchestra.run.smithi149.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6ct4Ld9K2U2Qle3FuUOHCFy7QFAaqYLW5kFQuDSrtrTJbfceASkA8HaYPEQzQ/JMDr5XTz7vs2m4aUtcrg7yq4fyX7Cg9qzGGb7wdXej7+usR9DtYF+L6Gp/RTPvOHugVQtcKV2bJOzOO1w7pAvGWIieq6w4Mb3jpw8lxmjg8zTcp3Mwp3ws5J2mrpLQnjicZpkI5YaE9bOm+FyfrebjuYxb2pZm23QX6rSvoqIYvpwFiCQHue4eml0iqexmNb5w1pGSF2JzW31ZbtaA7/uEhD+etHjayU8tti1PMc7Hv1zmuqX2cOMYEOGh5En/tUNjLtIk0prD6KAqBpo67pR0oCLfZ7E3l86xlEfOZQHhPZ6jGP6jxkng6xWaTUrUM9JiFu0hPDGcvctafGk/FStMYsQBTmROt0GfQdhT08zHAiAwozrYXIiw4/BWd/Ns3WASy27gdWrncw+AJp7sNuoCCo8NMmKeB5S318T9MFVQt74km76w7p2x1qQwlAh0bmWE= ceph-604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:14:35.520 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6ct4Ld9K2U2Qle3FuUOHCFy7QFAaqYLW5kFQuDSrtrTJbfceASkA8HaYPEQzQ/JMDr5XTz7vs2m4aUtcrg7yq4fyX7Cg9qzGGb7wdXej7+usR9DtYF+L6Gp/RTPvOHugVQtcKV2bJOzOO1w7pAvGWIieq6w4Mb3jpw8lxmjg8zTcp3Mwp3ws5J2mrpLQnjicZpkI5YaE9bOm+FyfrebjuYxb2pZm23QX6rSvoqIYvpwFiCQHue4eml0iqexmNb5w1pGSF2JzW31ZbtaA7/uEhD+etHjayU8tti1PMc7Hv1zmuqX2cOMYEOGh5En/tUNjLtIk0prD6KAqBpo67pR0oCLfZ7E3l86xlEfOZQHhPZ6jGP6jxkng6xWaTUrUM9JiFu0hPDGcvctafGk/FStMYsQBTmROt0GfQdhT08zHAiAwozrYXIiw4/BWd/Ns3WASy27gdWrncw+AJp7sNuoCCo8NMmKeB5S318T9MFVQt74km76w7p2x1qQwlAh0bmWE= ceph-604548c2-ec09-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-27T07:14:35.566 INFO:teuthology.orchestra.run.smithi153.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6ct4Ld9K2U2Qle3FuUOHCFy7QFAaqYLW5kFQuDSrtrTJbfceASkA8HaYPEQzQ/JMDr5XTz7vs2m4aUtcrg7yq4fyX7Cg9qzGGb7wdXej7+usR9DtYF+L6Gp/RTPvOHugVQtcKV2bJOzOO1w7pAvGWIieq6w4Mb3jpw8lxmjg8zTcp3Mwp3ws5J2mrpLQnjicZpkI5YaE9bOm+FyfrebjuYxb2pZm23QX6rSvoqIYvpwFiCQHue4eml0iqexmNb5w1pGSF2JzW31ZbtaA7/uEhD+etHjayU8tti1PMc7Hv1zmuqX2cOMYEOGh5En/tUNjLtIk0prD6KAqBpo67pR0oCLfZ7E3l86xlEfOZQHhPZ6jGP6jxkng6xWaTUrUM9JiFu0hPDGcvctafGk/FStMYsQBTmROt0GfQdhT08zHAiAwozrYXIiw4/BWd/Ns3WASy27gdWrncw+AJp7sNuoCCo8NMmKeB5S318T9MFVQt74km76w7p2x1qQwlAh0bmWE= ceph-604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:14:35.581 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-27T07:14:35.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:35 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2823813937' entity='client.admin' 2024-03-27T07:14:35.825 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:14:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.140+0000 7f16a0269700 1 -- 172.21.15.82:0/3556575212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1698100f70 msgr2=0x7f1698101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.140+0000 7f16a0269700 1 --2- 172.21.15.82:0/3556575212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1698100f70 0x7f1698101390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1688009910 tx=0x7f1688009c20 comp rx=0 tx=0).stop 2024-03-27T07:14:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.140+0000 7f16a0269700 1 -- 172.21.15.82:0/3556575212 shutdown_connections 2024-03-27T07:14:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.140+0000 7f16a0269700 1 --2- 172.21.15.82:0/3556575212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1698100f70 0x7f1698101390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.140+0000 7f16a0269700 1 -- 172.21.15.82:0/3556575212 >> 172.21.15.82:0/3556575212 conn(0x7f16980fc530 msgr2=0x7f16980fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.140+0000 7f16a0269700 1 -- 172.21.15.82:0/3556575212 shutdown_connections 2024-03-27T07:14:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.140+0000 7f16a0269700 1 -- 172.21.15.82:0/3556575212 wait complete. 2024-03-27T07:14:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.141+0000 7f16a0269700 1 Processor -- start 2024-03-27T07:14:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.141+0000 7f16a0269700 1 -- start start 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.141+0000 7f16a0269700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1698100f70 0x7f1698197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.141+0000 7f16a0269700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1698107000 con 0x7f1698100f70 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.141+0000 7f169e005700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1698100f70 0x7f1698197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.141+0000 7f169e005700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1698100f70 0x7f1698197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58412/0 (socket says 172.21.15.82:58412) 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.141+0000 7f169e005700 1 -- 172.21.15.82:0/4191259554 learned_addr learned my addr 172.21.15.82:0/4191259554 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.141+0000 7f169e005700 1 -- 172.21.15.82:0/4191259554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1698197ca0 con 0x7f1698100f70 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.142+0000 7f169e005700 1 --2- 172.21.15.82:0/4191259554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1698100f70 0x7f1698197760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1688006010 tx=0x7f1688005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.142+0000 7f168f7fe700 1 -- 172.21.15.82:0/4191259554 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1688027070 con 0x7f1698100f70 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.142+0000 7f168f7fe700 1 -- 172.21.15.82:0/4191259554 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f168800be40 con 0x7f1698100f70 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.142+0000 7f16a0269700 1 -- 172.21.15.82:0/4191259554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1698197f30 con 0x7f1698100f70 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.142+0000 7f168f7fe700 1 -- 172.21.15.82:0/4191259554 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f168800f460 con 0x7f1698100f70 2024-03-27T07:14:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.142+0000 7f16a0269700 1 -- 172.21.15.82:0/4191259554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169819ac20 con 0x7f1698100f70 2024-03-27T07:14:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.143+0000 7f168f7fe700 1 -- 172.21.15.82:0/4191259554 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f168802a070 con 0x7f1698100f70 2024-03-27T07:14:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.143+0000 7f16a0269700 1 -- 172.21.15.82:0/4191259554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1698107780 con 0x7f1698100f70 2024-03-27T07:14:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.143+0000 7f168f7fe700 1 --2- 172.21.15.82:0/4191259554 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1684039470 0x7f168403b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.143+0000 7f168f7fe700 1 -- 172.21.15.82:0/4191259554 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f168801e030 con 0x7f1698100f70 2024-03-27T07:14:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.143+0000 7f169d804700 1 --2- 172.21.15.82:0/4191259554 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1684039470 0x7f168403b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.143+0000 7f169d804700 1 --2- 172.21.15.82:0/4191259554 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1684039470 0x7f168403b930 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1694006fd0 tx=0x7f1694006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:38.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.148+0000 7f168f7fe700 1 -- 172.21.15.82:0/4191259554 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1688013070 con 0x7f1698100f70 2024-03-27T07:14:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.354+0000 7f16a0269700 1 -- 172.21.15.82:0/4191259554 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f169802de40 con 0x7f1698100f70 2024-03-27T07:14:38.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.356+0000 7f168f7fe700 1 -- 172.21.15.82:0/4191259554 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f1688031070 con 0x7f1698100f70 2024-03-27T07:14:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.359+0000 7f16a0269700 1 -- 172.21.15.82:0/4191259554 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1684039470 msgr2=0x7f168403b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.359+0000 7f16a0269700 1 --2- 172.21.15.82:0/4191259554 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1684039470 0x7f168403b930 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1694006fd0 tx=0x7f1694006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.359+0000 7f16a0269700 1 -- 172.21.15.82:0/4191259554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1698100f70 msgr2=0x7f1698197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.359+0000 7f16a0269700 1 --2- 172.21.15.82:0/4191259554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1698100f70 0x7f1698197760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1688006010 tx=0x7f1688005050 comp rx=0 tx=0).stop 2024-03-27T07:14:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.359+0000 7f16a0269700 1 -- 172.21.15.82:0/4191259554 shutdown_connections 2024-03-27T07:14:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.359+0000 7f16a0269700 1 --2- 172.21.15.82:0/4191259554 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1684039470 0x7f168403b930 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.359+0000 7f16a0269700 1 --2- 172.21.15.82:0/4191259554 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1698100f70 0x7f1698197760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.359+0000 7f16a0269700 1 -- 172.21.15.82:0/4191259554 >> 172.21.15.82:0/4191259554 conn(0x7f16980fc530 msgr2=0x7f169806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.359+0000 7f16a0269700 1 -- 172.21.15.82:0/4191259554 shutdown_connections 2024-03-27T07:14:38.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:38.359+0000 7f16a0269700 1 -- 172.21.15.82:0/4191259554 wait complete. 2024-03-27T07:14:38.966 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-27T07:14:38.966 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-27T07:14:39.221 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:14:39.569 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:39 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4191259554' entity='client.admin' 2024-03-27T07:14:40.832 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:40.832 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:40.832 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:14:40.832 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:40.833 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:14:40.833 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.031+0000 7f0df7615700 1 -- 172.21.15.82:0/1735276303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df0100f90 msgr2=0x7f0df01013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.031+0000 7f0df7615700 1 --2- 172.21.15.82:0/1735276303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df0100f90 0x7f0df01013b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009910 tx=0x7f0dec009c20 comp rx=0 tx=0).stop 2024-03-27T07:14:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.031+0000 7f0df7615700 1 -- 172.21.15.82:0/1735276303 shutdown_connections 2024-03-27T07:14:41.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.031+0000 7f0df7615700 1 --2- 172.21.15.82:0/1735276303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df0100f90 0x7f0df01013b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.031+0000 7f0df7615700 1 -- 172.21.15.82:0/1735276303 >> 172.21.15.82:0/1735276303 conn(0x7f0df00fc550 msgr2=0x7f0df00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.032+0000 7f0df7615700 1 -- 172.21.15.82:0/1735276303 shutdown_connections 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.032+0000 7f0df7615700 1 -- 172.21.15.82:0/1735276303 wait complete. 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.032+0000 7f0df7615700 1 Processor -- start 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.032+0000 7f0df7615700 1 -- start start 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.032+0000 7f0df7615700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df0100f90 0x7f0df0196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.032+0000 7f0df7615700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0df0107020 con 0x7f0df0100f90 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.032+0000 7f0df53b1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df0100f90 0x7f0df0196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.032+0000 7f0df53b1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df0100f90 0x7f0df0196730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58436/0 (socket says 172.21.15.82:58436) 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.032+0000 7f0df53b1700 1 -- 172.21.15.82:0/3680921332 learned_addr learned my addr 172.21.15.82:0/3680921332 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.033+0000 7f0df53b1700 1 -- 172.21.15.82:0/3680921332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df0196c70 con 0x7f0df0100f90 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.033+0000 7f0df53b1700 1 --2- 172.21.15.82:0/3680921332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df0100f90 0x7f0df0196730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009fd0 tx=0x7f0dec005050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.033+0000 7f0de67fc700 1 -- 172.21.15.82:0/3680921332 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dec027070 con 0x7f0df0100f90 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.033+0000 7f0de67fc700 1 -- 172.21.15.82:0/3680921332 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0dec00be40 con 0x7f0df0100f90 2024-03-27T07:14:41.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.033+0000 7f0df7615700 1 -- 172.21.15.82:0/3680921332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df0196f00 con 0x7f0df0100f90 2024-03-27T07:14:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.033+0000 7f0de67fc700 1 -- 172.21.15.82:0/3680921332 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dec00f460 con 0x7f0df0100f90 2024-03-27T07:14:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.033+0000 7f0df7615700 1 -- 172.21.15.82:0/3680921332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df0199bf0 con 0x7f0df0100f90 2024-03-27T07:14:41.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.034+0000 7f0de67fc700 1 -- 172.21.15.82:0/3680921332 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f0dec02a070 con 0x7f0df0100f90 2024-03-27T07:14:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.034+0000 7f0df7615700 1 -- 172.21.15.82:0/3680921332 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df01077a0 con 0x7f0df0100f90 2024-03-27T07:14:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.034+0000 7f0de67fc700 1 --2- 172.21.15.82:0/3680921332 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0ddc039470 0x7f0ddc03b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.034+0000 7f0de67fc700 1 -- 172.21.15.82:0/3680921332 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0dec01e030 con 0x7f0df0100f90 2024-03-27T07:14:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.034+0000 7f0df4bb0700 1 --2- 172.21.15.82:0/3680921332 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0ddc039470 0x7f0ddc03b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:41.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.035+0000 7f0df4bb0700 1 --2- 172.21.15.82:0/3680921332 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0ddc039470 0x7f0ddc03b930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0de0006fd0 tx=0x7f0de0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:41.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.039+0000 7f0de67fc700 1 -- 172.21.15.82:0/3680921332 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0dec013070 con 0x7f0df0100f90 2024-03-27T07:14:41.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.245+0000 7f0df7615700 1 -- 172.21.15.82:0/3680921332 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f0df002de40 con 0x7f0ddc039470 2024-03-27T07:14:41.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.248+0000 7f0de67fc700 1 -- 172.21.15.82:0/3680921332 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0df002de40 con 0x7f0ddc039470 2024-03-27T07:14:41.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.250+0000 7f0df7615700 1 -- 172.21.15.82:0/3680921332 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0ddc039470 msgr2=0x7f0ddc03b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:41.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.250+0000 7f0df7615700 1 --2- 172.21.15.82:0/3680921332 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0ddc039470 0x7f0ddc03b930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0de0006fd0 tx=0x7f0de0006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:41.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.250+0000 7f0df7615700 1 -- 172.21.15.82:0/3680921332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df0100f90 msgr2=0x7f0df0196730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:41.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.250+0000 7f0df7615700 1 --2- 172.21.15.82:0/3680921332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df0100f90 0x7f0df0196730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009fd0 tx=0x7f0dec005050 comp rx=0 tx=0).stop 2024-03-27T07:14:41.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.250+0000 7f0df7615700 1 -- 172.21.15.82:0/3680921332 shutdown_connections 2024-03-27T07:14:41.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.250+0000 7f0df7615700 1 --2- 172.21.15.82:0/3680921332 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0ddc039470 0x7f0ddc03b930 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:41.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.250+0000 7f0df7615700 1 --2- 172.21.15.82:0/3680921332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0df0100f90 0x7f0df0196730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:41.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.250+0000 7f0df7615700 1 -- 172.21.15.82:0/3680921332 >> 172.21.15.82:0/3680921332 conn(0x7f0df00fc550 msgr2=0x7f0df00fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:41.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.250+0000 7f0df7615700 1 -- 172.21.15.82:0/3680921332 shutdown_connections 2024-03-27T07:14:41.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:41.250+0000 7f0df7615700 1 -- 172.21.15.82:0/3680921332 wait complete. 2024-03-27T07:14:42.024 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi149 2024-03-27T07:14:42.024 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:14:42.024 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.conf 2024-03-27T07:14:42.043 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:14:42.043 DEBUG:teuthology.orchestra.run.smithi149:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:14:42.100 INFO:tasks.cephadm:Adding host smithi149 to orchestrator... 2024-03-27T07:14:42.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch host add smithi149 2024-03-27T07:14:42.336 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:14:42.587 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:42 smithi082 ceph-mon[32178]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:42.587 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:42.587 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:14:42.587 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:14:42.587 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:14:42.587 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:42 smithi082 ceph-mon[32178]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-27T07:14:42.588 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:42 smithi082 ceph-mon[32178]: Updating smithi082:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:14:42.588 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:42.588 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:42.588 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:43.300 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:43 smithi082 ceph-mon[32178]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:14:43.300 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:43 smithi082 ceph-mon[32178]: Updating smithi082:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:14:43.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.778+0000 7f8bf91c7700 1 -- 172.21.15.82:0/1132335465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4102280 msgr2=0x7f8bf4102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:43.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.778+0000 7f8bf91c7700 1 --2- 172.21.15.82:0/1132335465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4102280 0x7f8bf4102660 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b0a0 tx=0x7f8bec00b3b0 comp rx=0 tx=0).stop 2024-03-27T07:14:43.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.778+0000 7f8bf91c7700 1 -- 172.21.15.82:0/1132335465 shutdown_connections 2024-03-27T07:14:43.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.778+0000 7f8bf91c7700 1 --2- 172.21.15.82:0/1132335465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4102280 0x7f8bf4102660 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:43.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.778+0000 7f8bf91c7700 1 -- 172.21.15.82:0/1132335465 >> 172.21.15.82:0/1132335465 conn(0x7f8bf40fdb50 msgr2=0x7f8bf40fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.778+0000 7f8bf91c7700 1 -- 172.21.15.82:0/1132335465 shutdown_connections 2024-03-27T07:14:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.778+0000 7f8bf91c7700 1 -- 172.21.15.82:0/1132335465 wait complete. 2024-03-27T07:14:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.779+0000 7f8bf91c7700 1 Processor -- start 2024-03-27T07:14:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.779+0000 7f8bf91c7700 1 -- start start 2024-03-27T07:14:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.779+0000 7f8bf91c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4102280 0x7f8bf419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.779+0000 7f8bf91c7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf410c650 con 0x7f8bf4102280 2024-03-27T07:14:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.779+0000 7f8bf2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4102280 0x7f8bf419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.779+0000 7f8bf2d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4102280 0x7f8bf419d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58450/0 (socket says 172.21.15.82:58450) 2024-03-27T07:14:43.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.779+0000 7f8bf2d9d700 1 -- 172.21.15.82:0/2236214639 learned_addr learned my addr 172.21.15.82:0/2236214639 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:43.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.780+0000 7f8bf2d9d700 1 -- 172.21.15.82:0/2236214639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf419dcf0 con 0x7f8bf4102280 2024-03-27T07:14:43.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.780+0000 7f8bf2d9d700 1 --2- 172.21.15.82:0/2236214639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4102280 0x7f8bf419d7b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8bec015040 tx=0x7f8bec003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:43.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.780+0000 7f8bdbfff700 1 -- 172.21.15.82:0/2236214639 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bec017040 con 0x7f8bf4102280 2024-03-27T07:14:43.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.780+0000 7f8bdbfff700 1 -- 172.21.15.82:0/2236214639 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bec022070 con 0x7f8bf4102280 2024-03-27T07:14:43.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.780+0000 7f8bf91c7700 1 -- 172.21.15.82:0/2236214639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf419df80 con 0x7f8bf4102280 2024-03-27T07:14:43.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.780+0000 7f8bdbfff700 1 -- 172.21.15.82:0/2236214639 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bec01d5d0 con 0x7f8bf4102280 2024-03-27T07:14:43.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.780+0000 7f8bf91c7700 1 -- 172.21.15.82:0/2236214639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf4197970 con 0x7f8bf4102280 2024-03-27T07:14:43.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.781+0000 7f8bdbfff700 1 -- 172.21.15.82:0/2236214639 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f8bec01d8d0 con 0x7f8bf4102280 2024-03-27T07:14:43.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.781+0000 7f8bf91c7700 1 -- 172.21.15.82:0/2236214639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf4103760 con 0x7f8bf4102280 2024-03-27T07:14:43.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.781+0000 7f8bdbfff700 1 --2- 172.21.15.82:0/2236214639 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8bdc039470 0x7f8bdc03b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:43.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.781+0000 7f8bdbfff700 1 -- 172.21.15.82:0/2236214639 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8bec00f050 con 0x7f8bf4102280 2024-03-27T07:14:43.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.781+0000 7f8bf259c700 1 --2- 172.21.15.82:0/2236214639 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8bdc039470 0x7f8bdc03b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:43.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.782+0000 7f8bf259c700 1 --2- 172.21.15.82:0/2236214639 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8bdc039470 0x7f8bdc03b930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8be8006fd0 tx=0x7f8be8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.786+0000 7f8bdbfff700 1 -- 172.21.15.82:0/2236214639 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8bec007e20 con 0x7f8bf4102280 2024-03-27T07:14:43.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:43.987+0000 7f8bf91c7700 1 -- 172.21.15.82:0/2236214639 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}) -- 0x7f8bf4198ea0 con 0x7f8bdc039470 2024-03-27T07:14:44.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:44 smithi082 ceph-mon[32178]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi149", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:45.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:45 smithi082 ceph-mon[32178]: Deploying cephadm binary to smithi149 2024-03-27T07:14:47.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:47 smithi082 ceph-mon[32178]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:14:48.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.193+0000 7f8bdbfff700 1 -- 172.21.15.82:0/2236214639 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f8bf4198ea0 con 0x7f8bdc039470 2024-03-27T07:14:48.195 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi149' with addr '172.21.15.149' 2024-03-27T07:14:48.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.195+0000 7f8bf91c7700 1 -- 172.21.15.82:0/2236214639 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8bdc039470 msgr2=0x7f8bdc03b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:48.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.195+0000 7f8bf91c7700 1 --2- 172.21.15.82:0/2236214639 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8bdc039470 0x7f8bdc03b930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8be8006fd0 tx=0x7f8be8006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:48.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.195+0000 7f8bf91c7700 1 -- 172.21.15.82:0/2236214639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4102280 msgr2=0x7f8bf419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:48.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.195+0000 7f8bf91c7700 1 --2- 172.21.15.82:0/2236214639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4102280 0x7f8bf419d7b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8bec015040 tx=0x7f8bec003d50 comp rx=0 tx=0).stop 2024-03-27T07:14:48.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.196+0000 7f8bf91c7700 1 -- 172.21.15.82:0/2236214639 shutdown_connections 2024-03-27T07:14:48.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.196+0000 7f8bf91c7700 1 --2- 172.21.15.82:0/2236214639 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8bdc039470 0x7f8bdc03b930 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:48.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.196+0000 7f8bf91c7700 1 --2- 172.21.15.82:0/2236214639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8bf4102280 0x7f8bf419d7b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:48.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.196+0000 7f8bf91c7700 1 -- 172.21.15.82:0/2236214639 >> 172.21.15.82:0/2236214639 conn(0x7f8bf40fdb50 msgr2=0x7f8bf4103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:48.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.196+0000 7f8bf91c7700 1 -- 172.21.15.82:0/2236214639 shutdown_connections 2024-03-27T07:14:48.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:48.196+0000 7f8bf91c7700 1 -- 172.21.15.82:0/2236214639 wait complete. 2024-03-27T07:14:48.760 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch host ls --format=json 2024-03-27T07:14:48.991 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:14:49.384 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:49 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:49.384 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:49 smithi082 ceph-mon[32178]: Added host smithi149 2024-03-27T07:14:49.384 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:49 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:14:49.384 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:49 smithi082 ceph-mon[32178]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:14:49.384 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:49 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:50.436 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:50 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:50.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.465+0000 7f0480ca3700 1 -- 172.21.15.82:0/3393995785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f047c1066e0 msgr2=0x7f047c106ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:50.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.465+0000 7f0480ca3700 1 --2- 172.21.15.82:0/3393995785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f047c1066e0 0x7f047c106ac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0470009910 tx=0x7f0470009c20 comp rx=0 tx=0).stop 2024-03-27T07:14:50.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.466+0000 7f0480ca3700 1 -- 172.21.15.82:0/3393995785 shutdown_connections 2024-03-27T07:14:50.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.466+0000 7f0480ca3700 1 --2- 172.21.15.82:0/3393995785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f047c1066e0 0x7f047c106ac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:50.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.466+0000 7f0480ca3700 1 -- 172.21.15.82:0/3393995785 >> 172.21.15.82:0/3393995785 conn(0x7f047c078540 msgr2=0x7f047c078950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:50.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.466+0000 7f0480ca3700 1 -- 172.21.15.82:0/3393995785 shutdown_connections 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.466+0000 7f0480ca3700 1 -- 172.21.15.82:0/3393995785 wait complete. 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.466+0000 7f0480ca3700 1 Processor -- start 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.466+0000 7f0480ca3700 1 -- start start 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f0480ca3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f047c1066e0 0x7f047c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f0480ca3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f047c10b5b0 con 0x7f047c1066e0 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f047a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f047c1066e0 0x7f047c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f047a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f047c1066e0 0x7f047c19c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45992/0 (socket says 172.21.15.82:45992) 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f047a59c700 1 -- 172.21.15.82:0/2881603462 learned_addr learned my addr 172.21.15.82:0/2881603462 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f047a59c700 1 -- 172.21.15.82:0/2881603462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c19cc10 con 0x7f047c1066e0 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f047a59c700 1 --2- 172.21.15.82:0/2881603462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f047c1066e0 0x7f047c19c6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0470005850 tx=0x7f0470005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f046b7fe700 1 -- 172.21.15.82:0/2881603462 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0470028070 con 0x7f047c1066e0 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f046b7fe700 1 -- 172.21.15.82:0/2881603462 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f047000bbd0 con 0x7f047c1066e0 2024-03-27T07:14:50.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f0480ca3700 1 -- 172.21.15.82:0/2881603462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047c19cea0 con 0x7f047c1066e0 2024-03-27T07:14:50.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f046b7fe700 1 -- 172.21.15.82:0/2881603462 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0470003970 con 0x7f047c1066e0 2024-03-27T07:14:50.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.467+0000 7f0480ca3700 1 -- 172.21.15.82:0/2881603462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047c1968a0 con 0x7f047c1066e0 2024-03-27T07:14:50.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.468+0000 7f046b7fe700 1 -- 172.21.15.82:0/2881603462 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f047002b070 con 0x7f047c1066e0 2024-03-27T07:14:50.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.468+0000 7f0480ca3700 1 -- 172.21.15.82:0/2881603462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047c101e20 con 0x7f047c1066e0 2024-03-27T07:14:50.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.468+0000 7f046b7fe700 1 --2- 172.21.15.82:0/2881603462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0464039470 0x7f046403b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:50.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.468+0000 7f046b7fe700 1 -- 172.21.15.82:0/2881603462 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0470020070 con 0x7f047c1066e0 2024-03-27T07:14:50.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.468+0000 7f0479d9b700 1 --2- 172.21.15.82:0/2881603462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0464039470 0x7f046403b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:50.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.469+0000 7f0479d9b700 1 --2- 172.21.15.82:0/2881603462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0464039470 0x7f046403b930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f046c006fd0 tx=0x7f046c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:50.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.473+0000 7f046b7fe700 1 -- 172.21.15.82:0/2881603462 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0470013070 con 0x7f047c1066e0 2024-03-27T07:14:50.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.676+0000 7f0480ca3700 1 -- 172.21.15.82:0/2881603462 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f047c197d80 con 0x7f0464039470 2024-03-27T07:14:50.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.678+0000 7f046b7fe700 1 -- 172.21.15.82:0/2881603462 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f047c197d80 con 0x7f0464039470 2024-03-27T07:14:50.678 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:14:50.679 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.149", "hostname": "smithi149", "labels": [], "status": ""}] 2024-03-27T07:14:50.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.680+0000 7f0480ca3700 1 -- 172.21.15.82:0/2881603462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0464039470 msgr2=0x7f046403b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:50.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.680+0000 7f0480ca3700 1 --2- 172.21.15.82:0/2881603462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0464039470 0x7f046403b930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f046c006fd0 tx=0x7f046c006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:50.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.680+0000 7f0480ca3700 1 -- 172.21.15.82:0/2881603462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f047c1066e0 msgr2=0x7f047c19c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:50.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.680+0000 7f0480ca3700 1 --2- 172.21.15.82:0/2881603462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f047c1066e0 0x7f047c19c6d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0470005850 tx=0x7f0470005030 comp rx=0 tx=0).stop 2024-03-27T07:14:50.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.680+0000 7f0480ca3700 1 -- 172.21.15.82:0/2881603462 shutdown_connections 2024-03-27T07:14:50.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.680+0000 7f0480ca3700 1 --2- 172.21.15.82:0/2881603462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0464039470 0x7f046403b930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:50.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.680+0000 7f0480ca3700 1 --2- 172.21.15.82:0/2881603462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f047c1066e0 0x7f047c19c6d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:50.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.680+0000 7f0480ca3700 1 -- 172.21.15.82:0/2881603462 >> 172.21.15.82:0/2881603462 conn(0x7f047c078540 msgr2=0x7f047c0fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:50.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.680+0000 7f0480ca3700 1 -- 172.21.15.82:0/2881603462 shutdown_connections 2024-03-27T07:14:50.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:50.680+0000 7f0480ca3700 1 -- 172.21.15.82:0/2881603462 wait complete. 2024-03-27T07:14:51.280 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi153 2024-03-27T07:14:51.280 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:14:51.280 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.conf 2024-03-27T07:14:51.300 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:14:51.300 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:14:51.360 INFO:tasks.cephadm:Adding host smithi153 to orchestrator... 2024-03-27T07:14:51.360 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch host add smithi153 2024-03-27T07:14:51.594 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:14:51.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:51 smithi082 ceph-mon[32178]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:14:51.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:51 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:52.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:52 smithi082 ceph-mon[32178]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:14:53.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.145+0000 7f06f0057700 1 -- 172.21.15.82:0/3197613718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06e8102270 msgr2=0x7f06e8102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:53.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.145+0000 7f06f0057700 1 --2- 172.21.15.82:0/3197613718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06e8102270 0x7f06e8102650 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009910 tx=0x7f06d8009c20 comp rx=0 tx=0).stop 2024-03-27T07:14:53.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.145+0000 7f06f0057700 1 -- 172.21.15.82:0/3197613718 shutdown_connections 2024-03-27T07:14:53.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.145+0000 7f06f0057700 1 --2- 172.21.15.82:0/3197613718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06e8102270 0x7f06e8102650 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:53.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.145+0000 7f06f0057700 1 -- 172.21.15.82:0/3197613718 >> 172.21.15.82:0/3197613718 conn(0x7f06e80fdb20 msgr2=0x7f06e80fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:53.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.145+0000 7f06f0057700 1 -- 172.21.15.82:0/3197613718 shutdown_connections 2024-03-27T07:14:53.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.145+0000 7f06f0057700 1 -- 172.21.15.82:0/3197613718 wait complete. 2024-03-27T07:14:53.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.146+0000 7f06f0057700 1 Processor -- start 2024-03-27T07:14:53.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.146+0000 7f06f0057700 1 -- start start 2024-03-27T07:14:53.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.146+0000 7f06f0057700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06e8102270 0x7f06e819d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:53.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.146+0000 7f06f0057700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06e810c640 con 0x7f06e8102270 2024-03-27T07:14:53.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.146+0000 7f06eddf3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06e8102270 0x7f06e819d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:53.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.146+0000 7f06eddf3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06e8102270 0x7f06e819d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46018/0 (socket says 172.21.15.82:46018) 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.146+0000 7f06eddf3700 1 -- 172.21.15.82:0/715089676 learned_addr learned my addr 172.21.15.82:0/715089676 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.147+0000 7f06eddf3700 1 -- 172.21.15.82:0/715089676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e819dd00 con 0x7f06e8102270 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.147+0000 7f06eddf3700 1 --2- 172.21.15.82:0/715089676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06e8102270 0x7f06e819d7c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f06d8005850 tx=0x7f06d8005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.147+0000 7f06deffd700 1 -- 172.21.15.82:0/715089676 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8026070 con 0x7f06e8102270 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.147+0000 7f06deffd700 1 -- 172.21.15.82:0/715089676 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06d800bbd0 con 0x7f06e8102270 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.147+0000 7f06f0057700 1 -- 172.21.15.82:0/715089676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e819dff0 con 0x7f06e8102270 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.147+0000 7f06deffd700 1 -- 172.21.15.82:0/715089676 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f06d8003970 con 0x7f06e8102270 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.147+0000 7f06f0057700 1 -- 172.21.15.82:0/715089676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e8197980 con 0x7f06e8102270 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.148+0000 7f06deffd700 1 -- 172.21.15.82:0/715089676 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f06d8029070 con 0x7f06e8102270 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.148+0000 7f06f0057700 1 -- 172.21.15.82:0/715089676 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e8103750 con 0x7f06e8102270 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.148+0000 7f06deffd700 1 --2- 172.21.15.82:0/715089676 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f06d4039470 0x7f06d403b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.148+0000 7f06deffd700 1 -- 172.21.15.82:0/715089676 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f06d801e070 con 0x7f06e8102270 2024-03-27T07:14:53.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.148+0000 7f06ed5f2700 1 --2- 172.21.15.82:0/715089676 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f06d4039470 0x7f06d403b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:14:53.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.149+0000 7f06ed5f2700 1 --2- 172.21.15.82:0/715089676 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f06d4039470 0x7f06d403b930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f06e4006fd0 tx=0x7f06e4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:14:53.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.153+0000 7f06deffd700 1 -- 172.21.15.82:0/715089676 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f06d8013070 con 0x7f06e8102270 2024-03-27T07:14:53.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:53.358+0000 7f06f0057700 1 -- 172.21.15.82:0/715089676 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}) -- 0x7f06e8198eb0 con 0x7f06d4039470 2024-03-27T07:14:53.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:53 smithi082 ceph-mon[32178]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:14:54.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:54 smithi082 ceph-mon[32178]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:14:54.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:54.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:54.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:54.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:54.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:14:54.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:14:54.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:14:55.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:55 smithi082 ceph-mon[32178]: Updating smithi149:/etc/ceph/ceph.conf 2024-03-27T07:14:55.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:55 smithi082 ceph-mon[32178]: Updating smithi149:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:14:55.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:55 smithi082 ceph-mon[32178]: Deploying cephadm binary to smithi153 2024-03-27T07:14:55.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:55 smithi082 ceph-mon[32178]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:14:55.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:55 smithi082 ceph-mon[32178]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:14:56.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:56 smithi082 ceph-mon[32178]: Updating smithi149:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:14:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:57 smithi082 ceph-mon[32178]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:14:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:57.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.770+0000 7f06deffd700 1 -- 172.21.15.82:0/715089676 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f06e8198eb0 con 0x7f06d4039470 2024-03-27T07:14:57.771 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi153' with addr '172.21.15.153' 2024-03-27T07:14:57.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.773+0000 7f06f0057700 1 -- 172.21.15.82:0/715089676 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f06d4039470 msgr2=0x7f06d403b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:57.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.773+0000 7f06f0057700 1 --2- 172.21.15.82:0/715089676 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f06d4039470 0x7f06d403b930 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f06e4006fd0 tx=0x7f06e4006e40 comp rx=0 tx=0).stop 2024-03-27T07:14:57.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.773+0000 7f06f0057700 1 -- 172.21.15.82:0/715089676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06e8102270 msgr2=0x7f06e819d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:57.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.773+0000 7f06f0057700 1 --2- 172.21.15.82:0/715089676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06e8102270 0x7f06e819d7c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f06d8005850 tx=0x7f06d8005030 comp rx=0 tx=0).stop 2024-03-27T07:14:57.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.773+0000 7f06f0057700 1 -- 172.21.15.82:0/715089676 shutdown_connections 2024-03-27T07:14:57.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.773+0000 7f06f0057700 1 --2- 172.21.15.82:0/715089676 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f06d4039470 0x7f06d403b930 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:57.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.773+0000 7f06f0057700 1 --2- 172.21.15.82:0/715089676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06e8102270 0x7f06e819d7c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:57.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.773+0000 7f06f0057700 1 -- 172.21.15.82:0/715089676 >> 172.21.15.82:0/715089676 conn(0x7f06e80fdb20 msgr2=0x7f06e8103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:57.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.773+0000 7f06f0057700 1 -- 172.21.15.82:0/715089676 shutdown_connections 2024-03-27T07:14:57.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:57.773+0000 7f06f0057700 1 -- 172.21.15.82:0/715089676 wait complete. 2024-03-27T07:14:58.311 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch host ls --format=json 2024-03-27T07:14:58.548 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:14:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:58 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:58 smithi082 ceph-mon[32178]: Added host smithi153 2024-03-27T07:14:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:58 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:14:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:58 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:58 smithi082 ceph-mon[32178]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:14:59.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:14:59 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:14:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.998+0000 7f9923111700 1 -- 172.21.15.82:0/3395562988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c1011b0 msgr2=0x7f991c101590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:14:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.998+0000 7f9923111700 1 --2- 172.21.15.82:0/3395562988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c1011b0 0x7f991c101590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f991400b0a0 tx=0x7f991400b3b0 comp rx=0 tx=0).stop 2024-03-27T07:14:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.998+0000 7f9923111700 1 -- 172.21.15.82:0/3395562988 shutdown_connections 2024-03-27T07:14:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.998+0000 7f9923111700 1 --2- 172.21.15.82:0/3395562988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c1011b0 0x7f991c101590 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:14:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.998+0000 7f9923111700 1 -- 172.21.15.82:0/3395562988 >> 172.21.15.82:0/3395562988 conn(0x7f991c0fca80 msgr2=0x7f991c0feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:14:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.998+0000 7f9923111700 1 -- 172.21.15.82:0/3395562988 shutdown_connections 2024-03-27T07:14:59.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.998+0000 7f9923111700 1 -- 172.21.15.82:0/3395562988 wait complete. 2024-03-27T07:15:00.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9923111700 1 Processor -- start 2024-03-27T07:15:00.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9923111700 1 -- start start 2024-03-27T07:15:00.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9923111700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c1011b0 0x7f991c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:00.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9923111700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f991c10b580 con 0x7f991c1011b0 2024-03-27T07:15:00.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9920ead700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c1011b0 0x7f991c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:00.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9920ead700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c1011b0 0x7f991c19d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39050/0 (socket says 172.21.15.82:39050) 2024-03-27T07:15:00.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9920ead700 1 -- 172.21.15.82:0/530836297 learned_addr learned my addr 172.21.15.82:0/530836297 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9920ead700 1 -- 172.21.15.82:0/530836297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991c19dc40 con 0x7f991c1011b0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9920ead700 1 --2- 172.21.15.82:0/530836297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c1011b0 0x7f991c19d700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f99140093e0 tx=0x7f9914003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9919ffb700 1 -- 172.21.15.82:0/530836297 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9914017040 con 0x7f991c1011b0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9919ffb700 1 -- 172.21.15.82:0/530836297 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9914022070 con 0x7f991c1011b0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9923111700 1 -- 172.21.15.82:0/530836297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991c19ded0 con 0x7f991c1011b0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:14:59.999+0000 7f9919ffb700 1 -- 172.21.15.82:0/530836297 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f991401d440 con 0x7f991c1011b0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.000+0000 7f9923111700 1 -- 172.21.15.82:0/530836297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f991c1978c0 con 0x7f991c1011b0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.000+0000 7f9919ffb700 1 -- 172.21.15.82:0/530836297 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f9914004000 con 0x7f991c1011b0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.001+0000 7f9923111700 1 -- 172.21.15.82:0/530836297 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f991c102690 con 0x7f991c1011b0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.001+0000 7f9919ffb700 1 --2- 172.21.15.82:0/530836297 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9908039520 0x7f990803b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.001+0000 7f9919ffb700 1 -- 172.21.15.82:0/530836297 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f991400f050 con 0x7f991c1011b0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.001+0000 7f991bfff700 1 --2- 172.21.15.82:0/530836297 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9908039520 0x7f990803b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:00.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.001+0000 7f991bfff700 1 --2- 172.21.15.82:0/530836297 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9908039520 0x7f990803b9e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f990c006fd0 tx=0x7f990c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:00.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.006+0000 7f9919ffb700 1 -- 172.21.15.82:0/530836297 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9914007e20 con 0x7f991c1011b0 2024-03-27T07:15:00.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.208+0000 7f9923111700 1 -- 172.21.15.82:0/530836297 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f991c198df0 con 0x7f9908039520 2024-03-27T07:15:00.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.209+0000 7f9919ffb700 1 -- 172.21.15.82:0/530836297 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f991c198df0 con 0x7f9908039520 2024-03-27T07:15:00.210 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:15:00.210 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.149", "hostname": "smithi149", "labels": [], "status": ""}, {"addr": "172.21.15.153", "hostname": "smithi153", "labels": [], "status": ""}] 2024-03-27T07:15:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.211+0000 7f9923111700 1 -- 172.21.15.82:0/530836297 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9908039520 msgr2=0x7f990803b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.211+0000 7f9923111700 1 --2- 172.21.15.82:0/530836297 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9908039520 0x7f990803b9e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f990c006fd0 tx=0x7f990c006e40 comp rx=0 tx=0).stop 2024-03-27T07:15:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.211+0000 7f9923111700 1 -- 172.21.15.82:0/530836297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c1011b0 msgr2=0x7f991c19d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.211+0000 7f9923111700 1 --2- 172.21.15.82:0/530836297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c1011b0 0x7f991c19d700 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f99140093e0 tx=0x7f9914003ce0 comp rx=0 tx=0).stop 2024-03-27T07:15:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.211+0000 7f9923111700 1 -- 172.21.15.82:0/530836297 shutdown_connections 2024-03-27T07:15:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.211+0000 7f9923111700 1 --2- 172.21.15.82:0/530836297 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9908039520 0x7f990803b9e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.211+0000 7f9923111700 1 --2- 172.21.15.82:0/530836297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f991c1011b0 0x7f991c19d700 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.211+0000 7f9923111700 1 -- 172.21.15.82:0/530836297 >> 172.21.15.82:0/530836297 conn(0x7f991c0fca80 msgr2=0x7f991c06a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.211+0000 7f9923111700 1 -- 172.21.15.82:0/530836297 shutdown_connections 2024-03-27T07:15:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:00.211+0000 7f9923111700 1 -- 172.21.15.82:0/530836297 wait complete. 2024-03-27T07:15:00.836 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-27T07:15:00.837 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd crush tunables default 2024-03-27T07:15:01.068 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:15:01.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:01 smithi082 ceph-mon[32178]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:15:01.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:01 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:01.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:01 smithi082 ceph-mon[32178]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:02.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.496+0000 7f7f45c35700 1 -- 172.21.15.82:0/1557680167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f40103210 msgr2=0x7f7f401035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:02.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.496+0000 7f7f45c35700 1 --2- 172.21.15.82:0/1557680167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f40103210 0x7f7f401035f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7f30009910 tx=0x7f7f30009c20 comp rx=0 tx=0).stop 2024-03-27T07:15:02.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.496+0000 7f7f45c35700 1 -- 172.21.15.82:0/1557680167 shutdown_connections 2024-03-27T07:15:02.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.496+0000 7f7f45c35700 1 --2- 172.21.15.82:0/1557680167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f40103210 0x7f7f401035f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:02.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.496+0000 7f7f45c35700 1 -- 172.21.15.82:0/1557680167 >> 172.21.15.82:0/1557680167 conn(0x7f7f400fca80 msgr2=0x7f7f400feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.496+0000 7f7f45c35700 1 -- 172.21.15.82:0/1557680167 shutdown_connections 2024-03-27T07:15:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.496+0000 7f7f45c35700 1 -- 172.21.15.82:0/1557680167 wait complete. 2024-03-27T07:15:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.496+0000 7f7f45c35700 1 Processor -- start 2024-03-27T07:15:02.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f45c35700 1 -- start start 2024-03-27T07:15:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f45c35700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f40103210 0x7f7f4019d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:02.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f45c35700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4010c6e0 con 0x7f7f40103210 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f40103210 0x7f7f4019d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f3f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f40103210 0x7f7f4019d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39068/0 (socket says 172.21.15.82:39068) 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f3f7fe700 1 -- 172.21.15.82:0/2568459588 learned_addr learned my addr 172.21.15.82:0/2568459588 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f3f7fe700 1 -- 172.21.15.82:0/2568459588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4019dd50 con 0x7f7f40103210 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f3f7fe700 1 --2- 172.21.15.82:0/2568459588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f40103210 0x7f7f4019d810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7f30006010 tx=0x7f7f30005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f3cff9700 1 -- 172.21.15.82:0/2568459588 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f30026070 con 0x7f7f40103210 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f3cff9700 1 -- 172.21.15.82:0/2568459588 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f3000bc30 con 0x7f7f40103210 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.497+0000 7f7f45c35700 1 -- 172.21.15.82:0/2568459588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4019dfe0 con 0x7f7f40103210 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.498+0000 7f7f3cff9700 1 -- 172.21.15.82:0/2568459588 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f300039a0 con 0x7f7f40103210 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.498+0000 7f7f45c35700 1 -- 172.21.15.82:0/2568459588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f401979d0 con 0x7f7f40103210 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.498+0000 7f7f3cff9700 1 -- 172.21.15.82:0/2568459588 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f7f30029070 con 0x7f7f40103210 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.498+0000 7f7f45c35700 1 -- 172.21.15.82:0/2568459588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4006ad60 con 0x7f7f40103210 2024-03-27T07:15:02.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.498+0000 7f7f3cff9700 1 --2- 172.21.15.82:0/2568459588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7f280394d0 0x7f7f2803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:02.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.499+0000 7f7f3cff9700 1 -- 172.21.15.82:0/2568459588 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7f3001e070 con 0x7f7f40103210 2024-03-27T07:15:02.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.499+0000 7f7f3effd700 1 --2- 172.21.15.82:0/2568459588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7f280394d0 0x7f7f2803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:02.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.499+0000 7f7f3effd700 1 --2- 172.21.15.82:0/2568459588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7f280394d0 0x7f7f2803b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f34006fd0 tx=0x7f7f34006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:02.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.503+0000 7f7f3cff9700 1 -- 172.21.15.82:0/2568459588 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7f30013070 con 0x7f7f40103210 2024-03-27T07:15:02.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:02.706+0000 7f7f45c35700 1 -- 172.21.15.82:0/2568459588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7f40198f00 con 0x7f7f40103210 2024-03-27T07:15:03.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.436+0000 7f7f3cff9700 1 -- 172.21.15.82:0/2568459588 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f7f30030090 con 0x7f7f40103210 2024-03-27T07:15:03.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.439+0000 7f7f45c35700 1 -- 172.21.15.82:0/2568459588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7f280394d0 msgr2=0x7f7f2803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:03.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.439+0000 7f7f45c35700 1 --2- 172.21.15.82:0/2568459588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7f280394d0 0x7f7f2803b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7f34006fd0 tx=0x7f7f34006e40 comp rx=0 tx=0).stop 2024-03-27T07:15:03.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.439+0000 7f7f45c35700 1 -- 172.21.15.82:0/2568459588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f40103210 msgr2=0x7f7f4019d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:03.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.439+0000 7f7f45c35700 1 --2- 172.21.15.82:0/2568459588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f40103210 0x7f7f4019d810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7f30006010 tx=0x7f7f30005030 comp rx=0 tx=0).stop 2024-03-27T07:15:03.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.439+0000 7f7f45c35700 1 -- 172.21.15.82:0/2568459588 shutdown_connections 2024-03-27T07:15:03.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.439+0000 7f7f45c35700 1 --2- 172.21.15.82:0/2568459588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7f280394d0 0x7f7f2803b990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:03.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.439+0000 7f7f45c35700 1 --2- 172.21.15.82:0/2568459588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f40103210 0x7f7f4019d810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:03.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.439+0000 7f7f45c35700 1 -- 172.21.15.82:0/2568459588 >> 172.21.15.82:0/2568459588 conn(0x7f7f400fca80 msgr2=0x7f7f40103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:03.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.439+0000 7f7f45c35700 1 -- 172.21.15.82:0/2568459588 shutdown_connections 2024-03-27T07:15:03.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:03.439+0000 7f7f45c35700 1 -- 172.21.15.82:0/2568459588 wait complete. 2024-03-27T07:15:03.441 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-03-27T07:15:03.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:03 smithi082 ceph-mon[32178]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:03.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:03 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2568459588' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-27T07:15:03.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:03.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:03.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:03.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:03.765 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:15:03.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:03.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:04.082 INFO:tasks.cephadm:Adding mon.a on smithi082 2024-03-27T07:15:04.083 INFO:tasks.cephadm:Adding mon.b on smithi149 2024-03-27T07:15:04.083 INFO:tasks.cephadm:Adding mon.c on smithi153 2024-03-27T07:15:04.083 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch apply mon '3;smithi082:172.21.15.82=a;smithi149:172.21.15.149=b;smithi153:172.21.15.153=c' 2024-03-27T07:15:04.316 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:15:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:04 smithi082 ceph-mon[32178]: Updating smithi153:/etc/ceph/ceph.conf 2024-03-27T07:15:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:04 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2568459588' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-27T07:15:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:04 smithi082 ceph-mon[32178]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T07:15:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:04 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:04 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:04 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:05.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:05 smithi082 ceph-mon[32178]: Updating smithi153:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:15:05.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:05 smithi082 ceph-mon[32178]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:15:05.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:05 smithi082 ceph-mon[32178]: Updating smithi153:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:15:05.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:05 smithi082 ceph-mon[32178]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.822+0000 7fe75c3c7700 1 -- 172.21.15.153:0/4278252833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe754101180 msgr2=0x7fe754101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.822+0000 7fe75c3c7700 1 --2- 172.21.15.153:0/4278252833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe754101180 0x7fe754101560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe750009910 tx=0x7fe750009c20 comp rx=0 tx=0).stop 2024-03-27T07:15:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.822+0000 7fe75c3c7700 1 -- 172.21.15.153:0/4278252833 shutdown_connections 2024-03-27T07:15:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.822+0000 7fe75c3c7700 1 --2- 172.21.15.153:0/4278252833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe754101180 0x7fe754101560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.822+0000 7fe75c3c7700 1 -- 172.21.15.153:0/4278252833 >> 172.21.15.153:0/4278252833 conn(0x7fe7540fca10 msgr2=0x7fe7540fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.822+0000 7fe75c3c7700 1 -- 172.21.15.153:0/4278252833 shutdown_connections 2024-03-27T07:15:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.822+0000 7fe75c3c7700 1 -- 172.21.15.153:0/4278252833 wait complete. 2024-03-27T07:15:05.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.823+0000 7fe75c3c7700 1 Processor -- start 2024-03-27T07:15:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.823+0000 7fe75c3c7700 1 -- start start 2024-03-27T07:15:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.823+0000 7fe75c3c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe754101180 0x7fe75419d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:05.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.823+0000 7fe75c3c7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe75410b550 con 0x7fe754101180 2024-03-27T07:15:05.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.823+0000 7fe75a163700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe754101180 0x7fe75419d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.823+0000 7fe75a163700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe754101180 0x7fe75419d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.153:53016/0 (socket says 172.21.15.153:53016) 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.823+0000 7fe75a163700 1 -- 172.21.15.153:0/2273811304 learned_addr learned my addr 172.21.15.153:0/2273811304 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.824+0000 7fe75a163700 1 -- 172.21.15.153:0/2273811304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75419dce0 con 0x7fe754101180 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.824+0000 7fe75a163700 1 --2- 172.21.15.153:0/2273811304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe754101180 0x7fe75419d7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe750006010 tx=0x7fe750005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.824+0000 7fe74b7fe700 1 -- 172.21.15.153:0/2273811304 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe750026070 con 0x7fe754101180 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.824+0000 7fe75c3c7700 1 -- 172.21.15.153:0/2273811304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe75419dfd0 con 0x7fe754101180 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.824+0000 7fe74b7fe700 1 -- 172.21.15.153:0/2273811304 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe75000bbd0 con 0x7fe754101180 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.824+0000 7fe74b7fe700 1 -- 172.21.15.153:0/2273811304 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe750003910 con 0x7fe754101180 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.824+0000 7fe75c3c7700 1 -- 172.21.15.153:0/2273811304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe754197960 con 0x7fe754101180 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.825+0000 7fe75c3c7700 1 -- 172.21.15.153:0/2273811304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe754102660 con 0x7fe754101180 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.825+0000 7fe74b7fe700 1 -- 172.21.15.153:0/2273811304 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7fe750029070 con 0x7fe754101180 2024-03-27T07:15:05.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.825+0000 7fe74b7fe700 1 --2- 172.21.15.153:0/2273811304 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe7400394d0 0x7fe74003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:05.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.825+0000 7fe74b7fe700 1 -- 172.21.15.153:0/2273811304 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe75001e070 con 0x7fe754101180 2024-03-27T07:15:05.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.825+0000 7fe759962700 1 --2- 172.21.15.153:0/2273811304 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe7400394d0 0x7fe74003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:05.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.826+0000 7fe759962700 1 --2- 172.21.15.153:0/2273811304 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe7400394d0 0x7fe74003b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe744006fd0 tx=0x7fe744006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:05.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:05.830+0000 7fe74b7fe700 1 -- 172.21.15.153:0/2273811304 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe750013070 con 0x7fe754101180 2024-03-27T07:15:06.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.047+0000 7fe75c3c7700 1 -- 172.21.15.153:0/2273811304 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi149:172.21.15.149=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}) -- 0x7fe754198f00 con 0x7fe7400394d0 2024-03-27T07:15:06.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.053+0000 7fe74b7fe700 1 -- 172.21.15.153:0/2273811304 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe754198f00 con 0x7fe7400394d0 2024-03-27T07:15:06.055 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mon update... 2024-03-27T07:15:06.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.055+0000 7fe75c3c7700 1 -- 172.21.15.153:0/2273811304 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe7400394d0 msgr2=0x7fe74003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:06.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.055+0000 7fe75c3c7700 1 --2- 172.21.15.153:0/2273811304 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe7400394d0 0x7fe74003b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe744006fd0 tx=0x7fe744006e40 comp rx=0 tx=0).stop 2024-03-27T07:15:06.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.055+0000 7fe75c3c7700 1 -- 172.21.15.153:0/2273811304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe754101180 msgr2=0x7fe75419d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:06.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.055+0000 7fe75c3c7700 1 --2- 172.21.15.153:0/2273811304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe754101180 0x7fe75419d7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe750006010 tx=0x7fe750005030 comp rx=0 tx=0).stop 2024-03-27T07:15:06.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.055+0000 7fe75c3c7700 1 -- 172.21.15.153:0/2273811304 shutdown_connections 2024-03-27T07:15:06.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.055+0000 7fe75c3c7700 1 --2- 172.21.15.153:0/2273811304 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe7400394d0 0x7fe74003b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:06.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.055+0000 7fe75c3c7700 1 --2- 172.21.15.153:0/2273811304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe754101180 0x7fe75419d7a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:06.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.055+0000 7fe75c3c7700 1 -- 172.21.15.153:0/2273811304 >> 172.21.15.153:0/2273811304 conn(0x7fe7540fca10 msgr2=0x7fe75406a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:06.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.056+0000 7fe75c3c7700 1 -- 172.21.15.153:0/2273811304 shutdown_connections 2024-03-27T07:15:06.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:06.056+0000 7fe75c3c7700 1 -- 172.21.15.153:0/2273811304 wait complete. 2024-03-27T07:15:06.625 DEBUG:teuthology.orchestra.run.smithi149:mon.b> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.b.service 2024-03-27T07:15:06.627 DEBUG:teuthology.orchestra.run.smithi153:mon.c> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.c.service 2024-03-27T07:15:06.629 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-27T07:15:06.630 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-27T07:15:07.313 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:15:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi149:172.21.15.149=b;smithi153:172.21.15.153=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:15:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi149:172.21.15.149=b;smithi153:172.21.15.153=c;count:3 2024-03-27T07:15:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:07.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: Deploying daemon mon.c on smithi153 2024-03-27T07:15:07.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:07 smithi082 ceph-mon[32178]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:09.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.086+0000 7fa271a8c700 1 -- 172.21.15.153:0/2416519988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c1007d0 msgr2=0x7fa26c100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.086+0000 7fa271a8c700 1 --2- 172.21.15.153:0/2416519988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c1007d0 0x7fa26c100bb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009910 tx=0x7fa25c009c20 comp rx=0 tx=0).stop 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.086+0000 7fa271a8c700 1 -- 172.21.15.153:0/2416519988 shutdown_connections 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.086+0000 7fa271a8c700 1 --2- 172.21.15.153:0/2416519988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c1007d0 0x7fa26c100bb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.086+0000 7fa271a8c700 1 -- 172.21.15.153:0/2416519988 >> 172.21.15.153:0/2416519988 conn(0x7fa26c0fc190 msgr2=0x7fa26c0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.086+0000 7fa271a8c700 1 -- 172.21.15.153:0/2416519988 shutdown_connections 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.086+0000 7fa271a8c700 1 -- 172.21.15.153:0/2416519988 wait complete. 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.087+0000 7fa271a8c700 1 Processor -- start 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.087+0000 7fa271a8c700 1 -- start start 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.087+0000 7fa271a8c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c1007d0 0x7fa26c19d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.087+0000 7fa271a8c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa26c10c660 con 0x7fa26c1007d0 2024-03-27T07:15:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.087+0000 7fa26b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c1007d0 0x7fa26c19d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:09.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.087+0000 7fa26b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c1007d0 0x7fa26c19d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.153:53028/0 (socket says 172.21.15.153:53028) 2024-03-27T07:15:09.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.088+0000 7fa26b7fe700 1 -- 172.21.15.153:0/3068061914 learned_addr learned my addr 172.21.15.153:0/3068061914 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:15:09.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.088+0000 7fa26b7fe700 1 -- 172.21.15.153:0/3068061914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26c19dca0 con 0x7fa26c1007d0 2024-03-27T07:15:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.088+0000 7fa26b7fe700 1 --2- 172.21.15.153:0/3068061914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c1007d0 0x7fa26c19d760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa25c005850 tx=0x7fa25c005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.088+0000 7fa268ff9700 1 -- 172.21.15.153:0/3068061914 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa25c026070 con 0x7fa26c1007d0 2024-03-27T07:15:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.088+0000 7fa271a8c700 1 -- 172.21.15.153:0/3068061914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26c19df90 con 0x7fa26c1007d0 2024-03-27T07:15:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.088+0000 7fa268ff9700 1 -- 172.21.15.153:0/3068061914 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa25c00bbd0 con 0x7fa26c1007d0 2024-03-27T07:15:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.088+0000 7fa268ff9700 1 -- 172.21.15.153:0/3068061914 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa25c003970 con 0x7fa26c1007d0 2024-03-27T07:15:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.088+0000 7fa271a8c700 1 -- 172.21.15.153:0/3068061914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa26c197920 con 0x7fa26c1007d0 2024-03-27T07:15:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.089+0000 7fa271a8c700 1 -- 172.21.15.153:0/3068061914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa26c103890 con 0x7fa26c1007d0 2024-03-27T07:15:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.089+0000 7fa268ff9700 1 -- 172.21.15.153:0/3068061914 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7fa25c029070 con 0x7fa26c1007d0 2024-03-27T07:15:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.089+0000 7fa268ff9700 1 --2- 172.21.15.153:0/3068061914 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa254039470 0x7fa25403b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.089+0000 7fa268ff9700 1 -- 172.21.15.153:0/3068061914 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa25c01e070 con 0x7fa26c1007d0 2024-03-27T07:15:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.090+0000 7fa26affd700 1 --2- 172.21.15.153:0/3068061914 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa254039470 0x7fa25403b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.090+0000 7fa26affd700 1 --2- 172.21.15.153:0/3068061914 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa254039470 0x7fa25403b930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa260006fd0 tx=0x7fa260006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:09.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.095+0000 7fa268ff9700 1 -- 172.21.15.153:0/3068061914 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa25c013070 con 0x7fa26c1007d0 2024-03-27T07:15:09.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.392+0000 7fa271a8c700 1 -- 172.21.15.153:0/3068061914 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa26c198e50 con 0x7fa26c1007d0 2024-03-27T07:15:09.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.392+0000 7fa268ff9700 1 -- 172.21.15.153:0/3068061914 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fa25c030090 con 0x7fa26c1007d0 2024-03-27T07:15:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:15:09.394 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","modified":"2024-03-27T07:13:20.384938Z","created":"2024-03-27T07:13:20.384938Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-27T07:15:09.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.394+0000 7fa271a8c700 1 -- 172.21.15.153:0/3068061914 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa254039470 msgr2=0x7fa25403b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:09.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.394+0000 7fa271a8c700 1 --2- 172.21.15.153:0/3068061914 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa254039470 0x7fa25403b930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa260006fd0 tx=0x7fa260006e40 comp rx=0 tx=0).stop 2024-03-27T07:15:09.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.394+0000 7fa271a8c700 1 -- 172.21.15.153:0/3068061914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c1007d0 msgr2=0x7fa26c19d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:09.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.394+0000 7fa271a8c700 1 --2- 172.21.15.153:0/3068061914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c1007d0 0x7fa26c19d760 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa25c005850 tx=0x7fa25c005030 comp rx=0 tx=0).stop 2024-03-27T07:15:09.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.394+0000 7fa271a8c700 1 -- 172.21.15.153:0/3068061914 shutdown_connections 2024-03-27T07:15:09.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.394+0000 7fa271a8c700 1 --2- 172.21.15.153:0/3068061914 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa254039470 0x7fa25403b930 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:09.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.394+0000 7fa271a8c700 1 --2- 172.21.15.153:0/3068061914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa26c1007d0 0x7fa26c19d760 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:09.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.395+0000 7fa271a8c700 1 -- 172.21.15.153:0/3068061914 >> 172.21.15.153:0/3068061914 conn(0x7fa26c0fc190 msgr2=0x7fa26c109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:09.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.395+0000 7fa271a8c700 1 -- 172.21.15.153:0/3068061914 shutdown_connections 2024-03-27T07:15:09.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:09.395+0000 7fa271a8c700 1 -- 172.21.15.153:0/3068061914 wait complete. 2024-03-27T07:15:09.397 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-03-27T07:15:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:09 smithi082 ceph-mon[32178]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:09 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/3068061914' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T07:15:11.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:11 smithi153 systemd[1]: Started Ceph mon.c for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:15:11.540 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-27T07:15:11.541 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-27T07:15:11.773 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.533+0000 7fad346ca700 1 -- 172.21.15.153:0/2917869787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad2c102380 msgr2=0x7fad18005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.533+0000 7fad346ca700 1 --2- 172.21.15.153:0/2917869787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad2c102380 0x7fad18005610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad28005fa0 tx=0x7fad2800f4a0 comp rx=0 tx=0).stop 2024-03-27T07:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.534+0000 7fad346ca700 1 -- 172.21.15.153:0/2917869787 shutdown_connections 2024-03-27T07:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.534+0000 7fad346ca700 1 --2- 172.21.15.153:0/2917869787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad2c102380 0x7fad18005610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.534+0000 7fad346ca700 1 -- 172.21.15.153:0/2917869787 >> 172.21.15.153:0/2917869787 conn(0x7fad2c0fdc10 msgr2=0x7fad2c100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.534+0000 7fad346ca700 1 -- 172.21.15.153:0/2917869787 shutdown_connections 2024-03-27T07:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.534+0000 7fad346ca700 1 -- 172.21.15.153:0/2917869787 wait complete. 2024-03-27T07:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad346ca700 1 Processor -- start 2024-03-27T07:15:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad346ca700 1 -- start start 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad346ca700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c102380 0x7fad2c19d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad346ca700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad2c19ddb0 0x7fad2c197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad346ca700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c10a1b0 con 0x7fad2c19ddb0 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad346ca700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c10a030 con 0x7fad2c102380 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad32466700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c102380 0x7fad2c19d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad31c65700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad2c19ddb0 0x7fad2c197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad32466700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c102380 0x7fad2c19d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40694/0 (socket says 172.21.15.153:40694) 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad32466700 1 -- 172.21.15.153:0/2662988649 learned_addr learned my addr 172.21.15.153:0/2662988649 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad32466700 1 -- 172.21.15.153:0/2662988649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c102380 msgr2=0x7fad2c19d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad32466700 1 -- 172.21.15.153:0/2662988649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c102380 msgr2=0x7fad2c19d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad32466700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c102380 0x7fad2c19d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T07:15:16.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad32466700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c102380 0x7fad2c19d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad31c65700 1 -- 172.21.15.153:0/2662988649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c102380 msgr2=0x7fad2c19d870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad31c65700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c102380 0x7fad2c19d870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.535+0000 7fad31c65700 1 -- 172.21.15.153:0/2662988649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c19e3f0 con 0x7fad2c19ddb0 2024-03-27T07:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.536+0000 7fad31c65700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad2c19ddb0 0x7fad2c197a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00b4d0 tx=0x7fad1c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.536+0000 7fad237fe700 1 -- 172.21.15.153:0/2662988649 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fad1c011630 con 0x7fad2c19ddb0 2024-03-27T07:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.536+0000 7fad237fe700 1 -- 172.21.15.153:0/2662988649 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad1c011cb0 con 0x7fad2c19ddb0 2024-03-27T07:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.536+0000 7fad346ca700 1 -- 172.21.15.153:0/2662988649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2c197f70 con 0x7fad2c19ddb0 2024-03-27T07:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.536+0000 7fad237fe700 1 -- 172.21.15.153:0/2662988649 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fad1c010e60 con 0x7fad2c19ddb0 2024-03-27T07:15:16.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.536+0000 7fad346ca700 1 -- 172.21.15.153:0/2662988649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad2c198500 con 0x7fad2c19ddb0 2024-03-27T07:15:16.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.537+0000 7fad237fe700 1 -- 172.21.15.153:0/2662988649 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7fad1c018020 con 0x7fad2c19ddb0 2024-03-27T07:15:16.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.537+0000 7fad237fe700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fad10039230 0x7fad1003b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:16.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.537+0000 7fad346ca700 1 -- 172.21.15.153:0/2662988649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad2c103860 con 0x7fad2c19ddb0 2024-03-27T07:15:16.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.537+0000 7fad237fe700 1 -- 172.21.15.153:0/2662988649 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fad1c04c030 con 0x7fad2c19ddb0 2024-03-27T07:15:16.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.537+0000 7fad32466700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fad10039230 0x7fad1003b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:16.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.538+0000 7fad32466700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fad10039230 0x7fad1003b6f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fad280059d0 tx=0x7fad280058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:16.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.543+0000 7fad237fe700 1 -- 172.21.15.153:0/2662988649 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fad1c01f020 con 0x7fad2c19ddb0 2024-03-27T07:15:16.771 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:15:16.771 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.771 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: mon.a calling monitor election 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: mon.c calling monitor election 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: monmap epoch 2 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: last_changed 2024-03-27T07:15:11.406973+0000 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: created 2024-03-27T07:13:20.384938+0000 2024-03-27T07:15:16.772 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: min_mon_release 19 (squid) 2024-03-27T07:15:16.773 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: election_strategy: 1 2024-03-27T07:15:16.773 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-03-27T07:15:16.773 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-03-27T07:15:16.773 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: fsmap 2024-03-27T07:15:16.773 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T07:15:16.773 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: mgrmap e13: x(active, since 50s) 2024-03-27T07:15:16.773 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: overall HEALTH_OK 2024-03-27T07:15:16.773 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:16.773 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:16.773 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:16.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.828+0000 7fad346ca700 1 -- 172.21.15.153:0/2662988649 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fad2c198f60 con 0x7fad2c19ddb0 2024-03-27T07:15:16.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.829+0000 7fad237fe700 1 -- 172.21.15.153:0/2662988649 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fad1c037090 con 0x7fad2c19ddb0 2024-03-27T07:15:16.830 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:15:16.830 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","modified":"2024-03-27T07:15:11.406973Z","created":"2024-03-27T07:13:20.384938Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-27T07:15:16.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 -- 172.21.15.153:0/2662988649 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fad10039230 msgr2=0x7fad1003b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:16.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fad10039230 0x7fad1003b6f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fad280059d0 tx=0x7fad280058e0 comp rx=0 tx=0).stop 2024-03-27T07:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 -- 172.21.15.153:0/2662988649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad2c19ddb0 msgr2=0x7fad2c197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad2c19ddb0 0x7fad2c197a30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00b4d0 tx=0x7fad1c00b890 comp rx=0 tx=0).stop 2024-03-27T07:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 -- 172.21.15.153:0/2662988649 shutdown_connections 2024-03-27T07:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fad10039230 0x7fad1003b6f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad2c102380 0x7fad2c19d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 --2- 172.21.15.153:0/2662988649 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fad2c19ddb0 0x7fad2c197a30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 -- 172.21.15.153:0/2662988649 >> 172.21.15.153:0/2662988649 conn(0x7fad2c0fdc10 msgr2=0x7fad2c108780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 -- 172.21.15.153:0/2662988649 shutdown_connections 2024-03-27T07:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:16.831+0000 7fad346ca700 1 -- 172.21.15.153:0/2662988649 wait complete. 2024-03-27T07:15:16.833 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 2 2024-03-27T07:15:16.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:15:16.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: mon.a calling monitor election 2024-03-27T07:15:16.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:16.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: mon.c calling monitor election 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: monmap epoch 2 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: last_changed 2024-03-27T07:15:11.406973+0000 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: created 2024-03-27T07:13:20.384938+0000 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: min_mon_release 19 (squid) 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: election_strategy: 1 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-03-27T07:15:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-03-27T07:15:16.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: fsmap 2024-03-27T07:15:16.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T07:15:16.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: mgrmap e13: x(active, since 50s) 2024-03-27T07:15:16.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: overall HEALTH_OK 2024-03-27T07:15:16.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:16.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:16.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:17.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:17 smithi153 ceph-mon[36179]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:17.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:17.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:17.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:17 smithi153 ceph-mon[36179]: Deploying daemon mon.b on smithi149 2024-03-27T07:15:17.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:17 smithi153 ceph-mon[36179]: from='client.? 172.21.15.153:0/2662988649' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T07:15:17.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:17 smithi082 ceph-mon[32178]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:17 smithi082 ceph-mon[32178]: Deploying daemon mon.b on smithi149 2024-03-27T07:15:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:17 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/2662988649' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T07:15:17.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:18.436 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-27T07:15:18.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-27T07:15:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:15:19.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:19 smithi153 ceph-mon[36179]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:19.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:19 smithi082 ceph-mon[32178]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:20.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.178+0000 7f1d426f6700 1 -- 172.21.15.153:0/952997830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d3c1081e0 msgr2=0x7f1d3c1085c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:20.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.178+0000 7f1d426f6700 1 --2- 172.21.15.153:0/952997830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d3c1081e0 0x7f1d3c1085c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009910 tx=0x7f1d2c009c20 comp rx=0 tx=0).stop 2024-03-27T07:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.178+0000 7f1d426f6700 1 -- 172.21.15.153:0/952997830 shutdown_connections 2024-03-27T07:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.178+0000 7f1d426f6700 1 --2- 172.21.15.153:0/952997830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d3c1081e0 0x7f1d3c1085c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.178+0000 7f1d426f6700 1 -- 172.21.15.153:0/952997830 >> 172.21.15.153:0/952997830 conn(0x7f1d3c077730 msgr2=0x7f1d3c077b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.178+0000 7f1d426f6700 1 -- 172.21.15.153:0/952997830 shutdown_connections 2024-03-27T07:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.178+0000 7f1d426f6700 1 -- 172.21.15.153:0/952997830 wait complete. 2024-03-27T07:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.178+0000 7f1d426f6700 1 Processor -- start 2024-03-27T07:15:20.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.178+0000 7f1d426f6700 1 -- start start 2024-03-27T07:15:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d426f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d3c1081e0 0x7f1d3c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d426f6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d3c198310 0x7f1d3c19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d426f6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c10c770 con 0x7f1d3c198310 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d426f6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c10c5f0 con 0x7f1d3c1081e0 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d3c1081e0 0x7f1d3c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d3c1081e0 0x7f1d3c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40702/0 (socket says 172.21.15.153:40702) 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3bfff700 1 -- 172.21.15.153:0/1358739070 learned_addr learned my addr 172.21.15.153:0/1358739070 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3b7fe700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d3c198310 0x7f1d3c19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3bfff700 1 -- 172.21.15.153:0/1358739070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d3c1081e0 msgr2=0x7f1d3c197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3bfff700 1 -- 172.21.15.153:0/1358739070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d3c1081e0 msgr2=0x7f1d3c197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3bfff700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d3c1081e0 0x7f1d3c197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T07:15:20.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3bfff700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d3c1081e0 0x7f1d3c197dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:15:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3b7fe700 1 -- 172.21.15.153:0/1358739070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d3c1081e0 msgr2=0x7f1d3c197dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:15:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3b7fe700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d3c1081e0 0x7f1d3c197dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.179+0000 7f1d3b7fe700 1 -- 172.21.15.153:0/1358739070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c198950 con 0x7f1d3c198310 2024-03-27T07:15:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.180+0000 7f1d3b7fe700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d3c198310 0x7f1d3c19c650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400b4d0 tx=0x7f1d2400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.180+0000 7f1d397fa700 1 -- 172.21.15.153:0/1358739070 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1d24011630 con 0x7f1d3c198310 2024-03-27T07:15:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.180+0000 7f1d397fa700 1 -- 172.21.15.153:0/1358739070 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d24011cb0 con 0x7f1d3c198310 2024-03-27T07:15:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.180+0000 7f1d426f6700 1 -- 172.21.15.153:0/1358739070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3c19cb90 con 0x7f1d3c198310 2024-03-27T07:15:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.180+0000 7f1d397fa700 1 -- 172.21.15.153:0/1358739070 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f1d24010e60 con 0x7f1d3c198310 2024-03-27T07:15:20.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.180+0000 7f1d426f6700 1 -- 172.21.15.153:0/1358739070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3c19d0f0 con 0x7f1d3c198310 2024-03-27T07:15:20.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.181+0000 7f1d426f6700 1 -- 172.21.15.153:0/1358739070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3c06a580 con 0x7f1d3c198310 2024-03-27T07:15:20.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.181+0000 7f1d397fa700 1 -- 172.21.15.153:0/1358739070 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f1d24018020 con 0x7f1d3c198310 2024-03-27T07:15:20.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.181+0000 7f1d397fa700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d280391c0 0x7f1d2803b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:20.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.181+0000 7f1d397fa700 1 -- 172.21.15.153:0/1358739070 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1d2404bfd0 con 0x7f1d3c198310 2024-03-27T07:15:20.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.181+0000 7f1d3bfff700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d280391c0 0x7f1d2803b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:20.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.182+0000 7f1d3bfff700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d280391c0 0x7f1d2803b680 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c000c00 tx=0x7f1d2c00b580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:20.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.187+0000 7f1d397fa700 1 -- 172.21.15.153:0/1358739070 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1d2401f020 con 0x7f1d3c198310 2024-03-27T07:15:20.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.462+0000 7f1d426f6700 1 -- 172.21.15.153:0/1358739070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1d3c19d400 con 0x7f1d3c198310 2024-03-27T07:15:20.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.463+0000 7f1d397fa700 1 -- 172.21.15.153:0/1358739070 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f1d2400fe40 con 0x7f1d3c198310 2024-03-27T07:15:20.464 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:15:20.464 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","modified":"2024-03-27T07:15:11.406973Z","created":"2024-03-27T07:13:20.384938Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-27T07:15:20.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.465+0000 7f1d426f6700 1 -- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d280391c0 msgr2=0x7f1d2803b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.465+0000 7f1d426f6700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d280391c0 0x7f1d2803b680 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c000c00 tx=0x7f1d2c00b580 comp rx=0 tx=0).stop 2024-03-27T07:15:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.465+0000 7f1d426f6700 1 -- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d3c198310 msgr2=0x7f1d3c19c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.465+0000 7f1d426f6700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d3c198310 0x7f1d3c19c650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400b4d0 tx=0x7f1d2400b890 comp rx=0 tx=0).stop 2024-03-27T07:15:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.465+0000 7f1d426f6700 1 -- 172.21.15.153:0/1358739070 shutdown_connections 2024-03-27T07:15:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.465+0000 7f1d426f6700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d280391c0 0x7f1d2803b680 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.465+0000 7f1d426f6700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d3c1081e0 0x7f1d3c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.465+0000 7f1d426f6700 1 --2- 172.21.15.153:0/1358739070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d3c198310 0x7f1d3c19c650 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.465+0000 7f1d426f6700 1 -- 172.21.15.153:0/1358739070 >> 172.21.15.153:0/1358739070 conn(0x7f1d3c077730 msgr2=0x7f1d3c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.466+0000 7f1d426f6700 1 -- 172.21.15.153:0/1358739070 shutdown_connections 2024-03-27T07:15:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:20.466+0000 7f1d426f6700 1 -- 172.21.15.153:0/1358739070 wait complete. 2024-03-27T07:15:20.468 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 2 2024-03-27T07:15:20.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:20 smithi153 ceph-mon[36179]: from='client.? 172.21.15.153:0/1358739070' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T07:15:20.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:20 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/1358739070' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T07:15:21.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:20 smithi149 systemd[1]: Started Ceph mon.b for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:15:22.058 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-27T07:15:22.059 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-27T07:15:22.302 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:15:26.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:15:26.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: mon.c calling monitor election 2024-03-27T07:15:26.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: mon.a calling monitor election 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: monmap epoch 3 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: last_changed 2024-03-27T07:15:20.605334+0000 2024-03-27T07:15:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: created 2024-03-27T07:13:20.384938+0000 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: min_mon_release 19 (squid) 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: election_strategy: 1 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: 2: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: fsmap 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: mgrmap e13: x(active, since 59s) 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: overall HEALTH_OK 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:15:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: mon.c calling monitor election 2024-03-27T07:15:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: mon.a calling monitor election 2024-03-27T07:15:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: monmap epoch 3 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: last_changed 2024-03-27T07:15:20.605334+0000 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: created 2024-03-27T07:13:20.384938+0000 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: min_mon_release 19 (squid) 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: election_strategy: 1 2024-03-27T07:15:26.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-03-27T07:15:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-03-27T07:15:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: 2: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-03-27T07:15:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: fsmap 2024-03-27T07:15:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T07:15:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: mgrmap e13: x(active, since 59s) 2024-03-27T07:15:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: overall HEALTH_OK 2024-03-27T07:15:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:26.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:26.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.806+0000 7fdf0a09a700 1 -- 172.21.15.153:0/1753586108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00035c0 msgr2=0x7fdef0005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:26.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.806+0000 7fdf0a09a700 1 --2- 172.21.15.153:0/1753586108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00035c0 0x7fdef0005a50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf040798d0 tx=0x7fdef400feb0 comp rx=0 tx=0).stop 2024-03-27T07:15:26.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.806+0000 7fdf0a09a700 1 -- 172.21.15.153:0/1753586108 shutdown_connections 2024-03-27T07:15:26.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.806+0000 7fdf0a09a700 1 --2- 172.21.15.153:0/1753586108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00035c0 0x7fdef0005a50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:26.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.806+0000 7fdf0a09a700 1 -- 172.21.15.153:0/1753586108 >> 172.21.15.153:0/1753586108 conn(0x7fdf04077600 msgr2=0x7fdf04077a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:26.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.806+0000 7fdf0a09a700 1 -- 172.21.15.153:0/1753586108 shutdown_connections 2024-03-27T07:15:26.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.806+0000 7fdf0a09a700 1 -- 172.21.15.153:0/1753586108 wait complete. 2024-03-27T07:15:26.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.807+0000 7fdf0a09a700 1 Processor -- start 2024-03-27T07:15:26.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.807+0000 7fdf0a09a700 1 -- start start 2024-03-27T07:15:26.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf0a09a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00035c0 0x7fdf0419a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:26.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf0a09a700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0419a570 0x7fdf0419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:26.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf0a09a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf0419ee40 0x7fdf0419f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:26.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf0a09a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0410a160 con 0x7fdef00035c0 2024-03-27T07:15:26.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf0a09a700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdf04109fe0 con 0x7fdf0419a570 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf0a09a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0410a2e0 con 0x7fdf0419ee40 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf03fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf0419ee40 0x7fdf0419f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf03fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf0419ee40 0x7fdf0419f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57964/0 (socket says 172.21.15.153:57964) 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf037fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00035c0 0x7fdf0419a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf03fff700 1 -- 172.21.15.153:0/4005611855 learned_addr learned my addr 172.21.15.153:0/4005611855 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdefaffd700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0419a570 0x7fdf0419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf037fe700 1 -- 172.21.15.153:0/4005611855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf0419ee40 msgr2=0x7fdf0419f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf037fe700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf0419ee40 0x7fdf0419f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf037fe700 1 -- 172.21.15.153:0/4005611855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0419a570 msgr2=0x7fdf0419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf037fe700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0419a570 0x7fdf0419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf037fe700 1 -- 172.21.15.153:0/4005611855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf041a6bb0 con 0x7fdef00035c0 2024-03-27T07:15:26.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdefaffd700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0419a570 0x7fdf0419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:15:26.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf03fff700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf0419ee40 0x7fdf0419f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:15:26.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.808+0000 7fdf037fe700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00035c0 0x7fdf0419a030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdef4010010 tx=0x7fdef40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:26.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.809+0000 7fdf017fa700 1 -- 172.21.15.153:0/4005611855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4013960 con 0x7fdef00035c0 2024-03-27T07:15:26.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.809+0000 7fdf017fa700 1 -- 172.21.15.153:0/4005611855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdef4011940 con 0x7fdef00035c0 2024-03-27T07:15:26.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.809+0000 7fdf0a09a700 1 -- 172.21.15.153:0/4005611855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf041a6d80 con 0x7fdef00035c0 2024-03-27T07:15:26.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.809+0000 7fdf017fa700 1 -- 172.21.15.153:0/4005611855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4003d10 con 0x7fdef00035c0 2024-03-27T07:15:26.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.809+0000 7fdf0a09a700 1 -- 172.21.15.153:0/4005611855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf041a7200 con 0x7fdef00035c0 2024-03-27T07:15:26.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.810+0000 7fdf017fa700 1 -- 172.21.15.153:0/4005611855 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7fdef4023070 con 0x7fdef00035c0 2024-03-27T07:15:26.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.810+0000 7fdf0a09a700 1 -- 172.21.15.153:0/4005611855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf04063c70 con 0x7fdef00035c0 2024-03-27T07:15:26.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.810+0000 7fdf017fa700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdee4039900 0x7fdee403bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:26.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.810+0000 7fdf017fa700 1 -- 172.21.15.153:0/4005611855 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdef404e9d0 con 0x7fdef00035c0 2024-03-27T07:15:26.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.810+0000 7fdefaffd700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdee4039900 0x7fdee403bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:26.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.810+0000 7fdefaffd700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdee4039900 0x7fdee403bdc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0079b0 tx=0x7fdeec008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:26.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:26.815+0000 7fdf017fa700 1 -- 172.21.15.153:0/4005611855 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fdef4028020 con 0x7fdef00035c0 2024-03-27T07:15:27.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:27.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:26 smithi153 ceph-mon[36179]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:27.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:27.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:27.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.101+0000 7fdf0a09a700 1 -- 172.21.15.153:0/4005611855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fdf0402dd30 con 0x7fdef00035c0 2024-03-27T07:15:27.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.102+0000 7fdf017fa700 1 -- 172.21.15.153:0/4005611855 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7fdef4011df0 con 0x7fdef00035c0 2024-03-27T07:15:27.103 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-03-27T07:15:27.103 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":3,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","modified":"2024-03-27T07:15:20.605334Z","created":"2024-03-27T07:13:20.384938Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:3300","nonce":0},{"type":"v1","addr":"172.21.15.149:6789","nonce":0}]},"addr":"172.21.15.149:6789/0","public_addr":"172.21.15.149:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-27T07:15:27.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 -- 172.21.15.153:0/4005611855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdee4039900 msgr2=0x7fdee403bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:27.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdee4039900 0x7fdee403bdc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0079b0 tx=0x7fdeec008040 comp rx=0 tx=0).stop 2024-03-27T07:15:27.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 -- 172.21.15.153:0/4005611855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00035c0 msgr2=0x7fdf0419a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:27.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00035c0 0x7fdf0419a030 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdef4010010 tx=0x7fdef40057f0 comp rx=0 tx=0).stop 2024-03-27T07:15:27.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 -- 172.21.15.153:0/4005611855 shutdown_connections 2024-03-27T07:15:27.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdee4039900 0x7fdee403bdc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:27.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf0419ee40 0x7fdf0419f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:27.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdef00035c0 0x7fdf0419a030 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:27.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 --2- 172.21.15.153:0/4005611855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdf0419a570 0x7fdf0419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:27.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 -- 172.21.15.153:0/4005611855 >> 172.21.15.153:0/4005611855 conn(0x7fdf04077600 msgr2=0x7fdf04101ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:27.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 -- 172.21.15.153:0/4005611855 shutdown_connections 2024-03-27T07:15:27.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:27.104+0000 7fdf0a09a700 1 -- 172.21.15.153:0/4005611855 wait complete. 2024-03-27T07:15:27.107 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 3 2024-03-27T07:15:27.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:27.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:26 smithi082 ceph-mon[32178]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:27.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:27.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:27.798 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-27T07:15:27.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph config generate-minimal-conf 2024-03-27T07:15:28.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:15:28.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: mon.c calling monitor election 2024-03-27T07:15:28.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: mon.a calling monitor election 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: monmap epoch 3 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: last_changed 2024-03-27T07:15:20.605334+0000 2024-03-27T07:15:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: created 2024-03-27T07:13:20.384938+0000 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: min_mon_release 19 (squid) 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: election_strategy: 1 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: 2: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: fsmap 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: mgrmap e13: x(active, since 59s) 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: overall HEALTH_OK 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:28.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:28.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:28.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:28.040 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:15:28.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: mon.b calling monitor election 2024-03-27T07:15:28.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: mon.b calling monitor election 2024-03-27T07:15:28.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: mon.c calling monitor election 2024-03-27T07:15:28.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: mon.a calling monitor election 2024-03-27T07:15:28.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-27T07:15:28.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: monmap epoch 3 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: last_changed 2024-03-27T07:15:20.605334+0000 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: created 2024-03-27T07:13:20.384938+0000 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: min_mon_release 19 (squid) 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: election_strategy: 1 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: 2: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: fsmap 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: mgrmap e13: x(active, since 61s) 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: overall HEALTH_OK 2024-03-27T07:15:28.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:28.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:28.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:28.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:28.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: Reconfiguring mon.a (unknown last config time)... 2024-03-27T07:15:28.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:28.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T07:15:28.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:28.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: Reconfiguring daemon mon.a on smithi082 2024-03-27T07:15:28.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:28 smithi082 ceph-mon[32178]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:29.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: mon.b calling monitor election 2024-03-27T07:15:29.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: mon.b calling monitor election 2024-03-27T07:15:29.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: mon.c calling monitor election 2024-03-27T07:15:29.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: mon.a calling monitor election 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: monmap epoch 3 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: last_changed 2024-03-27T07:15:20.605334+0000 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: created 2024-03-27T07:13:20.384938+0000 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: min_mon_release 19 (squid) 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: election_strategy: 1 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: 2: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: fsmap 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: mgrmap e13: x(active, since 61s) 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: overall HEALTH_OK 2024-03-27T07:15:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:29.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:29.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:29.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:29.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: Reconfiguring mon.a (unknown last config time)... 2024-03-27T07:15:29.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:29.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T07:15:29.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:29.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: Reconfiguring daemon mon.a on smithi082 2024-03-27T07:15:29.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:28 smithi149 ceph-mon[36065]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:29.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: mon.b calling monitor election 2024-03-27T07:15:29.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: mon.b calling monitor election 2024-03-27T07:15:29.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: mon.c calling monitor election 2024-03-27T07:15:29.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: mon.a calling monitor election 2024-03-27T07:15:29.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: monmap epoch 3 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: last_changed 2024-03-27T07:15:20.605334+0000 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: created 2024-03-27T07:13:20.384938+0000 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: min_mon_release 19 (squid) 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: election_strategy: 1 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.c 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: 2: [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] mon.b 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: fsmap 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: mgrmap e13: x(active, since 61s) 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: overall HEALTH_OK 2024-03-27T07:15:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:29.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:29.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:29.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:29.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: Reconfiguring mon.a (unknown last config time)... 2024-03-27T07:15:29.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:29.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T07:15:29.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:29.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: Reconfiguring daemon mon.a on smithi082 2024-03-27T07:15:29.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:28 smithi153 ceph-mon[36179]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:29.867 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:30.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:15:30.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.534+0000 7f0239279700 1 -- 172.21.15.82:0/3337559325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234103050 msgr2=0x7f023410f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.534+0000 7f0239279700 1 --2- 172.21.15.82:0/3337559325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234103050 0x7f023410f490 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f022c00b0d0 tx=0x7f022c00b3e0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.534+0000 7f0239279700 1 -- 172.21.15.82:0/3337559325 shutdown_connections 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.534+0000 7f0239279700 1 --2- 172.21.15.82:0/3337559325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234103050 0x7f023410f490 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.534+0000 7f0239279700 1 --2- 172.21.15.82:0/3337559325 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0234108670 0x7f0234108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.534+0000 7f0239279700 1 --2- 172.21.15.82:0/3337559325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0234102690 0x7f0234102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.534+0000 7f0239279700 1 -- 172.21.15.82:0/3337559325 >> 172.21.15.82:0/3337559325 conn(0x7f0234079770 msgr2=0x7f0234079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.534+0000 7f0239279700 1 -- 172.21.15.82:0/3337559325 shutdown_connections 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.534+0000 7f0239279700 1 -- 172.21.15.82:0/3337559325 wait complete. 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f0239279700 1 Processor -- start 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f0239279700 1 -- start start 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f0239279700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0234102690 0x7f0234198f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:30.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f0239279700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234103050 0x7f0234199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f0239279700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0234108670 0x7f023419d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f0239279700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0234112a40 con 0x7f0234103050 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f0239279700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02341128c0 con 0x7f0234102690 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f0239279700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0234112bc0 con 0x7f0234108670 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f02327fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234103050 0x7f0234199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f02327fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234103050 0x7f0234199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60996/0 (socket says 172.21.15.82:60996) 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f02327fc700 1 -- 172.21.15.82:0/1289460799 learned_addr learned my addr 172.21.15.82:0/1289460799 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f02337fe700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0234108670 0x7f023419d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f02327fc700 1 -- 172.21.15.82:0/1289460799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0234108670 msgr2=0x7f023419d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f02327fc700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0234108670 0x7f023419d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f02327fc700 1 -- 172.21.15.82:0/1289460799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0234102690 msgr2=0x7f0234198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f02327fc700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0234102690 0x7f0234198f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f02327fc700 1 -- 172.21.15.82:0/1289460799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023419df20 con 0x7f0234103050 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.535+0000 7f02337fe700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0234108670 0x7f023419d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.536+0000 7f02327fc700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234103050 0x7f0234199450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f022800b530 tx=0x7f022800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.536+0000 7f021bfff700 1 -- 172.21.15.82:0/1289460799 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228015020 con 0x7f0234103050 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.536+0000 7f021bfff700 1 -- 172.21.15.82:0/1289460799 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0228011d10 con 0x7f0234103050 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.536+0000 7f0239279700 1 -- 172.21.15.82:0/1289460799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023419e210 con 0x7f0234103050 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.536+0000 7f021bfff700 1 -- 172.21.15.82:0/1289460799 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228010e50 con 0x7f0234103050 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.536+0000 7f0239279700 1 -- 172.21.15.82:0/1289460799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02341a5a90 con 0x7f0234103050 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.537+0000 7f021bfff700 1 -- 172.21.15.82:0/1289460799 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f0228018020 con 0x7f0234103050 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.537+0000 7f021bfff700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f021c039850 0x7f021c03bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.537+0000 7f0239279700 1 -- 172.21.15.82:0/1289460799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0234069300 con 0x7f0234103050 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.537+0000 7f021bfff700 1 -- 172.21.15.82:0/1289460799 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f022804c010 con 0x7f0234103050 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.537+0000 7f0232ffd700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f021c039850 0x7f021c03bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:30.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.537+0000 7f0232ffd700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f021c039850 0x7f021c03bd10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f02240097b0 tx=0x7f0224006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:30.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.542+0000 7f021bfff700 1 -- 172.21.15.82:0/1289460799 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f022801f020 con 0x7f0234103050 2024-03-27T07:15:30.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.742+0000 7f0239279700 1 -- 172.21.15.82:0/1289460799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f023402dd30 con 0x7f0234103050 2024-03-27T07:15:30.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.743+0000 7f021bfff700 1 -- 172.21.15.82:0/1289460799 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f0228018310 con 0x7f0234103050 2024-03-27T07:15:30.744 INFO:teuthology.orchestra.run.smithi082.stdout:# minimal ceph.conf for 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:15:30.744 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-03-27T07:15:30.744 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:15:30.744 INFO:teuthology.orchestra.run.smithi082.stdout: mon_host = [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-03-27T07:15:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 -- 172.21.15.82:0/1289460799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f021c039850 msgr2=0x7f021c03bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f021c039850 0x7f021c03bd10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f02240097b0 tx=0x7f0224006d20 comp rx=0 tx=0).stop 2024-03-27T07:15:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 -- 172.21.15.82:0/1289460799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234103050 msgr2=0x7f0234199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234103050 0x7f0234199450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f022800b530 tx=0x7f022800b8f0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 -- 172.21.15.82:0/1289460799 shutdown_connections 2024-03-27T07:15:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f021c039850 0x7f021c03bd10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0234108670 0x7f023419d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0234102690 0x7f0234198f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 --2- 172.21.15.82:0/1289460799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0234103050 0x7f0234199450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:30.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 -- 172.21.15.82:0/1289460799 >> 172.21.15.82:0/1289460799 conn(0x7f0234079770 msgr2=0x7f02341014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:30.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 -- 172.21.15.82:0/1289460799 shutdown_connections 2024-03-27T07:15:30.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:30.745+0000 7f0239279700 1 -- 172.21.15.82:0/1289460799 wait complete. 2024-03-27T07:15:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:30 smithi082 ceph-mon[32178]: Reconfiguring mon.b (monmap changed)... 2024-03-27T07:15:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T07:15:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:30 smithi082 ceph-mon[32178]: Reconfiguring daemon mon.b on smithi149 2024-03-27T07:15:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:30 smithi082 ceph-mon[32178]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:31.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:31.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:31.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:30 smithi149 ceph-mon[36065]: Reconfiguring mon.b (monmap changed)... 2024-03-27T07:15:31.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:31.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T07:15:31.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:31.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:30 smithi149 ceph-mon[36065]: Reconfiguring daemon mon.b on smithi149 2024-03-27T07:15:31.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:30 smithi149 ceph-mon[36065]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:31.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:31.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:31.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:30 smithi153 ceph-mon[36179]: Reconfiguring mon.b (monmap changed)... 2024-03-27T07:15:31.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:31.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T07:15:31.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:31.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:30 smithi153 ceph-mon[36179]: Reconfiguring daemon mon.b on smithi149 2024-03-27T07:15:31.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:30 smithi153 ceph-mon[36179]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:31.299 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-27T07:15:31.300 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:15:31.300 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-03-27T07:15:31.331 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:15:31.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:15:31.398 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:15:31.398 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.conf 2024-03-27T07:15:31.428 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:15:31.428 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:15:31.496 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:15:31.496 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.conf 2024-03-27T07:15:31.526 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:15:31.526 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:15:31.595 INFO:tasks.cephadm:Adding mgr.x on smithi082 2024-03-27T07:15:31.595 INFO:tasks.cephadm:Adding mgr.y on smithi149 2024-03-27T07:15:31.595 INFO:tasks.cephadm:Adding mgr.z on smithi153 2024-03-27T07:15:31.595 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch apply mgr '3;smithi082=x;smithi149=y;smithi153=z' 2024-03-27T07:15:31.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:31 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1289460799' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:31.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:31.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:31.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:31 smithi153 ceph-mon[36179]: Reconfiguring mon.c (monmap changed)... 2024-03-27T07:15:31.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:31.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T07:15:31.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:31.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:31 smithi153 ceph-mon[36179]: Reconfiguring daemon mon.c on smithi153 2024-03-27T07:15:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:31 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1289460799' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:31 smithi082 ceph-mon[32178]: Reconfiguring mon.c (monmap changed)... 2024-03-27T07:15:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T07:15:31.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:31.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:31 smithi082 ceph-mon[32178]: Reconfiguring daemon mon.c on smithi153 2024-03-27T07:15:31.986 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:15:32.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:31 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1289460799' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:32.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:32.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:32.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:31 smithi149 ceph-mon[36065]: Reconfiguring mon.c (monmap changed)... 2024-03-27T07:15:32.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T07:15:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T07:15:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:31 smithi149 ceph-mon[36065]: Reconfiguring daemon mon.c on smithi153 2024-03-27T07:15:32.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:32 smithi082 ceph-mon[32178]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:33.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:32 smithi149 ceph-mon[36065]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:33.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:32 smithi153 ceph-mon[36179]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:34.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.315+0000 7f68e08c7700 1 -- 172.21.15.153:0/2898613514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68dc1083b0 msgr2=0x7f68dc10a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:34.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.315+0000 7f68e08c7700 1 --2- 172.21.15.153:0/2898613514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68dc1083b0 0x7f68dc10a7c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f68d400b0a0 tx=0x7f68d400b3b0 comp rx=0 tx=0).stop 2024-03-27T07:15:34.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.315+0000 7f68e08c7700 1 -- 172.21.15.153:0/2898613514 shutdown_connections 2024-03-27T07:15:34.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.315+0000 7f68e08c7700 1 --2- 172.21.15.153:0/2898613514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68dc1083b0 0x7f68dc10a7c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:34.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.315+0000 7f68e08c7700 1 --2- 172.21.15.153:0/2898613514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68dc103150 0x7f68dc105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:34.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.315+0000 7f68e08c7700 1 --2- 172.21.15.153:0/2898613514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68dc105a80 0x7f68dc107e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.315+0000 7f68e08c7700 1 -- 172.21.15.153:0/2898613514 >> 172.21.15.153:0/2898613514 conn(0x7f68dc0fcb00 msgr2=0x7f68dc0fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.315+0000 7f68e08c7700 1 -- 172.21.15.153:0/2898613514 shutdown_connections 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.315+0000 7f68e08c7700 1 -- 172.21.15.153:0/2898613514 wait complete. 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.316+0000 7f68e08c7700 1 Processor -- start 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.316+0000 7f68e08c7700 1 -- start start 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.316+0000 7f68e08c7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68dc103150 0x7f68dc102a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.316+0000 7f68e08c7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68dc105a80 0x7f68dc101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.316+0000 7f68e08c7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68dc1083b0 0x7f68dc101640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.316+0000 7f68e08c7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc10e360 con 0x7f68dc103150 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.316+0000 7f68e08c7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc10e1e0 con 0x7f68dc1083b0 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.316+0000 7f68e08c7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68dc10e4e0 con 0x7f68dc105a80 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.316+0000 7f68d9d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68dc105a80 0x7f68dc101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68d9d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68dc105a80 0x7f68dc101100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57978/0 (socket says 172.21.15.153:57978) 2024-03-27T07:15:34.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68d9d9b700 1 -- 172.21.15.153:0/2308893474 learned_addr learned my addr 172.21.15.153:0/2308893474 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68da59c700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68dc103150 0x7f68dc102a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68dad9d700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68dc1083b0 0x7f68dc101640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68d9d9b700 1 -- 172.21.15.153:0/2308893474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68dc1083b0 msgr2=0x7f68dc101640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68d9d9b700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68dc1083b0 0x7f68dc101640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68d9d9b700 1 -- 172.21.15.153:0/2308893474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68dc103150 msgr2=0x7f68dc102a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68d9d9b700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68dc103150 0x7f68dc102a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68d9d9b700 1 -- 172.21.15.153:0/2308893474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68dc101e80 con 0x7f68dc105a80 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68dad9d700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68dc1083b0 0x7f68dc101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68d9d9b700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68dc105a80 0x7f68dc101100 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f68d000b530 tx=0x7f68d000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68cb7fe700 1 -- 172.21.15.153:0/2308893474 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0015020 con 0x7f68dc105a80 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68e08c7700 1 -- 172.21.15.153:0/2308893474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68dc1a2a70 con 0x7f68dc105a80 2024-03-27T07:15:34.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68cb7fe700 1 -- 172.21.15.153:0/2308893474 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68d0011d10 con 0x7f68dc105a80 2024-03-27T07:15:34.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68cb7fe700 1 -- 172.21.15.153:0/2308893474 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d000f2e0 con 0x7f68dc105a80 2024-03-27T07:15:34.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.317+0000 7f68e08c7700 1 -- 172.21.15.153:0/2308893474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68dc1a3000 con 0x7f68dc105a80 2024-03-27T07:15:34.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.318+0000 7f68cb7fe700 1 -- 172.21.15.153:0/2308893474 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7f68d0018020 con 0x7f68dc105a80 2024-03-27T07:15:34.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.318+0000 7f68e08c7700 1 -- 172.21.15.153:0/2308893474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68dc069300 con 0x7f68dc105a80 2024-03-27T07:15:34.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.319+0000 7f68cb7fe700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f68c40396b0 0x7f68c403bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:34.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.319+0000 7f68cb7fe700 1 -- 172.21.15.153:0/2308893474 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f68d004c240 con 0x7f68dc105a80 2024-03-27T07:15:34.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.319+0000 7f68da59c700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f68c40396b0 0x7f68c403bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:34.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.319+0000 7f68da59c700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f68c40396b0 0x7f68c403bb70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009a10 tx=0x7f68cc009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:34.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.324+0000 7f68cb7fe700 1 -- 172.21.15.153:0/2308893474 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f68d001f020 con 0x7f68dc105a80 2024-03-27T07:15:34.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.533+0000 7f68e08c7700 1 -- 172.21.15.153:0/2308893474 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi149=y;smithi153=z", "target": ["mon-mgr", ""]}) -- 0x7f68dc062a80 con 0x7f68c40396b0 2024-03-27T07:15:34.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.539+0000 7f68cb7fe700 1 -- 172.21.15.153:0/2308893474 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f68dc062a80 con 0x7f68c40396b0 2024-03-27T07:15:34.539 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mgr update... 2024-03-27T07:15:34.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 -- 172.21.15.153:0/2308893474 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f68c40396b0 msgr2=0x7f68c403bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:34.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f68c40396b0 0x7f68c403bb70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f68cc009a10 tx=0x7f68cc009190 comp rx=0 tx=0).stop 2024-03-27T07:15:34.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 -- 172.21.15.153:0/2308893474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68dc105a80 msgr2=0x7f68dc101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:34.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68dc105a80 0x7f68dc101100 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f68d000b530 tx=0x7f68d000b840 comp rx=0 tx=0).stop 2024-03-27T07:15:34.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 -- 172.21.15.153:0/2308893474 shutdown_connections 2024-03-27T07:15:34.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f68c40396b0 0x7f68c403bb70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:34.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68dc1083b0 0x7f68dc101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:34.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68dc103150 0x7f68dc102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:34.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 --2- 172.21.15.153:0/2308893474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68dc105a80 0x7f68dc101100 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:34.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 -- 172.21.15.153:0/2308893474 >> 172.21.15.153:0/2308893474 conn(0x7f68dc0fcb00 msgr2=0x7f68dc103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:34.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 -- 172.21.15.153:0/2308893474 shutdown_connections 2024-03-27T07:15:34.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:15:34.541+0000 7f68e08c7700 1 -- 172.21.15.153:0/2308893474 wait complete. 2024-03-27T07:15:34.739 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:34 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:34.739 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:34 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:34.739 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:34 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:34.739 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:34 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:34.740 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:34 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:34.740 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:34 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:34.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:34 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:34.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:34 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:34.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:34 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:34.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:34 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:34.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:34 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:34.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:34 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:34.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:34.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:34.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:34.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:34.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:34.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:35.130 DEBUG:teuthology.orchestra.run.smithi149:mgr.y> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.y.service 2024-03-27T07:15:35.133 DEBUG:teuthology.orchestra.run.smithi153:mgr.z> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.z.service 2024-03-27T07:15:35.135 INFO:tasks.cephadm:Deploying OSDs... 2024-03-27T07:15:35.135 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:15:35.135 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-03-27T07:15:35.154 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-27T07:15:35.155 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-03-27T07:15:35.212 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-27T07:15:35.212 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:35.212 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-03-27T07:15:35.212 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:35.212 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:35.213 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-03-27 07:14:38.345694293 +0000 2024-03-27T07:15:35.213 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-03-27 07:09:43.446446878 +0000 2024-03-27T07:15:35.213 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-03-27 07:09:43.446446878 +0000 2024-03-27T07:15:35.213 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-03-27 07:09:43.446446878 +0000 2024-03-27T07:15:35.213 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-27T07:15:35.283 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-03-27T07:15:35.283 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-03-27T07:15:35.283 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000231476 s, 2.2 MB/s 2024-03-27T07:15:35.285 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-27T07:15:35.342 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-03-27T07:15:35.399 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-27T07:15:35.399 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:35.400 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-27T07:15:35.400 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:35.400 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:35.400 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-03-27 07:14:38.381693592 +0000 2024-03-27T07:15:35.400 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-03-27 07:09:43.780440317 +0000 2024-03-27T07:15:35.400 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-03-27 07:09:43.780440317 +0000 2024-03-27T07:15:35.400 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-03-27 07:09:43.780440317 +0000 2024-03-27T07:15:35.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-27T07:15:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-03-27T07:15:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-03-27T07:15:35.468 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000243831 s, 2.1 MB/s 2024-03-27T07:15:35.471 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-27T07:15:35.528 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-03-27T07:15:35.584 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-27T07:15:35.584 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:35.585 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-03-27T07:15:35.585 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:35.585 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:35.585 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-03-27 07:14:38.412692988 +0000 2024-03-27T07:15:35.585 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-03-27 07:09:44.132433403 +0000 2024-03-27T07:15:35.585 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-03-27 07:09:44.132433403 +0000 2024-03-27T07:15:35.585 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-03-27 07:09:44.132433403 +0000 2024-03-27T07:15:35.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-27T07:15:35.586 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:35.586 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi149=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:15:35.586 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: Saving service mgr spec with placement smithi082=x;smithi149=y;smithi153=z;count:3 2024-03-27T07:15:35.586 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:35.586 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:35.586 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:35.587 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:35.587 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:35.587 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T07:15:35.587 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T07:15:35.587 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T07:15:35.587 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:35.587 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:35 smithi153 ceph-mon[36179]: Deploying daemon mgr.z on smithi153 2024-03-27T07:15:35.651 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-03-27T07:15:35.651 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-03-27T07:15:35.651 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000207346 s, 2.5 MB/s 2024-03-27T07:15:35.653 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-27T07:15:35.709 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-03-27T07:15:35.763 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-27T07:15:35.764 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:35.764 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-27T07:15:35.764 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:35.764 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:35.764 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-03-27 07:14:38.442692404 +0000 2024-03-27T07:15:35.764 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-03-27 07:09:44.474426685 +0000 2024-03-27T07:15:35.764 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-03-27 07:09:44.474426685 +0000 2024-03-27T07:15:35.764 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-03-27 07:09:44.474426685 +0000 2024-03-27T07:15:35.764 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-27T07:15:35.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:35.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi149=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:15:35.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: Saving service mgr spec with placement smithi082=x;smithi149=y;smithi153=z;count:3 2024-03-27T07:15:35.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:35.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:35.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:35.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:35.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:35.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T07:15:35.828 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T07:15:35.829 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T07:15:35.829 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:35.829 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:35 smithi082 ceph-mon[32178]: Deploying daemon mgr.z on smithi153 2024-03-27T07:15:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-03-27T07:15:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-03-27T07:15:35.830 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000213665 s, 2.4 MB/s 2024-03-27T07:15:35.831 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-27T07:15:35.887 DEBUG:teuthology.orchestra.run.smithi149:> set -ex 2024-03-27T07:15:35.888 DEBUG:teuthology.orchestra.run.smithi149:> dd if=/scratch_devs of=/dev/stdout 2024-03-27T07:15:35.906 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-27T07:15:35.906 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_1 2024-03-27T07:15:35.963 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-27T07:15:35.963 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:35.964 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 660 Links: 1 2024-03-27T07:15:35.964 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:35.964 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:35.964 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-03-27 07:15:19.878199578 +0000 2024-03-27T07:15:35.964 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-03-27 07:09:55.579189534 +0000 2024-03-27T07:15:35.964 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-03-27 07:09:55.579189534 +0000 2024-03-27T07:15:35.964 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-03-27 07:09:55.579189534 +0000 2024-03-27T07:15:35.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-27T07:15:36.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi149=y;smithi153=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: Saving service mgr spec with placement smithi082=x;smithi149=y;smithi153=z;count:3 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:35 smithi149 ceph-mon[36065]: Deploying daemon mgr.z on smithi153 2024-03-27T07:15:36.032 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-03-27T07:15:36.032 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-03-27T07:15:36.032 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000286631 s, 1.8 MB/s 2024-03-27T07:15:36.033 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-27T07:15:36.091 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_2 2024-03-27T07:15:36.146 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-27T07:15:36.146 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:36.147 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-03-27T07:15:36.147 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:36.147 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:36.147 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-03-27 07:15:19.878199578 +0000 2024-03-27T07:15:36.147 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-03-27 07:09:55.922182509 +0000 2024-03-27T07:15:36.147 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-03-27 07:09:55.922182509 +0000 2024-03-27T07:15:36.147 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-03-27 07:09:55.922182509 +0000 2024-03-27T07:15:36.147 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-27T07:15:36.214 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-03-27T07:15:36.214 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-03-27T07:15:36.214 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000215337 s, 2.4 MB/s 2024-03-27T07:15:36.215 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-27T07:15:36.272 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_3 2024-03-27T07:15:36.328 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-27T07:15:36.328 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:36.328 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-03-27T07:15:36.328 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:36.328 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:36.328 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-03-27 07:15:19.878199578 +0000 2024-03-27T07:15:36.328 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-03-27 07:09:56.250175790 +0000 2024-03-27T07:15:36.329 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-03-27 07:09:56.250175790 +0000 2024-03-27T07:15:36.329 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-03-27 07:09:56.250175790 +0000 2024-03-27T07:15:36.329 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-27T07:15:36.394 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-03-27T07:15:36.395 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-03-27T07:15:36.395 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000203321 s, 2.5 MB/s 2024-03-27T07:15:36.396 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-27T07:15:36.452 DEBUG:teuthology.orchestra.run.smithi149:> stat /dev/vg_nvme/lv_4 2024-03-27T07:15:36.507 INFO:teuthology.orchestra.run.smithi149.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-27T07:15:36.507 INFO:teuthology.orchestra.run.smithi149.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:36.507 INFO:teuthology.orchestra.run.smithi149.stdout:Device: 5h/5d Inode: 719 Links: 1 2024-03-27T07:15:36.507 INFO:teuthology.orchestra.run.smithi149.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:36.507 INFO:teuthology.orchestra.run.smithi149.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:36.507 INFO:teuthology.orchestra.run.smithi149.stdout:Access: 2024-03-27 07:15:19.879199558 +0000 2024-03-27T07:15:36.507 INFO:teuthology.orchestra.run.smithi149.stdout:Modify: 2024-03-27 07:09:56.578169072 +0000 2024-03-27T07:15:36.508 INFO:teuthology.orchestra.run.smithi149.stdout:Change: 2024-03-27 07:09:56.578169072 +0000 2024-03-27T07:15:36.508 INFO:teuthology.orchestra.run.smithi149.stdout: Birth: 2024-03-27 07:09:56.578169072 +0000 2024-03-27T07:15:36.508 DEBUG:teuthology.orchestra.run.smithi149:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-27T07:15:36.573 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records in 2024-03-27T07:15:36.573 INFO:teuthology.orchestra.run.smithi149.stderr:1+0 records out 2024-03-27T07:15:36.573 INFO:teuthology.orchestra.run.smithi149.stderr:512 bytes copied, 0.000177826 s, 2.9 MB/s 2024-03-27T07:15:36.574 DEBUG:teuthology.orchestra.run.smithi149:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-27T07:15:36.630 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-03-27T07:15:36.630 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-03-27T07:15:36.645 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-27T07:15:36.645 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-03-27T07:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-27T07:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 662 Links: 1 2024-03-27T07:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-27 07:15:36.571989704 +0000 2024-03-27T07:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-27 07:10:09.887206016 +0000 2024-03-27T07:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-27 07:10:09.887206016 +0000 2024-03-27T07:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-27 07:10:09.887206016 +0000 2024-03-27T07:15:36.701 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-27T07:15:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-27T07:15:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-27T07:15:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000273461 s, 1.9 MB/s 2024-03-27T07:15:36.769 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-27T07:15:36.826 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-03-27T07:15:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-27T07:15:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:36.881 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-03-27T07:15:36.881 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:36.881 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:36.881 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-27 07:15:36.571989704 +0000 2024-03-27T07:15:36.881 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-27 07:10:10.237199867 +0000 2024-03-27T07:15:36.881 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-27 07:10:10.237199867 +0000 2024-03-27T07:15:36.881 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-27 07:10:10.237199867 +0000 2024-03-27T07:15:36.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-27T07:15:36.944 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:36 smithi153 podman[38008]: 2024-03-27 07:15:36.866441517 +0000 UTC m=+0.134677190 container create 507ac8682273e4eca07609328f46b4a92ef60a45a23d81ef26eb17fa9bc7804b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-27T07:15:36.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-27T07:15:36.947 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000190697 s, 2.7 MB/s 2024-03-27T07:15:36.948 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-27T07:15:37.003 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-03-27T07:15:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-27T07:15:37.061 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:37.061 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-03-27T07:15:37.061 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:37.062 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:37.062 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-27 07:15:36.572989687 +0000 2024-03-27T07:15:37.062 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-27 07:10:10.581193823 +0000 2024-03-27T07:15:37.062 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-27 07:10:10.581193823 +0000 2024-03-27T07:15:37.062 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-27 07:10:10.581193823 +0000 2024-03-27T07:15:37.062 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-27T07:15:37.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-27T07:15:37.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-27T07:15:37.125 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000195667 s, 2.6 MB/s 2024-03-27T07:15:37.126 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-27T07:15:37.183 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-03-27T07:15:37.238 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-27T07:15:37.238 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T07:15:37.238 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-03-27T07:15:37.238 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:15:37.238 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T07:15:37.238 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-03-27 07:15:36.572989687 +0000 2024-03-27T07:15:37.238 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-03-27 07:10:10.921187851 +0000 2024-03-27T07:15:37.238 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-03-27 07:10:10.921187851 +0000 2024-03-27T07:15:37.238 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-03-27 07:10:10.921187851 +0000 2024-03-27T07:15:37.239 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-27T07:15:37.261 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:37 smithi153 podman[38008]: 2024-03-27 07:15:37.161124222 +0000 UTC m=+0.429359913 container init 507ac8682273e4eca07609328f46b4a92ef60a45a23d81ef26eb17fa9bc7804b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-03-27T07:15:37.261 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:37 smithi153 podman[38008]: 2024-03-27 07:15:37.164137304 +0000 UTC m=+0.432372983 container start 507ac8682273e4eca07609328f46b4a92ef60a45a23d81ef26eb17fa9bc7804b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-03-27T07:15:37.261 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-mgr[38151]: -- 172.21.15.153:0/1545307000 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a24b1ba5a0 con 0x55a24b18f000 2024-03-27T07:15:37.289 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-03-27T07:15:37.289 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-03-27T07:15:37.289 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000193258 s, 2.6 MB/s 2024-03-27T07:15:37.291 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-27T07:15:37.347 INFO:tasks.cephadm:Deploying osd.0 on smithi082 with /dev/vg_nvme/lv_4... 2024-03-27T07:15:37.347 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-27T07:15:37.537 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:37 smithi153 bash[38008]: 507ac8682273e4eca07609328f46b4a92ef60a45a23d81ef26eb17fa9bc7804b 2024-03-27T07:15:37.537 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:37 smithi153 systemd[1]: Started Ceph mgr.z for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:15:37.591 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:15:37.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:37 smithi082 ceph-mon[32178]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:37.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:37 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:37.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:37 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:37.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:37 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:37.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:37 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T07:15:37.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:37 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T07:15:37.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:37 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T07:15:37.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:37 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:37.847 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:37.750+0000 7f48012d1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T07:15:37.847 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:37.845+0000 7f48012d1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T07:15:37.847 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-mon[36179]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:37.847 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:37.847 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:37.847 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:37.847 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T07:15:37.847 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T07:15:37.847 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T07:15:37.847 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:37 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:37.930 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:37 smithi149 ceph-mon[36065]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:37.930 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:37 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:37.930 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:37 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:37.930 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:37 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:37.930 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:37 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T07:15:37.930 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:37 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T07:15:37.930 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:37 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T07:15:37.930 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:37 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:38.537 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:38.500+0000 7f48012d1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T07:15:38.809 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:38 smithi082 ceph-mon[32178]: Deploying daemon mgr.y on smithi149 2024-03-27T07:15:38.829 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:38 smithi153 ceph-mon[36179]: Deploying daemon mgr.y on smithi149 2024-03-27T07:15:38.829 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:38.593+0000 7f48012d1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T07:15:38.829 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:38.733+0000 7f48012d1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T07:15:38.885 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:38 smithi149 ceph-mon[36065]: Deploying daemon mgr.y on smithi149 2024-03-27T07:15:39.177 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:38.828+0000 7f48012d1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T07:15:39.177 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:38.910+0000 7f48012d1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T07:15:39.177 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:39.175+0000 7f48012d1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T07:15:39.444 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-27T07:15:39.444 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-27T07:15:39.444 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-03-27T07:15:39.444 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-03-27T07:15:39.444 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131367 s, 798 MB/s 2024-03-27T07:15:39.444 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-03-27T07:15:39.469 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:39.284+0000 7f48012d1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T07:15:39.469 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:39.372+0000 7f48012d1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T07:15:39.469 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:39.468+0000 7f48012d1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T07:15:39.504 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:39 smithi149 systemd[1]: Starting Ceph mgr.y for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:15:39.751 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:39 smithi082 ceph-mon[32178]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:39.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:39 smithi153 ceph-mon[36179]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:39.787 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:39.658+0000 7f48012d1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T07:15:39.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:39 smithi149 ceph-mon[36065]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:39.812 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:39 smithi149 podman[37477]: 2024-03-27 07:15:39.600999341 +0000 UTC m=+0.112923956 container create da6bb59530ec836b57fa598686313b2c2de3569d9777d2eba903046a054acd6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-03-27T07:15:39.812 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:39 smithi149 podman[37477]: 2024-03-27 07:15:39.505799005 +0000 UTC m=+0.017723638 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:15:39.812 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:39 smithi149 podman[37477]: 2024-03-27 07:15:39.811576264 +0000 UTC m=+0.323500878 container init da6bb59530ec836b57fa598686313b2c2de3569d9777d2eba903046a054acd6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-27T07:15:40.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-03-27T07:15:40.254 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:39 smithi149 podman[37477]: 2024-03-27 07:15:39.814252162 +0000 UTC m=+0.326176782 container start da6bb59530ec836b57fa598686313b2c2de3569d9777d2eba903046a054acd6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y, org.label-schema.build-date=20240326, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD) 2024-03-27T07:15:40.254 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:39 smithi149 ceph-mgr[37496]: -- 172.21.15.149:0/3542639096 <== mon.2 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558461e025a0 con 0x558461dd7000 2024-03-27T07:15:40.254 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:39 smithi149 bash[37477]: da6bb59530ec836b57fa598686313b2c2de3569d9777d2eba903046a054acd6e 2024-03-27T07:15:40.255 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:39 smithi149 systemd[1]: Started Ceph mgr.y for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:15:40.297 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:15:40.754 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:40 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:40.370+0000 7f5359a0e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T07:15:40.754 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:40 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:40.467+0000 7f5359a0e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T07:15:40.954 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:40.679+0000 7f48012d1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T07:15:40.955 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:40.813+0000 7f48012d1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T07:15:41.158 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:40 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.158 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:40 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.158 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:40 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.159 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:40 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.159 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:40 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:41.159 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:40 smithi149 ceph-mon[36065]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:40 smithi082 ceph-mon[32178]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:41.250 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:41.159+0000 7f48012d1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T07:15:41.251 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:41.249+0000 7f48012d1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T07:15:41.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:40 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:40 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:40 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:40 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:41.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:40 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:41.251 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:40 smithi153 ceph-mon[36179]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:41.411 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:41.156+0000 7f5359a0e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T07:15:41.411 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:41.261+0000 7f5359a0e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T07:15:41.537 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:41.453+0000 7f48012d1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:15:41.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.735+0000 7fd715532700 1 -- 172.21.15.82:0/1002822023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7101042f0 msgr2=0x7fd71010aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:41.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.735+0000 7fd715532700 1 --2- 172.21.15.82:0/1002822023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7101042f0 0x7fd71010aba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd70800b0a0 tx=0x7fd70800b3b0 comp rx=0 tx=0).stop 2024-03-27T07:15:41.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.735+0000 7fd715532700 1 -- 172.21.15.82:0/1002822023 shutdown_connections 2024-03-27T07:15:41.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.735+0000 7fd715532700 1 --2- 172.21.15.82:0/1002822023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd710100970 0x7fd710100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:41.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.735+0000 7fd715532700 1 --2- 172.21.15.82:0/1002822023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7101042f0 0x7fd71010aba0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:41.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.735+0000 7fd715532700 1 --2- 172.21.15.82:0/1002822023 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd710103950 0x7fd710103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:41.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.735+0000 7fd715532700 1 -- 172.21.15.82:0/1002822023 >> 172.21.15.82:0/1002822023 conn(0x7fd7100fc2d0 msgr2=0x7fd7100fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:15:41.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.735+0000 7fd715532700 1 -- 172.21.15.82:0/1002822023 shutdown_connections 2024-03-27T07:15:41.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.736+0000 7fd715532700 1 -- 172.21.15.82:0/1002822023 wait complete. 2024-03-27T07:15:41.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.736+0000 7fd715532700 1 Processor -- start 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.736+0000 7fd715532700 1 -- start start 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd715532700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd710100970 0x7fd7101987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd715532700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd710103950 0x7fd710198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd715532700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7101042f0 0x7fd71019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd715532700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd71010e290 con 0x7fd710100970 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd715532700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd71010e110 con 0x7fd710103950 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd715532700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd71010e410 con 0x7fd7101042f0 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd710100970 0x7fd7101987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd710100970 0x7fd7101987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34664/0 (socket says 172.21.15.82:34664) 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70effd700 1 -- 172.21.15.82:0/3181564623 learned_addr learned my addr 172.21.15.82:0/3181564623 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:15:41.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70e7fc700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd710103950 0x7fd710198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70f7fe700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7101042f0 0x7fd71019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70effd700 1 -- 172.21.15.82:0/3181564623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7101042f0 msgr2=0x7fd71019fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70effd700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7101042f0 0x7fd71019fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70effd700 1 -- 172.21.15.82:0/3181564623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd710103950 msgr2=0x7fd710198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70effd700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd710103950 0x7fd710198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70effd700 1 -- 172.21.15.82:0/3181564623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7101a0450 con 0x7fd710100970 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd70effd700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd710100970 0x7fd7101987f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd70000d9b0 tx=0x7fd70000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.737+0000 7fd6f7fff700 1 -- 172.21.15.82:0/3181564623 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700017070 con 0x7fd710100970 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.738+0000 7fd715532700 1 -- 172.21.15.82:0/3181564623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7101a0740 con 0x7fd710100970 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.738+0000 7fd6f7fff700 1 -- 172.21.15.82:0/3181564623 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd700009e10 con 0x7fd710100970 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.738+0000 7fd715532700 1 -- 172.21.15.82:0/3181564623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7101a0c80 con 0x7fd710100970 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.738+0000 7fd6f7fff700 1 -- 172.21.15.82:0/3181564623 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70000f3c0 con 0x7fd710100970 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.738+0000 7fd6f7fff700 1 -- 172.21.15.82:0/3181564623 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 46522+0+0 (secure 0 0 0) 0x7fd70000f560 con 0x7fd710100970 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.739+0000 7fd6f7fff700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd6f803dac0 0x7fd6f803ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:15:41.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.739+0000 7fd6f7fff700 1 -- 172.21.15.82:0/3181564623 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd70004d190 con 0x7fd710100970 2024-03-27T07:15:41.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.739+0000 7fd70e7fc700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd6f803dac0 0x7fd6f803ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:15:41.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.739+0000 7fd715532700 1 -- 172.21.15.82:0/3181564623 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6fc005360 con 0x7fd710100970 2024-03-27T07:15:41.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.739+0000 7fd70e7fc700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd6f803dac0 0x7fd6f803ff80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd704005950 tx=0x7fd70400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:15:41.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.744+0000 7fd6f7fff700 1 -- 172.21.15.82:0/3181564623 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd700021260 con 0x7fd710100970 2024-03-27T07:15:41.754 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:41.409+0000 7f5359a0e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T07:15:41.754 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:41.506+0000 7f5359a0e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T07:15:41.754 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:41.590+0000 7f5359a0e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T07:15:41.923 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:41.640+0000 7f48012d1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T07:15:41.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:41.955+0000 7fd715532700 1 -- 172.21.15.82:0/3181564623 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd6fc000bf0 con 0x7fd6f803dac0 2024-03-27T07:15:42.144 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:41.855+0000 7f5359a0e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T07:15:42.144 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:41.964+0000 7f5359a0e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T07:15:42.144 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:42.048+0000 7f5359a0e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T07:15:42.144 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:42.142+0000 7f5359a0e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T07:15:42.184 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:41.921+0000 7f48012d1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:15:42.185 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:42.183+0000 7f48012d1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T07:15:42.506 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:42.321+0000 7f5359a0e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T07:15:42.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:42.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:42.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: Reconfiguring mgr.x (unknown last config time)... 2024-03-27T07:15:42.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T07:15:42.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T07:15:42.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:42.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: Reconfiguring daemon mgr.x on smithi082 2024-03-27T07:15:42.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:15:42.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:15:42.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:42.537 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:42.421+0000 7f48012d1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T07:15:42.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:42.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: Reconfiguring mgr.x (unknown last config time)... 2024-03-27T07:15:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T07:15:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T07:15:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: Reconfiguring daemon mgr.x on smithi082 2024-03-27T07:15:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:15:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:15:42.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:42.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.550 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: Reconfiguring mgr.x (unknown last config time)... 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: Reconfiguring daemon mgr.x on smithi082 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:15:42.551 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:43.537 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:43.225+0000 7f48012d1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T07:15:43.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-mon[36179]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:15:43.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-mon[36179]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:43.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:43.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:43.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:43.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:43.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:43.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:43.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:43 smithi082 ceph-mon[32178]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:15:43.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:43 smithi082 ceph-mon[32178]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:43.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:43.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:43.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:43.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:43.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:43.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:43.754 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:43.287+0000 7f5359a0e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T07:15:43.754 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:43.417+0000 7f5359a0e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T07:15:43.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-mon[36065]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:15:43.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-mon[36065]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:43.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:43.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:43.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:43.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:43.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:15:43.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:44.037 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:43.754+0000 7f5359a0e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T07:15:44.037 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:43 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:43.843+0000 7f5359a0e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T07:15:44.037 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:44 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:44.035+0000 7f5359a0e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:15:44.119 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:43.798+0000 7f48012d1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T07:15:44.120 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:43.895+0000 7f48012d1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T07:15:44.120 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:15:44 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:15:44.112+0000 7f48012d1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T07:15:44.332 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:44 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:44.216+0000 7f5359a0e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T07:15:44.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:44.337+0000 7fd6f7fff700 1 -- 172.21.15.82:0/3181564623 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 14) ==== 92418+0+0 (secure 0 0 0) 0x7fd70000f8a0 con 0x7fd710100970 2024-03-27T07:15:44.352 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:44 smithi082 ceph-mon[32178]: Standby manager daemon z started 2024-03-27T07:15:44.352 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:44 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-27T07:15:44.352 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:44 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:15:44.352 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:44 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-27T07:15:44.353 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:44 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:15:44.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:44 smithi153 ceph-mon[36179]: Standby manager daemon z started 2024-03-27T07:15:44.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:44 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-27T07:15:44.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:44 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:15:44.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:44 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-27T07:15:44.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:44 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:15:44.754 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:44 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:44.501+0000 7f5359a0e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:15:44.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:44 smithi149 ceph-mon[36065]: Standby manager daemon z started 2024-03-27T07:15:44.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:44 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-27T07:15:44.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:44 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:15:44.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:44 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-27T07:15:44.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:44 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.153:0/2247912238' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:15:45.254 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:44 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:44.766+0000 7f5359a0e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T07:15:45.254 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:45 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:45.000+0000 7f5359a0e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T07:15:45.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:45 smithi082 ceph-mon[32178]: mgrmap e14: x(active, since 77s), standbys: z 2024-03-27T07:15:45.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:45 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-27T07:15:45.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:45 smithi082 ceph-mon[32178]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:45.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:45 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1630320879' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3843b5bc-e505-452f-8ce4-f4db52e6c7e8"}]: dispatch 2024-03-27T07:15:45.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:45 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1630320879' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3843b5bc-e505-452f-8ce4-f4db52e6c7e8"}]': finished 2024-03-27T07:15:45.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:45 smithi082 ceph-mon[32178]: osdmap e5: 1 total, 0 up, 1 in 2024-03-27T07:15:45.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:45 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:15:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:45 smithi149 ceph-mon[36065]: mgrmap e14: x(active, since 77s), standbys: z 2024-03-27T07:15:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:45 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-27T07:15:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:45 smithi149 ceph-mon[36065]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:45 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1630320879' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3843b5bc-e505-452f-8ce4-f4db52e6c7e8"}]: dispatch 2024-03-27T07:15:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:45 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1630320879' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3843b5bc-e505-452f-8ce4-f4db52e6c7e8"}]': finished 2024-03-27T07:15:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:45 smithi149 ceph-mon[36065]: osdmap e5: 1 total, 0 up, 1 in 2024-03-27T07:15:45.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:45 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:15:45.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:45 smithi153 ceph-mon[36179]: mgrmap e14: x(active, since 77s), standbys: z 2024-03-27T07:15:45.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:45 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-27T07:15:45.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:45 smithi153 ceph-mon[36179]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:45.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:45 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1630320879' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3843b5bc-e505-452f-8ce4-f4db52e6c7e8"}]: dispatch 2024-03-27T07:15:45.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:45 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1630320879' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3843b5bc-e505-452f-8ce4-f4db52e6c7e8"}]': finished 2024-03-27T07:15:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:45 smithi153 ceph-mon[36179]: osdmap e5: 1 total, 0 up, 1 in 2024-03-27T07:15:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:45 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:15:46.254 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:45 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:45.799+0000 7f5359a0e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T07:15:46.684 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:46 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1061117251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:15:46.684 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:46 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:46.374+0000 7f5359a0e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T07:15:46.685 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:46 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:46.469+0000 7f5359a0e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T07:15:46.685 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:15:46 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:15:46.683+0000 7f5359a0e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T07:15:46.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:46 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1061117251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:15:46.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:46 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1061117251' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:15:47.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:15:47.350+0000 7fd6f7fff700 1 -- 172.21.15.82:0/3181564623 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 15) ==== 138314+0+0 (secure 0 0 0) 0x7fd70000fc20 con 0x7fd710100970 2024-03-27T07:15:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:47 smithi082 ceph-mon[32178]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:47 smithi082 ceph-mon[32178]: Standby manager daemon y started 2024-03-27T07:15:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:47 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-27T07:15:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:47 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:15:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:47 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-27T07:15:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:47 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:15:47.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:47 smithi149 ceph-mon[36065]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:47.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:47 smithi149 ceph-mon[36065]: Standby manager daemon y started 2024-03-27T07:15:47.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:47 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-27T07:15:47.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:47 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:15:47.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:47 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-27T07:15:47.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:47 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:15:47.765 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:47 smithi153 ceph-mon[36179]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:47.765 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:47 smithi153 ceph-mon[36179]: Standby manager daemon y started 2024-03-27T07:15:47.765 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:47 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-27T07:15:47.765 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:47 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:15:47.765 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:47 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-27T07:15:47.765 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:47 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.149:0/2142647575' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:15:48.615 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:48 smithi082 ceph-mon[32178]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-03-27T07:15:48.615 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:48 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-27T07:15:48.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:48 smithi149 ceph-mon[36065]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-03-27T07:15:48.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:48 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-27T07:15:48.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:48 smithi153 ceph-mon[36179]: mgrmap e15: x(active, since 80s), standbys: z, y 2024-03-27T07:15:48.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:48 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-27T07:15:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:49 smithi082 ceph-mon[32178]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:49.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:49 smithi149 ceph-mon[36065]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:49.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:49 smithi153 ceph-mon[36179]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:51.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:51 smithi149 ceph-mon[36065]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:51.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:51 smithi153 ceph-mon[36179]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:51 smithi082 ceph-mon[32178]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:52.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:52 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-27T07:15:52.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:52 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:52.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:52 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-27T07:15:52.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:52 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:52.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:52 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-27T07:15:52.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:52 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:15:53.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:53 smithi082 ceph-mon[32178]: Deploying daemon osd.0 on smithi082 2024-03-27T07:15:53.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:53 smithi082 ceph-mon[32178]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:53.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:53 smithi149 ceph-mon[36065]: Deploying daemon osd.0 on smithi082 2024-03-27T07:15:53.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:53 smithi149 ceph-mon[36065]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:53.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:53 smithi153 ceph-mon[36179]: Deploying daemon osd.0 on smithi082 2024-03-27T07:15:53.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:53 smithi153 ceph-mon[36179]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:55.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:55 smithi082 ceph-mon[32178]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:55.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:55 smithi149 ceph-mon[36065]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:55.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:55 smithi153 ceph-mon[36179]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:57.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:57 smithi149 ceph-mon[36065]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:57.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:57.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:57.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:57.755 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:57 smithi082 ceph-mon[32178]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:57.755 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:57.755 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:57.756 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:57 smithi153 ceph-mon[36179]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:15:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:15:59.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:15:59 smithi149 ceph-mon[36065]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:59.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:15:59 smithi153 ceph-mon[36179]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:15:59.884 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:15:59 smithi082 ceph-mon[32178]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:16:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.661+0000 7fd6f7fff700 1 -- 172.21.15.82:0/3181564623 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd6fc000bf0 con 0x7fd6f803dac0 2024-03-27T07:16:00.662 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 0 on host 'smithi082' 2024-03-27T07:16:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 -- 172.21.15.82:0/3181564623 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd6f803dac0 msgr2=0x7fd6f803ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd6f803dac0 0x7fd6f803ff80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd704005950 tx=0x7fd70400b410 comp rx=0 tx=0).stop 2024-03-27T07:16:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 -- 172.21.15.82:0/3181564623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd710100970 msgr2=0x7fd7101987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd710100970 0x7fd7101987f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd70000d9b0 tx=0x7fd70000dcc0 comp rx=0 tx=0).stop 2024-03-27T07:16:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 -- 172.21.15.82:0/3181564623 shutdown_connections 2024-03-27T07:16:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd6f803dac0 0x7fd6f803ff80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7101042f0 0x7fd71019fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd710100970 0x7fd7101987f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 --2- 172.21.15.82:0/3181564623 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd710103950 0x7fd710198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 -- 172.21.15.82:0/3181564623 >> 172.21.15.82:0/3181564623 conn(0x7fd7100fc2d0 msgr2=0x7fd710106b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:16:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 -- 172.21.15.82:0/3181564623 shutdown_connections 2024-03-27T07:16:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:00.663+0000 7fd715532700 1 -- 172.21.15.82:0/3181564623 wait complete. 2024-03-27T07:16:01.328 DEBUG:teuthology.orchestra.run.smithi082:osd.0> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.0.service 2024-03-27T07:16:01.330 INFO:tasks.cephadm:Deploying osd.1 on smithi149 with /dev/vg_nvme/lv_4... 2024-03-27T07:16:01.331 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-27T07:16:01.579 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:16:01.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:01 smithi082 ceph-mon[32178]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:16:01.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:01 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:01 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:01 smithi082 ceph-mon[32178]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-27T07:16:01.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:01 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:01 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.701 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:01 smithi149 ceph-mon[36065]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:16:01.701 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:01 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.701 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:01 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.701 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:01 smithi149 ceph-mon[36065]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-27T07:16:01.701 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:01 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.701 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:01 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:01 smithi153 ceph-mon[36179]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:16:01.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:01 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:01 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:01 smithi153 ceph-mon[36179]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-27T07:16:01.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:01 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:01.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:01 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:02.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:02 smithi149 ceph-mon[36065]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-27T07:16:02.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:02 smithi149 ceph-mon[36065]: osdmap e6: 1 total, 0 up, 1 in 2024-03-27T07:16:02.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:02 smithi149 ceph-mon[36065]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:16:02.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:02 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:02.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:02 smithi149 ceph-mon[36065]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:16:02.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:02 smithi082 ceph-mon[32178]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-27T07:16:02.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:02 smithi082 ceph-mon[32178]: osdmap e6: 1 total, 0 up, 1 in 2024-03-27T07:16:02.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:02 smithi082 ceph-mon[32178]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:16:02.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:02 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:02.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:02 smithi082 ceph-mon[32178]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:16:03.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:02 smithi153 ceph-mon[36179]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-27T07:16:03.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:02 smithi153 ceph-mon[36179]: osdmap e6: 1 total, 0 up, 1 in 2024-03-27T07:16:03.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:02 smithi153 ceph-mon[36179]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:16:03.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:02 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:03.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:02 smithi153 ceph-mon[36179]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:16:03.308 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:16:03 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0[47213]: 2024-03-27T07:16:03.030+0000 7fcd3f935700 -1 osd.0 0 waiting for initial osdmap 2024-03-27T07:16:03.308 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:16:03 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0[47213]: 2024-03-27T07:16:03.033+0000 7fcd37720700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:16:03.400 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-27T07:16:03.401 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-27T07:16:03.401 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-03-27T07:16:03.401 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-03-27T07:16:03.401 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111903 s, 937 MB/s 2024-03-27T07:16:03.401 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-03-27T07:16:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:03 smithi082 ceph-mon[32178]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:16:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:03 smithi082 ceph-mon[32178]: osdmap e7: 1 total, 0 up, 1 in 2024-03-27T07:16:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:03 smithi082 ceph-mon[32178]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' 2024-03-27T07:16:04.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:03 smithi149 ceph-mon[36065]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:16:04.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:03 smithi149 ceph-mon[36065]: osdmap e7: 1 total, 0 up, 1 in 2024-03-27T07:16:04.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:03 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:04.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:03 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:04.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:03 smithi149 ceph-mon[36065]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' 2024-03-27T07:16:04.030 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi149:vg_nvme/lv_4 2024-03-27T07:16:04.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:03 smithi153 ceph-mon[36179]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:16:04.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:03 smithi153 ceph-mon[36179]: osdmap e7: 1 total, 0 up, 1 in 2024-03-27T07:16:04.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:03 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:04.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:03 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:04.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:03 smithi153 ceph-mon[36179]: from='osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020]' entity='osd.0' 2024-03-27T07:16:04.280 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:16:04.704 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:04 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:16:04.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:04 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:16:04.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:04 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:04.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:04 smithi149 ceph-mon[36065]: osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] boot 2024-03-27T07:16:04.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:04 smithi149 ceph-mon[36065]: osdmap e8: 1 total, 1 up, 1 in 2024-03-27T07:16:04.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:04 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:04.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:04 smithi149 ceph-mon[36065]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:16:04.898 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:04 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:16:04.898 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:04 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:16:04.898 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:04 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:04.898 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:04 smithi082 ceph-mon[32178]: osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] boot 2024-03-27T07:16:04.898 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:04 smithi082 ceph-mon[32178]: osdmap e8: 1 total, 1 up, 1 in 2024-03-27T07:16:04.899 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:04 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:04.899 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:04 smithi082 ceph-mon[32178]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:16:05.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:04 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:16:05.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:04 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:16:05.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:04 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:05.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:04 smithi153 ceph-mon[36179]: osd.0 [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] boot 2024-03-27T07:16:05.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:04 smithi153 ceph-mon[36179]: osdmap e8: 1 total, 1 up, 1 in 2024-03-27T07:16:05.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:04 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:16:05.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:04 smithi153 ceph-mon[36179]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T07:16:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.779+0000 7f892dc13700 1 -- 172.21.15.149:0/743573180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8928101850 msgr2=0x7f8928101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.779+0000 7f892dc13700 1 --2- 172.21.15.149:0/743573180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8928101850 0x7f8928101cd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f891c009990 tx=0x7f891c009ca0 comp rx=0 tx=0).stop 2024-03-27T07:16:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.779+0000 7f892dc13700 1 -- 172.21.15.149:0/743573180 shutdown_connections 2024-03-27T07:16:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.779+0000 7f892dc13700 1 --2- 172.21.15.149:0/743573180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8928100ef0 0x7f8928101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.779+0000 7f892dc13700 1 --2- 172.21.15.149:0/743573180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8928102210 0x7f8928102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.779+0000 7f892dc13700 1 --2- 172.21.15.149:0/743573180 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8928101850 0x7f8928101cd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.779+0000 7f892dc13700 1 -- 172.21.15.149:0/743573180 >> 172.21.15.149:0/743573180 conn(0x7f89280fcb30 msgr2=0x7f89280fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:16:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.780+0000 7f892dc13700 1 -- 172.21.15.149:0/743573180 shutdown_connections 2024-03-27T07:16:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.780+0000 7f892dc13700 1 -- 172.21.15.149:0/743573180 wait complete. 2024-03-27T07:16:05.781 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.780+0000 7f892dc13700 1 Processor -- start 2024-03-27T07:16:05.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.780+0000 7f892dc13700 1 -- start start 2024-03-27T07:16:05.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.780+0000 7f892dc13700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8928100ef0 0x7f892819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:05.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.780+0000 7f892dc13700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8928101850 0x7f892819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:05.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.780+0000 7f892dc13700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8928102210 0x7f89281a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:05.783 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f892dc13700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8928110420 con 0x7f8928100ef0 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f892dc13700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f89281102a0 con 0x7f8928101850 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f892dc13700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f89281105a0 con 0x7f8928102210 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8926ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8928101850 0x7f892819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8926ffd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8928101850 0x7f892819af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:49374/0 (socket says 172.21.15.149:49374) 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8926ffd700 1 -- 172.21.15.149:0/3588468650 learned_addr learned my addr 172.21.15.149:0/3588468650 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8927fff700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8928102210 0x7f89281a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f89277fe700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8928100ef0 0x7f892819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8926ffd700 1 -- 172.21.15.149:0/3588468650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8928102210 msgr2=0x7f89281a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8926ffd700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8928102210 0x7f89281a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8926ffd700 1 -- 172.21.15.149:0/3588468650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8928100ef0 msgr2=0x7f892819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8926ffd700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8928100ef0 0x7f892819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8926ffd700 1 -- 172.21.15.149:0/3588468650 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89281a2640 con 0x7f8928101850 2024-03-27T07:16:05.784 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8926ffd700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8928101850 0x7f892819af70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f891c0098e0 tx=0x7f891c0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:16:05.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8924ff9700 1 -- 172.21.15.149:0/3588468650 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c027070 con 0x7f8928101850 2024-03-27T07:16:05.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8924ff9700 1 -- 172.21.15.149:0/3588468650 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f891c004150 con 0x7f8928101850 2024-03-27T07:16:05.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f8924ff9700 1 -- 172.21.15.149:0/3588468650 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c00f460 con 0x7f8928101850 2024-03-27T07:16:05.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f892dc13700 1 -- 172.21.15.149:0/3588468650 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89281a28d0 con 0x7f8928101850 2024-03-27T07:16:05.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.781+0000 7f892dc13700 1 -- 172.21.15.149:0/3588468650 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89281a2cd0 con 0x7f8928101850 2024-03-27T07:16:05.785 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.782+0000 7f892dc13700 1 -- 172.21.15.149:0/3588468650 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8928069300 con 0x7f8928101850 2024-03-27T07:16:05.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.784+0000 7f8924ff9700 1 -- 172.21.15.149:0/3588468650 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 15) ==== 138314+0+0 (secure 0 0 0) 0x7f891c02a070 con 0x7f8928101850 2024-03-27T07:16:05.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.784+0000 7f8924ff9700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 0x7f89100a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:05.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.784+0000 7f8924ff9700 1 -- 172.21.15.149:0/3588468650 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7f891c0cf470 con 0x7f8928101850 2024-03-27T07:16:05.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.784+0000 7f89277fe700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 0x7f89100a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:05.786 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.785+0000 7f89277fe700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 0x7f89100a5ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8918005ea0 tx=0x7f8918005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:16:05.789 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.788+0000 7f8924ff9700 1 -- 172.21.15.149:0/3588468650 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f891c013070 con 0x7f8928101850 2024-03-27T07:16:05.998 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:05.997+0000 7f892dc13700 1 -- 172.21.15.149:0/3588468650 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8928062a80 con 0x7f89100a3610 2024-03-27T07:16:05.999 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi082 2024-03-27T07:16:05.999 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:05.999 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:05.999 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:16:05.999 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi082 to 17088M 2024-03-27T07:16:05.999 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.000 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:06.000 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:06.000 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.000 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:06.000 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:06.000 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:06.000 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi082 2024-03-27T07:16:06.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:16:06.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi082 to 17088M 2024-03-27T07:16:06.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:06.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:06.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:06.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:06.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:06.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi082 2024-03-27T07:16:06.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:16:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi082 to 17088M 2024-03-27T07:16:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:06 smithi082 ceph-mon[32178]: osdmap e9: 1 total, 1 up, 1 in 2024-03-27T07:16:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:06 smithi082 ceph-mon[32178]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:16:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:06 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:16:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:06 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:16:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:06 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:06 smithi082 ceph-mon[32178]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:07.188 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:06 smithi153 ceph-mon[36179]: osdmap e9: 1 total, 1 up, 1 in 2024-03-27T07:16:07.189 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:06 smithi153 ceph-mon[36179]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:16:07.189 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:06 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:16:07.189 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:06 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:16:07.189 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:06 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:07.189 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:06 smithi153 ceph-mon[36179]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:07.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:06 smithi149 ceph-mon[36065]: osdmap e9: 1 total, 1 up, 1 in 2024-03-27T07:16:07.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:06 smithi149 ceph-mon[36065]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:16:07.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:06 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:16:07.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:06 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:16:07.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:06 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:07.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:06 smithi149 ceph-mon[36065]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:09.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:09 smithi149 ceph-mon[36065]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:09.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:09 smithi149 ceph-mon[36065]: from='client.? 172.21.15.149:0/3641235661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fb771fe-8d60-4f03-b108-3a94c2e8e6c6"}]: dispatch 2024-03-27T07:16:09.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:09 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fb771fe-8d60-4f03-b108-3a94c2e8e6c6"}]: dispatch 2024-03-27T07:16:09.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:09 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fb771fe-8d60-4f03-b108-3a94c2e8e6c6"}]': finished 2024-03-27T07:16:09.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:09 smithi149 ceph-mon[36065]: osdmap e10: 2 total, 1 up, 2 in 2024-03-27T07:16:09.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:09 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:09.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:09 smithi149 ceph-mon[36065]: from='client.? 172.21.15.149:0/1255111508' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:16:09.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:09 smithi153 ceph-mon[36179]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:09.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:09 smithi153 ceph-mon[36179]: from='client.? 172.21.15.149:0/3641235661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fb771fe-8d60-4f03-b108-3a94c2e8e6c6"}]: dispatch 2024-03-27T07:16:09.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:09 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fb771fe-8d60-4f03-b108-3a94c2e8e6c6"}]: dispatch 2024-03-27T07:16:09.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:09 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fb771fe-8d60-4f03-b108-3a94c2e8e6c6"}]': finished 2024-03-27T07:16:09.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:09 smithi153 ceph-mon[36179]: osdmap e10: 2 total, 1 up, 2 in 2024-03-27T07:16:09.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:09 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:09.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:09 smithi153 ceph-mon[36179]: from='client.? 172.21.15.149:0/1255111508' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:16:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:09 smithi082 ceph-mon[32178]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:09 smithi082 ceph-mon[32178]: from='client.? 172.21.15.149:0/3641235661' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fb771fe-8d60-4f03-b108-3a94c2e8e6c6"}]: dispatch 2024-03-27T07:16:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:09 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fb771fe-8d60-4f03-b108-3a94c2e8e6c6"}]: dispatch 2024-03-27T07:16:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:09 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fb771fe-8d60-4f03-b108-3a94c2e8e6c6"}]': finished 2024-03-27T07:16:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:09 smithi082 ceph-mon[32178]: osdmap e10: 2 total, 1 up, 2 in 2024-03-27T07:16:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:09 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:09 smithi082 ceph-mon[32178]: from='client.? 172.21.15.149:0/1255111508' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:16:11.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:11 smithi149 ceph-mon[36065]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:11.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:11 smithi153 ceph-mon[36179]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:11 smithi082 ceph-mon[32178]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:13.711 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:13 smithi149 ceph-mon[36065]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:13.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:13 smithi153 ceph-mon[36179]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:13 smithi082 ceph-mon[32178]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:15.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:15 smithi149 ceph-mon[36065]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:15.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:15 smithi153 ceph-mon[36179]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:15 smithi082 ceph-mon[32178]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:16.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:16 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-27T07:16:16.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:16 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-27T07:16:16.726 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:16.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-27T07:16:16.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:17.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:17 smithi149 ceph-mon[36065]: Deploying daemon osd.1 on smithi149 2024-03-27T07:16:17.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:17 smithi149 ceph-mon[36065]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:17.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:17 smithi153 ceph-mon[36179]: Deploying daemon osd.1 on smithi149 2024-03-27T07:16:17.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:17 smithi153 ceph-mon[36179]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:17 smithi082 ceph-mon[32178]: Deploying daemon osd.1 on smithi149 2024-03-27T07:16:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:17 smithi082 ceph-mon[32178]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:19.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:19 smithi149 ceph-mon[36065]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:19.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:19 smithi153 ceph-mon[36179]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:19.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:19 smithi082 ceph-mon[32178]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:21.670 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:21 smithi149 ceph-mon[36065]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:21.671 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:21.671 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:21.671 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:21.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:21 smithi153 ceph-mon[36179]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:21.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:21.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:21.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:21 smithi082 ceph-mon[32178]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:23.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:23 smithi149 ceph-mon[36065]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:23.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:23 smithi153 ceph-mon[36179]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:23 smithi082 ceph-mon[32178]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:24.662 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.660+0000 7f8924ff9700 1 -- 172.21.15.149:0/3588468650 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8928062a80 con 0x7f89100a3610 2024-03-27T07:16:24.662 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 1 on host 'smithi149' 2024-03-27T07:16:24.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 -- 172.21.15.149:0/3588468650 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 msgr2=0x7f89100a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:24.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 0x7f89100a5ad0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8918005ea0 tx=0x7f8918005e30 comp rx=0 tx=0).stop 2024-03-27T07:16:24.664 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 -- 172.21.15.149:0/3588468650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8928101850 msgr2=0x7f892819af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:24.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8928101850 0x7f892819af70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f891c0098e0 tx=0x7f891c0057c0 comp rx=0 tx=0).stop 2024-03-27T07:16:24.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 -- 172.21.15.149:0/3588468650 shutdown_connections 2024-03-27T07:16:24.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 0x7f89100a5ad0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:24.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8928102210 0x7f89281a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:24.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8928100ef0 0x7f892819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:24.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 --2- 172.21.15.149:0/3588468650 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8928101850 0x7f892819af70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:24.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 -- 172.21.15.149:0/3588468650 >> 172.21.15.149:0/3588468650 conn(0x7f89280fcb30 msgr2=0x7f89280fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:16:24.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 -- 172.21.15.149:0/3588468650 shutdown_connections 2024-03-27T07:16:24.665 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:16:24.662+0000 7f892dc13700 1 -- 172.21.15.149:0/3588468650 wait complete. 2024-03-27T07:16:24.896 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:24.896 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:24.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:24.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:24.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:24.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:24 smithi149 ceph-mon[36065]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:24.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:24.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:24.897 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:25.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:25.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:25.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:25.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:25.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:25.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:24 smithi082 ceph-mon[32178]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:25.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:25.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:25.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:25.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:25.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:25.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:25.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:25.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:25.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:24 smithi153 ceph-mon[36179]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:25.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:25.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:25.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:25.367 DEBUG:teuthology.orchestra.run.smithi149:osd.1> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.1.service 2024-03-27T07:16:25.378 INFO:tasks.cephadm:Deploying osd.2 on smithi153 with /dev/vg_nvme/lv_4... 2024-03-27T07:16:25.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-27T07:16:25.630 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:16:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:25 smithi149 ceph-mon[36065]: from='osd.1 [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T07:16:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:25 smithi149 ceph-mon[36065]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T07:16:26.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:25 smithi153 ceph-mon[36179]: from='osd.1 [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T07:16:26.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:25 smithi153 ceph-mon[36179]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T07:16:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:25 smithi082 ceph-mon[32178]: from='osd.1 [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T07:16:26.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:25 smithi082 ceph-mon[32178]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T07:16:26.902 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:26 smithi149 ceph-mon[36065]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-27T07:16:26.902 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:26 smithi149 ceph-mon[36065]: from='osd.1 [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:16:26.902 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:26 smithi149 ceph-mon[36065]: osdmap e11: 2 total, 1 up, 2 in 2024-03-27T07:16:26.902 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:26.902 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:26 smithi149 ceph-mon[36065]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:16:26.902 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:26 smithi149 ceph-mon[36065]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:26.903 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:16:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1[40661]: 2024-03-27T07:16:26.818+0000 7f35cdaae700 -1 osd.1 0 waiting for initial osdmap 2024-03-27T07:16:26.903 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:16:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1[40661]: 2024-03-27T07:16:26.822+0000 7f35c98a1700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:16:27.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:26 smithi153 ceph-mon[36179]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-27T07:16:27.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:26 smithi153 ceph-mon[36179]: from='osd.1 [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:16:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:26 smithi153 ceph-mon[36179]: osdmap e11: 2 total, 1 up, 2 in 2024-03-27T07:16:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:26 smithi153 ceph-mon[36179]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:16:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:26 smithi153 ceph-mon[36179]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:27.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:26 smithi082 ceph-mon[32178]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-27T07:16:27.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:26 smithi082 ceph-mon[32178]: from='osd.1 [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:16:27.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:26 smithi082 ceph-mon[32178]: osdmap e11: 2 total, 1 up, 2 in 2024-03-27T07:16:27.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:27.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:26 smithi082 ceph-mon[32178]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:16:27.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:26 smithi082 ceph-mon[32178]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-27T07:16:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-27T07:16:27.584 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-03-27T07:16:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-03-27T07:16:27.584 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114956 s, 912 MB/s 2024-03-27T07:16:27.584 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-03-27T07:16:28.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:27 smithi149 ceph-mon[36065]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:16:28.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:27 smithi149 ceph-mon[36065]: osdmap e12: 2 total, 1 up, 2 in 2024-03-27T07:16:28.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:28.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:28.182 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:27 smithi153 ceph-mon[36179]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:16:28.182 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:27 smithi153 ceph-mon[36179]: osdmap e12: 2 total, 1 up, 2 in 2024-03-27T07:16:28.182 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:28.182 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:28.182 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:28.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:27 smithi082 ceph-mon[32178]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:16:28.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:27 smithi082 ceph-mon[32178]: osdmap e12: 2 total, 1 up, 2 in 2024-03-27T07:16:28.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:28.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:28.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:28.210 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi153:vg_nvme/lv_4 2024-03-27T07:16:28.497 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:16:28.959 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: osd.1 [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] boot 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: osdmap e13: 2 total, 2 up, 2 in 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi149 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi149 to 5807M 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:28.960 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:28.961 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:28.961 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:29.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:16:29.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:16:29.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: osd.1 [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] boot 2024-03-27T07:16:29.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: osdmap e13: 2 total, 2 up, 2 in 2024-03-27T07:16:29.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi149 2024-03-27T07:16:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:16:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi149 to 5807M 2024-03-27T07:16:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:29.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:16:29.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: osd.1 [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] boot 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: osdmap e13: 2 total, 2 up, 2 in 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi149 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi149 to 5807M 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:29.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:29.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:29.982 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:29 smithi153 ceph-mon[36179]: osdmap e14: 2 total, 2 up, 2 in 2024-03-27T07:16:30.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.084+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1879027186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a74103140 msgr2=0x7f7a741099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:30.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.084+0000 7f7a79d5d700 1 --2- 172.21.15.153:0/1879027186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a74103140 0x7f7a741099f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00b0a0 tx=0x7f7a6c00b3b0 comp rx=0 tx=0).stop 2024-03-27T07:16:30.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.084+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1879027186 shutdown_connections 2024-03-27T07:16:30.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.084+0000 7f7a79d5d700 1 --2- 172.21.15.153:0/1879027186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a74103140 0x7f7a741099f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:30.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.084+0000 7f7a79d5d700 1 --2- 172.21.15.153:0/1879027186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a741015a0 0x7f7a741019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:30.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.084+0000 7f7a79d5d700 1 --2- 172.21.15.153:0/1879027186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a741027a0 0x7f7a74102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:30.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.084+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1879027186 >> 172.21.15.153:0/1879027186 conn(0x7f7a740fcb40 msgr2=0x7f7a740fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:16:30.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.084+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1879027186 shutdown_connections 2024-03-27T07:16:30.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.084+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1879027186 wait complete. 2024-03-27T07:16:30.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.084+0000 7f7a79d5d700 1 Processor -- start 2024-03-27T07:16:30.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a79d5d700 1 -- start start 2024-03-27T07:16:30.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a79d5d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a741015a0 0x7f7a74198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:30.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a79d5d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a741027a0 0x7f7a74198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:30.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a79d5d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a74103140 0x7f7a7419ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:30.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a79d5d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410d280 con 0x7f7a741027a0 2024-03-27T07:16:30.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a79d5d700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410d100 con 0x7f7a74103140 2024-03-27T07:16:30.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a79d5d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7410d400 con 0x7f7a741015a0 2024-03-27T07:16:30.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a737fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a741015a0 0x7f7a74198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:30.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a737fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a741015a0 0x7f7a74198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47106/0 (socket says 172.21.15.153:47106) 2024-03-27T07:16:30.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a737fe700 1 -- 172.21.15.153:0/1577763564 learned_addr learned my addr 172.21.15.153:0/1577763564 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a73fff700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a74103140 0x7f7a7419ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a6affd700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a741027a0 0x7f7a74198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a737fe700 1 -- 172.21.15.153:0/1577763564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a74103140 msgr2=0x7f7a7419ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a737fe700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a74103140 0x7f7a7419ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a737fe700 1 -- 172.21.15.153:0/1577763564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a741027a0 msgr2=0x7f7a74198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a737fe700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a741027a0 0x7f7a74198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.085+0000 7f7a737fe700 1 -- 172.21.15.153:0/1577763564 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a741a0660 con 0x7f7a741015a0 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.086+0000 7f7a737fe700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a741015a0 0x7f7a74198a50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400b530 tx=0x7f7a6400b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.086+0000 7f7a717fa700 1 -- 172.21.15.153:0/1577763564 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64015020 con 0x7f7a741015a0 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.086+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1577763564 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a741a0950 con 0x7f7a741015a0 2024-03-27T07:16:30.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.086+0000 7f7a717fa700 1 -- 172.21.15.153:0/1577763564 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a64011d10 con 0x7f7a741015a0 2024-03-27T07:16:30.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.086+0000 7f7a717fa700 1 -- 172.21.15.153:0/1577763564 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400f2e0 con 0x7f7a741015a0 2024-03-27T07:16:30.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.086+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1577763564 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a741a0f60 con 0x7f7a741015a0 2024-03-27T07:16:30.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.087+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1577763564 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a74069300 con 0x7f7a741015a0 2024-03-27T07:16:30.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.088+0000 7f7a717fa700 1 -- 172.21.15.153:0/1577763564 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 15) ==== 138314+0+0 (secure 0 0 0) 0x7f7a64018020 con 0x7f7a741015a0 2024-03-27T07:16:30.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.088+0000 7f7a717fa700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7a600a3610 0x7f7a600a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:30.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.088+0000 7f7a717fa700 1 -- 172.21.15.153:0/1577763564 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f7a640cdc90 con 0x7f7a741015a0 2024-03-27T07:16:30.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.089+0000 7f7a6affd700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7a600a3610 0x7f7a600a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:30.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.089+0000 7f7a6affd700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7a600a3610 0x7f7a600a5ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c006fd0 tx=0x7f7a5c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:16:30.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.094+0000 7f7a717fa700 1 -- 172.21.15.153:0/1577763564 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7a640d3020 con 0x7f7a741015a0 2024-03-27T07:16:30.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:29 smithi082 ceph-mon[32178]: osdmap e14: 2 total, 2 up, 2 in 2024-03-27T07:16:30.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:29 smithi149 ceph-mon[36065]: osdmap e14: 2 total, 2 up, 2 in 2024-03-27T07:16:30.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:30.297+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1577763564 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7a740fec90 con 0x7f7a600a3610 2024-03-27T07:16:31.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:30 smithi153 ceph-mon[36179]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:16:31.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:16:31.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:16:31.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:31.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:30 smithi153 ceph-mon[36179]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:31.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:30 smithi082 ceph-mon[32178]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:16:31.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:16:31.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:16:31.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:31.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:30 smithi082 ceph-mon[32178]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:31.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:30 smithi149 ceph-mon[36065]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:16:31.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:16:31.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:16:31.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:31.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:30 smithi149 ceph-mon[36065]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:33.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:33 smithi149 ceph-mon[36065]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:33.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:33 smithi149 ceph-mon[36065]: from='client.? 172.21.15.153:0/1410269076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91427a95-87e5-4e0f-b881-9886eea7cd86"}]: dispatch 2024-03-27T07:16:33.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:33 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91427a95-87e5-4e0f-b881-9886eea7cd86"}]: dispatch 2024-03-27T07:16:33.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:33 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91427a95-87e5-4e0f-b881-9886eea7cd86"}]': finished 2024-03-27T07:16:33.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:33 smithi149 ceph-mon[36065]: osdmap e15: 3 total, 2 up, 3 in 2024-03-27T07:16:33.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:33.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:33 smithi153 ceph-mon[36179]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:33.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:33 smithi153 ceph-mon[36179]: from='client.? 172.21.15.153:0/1410269076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91427a95-87e5-4e0f-b881-9886eea7cd86"}]: dispatch 2024-03-27T07:16:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:33 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91427a95-87e5-4e0f-b881-9886eea7cd86"}]: dispatch 2024-03-27T07:16:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:33 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91427a95-87e5-4e0f-b881-9886eea7cd86"}]': finished 2024-03-27T07:16:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:33 smithi153 ceph-mon[36179]: osdmap e15: 3 total, 2 up, 3 in 2024-03-27T07:16:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:33 smithi082 ceph-mon[32178]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:33 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/1410269076' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91427a95-87e5-4e0f-b881-9886eea7cd86"}]: dispatch 2024-03-27T07:16:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:33 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91427a95-87e5-4e0f-b881-9886eea7cd86"}]: dispatch 2024-03-27T07:16:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:33 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91427a95-87e5-4e0f-b881-9886eea7cd86"}]': finished 2024-03-27T07:16:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:33 smithi082 ceph-mon[32178]: osdmap e15: 3 total, 2 up, 3 in 2024-03-27T07:16:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:34.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:34 smithi149 ceph-mon[36065]: from='client.? 172.21.15.153:0/52395531' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:16:34.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:34 smithi153 ceph-mon[36179]: from='client.? 172.21.15.153:0/52395531' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:16:34.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:34 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/52395531' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:16:35.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:35 smithi149 ceph-mon[36065]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:35.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:35 smithi153 ceph-mon[36179]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:35 smithi082 ceph-mon[32178]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:37.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:37 smithi149 ceph-mon[36065]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:37.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:37 smithi153 ceph-mon[36179]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:37 smithi082 ceph-mon[32178]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:39.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:39 smithi149 ceph-mon[36065]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:39.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:39 smithi153 ceph-mon[36179]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:39 smithi082 ceph-mon[32178]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:40.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:40 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-27T07:16:40.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:40 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:40.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:40 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-27T07:16:40.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:40 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:40.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-27T07:16:40.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:41.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:41 smithi149 ceph-mon[36065]: Deploying daemon osd.2 on smithi153 2024-03-27T07:16:41.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:41 smithi149 ceph-mon[36065]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:41.756 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:41 smithi153 ceph-mon[36179]: Deploying daemon osd.2 on smithi153 2024-03-27T07:16:41.756 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:41 smithi153 ceph-mon[36179]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:41 smithi082 ceph-mon[32178]: Deploying daemon osd.2 on smithi153 2024-03-27T07:16:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:41 smithi082 ceph-mon[32178]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:43.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:43 smithi149 ceph-mon[36065]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:43.771 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:43 smithi153 ceph-mon[36179]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:43.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:43 smithi082 ceph-mon[32178]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:45 smithi149 ceph-mon[36065]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:45.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:45 smithi153 ceph-mon[36179]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:45 smithi082 ceph-mon[32178]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:46.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:46.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:46.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:46.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:46.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:46.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:46.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:46.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:46.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:47.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:47 smithi149 ceph-mon[36065]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:47.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:47 smithi153 ceph-mon[36179]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:47.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:47 smithi082 ceph-mon[32178]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:48.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.917+0000 7f7a717fa700 1 -- 172.21.15.153:0/1577763564 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7a740fec90 con 0x7f7a600a3610 2024-03-27T07:16:48.919 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 2 on host 'smithi153' 2024-03-27T07:16:48.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1577763564 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7a600a3610 msgr2=0x7f7a600a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:48.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7a600a3610 0x7f7a600a5ad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c006fd0 tx=0x7f7a5c008040 comp rx=0 tx=0).stop 2024-03-27T07:16:48.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1577763564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a741015a0 msgr2=0x7f7a74198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:48.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a741015a0 0x7f7a74198a50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7a6400b530 tx=0x7f7a6400b8f0 comp rx=0 tx=0).stop 2024-03-27T07:16:48.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1577763564 shutdown_connections 2024-03-27T07:16:48.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7a600a3610 0x7f7a600a5ad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:48.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a741015a0 0x7f7a74198a50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:48.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7a74103140 0x7f7a7419ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:48.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 --2- 172.21.15.153:0/1577763564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7a741027a0 0x7f7a74198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:48.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1577763564 >> 172.21.15.153:0/1577763564 conn(0x7f7a740fcb40 msgr2=0x7f7a740fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:16:48.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1577763564 shutdown_connections 2024-03-27T07:16:48.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:16:48.920+0000 7f7a79d5d700 1 -- 172.21.15.153:0/1577763564 wait complete. 2024-03-27T07:16:49.545 DEBUG:teuthology.orchestra.run.smithi153:osd.2> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.2.service 2024-03-27T07:16:49.547 INFO:tasks.cephadm:Deploying osd.3 on smithi082 with /dev/vg_nvme/lv_3... 2024-03-27T07:16:49.548 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-27T07:16:49.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:49 smithi149 ceph-mon[36065]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:49.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:49 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:49.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:49 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:49.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:49 smithi153 ceph-mon[36179]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:49.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:49 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:49.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:49 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:49.798 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:16:49.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:49 smithi082 ceph-mon[32178]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:49.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:49 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:49.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:49 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:50.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:50 smithi153 ceph-mon[36179]: from='osd.2 [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T07:16:50.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:50 smithi153 ceph-mon[36179]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T07:16:50.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:50 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:50.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:50 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:50.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:50 smithi082 ceph-mon[32178]: from='osd.2 [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T07:16:50.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:50 smithi082 ceph-mon[32178]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T07:16:50.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:50 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:50.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:50 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:50.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:50 smithi149 ceph-mon[36065]: from='osd.2 [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T07:16:50.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:50 smithi149 ceph-mon[36065]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T07:16:50.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:50 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:50.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:50 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:51.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:51 smithi082 ceph-mon[32178]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:51.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:51 smithi082 ceph-mon[32178]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-27T07:16:51.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:51 smithi082 ceph-mon[32178]: osdmap e16: 3 total, 2 up, 3 in 2024-03-27T07:16:51.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:51 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:51.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:51 smithi082 ceph-mon[32178]: from='osd.2 [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:16:51.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:51 smithi082 ceph-mon[32178]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:16:51.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:51 smithi149 ceph-mon[36065]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:51.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:51 smithi149 ceph-mon[36065]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-27T07:16:51.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:51 smithi149 ceph-mon[36065]: osdmap e16: 3 total, 2 up, 3 in 2024-03-27T07:16:51.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:51 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:51.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:51 smithi149 ceph-mon[36065]: from='osd.2 [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:16:51.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:51 smithi149 ceph-mon[36065]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:16:51.779 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:51 smithi153 ceph-mon[36179]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:51.779 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:51 smithi153 ceph-mon[36179]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-27T07:16:51.779 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:51 smithi153 ceph-mon[36179]: osdmap e16: 3 total, 2 up, 3 in 2024-03-27T07:16:51.779 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:51 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:51.780 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:51 smithi153 ceph-mon[36179]: from='osd.2 [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:16:51.780 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:51 smithi153 ceph-mon[36179]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:16:51.843 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-27T07:16:51.843 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-27T07:16:51.843 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-03-27T07:16:51.843 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-03-27T07:16:51.843 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011508 s, 911 MB/s 2024-03-27T07:16:51.843 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-03-27T07:16:52.037 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:16:51 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2[41532]: 2024-03-27T07:16:51.940+0000 7f218f9d5700 -1 osd.2 0 waiting for initial osdmap 2024-03-27T07:16:52.037 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:16:51 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2[41532]: 2024-03-27T07:16:51.945+0000 7f21877c0700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:16:52.492 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-03-27T07:16:52.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:52 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:16:52.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:52 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:16:52.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:52 smithi153 ceph-mon[36179]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:16:52.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:52 smithi153 ceph-mon[36179]: osdmap e17: 3 total, 2 up, 3 in 2024-03-27T07:16:52.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:52 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:52.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:52 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:52.735 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:52 smithi153 ceph-mon[36179]: from='osd.2 ' entity='osd.2' 2024-03-27T07:16:52.736 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:16:52.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:52 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:16:52.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:52 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:16:52.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:52 smithi149 ceph-mon[36065]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:16:52.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:52 smithi149 ceph-mon[36065]: osdmap e17: 3 total, 2 up, 3 in 2024-03-27T07:16:52.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:52 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:52.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:52 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:52.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:52 smithi149 ceph-mon[36065]: from='osd.2 ' entity='osd.2' 2024-03-27T07:16:52.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:52 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:16:52.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:52 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:16:52.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:52 smithi082 ceph-mon[32178]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:16:52.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:52 smithi082 ceph-mon[32178]: osdmap e17: 3 total, 2 up, 3 in 2024-03-27T07:16:52.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:52 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:52.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:52 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:52.770 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:52 smithi082 ceph-mon[32178]: from='osd.2 ' entity='osd.2' 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: osd.2 [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] boot 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: osdmap e18: 3 total, 3 up, 3 in 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:53.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:53.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:53.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:53.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:53.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: osd.2 [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] boot 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: osdmap e18: 3 total, 3 up, 3 in 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:53.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:53.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:53.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.888 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-03-27T07:16:53.888 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:53.888 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: osd.2 [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] boot 2024-03-27T07:16:53.888 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: osdmap e18: 3 total, 3 up, 3 in 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:16:53.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:54.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.367+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1269691605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb201083d0 msgr2=0x7fcb2010a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:54.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.367+0000 7fcb27ae5700 1 --2- 172.21.15.82:0/1269691605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb201083d0 0x7fcb2010a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800b0a0 tx=0x7fcb1800b3b0 comp rx=0 tx=0).stop 2024-03-27T07:16:54.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.367+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1269691605 shutdown_connections 2024-03-27T07:16:54.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.367+0000 7fcb27ae5700 1 --2- 172.21.15.82:0/1269691605 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb20103170 0x7fcb20105560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:54.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.367+0000 7fcb27ae5700 1 --2- 172.21.15.82:0/1269691605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb201083d0 0x7fcb2010a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:54.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.367+0000 7fcb27ae5700 1 --2- 172.21.15.82:0/1269691605 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb20105aa0 0x7fcb20107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:54.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.367+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1269691605 >> 172.21.15.82:0/1269691605 conn(0x7fcb200fcba0 msgr2=0x7fcb200fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:16:54.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.367+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1269691605 shutdown_connections 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.367+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1269691605 wait complete. 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.367+0000 7fcb27ae5700 1 Processor -- start 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb27ae5700 1 -- start start 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb27ae5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb20103170 0x7fcb201987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb27ae5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb20105aa0 0x7fcb20198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb27ae5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb201083d0 0x7fcb2019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb27ae5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2010e250 con 0x7fcb201083d0 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb27ae5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2010e0d0 con 0x7fcb20105aa0 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb27ae5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2010e3d0 con 0x7fcb20103170 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb26082700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb201083d0 0x7fcb2019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb26082700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb201083d0 0x7fcb2019fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44662/0 (socket says 172.21.15.82:44662) 2024-03-27T07:16:54.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb26082700 1 -- 172.21.15.82:0/1087329492 learned_addr learned my addr 172.21.15.82:0/1087329492 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb25881700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb20103170 0x7fcb201987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb25080700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb20105aa0 0x7fcb20198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb26082700 1 -- 172.21.15.82:0/1087329492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb20103170 msgr2=0x7fcb201987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb26082700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb20103170 0x7fcb201987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb26082700 1 -- 172.21.15.82:0/1087329492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb20105aa0 msgr2=0x7fcb20198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb26082700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb20105aa0 0x7fcb20198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb26082700 1 -- 172.21.15.82:0/1087329492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb201a0450 con 0x7fcb201083d0 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb26082700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb201083d0 0x7fcb2019fdb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800b070 tx=0x7fcb18004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb16ffd700 1 -- 172.21.15.82:0/1087329492 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18021070 con 0x7fcb201083d0 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb16ffd700 1 -- 172.21.15.82:0/1087329492 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcb18007b80 con 0x7fcb201083d0 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1087329492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb201a06e0 con 0x7fcb201083d0 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.368+0000 7fcb16ffd700 1 -- 172.21.15.82:0/1087329492 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1801d450 con 0x7fcb201083d0 2024-03-27T07:16:54.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.369+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1087329492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb201a0be0 con 0x7fcb201083d0 2024-03-27T07:16:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.370+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1087329492 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb20069300 con 0x7fcb201083d0 2024-03-27T07:16:54.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.370+0000 7fcb16ffd700 1 -- 172.21.15.82:0/1087329492 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) ==== 138314+0+0 (secure 0 0 0) 0x7fcb18004000 con 0x7fcb201083d0 2024-03-27T07:16:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.371+0000 7fcb16ffd700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcb0c0a3690 0x7fcb0c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:16:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.371+0000 7fcb25881700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcb0c0a3690 0x7fcb0c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:16:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.371+0000 7fcb16ffd700 1 -- 172.21.15.82:0/1087329492 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7fcb1800f020 con 0x7fcb201083d0 2024-03-27T07:16:54.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.371+0000 7fcb25881700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcb0c0a3690 0x7fcb0c0a5b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c004630 tx=0x7fcb1c00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:16:54.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.376+0000 7fcb16ffd700 1 -- 172.21.15.82:0/1087329492 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fcb1802a020 con 0x7fcb201083d0 2024-03-27T07:16:54.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:54.585+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1087329492 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fcb20062a80 con 0x7fcb0c0a3690 2024-03-27T07:16:54.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:54 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi153 2024-03-27T07:16:54.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:54 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi153 to 17080M 2024-03-27T07:16:54.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:16:54.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:54 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi153 2024-03-27T07:16:54.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:54 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi153 to 17080M 2024-03-27T07:16:54.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:16:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:54 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi153 2024-03-27T07:16:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:54 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi153 to 17080M 2024-03-27T07:16:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:16:55.765 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 ceph-mon[36179]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:16:55.766 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-27T07:16:55.766 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 ceph-mon[36179]: osdmap e19: 3 total, 3 up, 3 in 2024-03-27T07:16:55.766 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:16:55.766 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 ceph-mon[36179]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:16:55.766 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:16:55.766 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:16:55.766 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:55.766 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45172]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T07:16:55.766 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45172]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:55.766 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45172]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:55.767 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45172]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:55.801 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 ceph-mon[32178]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:16:55.801 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-27T07:16:55.801 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 ceph-mon[32178]: osdmap e19: 3 total, 3 up, 3 in 2024-03-27T07:16:55.801 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:16:55.801 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 ceph-mon[32178]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:16:55.802 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:16:55.802 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:16:55.802 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:55.802 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52035]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T07:16:55.802 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52035]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:55.802 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52035]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:55.802 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52035]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:55.802 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52038]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T07:16:55.802 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52038]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:55.802 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52038]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:55.802 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52038]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:55.876 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 ceph-mon[36065]: pgmap v82: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:16:55.876 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-27T07:16:55.876 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 ceph-mon[36065]: osdmap e19: 3 total, 3 up, 3 in 2024-03-27T07:16:55.876 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:16:55.876 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 ceph-mon[36065]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:16:55.876 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:16:55.876 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:16:55.876 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:16:55.877 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44827]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T07:16:55.877 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44827]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:55.877 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44827]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:55.877 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44827]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:55.877 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44830]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T07:16:55.877 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44830]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:55.877 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44830]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:55.877 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44830]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:56.037 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45175]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T07:16:56.037 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45175]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:56.038 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45175]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:56.038 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45175]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45178]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T07:16:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45178]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45178]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45178]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45181]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T07:16:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45181]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45181]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:55 smithi153 sudo[45181]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:56.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52041]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T07:16:56.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52041]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:56.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52041]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:56.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52041]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:56.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52045]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T07:16:56.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52045]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:56.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52045]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:56.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:55 smithi082 sudo[52045]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:56.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44833]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T07:16:56.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44833]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:56.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44833]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:56.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44833]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:56.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44836]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T07:16:56.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44836]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T07:16:56.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44836]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T07:16:56.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:55 smithi149 sudo[44836]: pam_unix(sudo:session): session closed for user root 2024-03-27T07:16:56.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-27T07:16:56.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: osdmap e20: 3 total, 3 up, 3 in 2024-03-27T07:16:56.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:56.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:56.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T07:16:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T07:16:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:16:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:16:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:16:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T07:16:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:16:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:16:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:16:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T07:16:56.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T07:16:56.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:16:56.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:16:56.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:16:56.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:56 smithi082 ceph-mon[32178]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T07:16:56.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-27T07:16:56.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: osdmap e20: 3 total, 3 up, 3 in 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:16:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T07:16:56.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T07:16:56.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:16:56.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:16:56.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:16:56.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:56 smithi153 ceph-mon[36179]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T07:16:57.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-27T07:16:57.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: osdmap e20: 3 total, 3 up, 3 in 2024-03-27T07:16:57.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:57.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:57.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:16:57.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T07:16:57.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:16:57.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:56 smithi149 ceph-mon[36065]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T07:16:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:57 smithi153 ceph-mon[36179]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:16:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:57 smithi153 ceph-mon[36179]: osdmap e21: 3 total, 3 up, 3 in 2024-03-27T07:16:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:57 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1717050024' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fdaf48a-424a-48a1-b666-53dfd853d486"}]: dispatch 2024-03-27T07:16:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:57 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1717050024' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fdaf48a-424a-48a1-b666-53dfd853d486"}]': finished 2024-03-27T07:16:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:57 smithi153 ceph-mon[36179]: osdmap e22: 4 total, 3 up, 4 in 2024-03-27T07:16:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:16:57.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:16:57.800+0000 7fcb16ffd700 1 -- 172.21.15.82:0/1087329492 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fcb18099e20 con 0x7fcb201083d0 2024-03-27T07:16:57.803 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:57 smithi082 ceph-mon[32178]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:16:57.803 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:57 smithi082 ceph-mon[32178]: osdmap e21: 3 total, 3 up, 3 in 2024-03-27T07:16:57.803 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:57 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1717050024' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fdaf48a-424a-48a1-b666-53dfd853d486"}]: dispatch 2024-03-27T07:16:57.803 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:57 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1717050024' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fdaf48a-424a-48a1-b666-53dfd853d486"}]': finished 2024-03-27T07:16:57.803 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:57 smithi082 ceph-mon[32178]: osdmap e22: 4 total, 3 up, 4 in 2024-03-27T07:16:57.803 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:16:58.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:57 smithi149 ceph-mon[36065]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:16:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:57 smithi149 ceph-mon[36065]: osdmap e21: 3 total, 3 up, 3 in 2024-03-27T07:16:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:57 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1717050024' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0fdaf48a-424a-48a1-b666-53dfd853d486"}]: dispatch 2024-03-27T07:16:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:57 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1717050024' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0fdaf48a-424a-48a1-b666-53dfd853d486"}]': finished 2024-03-27T07:16:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:57 smithi149 ceph-mon[36065]: osdmap e22: 4 total, 3 up, 4 in 2024-03-27T07:16:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:16:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:58 smithi082 ceph-mon[32178]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-27T07:16:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:58 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1707563166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:16:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:16:58 smithi082 ceph-mon[32178]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:16:59.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:58 smithi149 ceph-mon[36065]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-27T07:16:59.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:58 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1707563166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:16:59.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:16:58 smithi149 ceph-mon[36065]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:16:59.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:58 smithi153 ceph-mon[36179]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-03-27T07:16:59.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:58 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1707563166' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:16:59.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:16:58 smithi153 ceph-mon[36179]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:01.549 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:01 smithi082 ceph-mon[32178]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:01.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:01 smithi149 ceph-mon[36065]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:01.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:01 smithi153 ceph-mon[36179]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:03.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:03 smithi082 ceph-mon[32178]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:03.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:03 smithi149 ceph-mon[36065]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:03.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:03 smithi153 ceph-mon[36179]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:05.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:05 smithi149 ceph-mon[36065]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:05.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-27T07:17:05.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:05.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:05 smithi149 ceph-mon[36065]: Deploying daemon osd.3 on smithi082 2024-03-27T07:17:05.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:05 smithi153 ceph-mon[36179]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:05.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-27T07:17:05.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:05.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:05 smithi153 ceph-mon[36179]: Deploying daemon osd.3 on smithi082 2024-03-27T07:17:05.844 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:05 smithi082 ceph-mon[32178]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:05.844 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-27T07:17:05.844 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:05.844 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:05 smithi082 ceph-mon[32178]: Deploying daemon osd.3 on smithi082 2024-03-27T07:17:07.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:07 smithi082 ceph-mon[32178]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:07.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:07 smithi149 ceph-mon[36065]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:07.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:07 smithi153 ceph-mon[36179]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:09.527 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:09 smithi082 ceph-mon[32178]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:09.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:09 smithi149 ceph-mon[36065]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:09.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:09 smithi153 ceph-mon[36179]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:11.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:11 smithi082 ceph-mon[32178]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:11.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:11.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:11.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:11.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:11 smithi149 ceph-mon[36065]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:11.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:11.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:11.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:11.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:11 smithi153 ceph-mon[36179]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:13.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:13 smithi149 ceph-mon[36065]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:13.857 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:13 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:13.857 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:13 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:13.857 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:13 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:13.857 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:13 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:13.857 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:13 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:13.858 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:13 smithi153 ceph-mon[36179]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:13.858 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:13 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:13.858 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:13 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:13.858 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:13 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:13.858 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:13 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:13.858 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:13 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:13.858 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:13 smithi082 ceph-mon[32178]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:13.858 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:13 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:13.858 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:13 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:13.859 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:13 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:13.859 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:13 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:13.859 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:13 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:13.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.839+0000 7fcb16ffd700 1 -- 172.21.15.82:0/1087329492 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcb20062a80 con 0x7fcb0c0a3690 2024-03-27T07:17:13.859 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 3 on host 'smithi082' 2024-03-27T07:17:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1087329492 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcb0c0a3690 msgr2=0x7fcb0c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:17:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcb0c0a3690 0x7fcb0c0a5b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c004630 tx=0x7fcb1c00b3c0 comp rx=0 tx=0).stop 2024-03-27T07:17:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1087329492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb201083d0 msgr2=0x7fcb2019fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:17:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb201083d0 0x7fcb2019fdb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800b070 tx=0x7fcb18004d00 comp rx=0 tx=0).stop 2024-03-27T07:17:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1087329492 shutdown_connections 2024-03-27T07:17:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcb0c0a3690 0x7fcb0c0a5b50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb20103170 0x7fcb201987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb201083d0 0x7fcb2019fdb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:13.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 --2- 172.21.15.82:0/1087329492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcb20105aa0 0x7fcb20198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:13.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1087329492 >> 172.21.15.82:0/1087329492 conn(0x7fcb200fcba0 msgr2=0x7fcb20103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:17:13.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1087329492 shutdown_connections 2024-03-27T07:17:13.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:17:13.841+0000 7fcb27ae5700 1 -- 172.21.15.82:0/1087329492 wait complete. 2024-03-27T07:17:14.469 DEBUG:teuthology.orchestra.run.smithi082:osd.3> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.3.service 2024-03-27T07:17:14.472 INFO:tasks.cephadm:Deploying osd.4 on smithi149 with /dev/vg_nvme/lv_3... 2024-03-27T07:17:14.472 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-27T07:17:14.712 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:17:15.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:15.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:15.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:15.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:14 smithi149 ceph-mon[36065]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-27T07:17:15.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:14 smithi149 ceph-mon[36065]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:15.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:15.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:15.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:15.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:14 smithi082 ceph-mon[32178]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-27T07:17:15.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:14 smithi082 ceph-mon[32178]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:15.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:15.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:15.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:15.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:14 smithi153 ceph-mon[36179]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-27T07:17:15.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:14 smithi153 ceph-mon[36179]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:15.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:15 smithi082 ceph-mon[32178]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-27T07:17:15.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:15 smithi082 ceph-mon[32178]: osdmap e23: 4 total, 3 up, 4 in 2024-03-27T07:17:15.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:15 smithi082 ceph-mon[32178]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:17:15.914 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:15 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:15.914 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:17:15 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3[54171]: 2024-03-27T07:17:15.835+0000 7f51a97c6700 -1 osd.3 0 waiting for initial osdmap 2024-03-27T07:17:15.914 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:17:15 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3[54171]: 2024-03-27T07:17:15.840+0000 7f51a55b9700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:17:16.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:15 smithi149 ceph-mon[36065]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-27T07:17:16.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:15 smithi149 ceph-mon[36065]: osdmap e23: 4 total, 3 up, 4 in 2024-03-27T07:17:16.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:15 smithi149 ceph-mon[36065]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:17:16.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:15 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:16.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:15 smithi153 ceph-mon[36179]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-27T07:17:16.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:15 smithi153 ceph-mon[36179]: osdmap e23: 4 total, 3 up, 4 in 2024-03-27T07:17:16.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:15 smithi153 ceph-mon[36179]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:17:16.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:15 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:16.566 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-27T07:17:16.566 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-27T07:17:16.566 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-03-27T07:17:16.566 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-03-27T07:17:16.567 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112251 s, 934 MB/s 2024-03-27T07:17:16.567 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-03-27T07:17:17.161 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:16 smithi149 ceph-mon[36065]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:17:17.161 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:16 smithi149 ceph-mon[36065]: osdmap e24: 4 total, 3 up, 4 in 2024-03-27T07:17:17.161 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:16 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:17.161 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:16 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:17.162 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:16 smithi149 ceph-mon[36065]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:16 smithi082 ceph-mon[32178]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:17:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:16 smithi082 ceph-mon[32178]: osdmap e24: 4 total, 3 up, 4 in 2024-03-27T07:17:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:17.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:16 smithi082 ceph-mon[32178]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:17.188 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi149:vg_nvme/lv_3 2024-03-27T07:17:17.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:16 smithi153 ceph-mon[36179]: from='osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:17:17.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:16 smithi153 ceph-mon[36179]: osdmap e24: 4 total, 3 up, 4 in 2024-03-27T07:17:17.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:17.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:17.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:16 smithi153 ceph-mon[36179]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T07:17:17.441 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:17:18.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] boot 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: osdmap e25: 4 total, 4 up, 4 in 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi082 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi082 to 8544M 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:18.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:17 smithi149 ceph-mon[36065]: osdmap e26: 4 total, 4 up, 4 in 2024-03-27T07:17:18.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:17:18.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] boot 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: osdmap e25: 4 total, 4 up, 4 in 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi082 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi082 to 8544M 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:18.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:18.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:17 smithi082 ceph-mon[32178]: osdmap e26: 4 total, 4 up, 4 in 2024-03-27T07:17:18.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: osd.3 [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] boot 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: osdmap e25: 4 total, 4 up, 4 in 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi082 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi082 to 8544M 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:18.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:17 smithi153 ceph-mon[36179]: osdmap e26: 4 total, 4 up, 4 in 2024-03-27T07:17:18.869 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:18 smithi149 ceph-mon[36065]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:18.870 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:18 smithi149 ceph-mon[36065]: osdmap e27: 4 total, 4 up, 4 in 2024-03-27T07:17:19.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.072+0000 7f10066da700 1 -- 172.21.15.149:0/3764099475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000101570 msgr2=0x7f1000101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:17:19.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.072+0000 7f10066da700 1 --2- 172.21.15.149:0/3764099475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000101570 0x7f1000101990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00099c0 tx=0x7f0ff0009cd0 comp rx=0 tx=0).stop 2024-03-27T07:17:19.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.072+0000 7f10066da700 1 -- 172.21.15.149:0/3764099475 shutdown_connections 2024-03-27T07:17:19.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.072+0000 7f10066da700 1 --2- 172.21.15.149:0/3764099475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1000103110 0x7f10001099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:19.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.072+0000 7f10066da700 1 --2- 172.21.15.149:0/3764099475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000101570 0x7f1000101990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:19.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.072+0000 7f10066da700 1 --2- 172.21.15.149:0/3764099475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1000102770 0x7f1000102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:19.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.072+0000 7f10066da700 1 -- 172.21.15.149:0/3764099475 >> 172.21.15.149:0/3764099475 conn(0x7f10000fcb10 msgr2=0x7f10000fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:17:19.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.072+0000 7f10066da700 1 -- 172.21.15.149:0/3764099475 shutdown_connections 2024-03-27T07:17:19.080 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.072+0000 7f10066da700 1 -- 172.21.15.149:0/3764099475 wait complete. 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f10066da700 1 Processor -- start 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f10066da700 1 -- start start 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f10066da700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1000101570 0x7f100006aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f10066da700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000102770 0x7f100019d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f10066da700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1000103110 0x7f100019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f10066da700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f100010d230 con 0x7f1000103110 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f10066da700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f100010d0b0 con 0x7f1000102770 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f10066da700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f100010d3b0 con 0x7f1000101570 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f0fff7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000102770 0x7f100019d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f0fff7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000102770 0x7f100019d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:36404/0 (socket says 172.21.15.149:36404) 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f0fff7fe700 1 -- 172.21.15.149:0/3251862668 learned_addr learned my addr 172.21.15.149:0/3251862668 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f1004c77700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1000103110 0x7f100019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f0ffffff700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1000101570 0x7f100006aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f0fff7fe700 1 -- 172.21.15.149:0/3251862668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1000101570 msgr2=0x7f100006aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:17:19.081 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f0fff7fe700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1000101570 0x7f100006aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f0fff7fe700 1 -- 172.21.15.149:0/3251862668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1000103110 msgr2=0x7f100019fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f0fff7fe700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1000103110 0x7f100019fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f0fff7fe700 1 -- 172.21.15.149:0/3251862668 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10001a06c0 con 0x7f1000102770 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.073+0000 7f0fff7fe700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000102770 0x7f100019d760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400b530 tx=0x7f0ff400b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.074+0000 7f0ffd7fa700 1 -- 172.21.15.149:0/3251862668 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4015020 con 0x7f1000102770 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.074+0000 7f10066da700 1 -- 172.21.15.149:0/3251862668 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10001a09b0 con 0x7f1000102770 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.074+0000 7f0ffd7fa700 1 -- 172.21.15.149:0/3251862668 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ff4011d10 con 0x7f1000102770 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.074+0000 7f0ffd7fa700 1 -- 172.21.15.149:0/3251862668 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4010e50 con 0x7f1000102770 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.074+0000 7f10066da700 1 -- 172.21.15.149:0/3251862668 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10001a0fc0 con 0x7f1000102770 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.075+0000 7f10066da700 1 -- 172.21.15.149:0/3251862668 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1000069300 con 0x7f1000102770 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.076+0000 7f0ffd7fa700 1 -- 172.21.15.149:0/3251862668 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f0ff4018020 con 0x7f1000102770 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.076+0000 7f0ffd7fa700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0fe80a3840 0x7f0fe80a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:17:19.082 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.076+0000 7f0ffd7fa700 1 -- 172.21.15.149:0/3251862668 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3698+0+0 (secure 0 0 0) 0x7f0ff40ce3a0 con 0x7f1000102770 2024-03-27T07:17:19.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.076+0000 7f0ffffff700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0fe80a3840 0x7f0fe80a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:17:19.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.077+0000 7f0ffffff700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0fe80a3840 0x7f0fe80a5d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00039c0 tx=0x7f0ff0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:17:19.083 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.081+0000 7f0ffd7fa700 1 -- 172.21.15.149:0/3251862668 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0ff401f020 con 0x7f1000102770 2024-03-27T07:17:19.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:18 smithi082 ceph-mon[32178]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:19.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:18 smithi082 ceph-mon[32178]: osdmap e27: 4 total, 4 up, 4 in 2024-03-27T07:17:19.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:18 smithi153 ceph-mon[36179]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:19.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:18 smithi153 ceph-mon[36179]: osdmap e27: 4 total, 4 up, 4 in 2024-03-27T07:17:19.289 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:19.287+0000 7f10066da700 1 -- 172.21.15.149:0/3251862668 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1000062a80 con 0x7f0fe80a3840 2024-03-27T07:17:20.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:19 smithi082 ceph-mon[32178]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:17:20.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:17:20.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:17:20.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:20.205 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:19 smithi149 ceph-mon[36065]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:17:20.205 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:17:20.205 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:17:20.205 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:20.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:19 smithi153 ceph-mon[36179]: from='client.24218 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:17:20.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:17:20.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:17:20.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:21.118 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:20 smithi149 ceph-mon[36065]: osdmap e28: 4 total, 4 up, 4 in 2024-03-27T07:17:21.118 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:20 smithi149 ceph-mon[36065]: pgmap v105: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-03-27T07:17:21.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:20 smithi082 ceph-mon[32178]: osdmap e28: 4 total, 4 up, 4 in 2024-03-27T07:17:21.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:20 smithi082 ceph-mon[32178]: pgmap v105: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-03-27T07:17:21.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:20 smithi153 ceph-mon[36179]: osdmap e28: 4 total, 4 up, 4 in 2024-03-27T07:17:21.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:20 smithi153 ceph-mon[36179]: pgmap v105: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-03-27T07:17:22.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:21 smithi082 ceph-mon[32178]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-03-27T07:17:22.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:21 smithi082 ceph-mon[32178]: osdmap e29: 4 total, 4 up, 4 in 2024-03-27T07:17:22.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:21 smithi149 ceph-mon[36065]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-03-27T07:17:22.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:21 smithi149 ceph-mon[36065]: osdmap e29: 4 total, 4 up, 4 in 2024-03-27T07:17:22.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:21 smithi153 ceph-mon[36179]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-03-27T07:17:22.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:21 smithi153 ceph-mon[36179]: osdmap e29: 4 total, 4 up, 4 in 2024-03-27T07:17:23.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:22 smithi082 ceph-mon[32178]: from='client.? 172.21.15.149:0/1608202544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ebc9ca5b-bfe9-4124-a145-964d792106b4"}]: dispatch 2024-03-27T07:17:23.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:22 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ebc9ca5b-bfe9-4124-a145-964d792106b4"}]: dispatch 2024-03-27T07:17:23.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:22 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ebc9ca5b-bfe9-4124-a145-964d792106b4"}]': finished 2024-03-27T07:17:23.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:22 smithi082 ceph-mon[32178]: osdmap e30: 5 total, 4 up, 5 in 2024-03-27T07:17:23.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:22 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:23.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:22 smithi082 ceph-mon[32178]: pgmap v108: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-03-27T07:17:23.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:22 smithi082 ceph-mon[32178]: from='client.? 172.21.15.149:0/851117823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:17:23.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:22 smithi149 ceph-mon[36065]: from='client.? 172.21.15.149:0/1608202544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ebc9ca5b-bfe9-4124-a145-964d792106b4"}]: dispatch 2024-03-27T07:17:23.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:22 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ebc9ca5b-bfe9-4124-a145-964d792106b4"}]: dispatch 2024-03-27T07:17:23.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:22 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ebc9ca5b-bfe9-4124-a145-964d792106b4"}]': finished 2024-03-27T07:17:23.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:22 smithi149 ceph-mon[36065]: osdmap e30: 5 total, 4 up, 5 in 2024-03-27T07:17:23.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:22 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:23.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:22 smithi149 ceph-mon[36065]: pgmap v108: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-03-27T07:17:23.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:22 smithi149 ceph-mon[36065]: from='client.? 172.21.15.149:0/851117823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:17:23.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:22 smithi153 ceph-mon[36179]: from='client.? 172.21.15.149:0/1608202544' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ebc9ca5b-bfe9-4124-a145-964d792106b4"}]: dispatch 2024-03-27T07:17:23.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:22 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ebc9ca5b-bfe9-4124-a145-964d792106b4"}]: dispatch 2024-03-27T07:17:23.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:22 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ebc9ca5b-bfe9-4124-a145-964d792106b4"}]': finished 2024-03-27T07:17:23.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:22 smithi153 ceph-mon[36179]: osdmap e30: 5 total, 4 up, 5 in 2024-03-27T07:17:23.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:22 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:23.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:22 smithi153 ceph-mon[36179]: pgmap v108: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-03-27T07:17:23.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:22 smithi153 ceph-mon[36179]: from='client.? 172.21.15.149:0/851117823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:17:24.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:24 smithi153 ceph-mon[36179]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-03-27T07:17:24.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:24 smithi153 ceph-mon[36179]: Cluster is now healthy 2024-03-27T07:17:24.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:24 smithi082 ceph-mon[32178]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-03-27T07:17:24.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:24 smithi082 ceph-mon[32178]: Cluster is now healthy 2024-03-27T07:17:25.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:24 smithi149 ceph-mon[36065]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-03-27T07:17:25.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:24 smithi149 ceph-mon[36065]: Cluster is now healthy 2024-03-27T07:17:25.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:25 smithi149 ceph-mon[36065]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-27T07:17:25.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:25 smithi153 ceph-mon[36179]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-27T07:17:25.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:25 smithi082 ceph-mon[32178]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-27T07:17:27.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:27 smithi149 ceph-mon[36065]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-03-27T07:17:27.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:27 smithi153 ceph-mon[36179]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-03-27T07:17:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:27 smithi082 ceph-mon[32178]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-03-27T07:17:29.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:29 smithi149 ceph-mon[36065]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T07:17:29.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-27T07:17:29.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:29.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:29 smithi153 ceph-mon[36179]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T07:17:29.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-27T07:17:29.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:29 smithi082 ceph-mon[32178]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T07:17:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-27T07:17:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:30.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:30 smithi149 ceph-mon[36065]: Deploying daemon osd.4 on smithi149 2024-03-27T07:17:30.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:30 smithi153 ceph-mon[36179]: Deploying daemon osd.4 on smithi149 2024-03-27T07:17:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:30 smithi082 ceph-mon[32178]: Deploying daemon osd.4 on smithi149 2024-03-27T07:17:31.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:31 smithi149 ceph-mon[36065]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-27T07:17:31.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:31 smithi153 ceph-mon[36179]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-27T07:17:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:31 smithi082 ceph-mon[32178]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-27T07:17:33.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:33 smithi153 ceph-mon[36179]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-03-27T07:17:33.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:33 smithi149 ceph-mon[36065]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-03-27T07:17:33.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:33 smithi082 ceph-mon[32178]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-03-27T07:17:35.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:35 smithi149 ceph-mon[36065]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-27T07:17:35.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:35.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:35.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:35.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:35 smithi153 ceph-mon[36179]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-27T07:17:35.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:35.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:35.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:35 smithi082 ceph-mon[32178]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-03-27T07:17:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:37.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:37 smithi153 ceph-mon[36179]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:37.891 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:37 smithi149 ceph-mon[36065]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:37 smithi082 ceph-mon[32178]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:39.256 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 4 on host 'smithi149' 2024-03-27T07:17:39.257 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.255+0000 7f0ffd7fa700 1 -- 172.21.15.149:0/3251862668 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1000062a80 con 0x7f0fe80a3840 2024-03-27T07:17:39.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 -- 172.21.15.149:0/3251862668 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0fe80a3840 msgr2=0x7f0fe80a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:17:39.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0fe80a3840 0x7f0fe80a5d00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00039c0 tx=0x7f0ff0000bc0 comp rx=0 tx=0).stop 2024-03-27T07:17:39.259 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 -- 172.21.15.149:0/3251862668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000102770 msgr2=0x7f100019d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:17:39.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000102770 0x7f100019d760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400b530 tx=0x7f0ff400b8f0 comp rx=0 tx=0).stop 2024-03-27T07:17:39.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 -- 172.21.15.149:0/3251862668 shutdown_connections 2024-03-27T07:17:39.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0fe80a3840 0x7f0fe80a5d00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:39.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1000101570 0x7f100006aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:39.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1000103110 0x7f100019fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:39.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 --2- 172.21.15.149:0/3251862668 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1000102770 0x7f100019d760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:39.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 -- 172.21.15.149:0/3251862668 >> 172.21.15.149:0/3251862668 conn(0x7f10000fcb10 msgr2=0x7f1000105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:17:39.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 -- 172.21.15.149:0/3251862668 shutdown_connections 2024-03-27T07:17:39.260 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:17:39.258+0000 7f10066da700 1 -- 172.21.15.149:0/3251862668 wait complete. 2024-03-27T07:17:39.581 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.581 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.581 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:39.581 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:39.582 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:39.582 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.582 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: from='osd.4 [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T07:17:39.582 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T07:17:39.582 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.582 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.582 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:39.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:39.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: from='osd.4 [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T07:17:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T07:17:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:39.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: from='osd.4 [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T07:17:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T07:17:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:17:39.948 DEBUG:teuthology.orchestra.run.smithi149:osd.4> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.4.service 2024-03-27T07:17:39.950 INFO:tasks.cephadm:Deploying osd.5 on smithi153 with /dev/vg_nvme/lv_3... 2024-03-27T07:17:39.950 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-27T07:17:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:17:40.451 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:40 smithi149 ceph-mon[36065]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-27T07:17:40.451 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:40 smithi149 ceph-mon[36065]: osdmap e31: 5 total, 4 up, 5 in 2024-03-27T07:17:40.451 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:40 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:40.452 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:40 smithi149 ceph-mon[36065]: from='osd.4 [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:17:40.452 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:40 smithi149 ceph-mon[36065]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:17:40.452 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:17:40 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4[47648]: 2024-03-27T07:17:40.424+0000 7f1894b33700 -1 osd.4 0 waiting for initial osdmap 2024-03-27T07:17:40.452 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:17:40 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4[47648]: 2024-03-27T07:17:40.433+0000 7f1890926700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:17:40.616 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:40 smithi153 ceph-mon[36179]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-27T07:17:40.616 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:40 smithi153 ceph-mon[36179]: osdmap e31: 5 total, 4 up, 5 in 2024-03-27T07:17:40.616 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:40 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:40.616 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:40 smithi153 ceph-mon[36179]: from='osd.4 [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:17:40.616 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:40 smithi153 ceph-mon[36179]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:17:40.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:40 smithi082 ceph-mon[32178]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-27T07:17:40.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:40 smithi082 ceph-mon[32178]: osdmap e31: 5 total, 4 up, 5 in 2024-03-27T07:17:40.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:40 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:40.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:40 smithi082 ceph-mon[32178]: from='osd.4 [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:17:40.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:40 smithi082 ceph-mon[32178]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:17:41.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:41 smithi149 ceph-mon[36065]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:41.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:41 smithi149 ceph-mon[36065]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:17:41.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:41 smithi149 ceph-mon[36065]: osdmap e32: 5 total, 4 up, 5 in 2024-03-27T07:17:41.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:41 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:41.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:41 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:41.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:41 smithi153 ceph-mon[36179]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:41.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:41 smithi153 ceph-mon[36179]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:17:41.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:41 smithi153 ceph-mon[36179]: osdmap e32: 5 total, 4 up, 5 in 2024-03-27T07:17:41.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:41 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:41.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:41 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:41.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:41 smithi082 ceph-mon[32178]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:41.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:41 smithi082 ceph-mon[32178]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:17:41.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:41 smithi082 ceph-mon[32178]: osdmap e32: 5 total, 4 up, 5 in 2024-03-27T07:17:41.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:41 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:41.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:41 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:42.198 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-27T07:17:42.198 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-27T07:17:42.198 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-03-27T07:17:42.198 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-03-27T07:17:42.199 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117168 s, 895 MB/s 2024-03-27T07:17:42.199 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-03-27T07:17:42.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:42 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:17:42.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:42 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:17:42.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:42 smithi153 ceph-mon[36179]: osd.4 [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] boot 2024-03-27T07:17:42.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:42 smithi153 ceph-mon[36179]: osdmap e33: 5 total, 5 up, 5 in 2024-03-27T07:17:42.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:42.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:42 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:17:42.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:42 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:17:42.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:42 smithi082 ceph-mon[32178]: osd.4 [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] boot 2024-03-27T07:17:42.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:42 smithi082 ceph-mon[32178]: osdmap e33: 5 total, 5 up, 5 in 2024-03-27T07:17:42.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:42.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:42 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:17:42.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:42 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:17:42.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:42 smithi149 ceph-mon[36065]: osd.4 [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] boot 2024-03-27T07:17:42.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:42 smithi149 ceph-mon[36065]: osdmap e33: 5 total, 5 up, 5 in 2024-03-27T07:17:42.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:17:42.945 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi153:vg_nvme/lv_3 2024-03-27T07:17:43.192 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:17:43.438 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:43 smithi149 ceph-mon[36065]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:43.439 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:43 smithi149 ceph-mon[36065]: osdmap e34: 5 total, 5 up, 5 in 2024-03-27T07:17:43.439 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.439 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.439 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:43.439 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:43.439 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.439 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:43.439 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:43.439 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:43 smithi153 ceph-mon[36179]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:43.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:43 smithi153 ceph-mon[36179]: osdmap e34: 5 total, 5 up, 5 in 2024-03-27T07:17:43.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:43.529 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:43.530 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.530 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:43.530 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:43.530 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:43 smithi082 ceph-mon[32178]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-03-27T07:17:43.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:43 smithi082 ceph-mon[32178]: osdmap e34: 5 total, 5 up, 5 in 2024-03-27T07:17:43.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:17:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:17:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:17:44.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:44 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi149 2024-03-27T07:17:44.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:44 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi149 to 2903M 2024-03-27T07:17:44.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:44 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi149 2024-03-27T07:17:44.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:44 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi149 to 2903M 2024-03-27T07:17:44.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.829+0000 7f2f794b5700 1 -- 172.21.15.153:0/2437469190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f74104210 msgr2=0x7f2f7410aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:17:44.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.829+0000 7f2f794b5700 1 --2- 172.21.15.153:0/2437469190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f74104210 0x7f2f7410aac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c00b0a0 tx=0x7f2f6c00b3b0 comp rx=0 tx=0).stop 2024-03-27T07:17:44.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.829+0000 7f2f794b5700 1 -- 172.21.15.153:0/2437469190 shutdown_connections 2024-03-27T07:17:44.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.829+0000 7f2f794b5700 1 --2- 172.21.15.153:0/2437469190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f74104210 0x7f2f7410aac0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:44.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.829+0000 7f2f794b5700 1 --2- 172.21.15.153:0/2437469190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74102670 0x7f2f74102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:44.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.829+0000 7f2f794b5700 1 --2- 172.21.15.153:0/2437469190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f74103870 0x7f2f74103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:44.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.829+0000 7f2f794b5700 1 -- 172.21.15.153:0/2437469190 >> 172.21.15.153:0/2437469190 conn(0x7f2f740fdc50 msgr2=0x7f2f74100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:17:44.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.830+0000 7f2f794b5700 1 -- 172.21.15.153:0/2437469190 shutdown_connections 2024-03-27T07:17:44.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.830+0000 7f2f794b5700 1 -- 172.21.15.153:0/2437469190 wait complete. 2024-03-27T07:17:44.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.830+0000 7f2f794b5700 1 Processor -- start 2024-03-27T07:17:44.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.830+0000 7f2f794b5700 1 -- start start 2024-03-27T07:17:44.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.830+0000 7f2f794b5700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f74102670 0x7f2f741987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:17:44.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.830+0000 7f2f794b5700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74103870 0x7f2f74198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.830+0000 7f2f794b5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f74104210 0x7f2f7419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.830+0000 7f2f794b5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7410e240 con 0x7f2f74104210 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.830+0000 7f2f794b5700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7410e0c0 con 0x7f2f74103870 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.830+0000 7f2f794b5700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7410e3c0 con 0x7f2f74102670 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f72ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f74102670 0x7f2f741987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f72ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f74102670 0x7f2f741987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40252/0 (socket says 172.21.15.153:40252) 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f72ffd700 1 -- 172.21.15.153:0/775626876 learned_addr learned my addr 172.21.15.153:0/775626876 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f727fc700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74103870 0x7f2f74198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f737fe700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f74104210 0x7f2f7419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f72ffd700 1 -- 172.21.15.153:0/775626876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74103870 msgr2=0x7f2f74198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f72ffd700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74103870 0x7f2f74198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:44.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f72ffd700 1 -- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f74104210 msgr2=0x7f2f7419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:17:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f72ffd700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f74104210 0x7f2f7419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:17:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f72ffd700 1 -- 172.21.15.153:0/775626876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f741a0420 con 0x7f2f74102670 2024-03-27T07:17:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f737fe700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f74104210 0x7f2f7419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:17:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f72ffd700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f74102670 0x7f2f741987c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400d9b0 tx=0x7f2f6400dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:17:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f5bfff700 1 -- 172.21.15.153:0/775626876 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64016070 con 0x7f2f74102670 2024-03-27T07:17:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f794b5700 1 -- 172.21.15.153:0/775626876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f741a0710 con 0x7f2f74102670 2024-03-27T07:17:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f5bfff700 1 -- 172.21.15.153:0/775626876 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f6400bb60 con 0x7f2f74102670 2024-03-27T07:17:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f5bfff700 1 -- 172.21.15.153:0/775626876 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400f3c0 con 0x7f2f74102670 2024-03-27T07:17:44.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.831+0000 7f2f794b5700 1 -- 172.21.15.153:0/775626876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f741a0c50 con 0x7f2f74102670 2024-03-27T07:17:44.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.832+0000 7f2f794b5700 1 -- 172.21.15.153:0/775626876 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f74069300 con 0x7f2f74102670 2024-03-27T07:17:44.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.833+0000 7f2f5bfff700 1 -- 172.21.15.153:0/775626876 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f2f64019070 con 0x7f2f74102670 2024-03-27T07:17:44.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.834+0000 7f2f5bfff700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2f5c0a36a0 0x7f2f5c0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:17:44.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.834+0000 7f2f5bfff700 1 -- 172.21.15.153:0/775626876 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4101+0+0 (secure 0 0 0) 0x7f2f640cf1f0 con 0x7f2f74102670 2024-03-27T07:17:44.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.834+0000 7f2f727fc700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2f5c0a36a0 0x7f2f5c0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:17:44.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.835+0000 7f2f727fc700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2f5c0a36a0 0x7f2f5c0a5b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800dad0 tx=0x7f2f6800d4b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:17:44.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:44.838+0000 7f2f5bfff700 1 -- 172.21.15.153:0/775626876 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2f64020030 con 0x7f2f74102670 2024-03-27T07:17:44.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:44 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi149 2024-03-27T07:17:44.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:44 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi149 to 2903M 2024-03-27T07:17:45.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:17:45.043+0000 7f2f794b5700 1 -- 172.21.15.153:0/775626876 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2f74062a80 con 0x7f2f5c0a36a0 2024-03-27T07:17:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:45 smithi149 ceph-mon[36065]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:45 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:17:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:45 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:17:45.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:45 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:45.777 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:45 smithi153 ceph-mon[36179]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:45.777 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:45 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:17:45.777 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:45 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:17:45.778 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:45 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:45 smithi082 ceph-mon[32178]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:45 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:17:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:45 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:17:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:45 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:46.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:46 smithi149 ceph-mon[36065]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:17:46.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:46 smithi153 ceph-mon[36179]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:17:46.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:46 smithi082 ceph-mon[32178]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:17:47.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:47 smithi149 ceph-mon[36065]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:47.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:47 smithi153 ceph-mon[36179]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:47.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:47 smithi082 ceph-mon[32178]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:48.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:48 smithi153 ceph-mon[36179]: from='client.? 172.21.15.153:0/144767483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03acb116-175d-40b6-a569-3ecac8868d99"}]: dispatch 2024-03-27T07:17:48.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:48 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03acb116-175d-40b6-a569-3ecac8868d99"}]: dispatch 2024-03-27T07:17:48.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:48 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03acb116-175d-40b6-a569-3ecac8868d99"}]': finished 2024-03-27T07:17:48.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:48 smithi153 ceph-mon[36179]: osdmap e35: 6 total, 5 up, 6 in 2024-03-27T07:17:48.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:48 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:17:48.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:48 smithi149 ceph-mon[36065]: from='client.? 172.21.15.153:0/144767483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03acb116-175d-40b6-a569-3ecac8868d99"}]: dispatch 2024-03-27T07:17:48.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:48 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03acb116-175d-40b6-a569-3ecac8868d99"}]: dispatch 2024-03-27T07:17:48.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:48 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03acb116-175d-40b6-a569-3ecac8868d99"}]': finished 2024-03-27T07:17:48.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:48 smithi149 ceph-mon[36065]: osdmap e35: 6 total, 5 up, 6 in 2024-03-27T07:17:48.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:48 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:17:48.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:48 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/144767483' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03acb116-175d-40b6-a569-3ecac8868d99"}]: dispatch 2024-03-27T07:17:48.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:48 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "03acb116-175d-40b6-a569-3ecac8868d99"}]: dispatch 2024-03-27T07:17:48.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:48 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03acb116-175d-40b6-a569-3ecac8868d99"}]': finished 2024-03-27T07:17:48.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:48 smithi082 ceph-mon[32178]: osdmap e35: 6 total, 5 up, 6 in 2024-03-27T07:17:48.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:48 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:17:49.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:49 smithi149 ceph-mon[36065]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:49.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:49 smithi149 ceph-mon[36065]: from='client.? 172.21.15.153:0/3127932173' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:17:49.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:49 smithi153 ceph-mon[36179]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:49.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:49 smithi153 ceph-mon[36179]: from='client.? 172.21.15.153:0/3127932173' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:17:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:49 smithi082 ceph-mon[32178]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:49 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/3127932173' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:17:51.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:51 smithi149 ceph-mon[36065]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:51.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:51 smithi153 ceph-mon[36179]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:51 smithi082 ceph-mon[32178]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:53.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:53 smithi149 ceph-mon[36065]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:53.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:53 smithi153 ceph-mon[36179]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:53.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:53 smithi082 ceph-mon[32178]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:55.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:55 smithi153 ceph-mon[36179]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:55.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-27T07:17:55.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:55.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:55 smithi149 ceph-mon[36065]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:55.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-27T07:17:55.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:55 smithi082 ceph-mon[32178]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-27T07:17:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:17:56.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:56 smithi149 ceph-mon[36065]: Deploying daemon osd.5 on smithi153 2024-03-27T07:17:56.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:56 smithi153 ceph-mon[36179]: Deploying daemon osd.5 on smithi153 2024-03-27T07:17:56.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:56 smithi082 ceph-mon[32178]: Deploying daemon osd.5 on smithi153 2024-03-27T07:17:57.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:57 smithi149 ceph-mon[36065]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:57 smithi153 ceph-mon[36179]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:57 smithi082 ceph-mon[32178]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:59.654 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:17:59 smithi153 ceph-mon[36179]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:59.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:17:59 smithi149 ceph-mon[36065]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:17:59.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:17:59 smithi082 ceph-mon[32178]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:01.578 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:01 smithi153 ceph-mon[36179]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:01.578 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:01 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:01.579 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:01 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:01.579 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:01 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:01.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:01 smithi149 ceph-mon[36065]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:01.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:01 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:01.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:01 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:01.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:01 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:01.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:01 smithi082 ceph-mon[32178]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:01.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:01 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:01.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:01 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:01.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:01 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:03.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:03 smithi149 ceph-mon[36065]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:03.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:03 smithi153 ceph-mon[36179]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:03 smithi082 ceph-mon[32178]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:04.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.709+0000 7f2f5bfff700 1 -- 172.21.15.153:0/775626876 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2f74062a80 con 0x7f2f5c0a36a0 2024-03-27T07:18:04.712 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 5 on host 'smithi153' 2024-03-27T07:18:04.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 -- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2f5c0a36a0 msgr2=0x7f2f5c0a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:04.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2f5c0a36a0 0x7f2f5c0a5b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800dad0 tx=0x7f2f6800d4b0 comp rx=0 tx=0).stop 2024-03-27T07:18:04.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 -- 172.21.15.153:0/775626876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f74102670 msgr2=0x7f2f741987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:04.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f74102670 0x7f2f741987c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400d9b0 tx=0x7f2f6400dd70 comp rx=0 tx=0).stop 2024-03-27T07:18:04.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 -- 172.21.15.153:0/775626876 shutdown_connections 2024-03-27T07:18:04.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2f5c0a36a0 0x7f2f5c0a5b60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:04.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f74102670 0x7f2f741987c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:04.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f74104210 0x7f2f7419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:04.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 --2- 172.21.15.153:0/775626876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2f74103870 0x7f2f74198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:04.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 -- 172.21.15.153:0/775626876 >> 172.21.15.153:0/775626876 conn(0x7f2f740fdc50 msgr2=0x7f2f74106b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:18:04.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 -- 172.21.15.153:0/775626876 shutdown_connections 2024-03-27T07:18:04.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:18:04.713+0000 7f2f794b5700 1 -- 172.21.15.153:0/775626876 wait complete. 2024-03-27T07:18:05.370 DEBUG:teuthology.orchestra.run.smithi153:osd.5> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.5.service 2024-03-27T07:18:05.373 INFO:tasks.cephadm:Deploying osd.6 on smithi082 with /dev/vg_nvme/lv_2... 2024-03-27T07:18:05.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-27T07:18:05.634 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:18:05.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:05 smithi082 ceph-mon[32178]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:05.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:05 smithi082 ceph-mon[32178]: from='osd.5 [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T07:18:05.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:05 smithi082 ceph-mon[32178]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T07:18:05.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:05 smithi149 ceph-mon[36065]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:05.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:05 smithi149 ceph-mon[36065]: from='osd.5 [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T07:18:05.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:05 smithi149 ceph-mon[36065]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T07:18:05.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:05 smithi153 ceph-mon[36179]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:05.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:05 smithi153 ceph-mon[36179]: from='osd.5 [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T07:18:05.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:05 smithi153 ceph-mon[36179]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T07:18:05.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:05.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:06.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:06 smithi082 ceph-mon[32178]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-27T07:18:06.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:06 smithi082 ceph-mon[32178]: from='osd.5 [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:18:06.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:06 smithi082 ceph-mon[32178]: osdmap e36: 6 total, 5 up, 6 in 2024-03-27T07:18:06.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:06 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:06.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:06 smithi082 ceph-mon[32178]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:18:06.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:06 smithi082 ceph-mon[32178]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:07.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:06 smithi149 ceph-mon[36065]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-27T07:18:07.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:06 smithi149 ceph-mon[36065]: from='osd.5 [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:18:07.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:06 smithi149 ceph-mon[36065]: osdmap e36: 6 total, 5 up, 6 in 2024-03-27T07:18:07.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:06 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:07.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:06 smithi149 ceph-mon[36065]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:18:07.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:06 smithi149 ceph-mon[36065]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:07.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:06 smithi153 ceph-mon[36179]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-27T07:18:07.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:06 smithi153 ceph-mon[36179]: from='osd.5 [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:18:07.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:06 smithi153 ceph-mon[36179]: osdmap e36: 6 total, 5 up, 6 in 2024-03-27T07:18:07.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:06 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:07.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:06 smithi153 ceph-mon[36179]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:18:07.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:06 smithi153 ceph-mon[36179]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-03-27T07:18:07.388 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:18:07 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:18:07.117+0000 7f0701cdf700 -1 osd.5 0 waiting for initial osdmap 2024-03-27T07:18:07.388 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:18:07 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:18:07.124+0000 7f06f9aca700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:18:07.827 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-27T07:18:07.827 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-27T07:18:07.827 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-03-27T07:18:07.827 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-03-27T07:18:07.827 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0129202 s, 812 MB/s 2024-03-27T07:18:07.827 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-03-27T07:18:08.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:07 smithi149 ceph-mon[36065]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:18:08.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:07 smithi149 ceph-mon[36065]: osdmap e37: 6 total, 5 up, 6 in 2024-03-27T07:18:08.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:07 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:08.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:07 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:08.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:07 smithi149 ceph-mon[36065]: from='osd.5 ' entity='osd.5' 2024-03-27T07:18:08.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:07 smithi149 ceph-mon[36065]: osd.5 [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] boot 2024-03-27T07:18:08.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:07 smithi149 ceph-mon[36065]: osdmap e38: 6 total, 6 up, 6 in 2024-03-27T07:18:08.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:07 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:07 smithi153 ceph-mon[36179]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:18:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:07 smithi153 ceph-mon[36179]: osdmap e37: 6 total, 5 up, 6 in 2024-03-27T07:18:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:07 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:07 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:07 smithi153 ceph-mon[36179]: from='osd.5 ' entity='osd.5' 2024-03-27T07:18:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:07 smithi153 ceph-mon[36179]: osd.5 [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] boot 2024-03-27T07:18:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:07 smithi153 ceph-mon[36179]: osdmap e38: 6 total, 6 up, 6 in 2024-03-27T07:18:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:07 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:07 smithi082 ceph-mon[32178]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:18:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:07 smithi082 ceph-mon[32178]: osdmap e37: 6 total, 5 up, 6 in 2024-03-27T07:18:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:07 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:07 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:07 smithi082 ceph-mon[32178]: from='osd.5 ' entity='osd.5' 2024-03-27T07:18:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:07 smithi082 ceph-mon[32178]: osd.5 [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] boot 2024-03-27T07:18:08.119 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:07 smithi082 ceph-mon[32178]: osdmap e38: 6 total, 6 up, 6 in 2024-03-27T07:18:08.120 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:07 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:18:08.458 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-03-27T07:18:08.697 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:18:08.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:08 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:18:08.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:08 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:18:08.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:08 smithi082 ceph-mon[32178]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:08.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:08 smithi082 ceph-mon[32178]: osdmap e39: 6 total, 6 up, 6 in 2024-03-27T07:18:08.998 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:08 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:18:08.998 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:08 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:18:08.999 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:08 smithi153 ceph-mon[36179]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:08.999 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:08 smithi153 ceph-mon[36179]: osdmap e39: 6 total, 6 up, 6 in 2024-03-27T07:18:09.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:08 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:18:09.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:08 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:18:09.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:08 smithi149 ceph-mon[36065]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:09.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:08 smithi149 ceph-mon[36065]: osdmap e39: 6 total, 6 up, 6 in 2024-03-27T07:18:10.298 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi153 2024-03-27T07:18:10.298 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.298 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.298 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:10.298 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:10.298 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi153 to 8540M 2024-03-27T07:18:10.298 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.298 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:10.298 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:10.298 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.299 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:10.299 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:10.299 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:10.299 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.299 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:10 smithi082 ceph-mon[32178]: osdmap e40: 6 total, 6 up, 6 in 2024-03-27T07:18:10.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 -- 172.21.15.82:0/3044570887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484102770 msgr2=0x7fa484102bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:10.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 --2- 172.21.15.82:0/3044570887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484102770 0x7fa484102bd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa4740099c0 tx=0x7fa474009cd0 comp rx=0 tx=0).stop 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 -- 172.21.15.82:0/3044570887 shutdown_connections 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 --2- 172.21.15.82:0/3044570887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa484101570 0x7fa484101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 --2- 172.21.15.82:0/3044570887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa484103110 0x7fa4841099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 --2- 172.21.15.82:0/3044570887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484102770 0x7fa484102bd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 -- 172.21.15.82:0/3044570887 >> 172.21.15.82:0/3044570887 conn(0x7fa4840fcb30 msgr2=0x7fa4840fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 -- 172.21.15.82:0/3044570887 shutdown_connections 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 -- 172.21.15.82:0/3044570887 wait complete. 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 Processor -- start 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.324+0000 7fa48bf64700 1 -- start start 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa48bf64700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa484101570 0x7fa484105500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa48bf64700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484102770 0x7fa484103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa48bf64700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa484103110 0x7fa484104090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:18:10.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa48bf64700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa48410d150 con 0x7fa484102770 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa48bf64700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa48410cfd0 con 0x7fa484101570 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa48bf64700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa48410d2d0 con 0x7fa484103110 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa4894ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484102770 0x7fa484103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa4894ff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484102770 0x7fa484103b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41650/0 (socket says 172.21.15.82:41650) 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa4894ff700 1 -- 172.21.15.82:0/4235719352 learned_addr learned my addr 172.21.15.82:0/4235719352 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa48a501700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa484103110 0x7fa484104090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa489d00700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa484101570 0x7fa484105500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa4894ff700 1 -- 172.21.15.82:0/4235719352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa484103110 msgr2=0x7fa484104090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa4894ff700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa484103110 0x7fa484104090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa4894ff700 1 -- 172.21.15.82:0/4235719352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa484101570 msgr2=0x7fa484105500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa4894ff700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa484101570 0x7fa484105500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa4894ff700 1 -- 172.21.15.82:0/4235719352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa484104940 con 0x7fa484102770 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa48a501700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa484103110 0x7fa484104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa489d00700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa484101570 0x7fa484105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:18:10.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa4894ff700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484102770 0x7fa484103b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa474005910 tx=0x7fa474009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:18:10.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa47affd700 1 -- 172.21.15.82:0/4235719352 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474027070 con 0x7fa484102770 2024-03-27T07:18:10.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa47affd700 1 -- 172.21.15.82:0/4235719352 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa474004150 con 0x7fa484102770 2024-03-27T07:18:10.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa48bf64700 1 -- 172.21.15.82:0/4235719352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4841a2990 con 0x7fa484102770 2024-03-27T07:18:10.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa47affd700 1 -- 172.21.15.82:0/4235719352 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47400f460 con 0x7fa484102770 2024-03-27T07:18:10.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.325+0000 7fa48bf64700 1 -- 172.21.15.82:0/4235719352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4841a2de0 con 0x7fa484102770 2024-03-27T07:18:10.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.326+0000 7fa48bf64700 1 -- 172.21.15.82:0/4235719352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4841a2fb0 con 0x7fa484102770 2024-03-27T07:18:10.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.328+0000 7fa47affd700 1 -- 172.21.15.82:0/4235719352 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fa47402a070 con 0x7fa484102770 2024-03-27T07:18:10.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.328+0000 7fa47affd700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4700a36a0 0x7fa4700a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:18:10.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.328+0000 7fa489d00700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4700a36a0 0x7fa4700a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:18:10.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.328+0000 7fa47affd700 1 -- 172.21.15.82:0/4235719352 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4562+0+0 (secure 0 0 0) 0x7fa4740d02b0 con 0x7fa484102770 2024-03-27T07:18:10.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.328+0000 7fa489d00700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4700a36a0 0x7fa4700a5b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa480005fd0 tx=0x7fa480005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:18:10.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.332+0000 7fa47affd700 1 -- 172.21.15.82:0/4235719352 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa474031070 con 0x7fa484102770 2024-03-27T07:18:10.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi153 2024-03-27T07:18:10.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:10.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:10.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi153 to 8540M 2024-03-27T07:18:10.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:10 smithi149 ceph-mon[36065]: osdmap e40: 6 total, 6 up, 6 in 2024-03-27T07:18:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi153 2024-03-27T07:18:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi153 to 8540M 2024-03-27T07:18:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:10 smithi153 ceph-mon[36179]: osdmap e40: 6 total, 6 up, 6 in 2024-03-27T07:18:10.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:10.539+0000 7fa48bf64700 1 -- 172.21.15.82:0/4235719352 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fa4840fecd0 con 0x7fa4700a36a0 2024-03-27T07:18:11.350 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:11 smithi082 ceph-mon[32178]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 188 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:11.350 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:11 smithi082 ceph-mon[32178]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:18:11.351 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:18:11.351 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:18:11.351 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:11.351 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:11 smithi082 ceph-mon[32178]: osdmap e41: 6 total, 6 up, 6 in 2024-03-27T07:18:11.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:11 smithi149 ceph-mon[36065]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 188 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:11.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:11 smithi149 ceph-mon[36065]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:18:11.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:18:11.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:18:11.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:11.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:11 smithi149 ceph-mon[36065]: osdmap e41: 6 total, 6 up, 6 in 2024-03-27T07:18:11.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:11 smithi153 ceph-mon[36179]: pgmap v142: 1 pgs: 1 remapped+peering; 577 KiB data, 188 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:11.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:11 smithi153 ceph-mon[36179]: from='client.14361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:18:11.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:18:11.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:18:11.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:11.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:11 smithi153 ceph-mon[36179]: osdmap e41: 6 total, 6 up, 6 in 2024-03-27T07:18:12.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:12 smithi082 ceph-mon[32178]: osdmap e42: 6 total, 6 up, 6 in 2024-03-27T07:18:12.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:12 smithi082 ceph-mon[32178]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 188 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:13.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:12 smithi149 ceph-mon[36065]: osdmap e42: 6 total, 6 up, 6 in 2024-03-27T07:18:13.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:12 smithi149 ceph-mon[36065]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 188 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:13.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:12 smithi153 ceph-mon[36179]: osdmap e42: 6 total, 6 up, 6 in 2024-03-27T07:18:13.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:12 smithi153 ceph-mon[36179]: pgmap v145: 1 pgs: 1 remapped+peering; 577 KiB data, 188 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:13 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/453466139' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1"}]: dispatch 2024-03-27T07:18:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:13 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/453466139' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1"}]': finished 2024-03-27T07:18:13.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:13 smithi082 ceph-mon[32178]: osdmap e43: 7 total, 6 up, 7 in 2024-03-27T07:18:13.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:13 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:14.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:13 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/453466139' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1"}]: dispatch 2024-03-27T07:18:14.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:13 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/453466139' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1"}]': finished 2024-03-27T07:18:14.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:13 smithi149 ceph-mon[36065]: osdmap e43: 7 total, 6 up, 7 in 2024-03-27T07:18:14.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:13 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:14.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:13 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/453466139' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1"}]: dispatch 2024-03-27T07:18:14.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:13 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/453466139' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1"}]': finished 2024-03-27T07:18:14.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:13 smithi153 ceph-mon[36179]: osdmap e43: 7 total, 6 up, 7 in 2024-03-27T07:18:14.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:13 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:14.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:14 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/30182419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:18:14.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:14 smithi082 ceph-mon[32178]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-03-27T07:18:15.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:14 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/30182419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:18:15.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:14 smithi149 ceph-mon[36065]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-03-27T07:18:15.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:14 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/30182419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:18:15.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:14 smithi153 ceph-mon[36179]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-03-27T07:18:17.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:17 smithi149 ceph-mon[36065]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T07:18:17.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:17 smithi153 ceph-mon[36179]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T07:18:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:17 smithi082 ceph-mon[32178]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T07:18:19.533 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:19 smithi082 ceph-mon[32178]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-03-27T07:18:19.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:19 smithi149 ceph-mon[36065]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-03-27T07:18:19.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:19 smithi153 ceph-mon[36179]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-03-27T07:18:21.583 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:21 smithi082 ceph-mon[32178]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-03-27T07:18:21.584 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-27T07:18:21.584 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:21.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:21 smithi149 ceph-mon[36065]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-03-27T07:18:21.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-27T07:18:21.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:21.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:21 smithi153 ceph-mon[36179]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-03-27T07:18:21.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-27T07:18:21.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:22.593 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:22 smithi082 ceph-mon[32178]: Deploying daemon osd.6 on smithi082 2024-03-27T07:18:22.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:22 smithi149 ceph-mon[36065]: Deploying daemon osd.6 on smithi082 2024-03-27T07:18:22.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:22 smithi153 ceph-mon[36179]: Deploying daemon osd.6 on smithi082 2024-03-27T07:18:23.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:23 smithi082 ceph-mon[32178]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-27T07:18:23.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:23 smithi149 ceph-mon[36065]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-27T07:18:23.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:23 smithi153 ceph-mon[36179]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-27T07:18:25.646 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:25 smithi082 ceph-mon[32178]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-03-27T07:18:25.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:25 smithi149 ceph-mon[36065]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-03-27T07:18:25.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:25 smithi153 ceph-mon[36179]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-03-27T07:18:27.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:27.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:27.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:27.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:27 smithi149 ceph-mon[36065]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:27.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:27.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:27.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:27.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:27 smithi153 ceph-mon[36179]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:27.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:27.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:27.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:27 smithi082 ceph-mon[32178]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:29.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:29 smithi082 ceph-mon[32178]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:29.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:29.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:29.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:29.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:29.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:29.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:29 smithi149 ceph-mon[36065]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:29.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:29.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:29.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:29.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:29.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:29.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:29 smithi153 ceph-mon[36179]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:30.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.003+0000 7fa47affd700 1 -- 172.21.15.82:0/4235719352 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa4840fecd0 con 0x7fa4700a36a0 2024-03-27T07:18:30.005 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 6 on host 'smithi082' 2024-03-27T07:18:30.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.006+0000 7fa48bf64700 1 -- 172.21.15.82:0/4235719352 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4700a36a0 msgr2=0x7fa4700a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.006+0000 7fa48bf64700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4700a36a0 0x7fa4700a5b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa480005fd0 tx=0x7fa480005de0 comp rx=0 tx=0).stop 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.006+0000 7fa48bf64700 1 -- 172.21.15.82:0/4235719352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484102770 msgr2=0x7fa484103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.006+0000 7fa48bf64700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484102770 0x7fa484103b50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa474005910 tx=0x7fa474009580 comp rx=0 tx=0).stop 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.007+0000 7fa48bf64700 1 -- 172.21.15.82:0/4235719352 shutdown_connections 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.007+0000 7fa48bf64700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa4700a36a0 0x7fa4700a5b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.007+0000 7fa48bf64700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa484103110 0x7fa484104090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.007+0000 7fa48bf64700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa484101570 0x7fa484105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.007+0000 7fa48bf64700 1 --2- 172.21.15.82:0/4235719352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa484102770 0x7fa484103b50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.007+0000 7fa48bf64700 1 -- 172.21.15.82:0/4235719352 >> 172.21.15.82:0/4235719352 conn(0x7fa4840fcb30 msgr2=0x7fa4840fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.007+0000 7fa48bf64700 1 -- 172.21.15.82:0/4235719352 shutdown_connections 2024-03-27T07:18:30.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:18:30.007+0000 7fa48bf64700 1 -- 172.21.15.82:0/4235719352 wait complete. 2024-03-27T07:18:30.719 DEBUG:teuthology.orchestra.run.smithi082:osd.6> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.6.service 2024-03-27T07:18:30.722 INFO:tasks.cephadm:Deploying osd.7 on smithi149 with /dev/vg_nvme/lv_2... 2024-03-27T07:18:30.722 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-27T07:18:30.972 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:18:31.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:31.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:31.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:31.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:30 smithi149 ceph-mon[36065]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-27T07:18:31.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:30 smithi149 ceph-mon[36065]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:31.285 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:31.285 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:31.285 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:31.285 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:30 smithi082 ceph-mon[32178]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-27T07:18:31.285 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:30 smithi082 ceph-mon[32178]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:31.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:31.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:31.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:31.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:30 smithi153 ceph-mon[36179]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-27T07:18:31.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:30 smithi153 ceph-mon[36179]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:32.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:31 smithi082 ceph-mon[32178]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-27T07:18:32.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:31 smithi082 ceph-mon[32178]: osdmap e44: 7 total, 6 up, 7 in 2024-03-27T07:18:32.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:31 smithi082 ceph-mon[32178]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:18:32.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:32.188 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:18:31 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:18:31.991+0000 7fb5dc9a2700 -1 osd.6 0 waiting for initial osdmap 2024-03-27T07:18:32.189 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:18:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:18:32.002+0000 7fb5d8795700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:18:32.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:31 smithi149 ceph-mon[36065]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-27T07:18:32.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:31 smithi149 ceph-mon[36065]: osdmap e44: 7 total, 6 up, 7 in 2024-03-27T07:18:32.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:31 smithi149 ceph-mon[36065]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:18:32.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:32.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:31 smithi153 ceph-mon[36179]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-27T07:18:32.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:31 smithi153 ceph-mon[36179]: osdmap e44: 7 total, 6 up, 7 in 2024-03-27T07:18:32.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:31 smithi153 ceph-mon[36179]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:18:32.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:33.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:32 smithi149 ceph-mon[36065]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:18:33.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:32 smithi149 ceph-mon[36065]: osdmap e45: 7 total, 6 up, 7 in 2024-03-27T07:18:33.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:32 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:33.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:32 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:33.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:32 smithi149 ceph-mon[36065]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:33.277 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-27T07:18:33.277 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-27T07:18:33.278 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-03-27T07:18:33.278 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-03-27T07:18:33.278 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113783 s, 922 MB/s 2024-03-27T07:18:33.278 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-03-27T07:18:33.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:32 smithi153 ceph-mon[36179]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:18:33.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:32 smithi153 ceph-mon[36179]: osdmap e45: 7 total, 6 up, 7 in 2024-03-27T07:18:33.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:32 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:33.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:32 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:33.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:32 smithi153 ceph-mon[36179]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:33.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:18:33.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: osdmap e45: 7 total, 6 up, 7 in 2024-03-27T07:18:33.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:33.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:33.304 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-03-27T07:18:33.964 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi149:vg_nvme/lv_2 2024-03-27T07:18:34.209 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:18:34.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] boot 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: osdmap e46: 7 total, 7 up, 7 in 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:34.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:34 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:34.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:34 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:18:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:18:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] boot 2024-03-27T07:18:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: osdmap e46: 7 total, 7 up, 7 in 2024-03-27T07:18:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:34.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:34.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:34.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:34.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:34 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:18:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:18:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: osd.6 [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] boot 2024-03-27T07:18:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: osdmap e46: 7 total, 7 up, 7 in 2024-03-27T07:18:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:18:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:34.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:34.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:18:34.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:34.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:34.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:34.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:35.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:35 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi082 2024-03-27T07:18:35.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:35 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi082 to 5696M 2024-03-27T07:18:35.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:35 smithi149 ceph-mon[36065]: osdmap e47: 7 total, 7 up, 7 in 2024-03-27T07:18:35.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:35 smithi149 ceph-mon[36065]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:35.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:35 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi082 2024-03-27T07:18:35.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:35 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi082 to 5696M 2024-03-27T07:18:35.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:35 smithi153 ceph-mon[36179]: osdmap e47: 7 total, 7 up, 7 in 2024-03-27T07:18:35.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:35 smithi153 ceph-mon[36179]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:35.338 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:35 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi082 2024-03-27T07:18:35.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:35 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi082 to 5696M 2024-03-27T07:18:35.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:35 smithi082 ceph-mon[32178]: osdmap e47: 7 total, 7 up, 7 in 2024-03-27T07:18:35.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:35 smithi082 ceph-mon[32178]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:35.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.794+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2182123363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c104300 msgr2=0x7f2c1c10abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:35.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.794+0000 7f2c20d5e700 1 --2- 172.21.15.149:0/2182123363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c104300 0x7f2c1c10abb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400b0a0 tx=0x7f2c1400b3b0 comp rx=0 tx=0).stop 2024-03-27T07:18:35.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.795+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2182123363 shutdown_connections 2024-03-27T07:18:35.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.795+0000 7f2c20d5e700 1 --2- 172.21.15.149:0/2182123363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c1c100980 0x7f2c1c100da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:35.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.795+0000 7f2c20d5e700 1 --2- 172.21.15.149:0/2182123363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c104300 0x7f2c1c10abb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:35.796 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.795+0000 7f2c20d5e700 1 --2- 172.21.15.149:0/2182123363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c1c103960 0x7f2c1c103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:35.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.795+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2182123363 >> 172.21.15.149:0/2182123363 conn(0x7f2c1c0fc2e0 msgr2=0x7f2c1c0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:18:35.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.795+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2182123363 shutdown_connections 2024-03-27T07:18:35.797 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.795+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2182123363 wait complete. 2024-03-27T07:18:35.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.795+0000 7f2c20d5e700 1 Processor -- start 2024-03-27T07:18:35.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c20d5e700 1 -- start start 2024-03-27T07:18:35.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c20d5e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c1c100980 0x7f2c1c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:18:35.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c20d5e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c103960 0x7f2c1c19afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:18:35.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c20d5e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c1c104300 0x7f2c1c1a2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:18:35.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c20d5e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c10e310 con 0x7f2c1c104300 2024-03-27T07:18:35.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c20d5e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c10e190 con 0x7f2c1c103960 2024-03-27T07:18:35.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c20d5e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c10e490 con 0x7f2c1c100980 2024-03-27T07:18:35.799 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c19d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c103960 0x7f2c1c19afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c19d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c103960 0x7f2c1c19afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:35208/0 (socket says 172.21.15.149:35208) 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c19d9b700 1 -- 172.21.15.149:0/2294997430 learned_addr learned my addr 172.21.15.149:0/2294997430 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c1ad9d700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c1c104300 0x7f2c1c1a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c1a59c700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c1c100980 0x7f2c1c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c19d9b700 1 -- 172.21.15.149:0/2294997430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c1c100980 msgr2=0x7f2c1c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c19d9b700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c1c100980 0x7f2c1c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c19d9b700 1 -- 172.21.15.149:0/2294997430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c1c104300 msgr2=0x7f2c1c1a2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c19d9b700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c1c104300 0x7f2c1c1a2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c19d9b700 1 -- 172.21.15.149:0/2294997430 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c1a26e0 con 0x7f2c1c103960 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c1a59c700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c1c100980 0x7f2c1c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c19d9b700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c103960 0x7f2c1c19afc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00b530 tx=0x7f2c0c00b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c0b7fe700 1 -- 172.21.15.149:0/2294997430 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c015020 con 0x7f2c1c103960 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2294997430 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1c1a29d0 con 0x7f2c1c103960 2024-03-27T07:18:35.800 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.796+0000 7f2c0b7fe700 1 -- 172.21.15.149:0/2294997430 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c0c011d10 con 0x7f2c1c103960 2024-03-27T07:18:35.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.797+0000 7f2c0b7fe700 1 -- 172.21.15.149:0/2294997430 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c00f2e0 con 0x7f2c1c103960 2024-03-27T07:18:35.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.797+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2294997430 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1c1a2f60 con 0x7f2c1c103960 2024-03-27T07:18:35.801 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.797+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2294997430 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1c069300 con 0x7f2c1c103960 2024-03-27T07:18:35.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.798+0000 7f2c0b7fe700 1 -- 172.21.15.149:0/2294997430 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f2c0c018020 con 0x7f2c1c103960 2024-03-27T07:18:35.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.799+0000 7f2c0b7fe700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2c040a36a0 0x7f2c040a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:18:35.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.799+0000 7f2c0b7fe700 1 -- 172.21.15.149:0/2294997430 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 4965+0+0 (secure 0 0 0) 0x7f2c0c0ce7e0 con 0x7f2c1c103960 2024-03-27T07:18:35.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.799+0000 7f2c1a59c700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2c040a36a0 0x7f2c040a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:18:35.802 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.800+0000 7f2c1a59c700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2c040a36a0 0x7f2c040a5b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2c10005fd0 tx=0x7f2c10005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:18:35.805 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:35.804+0000 7f2c0b7fe700 1 -- 172.21.15.149:0/2294997430 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2c0c01f020 con 0x7f2c1c103960 2024-03-27T07:18:36.010 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:36.009+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2294997430 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2c1c102e70 con 0x7f2c040a36a0 2024-03-27T07:18:36.354 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:36 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:18:36.354 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:36 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:18:36.354 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:36 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:36.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:36 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:18:36.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:36 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:18:36.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:36 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:36.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:36 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:18:36.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:36 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:18:36.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:36 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:37.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:37 smithi149 ceph-mon[36065]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:18:37.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:37 smithi149 ceph-mon[36065]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:37.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:37 smithi082 ceph-mon[32178]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:18:37.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:37 smithi082 ceph-mon[32178]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:37.438 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:37 smithi153 ceph-mon[36179]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:18:37.439 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:37 smithi153 ceph-mon[36179]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:39.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:39 smithi149 ceph-mon[36065]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:39.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:39 smithi149 ceph-mon[36065]: from='client.? 172.21.15.149:0/1335117782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a0a4fc5-d9ec-46ff-8052-1cb270698473"}]: dispatch 2024-03-27T07:18:39.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:39 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a0a4fc5-d9ec-46ff-8052-1cb270698473"}]: dispatch 2024-03-27T07:18:39.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:39 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a0a4fc5-d9ec-46ff-8052-1cb270698473"}]': finished 2024-03-27T07:18:39.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:39 smithi149 ceph-mon[36065]: osdmap e48: 8 total, 7 up, 8 in 2024-03-27T07:18:39.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:39.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:39 smithi149 ceph-mon[36065]: from='client.? 172.21.15.149:0/573733885' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:18:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:39 smithi153 ceph-mon[36179]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:39 smithi153 ceph-mon[36179]: from='client.? 172.21.15.149:0/1335117782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a0a4fc5-d9ec-46ff-8052-1cb270698473"}]: dispatch 2024-03-27T07:18:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:39 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a0a4fc5-d9ec-46ff-8052-1cb270698473"}]: dispatch 2024-03-27T07:18:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:39 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a0a4fc5-d9ec-46ff-8052-1cb270698473"}]': finished 2024-03-27T07:18:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:39 smithi153 ceph-mon[36179]: osdmap e48: 8 total, 7 up, 8 in 2024-03-27T07:18:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:39 smithi153 ceph-mon[36179]: from='client.? 172.21.15.149:0/573733885' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:18:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:39 smithi082 ceph-mon[32178]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:39 smithi082 ceph-mon[32178]: from='client.? 172.21.15.149:0/1335117782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a0a4fc5-d9ec-46ff-8052-1cb270698473"}]: dispatch 2024-03-27T07:18:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:39 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a0a4fc5-d9ec-46ff-8052-1cb270698473"}]: dispatch 2024-03-27T07:18:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:39 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a0a4fc5-d9ec-46ff-8052-1cb270698473"}]': finished 2024-03-27T07:18:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:39 smithi082 ceph-mon[32178]: osdmap e48: 8 total, 7 up, 8 in 2024-03-27T07:18:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:39.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:39 smithi082 ceph-mon[32178]: from='client.? 172.21.15.149:0/573733885' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:18:41.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:41 smithi149 ceph-mon[36065]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:41.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:41 smithi153 ceph-mon[36179]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:41 smithi082 ceph-mon[32178]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:43.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:43 smithi149 ceph-mon[36065]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:43.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:43 smithi153 ceph-mon[36179]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:43.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:43 smithi082 ceph-mon[32178]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:45.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:45 smithi149 ceph-mon[36065]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:45.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:45 smithi153 ceph-mon[36179]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:45 smithi082 ceph-mon[32178]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:46.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-27T07:18:46.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:46.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-27T07:18:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:46.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-27T07:18:46.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:47.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:47 smithi149 ceph-mon[36065]: Deploying daemon osd.7 on smithi149 2024-03-27T07:18:47.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:47 smithi149 ceph-mon[36065]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:47.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:47 smithi153 ceph-mon[36179]: Deploying daemon osd.7 on smithi149 2024-03-27T07:18:47.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:47 smithi153 ceph-mon[36179]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:47.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:47 smithi082 ceph-mon[32178]: Deploying daemon osd.7 on smithi149 2024-03-27T07:18:47.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:47 smithi082 ceph-mon[32178]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:49.545 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:49 smithi149 ceph-mon[36065]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:49.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:49 smithi153 ceph-mon[36179]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:49 smithi082 ceph-mon[32178]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:51.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:51 smithi149 ceph-mon[36065]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:51.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:51 smithi153 ceph-mon[36179]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:51 smithi082 ceph-mon[32178]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:52.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:52 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:52.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:52 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:52.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:52 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:52.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:52 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:52.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:52 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:52.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:52 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:52.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:52 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:52 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:52 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:53.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:53 smithi149 ceph-mon[36065]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:53.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:53 smithi153 ceph-mon[36179]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:53.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:53 smithi082 ceph-mon[32178]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:55.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:55 smithi149 ceph-mon[36065]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:55.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:55.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:55.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:55.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:55.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:55 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:55.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:55 smithi153 ceph-mon[36179]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:55.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:55.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:55.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:55.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:55.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:55 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:55 smithi082 ceph-mon[32178]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:18:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:18:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:55 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:56.129 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.126+0000 7f2c0b7fe700 1 -- 172.21.15.149:0/2294997430 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2c1c102e70 con 0x7f2c040a36a0 2024-03-27T07:18:56.129 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 7 on host 'smithi149' 2024-03-27T07:18:56.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2294997430 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2c040a36a0 msgr2=0x7f2c040a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:56.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2c040a36a0 0x7f2c040a5b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2c10005fd0 tx=0x7f2c10005de0 comp rx=0 tx=0).stop 2024-03-27T07:18:56.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2294997430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c103960 msgr2=0x7f2c1c19afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:18:56.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c103960 0x7f2c1c19afc0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00b530 tx=0x7f2c0c00b8f0 comp rx=0 tx=0).stop 2024-03-27T07:18:56.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2294997430 shutdown_connections 2024-03-27T07:18:56.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2c040a36a0 0x7f2c040a5b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:56.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c1c100980 0x7f2c1c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:56.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c1c104300 0x7f2c1c1a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:56.132 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 --2- 172.21.15.149:0/2294997430 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2c1c103960 0x7f2c1c19afc0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:18:56.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2294997430 >> 172.21.15.149:0/2294997430 conn(0x7f2c1c0fc2e0 msgr2=0x7f2c1c101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:18:56.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2294997430 shutdown_connections 2024-03-27T07:18:56.133 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:18:56.129+0000 7f2c20d5e700 1 -- 172.21.15.149:0/2294997430 wait complete. 2024-03-27T07:18:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:56 smithi153 ceph-mon[36179]: from='osd.7 [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T07:18:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:56 smithi153 ceph-mon[36179]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T07:18:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:56.848 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:56 smithi149 ceph-mon[36065]: from='osd.7 [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T07:18:56.848 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:56 smithi149 ceph-mon[36065]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T07:18:56.848 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:56.849 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:56.849 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:56.874 DEBUG:teuthology.orchestra.run.smithi149:osd.7> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.7.service 2024-03-27T07:18:56.877 INFO:tasks.cephadm:Deploying osd.8 on smithi153 with /dev/vg_nvme/lv_2... 2024-03-27T07:18:56.877 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-27T07:18:56.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:56 smithi082 ceph-mon[32178]: from='osd.7 [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T07:18:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:56 smithi082 ceph-mon[32178]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T07:18:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:18:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:18:57.125 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:18:57.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:57 smithi149 ceph-mon[36065]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:57.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:57 smithi149 ceph-mon[36065]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-27T07:18:57.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:57 smithi149 ceph-mon[36065]: osdmap e49: 8 total, 7 up, 8 in 2024-03-27T07:18:57.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:57.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:57 smithi149 ceph-mon[36065]: from='osd.7 [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:18:57.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:57 smithi149 ceph-mon[36065]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:18:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:57 smithi153 ceph-mon[36179]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:57 smithi153 ceph-mon[36179]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-27T07:18:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:57 smithi153 ceph-mon[36179]: osdmap e49: 8 total, 7 up, 8 in 2024-03-27T07:18:57.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:57 smithi153 ceph-mon[36179]: from='osd.7 [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:18:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:57 smithi153 ceph-mon[36179]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:18:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:57 smithi082 ceph-mon[32178]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:57 smithi082 ceph-mon[32178]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-27T07:18:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:57 smithi082 ceph-mon[32178]: osdmap e49: 8 total, 7 up, 8 in 2024-03-27T07:18:57.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:57.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:57 smithi082 ceph-mon[32178]: from='osd.7 [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:18:57.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:57 smithi082 ceph-mon[32178]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:18:58.090 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:18:57 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:18:57.937+0000 7fa0d9f3d700 -1 osd.7 0 waiting for initial osdmap 2024-03-27T07:18:58.090 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:18:57 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:18:57.948+0000 7fa0d1d28700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:18:58.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:58 smithi153 ceph-mon[36179]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:18:58.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:58 smithi153 ceph-mon[36179]: osdmap e50: 8 total, 7 up, 8 in 2024-03-27T07:18:58.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:58 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:58.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:58 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:58.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:58 smithi153 ceph-mon[36179]: osdmap e51: 8 total, 7 up, 8 in 2024-03-27T07:18:58.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:58 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:58.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:58 smithi153 ceph-mon[36179]: from='osd.7 ' entity='osd.7' 2024-03-27T07:18:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:58 smithi082 ceph-mon[32178]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:18:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:58 smithi082 ceph-mon[32178]: osdmap e50: 8 total, 7 up, 8 in 2024-03-27T07:18:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:58 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:58 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:58 smithi082 ceph-mon[32178]: osdmap e51: 8 total, 7 up, 8 in 2024-03-27T07:18:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:58 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:58 smithi082 ceph-mon[32178]: from='osd.7 ' entity='osd.7' 2024-03-27T07:18:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:58 smithi149 ceph-mon[36065]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:18:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:58 smithi149 ceph-mon[36065]: osdmap e50: 8 total, 7 up, 8 in 2024-03-27T07:18:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:58 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:58 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:58 smithi149 ceph-mon[36065]: osdmap e51: 8 total, 7 up, 8 in 2024-03-27T07:18:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:58 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:58 smithi149 ceph-mon[36065]: from='osd.7 ' entity='osd.7' 2024-03-27T07:18:59.307 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-27T07:18:59.307 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-27T07:18:59.307 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-03-27T07:18:59.307 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-03-27T07:18:59.308 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0121295 s, 864 MB/s 2024-03-27T07:18:59.308 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-03-27T07:18:59.614 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:59 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:18:59.615 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:59 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:18:59.615 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:59 smithi153 ceph-mon[36179]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:59.615 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:59 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:59.615 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:59 smithi153 ceph-mon[36179]: osd.7 [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] boot 2024-03-27T07:18:59.615 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:59 smithi153 ceph-mon[36179]: osdmap e52: 8 total, 8 up, 8 in 2024-03-27T07:18:59.616 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:18:59 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:59.688 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:59 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:18:59.688 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:59 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:18:59.688 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:59 smithi149 ceph-mon[36065]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:59.688 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:59 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:59.688 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:59 smithi149 ceph-mon[36065]: osd.7 [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] boot 2024-03-27T07:18:59.688 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:59 smithi149 ceph-mon[36065]: osdmap e52: 8 total, 8 up, 8 in 2024-03-27T07:18:59.688 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:18:59 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:59.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:59 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:18:59.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:59 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:18:59.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:59 smithi082 ceph-mon[32178]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-03-27T07:18:59.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:59 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:18:59.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:59 smithi082 ceph-mon[32178]: osd.7 [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] boot 2024-03-27T07:18:59.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:59 smithi082 ceph-mon[32178]: osdmap e52: 8 total, 8 up, 8 in 2024-03-27T07:18:59.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:18:59 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:19:00.047 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi153:vg_nvme/lv_2 2024-03-27T07:19:00.303 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:19:00.713 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:00 smithi153 ceph-mon[36179]: osdmap e53: 8 total, 8 up, 8 in 2024-03-27T07:19:00.713 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:00.713 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:00.713 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:00.713 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:00.713 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:00.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:00.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:00.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:00.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:00.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:00 smithi082 ceph-mon[32178]: osdmap e53: 8 total, 8 up, 8 in 2024-03-27T07:19:00.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:00.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:01.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:00 smithi149 ceph-mon[36065]: osdmap e53: 8 total, 8 up, 8 in 2024-03-27T07:19:01.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:01.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:01.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:01.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:01.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:01.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:01.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:01.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:01.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:01.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:01 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi149 2024-03-27T07:19:01.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:01 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi149 to 1935M 2024-03-27T07:19:01.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:01 smithi153 ceph-mon[36179]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:01.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:01 smithi153 ceph-mon[36179]: osdmap e54: 8 total, 8 up, 8 in 2024-03-27T07:19:01.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:01 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi149 2024-03-27T07:19:01.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:01 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi149 to 1935M 2024-03-27T07:19:01.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:01 smithi082 ceph-mon[32178]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:01.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:01 smithi082 ceph-mon[32178]: osdmap e54: 8 total, 8 up, 8 in 2024-03-27T07:19:02.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:01 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi149 2024-03-27T07:19:02.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:01 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi149 to 1935M 2024-03-27T07:19:02.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:01 smithi149 ceph-mon[36065]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:02.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:01 smithi149 ceph-mon[36065]: osdmap e54: 8 total, 8 up, 8 in 2024-03-27T07:19:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.015+0000 7f15051ed700 1 -- 172.21.15.153:0/3106607121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15001027e0 msgr2=0x7f1500102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.015+0000 7f15051ed700 1 --2- 172.21.15.153:0/3106607121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15001027e0 0x7f1500102c40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009990 tx=0x7f14f0009ca0 comp rx=0 tx=0).stop 2024-03-27T07:19:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.015+0000 7f15051ed700 1 -- 172.21.15.153:0/3106607121 shutdown_connections 2024-03-27T07:19:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.015+0000 7f15051ed700 1 --2- 172.21.15.153:0/3106607121 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1500103180 0x7f1500109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.015+0000 7f15051ed700 1 --2- 172.21.15.153:0/3106607121 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f15001015e0 0x7f1500101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.015+0000 7f15051ed700 1 --2- 172.21.15.153:0/3106607121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15001027e0 0x7f1500102c40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.015+0000 7f15051ed700 1 -- 172.21.15.153:0/3106607121 >> 172.21.15.153:0/3106607121 conn(0x7f15000fcba0 msgr2=0x7f15000fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:19:02.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.015+0000 7f15051ed700 1 -- 172.21.15.153:0/3106607121 shutdown_connections 2024-03-27T07:19:02.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.015+0000 7f15051ed700 1 -- 172.21.15.153:0/3106607121 wait complete. 2024-03-27T07:19:02.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f15051ed700 1 Processor -- start 2024-03-27T07:19:02.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f15051ed700 1 -- start start 2024-03-27T07:19:02.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f15051ed700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15001015e0 0x7f1500105570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:02.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f15051ed700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15001027e0 0x7f1500103bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f15051ed700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1500103180 0x7f1500104100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f15051ed700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f150010d1d0 con 0x7f15001027e0 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f15051ed700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f150010d050 con 0x7f1500103180 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f15051ed700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f150010d350 con 0x7f15001015e0 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f14fed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15001015e0 0x7f1500105570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f14fed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15001015e0 0x7f1500105570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51040/0 (socket says 172.21.15.153:51040) 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f14fed9d700 1 -- 172.21.15.153:0/1184867667 learned_addr learned my addr 172.21.15.153:0/1184867667 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.016+0000 7f14ff59e700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1500103180 0x7f1500104100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14fe59c700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15001027e0 0x7f1500103bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14fed9d700 1 -- 172.21.15.153:0/1184867667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1500103180 msgr2=0x7f1500104100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14fed9d700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1500103180 0x7f1500104100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14fed9d700 1 -- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15001027e0 msgr2=0x7f1500103bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:02.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14fed9d700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15001027e0 0x7f1500103bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:02.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14fed9d700 1 -- 172.21.15.153:0/1184867667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15001049b0 con 0x7f15001015e0 2024-03-27T07:19:02.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14fe59c700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15001027e0 0x7f1500103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:19:02.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14fed9d700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15001015e0 0x7f1500105570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f14f400b500 tx=0x7f14f400b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:19:02.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14e7fff700 1 -- 172.21.15.153:0/1184867667 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4015020 con 0x7f15001015e0 2024-03-27T07:19:02.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f15051ed700 1 -- 172.21.15.153:0/1184867667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15001a2a90 con 0x7f15001015e0 2024-03-27T07:19:02.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14e7fff700 1 -- 172.21.15.153:0/1184867667 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f14f4011d10 con 0x7f15001015e0 2024-03-27T07:19:02.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f14e7fff700 1 -- 172.21.15.153:0/1184867667 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4010e50 con 0x7f15001015e0 2024-03-27T07:19:02.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.017+0000 7f15051ed700 1 -- 172.21.15.153:0/1184867667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15001a2fa0 con 0x7f15001015e0 2024-03-27T07:19:02.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.018+0000 7f15051ed700 1 -- 172.21.15.153:0/1184867667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1500069300 con 0x7f15001015e0 2024-03-27T07:19:02.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.019+0000 7f14e7fff700 1 -- 172.21.15.153:0/1184867667 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f14f4018020 con 0x7f15001015e0 2024-03-27T07:19:02.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.020+0000 7f14e7fff700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14e80a3840 0x7f14e80a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:02.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.020+0000 7f14e7fff700 1 -- 172.21.15.153:0/1184867667 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5397+0+0 (secure 0 0 0) 0x7f14f40ceeb0 con 0x7f15001015e0 2024-03-27T07:19:02.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.020+0000 7f14fe59c700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14e80a3840 0x7f14e80a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:02.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.020+0000 7f14fe59c700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14e80a3840 0x7f14e80a5d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14f000b5c0 tx=0x7f14f0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:19:02.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.024+0000 7f14e7fff700 1 -- 172.21.15.153:0/1184867667 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f14f40fdcb0 con 0x7f15001015e0 2024-03-27T07:19:02.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:02.228+0000 7f15051ed700 1 -- 172.21.15.153:0/1184867667 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f15000fed30 con 0x7f14e80a3840 2024-03-27T07:19:02.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:02 smithi082 ceph-mon[32178]: osdmap e55: 8 total, 8 up, 8 in 2024-03-27T07:19:02.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:02 smithi082 ceph-mon[32178]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:19:02.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:02 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:19:02.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:02 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:19:02.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:02 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:02.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:02 smithi082 ceph-mon[32178]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:02.995 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:02 smithi153 ceph-mon[36179]: osdmap e55: 8 total, 8 up, 8 in 2024-03-27T07:19:02.995 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:02 smithi153 ceph-mon[36179]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:19:02.996 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:02 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:19:02.996 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:02 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:19:02.996 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:02 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:02.996 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:02 smithi153 ceph-mon[36179]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:03.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:02 smithi149 ceph-mon[36065]: osdmap e55: 8 total, 8 up, 8 in 2024-03-27T07:19:03.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:02 smithi149 ceph-mon[36065]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:19:03.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:02 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:19:03.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:02 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:19:03.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:02 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:03.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:02 smithi149 ceph-mon[36065]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:03.902 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:03 smithi153 ceph-mon[36179]: osdmap e56: 8 total, 8 up, 8 in 2024-03-27T07:19:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:03 smithi082 ceph-mon[32178]: osdmap e56: 8 total, 8 up, 8 in 2024-03-27T07:19:04.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:03 smithi149 ceph-mon[36065]: osdmap e56: 8 total, 8 up, 8 in 2024-03-27T07:19:04.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:04 smithi082 ceph-mon[32178]: pgmap v185: 1 pgs: 1 remapped+peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:05.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:04 smithi149 ceph-mon[36065]: pgmap v185: 1 pgs: 1 remapped+peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:05.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:04 smithi153 ceph-mon[36179]: pgmap v185: 1 pgs: 1 remapped+peering; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:05 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/2271075243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1af4d31-3f29-41c3-8d02-605bad1858c6"}]: dispatch 2024-03-27T07:19:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:05 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1af4d31-3f29-41c3-8d02-605bad1858c6"}]: dispatch 2024-03-27T07:19:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:05 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1af4d31-3f29-41c3-8d02-605bad1858c6"}]': finished 2024-03-27T07:19:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:05 smithi082 ceph-mon[32178]: osdmap e57: 9 total, 8 up, 9 in 2024-03-27T07:19:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:06.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:05 smithi149 ceph-mon[36065]: from='client.? 172.21.15.153:0/2271075243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1af4d31-3f29-41c3-8d02-605bad1858c6"}]: dispatch 2024-03-27T07:19:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:05 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1af4d31-3f29-41c3-8d02-605bad1858c6"}]: dispatch 2024-03-27T07:19:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:05 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1af4d31-3f29-41c3-8d02-605bad1858c6"}]': finished 2024-03-27T07:19:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:05 smithi149 ceph-mon[36065]: osdmap e57: 9 total, 8 up, 9 in 2024-03-27T07:19:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:06.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:05 smithi153 ceph-mon[36179]: from='client.? 172.21.15.153:0/2271075243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1af4d31-3f29-41c3-8d02-605bad1858c6"}]: dispatch 2024-03-27T07:19:06.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:05 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1af4d31-3f29-41c3-8d02-605bad1858c6"}]: dispatch 2024-03-27T07:19:06.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:05 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1af4d31-3f29-41c3-8d02-605bad1858c6"}]': finished 2024-03-27T07:19:06.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:05 smithi153 ceph-mon[36179]: osdmap e57: 9 total, 8 up, 9 in 2024-03-27T07:19:06.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:06 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/2247675840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:19:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:06 smithi082 ceph-mon[32178]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:07.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:06 smithi149 ceph-mon[36065]: from='client.? 172.21.15.153:0/2247675840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:19:07.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:06 smithi149 ceph-mon[36065]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:07.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:06 smithi153 ceph-mon[36179]: from='client.? 172.21.15.153:0/2247675840' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:19:07.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:06 smithi153 ceph-mon[36179]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:09.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:09 smithi149 ceph-mon[36065]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:09.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:09 smithi153 ceph-mon[36179]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:09 smithi082 ceph-mon[32178]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:11.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:11 smithi149 ceph-mon[36065]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:11.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:11 smithi153 ceph-mon[36179]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:11 smithi082 ceph-mon[32178]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:13.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:13 smithi149 ceph-mon[36065]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:13.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:13 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-27T07:19:13.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:13 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:13.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:13 smithi149 ceph-mon[36065]: Deploying daemon osd.8 on smithi153 2024-03-27T07:19:13.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:13 smithi153 ceph-mon[36179]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:13.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:13 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-27T07:19:13.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:13 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:13.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:13 smithi153 ceph-mon[36179]: Deploying daemon osd.8 on smithi153 2024-03-27T07:19:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:13 smithi082 ceph-mon[32178]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:13 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-27T07:19:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:13 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:13.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:13 smithi082 ceph-mon[32178]: Deploying daemon osd.8 on smithi153 2024-03-27T07:19:15.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:15 smithi153 ceph-mon[36179]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:15.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:15 smithi149 ceph-mon[36065]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:15 smithi082 ceph-mon[32178]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:17.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:17 smithi149 ceph-mon[36065]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:17.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:17 smithi153 ceph-mon[36179]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:17 smithi082 ceph-mon[32178]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:19.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:19 smithi153 ceph-mon[36179]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:19.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:19.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:19.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:19.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:19 smithi082 ceph-mon[32178]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:19.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:19.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:19.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:20.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:19 smithi149 ceph-mon[36065]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:21.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:21 smithi149 ceph-mon[36065]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:21.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:21 smithi153 ceph-mon[36179]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:21 smithi082 ceph-mon[32178]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:22.249 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 8 on host 'smithi153' 2024-03-27T07:19:22.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.247+0000 7f14e7fff700 1 -- 172.21.15.153:0/1184867667 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f15000fed30 con 0x7f14e80a3840 2024-03-27T07:19:22.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 -- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14e80a3840 msgr2=0x7f14e80a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14e80a3840 0x7f14e80a5d00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14f000b5c0 tx=0x7f14f0005fb0 comp rx=0 tx=0).stop 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 -- 172.21.15.153:0/1184867667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15001015e0 msgr2=0x7f1500105570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15001015e0 0x7f1500105570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f14f400b500 tx=0x7f14f400b810 comp rx=0 tx=0).stop 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 -- 172.21.15.153:0/1184867667 shutdown_connections 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14e80a3840 0x7f14e80a5d00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15001015e0 0x7f1500105570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1500103180 0x7f1500104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 --2- 172.21.15.153:0/1184867667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15001027e0 0x7f1500103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 -- 172.21.15.153:0/1184867667 >> 172.21.15.153:0/1184867667 conn(0x7f15000fcba0 msgr2=0x7f15000fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 -- 172.21.15.153:0/1184867667 shutdown_connections 2024-03-27T07:19:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:19:22.250+0000 7f15051ed700 1 -- 172.21.15.153:0/1184867667 wait complete. 2024-03-27T07:19:22.945 DEBUG:teuthology.orchestra.run.smithi153:osd.8> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.8.service 2024-03-27T07:19:22.947 INFO:tasks.cephadm:Deploying osd.9 on smithi082 with /dev/vg_nvme/lv_1... 2024-03-27T07:19:22.948 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-27T07:19:23.198 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:19:23.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:23 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:23 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:23 smithi149 ceph-mon[36065]: from='osd.8 [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T07:19:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:23 smithi149 ceph-mon[36065]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T07:19:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:23 smithi149 ceph-mon[36065]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:23 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:23 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:23 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:23 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:23 smithi153 ceph-mon[36179]: from='osd.8 [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T07:19:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:23 smithi153 ceph-mon[36179]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T07:19:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:23 smithi153 ceph-mon[36179]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:23 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:23 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.561 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:23 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.561 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:23 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.561 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:23 smithi082 ceph-mon[32178]: from='osd.8 [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T07:19:23.561 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:23 smithi082 ceph-mon[32178]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T07:19:23.561 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:23 smithi082 ceph-mon[32178]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:23.561 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:23 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:23.561 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:23 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:24.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:24 smithi149 ceph-mon[36065]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-27T07:19:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:24 smithi149 ceph-mon[36065]: osdmap e58: 9 total, 8 up, 9 in 2024-03-27T07:19:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:24 smithi149 ceph-mon[36065]: from='osd.8 [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:19:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:24 smithi149 ceph-mon[36065]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:19:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:24 smithi153 ceph-mon[36179]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-27T07:19:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:24 smithi153 ceph-mon[36179]: osdmap e58: 9 total, 8 up, 9 in 2024-03-27T07:19:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:24 smithi153 ceph-mon[36179]: from='osd.8 [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:19:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:24 smithi153 ceph-mon[36179]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:19:24.538 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:19:24 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:19:24.256+0000 7f341e229700 -1 osd.8 0 waiting for initial osdmap 2024-03-27T07:19:24.538 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:19:24 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:19:24.265+0000 7f341a01c700 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:19:24.564 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:24 smithi082 ceph-mon[32178]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-27T07:19:24.564 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:24 smithi082 ceph-mon[32178]: osdmap e58: 9 total, 8 up, 9 in 2024-03-27T07:19:24.564 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:24.564 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:24 smithi082 ceph-mon[32178]: from='osd.8 [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:19:24.564 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:24 smithi082 ceph-mon[32178]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:19:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-27T07:19:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-27T07:19:25.207 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-03-27T07:19:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-03-27T07:19:25.207 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113758 s, 922 MB/s 2024-03-27T07:19:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-03-27T07:19:25.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:25 smithi082 ceph-mon[32178]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:19:25.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:25 smithi082 ceph-mon[32178]: osdmap e59: 9 total, 8 up, 9 in 2024-03-27T07:19:25.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:25.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:25 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:25.512 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:25 smithi082 ceph-mon[32178]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:25.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:25 smithi153 ceph-mon[36179]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:19:25.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:25 smithi153 ceph-mon[36179]: osdmap e59: 9 total, 8 up, 9 in 2024-03-27T07:19:25.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:25.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:25 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:25.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:25 smithi153 ceph-mon[36179]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:25.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:25 smithi149 ceph-mon[36065]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:19:25.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:25 smithi149 ceph-mon[36065]: osdmap e59: 9 total, 8 up, 9 in 2024-03-27T07:19:25.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:25 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:25.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:25 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:25.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:25 smithi149 ceph-mon[36065]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 232 MiB used, 715 GiB / 715 GiB avail 2024-03-27T07:19:25.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2024-03-27T07:19:26.100 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:19:26.440 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:26 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:19:26.440 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:26 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:19:26.440 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:26.440 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:26 smithi153 ceph-mon[36179]: osd.8 [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] boot 2024-03-27T07:19:26.440 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:26 smithi153 ceph-mon[36179]: osdmap e60: 9 total, 9 up, 9 in 2024-03-27T07:19:26.440 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:26.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:26 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:19:26.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:26 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:19:26.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:26.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:26 smithi082 ceph-mon[32178]: osd.8 [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] boot 2024-03-27T07:19:26.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:26 smithi082 ceph-mon[32178]: osdmap e60: 9 total, 9 up, 9 in 2024-03-27T07:19:26.503 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:26.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:26 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:19:26.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:26 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:19:26.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:26.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:26 smithi149 ceph-mon[36065]: osd.8 [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] boot 2024-03-27T07:19:26.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:26 smithi149 ceph-mon[36065]: osdmap e60: 9 total, 9 up, 9 in 2024-03-27T07:19:26.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:19:27.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: osdmap e61: 9 total, 9 up, 9 in 2024-03-27T07:19:27.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:27.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:27.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:27.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:27.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:27.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:27.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: osdmap e61: 9 total, 9 up, 9 in 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: osdmap e61: 9 total, 9 up, 9 in 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: pgmap v201: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:27.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.831+0000 7fcf98185700 1 -- 172.21.15.82:0/3564325368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf90102770 msgr2=0x7fcf90102bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.831+0000 7fcf98185700 1 --2- 172.21.15.82:0/3564325368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf90102770 0x7fcf90102bd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcf800099c0 tx=0x7fcf80009cd0 comp rx=0 tx=0).stop 2024-03-27T07:19:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.831+0000 7fcf98185700 1 -- 172.21.15.82:0/3564325368 shutdown_connections 2024-03-27T07:19:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.831+0000 7fcf98185700 1 --2- 172.21.15.82:0/3564325368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf90103110 0x7fcf901099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.831+0000 7fcf98185700 1 --2- 172.21.15.82:0/3564325368 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf90101570 0x7fcf90101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.831+0000 7fcf98185700 1 --2- 172.21.15.82:0/3564325368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf90102770 0x7fcf90102bd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.831+0000 7fcf98185700 1 -- 172.21.15.82:0/3564325368 >> 172.21.15.82:0/3564325368 conn(0x7fcf900fcb10 msgr2=0x7fcf900fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:19:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.831+0000 7fcf98185700 1 -- 172.21.15.82:0/3564325368 shutdown_connections 2024-03-27T07:19:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.831+0000 7fcf98185700 1 -- 172.21.15.82:0/3564325368 wait complete. 2024-03-27T07:19:27.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf98185700 1 Processor -- start 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf98185700 1 -- start start 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf98185700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf90101570 0x7fcf9006aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf98185700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf90102770 0x7fcf9019d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf98185700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf90103110 0x7fcf9019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf98185700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9010d1b0 con 0x7fcf90101570 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf98185700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9010d030 con 0x7fcf90103110 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf98185700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9010d330 con 0x7fcf90102770 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf95f21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf90101570 0x7fcf9006aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf95f21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf90101570 0x7fcf9006aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47876/0 (socket says 172.21.15.82:47876) 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf95f21700 1 -- 172.21.15.82:0/3354237273 learned_addr learned my addr 172.21.15.82:0/3354237273 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf95720700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf90102770 0x7fcf9019d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.832+0000 7fcf96722700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf90103110 0x7fcf9019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf95f21700 1 -- 172.21.15.82:0/3354237273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf90102770 msgr2=0x7fcf9019d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:27.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf95f21700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf90102770 0x7fcf9019d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:27.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf95f21700 1 -- 172.21.15.82:0/3354237273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf90103110 msgr2=0x7fcf9019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:27.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf95f21700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf90103110 0x7fcf9019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:27.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf95f21700 1 -- 172.21.15.82:0/3354237273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf901a0500 con 0x7fcf90101570 2024-03-27T07:19:27.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf95f21700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf90101570 0x7fcf9006aeb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00c990 tx=0x7fcf8c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:19:27.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf86ffd700 1 -- 172.21.15.82:0/3354237273 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c007940 con 0x7fcf90101570 2024-03-27T07:19:27.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf86ffd700 1 -- 172.21.15.82:0/3354237273 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcf8c00f450 con 0x7fcf90101570 2024-03-27T07:19:27.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf98185700 1 -- 172.21.15.82:0/3354237273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf901a07f0 con 0x7fcf90101570 2024-03-27T07:19:27.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf86ffd700 1 -- 172.21.15.82:0/3354237273 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c018660 con 0x7fcf90101570 2024-03-27T07:19:27.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.833+0000 7fcf98185700 1 -- 172.21.15.82:0/3354237273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf901a0e00 con 0x7fcf90101570 2024-03-27T07:19:27.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.834+0000 7fcf98185700 1 -- 172.21.15.82:0/3354237273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf90069300 con 0x7fcf90101570 2024-03-27T07:19:27.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.835+0000 7fcf86ffd700 1 -- 172.21.15.82:0/3354237273 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fcf8c00f600 con 0x7fcf90101570 2024-03-27T07:19:27.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.836+0000 7fcf86ffd700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcf7c0a3720 0x7fcf7c0a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:27.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.836+0000 7fcf95720700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcf7c0a3720 0x7fcf7c0a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:27.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.836+0000 7fcf86ffd700 1 -- 172.21.15.82:0/3354237273 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5829+0+0 (secure 0 0 0) 0x7fcf8c0cf160 con 0x7fcf90101570 2024-03-27T07:19:27.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.836+0000 7fcf95720700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcf7c0a3720 0x7fcf7c0a5be0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009fd0 tx=0x7fcf80005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:19:27.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:27.840+0000 7fcf86ffd700 1 -- 172.21.15.82:0/3354237273 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fcf8c014030 con 0x7fcf90101570 2024-03-27T07:19:28.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:28.046+0000 7fcf98185700 1 -- 172.21.15.82:0/3354237273 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fcf90062a80 con 0x7fcf7c0a3720 2024-03-27T07:19:28.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:28 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi153 2024-03-27T07:19:28.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:28 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi153 to 5693M 2024-03-27T07:19:28.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:28 smithi153 ceph-mon[36179]: osdmap e62: 9 total, 9 up, 9 in 2024-03-27T07:19:28.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:28 smithi153 ceph-mon[36179]: osdmap e63: 9 total, 9 up, 9 in 2024-03-27T07:19:28.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:28.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:28.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:28.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:19:28.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:19:28.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:28 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:28.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:28 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi153 2024-03-27T07:19:28.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:28 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi153 to 5693M 2024-03-27T07:19:28.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:28 smithi082 ceph-mon[32178]: osdmap e62: 9 total, 9 up, 9 in 2024-03-27T07:19:28.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:28 smithi082 ceph-mon[32178]: osdmap e63: 9 total, 9 up, 9 in 2024-03-27T07:19:28.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:28.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:28.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:28.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:19:28.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:19:28.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:28 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:28.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:28 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi153 2024-03-27T07:19:28.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:28 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi153 to 5693M 2024-03-27T07:19:28.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:28 smithi149 ceph-mon[36065]: osdmap e62: 9 total, 9 up, 9 in 2024-03-27T07:19:28.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:28 smithi149 ceph-mon[36065]: osdmap e63: 9 total, 9 up, 9 in 2024-03-27T07:19:28.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:28.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:28.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:28.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:19:28.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:19:28.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:28 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:29 smithi082 ceph-mon[32178]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:19:30.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:29 smithi082 ceph-mon[32178]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:30.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:29 smithi082 ceph-mon[32178]: osdmap e64: 9 total, 9 up, 9 in 2024-03-27T07:19:30.046 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:29 smithi153 ceph-mon[36179]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:19:30.046 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:29 smithi153 ceph-mon[36179]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:30.046 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:29 smithi153 ceph-mon[36179]: osdmap e64: 9 total, 9 up, 9 in 2024-03-27T07:19:30.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:29 smithi149 ceph-mon[36065]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:19:30.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:29 smithi149 ceph-mon[36065]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:30.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:29 smithi149 ceph-mon[36065]: osdmap e64: 9 total, 9 up, 9 in 2024-03-27T07:19:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:31 smithi082 ceph-mon[32178]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-03-27T07:19:31.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:31 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2624997662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7905db5d-ad78-473a-b285-f1c4043865cb"}]: dispatch 2024-03-27T07:19:31.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:31 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2624997662' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7905db5d-ad78-473a-b285-f1c4043865cb"}]': finished 2024-03-27T07:19:31.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:31 smithi082 ceph-mon[32178]: osdmap e65: 10 total, 9 up, 10 in 2024-03-27T07:19:31.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:31.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:31 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1430339040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:19:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:31 smithi149 ceph-mon[36065]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-03-27T07:19:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:31 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2624997662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7905db5d-ad78-473a-b285-f1c4043865cb"}]: dispatch 2024-03-27T07:19:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:31 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2624997662' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7905db5d-ad78-473a-b285-f1c4043865cb"}]': finished 2024-03-27T07:19:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:31 smithi149 ceph-mon[36065]: osdmap e65: 10 total, 9 up, 10 in 2024-03-27T07:19:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:31 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1430339040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:19:32.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:31 smithi153 ceph-mon[36179]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-03-27T07:19:32.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:31 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2624997662' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7905db5d-ad78-473a-b285-f1c4043865cb"}]: dispatch 2024-03-27T07:19:32.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:31 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2624997662' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7905db5d-ad78-473a-b285-f1c4043865cb"}]': finished 2024-03-27T07:19:32.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:31 smithi153 ceph-mon[36179]: osdmap e65: 10 total, 9 up, 10 in 2024-03-27T07:19:32.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:32.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:31 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1430339040' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:19:33.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:33 smithi082 ceph-mon[32178]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-03-27T07:19:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:33 smithi149 ceph-mon[36065]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-03-27T07:19:34.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:33 smithi153 ceph-mon[36179]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-03-27T07:19:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:35 smithi082 ceph-mon[32178]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-03-27T07:19:36.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:35 smithi149 ceph-mon[36065]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-03-27T07:19:36.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:35 smithi153 ceph-mon[36179]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-03-27T07:19:37.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:37 smithi082 ceph-mon[32178]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T07:19:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:37 smithi149 ceph-mon[36065]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T07:19:38.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:37 smithi153 ceph-mon[36179]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T07:19:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:39 smithi082 ceph-mon[32178]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-27T07:19:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-27T07:19:39.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:40.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:39 smithi149 ceph-mon[36065]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-27T07:19:40.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-27T07:19:40.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:40.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:39 smithi153 ceph-mon[36179]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-03-27T07:19:40.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-27T07:19:40.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:40.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:40 smithi082 ceph-mon[32178]: Deploying daemon osd.9 on smithi082 2024-03-27T07:19:40.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:40 smithi082 ceph-mon[32178]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:41.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:40 smithi149 ceph-mon[36065]: Deploying daemon osd.9 on smithi082 2024-03-27T07:19:41.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:40 smithi149 ceph-mon[36065]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:41.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:40 smithi153 ceph-mon[36179]: Deploying daemon osd.9 on smithi082 2024-03-27T07:19:41.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:40 smithi153 ceph-mon[36179]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:43.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:43 smithi149 ceph-mon[36065]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:43.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:43 smithi153 ceph-mon[36179]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:43.925 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:43 smithi082 ceph-mon[32178]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:45 smithi153 ceph-mon[36179]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:45 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:45 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:45 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:45 smithi082 ceph-mon[32178]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:45 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:45 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:45 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:46.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:45 smithi149 ceph-mon[36065]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:46.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:45 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:46.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:45 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:46.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:45 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:47.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:47 smithi082 ceph-mon[32178]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:47.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:47 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:47.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:47 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:47.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:47 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:47.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:47 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:47.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:47 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:47.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:47 smithi153 ceph-mon[36179]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:47.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:47 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:47.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:47 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:47.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:47 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:47.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:47 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:47.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:47 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:48.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:47 smithi149 ceph-mon[36065]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:48.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:47 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:48.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:47 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:48.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:47 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:48.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:47 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:48.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:47 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:48.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.403+0000 7fcf86ffd700 1 -- 172.21.15.82:0/3354237273 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcf90062a80 con 0x7fcf7c0a3720 2024-03-27T07:19:48.406 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 9 on host 'smithi082' 2024-03-27T07:19:48.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 -- 172.21.15.82:0/3354237273 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcf7c0a3720 msgr2=0x7fcf7c0a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:48.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcf7c0a3720 0x7fcf7c0a5be0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009fd0 tx=0x7fcf80005fb0 comp rx=0 tx=0).stop 2024-03-27T07:19:48.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 -- 172.21.15.82:0/3354237273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf90101570 msgr2=0x7fcf9006aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:48.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf90101570 0x7fcf9006aeb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00c990 tx=0x7fcf8c00cca0 comp rx=0 tx=0).stop 2024-03-27T07:19:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 -- 172.21.15.82:0/3354237273 shutdown_connections 2024-03-27T07:19:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fcf7c0a3720 0x7fcf7c0a5be0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcf90103110 0x7fcf9019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcf90101570 0x7fcf9006aeb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:48.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 --2- 172.21.15.82:0/3354237273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf90102770 0x7fcf9019d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:48.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 -- 172.21.15.82:0/3354237273 >> 172.21.15.82:0/3354237273 conn(0x7fcf900fcb10 msgr2=0x7fcf90105af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:19:48.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 -- 172.21.15.82:0/3354237273 shutdown_connections 2024-03-27T07:19:48.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:19:48.406+0000 7fcf98185700 1 -- 172.21.15.82:0/3354237273 wait complete. 2024-03-27T07:19:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:48 smithi082 ceph-mon[32178]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-27T07:19:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:48 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:48 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:48.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:48 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:48.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:48 smithi153 ceph-mon[36179]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-27T07:19:48.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:48 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:48.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:48 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:48.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:48 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:49.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:48 smithi149 ceph-mon[36065]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-27T07:19:49.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:48 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:49.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:48 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:49.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:48 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:19:49.043 DEBUG:teuthology.orchestra.run.smithi082:osd.9> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.9.service 2024-03-27T07:19:49.046 INFO:tasks.cephadm:Deploying osd.10 on smithi149 with /dev/vg_nvme/lv_1... 2024-03-27T07:19:49.046 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-27T07:19:49.292 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:19:49.673 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:49 smithi149 ceph-mon[36065]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:49.673 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:49 smithi149 ceph-mon[36065]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-27T07:19:49.673 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:49 smithi149 ceph-mon[36065]: osdmap e66: 10 total, 9 up, 10 in 2024-03-27T07:19:49.673 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:49 smithi149 ceph-mon[36065]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:19:49.673 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:49 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:49 smithi082 ceph-mon[32178]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:49 smithi082 ceph-mon[32178]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-27T07:19:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:49 smithi082 ceph-mon[32178]: osdmap e66: 10 total, 9 up, 10 in 2024-03-27T07:19:49.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:49 smithi082 ceph-mon[32178]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:19:49.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:49 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:50.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:49 smithi153 ceph-mon[36179]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:50.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:49 smithi153 ceph-mon[36179]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-27T07:19:50.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:49 smithi153 ceph-mon[36179]: osdmap e66: 10 total, 9 up, 10 in 2024-03-27T07:19:50.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:49 smithi153 ceph-mon[36179]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-03-27T07:19:50.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:49 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:50.187 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:19:50 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:19:50.005+0000 7f7044750700 -1 osd.9 0 waiting for initial osdmap 2024-03-27T07:19:50.188 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:19:50 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:19:50.017+0000 7f703c53b700 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:19:50.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:50 smithi082 ceph-mon[32178]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:19:50.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:50 smithi082 ceph-mon[32178]: osdmap e67: 10 total, 9 up, 10 in 2024-03-27T07:19:50.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:50 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:50.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:50 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:50.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:50 smithi082 ceph-mon[32178]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' 2024-03-27T07:19:50.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:50 smithi149 ceph-mon[36065]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:19:50.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:50 smithi149 ceph-mon[36065]: osdmap e67: 10 total, 9 up, 10 in 2024-03-27T07:19:50.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:50 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:50.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:50 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:50.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:50 smithi149 ceph-mon[36065]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' 2024-03-27T07:19:51.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:50 smithi153 ceph-mon[36179]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-03-27T07:19:51.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:50 smithi153 ceph-mon[36179]: osdmap e67: 10 total, 9 up, 10 in 2024-03-27T07:19:51.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:50 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:51.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:50 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:51.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:50 smithi153 ceph-mon[36179]: from='osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916]' entity='osd.9' 2024-03-27T07:19:51.335 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-27T07:19:51.335 INFO:teuthology.orchestra.run.smithi149.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-27T07:19:51.335 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10+0 records in 2024-03-27T07:19:51.335 INFO:teuthology.orchestra.run.smithi149.stderr:10+0 records out 2024-03-27T07:19:51.335 INFO:teuthology.orchestra.run.smithi149.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114384 s, 917 MB/s 2024-03-27T07:19:51.335 INFO:teuthology.orchestra.run.smithi149.stderr:--> Zapping successful for: 2024-03-27T07:19:51.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:51 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:19:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:51 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:19:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:51 smithi082 ceph-mon[32178]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:51 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:51 smithi082 ceph-mon[32178]: osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] boot 2024-03-27T07:19:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:51 smithi082 ceph-mon[32178]: osdmap e68: 10 total, 10 up, 10 in 2024-03-27T07:19:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:51 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:51 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:19:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:51 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:19:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:51 smithi149 ceph-mon[36065]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:51 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:51 smithi149 ceph-mon[36065]: osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] boot 2024-03-27T07:19:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:51 smithi149 ceph-mon[36065]: osdmap e68: 10 total, 10 up, 10 in 2024-03-27T07:19:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:51 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:51 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:19:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:51 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:19:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:51 smithi153 ceph-mon[36179]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-03-27T07:19:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:51 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:51 smithi153 ceph-mon[36179]: osd.9 [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] boot 2024-03-27T07:19:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:51 smithi153 ceph-mon[36179]: osdmap e68: 10 total, 10 up, 10 in 2024-03-27T07:19:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:51 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:19:52.154 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi149:vg_nvme/lv_1 2024-03-27T07:19:52.406 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:19:53.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: osdmap e69: 10 total, 10 up, 10 in 2024-03-27T07:19:53.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi082 2024-03-27T07:19:53.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi082 to 4272M 2024-03-27T07:19:53.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:53.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:53.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:19:53.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:53 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: osdmap e69: 10 total, 10 up, 10 in 2024-03-27T07:19:53.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi082 2024-03-27T07:19:53.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi082 to 4272M 2024-03-27T07:19:53.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:53.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:53.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:19:53.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:53 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: osdmap e69: 10 total, 10 up, 10 in 2024-03-27T07:19:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi082 2024-03-27T07:19:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:19:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi082 to 4272M 2024-03-27T07:19:53.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:53.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:53.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:19:53.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:19:53.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:53 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:19:54.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 -- 172.21.15.149:0/2061818043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1544102670 msgr2=0x7f1544102a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:54.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 --2- 172.21.15.149:0/2061818043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1544102670 0x7f1544102a90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f15400099c0 tx=0x7f1540009cd0 comp rx=0 tx=0).stop 2024-03-27T07:19:54.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 -- 172.21.15.149:0/2061818043 shutdown_connections 2024-03-27T07:19:54.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 --2- 172.21.15.149:0/2061818043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1544104210 0x7f154410aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:54.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 --2- 172.21.15.149:0/2061818043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1544102670 0x7f1544102a90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:54.235 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 --2- 172.21.15.149:0/2061818043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1544103870 0x7f1544103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 -- 172.21.15.149:0/2061818043 >> 172.21.15.149:0/2061818043 conn(0x7f15440fdc50 msgr2=0x7f1544100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 -- 172.21.15.149:0/2061818043 shutdown_connections 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 -- 172.21.15.149:0/2061818043 wait complete. 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 Processor -- start 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 -- start start 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.231+0000 7f154b6e7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1544102670 0x7f1544198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f154b6e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1544103870 0x7f1544198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f154b6e7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1544104210 0x7f154419fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f154b6e7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f154410e2c0 con 0x7f1544103870 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f154b6e7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f154410e140 con 0x7f1544104210 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f154b6e7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f154410e440 con 0x7f1544102670 2024-03-27T07:19:54.236 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1549c84700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1544104210 0x7f154419fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1549483700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1544102670 0x7f1544198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1549c84700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1544104210 0x7f154419fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.149:33442/0 (socket says 172.21.15.149:33442) 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1549c84700 1 -- 172.21.15.149:0/766509506 learned_addr learned my addr 172.21.15.149:0/766509506 (peer_addr_for_me v2:172.21.15.149:0/0) 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1548c82700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1544103870 0x7f1544198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1549c84700 1 -- 172.21.15.149:0/766509506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1544102670 msgr2=0x7f1544198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1549c84700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1544102670 0x7f1544198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1549c84700 1 -- 172.21.15.149:0/766509506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1544103870 msgr2=0x7f1544198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1549c84700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1544103870 0x7f1544198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1549c84700 1 -- 172.21.15.149:0/766509506 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15441a0560 con 0x7f1544104210 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f1549c84700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1544104210 0x7f154419fec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f153c00b970 tx=0x7f153c00bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f153a7fc700 1 -- 172.21.15.149:0/766509506 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c019070 con 0x7f1544104210 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f154b6e7700 1 -- 172.21.15.149:0/766509506 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15441a0850 con 0x7f1544104210 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f153a7fc700 1 -- 172.21.15.149:0/766509506 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f153c00ce10 con 0x7f1544104210 2024-03-27T07:19:54.237 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f153a7fc700 1 -- 172.21.15.149:0/766509506 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c0073d0 con 0x7f1544104210 2024-03-27T07:19:54.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.232+0000 7f154b6e7700 1 -- 172.21.15.149:0/766509506 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15441a0d90 con 0x7f1544104210 2024-03-27T07:19:54.238 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.233+0000 7f154b6e7700 1 -- 172.21.15.149:0/766509506 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1544069300 con 0x7f1544104210 2024-03-27T07:19:54.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.235+0000 7f153a7fc700 1 -- 172.21.15.149:0/766509506 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f153c01c070 con 0x7f1544104210 2024-03-27T07:19:54.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.235+0000 7f153a7fc700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f15300a36a0 0x7f15300a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:19:54.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.236+0000 7f153a7fc700 1 -- 172.21.15.149:0/766509506 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6261+0+0 (secure 0 0 0) 0x7f153c0ceda0 con 0x7f1544104210 2024-03-27T07:19:54.239 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.236+0000 7f1549483700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f15300a36a0 0x7f15300a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:19:54.240 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.236+0000 7f1549483700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f15300a36a0 0x7f15300a5b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f154000b580 tx=0x7f1540005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:19:54.241 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.239+0000 7f153a7fc700 1 -- 172.21.15.149:0/766509506 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f153c09c0d0 con 0x7f1544104210 2024-03-27T07:19:54.445 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:19:54.443+0000 7f154b6e7700 1 -- 172.21.15.149:0/766509506 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1544062a80 con 0x7f15300a36a0 2024-03-27T07:19:54.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:19:54.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:19:54.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:54.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:19:54.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:19:54.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:19:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:19:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:19:55.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:55 smithi149 ceph-mon[36065]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:19:55.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:55 smithi149 ceph-mon[36065]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:19:55.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:55 smithi153 ceph-mon[36179]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:19:55.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:55 smithi153 ceph-mon[36179]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:19:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:55 smithi082 ceph-mon[32178]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:19:55.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:55 smithi082 ceph-mon[32178]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi149:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:19:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:57 smithi153 ceph-mon[36179]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:19:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:57 smithi153 ceph-mon[36179]: from='client.? 172.21.15.149:0/3536788375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a76fdd45-339b-4cae-a342-d9b1bea0f85f"}]: dispatch 2024-03-27T07:19:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:57 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a76fdd45-339b-4cae-a342-d9b1bea0f85f"}]: dispatch 2024-03-27T07:19:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:57 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a76fdd45-339b-4cae-a342-d9b1bea0f85f"}]': finished 2024-03-27T07:19:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:57 smithi153 ceph-mon[36179]: osdmap e70: 11 total, 10 up, 11 in 2024-03-27T07:19:57.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:19:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:57 smithi082 ceph-mon[32178]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:19:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:57 smithi082 ceph-mon[32178]: from='client.? 172.21.15.149:0/3536788375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a76fdd45-339b-4cae-a342-d9b1bea0f85f"}]: dispatch 2024-03-27T07:19:57.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:57 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a76fdd45-339b-4cae-a342-d9b1bea0f85f"}]: dispatch 2024-03-27T07:19:57.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:57 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a76fdd45-339b-4cae-a342-d9b1bea0f85f"}]': finished 2024-03-27T07:19:57.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:57 smithi082 ceph-mon[32178]: osdmap e70: 11 total, 10 up, 11 in 2024-03-27T07:19:57.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:19:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:57 smithi149 ceph-mon[36065]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:19:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:57 smithi149 ceph-mon[36065]: from='client.? 172.21.15.149:0/3536788375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a76fdd45-339b-4cae-a342-d9b1bea0f85f"}]: dispatch 2024-03-27T07:19:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:57 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a76fdd45-339b-4cae-a342-d9b1bea0f85f"}]: dispatch 2024-03-27T07:19:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:57 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a76fdd45-339b-4cae-a342-d9b1bea0f85f"}]': finished 2024-03-27T07:19:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:57 smithi149 ceph-mon[36065]: osdmap e70: 11 total, 10 up, 11 in 2024-03-27T07:19:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:19:58.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:58 smithi153 ceph-mon[36179]: from='client.? 172.21.15.149:0/846576858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:19:58.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:58 smithi082 ceph-mon[32178]: from='client.? 172.21.15.149:0/846576858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:19:59.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:58 smithi149 ceph-mon[36065]: from='client.? 172.21.15.149:0/846576858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:19:59.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:19:59 smithi153 ceph-mon[36179]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:19:59.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:19:59 smithi082 ceph-mon[32178]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:00.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:19:59 smithi149 ceph-mon[36065]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:00.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:00 smithi153 ceph-mon[36179]: overall HEALTH_OK 2024-03-27T07:20:00.880 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:00 smithi149 ceph-mon[36065]: overall HEALTH_OK 2024-03-27T07:20:00.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:00 smithi082 ceph-mon[32178]: overall HEALTH_OK 2024-03-27T07:20:01.588 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:01 smithi149 ceph-mon[36065]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:01.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:01 smithi153 ceph-mon[36179]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:01.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:01 smithi082 ceph-mon[32178]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:03.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:03 smithi153 ceph-mon[36179]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:03.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:03 smithi149 ceph-mon[36065]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:03.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:03 smithi082 ceph-mon[32178]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:05.690 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:05 smithi149 ceph-mon[36065]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:05.691 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-27T07:20:05.691 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:05.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:05 smithi153 ceph-mon[36179]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:05.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-27T07:20:05.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:05.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:05 smithi082 ceph-mon[32178]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-27T07:20:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:06.714 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:06 smithi149 ceph-mon[36065]: Deploying daemon osd.10 on smithi149 2024-03-27T07:20:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:06 smithi082 ceph-mon[32178]: Deploying daemon osd.10 on smithi149 2024-03-27T07:20:07.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:06 smithi153 ceph-mon[36179]: Deploying daemon osd.10 on smithi149 2024-03-27T07:20:07.735 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:07 smithi149 ceph-mon[36065]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:07.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:07 smithi082 ceph-mon[32178]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:08.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:07 smithi153 ceph-mon[36179]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:09.840 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:09 smithi153 ceph-mon[36179]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:09.930 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:09 smithi149 ceph-mon[36065]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:09 smithi082 ceph-mon[32178]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:11 smithi082 ceph-mon[32178]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:11 smithi149 ceph-mon[36065]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:12.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:11 smithi153 ceph-mon[36179]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:12.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:12.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:12.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:13 smithi082 ceph-mon[32178]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:14.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:13 smithi149 ceph-mon[36065]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:14.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:13 smithi153 ceph-mon[36179]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:14.562 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.560+0000 7f153a7fc700 1 -- 172.21.15.149:0/766509506 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1544062a80 con 0x7f15300a36a0 2024-03-27T07:20:14.562 INFO:teuthology.orchestra.run.smithi149.stdout:Created osd(s) 10 on host 'smithi149' 2024-03-27T07:20:14.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 -- 172.21.15.149:0/766509506 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f15300a36a0 msgr2=0x7f15300a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:14.564 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f15300a36a0 0x7f15300a5b60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f154000b580 tx=0x7f1540005fb0 comp rx=0 tx=0).stop 2024-03-27T07:20:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 -- 172.21.15.149:0/766509506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1544104210 msgr2=0x7f154419fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1544104210 0x7f154419fec0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f153c00b970 tx=0x7f153c00bc80 comp rx=0 tx=0).stop 2024-03-27T07:20:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 -- 172.21.15.149:0/766509506 shutdown_connections 2024-03-27T07:20:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f15300a36a0 0x7f15300a5b60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1544102670 0x7f1544198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1544104210 0x7f154419fec0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 --2- 172.21.15.149:0/766509506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1544103870 0x7f1544198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 -- 172.21.15.149:0/766509506 >> 172.21.15.149:0/766509506 conn(0x7f15440fdc50 msgr2=0x7f1544106b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 -- 172.21.15.149:0/766509506 shutdown_connections 2024-03-27T07:20:14.565 INFO:teuthology.orchestra.run.smithi149.stderr:2024-03-27T07:20:14.563+0000 7f154b6e7700 1 -- 172.21.15.149:0/766509506 wait complete. 2024-03-27T07:20:14.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:14.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:14.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:14.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:14.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:14.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:14 smithi149 ceph-mon[36065]: from='osd.10 [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T07:20:14.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:14 smithi149 ceph-mon[36065]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T07:20:14.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:14.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:14.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:14 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:14.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:14.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:14.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:14.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:14.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:14.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:14 smithi082 ceph-mon[32178]: from='osd.10 [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T07:20:14.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:14 smithi082 ceph-mon[32178]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T07:20:14.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:14.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:14.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:14 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:14 smithi153 ceph-mon[36179]: from='osd.10 [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T07:20:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:14 smithi153 ceph-mon[36179]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T07:20:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:15.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:14 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:15.276 DEBUG:teuthology.orchestra.run.smithi149:osd.10> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.10.service 2024-03-27T07:20:15.279 INFO:tasks.cephadm:Deploying osd.11 on smithi153 with /dev/vg_nvme/lv_1... 2024-03-27T07:20:15.279 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-27T07:20:15.532 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:20:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:15 smithi149 ceph-mon[36065]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:15 smithi149 ceph-mon[36065]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-27T07:20:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:15 smithi149 ceph-mon[36065]: osdmap e71: 11 total, 10 up, 11 in 2024-03-27T07:20:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:15 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:15 smithi149 ceph-mon[36065]: from='osd.10 [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:20:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:15 smithi149 ceph-mon[36065]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:20:15.755 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:20:15 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:20:15.620+0000 7f9dc538d700 -1 osd.10 0 waiting for initial osdmap 2024-03-27T07:20:15.755 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:20:15 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:20:15.632+0000 7f9dc1180700 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:20:15.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:15 smithi153 ceph-mon[36179]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:15.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:15 smithi153 ceph-mon[36179]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-27T07:20:15.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:15 smithi153 ceph-mon[36179]: osdmap e71: 11 total, 10 up, 11 in 2024-03-27T07:20:15.891 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:15 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:15.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:15 smithi153 ceph-mon[36179]: from='osd.10 [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:20:15.892 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:15 smithi153 ceph-mon[36179]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:20:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:15 smithi082 ceph-mon[32178]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:15.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:15 smithi082 ceph-mon[32178]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-27T07:20:15.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:15 smithi082 ceph-mon[32178]: osdmap e71: 11 total, 10 up, 11 in 2024-03-27T07:20:15.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:15 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:15.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:15 smithi082 ceph-mon[32178]: from='osd.10 [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:20:15.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:15 smithi082 ceph-mon[32178]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]: dispatch 2024-03-27T07:20:16.877 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:16 smithi149 ceph-mon[36065]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:20:16.877 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:16 smithi149 ceph-mon[36065]: osdmap e72: 11 total, 10 up, 11 in 2024-03-27T07:20:16.878 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:16 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:16.878 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:16 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:16.878 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:16 smithi149 ceph-mon[36065]: osd.10 [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] boot 2024-03-27T07:20:16.878 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:16 smithi149 ceph-mon[36065]: osdmap e73: 11 total, 11 up, 11 in 2024-03-27T07:20:16.878 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:16 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:16.921 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:16 smithi153 ceph-mon[36179]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:20:16.922 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:16 smithi153 ceph-mon[36179]: osdmap e72: 11 total, 10 up, 11 in 2024-03-27T07:20:16.922 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:16.922 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:16.922 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:16 smithi153 ceph-mon[36179]: osd.10 [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] boot 2024-03-27T07:20:16.922 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:16 smithi153 ceph-mon[36179]: osdmap e73: 11 total, 11 up, 11 in 2024-03-27T07:20:16.922 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:16 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:16.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:16 smithi082 ceph-mon[32178]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi149", "root=default"]}]': finished 2024-03-27T07:20:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:16 smithi082 ceph-mon[32178]: osdmap e72: 11 total, 10 up, 11 in 2024-03-27T07:20:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:16 smithi082 ceph-mon[32178]: osd.10 [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] boot 2024-03-27T07:20:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:16 smithi082 ceph-mon[32178]: osdmap e73: 11 total, 11 up, 11 in 2024-03-27T07:20:16.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:16 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:20:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-27T07:20:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-27T07:20:17.850 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10+0 records in 2024-03-27T07:20:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:10+0 records out 2024-03-27T07:20:17.850 INFO:teuthology.orchestra.run.smithi153.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0152258 s, 689 MB/s 2024-03-27T07:20:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:--> Zapping successful for: 2024-03-27T07:20:17.850 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:17 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:20:17.850 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:17 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:20:17.851 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:17 smithi153 ceph-mon[36179]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:17.851 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:17 smithi153 ceph-mon[36179]: osdmap e74: 11 total, 11 up, 11 in 2024-03-27T07:20:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:17 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:20:17.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:17 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:20:17.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:17 smithi082 ceph-mon[32178]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:17.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:17 smithi082 ceph-mon[32178]: osdmap e74: 11 total, 11 up, 11 in 2024-03-27T07:20:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:17 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:20:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:17 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:20:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:17 smithi149 ceph-mon[36065]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-03-27T07:20:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:17 smithi149 ceph-mon[36065]: osdmap e74: 11 total, 11 up, 11 in 2024-03-27T07:20:18.591 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi153:vg_nvme/lv_1 2024-03-27T07:20:18.834 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:20:19.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi149 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi149 to 1451M 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:19.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:19 smithi082 ceph-mon[32178]: osdmap e75: 11 total, 11 up, 11 in 2024-03-27T07:20:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi149 2024-03-27T07:20:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:20.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:20.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:20.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi149 to 1451M 2024-03-27T07:20:20.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:20.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:20.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:20.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:20.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:19 smithi149 ceph-mon[36065]: osdmap e75: 11 total, 11 up, 11 in 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi149 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi149 to 1451M 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:20.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:20.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:19 smithi153 ceph-mon[36179]: osdmap e75: 11 total, 11 up, 11 in 2024-03-27T07:20:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/2256469297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d88103180 msgr2=0x7f1d88109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 --2- 172.21.15.153:0/2256469297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d88103180 0x7f1d88109a30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000b0a0 tx=0x7f1d8000b3b0 comp rx=0 tx=0).stop 2024-03-27T07:20:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/2256469297 shutdown_connections 2024-03-27T07:20:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 --2- 172.21.15.153:0/2256469297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d88103180 0x7f1d88109a30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 --2- 172.21.15.153:0/2256469297 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d881015e0 0x7f1d88101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 --2- 172.21.15.153:0/2256469297 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d881027e0 0x7f1d88102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/2256469297 >> 172.21.15.153:0/2256469297 conn(0x7f1d880fcba0 msgr2=0x7f1d880fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:20.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/2256469297 shutdown_connections 2024-03-27T07:20:20.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/2256469297 wait complete. 2024-03-27T07:20:20.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:20 smithi153 ceph-mon[36179]: osdmap e76: 11 total, 11 up, 11 in 2024-03-27T07:20:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 Processor -- start 2024-03-27T07:20:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.699+0000 7f1d8f0d4700 1 -- start start 2024-03-27T07:20:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d8f0d4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d881015e0 0x7f1d8806b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d8f0d4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d881027e0 0x7f1d8819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d8f0d4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d88103180 0x7f1d8819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d8f0d4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8810d1e0 con 0x7f1d88103180 2024-03-27T07:20:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d8f0d4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8810d060 con 0x7f1d881015e0 2024-03-27T07:20:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d8f0d4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8810d360 con 0x7f1d881027e0 2024-03-27T07:20:20.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d87fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d881027e0 0x7f1d8819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d87fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d881027e0 0x7f1d8819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49612/0 (socket says 172.21.15.153:49612) 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d87fff700 1 -- 172.21.15.153:0/3970279138 learned_addr learned my addr 172.21.15.153:0/3970279138 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d8ce70700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d881015e0 0x7f1d8806b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d8d671700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d88103180 0x7f1d8819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d87fff700 1 -- 172.21.15.153:0/3970279138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d881015e0 msgr2=0x7f1d8806b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d87fff700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d881015e0 0x7f1d8806b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d87fff700 1 -- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d88103180 msgr2=0x7f1d8819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d87fff700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d88103180 0x7f1d8819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d87fff700 1 -- 172.21.15.153:0/3970279138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d881a0530 con 0x7f1d881027e0 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d8d671700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d88103180 0x7f1d8819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d8ce70700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d881015e0 0x7f1d8806b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.700+0000 7f1d87fff700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d881027e0 0x7f1d8819d620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400d950 tx=0x7f1d7400dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.701+0000 7f1d85ffb700 1 -- 172.21.15.153:0/3970279138 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74016070 con 0x7f1d881027e0 2024-03-27T07:20:20.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.701+0000 7f1d85ffb700 1 -- 172.21.15.153:0/3970279138 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d74009b40 con 0x7f1d881027e0 2024-03-27T07:20:20.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.701+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/3970279138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d881a0820 con 0x7f1d881027e0 2024-03-27T07:20:20.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.701+0000 7f1d85ffb700 1 -- 172.21.15.153:0/3970279138 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400f620 con 0x7f1d881027e0 2024-03-27T07:20:20.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.701+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/3970279138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d881a0de0 con 0x7f1d881027e0 2024-03-27T07:20:20.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.702+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/3970279138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d88069300 con 0x7f1d881027e0 2024-03-27T07:20:20.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.704+0000 7f1d85ffb700 1 -- 172.21.15.153:0/3970279138 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f1d74019070 con 0x7f1d881027e0 2024-03-27T07:20:20.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.704+0000 7f1d85ffb700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d780a36a0 0x7f1d780a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:20.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.704+0000 7f1d85ffb700 1 -- 172.21.15.153:0/3970279138 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 6694+0+0 (secure 0 0 0) 0x7f1d740cf6d0 con 0x7f1d881027e0 2024-03-27T07:20:20.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.704+0000 7f1d8ce70700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d780a36a0 0x7f1d780a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:20.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.705+0000 7f1d8ce70700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d780a36a0 0x7f1d780a5b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d88102640 tx=0x7f1d7c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:20.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.708+0000 7f1d85ffb700 1 -- 172.21.15.153:0/3970279138 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1d7409c8f0 con 0x7f1d881027e0 2024-03-27T07:20:20.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:20.913+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/3970279138 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1d88062a80 con 0x7f1d780a36a0 2024-03-27T07:20:20.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:20 smithi082 ceph-mon[32178]: osdmap e76: 11 total, 11 up, 11 in 2024-03-27T07:20:21.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:20 smithi149 ceph-mon[36065]: osdmap e76: 11 total, 11 up, 11 in 2024-03-27T07:20:21.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:21 smithi153 ceph-mon[36179]: pgmap v243: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-27T07:20:21.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:21 smithi153 ceph-mon[36179]: osdmap e77: 11 total, 11 up, 11 in 2024-03-27T07:20:21.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:20:21.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:20:21.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:21 smithi082 ceph-mon[32178]: pgmap v243: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-27T07:20:21.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:21 smithi082 ceph-mon[32178]: osdmap e77: 11 total, 11 up, 11 in 2024-03-27T07:20:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:20:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:20:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:22.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:21 smithi149 ceph-mon[36065]: pgmap v243: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-27T07:20:22.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:21 smithi149 ceph-mon[36065]: osdmap e77: 11 total, 11 up, 11 in 2024-03-27T07:20:22.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T07:20:22.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T07:20:22.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:22.896 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:22 smithi153 ceph-mon[36179]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:20:22.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:22 smithi082 ceph-mon[32178]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:20:23.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:22 smithi149 ceph-mon[36065]: from='client.24340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:20:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:23 smithi082 ceph-mon[32178]: pgmap v245: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-03-27T07:20:24.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:23 smithi149 ceph-mon[36065]: pgmap v245: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-03-27T07:20:24.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:23 smithi153 ceph-mon[36179]: pgmap v245: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-03-27T07:20:24.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:24 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/491194795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d520186c-b3fd-4979-8b42-634cd9b0c60b"}]: dispatch 2024-03-27T07:20:24.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:24 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d520186c-b3fd-4979-8b42-634cd9b0c60b"}]: dispatch 2024-03-27T07:20:24.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:24 smithi082 ceph-mon[32178]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d520186c-b3fd-4979-8b42-634cd9b0c60b"}]': finished 2024-03-27T07:20:24.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:24 smithi082 ceph-mon[32178]: osdmap e78: 12 total, 11 up, 12 in 2024-03-27T07:20:24.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:24.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:24 smithi082 ceph-mon[32178]: pgmap v247: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-27T07:20:24.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:24 smithi082 ceph-mon[32178]: from='client.? 172.21.15.153:0/3454132736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:20:25.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:24 smithi149 ceph-mon[36065]: from='client.? 172.21.15.153:0/491194795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d520186c-b3fd-4979-8b42-634cd9b0c60b"}]: dispatch 2024-03-27T07:20:25.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:24 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d520186c-b3fd-4979-8b42-634cd9b0c60b"}]: dispatch 2024-03-27T07:20:25.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:24 smithi149 ceph-mon[36065]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d520186c-b3fd-4979-8b42-634cd9b0c60b"}]': finished 2024-03-27T07:20:25.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:24 smithi149 ceph-mon[36065]: osdmap e78: 12 total, 11 up, 12 in 2024-03-27T07:20:25.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:25.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:24 smithi149 ceph-mon[36065]: pgmap v247: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-27T07:20:25.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:24 smithi149 ceph-mon[36065]: from='client.? 172.21.15.153:0/3454132736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:20:25.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:24 smithi153 ceph-mon[36179]: from='client.? 172.21.15.153:0/491194795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d520186c-b3fd-4979-8b42-634cd9b0c60b"}]: dispatch 2024-03-27T07:20:25.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:24 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d520186c-b3fd-4979-8b42-634cd9b0c60b"}]: dispatch 2024-03-27T07:20:25.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:24 smithi153 ceph-mon[36179]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d520186c-b3fd-4979-8b42-634cd9b0c60b"}]': finished 2024-03-27T07:20:25.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:24 smithi153 ceph-mon[36179]: osdmap e78: 12 total, 11 up, 12 in 2024-03-27T07:20:25.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:25.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:24 smithi153 ceph-mon[36179]: pgmap v247: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-03-27T07:20:25.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:24 smithi153 ceph-mon[36179]: from='client.? 172.21.15.153:0/3454132736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T07:20:26.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:20:26 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:20:26.413+0000 7f1e2e0f2700 -1 calc_pg_upmaps abort due to max <= 0 2024-03-27T07:20:27.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:27 smithi149 ceph-mon[36065]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:27.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:27 smithi153 ceph-mon[36179]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:27 smithi082 ceph-mon[32178]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:29.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:29 smithi149 ceph-mon[36065]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:29.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:29 smithi153 ceph-mon[36179]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:29.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:29 smithi082 ceph-mon[32178]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:31.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:31 smithi153 ceph-mon[36179]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:31.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:31 smithi082 ceph-mon[32178]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:31 smithi149 ceph-mon[36065]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:32.586 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:32 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-27T07:20:32.586 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:32 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:32.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:32 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-27T07:20:32.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:32 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:33.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:32 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-27T07:20:33.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:32 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:33.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:33 smithi153 ceph-mon[36179]: Deploying daemon osd.11 on smithi153 2024-03-27T07:20:33.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:33 smithi153 ceph-mon[36179]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:33.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:33 smithi082 ceph-mon[32178]: Deploying daemon osd.11 on smithi153 2024-03-27T07:20:33.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:33 smithi082 ceph-mon[32178]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:33 smithi149 ceph-mon[36065]: Deploying daemon osd.11 on smithi153 2024-03-27T07:20:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:33 smithi149 ceph-mon[36065]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:35.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:35 smithi153 ceph-mon[36179]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:35.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:35 smithi082 ceph-mon[32178]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:35 smithi149 ceph-mon[36065]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:37.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:37 smithi153 ceph-mon[36179]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:37 smithi082 ceph-mon[32178]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:37 smithi149 ceph-mon[36065]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:39.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:39.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:39.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:39 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:39.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:39 smithi153 ceph-mon[36179]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:39.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:39.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:39.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:39 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:39.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:39 smithi082 ceph-mon[32178]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:39.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:39.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:39.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:39 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:39.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:39 smithi149 ceph-mon[36065]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:41.607 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:41 smithi153 ceph-mon[36179]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:41.607 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:41 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:41.607 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:41 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:41.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:41 smithi149 ceph-mon[36065]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:41.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:41 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:41.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:41 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:41.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:41 smithi082 ceph-mon[32178]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:41.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:41 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:41.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:41 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:42.036 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 11 on host 'smithi153' 2024-03-27T07:20:42.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.034+0000 7f1d85ffb700 1 -- 172.21.15.153:0/3970279138 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1d88062a80 con 0x7f1d780a36a0 2024-03-27T07:20:42.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d780a36a0 msgr2=0x7f1d780a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:42.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d780a36a0 0x7f1d780a5b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d88102640 tx=0x7f1d7c008040 comp rx=0 tx=0).stop 2024-03-27T07:20:42.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/3970279138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d881027e0 msgr2=0x7f1d8819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:42.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d881027e0 0x7f1d8819d620 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400d950 tx=0x7f1d7400dd10 comp rx=0 tx=0).stop 2024-03-27T07:20:42.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/3970279138 shutdown_connections 2024-03-27T07:20:42.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1d780a36a0 0x7f1d780a5b60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:42.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d88103180 0x7f1d8819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:42.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1d881015e0 0x7f1d8806b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:42.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 --2- 172.21.15.153:0/3970279138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d881027e0 0x7f1d8819d620 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:42.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/3970279138 >> 172.21.15.153:0/3970279138 conn(0x7f1d880fcba0 msgr2=0x7f1d88105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:42.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/3970279138 shutdown_connections 2024-03-27T07:20:42.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:42.037+0000 7f1d8f0d4700 1 -- 172.21.15.153:0/3970279138 wait complete. 2024-03-27T07:20:42.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:42 smithi153 ceph-mon[36179]: from='osd.11 [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T07:20:42.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:42 smithi153 ceph-mon[36179]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T07:20:42.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:42.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:42 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:42.882 DEBUG:teuthology.orchestra.run.smithi153:osd.11> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.11.service 2024-03-27T07:20:42.885 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-03-27T07:20:42.885 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd stat -f json 2024-03-27T07:20:42.915 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:42 smithi082 ceph-mon[32178]: from='osd.11 [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T07:20:42.915 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:42 smithi082 ceph-mon[32178]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T07:20:42.916 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:42.916 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:42 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:43.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:42 smithi149 ceph-mon[36065]: from='osd.11 [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T07:20:43.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:42 smithi149 ceph-mon[36065]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T07:20:43.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:43.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:42 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:43.137 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:20:43.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:43 smithi153 ceph-mon[36179]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:43.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:43 smithi153 ceph-mon[36179]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-27T07:20:43.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:43 smithi153 ceph-mon[36179]: osdmap e79: 12 total, 11 up, 12 in 2024-03-27T07:20:43.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:43 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:43.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:43 smithi153 ceph-mon[36179]: from='osd.11 [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:20:43.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:43 smithi153 ceph-mon[36179]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:20:43.787 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:20:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:20:43.519+0000 7f8ec07b8700 -1 osd.11 0 waiting for initial osdmap 2024-03-27T07:20:43.787 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:20:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:20:43.531+0000 7f8ebc5ab700 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T07:20:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:43 smithi082 ceph-mon[32178]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:43 smithi082 ceph-mon[32178]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-27T07:20:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:43 smithi082 ceph-mon[32178]: osdmap e79: 12 total, 11 up, 12 in 2024-03-27T07:20:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:43 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:43 smithi082 ceph-mon[32178]: from='osd.11 [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:20:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:43 smithi082 ceph-mon[32178]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:20:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:43 smithi149 ceph-mon[36065]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:43 smithi149 ceph-mon[36065]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-27T07:20:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:43 smithi149 ceph-mon[36065]: osdmap e79: 12 total, 11 up, 12 in 2024-03-27T07:20:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:43 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:43 smithi149 ceph-mon[36065]: from='osd.11 [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:20:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:43 smithi149 ceph-mon[36065]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-03-27T07:20:44.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:44 smithi082 ceph-mon[32178]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:20:44.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:44 smithi082 ceph-mon[32178]: osdmap e80: 12 total, 11 up, 12 in 2024-03-27T07:20:44.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:44 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:44.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:44 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:44.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:44 smithi153 ceph-mon[36179]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:20:44.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:44 smithi153 ceph-mon[36179]: osdmap e80: 12 total, 11 up, 12 in 2024-03-27T07:20:44.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:44 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:44.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:44 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:44.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.850+0000 7f7159756700 1 -- 172.21.15.82:0/1275791694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7154103100 msgr2=0x7f71541099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:44.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.850+0000 7f7159756700 1 --2- 172.21.15.82:0/1275791694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7154103100 0x7f71541099b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b0d0 tx=0x7f714c00b3e0 comp rx=0 tx=0).stop 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.850+0000 7f7159756700 1 -- 172.21.15.82:0/1275791694 shutdown_connections 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.850+0000 7f7159756700 1 --2- 172.21.15.82:0/1275791694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154101560 0x7f7154101980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.850+0000 7f7159756700 1 --2- 172.21.15.82:0/1275791694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7154103100 0x7f71541099b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.850+0000 7f7159756700 1 --2- 172.21.15.82:0/1275791694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7154102760 0x7f7154102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.850+0000 7f7159756700 1 -- 172.21.15.82:0/1275791694 >> 172.21.15.82:0/1275791694 conn(0x7f71540fcb00 msgr2=0x7f71540fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.850+0000 7f7159756700 1 -- 172.21.15.82:0/1275791694 shutdown_connections 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.850+0000 7f7159756700 1 -- 172.21.15.82:0/1275791694 wait complete. 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7159756700 1 Processor -- start 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7159756700 1 -- start start 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7159756700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7154101560 0x7f7154197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7159756700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154102760 0x7f7154197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7159756700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7154103100 0x7f715419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7159756700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f715410d150 con 0x7f7154101560 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7159756700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f715410cfd0 con 0x7f7154103100 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7159756700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f715410d2d0 con 0x7f7154102760 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7152ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7154101560 0x7f7154197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7152ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7154101560 0x7f7154197670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52522/0 (socket says 172.21.15.82:52522) 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.851+0000 7f7152ffd700 1 -- 172.21.15.82:0/4009416879 learned_addr learned my addr 172.21.15.82:0/4009416879 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f71527fc700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154102760 0x7f7154197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f71537fe700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7154103100 0x7f715419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f7152ffd700 1 -- 172.21.15.82:0/4009416879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154102760 msgr2=0x7f7154197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f7152ffd700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154102760 0x7f7154197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f7152ffd700 1 -- 172.21.15.82:0/4009416879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7154103100 msgr2=0x7f715419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f7152ffd700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7154103100 0x7f715419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f7152ffd700 1 -- 172.21.15.82:0/4009416879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715419f2d0 con 0x7f7154101560 2024-03-27T07:20:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f7152ffd700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7154101560 0x7f7154197670 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f714800e980 tx=0x7f714800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f713bfff700 1 -- 172.21.15.82:0/4009416879 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148004230 con 0x7f7154101560 2024-03-27T07:20:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f713bfff700 1 -- 172.21.15.82:0/4009416879 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71480043d0 con 0x7f7154101560 2024-03-27T07:20:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f7159756700 1 -- 172.21.15.82:0/4009416879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715419f5c0 con 0x7f7154101560 2024-03-27T07:20:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f713bfff700 1 -- 172.21.15.82:0/4009416879 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148003dc0 con 0x7f7154101560 2024-03-27T07:20:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.852+0000 7f7159756700 1 -- 172.21.15.82:0/4009416879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715419fab0 con 0x7f7154101560 2024-03-27T07:20:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.853+0000 7f7159756700 1 -- 172.21.15.82:0/4009416879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7154069300 con 0x7f7154101560 2024-03-27T07:20:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.854+0000 7f713bfff700 1 -- 172.21.15.82:0/4009416879 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f714800c810 con 0x7f7154101560 2024-03-27T07:20:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.855+0000 7f713bfff700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f713c0a36a0 0x7f713c0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.855+0000 7f71527fc700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f713c0a36a0 0x7f713c0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.855+0000 7f713bfff700 1 -- 172.21.15.82:0/4009416879 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7127+0+0 (secure 0 0 0) 0x7f71480cfad0 con 0x7f7154101560 2024-03-27T07:20:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.855+0000 7f71527fc700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f713c0a36a0 0x7f713c0a5b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f714400ac50 tx=0x7f714400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:44.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:44.859+0000 7f713bfff700 1 -- 172.21.15.82:0/4009416879 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f714809cb40 con 0x7f7154101560 2024-03-27T07:20:45.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:44 smithi149 ceph-mon[36065]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-03-27T07:20:45.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:44 smithi149 ceph-mon[36065]: osdmap e80: 12 total, 11 up, 12 in 2024-03-27T07:20:45.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:44 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:45.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:44 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:45.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.059+0000 7f7159756700 1 -- 172.21.15.82:0/4009416879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f715402ddf0 con 0x7f7154101560 2024-03-27T07:20:45.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.060+0000 7f713bfff700 1 -- 172.21.15.82:0/4009416879 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) ==== 74+0+133 (secure 0 0 0) 0x7f714809c440 con 0x7f7154101560 2024-03-27T07:20:45.061 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:20:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 -- 172.21.15.82:0/4009416879 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f713c0a36a0 msgr2=0x7f713c0a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f713c0a36a0 0x7f713c0a5b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f714400ac50 tx=0x7f714400a380 comp rx=0 tx=0).stop 2024-03-27T07:20:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 -- 172.21.15.82:0/4009416879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7154101560 msgr2=0x7f7154197670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7154101560 0x7f7154197670 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f714800e980 tx=0x7f714800ec90 comp rx=0 tx=0).stop 2024-03-27T07:20:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 -- 172.21.15.82:0/4009416879 shutdown_connections 2024-03-27T07:20:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f713c0a36a0 0x7f713c0a5b60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7154103100 0x7f715419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7154101560 0x7f7154197670 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 --2- 172.21.15.82:0/4009416879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7154102760 0x7f7154197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 -- 172.21.15.82:0/4009416879 >> 172.21.15.82:0/4009416879 conn(0x7f71540fcb00 msgr2=0x7f7154105990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 -- 172.21.15.82:0/4009416879 shutdown_connections 2024-03-27T07:20:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:45.062+0000 7f7159756700 1 -- 172.21.15.82:0/4009416879 wait complete. 2024-03-27T07:20:45.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:45 smithi082 ceph-mon[32178]: purged_snaps scrub starts 2024-03-27T07:20:45.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:45 smithi082 ceph-mon[32178]: purged_snaps scrub ok 2024-03-27T07:20:45.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:45 smithi082 ceph-mon[32178]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:45.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:45 smithi082 ceph-mon[32178]: osd.11 [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] boot 2024-03-27T07:20:45.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:45 smithi082 ceph-mon[32178]: osdmap e81: 12 total, 12 up, 12 in 2024-03-27T07:20:45.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:45 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:45.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:45 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4009416879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-27T07:20:45.691 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1711524044,"num_in_osds":12,"osd_in_since":1711524023,"num_remapped_pgs":0} 2024-03-27T07:20:45.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-27T07:20:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:45 smithi153 ceph-mon[36179]: purged_snaps scrub starts 2024-03-27T07:20:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:45 smithi153 ceph-mon[36179]: purged_snaps scrub ok 2024-03-27T07:20:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:45 smithi153 ceph-mon[36179]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:45 smithi153 ceph-mon[36179]: osd.11 [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] boot 2024-03-27T07:20:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:45 smithi153 ceph-mon[36179]: osdmap e81: 12 total, 12 up, 12 in 2024-03-27T07:20:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:45 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:45 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4009416879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-27T07:20:45.972 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:20:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:45 smithi149 ceph-mon[36065]: purged_snaps scrub starts 2024-03-27T07:20:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:45 smithi149 ceph-mon[36065]: purged_snaps scrub ok 2024-03-27T07:20:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:45 smithi149 ceph-mon[36065]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-03-27T07:20:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:45 smithi149 ceph-mon[36065]: osd.11 [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] boot 2024-03-27T07:20:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:45 smithi149 ceph-mon[36065]: osdmap e81: 12 total, 12 up, 12 in 2024-03-27T07:20:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:45 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:20:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:45 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4009416879' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: osdmap e82: 12 total, 12 up, 12 in 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:46.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:46 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: osdmap e82: 12 total, 12 up, 12 in 2024-03-27T07:20:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:46.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:46.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:46.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:46.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:46.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:46.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:46 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:47.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: osdmap e82: 12 total, 12 up, 12 in 2024-03-27T07:20:47.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:47.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:47.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:47.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:47.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:20:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:46 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.628+0000 7f8586665700 1 -- 172.21.15.82:0/41008693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8580101ee0 msgr2=0x7f858010e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.628+0000 7f8586665700 1 --2- 172.21.15.82:0/41008693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8580101ee0 0x7f858010e3d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8578009fc0 tx=0x7f857800b330 comp rx=0 tx=0).stop 2024-03-27T07:20:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.628+0000 7f8586665700 1 -- 172.21.15.82:0/41008693 shutdown_connections 2024-03-27T07:20:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.628+0000 7f8586665700 1 --2- 172.21.15.82:0/41008693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8580101ee0 0x7f858010e3d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:47.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.628+0000 7f8586665700 1 --2- 172.21.15.82:0/41008693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85801064d0 0x7f85801068b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.628+0000 7f8586665700 1 --2- 172.21.15.82:0/41008693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8580101520 0x7f85801019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.629+0000 7f8586665700 1 -- 172.21.15.82:0/41008693 >> 172.21.15.82:0/41008693 conn(0x7f8580078550 msgr2=0x7f8580078960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.629+0000 7f8586665700 1 -- 172.21.15.82:0/41008693 shutdown_connections 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.629+0000 7f8586665700 1 -- 172.21.15.82:0/41008693 wait complete. 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.629+0000 7f8586665700 1 Processor -- start 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.629+0000 7f8586665700 1 -- start start 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.629+0000 7f8586665700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8580101520 0x7f858019b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.629+0000 7f8586665700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8580101ee0 0x7f858019b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f8586665700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85801064d0 0x7f858019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f8586665700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f85801118a0 con 0x7f8580101ee0 2024-03-27T07:20:47.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f8586665700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8580111720 con 0x7f85801064d0 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f8586665700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8580111a20 con 0x7f8580101520 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8580101ee0 0x7f858019b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857f7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8580101ee0 0x7f858019b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39654/0 (socket says 172.21.15.82:39654) 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857f7fe700 1 -- 172.21.15.82:0/1903989729 learned_addr learned my addr 172.21.15.82:0/1903989729 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857ffff700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8580101520 0x7f858019b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f8584c02700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85801064d0 0x7f858019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857f7fe700 1 -- 172.21.15.82:0/1903989729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8580101520 msgr2=0x7f858019b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857f7fe700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8580101520 0x7f858019b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857f7fe700 1 -- 172.21.15.82:0/1903989729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85801064d0 msgr2=0x7f858019f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857f7fe700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85801064d0 0x7f858019f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857f7fe700 1 -- 172.21.15.82:0/1903989729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85801a0020 con 0x7f8580101ee0 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857f7fe700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8580101ee0 0x7f858019b550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f857400e9c0 tx=0x7f857400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:47.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857d7fa700 1 -- 172.21.15.82:0/1903989729 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574004a30 con 0x7f8580101ee0 2024-03-27T07:20:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f8586665700 1 -- 172.21.15.82:0/1903989729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85801a0310 con 0x7f8580101ee0 2024-03-27T07:20:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.630+0000 7f857d7fa700 1 -- 172.21.15.82:0/1903989729 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f857400cca0 con 0x7f8580101ee0 2024-03-27T07:20:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.631+0000 7f857d7fa700 1 -- 172.21.15.82:0/1903989729 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574005610 con 0x7f8580101ee0 2024-03-27T07:20:47.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.631+0000 7f8586665700 1 -- 172.21.15.82:0/1903989729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85801a7b90 con 0x7f8580101ee0 2024-03-27T07:20:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.631+0000 7f8586665700 1 -- 172.21.15.82:0/1903989729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8580069300 con 0x7f8580101ee0 2024-03-27T07:20:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.632+0000 7f857d7fa700 1 -- 172.21.15.82:0/1903989729 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f8574004cf0 con 0x7f8580101ee0 2024-03-27T07:20:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.633+0000 7f857d7fa700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f85680a36a0 0x7f85680a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.633+0000 7f857ffff700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f85680a36a0 0x7f85680a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.633+0000 7f857d7fa700 1 -- 172.21.15.82:0/1903989729 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f85740cf960 con 0x7f8580101ee0 2024-03-27T07:20:47.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.633+0000 7f857ffff700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f85680a36a0 0x7f85680a5b60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8580102730 tx=0x7f857000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:47.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.638+0000 7f857d7fa700 1 -- 172.21.15.82:0/1903989729 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f857409c9d0 con 0x7f8580101ee0 2024-03-27T07:20:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:47 smithi082 ceph-mon[32178]: Detected new or changed devices on smithi153 2024-03-27T07:20:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:47 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi153 to 4270M 2024-03-27T07:20:47.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:47 smithi082 ceph-mon[32178]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:47.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:47 smithi153 ceph-mon[36179]: Detected new or changed devices on smithi153 2024-03-27T07:20:47.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:47 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi153 to 4270M 2024-03-27T07:20:47.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:47 smithi153 ceph-mon[36179]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:47.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.836+0000 7f8586665700 1 -- 172.21.15.82:0/1903989729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85801a7dc0 con 0x7f8580101ee0 2024-03-27T07:20:47.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.837+0000 7f857d7fa700 1 -- 172.21.15.82:0/1903989729 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18409 (secure 0 0 0) 0x7f857409c2d0 con 0x7f8580101ee0 2024-03-27T07:20:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:20:47.839 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:20:45.525020+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:20:47.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 -- 172.21.15.82:0/1903989729 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f85680a36a0 msgr2=0x7f85680a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:47.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f85680a36a0 0x7f85680a5b60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8580102730 tx=0x7f857000b410 comp rx=0 tx=0).stop 2024-03-27T07:20:47.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 -- 172.21.15.82:0/1903989729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8580101ee0 msgr2=0x7f858019b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:47.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8580101ee0 0x7f858019b550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f857400e9c0 tx=0x7f857400ecd0 comp rx=0 tx=0).stop 2024-03-27T07:20:47.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 -- 172.21.15.82:0/1903989729 shutdown_connections 2024-03-27T07:20:47.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f85680a36a0 0x7f85680a5b60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:47.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8580101520 0x7f858019b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:47.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f85801064d0 0x7f858019f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:47.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 --2- 172.21.15.82:0/1903989729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8580101ee0 0x7f858019b550 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:47.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 -- 172.21.15.82:0/1903989729 >> 172.21.15.82:0/1903989729 conn(0x7f8580078550 msgr2=0x7f858006aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:47.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 -- 172.21.15.82:0/1903989729 shutdown_connections 2024-03-27T07:20:47.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:47.839+0000 7f8586665700 1 -- 172.21.15.82:0/1903989729 wait complete. 2024-03-27T07:20:48.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:47 smithi149 ceph-mon[36065]: Detected new or changed devices on smithi153 2024-03-27T07:20:48.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:47 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi153 to 4270M 2024-03-27T07:20:48.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:47 smithi149 ceph-mon[36065]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:48.614 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:20:48.615 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-27T07:20:48.855 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:20:48.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:48 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1903989729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:20:49.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:48 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1903989729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:20:49.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:48 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1903989729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:20:49.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:49 smithi082 ceph-mon[32178]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:50.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:49 smithi149 ceph-mon[36065]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:50.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:49 smithi153 ceph-mon[36179]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:50.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.465+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2688663908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a4101560 msgr2=0x7fd5a41019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:50.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.465+0000 7fd5aa6d8700 1 --2- 172.21.15.82:0/2688663908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a4101560 0x7fd5a41019e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd5940099c0 tx=0x7fd594009cd0 comp rx=0 tx=0).stop 2024-03-27T07:20:50.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.465+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2688663908 shutdown_connections 2024-03-27T07:20:50.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.465+0000 7fd5aa6d8700 1 --2- 172.21.15.82:0/2688663908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5a4107610 0x7fd5a41079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:50.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.465+0000 7fd5aa6d8700 1 --2- 172.21.15.82:0/2688663908 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4101f20 0x7fd5a410e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:50.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.465+0000 7fd5aa6d8700 1 --2- 172.21.15.82:0/2688663908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a4101560 0x7fd5a41019e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:50.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.465+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2688663908 >> 172.21.15.82:0/2688663908 conn(0x7fd5a4078610 msgr2=0x7fd5a4078a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:50.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.465+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2688663908 shutdown_connections 2024-03-27T07:20:50.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.465+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2688663908 wait complete. 2024-03-27T07:20:50.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5aa6d8700 1 Processor -- start 2024-03-27T07:20:50.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5aa6d8700 1 -- start start 2024-03-27T07:20:50.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5aa6d8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4101560 0x7fd5a4199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:50.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5aa6d8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a4101f20 0x7fd5a419a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:50.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5aa6d8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5a4107610 0x7fd5a41a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:50.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5aa6d8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a4111910 con 0x7fd5a4101f20 2024-03-27T07:20:50.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5aa6d8700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a4111790 con 0x7fd5a4101560 2024-03-27T07:20:50.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5aa6d8700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a4111a90 con 0x7fd5a4107610 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5a37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a4101f20 0x7fd5a419a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5a37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a4101f20 0x7fd5a419a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39678/0 (socket says 172.21.15.82:39678) 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5a37fe700 1 -- 172.21.15.82:0/2602065588 learned_addr learned my addr 172.21.15.82:0/2602065588 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.466+0000 7fd5a3fff700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4101560 0x7fd5a4199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5a8c75700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5a4107610 0x7fd5a41a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5a37fe700 1 -- 172.21.15.82:0/2602065588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5a4107610 msgr2=0x7fd5a41a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5a37fe700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5a4107610 0x7fd5a41a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5a37fe700 1 -- 172.21.15.82:0/2602065588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4101560 msgr2=0x7fd5a4199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5a37fe700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4101560 0x7fd5a4199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5a37fe700 1 -- 172.21.15.82:0/2602065588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a41a5210 con 0x7fd5a4101f20 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5a37fe700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a4101f20 0x7fd5a419a190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd594009990 tx=0x7fd594009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:50.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5a17fa700 1 -- 172.21.15.82:0/2602065588 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd594026070 con 0x7fd5a4101f20 2024-03-27T07:20:50.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2602065588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a41a53e0 con 0x7fd5a4101f20 2024-03-27T07:20:50.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5a17fa700 1 -- 172.21.15.82:0/2602065588 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd594003780 con 0x7fd5a4101f20 2024-03-27T07:20:50.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5a17fa700 1 -- 172.21.15.82:0/2602065588 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59400fc90 con 0x7fd5a4101f20 2024-03-27T07:20:50.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.467+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2602065588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a41a5890 con 0x7fd5a4101f20 2024-03-27T07:20:50.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.468+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2602065588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a4109aa0 con 0x7fd5a4101f20 2024-03-27T07:20:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.469+0000 7fd5a17fa700 1 -- 172.21.15.82:0/2602065588 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fd594029070 con 0x7fd5a4101f20 2024-03-27T07:20:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.470+0000 7fd5a17fa700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd5900a36a0 0x7fd5900a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.470+0000 7fd5a3fff700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd5900a36a0 0x7fd5900a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.470+0000 7fd5a17fa700 1 -- 172.21.15.82:0/2602065588 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fd5940d05e0 con 0x7fd5a4101f20 2024-03-27T07:20:50.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.470+0000 7fd5a3fff700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd5900a36a0 0x7fd5900a5b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009a10 tx=0x7fd58c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:50.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.473+0000 7fd5a17fa700 1 -- 172.21.15.82:0/2602065588 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd594030020 con 0x7fd5a4101f20 2024-03-27T07:20:50.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.673+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2602065588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5a4109480 con 0x7fd5a4101f20 2024-03-27T07:20:50.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.673+0000 7fd5a17fa700 1 -- 172.21.15.82:0/2602065588 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7fd594013070 con 0x7fd5a4101f20 2024-03-27T07:20:50.676 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:20:50.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.675+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2602065588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd5900a36a0 msgr2=0x7fd5900a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:50.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.675+0000 7fd5aa6d8700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd5900a36a0 0x7fd5900a5b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009a10 tx=0x7fd58c009190 comp rx=0 tx=0).stop 2024-03-27T07:20:50.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.675+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2602065588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a4101f20 msgr2=0x7fd5a419a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:50.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.675+0000 7fd5aa6d8700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a4101f20 0x7fd5a419a190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd594009990 tx=0x7fd594009f80 comp rx=0 tx=0).stop 2024-03-27T07:20:50.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.676+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2602065588 shutdown_connections 2024-03-27T07:20:50.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.676+0000 7fd5aa6d8700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd5900a36a0 0x7fd5900a5b60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:50.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.676+0000 7fd5aa6d8700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5a4107610 0x7fd5a41a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:50.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.676+0000 7fd5aa6d8700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5a4101560 0x7fd5a4199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:50.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.676+0000 7fd5aa6d8700 1 --2- 172.21.15.82:0/2602065588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5a4101f20 0x7fd5a419a190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:50.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.676+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2602065588 >> 172.21.15.82:0/2602065588 conn(0x7fd5a4078610 msgr2=0x7fd5a4100030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:50.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.676+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2602065588 shutdown_connections 2024-03-27T07:20:50.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:50.676+0000 7fd5aa6d8700 1 -- 172.21.15.82:0/2602065588 wait complete. 2024-03-27T07:20:51.431 INFO:tasks.cephadm:Adding mds.a on smithi082 2024-03-27T07:20:51.431 INFO:tasks.cephadm:Adding mds.d on smithi082 2024-03-27T07:20:51.431 INFO:tasks.cephadm:Adding mds.g on smithi082 2024-03-27T07:20:51.431 INFO:tasks.cephadm:Adding mds.j on smithi082 2024-03-27T07:20:51.431 INFO:tasks.cephadm:Adding mds.b on smithi149 2024-03-27T07:20:51.431 INFO:tasks.cephadm:Adding mds.e on smithi149 2024-03-27T07:20:51.432 INFO:tasks.cephadm:Adding mds.h on smithi149 2024-03-27T07:20:51.432 INFO:tasks.cephadm:Adding mds.k on smithi149 2024-03-27T07:20:51.432 INFO:tasks.cephadm:Adding mds.c on smithi153 2024-03-27T07:20:51.432 INFO:tasks.cephadm:Adding mds.f on smithi153 2024-03-27T07:20:51.432 INFO:tasks.cephadm:Adding mds.i on smithi153 2024-03-27T07:20:51.432 INFO:tasks.cephadm:Adding mds.l on smithi153 2024-03-27T07:20:51.432 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph orch apply mds all '12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi149=b;smithi149=e;smithi149=h;smithi149=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l' 2024-03-27T07:20:51.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:51 smithi082 ceph-mon[32178]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:51.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:51 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2602065588' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:20:51.708 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:20:51.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:51 smithi153 ceph-mon[36179]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:51.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:51 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2602065588' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:20:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:51 smithi149 ceph-mon[36065]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:52.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:51 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2602065588' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:20:53.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.552+0000 7f20566c6700 1 -- 172.21.15.153:0/2787263513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20501017c0 msgr2=0x7f2050101c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:53.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.552+0000 7f20566c6700 1 --2- 172.21.15.153:0/2787263513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20501017c0 0x7f2050101c40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2044009990 tx=0x7f2044009ca0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.552+0000 7f20566c6700 1 -- 172.21.15.153:0/2787263513 shutdown_connections 2024-03-27T07:20:53.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.552+0000 7f20566c6700 1 --2- 172.21.15.153:0/2787263513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2050102180 0x7f2050109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.552+0000 7f20566c6700 1 --2- 172.21.15.153:0/2787263513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2050102bf0 0x7f2050103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.552+0000 7f20566c6700 1 --2- 172.21.15.153:0/2787263513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20501017c0 0x7f2050101c40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.552+0000 7f20566c6700 1 -- 172.21.15.153:0/2787263513 >> 172.21.15.153:0/2787263513 conn(0x7f20500fc2b0 msgr2=0x7f20500fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.552+0000 7f20566c6700 1 -- 172.21.15.153:0/2787263513 shutdown_connections 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.552+0000 7f20566c6700 1 -- 172.21.15.153:0/2787263513 wait complete. 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f20566c6700 1 Processor -- start 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f20566c6700 1 -- start start 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f20566c6700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20501017c0 0x7f2050101230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f20566c6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2050102180 0x7f205019d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f20566c6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2050102bf0 0x7f205019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f20566c6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f205010d140 con 0x7f2050102180 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f20566c6700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f205010cfc0 con 0x7f20501017c0 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f20566c6700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f205010d2c0 con 0x7f2050102bf0 2024-03-27T07:20:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f2054c63700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2050102bf0 0x7f205019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f2054c63700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2050102bf0 0x7f205019fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48926/0 (socket says 172.21.15.153:48926) 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f2054c63700 1 -- 172.21.15.153:0/3159306303 learned_addr learned my addr 172.21.15.153:0/3159306303 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f204f7fe700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2050102180 0x7f205019d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f204ffff700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20501017c0 0x7f2050101230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f2054c63700 1 -- 172.21.15.153:0/3159306303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20501017c0 msgr2=0x7f2050101230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.553+0000 7f2054c63700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20501017c0 0x7f2050101230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.554+0000 7f2054c63700 1 -- 172.21.15.153:0/3159306303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2050102180 msgr2=0x7f205019d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.554+0000 7f2054c63700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2050102180 0x7f205019d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.554+0000 7f2054c63700 1 -- 172.21.15.153:0/3159306303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20501a0480 con 0x7f2050102bf0 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.554+0000 7f2054c63700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2050102bf0 0x7f205019fbb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2048007ee0 tx=0x7f204800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.554+0000 7f204d7fa700 1 -- 172.21.15.153:0/3159306303 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048004bb0 con 0x7f2050102bf0 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.554+0000 7f204d7fa700 1 -- 172.21.15.153:0/3159306303 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2048004d50 con 0x7f2050102bf0 2024-03-27T07:20:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.554+0000 7f20566c6700 1 -- 172.21.15.153:0/3159306303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20501a0770 con 0x7f2050102bf0 2024-03-27T07:20:53.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.554+0000 7f204d7fa700 1 -- 172.21.15.153:0/3159306303 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048005960 con 0x7f2050102bf0 2024-03-27T07:20:53.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.554+0000 7f20566c6700 1 -- 172.21.15.153:0/3159306303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20501a0c30 con 0x7f2050102bf0 2024-03-27T07:20:53.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.555+0000 7f20566c6700 1 -- 172.21.15.153:0/3159306303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2050069300 con 0x7f2050102bf0 2024-03-27T07:20:53.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.556+0000 7f204d7fa700 1 -- 172.21.15.153:0/3159306303 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f204801a020 con 0x7f2050102bf0 2024-03-27T07:20:53.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.556+0000 7f204d7fa700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a36a0 0x7f20380a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:53.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.557+0000 7f204d7fa700 1 -- 172.21.15.153:0/3159306303 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f20480cf640 con 0x7f2050102bf0 2024-03-27T07:20:53.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.557+0000 7f204ffff700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a36a0 0x7f20380a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:53.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.557+0000 7f204ffff700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a36a0 0x7f20380a5b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2040007be0 tx=0x7f20400073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.560+0000 7f204d7fa700 1 -- 172.21.15.153:0/3159306303 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2048010070 con 0x7f2050102bf0 2024-03-27T07:20:53.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.767+0000 7f20566c6700 1 -- 172.21.15.153:0/3159306303 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi149=b;smithi149=e;smithi149=h;smithi149=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}) -- 0x7f2050062b80 con 0x7f20380a36a0 2024-03-27T07:20:53.769 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:53 smithi153 ceph-mon[36179]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:53.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.777+0000 7f204d7fa700 1 -- 172.21.15.153:0/3159306303 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f2050062b80 con 0x7f20380a36a0 2024-03-27T07:20:53.779 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mds.all update... 2024-03-27T07:20:53.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.779+0000 7f20566c6700 1 -- 172.21.15.153:0/3159306303 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a36a0 msgr2=0x7f20380a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:53.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.779+0000 7f20566c6700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a36a0 0x7f20380a5b60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2040007be0 tx=0x7f20400073d0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.779+0000 7f20566c6700 1 -- 172.21.15.153:0/3159306303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2050102bf0 msgr2=0x7f205019fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:53.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.779+0000 7f20566c6700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2050102bf0 0x7f205019fbb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2048007ee0 tx=0x7f204800d3b0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.779+0000 7f20566c6700 1 -- 172.21.15.153:0/3159306303 shutdown_connections 2024-03-27T07:20:53.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.779+0000 7f20566c6700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a36a0 0x7f20380a5b60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.779+0000 7f20566c6700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2050102bf0 0x7f205019fbb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.779+0000 7f20566c6700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20501017c0 0x7f2050101230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.779+0000 7f20566c6700 1 --2- 172.21.15.153:0/3159306303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2050102180 0x7f205019d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:53.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.779+0000 7f20566c6700 1 -- 172.21.15.153:0/3159306303 >> 172.21.15.153:0/3159306303 conn(0x7f20500fc2b0 msgr2=0x7f2050105a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:53.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.780+0000 7f20566c6700 1 -- 172.21.15.153:0/3159306303 shutdown_connections 2024-03-27T07:20:53.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-03-27T07:20:53.780+0000 7f20566c6700 1 -- 172.21.15.153:0/3159306303 wait complete. 2024-03-27T07:20:53.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:53 smithi082 ceph-mon[32178]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:54.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:53 smithi149 ceph-mon[36065]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:54.520 DEBUG:teuthology.orchestra.run.smithi082:mds.a> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.a.service 2024-03-27T07:20:54.523 DEBUG:teuthology.orchestra.run.smithi082:mds.d> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.d.service 2024-03-27T07:20:54.567 DEBUG:teuthology.orchestra.run.smithi082:mds.g> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.g.service 2024-03-27T07:20:54.610 DEBUG:teuthology.orchestra.run.smithi082:mds.j> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.j.service 2024-03-27T07:20:54.654 DEBUG:teuthology.orchestra.run.smithi149:mds.b> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.b.service 2024-03-27T07:20:54.657 DEBUG:teuthology.orchestra.run.smithi149:mds.e> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.e.service 2024-03-27T07:20:54.701 DEBUG:teuthology.orchestra.run.smithi149:mds.h> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.h.service 2024-03-27T07:20:54.745 DEBUG:teuthology.orchestra.run.smithi149:mds.k> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.k.service 2024-03-27T07:20:54.787 DEBUG:teuthology.orchestra.run.smithi153:mds.c> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service 2024-03-27T07:20:54.790 DEBUG:teuthology.orchestra.run.smithi153:mds.f> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.f.service 2024-03-27T07:20:54.833 DEBUG:teuthology.orchestra.run.smithi153:mds.i> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.i.service 2024-03-27T07:20:54.875 DEBUG:teuthology.orchestra.run.smithi153:mds.l> sudo journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.l.service 2024-03-27T07:20:54.918 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-03-27T07:20:54.919 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:20:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi149=b;smithi149=e;smithi149=h;smithi149=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:20:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi149=b;smithi149=e;smithi149=h;smithi149=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-03-27T07:20:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:54.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:20:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:20:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: Deploying daemon mds.l on smithi153 2024-03-27T07:20:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:54 smithi082 ceph-mon[32178]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi149=b;smithi149=e;smithi149=h;smithi149=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi149=b;smithi149=e;smithi149=h;smithi149=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: Deploying daemon mds.l on smithi153 2024-03-27T07:20:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:54 smithi149 ceph-mon[36065]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:55.011 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi149=b;smithi149=e;smithi149=h;smithi149=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:20:55.011 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi149=b;smithi149=e;smithi149=h;smithi149=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-03-27T07:20:55.011 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:55.011 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:20:55.011 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:55.011 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:20:55.011 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:55.011 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:20:55.011 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:20:55.011 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:55.012 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: Deploying daemon mds.l on smithi153 2024-03-27T07:20:55.012 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:54 smithi153 ceph-mon[36179]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.027+0000 7f956f0eb640 1 -- 172.21.15.82:0/169078658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95681013f0 msgr2=0x7f9568101870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.027+0000 7f956f0eb640 1 --2- 172.21.15.82:0/169078658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95681013f0 0x7f9568101870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f955400aa10 tx=0x7f955402cf70 comp rx=0 tx=0).stop 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.027+0000 7f956f0eb640 1 -- 172.21.15.82:0/169078658 shutdown_connections 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.027+0000 7f956f0eb640 1 --2- 172.21.15.82:0/169078658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95681013f0 0x7f9568101870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.027+0000 7f956f0eb640 1 --2- 172.21.15.82:0/169078658 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9568101db0 0x7f9568108640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.027+0000 7f956f0eb640 1 --2- 172.21.15.82:0/169078658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9568100200 0x7f9568100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.027+0000 7f956f0eb640 1 -- 172.21.15.82:0/169078658 >> 172.21.15.82:0/169078658 conn(0x7f95680fb770 msgr2=0x7f95680fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.027+0000 7f956f0eb640 1 -- 172.21.15.82:0/169078658 shutdown_connections 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.027+0000 7f956f0eb640 1 -- 172.21.15.82:0/169078658 wait complete. 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956f0eb640 1 Processor -- start 2024-03-27T07:20:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956f0eb640 1 -- start start 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956f0eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568100200 0x7f9568104260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956f0eb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95681013f0 0x7f95681028a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956f0eb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9568101db0 0x7f9568102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956f0eb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f956810b660 con 0x7f9568100200 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956f0eb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f956810b4e0 con 0x7f95681013f0 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956f0eb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f956810b7e0 con 0x7f9568101db0 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956ce87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568100200 0x7f9568104260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956ce87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568100200 0x7f9568104260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39690/0 (socket says 172.21.15.82:39690) 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956ce87640 1 -- 172.21.15.82:0/2788165239 learned_addr learned my addr 172.21.15.82:0/2788165239 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956d688640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9568101db0 0x7f9568102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f9567fff640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95681013f0 0x7f95681028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956ce87640 1 -- 172.21.15.82:0/2788165239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9568101db0 msgr2=0x7f9568102de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956ce87640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9568101db0 0x7f9568102de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956ce87640 1 -- 172.21.15.82:0/2788165239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95681013f0 msgr2=0x7f95681028a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956ce87640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95681013f0 0x7f95681028a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956ce87640 1 -- 172.21.15.82:0/2788165239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9568103670 con 0x7f9568100200 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f9567fff640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95681013f0 0x7f95681028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f956ce87640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568100200 0x7f9568104260 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f955c00e9c0 tx=0x7f955c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.028+0000 7f9565ffb640 1 -- 172.21.15.82:0/2788165239 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c00cd80 con 0x7f9568100200 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.029+0000 7f9565ffb640 1 -- 172.21.15.82:0/2788165239 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f955c0035f0 con 0x7f9568100200 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.029+0000 7f956f0eb640 1 -- 172.21.15.82:0/2788165239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95681a1fc0 con 0x7f9568100200 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.029+0000 7f9565ffb640 1 -- 172.21.15.82:0/2788165239 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955c010690 con 0x7f9568100200 2024-03-27T07:20:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.029+0000 7f956f0eb640 1 -- 172.21.15.82:0/2788165239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95681a23c0 con 0x7f9568100200 2024-03-27T07:20:55.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.030+0000 7f956f0eb640 1 -- 172.21.15.82:0/2788165239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95681a26b0 con 0x7f9568100200 2024-03-27T07:20:55.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.031+0000 7f9565ffb640 1 -- 172.21.15.82:0/2788165239 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f955c0037a0 con 0x7f9568100200 2024-03-27T07:20:55.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.031+0000 7f9565ffb640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f95580a3690 0x7f95580a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.031+0000 7f9567fff640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f95580a3690 0x7f95580a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.031+0000 7f9565ffb640 1 -- 172.21.15.82:0/2788165239 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f955c0cfbf0 con 0x7f9568100200 2024-03-27T07:20:55.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.032+0000 7f9567fff640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f95580a3690 0x7f95580a5b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f955402d580 tx=0x7f9554005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:55.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.036+0000 7f9565ffb640 1 -- 172.21.15.82:0/2788165239 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f955c09cc60 con 0x7f9568100200 2024-03-27T07:20:55.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.221+0000 7f956f0eb640 1 -- 172.21.15.82:0/2788165239 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95681a2a40 con 0x7f9568100200 2024-03-27T07:20:55.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.222+0000 7f9565ffb640 1 -- 172.21.15.82:0/2788165239 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18409 (secure 0 0 0) 0x7f955c09c560 con 0x7f9568100200 2024-03-27T07:20:55.224 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:20:55.224 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:20:45.525020+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:20:55.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.224+0000 7f956f0eb640 1 -- 172.21.15.82:0/2788165239 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f95580a3690 msgr2=0x7f95580a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.224+0000 7f956f0eb640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f95580a3690 0x7f95580a5b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f955402d580 tx=0x7f9554005fd0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.224+0000 7f956f0eb640 1 -- 172.21.15.82:0/2788165239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568100200 msgr2=0x7f9568104260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.224+0000 7f956f0eb640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568100200 0x7f9568104260 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f955c00e9c0 tx=0x7f955c00ee80 comp rx=0 tx=0).stop 2024-03-27T07:20:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.224+0000 7f956f0eb640 1 -- 172.21.15.82:0/2788165239 shutdown_connections 2024-03-27T07:20:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.224+0000 7f956f0eb640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f95580a3690 0x7f95580a5b50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.224+0000 7f956f0eb640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9568101db0 0x7f9568102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.225+0000 7f956f0eb640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f95681013f0 0x7f95681028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.225+0000 7f956f0eb640 1 --2- 172.21.15.82:0/2788165239 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9568100200 0x7f9568104260 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.225+0000 7f956f0eb640 1 -- 172.21.15.82:0/2788165239 >> 172.21.15.82:0/2788165239 conn(0x7f95680fb770 msgr2=0x7f9568106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.225+0000 7f956f0eb640 1 -- 172.21.15.82:0/2788165239 shutdown_connections 2024-03-27T07:20:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.225+0000 7f956f0eb640 1 -- 172.21.15.82:0/2788165239 wait complete. 2024-03-27T07:20:55.237 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:20:55.237 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:20:55.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.380+0000 7f075e6fb640 1 -- 172.21.15.82:0/2199524526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0758101c60 msgr2=0x7f07581020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.380+0000 7f075e6fb640 1 --2- 172.21.15.82:0/2199524526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0758101c60 0x7f07581020e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f074c009900 tx=0x7f074c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:20:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.380+0000 7f075e6fb640 1 -- 172.21.15.82:0/2199524526 shutdown_connections 2024-03-27T07:20:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.380+0000 7f075e6fb640 1 --2- 172.21.15.82:0/2199524526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0758101c60 0x7f07581020e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.380+0000 7f075e6fb640 1 --2- 172.21.15.82:0/2199524526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758102620 0x7f0758108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.380+0000 7f075e6fb640 1 --2- 172.21.15.82:0/2199524526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0758100a70 0x7f0758100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.380+0000 7f075e6fb640 1 -- 172.21.15.82:0/2199524526 >> 172.21.15.82:0/2199524526 conn(0x7f07580fc000 msgr2=0x7f07580fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.380+0000 7f075e6fb640 1 -- 172.21.15.82:0/2199524526 shutdown_connections 2024-03-27T07:20:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.380+0000 7f075e6fb640 1 -- 172.21.15.82:0/2199524526 wait complete. 2024-03-27T07:20:55.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f075e6fb640 1 Processor -- start 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f075e6fb640 1 -- start start 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f075e6fb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0758100a70 0x7f0758197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f075e6fb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0758101c60 0x7f07581983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f075e6fb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758102620 0x7f075819f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f075e6fb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f075810d810 con 0x7f0758101c60 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f075e6fb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f075810d690 con 0x7f0758100a70 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f075e6fb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f075810d990 con 0x7f0758102620 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f07577fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0758101c60 0x7f07581983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f07577fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0758101c60 0x7f07581983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39706/0 (socket says 172.21.15.82:39706) 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f07577fe640 1 -- 172.21.15.82:0/1305584824 learned_addr learned my addr 172.21.15.82:0/1305584824 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f075cc98640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758102620 0x7f075819f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.381+0000 7f07577fe640 1 -- 172.21.15.82:0/1305584824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758102620 msgr2=0x7f075819f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f07577fe640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758102620 0x7f075819f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f07577fe640 1 -- 172.21.15.82:0/1305584824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0758100a70 msgr2=0x7f0758197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f0757fff640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0758100a70 0x7f0758197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f07577fe640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0758100a70 0x7f0758197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f07577fe640 1 -- 172.21.15.82:0/1305584824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075819fa90 con 0x7f0758101c60 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f07577fe640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0758101c60 0x7f07581983b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f074c02c8e0 tx=0x7f074c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f07557fa640 1 -- 172.21.15.82:0/1305584824 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c041070 con 0x7f0758101c60 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f075e6fb640 1 -- 172.21.15.82:0/1305584824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075819fd20 con 0x7f0758101c60 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f07557fa640 1 -- 172.21.15.82:0/1305584824 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f074c0054e0 con 0x7f0758101c60 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f07557fa640 1 -- 172.21.15.82:0/1305584824 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c0346a0 con 0x7f0758101c60 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.382+0000 7f075e6fb640 1 -- 172.21.15.82:0/1305584824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07581a01d0 con 0x7f0758101c60 2024-03-27T07:20:55.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.383+0000 7f075e6fb640 1 -- 172.21.15.82:0/1305584824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0758107d30 con 0x7f0758101c60 2024-03-27T07:20:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.384+0000 7f07557fa640 1 -- 172.21.15.82:0/1305584824 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f074c044070 con 0x7f0758101c60 2024-03-27T07:20:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.384+0000 7f07557fa640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f07400a3610 0x7f07400a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.385+0000 7f0757fff640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f07400a3610 0x7f07400a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.385+0000 7f07557fa640 1 -- 172.21.15.82:0/1305584824 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f074c0f1830 con 0x7f0758101c60 2024-03-27T07:20:55.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.385+0000 7f0757fff640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f07400a3610 0x7f07400a5ad0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0758101ac0 tx=0x7f0748005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:55.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.389+0000 7f07557fa640 1 -- 172.21.15.82:0/1305584824 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f074c0be8a0 con 0x7f0758101c60 2024-03-27T07:20:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.564+0000 7f075e6fb640 1 -- 172.21.15.82:0/1305584824 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f075802d590 con 0x7f0758101c60 2024-03-27T07:20:55.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.564+0000 7f07557fa640 1 -- 172.21.15.82:0/1305584824 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f074c0be1a0 con 0x7f0758101c60 2024-03-27T07:20:55.566 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:20:55.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 -- 172.21.15.82:0/1305584824 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f07400a3610 msgr2=0x7f07400a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f07400a3610 0x7f07400a5ad0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0758101ac0 tx=0x7f0748005c60 comp rx=0 tx=0).stop 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 -- 172.21.15.82:0/1305584824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0758101c60 msgr2=0x7f07581983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0758101c60 0x7f07581983b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f074c02c8e0 tx=0x7f074c004270 comp rx=0 tx=0).stop 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 -- 172.21.15.82:0/1305584824 shutdown_connections 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f07400a3610 0x7f07400a5ad0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0758101c60 0x7f07581983b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0758102620 0x7f075819f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 --2- 172.21.15.82:0/1305584824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0758100a70 0x7f0758197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 -- 172.21.15.82:0/1305584824 >> 172.21.15.82:0/1305584824 conn(0x7f07580fc000 msgr2=0x7f0758104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 -- 172.21.15.82:0/1305584824 shutdown_connections 2024-03-27T07:20:55.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.567+0000 7f075e6fb640 1 -- 172.21.15.82:0/1305584824 wait complete. 2024-03-27T07:20:55.580 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:20:55.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.679+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/2565603890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c0102610 msgr2=0x7fc4c0104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.679+0000 7fc4c5c4e640 1 --2- 172.21.15.82:0/2565603890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c0102610 0x7fc4c0104a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009900 tx=0x7fc4b002bc30 comp rx=0 tx=0).stop 2024-03-27T07:20:55.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.679+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/2565603890 shutdown_connections 2024-03-27T07:20:55.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.679+0000 7fc4c5c4e640 1 --2- 172.21.15.82:0/2565603890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c0107870 0x7fc4c0109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.679+0000 7fc4c5c4e640 1 --2- 172.21.15.82:0/2565603890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c0104f40 0x7fc4c0107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.679+0000 7fc4c5c4e640 1 --2- 172.21.15.82:0/2565603890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c0102610 0x7fc4c0104a00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.679+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/2565603890 >> 172.21.15.82:0/2565603890 conn(0x7fc4c00fc000 msgr2=0x7fc4c00fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.679+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/2565603890 shutdown_connections 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.679+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/2565603890 wait complete. 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.679+0000 7fc4c5c4e640 1 Processor -- start 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4c5c4e640 1 -- start start 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4c5c4e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c0102610 0x7fc4c0101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4c5c4e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c0104f40 0x7fc4c01005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4c5c4e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c0107870 0x7fc4c0100b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4c5c4e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c010d810 con 0x7fc4c0107870 2024-03-27T07:20:55.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4c5c4e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c010d690 con 0x7fc4c0104f40 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4c5c4e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c010d990 con 0x7fc4c0102610 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c0107870 0x7fc4c0100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bf7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c0102610 0x7fc4c0101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c0107870 0x7fc4c0100b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39716/0 (socket says 172.21.15.82:39716) 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bffff640 1 -- 172.21.15.82:0/1372335104 learned_addr learned my addr 172.21.15.82:0/1372335104 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4beffd640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c0104f40 0x7fc4c01005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bffff640 1 -- 172.21.15.82:0/1372335104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c0102610 msgr2=0x7fc4c0101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bffff640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c0102610 0x7fc4c0101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bffff640 1 -- 172.21.15.82:0/1372335104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c0104f40 msgr2=0x7fc4c01005c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bffff640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c0104f40 0x7fc4c01005c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bffff640 1 -- 172.21.15.82:0/1372335104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c0101390 con 0x7fc4c0107870 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bffff640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c0107870 0x7fc4c0100b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800eaa0 tx=0x7fc4b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bcff9640 1 -- 172.21.15.82:0/1372335104 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800cdb0 con 0x7fc4c0107870 2024-03-27T07:20:55.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/1372335104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c01a1fa0 con 0x7fc4c0107870 2024-03-27T07:20:55.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bcff9640 1 -- 172.21.15.82:0/1372335104 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4b8005020 con 0x7fc4c0107870 2024-03-27T07:20:55.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4bcff9640 1 -- 172.21.15.82:0/1372335104 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80116b0 con 0x7fc4c0107870 2024-03-27T07:20:55.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.680+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/1372335104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c01a2460 con 0x7fc4c0107870 2024-03-27T07:20:55.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.681+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/1372335104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c00fdaf0 con 0x7fc4c0107870 2024-03-27T07:20:55.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.683+0000 7fc4bcff9640 1 -- 172.21.15.82:0/1372335104 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fc4b8005560 con 0x7fc4c0107870 2024-03-27T07:20:55.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.683+0000 7fc4bcff9640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc4a80a3610 0x7fc4a80a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:55.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.683+0000 7fc4bf7fe640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc4a80a3610 0x7fc4a80a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:55.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.683+0000 7fc4bcff9640 1 -- 172.21.15.82:0/1372335104 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fc4b80cfe30 con 0x7fc4c0107870 2024-03-27T07:20:55.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.684+0000 7fc4bf7fe640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc4a80a3610 0x7fc4a80a5ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009230 tx=0x7fc4b0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:55.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.687+0000 7fc4bcff9640 1 -- 172.21.15.82:0/1372335104 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc4b8016030 con 0x7fc4c0107870 2024-03-27T07:20:55.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.902+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/1372335104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4c002d370 con 0x7fc4c0107870 2024-03-27T07:20:55.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.903+0000 7fc4bcff9640 1 -- 172.21.15.82:0/1372335104 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7fc4b809cea0 con 0x7fc4c0107870 2024-03-27T07:20:55.905 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:20:55.905 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-27T07:20:55.905 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 1 2024-03-27T07:20:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/1372335104 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc4a80a3610 msgr2=0x7fc4a80a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc4a80a3610 0x7fc4a80a5ad0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009230 tx=0x7fc4b0005fd0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/1372335104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c0107870 msgr2=0x7fc4c0100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c0107870 0x7fc4c0100b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800eaa0 tx=0x7fc4b800ef60 comp rx=0 tx=0).stop 2024-03-27T07:20:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/1372335104 shutdown_connections 2024-03-27T07:20:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc4a80a3610 0x7fc4a80a5ad0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc4c0107870 0x7fc4c0100b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc4c0104f40 0x7fc4c01005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 --2- 172.21.15.82:0/1372335104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c0102610 0x7fc4c0101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/1372335104 >> 172.21.15.82:0/1372335104 conn(0x7fc4c00fc000 msgr2=0x7fc4c0103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/1372335104 shutdown_connections 2024-03-27T07:20:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:55.905+0000 7fc4c5c4e640 1 -- 172.21.15.82:0/1372335104 wait complete. 2024-03-27T07:20:55.917 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:55 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2788165239' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:20:55.917 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:55 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1305584824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:20:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:55 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2788165239' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:20:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:55 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1305584824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:20:56.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:55 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2788165239' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:20:56.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:55 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1305584824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:20:56.504 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:20:56 smithi153 systemd[1]: Starting Ceph mds.l for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:20:56.759 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:20:56 smithi153 podman[66532]: 2024-03-27 07:20:56.405315882 +0000 UTC m=+0.017550438 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:20:56.759 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:20:56 smithi153 podman[66532]: 2024-03-27 07:20:56.513346411 +0000 UTC m=+0.125580961 container create a2996c7af0b615507e9bc7edcedc70773233aa7d152db8866391b45be5c6c3f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-l, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240326) 2024-03-27T07:20:56.759 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:20:56 smithi153 podman[66532]: 2024-03-27 07:20:56.75820283 +0000 UTC m=+0.370437384 container init a2996c7af0b615507e9bc7edcedc70773233aa7d152db8866391b45be5c6c3f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-l, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-27T07:20:57.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:56 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1372335104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:20:57.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:56 smithi153 ceph-mon[36179]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:57.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:56 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6832/193154371,v1:172.21.15.153:6833/193154371] up:boot 2024-03-27T07:20:57.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:56 smithi153 ceph-mon[36179]: fsmap 1 up:standby 2024-03-27T07:20:57.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:56 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-27T07:20:57.039 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:20:56 smithi153 podman[66532]: 2024-03-27 07:20:56.760865053 +0000 UTC m=+0.373099612 container start a2996c7af0b615507e9bc7edcedc70773233aa7d152db8866391b45be5c6c3f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-l, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-03-27T07:20:57.039 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:20:56 smithi153 ceph-mds[66551]: -- 172.21.15.153:0/3198693444 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c5cf083a40 con 0x55c5cf057000 2024-03-27T07:20:57.039 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:20:56 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-l[66547]: starting mds.l at 2024-03-27T07:20:57.040 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:20:56 smithi153 bash[66532]: a2996c7af0b615507e9bc7edcedc70773233aa7d152db8866391b45be5c6c3f7 2024-03-27T07:20:57.040 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:20:56 smithi153 systemd[1]: Started Ceph mds.l for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:20:57.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:56 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1372335104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:20:57.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:56 smithi082 ceph-mon[32178]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:57.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:56 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6832/193154371,v1:172.21.15.153:6833/193154371] up:boot 2024-03-27T07:20:57.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:56 smithi082 ceph-mon[32178]: fsmap 1 up:standby 2024-03-27T07:20:57.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:56 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-27T07:20:57.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:56 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1372335104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:20:57.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:56 smithi149 ceph-mon[36065]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:57.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:56 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6832/193154371,v1:172.21.15.153:6833/193154371] up:boot 2024-03-27T07:20:57.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:56 smithi149 ceph-mon[36065]: fsmap 1 up:standby 2024-03-27T07:20:57.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:56 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-27T07:20:57.919 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:20:58.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.030+0000 7f94fd0eb640 1 -- 172.21.15.82:0/1478393212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f8103730 msgr2=0x7f94f8109fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.030+0000 7f94fd0eb640 1 --2- 172.21.15.82:0/1478393212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f8103730 0x7f94f8109fc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009ca0 tx=0x7f94f002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:20:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.030+0000 7f94fd0eb640 1 -- 172.21.15.82:0/1478393212 shutdown_connections 2024-03-27T07:20:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.030+0000 7f94fd0eb640 1 --2- 172.21.15.82:0/1478393212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f8103730 0x7f94f8109fc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.031+0000 7f94fd0eb640 1 --2- 172.21.15.82:0/1478393212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8102d70 0x7f94f81031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.031+0000 7f94fd0eb640 1 --2- 172.21.15.82:0/1478393212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f8101b80 0x7f94f8101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.031+0000 7f94fd0eb640 1 -- 172.21.15.82:0/1478393212 >> 172.21.15.82:0/1478393212 conn(0x7f94f80fd130 msgr2=0x7f94f80ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.031+0000 7f94fd0eb640 1 -- 172.21.15.82:0/1478393212 shutdown_connections 2024-03-27T07:20:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.031+0000 7f94fd0eb640 1 -- 172.21.15.82:0/1478393212 wait complete. 2024-03-27T07:20:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.031+0000 7f94fd0eb640 1 Processor -- start 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.031+0000 7f94fd0eb640 1 -- start start 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94fd0eb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f8101b80 0x7f94f8197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94fd0eb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f8102d70 0x7f94f81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94fd0eb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8103730 0x7f94f819f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94fd0eb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94f810d800 con 0x7f94f8101b80 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94fd0eb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f94f810d680 con 0x7f94f8102d70 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94fd0eb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f94f810d980 con 0x7f94f8103730 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f8101b80 0x7f94f8197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f8101b80 0x7f94f8197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52104/0 (socket says 172.21.15.82:52104) 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f6d9d640 1 -- 172.21.15.82:0/3711188568 learned_addr learned my addr 172.21.15.82:0/3711188568 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:20:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f759e640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8103730 0x7f94f819f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f659c640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f8102d70 0x7f94f81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f6d9d640 1 -- 172.21.15.82:0/3711188568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8103730 msgr2=0x7f94f819f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f6d9d640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8103730 0x7f94f819f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f6d9d640 1 -- 172.21.15.82:0/3711188568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f8102d70 msgr2=0x7f94f81983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f6d9d640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f8102d70 0x7f94f81983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f6d9d640 1 -- 172.21.15.82:0/3711188568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f819fa80 con 0x7f94f8101b80 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f659c640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f8102d70 0x7f94f81983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94f6d9d640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f8101b80 0x7f94f8197e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00d770 tx=0x7f94ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94dffff640 1 -- 172.21.15.82:0/3711188568 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec017070 con 0x7f94f8101b80 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94dffff640 1 -- 172.21.15.82:0/3711188568 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94ec009c30 con 0x7f94f8101b80 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94fd0eb640 1 -- 172.21.15.82:0/3711188568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f819fd70 con 0x7f94f8101b80 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94dffff640 1 -- 172.21.15.82:0/3711188568 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec003dd0 con 0x7f94f8101b80 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.032+0000 7f94fd0eb640 1 -- 172.21.15.82:0/3711188568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f81a0200 con 0x7f94f8101b80 2024-03-27T07:20:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.033+0000 7f94fd0eb640 1 -- 172.21.15.82:0/3711188568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f8108e40 con 0x7f94f8101b80 2024-03-27T07:20:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.034+0000 7f94dffff640 1 -- 172.21.15.82:0/3711188568 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f94ec003fb0 con 0x7f94f8101b80 2024-03-27T07:20:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.035+0000 7f94dffff640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94e00a3610 0x7f94e00a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:20:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.035+0000 7f94f659c640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94e00a3610 0x7f94e00a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:20:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.035+0000 7f94dffff640 1 -- 172.21.15.82:0/3711188568 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f94ec0cf1e0 con 0x7f94f8101b80 2024-03-27T07:20:58.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.036+0000 7f94f659c640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94e00a3610 0x7f94e00a5ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f94f8199370 tx=0x7f94e8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:20:58.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.040+0000 7f94dffff640 1 -- 172.21.15.82:0/3711188568 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f94ec09c250 con 0x7f94f8101b80 2024-03-27T07:20:58.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:58.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:58.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:58.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:20:58.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:20:58.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:57 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:58.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:57 smithi082 ceph-mon[32178]: Deploying daemon mds.k on smithi149 2024-03-27T07:20:58.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:58.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:58.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:58.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:20:58.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:20:58.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:57 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:58.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:57 smithi149 ceph-mon[36065]: Deploying daemon mds.k on smithi149 2024-03-27T07:20:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.254+0000 7f94fd0eb640 1 -- 172.21.15.82:0/3711188568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94f802d370 con 0x7f94f8101b80 2024-03-27T07:20:58.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.255+0000 7f94dffff640 1 -- 172.21.15.82:0/3711188568 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1393 (secure 0 0 0) 0x7f94f802d370 con 0x7f94f8101b80 2024-03-27T07:20:58.256 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:20:58.257 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-27T07:20:58.257 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2024-03-27T07:20:58.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 -- 172.21.15.82:0/3711188568 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94e00a3610 msgr2=0x7f94e00a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94e00a3610 0x7f94e00a5ad0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f94f8199370 tx=0x7f94e8005f90 comp rx=0 tx=0).stop 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 -- 172.21.15.82:0/3711188568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f8101b80 msgr2=0x7f94f8197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f8101b80 0x7f94f8197e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94ec00d770 tx=0x7f94ec00dc30 comp rx=0 tx=0).stop 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 -- 172.21.15.82:0/3711188568 shutdown_connections 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94e00a3610 0x7f94e00a5ad0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f8103730 0x7f94f819f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f94f8102d70 0x7f94f81983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 --2- 172.21.15.82:0/3711188568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f94f8101b80 0x7f94f8197e60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 -- 172.21.15.82:0/3711188568 >> 172.21.15.82:0/3711188568 conn(0x7f94f80fd130 msgr2=0x7f94f8106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 -- 172.21.15.82:0/3711188568 shutdown_connections 2024-03-27T07:20:58.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:20:58.257+0000 7f94fd0eb640 1 -- 172.21.15.82:0/3711188568 wait complete. 2024-03-27T07:20:58.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:58.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:58.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:20:58.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:20:58.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:20:58.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:57 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:20:58.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:57 smithi153 ceph-mon[36179]: Deploying daemon mds.k on smithi149 2024-03-27T07:20:59.175 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:58 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3711188568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:20:59.175 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:20:58 smithi149 ceph-mon[36065]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:59.176 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:20:59 smithi149 systemd[1]: Starting Ceph mds.k for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:20:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:58 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3711188568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:20:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:20:58 smithi082 ceph-mon[32178]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:59.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:58 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3711188568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:20:59.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:20:58 smithi153 ceph-mon[36179]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:20:59.505 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:20:59 smithi149 podman[66041]: 2024-03-27 07:20:59.294850699 +0000 UTC m=+0.017712516 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:20:59.505 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:20:59 smithi149 podman[66041]: 2024-03-27 07:20:59.416692537 +0000 UTC m=+0.139554351 container create 65861988f4cb10cf9bb5be99d35d98d3a286452844f17aeb9377a73fe163a1b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-k, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:21:00.005 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:20:59 smithi149 podman[66041]: 2024-03-27 07:20:59.652549168 +0000 UTC m=+0.375410989 container init 65861988f4cb10cf9bb5be99d35d98d3a286452844f17aeb9377a73fe163a1b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-k, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:21:00.005 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:20:59 smithi149 podman[66041]: 2024-03-27 07:20:59.655288528 +0000 UTC m=+0.378150348 container start 65861988f4cb10cf9bb5be99d35d98d3a286452844f17aeb9377a73fe163a1b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-k, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True) 2024-03-27T07:21:00.005 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:20:59 smithi149 ceph-mds[66060]: -- 172.21.15.149:0/125707198 <== mon.2 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555d27067a40 con 0x555d2703a800 2024-03-27T07:21:00.005 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:20:59 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-k[66056]: starting mds.k at 2024-03-27T07:21:00.005 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:20:59 smithi149 bash[66041]: 65861988f4cb10cf9bb5be99d35d98d3a286452844f17aeb9377a73fe163a1b1 2024-03-27T07:21:00.005 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:20:59 smithi149 systemd[1]: Started Ceph mds.k for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:00.270 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:00.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.381+0000 7f7e58b7a640 1 -- 172.21.15.82:0/688226391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e54107930 msgr2=0x7f7e54109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.381+0000 7f7e58b7a640 1 --2- 172.21.15.82:0/688226391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e54107930 0x7f7e54109d20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009ca0 tx=0x7f7e4c02c0f0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.381+0000 7f7e58b7a640 1 -- 172.21.15.82:0/688226391 shutdown_connections 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.381+0000 7f7e58b7a640 1 --2- 172.21.15.82:0/688226391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e54107930 0x7f7e54109d20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.381+0000 7f7e58b7a640 1 --2- 172.21.15.82:0/688226391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e54105000 0x7f7e541073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.381+0000 7f7e58b7a640 1 --2- 172.21.15.82:0/688226391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e541026d0 0x7f7e54104ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.381+0000 7f7e58b7a640 1 -- 172.21.15.82:0/688226391 >> 172.21.15.82:0/688226391 conn(0x7f7e540fc000 msgr2=0x7f7e540fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.381+0000 7f7e58b7a640 1 -- 172.21.15.82:0/688226391 shutdown_connections 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.381+0000 7f7e58b7a640 1 -- 172.21.15.82:0/688226391 wait complete. 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.381+0000 7f7e58b7a640 1 Processor -- start 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e58b7a640 1 -- start start 2024-03-27T07:21:00.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e58b7a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e541026d0 0x7f7e54102040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e58b7a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e54105000 0x7f7e54100680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e58b7a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e54107930 0x7f7e54100bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e58b7a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5410d890 con 0x7f7e54107930 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e58b7a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5410d710 con 0x7f7e541026d0 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e58b7a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5410da10 con 0x7f7e54105000 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e52d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e54107930 0x7f7e54100bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e52d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e54107930 0x7f7e54100bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52128/0 (socket says 172.21.15.82:52128) 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e52d9d640 1 -- 172.21.15.82:0/245311393 learned_addr learned my addr 172.21.15.82:0/245311393 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e49d9b640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e54105000 0x7f7e54100680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e5259c640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e541026d0 0x7f7e54102040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e52d9d640 1 -- 172.21.15.82:0/245311393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e54105000 msgr2=0x7f7e54100680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e52d9d640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e54105000 0x7f7e54100680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e52d9d640 1 -- 172.21.15.82:0/245311393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e541026d0 msgr2=0x7f7e54102040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:00.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e52d9d640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e541026d0 0x7f7e54102040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e52d9d640 1 -- 172.21.15.82:0/245311393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e54101450 con 0x7f7e54107930 2024-03-27T07:21:00.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e5259c640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e541026d0 0x7f7e54102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:00.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e52d9d640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e54107930 0x7f7e54100bc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c037040 tx=0x7f7e4c032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:00.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e4bfff640 1 -- 172.21.15.82:0/245311393 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c039040 con 0x7f7e54107930 2024-03-27T07:21:00.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.382+0000 7f7e4bfff640 1 -- 172.21.15.82:0/245311393 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e4c044070 con 0x7f7e54107930 2024-03-27T07:21:00.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.383+0000 7f7e58b7a640 1 -- 172.21.15.82:0/245311393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e541a1f10 con 0x7f7e54107930 2024-03-27T07:21:00.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.383+0000 7f7e4bfff640 1 -- 172.21.15.82:0/245311393 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c004260 con 0x7f7e54107930 2024-03-27T07:21:00.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.383+0000 7f7e58b7a640 1 -- 172.21.15.82:0/245311393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e541a2370 con 0x7f7e54107930 2024-03-27T07:21:00.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.384+0000 7f7e58b7a640 1 -- 172.21.15.82:0/245311393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e540fdaf0 con 0x7f7e54107930 2024-03-27T07:21:00.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.384+0000 7f7e4bfff640 1 -- 172.21.15.82:0/245311393 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f7e4c003970 con 0x7f7e54107930 2024-03-27T07:21:00.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.385+0000 7f7e4bfff640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e400a3610 0x7f7e400a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:00.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.385+0000 7f7e5259c640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e400a3610 0x7f7e400a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:00.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.385+0000 7f7e4bfff640 1 -- 172.21.15.82:0/245311393 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f7e4c0f1f70 con 0x7f7e54107930 2024-03-27T07:21:00.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.386+0000 7f7e5259c640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e400a3610 0x7f7e400a5ad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400abe0 tx=0x7f7e4400a5c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:00.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.390+0000 7f7e4bfff640 1 -- 172.21.15.82:0/245311393 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7e4c0befe0 con 0x7f7e54107930 2024-03-27T07:21:00.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.612+0000 7f7e58b7a640 1 -- 172.21.15.82:0/245311393 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e5402d570 con 0x7f7e54107930 2024-03-27T07:21:00.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.612+0000 7f7e4bfff640 1 -- 172.21.15.82:0/245311393 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2215 (secure 0 0 0) 0x7f7e4c0be8e0 con 0x7f7e54107930 2024-03-27T07:21:00.614 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:00.614 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-27T07:21:00.615 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2024-03-27T07:21:00.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.614+0000 7f7e58b7a640 1 -- 172.21.15.82:0/245311393 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e400a3610 msgr2=0x7f7e400a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:00.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.614+0000 7f7e58b7a640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e400a3610 0x7f7e400a5ad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400abe0 tx=0x7f7e4400a5c0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.614+0000 7f7e58b7a640 1 -- 172.21.15.82:0/245311393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e54107930 msgr2=0x7f7e54100bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:00.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.614+0000 7f7e58b7a640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e54107930 0x7f7e54100bc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c037040 tx=0x7f7e4c032f90 comp rx=0 tx=0).stop 2024-03-27T07:21:00.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.614+0000 7f7e58b7a640 1 -- 172.21.15.82:0/245311393 shutdown_connections 2024-03-27T07:21:00.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.614+0000 7f7e58b7a640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e400a3610 0x7f7e400a5ad0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.614+0000 7f7e58b7a640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e54107930 0x7f7e54100bc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.614+0000 7f7e58b7a640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e54105000 0x7f7e54100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.614+0000 7f7e58b7a640 1 --2- 172.21.15.82:0/245311393 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e541026d0 0x7f7e54102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:00.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.614+0000 7f7e58b7a640 1 -- 172.21.15.82:0/245311393 >> 172.21.15.82:0/245311393 conn(0x7f7e540fc000 msgr2=0x7f7e54103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:00.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.615+0000 7f7e58b7a640 1 -- 172.21.15.82:0/245311393 shutdown_connections 2024-03-27T07:21:00.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:00.615+0000 7f7e58b7a640 1 -- 172.21.15.82:0/245311393 wait complete. 2024-03-27T07:21:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:00.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: Deploying daemon mds.j on smithi082 2024-03-27T07:21:00.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.149:6832/51873872,v1:172.21.15.149:6833/51873872] up:boot 2024-03-27T07:21:00.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: fsmap 2 up:standby 2024-03-27T07:21:00.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-27T07:21:00.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:00.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:00 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/245311393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:01.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:01.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:01.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:01.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:01.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:01.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:01.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: Deploying daemon mds.j on smithi082 2024-03-27T07:21:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.149:6832/51873872,v1:172.21.15.149:6833/51873872] up:boot 2024-03-27T07:21:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: fsmap 2 up:standby 2024-03-27T07:21:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-27T07:21:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:00 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/245311393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:01.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:01.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:01.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:01.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:01.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:01.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:01.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: Deploying daemon mds.j on smithi082 2024-03-27T07:21:01.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.149:6832/51873872,v1:172.21.15.149:6833/51873872] up:boot 2024-03-27T07:21:01.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: fsmap 2 up:standby 2024-03-27T07:21:01.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-27T07:21:01.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:01.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:00 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/245311393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:02.188 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:21:01 smithi082 systemd[1]: Starting Ceph mds.j for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:21:02.460 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:21:02 smithi082 podman[72619]: 2024-03-27 07:21:02.100677621 +0000 UTC m=+0.017979571 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:21:02.460 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:21:02 smithi082 podman[72619]: 2024-03-27 07:21:02.231408357 +0000 UTC m=+0.148710292 container create eff950a026493b49f4937b7301dcfbb88a76a6fd05ed3ab0e8a2da53c74963b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-j, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326) 2024-03-27T07:21:02.460 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:21:02 smithi082 podman[72619]: 2024-03-27 07:21:02.459296233 +0000 UTC m=+0.376598168 container init eff950a026493b49f4937b7301dcfbb88a76a6fd05ed3ab0e8a2da53c74963b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:21:02.628 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.736+0000 7f9288916640 1 -- 172.21.15.82:0/3195755751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9284101c60 msgr2=0x7f92841020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.736+0000 7f9288916640 1 --2- 172.21.15.82:0/3195755751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9284101c60 0x7f92841020e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9278009ca0 tx=0x7f927802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:21:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.736+0000 7f9288916640 1 -- 172.21.15.82:0/3195755751 shutdown_connections 2024-03-27T07:21:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.736+0000 7f9288916640 1 --2- 172.21.15.82:0/3195755751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9284101c60 0x7f92841020e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.736+0000 7f9288916640 1 --2- 172.21.15.82:0/3195755751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9284102620 0x7f9284108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.736+0000 7f9288916640 1 --2- 172.21.15.82:0/3195755751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9284100a70 0x7f9284100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.736+0000 7f9288916640 1 -- 172.21.15.82:0/3195755751 >> 172.21.15.82:0/3195755751 conn(0x7f92840fbfe0 msgr2=0x7f92840fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:02.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.736+0000 7f9288916640 1 -- 172.21.15.82:0/3195755751 shutdown_connections 2024-03-27T07:21:02.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.736+0000 7f9288916640 1 -- 172.21.15.82:0/3195755751 wait complete. 2024-03-27T07:21:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.736+0000 7f9288916640 1 Processor -- start 2024-03-27T07:21:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9288916640 1 -- start start 2024-03-27T07:21:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9288916640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9284100a70 0x7f9284069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9288916640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9284101c60 0x7f928419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9288916640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9284102620 0x7f928419f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:02.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9288916640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f928410c6f0 con 0x7f9284102620 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9288916640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f928410c570 con 0x7f9284100a70 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9288916640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f928410c870 con 0x7f9284101c60 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9282d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9284102620 0x7f928419f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9282d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9284102620 0x7f928419f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52176/0 (socket says 172.21.15.82:52176) 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9282d9d640 1 -- 172.21.15.82:0/3439727918 learned_addr learned my addr 172.21.15.82:0/3439727918 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9281d9b640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9284101c60 0x7f928419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f928259c640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9284100a70 0x7f9284069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9282d9d640 1 -- 172.21.15.82:0/3439727918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9284101c60 msgr2=0x7f928419cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9282d9d640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9284101c60 0x7f928419cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9282d9d640 1 -- 172.21.15.82:0/3439727918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9284100a70 msgr2=0x7f9284069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9282d9d640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9284100a70 0x7f9284069820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:02.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9282d9d640 1 -- 172.21.15.82:0/3439727918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928419faf0 con 0x7f9284102620 2024-03-27T07:21:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9282d9d640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9284102620 0x7f928419f1e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f927400d750 tx=0x7f927400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f92737fe640 1 -- 172.21.15.82:0/3439727918 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274017070 con 0x7f9284102620 2024-03-27T07:21:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f92737fe640 1 -- 172.21.15.82:0/3439727918 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9274005500 con 0x7f9284102620 2024-03-27T07:21:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.737+0000 7f9288916640 1 -- 172.21.15.82:0/3439727918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f928419fd80 con 0x7f9284102620 2024-03-27T07:21:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.738+0000 7f92737fe640 1 -- 172.21.15.82:0/3439727918 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274004d90 con 0x7f9284102620 2024-03-27T07:21:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.738+0000 7f9288916640 1 -- 172.21.15.82:0/3439727918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92841a01f0 con 0x7f9284102620 2024-03-27T07:21:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.739+0000 7f9288916640 1 -- 172.21.15.82:0/3439727918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9284107e10 con 0x7f9284102620 2024-03-27T07:21:02.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.740+0000 7f92737fe640 1 -- 172.21.15.82:0/3439727918 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f9274004f30 con 0x7f9284102620 2024-03-27T07:21:02.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.740+0000 7f92737fe640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f926c0a3610 0x7f926c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:02.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.741+0000 7f928259c640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f926c0a3610 0x7f926c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:02.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.741+0000 7f92737fe640 1 -- 172.21.15.82:0/3439727918 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f92740cf260 con 0x7f9284102620 2024-03-27T07:21:02.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.741+0000 7f928259c640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f926c0a3610 0x7f926c0a5ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f927c005fd0 tx=0x7f927c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:02.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.745+0000 7f92737fe640 1 -- 172.21.15.82:0/3439727918 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f927409c2d0 con 0x7f9284102620 2024-03-27T07:21:02.937 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:21:02 smithi082 podman[72619]: 2024-03-27 07:21:02.462119556 +0000 UTC m=+0.379421495 container start eff950a026493b49f4937b7301dcfbb88a76a6fd05ed3ab0e8a2da53c74963b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-j, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-03-27T07:21:02.938 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:21:02 smithi082 ceph-mds[72638]: -- 172.21.15.82:0/3846083078 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cdb4635a40 con 0x55cdb4608800 2024-03-27T07:21:02.938 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:21:02 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-j[72634]: starting mds.j at 2024-03-27T07:21:02.938 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:21:02 smithi082 bash[72619]: eff950a026493b49f4937b7301dcfbb88a76a6fd05ed3ab0e8a2da53c74963b9 2024-03-27T07:21:02.938 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:21:02 smithi082 systemd[1]: Started Ceph mds.j for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:02.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.976+0000 7f9288916640 1 -- 172.21.15.82:0/3439727918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f928402d5b0 con 0x7f9284102620 2024-03-27T07:21:02.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.976+0000 7f92737fe640 1 -- 172.21.15.82:0/3439727918 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3037 (secure 0 0 0) 0x7f927409bbd0 con 0x7f9284102620 2024-03-27T07:21:02.978 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:02.978 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-27T07:21:02.978 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 4 2024-03-27T07:21:02.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 -- 172.21.15.82:0/3439727918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f926c0a3610 msgr2=0x7f926c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f926c0a3610 0x7f926c0a5ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f927c005fd0 tx=0x7f927c005850 comp rx=0 tx=0).stop 2024-03-27T07:21:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 -- 172.21.15.82:0/3439727918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9284102620 msgr2=0x7f928419f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9284102620 0x7f928419f1e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f927400d750 tx=0x7f927400dc10 comp rx=0 tx=0).stop 2024-03-27T07:21:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 -- 172.21.15.82:0/3439727918 shutdown_connections 2024-03-27T07:21:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f926c0a3610 0x7f926c0a5ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9284102620 0x7f928419f1e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9284101c60 0x7f928419cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 --2- 172.21.15.82:0/3439727918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9284100a70 0x7f9284069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 -- 172.21.15.82:0/3439727918 >> 172.21.15.82:0/3439727918 conn(0x7f92840fbfe0 msgr2=0x7f9284104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:02.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 -- 172.21.15.82:0/3439727918 shutdown_connections 2024-03-27T07:21:02.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:02.979+0000 7f9288916640 1 -- 172.21.15.82:0/3439727918 wait complete. 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.82:6834/159427358,v1:172.21.15.82:6835/159427358] up:boot 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: fsmap 3 up:standby 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:03.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:03 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3439727918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:04.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:04.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.82:6834/159427358,v1:172.21.15.82:6835/159427358] up:boot 2024-03-27T07:21:04.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: fsmap 3 up:standby 2024-03-27T07:21:04.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-27T07:21:04.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:04.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:04.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:04.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:04.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:04.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:04.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:03 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3439727918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:04.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:04.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.82:6834/159427358,v1:172.21.15.82:6835/159427358] up:boot 2024-03-27T07:21:04.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: fsmap 3 up:standby 2024-03-27T07:21:04.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-27T07:21:04.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:04.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:04.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:04.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:04.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:04.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:04.040 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:03 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3439727918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:04.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:04 smithi082 ceph-mon[32178]: Deploying daemon mds.d on smithi082 2024-03-27T07:21:04.993 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:05.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:04 smithi149 ceph-mon[36065]: Deploying daemon mds.d on smithi082 2024-03-27T07:21:05.020 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:21:04 smithi082 systemd[1]: Starting Ceph mds.d for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:21:05.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:04 smithi153 ceph-mon[36179]: Deploying daemon mds.d on smithi082 2024-03-27T07:21:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.099+0000 7fd45cb93640 1 -- 172.21.15.82:0/370726831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd458107850 msgr2=0x7fd458109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.099+0000 7fd45cb93640 1 --2- 172.21.15.82:0/370726831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd458107850 0x7fd458109ca0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd448009900 tx=0x7fd44802bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.099+0000 7fd45cb93640 1 -- 172.21.15.82:0/370726831 shutdown_connections 2024-03-27T07:21:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.099+0000 7fd45cb93640 1 --2- 172.21.15.82:0/370726831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd458107850 0x7fd458109ca0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.099+0000 7fd45cb93640 1 --2- 172.21.15.82:0/370726831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd458104f20 0x7fd458107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.099+0000 7fd45cb93640 1 --2- 172.21.15.82:0/370726831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4581025f0 0x7fd4581049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.099+0000 7fd45cb93640 1 -- 172.21.15.82:0/370726831 >> 172.21.15.82:0/370726831 conn(0x7fd4580fbfe0 msgr2=0x7fd4580fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.099+0000 7fd45cb93640 1 -- 172.21.15.82:0/370726831 shutdown_connections 2024-03-27T07:21:05.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.099+0000 7fd45cb93640 1 -- 172.21.15.82:0/370726831 wait complete. 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.099+0000 7fd45cb93640 1 Processor -- start 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45cb93640 1 -- start start 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45cb93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581025f0 0x7fd458197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45cb93640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd458104f20 0x7fd458198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45cb93640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd458107850 0x7fd45819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45cb93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd45810d880 con 0x7fd4581025f0 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45cb93640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd45810d700 con 0x7fd458107850 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45cb93640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd45810da00 con 0x7fd458104f20 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581025f0 0x7fd458197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581025f0 0x7fd458197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52194/0 (socket says 172.21.15.82:52194) 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45659c640 1 -- 172.21.15.82:0/156525775 learned_addr learned my addr 172.21.15.82:0/156525775 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd455d9b640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd458104f20 0x7fd458198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd456d9d640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd458107850 0x7fd45819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:05.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45659c640 1 -- 172.21.15.82:0/156525775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd458104f20 msgr2=0x7fd458198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45659c640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd458104f20 0x7fd458198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45659c640 1 -- 172.21.15.82:0/156525775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd458107850 msgr2=0x7fd45819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45659c640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd458107850 0x7fd45819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45659c640 1 -- 172.21.15.82:0/156525775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45819faf0 con 0x7fd4581025f0 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd456d9d640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd458107850 0x7fd45819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45659c640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581025f0 0x7fd458197ed0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd45000d770 tx=0x7fd45000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd4477fe640 1 -- 172.21.15.82:0/156525775 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450017070 con 0x7fd4581025f0 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd4477fe640 1 -- 172.21.15.82:0/156525775 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd450005500 con 0x7fd4581025f0 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45cb93640 1 -- 172.21.15.82:0/156525775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45819fde0 con 0x7fd4581025f0 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd4477fe640 1 -- 172.21.15.82:0/156525775 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd450004e00 con 0x7fd4581025f0 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.100+0000 7fd45cb93640 1 -- 172.21.15.82:0/156525775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4581a01f0 con 0x7fd4581025f0 2024-03-27T07:21:05.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.101+0000 7fd45cb93640 1 -- 172.21.15.82:0/156525775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4580fdad0 con 0x7fd4581025f0 2024-03-27T07:21:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.102+0000 7fd4477fe640 1 -- 172.21.15.82:0/156525775 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fd450004fa0 con 0x7fd4581025f0 2024-03-27T07:21:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.103+0000 7fd4477fe640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4400a3610 0x7fd4400a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.103+0000 7fd455d9b640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4400a3610 0x7fd4400a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:05.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.103+0000 7fd4477fe640 1 -- 172.21.15.82:0/156525775 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fd4500cf370 con 0x7fd4581025f0 2024-03-27T07:21:05.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.104+0000 7fd455d9b640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4400a3610 0x7fd4400a5ad0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd4581993e0 tx=0x7fd44c0094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:05.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.109+0000 7fd4477fe640 1 -- 172.21.15.82:0/156525775 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd45009c3e0 con 0x7fd4581025f0 2024-03-27T07:21:05.343 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:21:05 smithi082 podman[72970]: 2024-03-27 07:21:04.995024935 +0000 UTC m=+0.017853031 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:21:05.343 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:21:05 smithi082 podman[72970]: 2024-03-27 07:21:05.10581781 +0000 UTC m=+0.128645882 container create e702cb3f7c87b2e026c55d12a0b5a38f527fcea461ff5949f9cbba356d5a86f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-d, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T07:21:05.343 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:21:05 smithi082 podman[72970]: 2024-03-27 07:21:05.342110525 +0000 UTC m=+0.364938590 container init e702cb3f7c87b2e026c55d12a0b5a38f527fcea461ff5949f9cbba356d5a86f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-d, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:21:05.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.346+0000 7fd45cb93640 1 -- 172.21.15.82:0/156525775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd45802d5e0 con 0x7fd4581025f0 2024-03-27T07:21:05.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.347+0000 7fd4477fe640 1 -- 172.21.15.82:0/156525775 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3037 (secure 0 0 0) 0x7fd45009bce0 con 0x7fd4581025f0 2024-03-27T07:21:05.348 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:05.349 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-27T07:21:05.349 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 4 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 -- 172.21.15.82:0/156525775 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4400a3610 msgr2=0x7fd4400a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4400a3610 0x7fd4400a5ad0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd4581993e0 tx=0x7fd44c0094f0 comp rx=0 tx=0).stop 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 -- 172.21.15.82:0/156525775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581025f0 msgr2=0x7fd458197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581025f0 0x7fd458197ed0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd45000d770 tx=0x7fd45000dc30 comp rx=0 tx=0).stop 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 -- 172.21.15.82:0/156525775 shutdown_connections 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4400a3610 0x7fd4400a5ad0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd458107850 0x7fd45819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd458104f20 0x7fd458198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 --2- 172.21.15.82:0/156525775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4581025f0 0x7fd458197ed0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 -- 172.21.15.82:0/156525775 >> 172.21.15.82:0/156525775 conn(0x7fd4580fbfe0 msgr2=0x7fd458102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 -- 172.21.15.82:0/156525775 shutdown_connections 2024-03-27T07:21:05.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:05.350+0000 7fd45cb93640 1 -- 172.21.15.82:0/156525775 wait complete. 2024-03-27T07:21:05.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:05 smithi082 ceph-mon[32178]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:05.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:05 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/156525775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:05.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:05.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:05.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:05.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:05.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:05.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:05 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:05.689 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:21:05 smithi082 podman[72970]: 2024-03-27 07:21:05.346205538 +0000 UTC m=+0.369033601 container start e702cb3f7c87b2e026c55d12a0b5a38f527fcea461ff5949f9cbba356d5a86f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:21:05.689 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:21:05 smithi082 ceph-mds[73028]: -- 172.21.15.82:0/1069117914 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5557cc11da40 con 0x5557cc0f0800 2024-03-27T07:21:05.689 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:21:05 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-d[73024]: starting mds.d at 2024-03-27T07:21:05.689 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:21:05 smithi082 bash[72970]: e702cb3f7c87b2e026c55d12a0b5a38f527fcea461ff5949f9cbba356d5a86f0 2024-03-27T07:21:05.689 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:21:05 smithi082 systemd[1]: Started Ceph mds.d for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:05.834 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:05 smithi153 ceph-mon[36179]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:05.834 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:05 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/156525775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:05.835 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:05.835 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:05.835 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:05.835 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:05.835 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:05.835 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:05 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:05 smithi149 ceph-mon[36065]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:05 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/156525775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:05 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:06.754 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:06 smithi082 ceph-mon[32178]: Deploying daemon mds.e on smithi149 2024-03-27T07:21:06.755 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:06 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.82:6836/2302110902,v1:172.21.15.82:6837/2302110902] up:boot 2024-03-27T07:21:06.755 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:06 smithi082 ceph-mon[32178]: fsmap 4 up:standby 2024-03-27T07:21:06.755 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:06 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-27T07:21:06.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:06 smithi149 ceph-mon[36065]: Deploying daemon mds.e on smithi149 2024-03-27T07:21:06.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:06 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.82:6836/2302110902,v1:172.21.15.82:6837/2302110902] up:boot 2024-03-27T07:21:06.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:06 smithi149 ceph-mon[36065]: fsmap 4 up:standby 2024-03-27T07:21:06.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:06 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-27T07:21:07.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:06 smithi153 ceph-mon[36179]: Deploying daemon mds.e on smithi149 2024-03-27T07:21:07.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:06 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.82:6836/2302110902,v1:172.21.15.82:6837/2302110902] up:boot 2024-03-27T07:21:07.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:06 smithi153 ceph-mon[36179]: fsmap 4 up:standby 2024-03-27T07:21:07.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:06 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-27T07:21:07.367 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.470+0000 7fec30ccf640 1 -- 172.21.15.82:0/3532266448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c102620 msgr2=0x7fec2c108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.470+0000 7fec30ccf640 1 --2- 172.21.15.82:0/3532266448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c102620 0x7fec2c108eb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fec24009ca0 tx=0x7fec2402c0f0 comp rx=0 tx=0).stop 2024-03-27T07:21:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.470+0000 7fec30ccf640 1 -- 172.21.15.82:0/3532266448 shutdown_connections 2024-03-27T07:21:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.470+0000 7fec30ccf640 1 --2- 172.21.15.82:0/3532266448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c102620 0x7fec2c108eb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.470+0000 7fec30ccf640 1 --2- 172.21.15.82:0/3532266448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec2c101c60 0x7fec2c1020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.470+0000 7fec30ccf640 1 --2- 172.21.15.82:0/3532266448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec2c100a70 0x7fec2c100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:07.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.470+0000 7fec30ccf640 1 -- 172.21.15.82:0/3532266448 >> 172.21.15.82:0/3532266448 conn(0x7fec2c0fbfe0 msgr2=0x7fec2c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:07.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.470+0000 7fec30ccf640 1 -- 172.21.15.82:0/3532266448 shutdown_connections 2024-03-27T07:21:07.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.470+0000 7fec30ccf640 1 -- 172.21.15.82:0/3532266448 wait complete. 2024-03-27T07:21:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec30ccf640 1 Processor -- start 2024-03-27T07:21:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec30ccf640 1 -- start start 2024-03-27T07:21:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec30ccf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c100a70 0x7fec2c196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec30ccf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec2c101c60 0x7fec2c1972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec30ccf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec2c102620 0x7fec2c19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec30ccf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c10c6f0 con 0x7fec2c100a70 2024-03-27T07:21:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec30ccf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c10c570 con 0x7fec2c102620 2024-03-27T07:21:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec30ccf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c10c870 con 0x7fec2c101c60 2024-03-27T07:21:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec2a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c100a70 0x7fec2c196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:07.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec2a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c100a70 0x7fec2c196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52226/0 (socket says 172.21.15.82:52226) 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec2a59c640 1 -- 172.21.15.82:0/495012869 learned_addr learned my addr 172.21.15.82:0/495012869 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec2ad9d640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec2c102620 0x7fec2c19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec29d9b640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec2c101c60 0x7fec2c1972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec2a59c640 1 -- 172.21.15.82:0/495012869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec2c101c60 msgr2=0x7fec2c1972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec2a59c640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec2c101c60 0x7fec2c1972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec2a59c640 1 -- 172.21.15.82:0/495012869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec2c102620 msgr2=0x7fec2c19e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec2a59c640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec2c102620 0x7fec2c19e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.471+0000 7fec2a59c640 1 -- 172.21.15.82:0/495012869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c19e980 con 0x7fec2c100a70 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.472+0000 7fec2a59c640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c100a70 0x7fec2c196d60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fec1400d950 tx=0x7fec1400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.472+0000 7fec237fe640 1 -- 172.21.15.82:0/495012869 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14017070 con 0x7fec2c100a70 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.472+0000 7fec237fe640 1 -- 172.21.15.82:0/495012869 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec14009c30 con 0x7fec2c100a70 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.472+0000 7fec237fe640 1 -- 172.21.15.82:0/495012869 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1400f600 con 0x7fec2c100a70 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.472+0000 7fec30ccf640 1 -- 172.21.15.82:0/495012869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2c19ec70 con 0x7fec2c100a70 2024-03-27T07:21:07.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.472+0000 7fec30ccf640 1 -- 172.21.15.82:0/495012869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2c19f170 con 0x7fec2c100a70 2024-03-27T07:21:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.473+0000 7fec30ccf640 1 -- 172.21.15.82:0/495012869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec2c107d90 con 0x7fec2c100a70 2024-03-27T07:21:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.474+0000 7fec237fe640 1 -- 172.21.15.82:0/495012869 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fec1401a070 con 0x7fec2c100a70 2024-03-27T07:21:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.474+0000 7fec237fe640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec180a3610 0x7fec180a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.475+0000 7fec29d9b640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec180a3610 0x7fec180a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:07.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.475+0000 7fec237fe640 1 -- 172.21.15.82:0/495012869 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fec140cf2f0 con 0x7fec2c100a70 2024-03-27T07:21:07.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.475+0000 7fec29d9b640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec180a3610 0x7fec180a5ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec2c198270 tx=0x7fec1c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:07.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.479+0000 7fec237fe640 1 -- 172.21.15.82:0/495012869 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fec14009de0 con 0x7fec2c100a70 2024-03-27T07:21:07.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:07 smithi082 ceph-mon[32178]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.723+0000 7fec30ccf640 1 -- 172.21.15.82:0/495012869 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec2c02d560 con 0x7fec2c100a70 2024-03-27T07:21:07.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.724+0000 7fec237fe640 1 -- 172.21.15.82:0/495012869 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3862 (secure 0 0 0) 0x7fec1409c360 con 0x7fec2c100a70 2024-03-27T07:21:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:07.726 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-27T07:21:07.726 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 5 2024-03-27T07:21:07.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 -- 172.21.15.82:0/495012869 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec180a3610 msgr2=0x7fec180a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec180a3610 0x7fec180a5ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec2c198270 tx=0x7fec1c005f90 comp rx=0 tx=0).stop 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 -- 172.21.15.82:0/495012869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c100a70 msgr2=0x7fec2c196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c100a70 0x7fec2c196d60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fec1400d950 tx=0x7fec1400de10 comp rx=0 tx=0).stop 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 -- 172.21.15.82:0/495012869 shutdown_connections 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec180a3610 0x7fec180a5ad0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec2c102620 0x7fec2c19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec2c101c60 0x7fec2c1972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 --2- 172.21.15.82:0/495012869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c100a70 0x7fec2c196d60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 -- 172.21.15.82:0/495012869 >> 172.21.15.82:0/495012869 conn(0x7fec2c0fbfe0 msgr2=0x7fec2c104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 -- 172.21.15.82:0/495012869 shutdown_connections 2024-03-27T07:21:07.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:07.726+0000 7fec30ccf640 1 -- 172.21.15.82:0/495012869 wait complete. 2024-03-27T07:21:07.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:07 smithi149 ceph-mon[36065]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:07 smithi153 ceph-mon[36179]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:08.505 INFO:journalctl@ceph.mds.e.smithi149.stdout:Mar 27 07:21:08 smithi149 systemd[1]: Started Ceph mds.e for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:08.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:08 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/495012869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:08.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:08 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:08.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:08 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:08.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:08 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:08.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:08 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:08.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:08 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:08.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:08 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:09.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:08 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/495012869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:09.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:08 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:09.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:08 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:09.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:08 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:09.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:08 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:09.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:08 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:09.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:08 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:09.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:08 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/495012869' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:09.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:08 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:09.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:08 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:09.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:08 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:09.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:08 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:09.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:08 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:09.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:08 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:09.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:09 smithi153 ceph-mon[36179]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:09.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:09 smithi153 ceph-mon[36179]: Deploying daemon mds.f on smithi153 2024-03-27T07:21:09.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:09 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.149:6834/227197026,v1:172.21.15.149:6835/227197026] up:boot 2024-03-27T07:21:09.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:09 smithi153 ceph-mon[36179]: fsmap 5 up:standby 2024-03-27T07:21:09.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:09 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T07:21:09.739 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 -- 172.21.15.82:0/2208577199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe024104f10 msgr2=0x7fe024107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 --2- 172.21.15.82:0/2208577199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe024104f10 0x7fe024107300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009900 tx=0x7fe00c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 -- 172.21.15.82:0/2208577199 shutdown_connections 2024-03-27T07:21:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 --2- 172.21.15.82:0/2208577199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe024104f10 0x7fe024107300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 --2- 172.21.15.82:0/2208577199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe024107840 0x7fe024109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 --2- 172.21.15.82:0/2208577199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0241025e0 0x7fe0241049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 -- 172.21.15.82:0/2208577199 >> 172.21.15.82:0/2208577199 conn(0x7fe0240fbff0 msgr2=0x7fe0240fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 -- 172.21.15.82:0/2208577199 shutdown_connections 2024-03-27T07:21:09.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 -- 172.21.15.82:0/2208577199 wait complete. 2024-03-27T07:21:09.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 Processor -- start 2024-03-27T07:21:09.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.850+0000 7fe02a18a640 1 -- start start 2024-03-27T07:21:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe02a18a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0241025e0 0x7fe024197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe02a18a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe024104f10 0x7fe024198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe02a18a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe024107840 0x7fe02419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe02a18a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe02410d7d0 con 0x7fe024104f10 2024-03-27T07:21:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe02a18a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe02410d650 con 0x7fe0241025e0 2024-03-27T07:21:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe02a18a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe02410d950 con 0x7fe024107840 2024-03-27T07:21:09.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe01affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe024104f10 0x7fe024198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe01affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe024104f10 0x7fe024198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56788/0 (socket says 172.21.15.82:56788) 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe01affd640 1 -- 172.21.15.82:0/3289490495 learned_addr learned my addr 172.21.15.82:0/3289490495 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe023fff640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe024107840 0x7fe02419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe0237fe640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0241025e0 0x7fe024197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe01affd640 1 -- 172.21.15.82:0/3289490495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe024107840 msgr2=0x7fe02419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe01affd640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe024107840 0x7fe02419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe01affd640 1 -- 172.21.15.82:0/3289490495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0241025e0 msgr2=0x7fe024197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe01affd640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0241025e0 0x7fe024197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe01affd640 1 -- 172.21.15.82:0/3289490495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02419fa60 con 0x7fe024104f10 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe01affd640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe024104f10 0x7fe024198380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe00c005ab0 tx=0x7fe00c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:09.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe0217fa640 1 -- 172.21.15.82:0/3289490495 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c041070 con 0x7fe024104f10 2024-03-27T07:21:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe0217fa640 1 -- 172.21.15.82:0/3289490495 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe00c0054e0 con 0x7fe024104f10 2024-03-27T07:21:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.851+0000 7fe02a18a640 1 -- 172.21.15.82:0/3289490495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02419fcf0 con 0x7fe024104f10 2024-03-27T07:21:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.852+0000 7fe0217fa640 1 -- 172.21.15.82:0/3289490495 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c034440 con 0x7fe024104f10 2024-03-27T07:21:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.852+0000 7fe02a18a640 1 -- 172.21.15.82:0/3289490495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0241a0190 con 0x7fe024104f10 2024-03-27T07:21:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.853+0000 7fe02a18a640 1 -- 172.21.15.82:0/3289490495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0240fdae0 con 0x7fe024104f10 2024-03-27T07:21:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.854+0000 7fe0217fa640 1 -- 172.21.15.82:0/3289490495 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fe00c044070 con 0x7fe024104f10 2024-03-27T07:21:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.854+0000 7fe0217fa640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe0100a3610 0x7fe0100a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.854+0000 7fe0237fe640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe0100a3610 0x7fe0100a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.854+0000 7fe0217fa640 1 -- 172.21.15.82:0/3289490495 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fe00c0f14a0 con 0x7fe024104f10 2024-03-27T07:21:09.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.855+0000 7fe0237fe640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe0100a3610 0x7fe0100a5ad0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe014005fd0 tx=0x7fe014005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:09.859+0000 7fe0217fa640 1 -- 172.21.15.82:0/3289490495 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe00c0be510 con 0x7fe024104f10 2024-03-27T07:21:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:09 smithi082 ceph-mon[32178]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:09 smithi082 ceph-mon[32178]: Deploying daemon mds.f on smithi153 2024-03-27T07:21:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:09 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.149:6834/227197026,v1:172.21.15.149:6835/227197026] up:boot 2024-03-27T07:21:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:09 smithi082 ceph-mon[32178]: fsmap 5 up:standby 2024-03-27T07:21:09.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:09 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T07:21:10.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:09 smithi149 ceph-mon[36065]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:10.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:09 smithi149 ceph-mon[36065]: Deploying daemon mds.f on smithi153 2024-03-27T07:21:10.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:09 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.149:6834/227197026,v1:172.21.15.149:6835/227197026] up:boot 2024-03-27T07:21:10.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:09 smithi149 ceph-mon[36065]: fsmap 5 up:standby 2024-03-27T07:21:10.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:09 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T07:21:10.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.075+0000 7fe02a18a640 1 -- 172.21.15.82:0/3289490495 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe02402d370 con 0x7fe024104f10 2024-03-27T07:21:10.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.075+0000 7fe0217fa640 1 -- 172.21.15.82:0/3289490495 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4687 (secure 0 0 0) 0x7fe00c0bde10 con 0x7fe024104f10 2024-03-27T07:21:10.077 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:10.077 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-03-27T07:21:10.078 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 6 2024-03-27T07:21:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.077+0000 7fe02a18a640 1 -- 172.21.15.82:0/3289490495 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe0100a3610 msgr2=0x7fe0100a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.077+0000 7fe02a18a640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe0100a3610 0x7fe0100a5ad0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe014005fd0 tx=0x7fe014005850 comp rx=0 tx=0).stop 2024-03-27T07:21:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.077+0000 7fe02a18a640 1 -- 172.21.15.82:0/3289490495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe024104f10 msgr2=0x7fe024198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.077+0000 7fe02a18a640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe024104f10 0x7fe024198380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe00c005ab0 tx=0x7fe00c005dc0 comp rx=0 tx=0).stop 2024-03-27T07:21:10.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.078+0000 7fe02a18a640 1 -- 172.21.15.82:0/3289490495 shutdown_connections 2024-03-27T07:21:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.078+0000 7fe02a18a640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe0100a3610 0x7fe0100a5ad0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.078+0000 7fe02a18a640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe024104f10 0x7fe024198380 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.078+0000 7fe02a18a640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe024107840 0x7fe02419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.078+0000 7fe02a18a640 1 --2- 172.21.15.82:0/3289490495 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe0241025e0 0x7fe024197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.078+0000 7fe02a18a640 1 -- 172.21.15.82:0/3289490495 >> 172.21.15.82:0/3289490495 conn(0x7fe0240fbff0 msgr2=0x7fe024102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.078+0000 7fe02a18a640 1 -- 172.21.15.82:0/3289490495 shutdown_connections 2024-03-27T07:21:10.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:10.078+0000 7fe02a18a640 1 -- 172.21.15.82:0/3289490495 wait complete. 2024-03-27T07:21:10.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:10 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3289490495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:10.788 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:21:10 smithi153 systemd[1]: Starting Ceph mds.f for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:21:10.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:10 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3289490495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:11.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:10 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3289490495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:11.197 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:21:10 smithi153 podman[66856]: 2024-03-27 07:21:10.824800415 +0000 UTC m=+0.017918416 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:21:11.197 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:21:10 smithi153 podman[66856]: 2024-03-27 07:21:10.943329107 +0000 UTC m=+0.136447082 container create 2767a95d99155316e9fc251d04c8454eb1b840790be0febe936e8b04ad94a792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-27T07:21:11.197 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:21:11 smithi153 podman[66856]: 2024-03-27 07:21:11.196115577 +0000 UTC m=+0.389233566 container init 2767a95d99155316e9fc251d04c8454eb1b840790be0febe936e8b04ad94a792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-27T07:21:11.538 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:21:11 smithi153 podman[66856]: 2024-03-27 07:21:11.198797076 +0000 UTC m=+0.391915067 container start 2767a95d99155316e9fc251d04c8454eb1b840790be0febe936e8b04ad94a792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0) 2024-03-27T07:21:11.538 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:21:11 smithi153 ceph-mds[66875]: -- 172.21.15.153:0/2833488786 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a0bf8eda40 con 0x55a0bf8c1000 2024-03-27T07:21:11.538 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:21:11 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f[66871]: starting mds.f at 2024-03-27T07:21:11.538 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:21:11 smithi153 bash[66856]: 2767a95d99155316e9fc251d04c8454eb1b840790be0febe936e8b04ad94a792 2024-03-27T07:21:11.538 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:21:11 smithi153 systemd[1]: Started Ceph mds.f for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:11 smithi082 ceph-mon[32178]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:11 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:11 smithi149 ceph-mon[36065]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:11 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:12.014 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:11 smithi153 ceph-mon[36179]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:12.014 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:12.015 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:12.015 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:12.015 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:12.015 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:12.015 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:11 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:12.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:12.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.202+0000 7fe869101640 1 -- 172.21.15.82:0/2451937858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe864101b70 msgr2=0x7fe864101f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:12.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.202+0000 7fe869101640 1 --2- 172.21.15.82:0/2451937858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe864101b70 0x7fe864101f90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe854009900 tx=0x7fe85402bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:12.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.202+0000 7fe869101640 1 -- 172.21.15.82:0/2451937858 shutdown_connections 2024-03-27T07:21:12.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.202+0000 7fe869101640 1 --2- 172.21.15.82:0/2451937858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe864103720 0x7fe864109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:12.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.202+0000 7fe869101640 1 --2- 172.21.15.82:0/2451937858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe864102d60 0x7fe8641031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:12.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.202+0000 7fe869101640 1 --2- 172.21.15.82:0/2451937858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe864101b70 0x7fe864101f90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:12.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.202+0000 7fe869101640 1 -- 172.21.15.82:0/2451937858 >> 172.21.15.82:0/2451937858 conn(0x7fe8640fd100 msgr2=0x7fe8640ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:12.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.202+0000 7fe869101640 1 -- 172.21.15.82:0/2451937858 shutdown_connections 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.202+0000 7fe869101640 1 -- 172.21.15.82:0/2451937858 wait complete. 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe869101640 1 Processor -- start 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe869101640 1 -- start start 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe869101640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe864101b70 0x7fe864197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe869101640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe864102d60 0x7fe864198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe869101640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe864103720 0x7fe86419f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe869101640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe86410d840 con 0x7fe864101b70 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe869101640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe86410d6c0 con 0x7fe864103720 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe869101640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe86410d9c0 con 0x7fe864102d60 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe862d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe864101b70 0x7fe864197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:12.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe862d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe864101b70 0x7fe864197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56798/0 (socket says 172.21.15.82:56798) 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe862d9d640 1 -- 172.21.15.82:0/2538469280 learned_addr learned my addr 172.21.15.82:0/2538469280 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe85bfff640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe864102d60 0x7fe864198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe862d9d640 1 -- 172.21.15.82:0/2538469280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe864102d60 msgr2=0x7fe864198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.203+0000 7fe862d9d640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe864102d60 0x7fe864198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe862d9d640 1 -- 172.21.15.82:0/2538469280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe864103720 msgr2=0x7fe86419f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe86359e640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe864103720 0x7fe86419f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe862d9d640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe864103720 0x7fe86419f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe862d9d640 1 -- 172.21.15.82:0/2538469280 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86419fb00 con 0x7fe864101b70 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe85bfff640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe864102d60 0x7fe864198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe862d9d640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe864101b70 0x7fe864197ee0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe854000c00 tx=0x7fe854004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe860d99640 1 -- 172.21.15.82:0/2538469280 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854041070 con 0x7fe864101b70 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe869101640 1 -- 172.21.15.82:0/2538469280 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86419fd90 con 0x7fe864101b70 2024-03-27T07:21:12.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe860d99640 1 -- 172.21.15.82:0/2538469280 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8540054e0 con 0x7fe864101b70 2024-03-27T07:21:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe860d99640 1 -- 172.21.15.82:0/2538469280 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8540346a0 con 0x7fe864101b70 2024-03-27T07:21:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.204+0000 7fe869101640 1 -- 172.21.15.82:0/2538469280 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8641a01d0 con 0x7fe864101b70 2024-03-27T07:21:12.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.205+0000 7fe869101640 1 -- 172.21.15.82:0/2538469280 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe864108e90 con 0x7fe864101b70 2024-03-27T07:21:12.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.206+0000 7fe860d99640 1 -- 172.21.15.82:0/2538469280 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fe854044070 con 0x7fe864101b70 2024-03-27T07:21:12.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.206+0000 7fe860d99640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe8500a3610 0x7fe8500a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:12.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.207+0000 7fe85bfff640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe8500a3610 0x7fe8500a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:12.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.207+0000 7fe860d99640 1 -- 172.21.15.82:0/2538469280 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7fe8540f16e0 con 0x7fe864101b70 2024-03-27T07:21:12.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.207+0000 7fe85bfff640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe8500a3610 0x7fe8500a5ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe8641993f0 tx=0x7fe84c005d30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:12.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.211+0000 7fe860d99640 1 -- 172.21.15.82:0/2538469280 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe8540be750 con 0x7fe864101b70 2024-03-27T07:21:12.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.425+0000 7fe869101640 1 -- 172.21.15.82:0/2538469280 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe86402d370 con 0x7fe864101b70 2024-03-27T07:21:12.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.426+0000 7fe860d99640 1 -- 172.21.15.82:0/2538469280 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5515 (secure 0 0 0) 0x7fe8540be050 con 0x7fe864101b70 2024-03-27T07:21:12.428 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:12.428 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-03-27T07:21:12.428 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2024-03-27T07:21:12.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 -- 172.21.15.82:0/2538469280 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe8500a3610 msgr2=0x7fe8500a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:12.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe8500a3610 0x7fe8500a5ad0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe8641993f0 tx=0x7fe84c005d30 comp rx=0 tx=0).stop 2024-03-27T07:21:12.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 -- 172.21.15.82:0/2538469280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe864101b70 msgr2=0x7fe864197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:12.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe864101b70 0x7fe864197ee0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe854000c00 tx=0x7fe854004040 comp rx=0 tx=0).stop 2024-03-27T07:21:12.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 -- 172.21.15.82:0/2538469280 shutdown_connections 2024-03-27T07:21:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe8500a3610 0x7fe8500a5ad0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe864103720 0x7fe86419f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe864102d60 0x7fe864198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 --2- 172.21.15.82:0/2538469280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe864101b70 0x7fe864197ee0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 -- 172.21.15.82:0/2538469280 >> 172.21.15.82:0/2538469280 conn(0x7fe8640fd100 msgr2=0x7fe864106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 -- 172.21.15.82:0/2538469280 shutdown_connections 2024-03-27T07:21:12.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:12.428+0000 7fe869101640 1 -- 172.21.15.82:0/2538469280 wait complete. 2024-03-27T07:21:12.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:12 smithi082 ceph-mon[32178]: Deploying daemon mds.c on smithi153 2024-03-27T07:21:12.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:12 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6834/1080332547,v1:172.21.15.153:6835/1080332547] up:boot 2024-03-27T07:21:12.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:12 smithi082 ceph-mon[32178]: fsmap 6 up:standby 2024-03-27T07:21:12.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:12 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T07:21:12.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:12 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2538469280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:13.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:12 smithi149 ceph-mon[36065]: Deploying daemon mds.c on smithi153 2024-03-27T07:21:13.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:12 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6834/1080332547,v1:172.21.15.153:6835/1080332547] up:boot 2024-03-27T07:21:13.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:12 smithi149 ceph-mon[36065]: fsmap 6 up:standby 2024-03-27T07:21:13.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:12 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T07:21:13.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:12 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2538469280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:13.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:12 smithi153 ceph-mon[36179]: Deploying daemon mds.c on smithi153 2024-03-27T07:21:13.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:12 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6834/1080332547,v1:172.21.15.153:6835/1080332547] up:boot 2024-03-27T07:21:13.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:12 smithi153 ceph-mon[36179]: fsmap 6 up:standby 2024-03-27T07:21:13.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:12 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T07:21:13.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:12 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2538469280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:13.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:13 smithi153 ceph-mon[36179]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:13.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:13 smithi082 ceph-mon[32178]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:14.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:13 smithi149 ceph-mon[36065]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:14.441 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:14.538 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:21:14 smithi153 systemd[1]: Started Ceph mds.c for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:14.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.549+0000 7f302dff7640 1 -- 172.21.15.82:0/3852409977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3028100a70 msgr2=0x7f3028100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:14.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.550+0000 7f302dff7640 1 --2- 172.21.15.82:0/3852409977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3028100a70 0x7f3028100e90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3018009900 tx=0x7f301802bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.550+0000 7f302dff7640 1 -- 172.21.15.82:0/3852409977 shutdown_connections 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.550+0000 7f302dff7640 1 --2- 172.21.15.82:0/3852409977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3028102620 0x7f3028108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.550+0000 7f302dff7640 1 --2- 172.21.15.82:0/3852409977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3028101c60 0x7f30281020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.550+0000 7f302dff7640 1 --2- 172.21.15.82:0/3852409977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3028100a70 0x7f3028100e90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.550+0000 7f302dff7640 1 -- 172.21.15.82:0/3852409977 >> 172.21.15.82:0/3852409977 conn(0x7f30280fbfe0 msgr2=0x7f30280fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.550+0000 7f302dff7640 1 -- 172.21.15.82:0/3852409977 shutdown_connections 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.550+0000 7f302dff7640 1 -- 172.21.15.82:0/3852409977 wait complete. 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.550+0000 7f302dff7640 1 Processor -- start 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.550+0000 7f302dff7640 1 -- start start 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f302dff7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3028100a70 0x7f3028197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f302dff7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3028101c60 0x7f30281983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f302dff7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3028102620 0x7f302819f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:14.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f302dff7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f302810c6f0 con 0x7f3028100a70 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f302dff7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f302810c570 con 0x7f3028101c60 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f302dff7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f302810c870 con 0x7f3028102620 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f30277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3028100a70 0x7f3028197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f30277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3028100a70 0x7f3028197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56812/0 (socket says 172.21.15.82:56812) 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f30277fe640 1 -- 172.21.15.82:0/1260115493 learned_addr learned my addr 172.21.15.82:0/1260115493 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f3026ffd640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3028101c60 0x7f30281983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f3027fff640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3028102620 0x7f302819f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f30277fe640 1 -- 172.21.15.82:0/1260115493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3028102620 msgr2=0x7f302819f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f30277fe640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3028102620 0x7f302819f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f30277fe640 1 -- 172.21.15.82:0/1260115493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3028101c60 msgr2=0x7f30281983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f30277fe640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3028101c60 0x7f30281983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f30277fe640 1 -- 172.21.15.82:0/1260115493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302819fab0 con 0x7f3028100a70 2024-03-27T07:21:14.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f30277fe640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3028100a70 0x7f3028197e90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3018000c00 tx=0x7f3018005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:14.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f3024ff9640 1 -- 172.21.15.82:0/1260115493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018041070 con 0x7f3028100a70 2024-03-27T07:21:14.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f3024ff9640 1 -- 172.21.15.82:0/1260115493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30180044d0 con 0x7f3028100a70 2024-03-27T07:21:14.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f302dff7640 1 -- 172.21.15.82:0/1260115493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302819fd40 con 0x7f3028100a70 2024-03-27T07:21:14.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f3024ff9640 1 -- 172.21.15.82:0/1260115493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3018034440 con 0x7f3028100a70 2024-03-27T07:21:14.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.551+0000 7f302dff7640 1 -- 172.21.15.82:0/1260115493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30281a0180 con 0x7f3028100a70 2024-03-27T07:21:14.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.552+0000 7f302dff7640 1 -- 172.21.15.82:0/1260115493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30281a03b0 con 0x7f3028100a70 2024-03-27T07:21:14.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.553+0000 7f3024ff9640 1 -- 172.21.15.82:0/1260115493 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f3018044070 con 0x7f3028100a70 2024-03-27T07:21:14.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.554+0000 7f3024ff9640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f30140a3610 0x7f30140a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:14.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.554+0000 7f3026ffd640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f30140a3610 0x7f30140a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:14.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.554+0000 7f3024ff9640 1 -- 172.21.15.82:0/1260115493 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f30180f1410 con 0x7f3028100a70 2024-03-27T07:21:14.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.555+0000 7f3026ffd640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f30140a3610 0x7f30140a5ad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f30281993a0 tx=0x7f3010005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:14.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.560+0000 7f3024ff9640 1 -- 172.21.15.82:0/1260115493 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f30180be480 con 0x7f3028100a70 2024-03-27T07:21:14.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.776+0000 7f302dff7640 1 -- 172.21.15.82:0/1260115493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30281a0750 con 0x7f3028100a70 2024-03-27T07:21:14.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.777+0000 7f3024ff9640 1 -- 172.21.15.82:0/1260115493 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6343 (secure 0 0 0) 0x7f30180bdd80 con 0x7f3028100a70 2024-03-27T07:21:14.779 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:14.780 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-03-27T07:21:14.780 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-03-27T07:21:14.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 -- 172.21.15.82:0/1260115493 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f30140a3610 msgr2=0x7f30140a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f30140a3610 0x7f30140a5ad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f30281993a0 tx=0x7f3010005f90 comp rx=0 tx=0).stop 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 -- 172.21.15.82:0/1260115493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3028100a70 msgr2=0x7f3028197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3028100a70 0x7f3028197e90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3018000c00 tx=0x7f3018005d50 comp rx=0 tx=0).stop 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 -- 172.21.15.82:0/1260115493 shutdown_connections 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f30140a3610 0x7f30140a5ad0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3028102620 0x7f302819f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3028101c60 0x7f30281983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 --2- 172.21.15.82:0/1260115493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3028100a70 0x7f3028197e90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 -- 172.21.15.82:0/1260115493 >> 172.21.15.82:0/1260115493 conn(0x7f30280fbfe0 msgr2=0x7f3028068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 -- 172.21.15.82:0/1260115493 shutdown_connections 2024-03-27T07:21:14.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:14.779+0000 7f302dff7640 1 -- 172.21.15.82:0/1260115493 wait complete. 2024-03-27T07:21:15.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:15.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:15.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:15.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:15.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:15.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:15.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: Deploying daemon mds.h on smithi149 2024-03-27T07:21:15.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:15.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6836/1290254754,v1:172.21.15.153:6837/1290254754] up:boot 2024-03-27T07:21:15.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: fsmap 7 up:standby 2024-03-27T07:21:15.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:21:15.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:15 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1260115493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:15.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: Deploying daemon mds.h on smithi149 2024-03-27T07:21:15.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:15.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6836/1290254754,v1:172.21.15.153:6837/1290254754] up:boot 2024-03-27T07:21:15.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: fsmap 7 up:standby 2024-03-27T07:21:15.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:21:15.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:15 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1260115493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:15.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:15.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:15.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:15.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:15.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:15.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:15.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: Deploying daemon mds.h on smithi149 2024-03-27T07:21:15.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:15.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6836/1290254754,v1:172.21.15.153:6837/1290254754] up:boot 2024-03-27T07:21:15.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: fsmap 7 up:standby 2024-03-27T07:21:15.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:21:15.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:15 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1260115493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:16.755 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:21:16 smithi149 systemd[1]: Starting Ceph mds.h for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:21:16.794 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:16.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.906+0000 7f205192e640 1 -- 172.21.15.82:0/1460494235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f204c100af0 msgr2=0x7f204c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:16.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.906+0000 7f205192e640 1 --2- 172.21.15.82:0/1460494235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f204c100af0 0x7f204c100f10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f203c009900 tx=0x7f203c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:16.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.906+0000 7f205192e640 1 -- 172.21.15.82:0/1460494235 shutdown_connections 2024-03-27T07:21:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.906+0000 7f205192e640 1 --2- 172.21.15.82:0/1460494235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f204c1026a0 0x7f204c108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.906+0000 7f205192e640 1 --2- 172.21.15.82:0/1460494235 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f204c101ce0 0x7f204c102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.906+0000 7f205192e640 1 --2- 172.21.15.82:0/1460494235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f204c100af0 0x7f204c100f10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.906+0000 7f205192e640 1 -- 172.21.15.82:0/1460494235 >> 172.21.15.82:0/1460494235 conn(0x7f204c0fc080 msgr2=0x7f204c0fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.906+0000 7f205192e640 1 -- 172.21.15.82:0/1460494235 shutdown_connections 2024-03-27T07:21:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.906+0000 7f205192e640 1 -- 172.21.15.82:0/1460494235 wait complete. 2024-03-27T07:21:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f205192e640 1 Processor -- start 2024-03-27T07:21:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f205192e640 1 -- start start 2024-03-27T07:21:16.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f205192e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f204c100af0 0x7f204c196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f205192e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f204c101ce0 0x7f204c197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f205192e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f204c1026a0 0x7f204c19e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f205192e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f204c10c750 con 0x7f204c101ce0 2024-03-27T07:21:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f205192e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f204c10c5d0 con 0x7f204c1026a0 2024-03-27T07:21:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f205192e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f204c10c8d0 con 0x7f204c100af0 2024-03-27T07:21:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f2043fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f204c101ce0 0x7f204c197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f2043fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f204c101ce0 0x7f204c197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56824/0 (socket says 172.21.15.82:56824) 2024-03-27T07:21:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f2043fff640 1 -- 172.21.15.82:0/3055201509 learned_addr learned my addr 172.21.15.82:0/3055201509 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:16.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f204b7fe640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f204c1026a0 0x7f204c19e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f204affd640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f204c100af0 0x7f204c196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f2043fff640 1 -- 172.21.15.82:0/3055201509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f204c100af0 msgr2=0x7f204c196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f2043fff640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f204c100af0 0x7f204c196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f2043fff640 1 -- 172.21.15.82:0/3055201509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f204c1026a0 msgr2=0x7f204c19e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f2043fff640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f204c1026a0 0x7f204c19e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f2043fff640 1 -- 172.21.15.82:0/3055201509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204c19e930 con 0x7f204c101ce0 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.907+0000 7f2043fff640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f204c101ce0 0x7f204c197260 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f203400c920 tx=0x7f203400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.908+0000 7f205092c640 1 -- 172.21.15.82:0/3055201509 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034007c70 con 0x7f204c101ce0 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.908+0000 7f205092c640 1 -- 172.21.15.82:0/3055201509 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2034007e10 con 0x7f204c101ce0 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.908+0000 7f205192e640 1 -- 172.21.15.82:0/3055201509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f204c19ec20 con 0x7f204c101ce0 2024-03-27T07:21:16.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.908+0000 7f205092c640 1 -- 172.21.15.82:0/3055201509 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2034018890 con 0x7f204c101ce0 2024-03-27T07:21:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.908+0000 7f205192e640 1 -- 172.21.15.82:0/3055201509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f204c19f1c0 con 0x7f204c101ce0 2024-03-27T07:21:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.909+0000 7f205192e640 1 -- 172.21.15.82:0/3055201509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f204c107db0 con 0x7f204c101ce0 2024-03-27T07:21:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.910+0000 7f205092c640 1 -- 172.21.15.82:0/3055201509 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f2034018a70 con 0x7f204c101ce0 2024-03-27T07:21:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.910+0000 7f205092c640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a3690 0x7f20380a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.910+0000 7f204affd640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a3690 0x7f20380a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.910+0000 7f205092c640 1 -- 172.21.15.82:0/3055201509 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f20340cfa50 con 0x7f204c101ce0 2024-03-27T07:21:16.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.911+0000 7f204affd640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a3690 0x7f20380a5b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f204c1981f0 tx=0x7f203c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:16.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:16.915+0000 7f205092c640 1 -- 172.21.15.82:0/3055201509 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2034014030 con 0x7f204c101ce0 2024-03-27T07:21:17.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.130+0000 7f205192e640 1 -- 172.21.15.82:0/3055201509 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f204c02d560 con 0x7f204c101ce0 2024-03-27T07:21:17.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.130+0000 7f205092c640 1 -- 172.21.15.82:0/3055201509 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6343 (secure 0 0 0) 0x7f203409cac0 con 0x7f204c101ce0 2024-03-27T07:21:17.132 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:17.133 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-03-27T07:21:17.133 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 8 2024-03-27T07:21:17.133 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:21:16 smithi149 podman[66662]: 2024-03-27 07:21:16.760230488 +0000 UTC m=+0.018740417 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:21:17.133 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:21:16 smithi149 podman[66662]: 2024-03-27 07:21:16.868691021 +0000 UTC m=+0.127200959 container create ba48746825b23c46c5d26889a96adf2cd4fa36051d923eda86972c67ee024aee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T07:21:17.134 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:21:17 smithi149 podman[66662]: 2024-03-27 07:21:17.132181059 +0000 UTC m=+0.390690978 container init ba48746825b23c46c5d26889a96adf2cd4fa36051d923eda86972c67ee024aee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-27T07:21:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 -- 172.21.15.82:0/3055201509 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a3690 msgr2=0x7f20380a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a3690 0x7f20380a5b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f204c1981f0 tx=0x7f203c000bc0 comp rx=0 tx=0).stop 2024-03-27T07:21:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 -- 172.21.15.82:0/3055201509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f204c101ce0 msgr2=0x7f204c197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f204c101ce0 0x7f204c197260 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f203400c920 tx=0x7f203400cde0 comp rx=0 tx=0).stop 2024-03-27T07:21:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 -- 172.21.15.82:0/3055201509 shutdown_connections 2024-03-27T07:21:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20380a3690 0x7f20380a5b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f204c101ce0 0x7f204c197260 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f204c1026a0 0x7f204c19e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 --2- 172.21.15.82:0/3055201509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f204c100af0 0x7f204c196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:17.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 -- 172.21.15.82:0/3055201509 >> 172.21.15.82:0/3055201509 conn(0x7f204c0fc080 msgr2=0x7f204c104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 -- 172.21.15.82:0/3055201509 shutdown_connections 2024-03-27T07:21:17.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:17.132+0000 7f205192e640 1 -- 172.21.15.82:0/3055201509 wait complete. 2024-03-27T07:21:17.505 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:21:17 smithi149 podman[66662]: 2024-03-27 07:21:17.134809471 +0000 UTC m=+0.393319392 container start ba48746825b23c46c5d26889a96adf2cd4fa36051d923eda86972c67ee024aee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-03-27T07:21:17.505 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:21:17 smithi149 ceph-mds[66682]: -- 172.21.15.149:0/432273480 <== mon.2 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556617435a40 con 0x556617408800 2024-03-27T07:21:17.505 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:21:17 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: starting mds.h at 2024-03-27T07:21:17.505 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:21:17 smithi149 bash[66662]: ba48746825b23c46c5d26889a96adf2cd4fa36051d923eda86972c67ee024aee 2024-03-27T07:21:17.505 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:21:17 smithi149 systemd[1]: Started Ceph mds.h for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:17.776 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:17 smithi082 ceph-mon[32178]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:17.776 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:17 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3055201509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:17.776 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:17.776 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:17.776 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:17.776 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:17.776 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:17.777 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:17 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:17.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:17 smithi153 ceph-mon[36179]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:17.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:17 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3055201509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:17.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:17.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:17.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:17.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:17.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:17.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:17 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:17 smithi149 ceph-mon[36065]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:17 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3055201509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:18.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:18.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:18.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:17 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:18.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:18 smithi153 ceph-mon[36179]: Deploying daemon mds.i on smithi153 2024-03-27T07:21:18.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:18 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] up:boot 2024-03-27T07:21:18.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:18 smithi153 ceph-mon[36179]: fsmap 8 up:standby 2024-03-27T07:21:18.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:18 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T07:21:18.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:18 smithi082 ceph-mon[32178]: Deploying daemon mds.i on smithi153 2024-03-27T07:21:18.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:18 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] up:boot 2024-03-27T07:21:18.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:18 smithi082 ceph-mon[32178]: fsmap 8 up:standby 2024-03-27T07:21:18.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:18 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T07:21:19.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:18 smithi149 ceph-mon[36065]: Deploying daemon mds.i on smithi153 2024-03-27T07:21:19.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:18 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] up:boot 2024-03-27T07:21:19.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:18 smithi149 ceph-mon[36065]: fsmap 8 up:standby 2024-03-27T07:21:19.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:18 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T07:21:19.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:19.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.257+0000 7f41c7135640 1 -- 172.21.15.82:0/366619156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0102620 msgr2=0x7f41c0108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:19.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.257+0000 7f41c7135640 1 --2- 172.21.15.82:0/366619156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0102620 0x7f41c0108eb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009ca0 tx=0x7f41b802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:21:19.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.257+0000 7f41c7135640 1 -- 172.21.15.82:0/366619156 shutdown_connections 2024-03-27T07:21:19.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.257+0000 7f41c7135640 1 --2- 172.21.15.82:0/366619156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0102620 0x7f41c0108eb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:19.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.257+0000 7f41c7135640 1 --2- 172.21.15.82:0/366619156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0101c60 0x7f41c01020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:19.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.257+0000 7f41c7135640 1 --2- 172.21.15.82:0/366619156 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c0100a70 0x7f41c0100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:19.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.257+0000 7f41c7135640 1 -- 172.21.15.82:0/366619156 >> 172.21.15.82:0/366619156 conn(0x7f41c00fbfe0 msgr2=0x7f41c00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:19.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.257+0000 7f41c7135640 1 -- 172.21.15.82:0/366619156 shutdown_connections 2024-03-27T07:21:19.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.257+0000 7f41c7135640 1 -- 172.21.15.82:0/366619156 wait complete. 2024-03-27T07:21:19.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c7135640 1 Processor -- start 2024-03-27T07:21:19.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c7135640 1 -- start start 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c7135640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0100a70 0x7f41c0069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c7135640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0101c60 0x7f41c019cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c7135640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c0102620 0x7f41c019f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c7135640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41c010c6f0 con 0x7f41c0100a70 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c7135640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f41c010c570 con 0x7f41c0102620 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c7135640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41c010c870 con 0x7f41c0101c60 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c4ed1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0100a70 0x7f41c0069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c4ed1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0100a70 0x7f41c0069880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36780/0 (socket says 172.21.15.82:36780) 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c4ed1640 1 -- 172.21.15.82:0/4254252095 learned_addr learned my addr 172.21.15.82:0/4254252095 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41bffff640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0101c60 0x7f41c019cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c56d2640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c0102620 0x7f41c019f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c4ed1640 1 -- 172.21.15.82:0/4254252095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0101c60 msgr2=0x7f41c019cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c4ed1640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0101c60 0x7f41c019cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c4ed1640 1 -- 172.21.15.82:0/4254252095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c0102620 msgr2=0x7f41c019f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c4ed1640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c0102620 0x7f41c019f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c4ed1640 1 -- 172.21.15.82:0/4254252095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c019fa80 con 0x7f41c0100a70 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41bffff640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0101c60 0x7f41c019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c56d2640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c0102620 0x7f41c019f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.258+0000 7f41c4ed1640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0100a70 0x7f41c0069880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f41b400d950 tx=0x7f41b400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.259+0000 7f41bdffb640 1 -- 172.21.15.82:0/4254252095 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b4017020 con 0x7f41c0100a70 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.259+0000 7f41c7135640 1 -- 172.21.15.82:0/4254252095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c019fd70 con 0x7f41c0100a70 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.259+0000 7f41bdffb640 1 -- 172.21.15.82:0/4254252095 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41b4009c30 con 0x7f41c0100a70 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.259+0000 7f41bdffb640 1 -- 172.21.15.82:0/4254252095 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b400f6b0 con 0x7f41c0100a70 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.259+0000 7f41c7135640 1 -- 172.21.15.82:0/4254252095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c01a0230 con 0x7f41c0100a70 2024-03-27T07:21:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.260+0000 7f41c7135640 1 -- 172.21.15.82:0/4254252095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c0107d90 con 0x7f41c0100a70 2024-03-27T07:21:19.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.261+0000 7f41bdffb640 1 -- 172.21.15.82:0/4254252095 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f41b401a020 con 0x7f41c0100a70 2024-03-27T07:21:19.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.261+0000 7f41bdffb640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f41b00a3610 0x7f41b00a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:19.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.261+0000 7f41bffff640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f41b00a3610 0x7f41b00a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:19.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.261+0000 7f41bdffb640 1 -- 172.21.15.82:0/4254252095 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f41b40cf940 con 0x7f41c0100a70 2024-03-27T07:21:19.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.262+0000 7f41bffff640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f41b00a3610 0x7f41b00a5ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41c00695f0 tx=0x7f41ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:19.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.266+0000 7f41bdffb640 1 -- 172.21.15.82:0/4254252095 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f41b4021020 con 0x7f41c0100a70 2024-03-27T07:21:19.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.479+0000 7f41c7135640 1 -- 172.21.15.82:0/4254252095 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41c002d370 con 0x7f41c0100a70 2024-03-27T07:21:19.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.480+0000 7f41bdffb640 1 -- 172.21.15.82:0/4254252095 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7171 (secure 0 0 0) 0x7f41c002d370 con 0x7f41c0100a70 2024-03-27T07:21:19.482 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:19.482 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-27T07:21:19.482 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 9 2024-03-27T07:21:19.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.482+0000 7f41c7135640 1 -- 172.21.15.82:0/4254252095 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f41b00a3610 msgr2=0x7f41b00a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:19.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.482+0000 7f41c7135640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f41b00a3610 0x7f41b00a5ad0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41c00695f0 tx=0x7f41ac005f90 comp rx=0 tx=0).stop 2024-03-27T07:21:19.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.482+0000 7f41c7135640 1 -- 172.21.15.82:0/4254252095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0100a70 msgr2=0x7f41c0069880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:19.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.482+0000 7f41c7135640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0100a70 0x7f41c0069880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f41b400d950 tx=0x7f41b400de10 comp rx=0 tx=0).stop 2024-03-27T07:21:19.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.482+0000 7f41c7135640 1 -- 172.21.15.82:0/4254252095 shutdown_connections 2024-03-27T07:21:19.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.482+0000 7f41c7135640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f41b00a3610 0x7f41b00a5ad0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:19.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.482+0000 7f41c7135640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f41c0102620 0x7f41c019f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:19.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.482+0000 7f41c7135640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0101c60 0x7f41c019cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:19.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.482+0000 7f41c7135640 1 --2- 172.21.15.82:0/4254252095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41c0100a70 0x7f41c0069880 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:19.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.483+0000 7f41c7135640 1 -- 172.21.15.82:0/4254252095 >> 172.21.15.82:0/4254252095 conn(0x7f41c00fbfe0 msgr2=0x7f41c0104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:19.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.483+0000 7f41c7135640 1 -- 172.21.15.82:0/4254252095 shutdown_connections 2024-03-27T07:21:19.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:19.483+0000 7f41c7135640 1 -- 172.21.15.82:0/4254252095 wait complete. 2024-03-27T07:21:19.769 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:19 smithi153 ceph-mon[36179]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:19.770 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:19 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4254252095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:19.770 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:21:19 smithi153 systemd[1]: Starting Ceph mds.i for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:21:19.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:19 smithi082 ceph-mon[32178]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:19 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4254252095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:19 smithi149 ceph-mon[36065]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:19 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4254252095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:20.030 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:21:19 smithi153 podman[67474]: 2024-03-27 07:21:19.768278922 +0000 UTC m=+0.109561674 container create 3a4066c405da6c71de519e4762caea9e8fbc195d8666ef2143cbd94437b78127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-27T07:21:20.030 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:21:19 smithi153 podman[67474]: 2024-03-27 07:21:19.676235468 +0000 UTC m=+0.017518245 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:21:20.288 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:21:20 smithi153 podman[67474]: 2024-03-27 07:21:20.029394261 +0000 UTC m=+0.370677031 container init 3a4066c405da6c71de519e4762caea9e8fbc195d8666ef2143cbd94437b78127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-27T07:21:20.288 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:21:20 smithi153 podman[67474]: 2024-03-27 07:21:20.032291793 +0000 UTC m=+0.373574562 container start 3a4066c405da6c71de519e4762caea9e8fbc195d8666ef2143cbd94437b78127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:21:20.288 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:21:20 smithi153 ceph-mds[67493]: -- 172.21.15.153:0/3707397679 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5607a5ef9a40 con 0x5607a5ecd000 2024-03-27T07:21:20.288 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:21:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: starting mds.i at 2024-03-27T07:21:20.288 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:21:20 smithi153 bash[67474]: 3a4066c405da6c71de519e4762caea9e8fbc195d8666ef2143cbd94437b78127 2024-03-27T07:21:20.288 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:21:20 smithi153 systemd[1]: Started Ceph mds.i for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:21.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:21.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:21.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:21.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:21.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:21.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:21.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: Deploying daemon mds.g on smithi082 2024-03-27T07:21:21.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:21.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] up:boot 2024-03-27T07:21:21.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: fsmap 9 up:standby 2024-03-27T07:21:21.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:21 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T07:21:21.496 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: Deploying daemon mds.g on smithi082 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] up:boot 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: fsmap 9 up:standby 2024-03-27T07:21:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:21 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T07:21:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: Deploying daemon mds.g on smithi082 2024-03-27T07:21:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] up:boot 2024-03-27T07:21:21.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: fsmap 9 up:standby 2024-03-27T07:21:21.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:21 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T07:21:21.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 -- 172.21.15.82:0/992372407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a2c101c60 msgr2=0x7f2a2c1020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:21.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 --2- 172.21.15.82:0/992372407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a2c101c60 0x7f2a2c1020e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2a20009ca0 tx=0x7f2a2002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:21:21.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 -- 172.21.15.82:0/992372407 shutdown_connections 2024-03-27T07:21:21.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 --2- 172.21.15.82:0/992372407 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a2c101c60 0x7f2a2c1020e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:21.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 --2- 172.21.15.82:0/992372407 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a2c102620 0x7f2a2c108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:21.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 --2- 172.21.15.82:0/992372407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c100a70 0x7f2a2c100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:21.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 -- 172.21.15.82:0/992372407 >> 172.21.15.82:0/992372407 conn(0x7f2a2c0fbfe0 msgr2=0x7f2a2c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:21.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 -- 172.21.15.82:0/992372407 shutdown_connections 2024-03-27T07:21:21.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 -- 172.21.15.82:0/992372407 wait complete. 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 Processor -- start 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.601+0000 7f2a3160e640 1 -- start start 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a3160e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c100a70 0x7f2a2c069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a3160e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a2c101c60 0x7f2a2c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a3160e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a2c102620 0x7f2a2c19f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a3160e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c10c6f0 con 0x7f2a2c102620 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a3160e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c10c570 con 0x7f2a2c101c60 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a3160e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2c10c870 con 0x7f2a2c100a70 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a2c102620 0x7f2a2c19f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a2c102620 0x7f2a2c19f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36790/0 (socket says 172.21.15.82:36790) 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2b7fe640 1 -- 172.21.15.82:0/1755535677 learned_addr learned my addr 172.21.15.82:0/1755535677 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:21.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2affd640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c100a70 0x7f2a2c069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2a7fc640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a2c101c60 0x7f2a2c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2b7fe640 1 -- 172.21.15.82:0/1755535677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c100a70 msgr2=0x7f2a2c069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2b7fe640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c100a70 0x7f2a2c069820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2b7fe640 1 -- 172.21.15.82:0/1755535677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a2c101c60 msgr2=0x7f2a2c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2b7fe640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a2c101c60 0x7f2a2c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2b7fe640 1 -- 172.21.15.82:0/1755535677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2c19fb40 con 0x7f2a2c102620 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2affd640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c100a70 0x7f2a2c069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2a7fc640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a2c101c60 0x7f2a2c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a2b7fe640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a2c102620 0x7f2a2c19f230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00c970 tx=0x7f2a1c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a13fff640 1 -- 172.21.15.82:0/1755535677 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c007bb0 con 0x7f2a2c102620 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a13fff640 1 -- 172.21.15.82:0/1755535677 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a1c007d50 con 0x7f2a2c102620 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a3160e640 1 -- 172.21.15.82:0/1755535677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2c19fdd0 con 0x7f2a2c102620 2024-03-27T07:21:21.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a13fff640 1 -- 172.21.15.82:0/1755535677 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00f450 con 0x7f2a2c102620 2024-03-27T07:21:21.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.602+0000 7f2a3160e640 1 -- 172.21.15.82:0/1755535677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a2c1a0290 con 0x7f2a2c102620 2024-03-27T07:21:21.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.603+0000 7f2a3160e640 1 -- 172.21.15.82:0/1755535677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a2c107e10 con 0x7f2a2c102620 2024-03-27T07:21:21.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.604+0000 7f2a13fff640 1 -- 172.21.15.82:0/1755535677 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f2a1c004f60 con 0x7f2a2c102620 2024-03-27T07:21:21.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.605+0000 7f2a13fff640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2a140a3690 0x7f2a140a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:21.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.605+0000 7f2a2affd640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2a140a3690 0x7f2a140a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:21.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.605+0000 7f2a13fff640 1 -- 172.21.15.82:0/1755535677 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f2a1c0cf590 con 0x7f2a2c102620 2024-03-27T07:21:21.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.605+0000 7f2a2affd640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2a140a3690 0x7f2a140a5b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2a240058c0 tx=0x7f2a24005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:21.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.609+0000 7f2a13fff640 1 -- 172.21.15.82:0/1755535677 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2a1c014030 con 0x7f2a2c102620 2024-03-27T07:21:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.828+0000 7f2a3160e640 1 -- 172.21.15.82:0/1755535677 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a2c02d370 con 0x7f2a2c102620 2024-03-27T07:21:21.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.829+0000 7f2a13fff640 1 -- 172.21.15.82:0/1755535677 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8001 (secure 0 0 0) 0x7f2a1c09c600 con 0x7f2a2c102620 2024-03-27T07:21:21.831 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:21.831 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-03-27T07:21:21.831 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 10 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 -- 172.21.15.82:0/1755535677 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2a140a3690 msgr2=0x7f2a140a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2a140a3690 0x7f2a140a5b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2a240058c0 tx=0x7f2a24005850 comp rx=0 tx=0).stop 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 -- 172.21.15.82:0/1755535677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a2c102620 msgr2=0x7f2a2c19f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a2c102620 0x7f2a2c19f230 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00c970 tx=0x7f2a1c00ce30 comp rx=0 tx=0).stop 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 -- 172.21.15.82:0/1755535677 shutdown_connections 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2a140a3690 0x7f2a140a5b50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2a2c102620 0x7f2a2c19f230 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2a2c101c60 0x7f2a2c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 --2- 172.21.15.82:0/1755535677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a2c100a70 0x7f2a2c069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 -- 172.21.15.82:0/1755535677 >> 172.21.15.82:0/1755535677 conn(0x7f2a2c0fbfe0 msgr2=0x7f2a2c104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 -- 172.21.15.82:0/1755535677 shutdown_connections 2024-03-27T07:21:21.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:21.831+0000 7f2a3160e640 1 -- 172.21.15.82:0/1755535677 wait complete. 2024-03-27T07:21:22.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:22 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1755535677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:22.438 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:21:22 smithi082 systemd[1]: Starting Ceph mds.g for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:21:22.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:22 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1755535677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:22.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:22 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1755535677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:22.816 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:21:22 smithi082 podman[73622]: 2024-03-27 07:21:22.451042748 +0000 UTC m=+0.018375037 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:21:22.816 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:21:22 smithi082 podman[73622]: 2024-03-27 07:21:22.561896922 +0000 UTC m=+0.129229201 container create d9b53df302f37063d39591327bce0c25adaf7c632825e48599fb94005f3b8a7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-g, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:21:22.816 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:21:22 smithi082 podman[73622]: 2024-03-27 07:21:22.814987207 +0000 UTC m=+0.382319487 container init d9b53df302f37063d39591327bce0c25adaf7c632825e48599fb94005f3b8a7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-g, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:21:23.189 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:21:22 smithi082 podman[73622]: 2024-03-27 07:21:22.81768237 +0000 UTC m=+0.385014651 container start d9b53df302f37063d39591327bce0c25adaf7c632825e48599fb94005f3b8a7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-g, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True) 2024-03-27T07:21:23.190 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:21:22 smithi082 ceph-mds[73642]: -- 172.21.15.82:0/1277264390 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c301ccba40 con 0x55c301c9ec00 2024-03-27T07:21:23.190 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:21:22 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-g[73638]: starting mds.g at 2024-03-27T07:21:23.190 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:21:22 smithi082 bash[73622]: d9b53df302f37063d39591327bce0c25adaf7c632825e48599fb94005f3b8a7e 2024-03-27T07:21:23.190 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:21:22 smithi082 systemd[1]: Started Ceph mds.g for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:23 smithi149 ceph-mon[36065]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:23 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:23 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:23 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:23 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:23 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:23 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:23 smithi153 ceph-mon[36179]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:23 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:23 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:23 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:23 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:23 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:23 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:23.634 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:23 smithi082 ceph-mon[32178]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:23.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:23 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:23.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:23 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:23.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:23 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:23.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:23 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:23.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:23 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:23.635 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:23 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:23.845 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:23.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/863724844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bac102670 msgr2=0x7f1bac104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:23.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 --2- 172.21.15.82:0/863724844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bac102670 0x7f1bac104a60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009900 tx=0x7f1b9c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:23.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/863724844 shutdown_connections 2024-03-27T07:21:23.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 --2- 172.21.15.82:0/863724844 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bac1078d0 0x7f1bac109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:23.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 --2- 172.21.15.82:0/863724844 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac104fa0 0x7f1bac107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:23.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 --2- 172.21.15.82:0/863724844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bac102670 0x7f1bac104a60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/863724844 >> 172.21.15.82:0/863724844 conn(0x7f1bac0fc080 msgr2=0x7f1bac0fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/863724844 shutdown_connections 2024-03-27T07:21:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/863724844 wait complete. 2024-03-27T07:21:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 Processor -- start 2024-03-27T07:21:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.956+0000 7f1bb1ff7640 1 -- start start 2024-03-27T07:21:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bb1ff7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bac102670 0x7f1bac197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bb1ff7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bac104fa0 0x7f1bac198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bb1ff7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac1078d0 0x7f1bac19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bb1ff7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac10d830 con 0x7f1bac102670 2024-03-27T07:21:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bb1ff7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac10d6b0 con 0x7f1bac104fa0 2024-03-27T07:21:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bb1ff7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1bac10d9b0 con 0x7f1bac1078d0 2024-03-27T07:21:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bab7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bac102670 0x7f1bac197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bab7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bac102670 0x7f1bac197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36814/0 (socket says 172.21.15.82:36814) 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bab7fe640 1 -- 172.21.15.82:0/987843137 learned_addr learned my addr 172.21.15.82:0/987843137 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1babfff640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac1078d0 0x7f1bac19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1ba2ffd640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bac104fa0 0x7f1bac198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bab7fe640 1 -- 172.21.15.82:0/987843137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac1078d0 msgr2=0x7f1bac19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bab7fe640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac1078d0 0x7f1bac19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bab7fe640 1 -- 172.21.15.82:0/987843137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bac104fa0 msgr2=0x7f1bac198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bab7fe640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bac104fa0 0x7f1bac198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bab7fe640 1 -- 172.21.15.82:0/987843137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bac19fb00 con 0x7f1bac102670 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1babfff640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac1078d0 0x7f1bac19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1ba2ffd640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bac104fa0 0x7f1bac198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1bab7fe640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bac102670 0x7f1bac197ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009230 tx=0x7f1b9c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.957+0000 7f1ba97fa640 1 -- 172.21.15.82:0/987843137 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c041070 con 0x7f1bac102670 2024-03-27T07:21:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.958+0000 7f1ba97fa640 1 -- 172.21.15.82:0/987843137 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b9c0054e0 con 0x7f1bac102670 2024-03-27T07:21:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.958+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/987843137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bac19fd90 con 0x7f1bac102670 2024-03-27T07:21:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.958+0000 7f1ba97fa640 1 -- 172.21.15.82:0/987843137 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c034440 con 0x7f1bac102670 2024-03-27T07:21:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.958+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/987843137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bac1a01d0 con 0x7f1bac102670 2024-03-27T07:21:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.958+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/987843137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bac0fdb70 con 0x7f1bac102670 2024-03-27T07:21:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.960+0000 7f1ba97fa640 1 -- 172.21.15.82:0/987843137 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f1b9c044070 con 0x7f1bac102670 2024-03-27T07:21:23.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.960+0000 7f1ba97fa640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1b980a3610 0x7f1b980a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.960+0000 7f1ba2ffd640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1b980a3610 0x7f1b980a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.960+0000 7f1ba97fa640 1 -- 172.21.15.82:0/987843137 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f1b9c0f1660 con 0x7f1bac102670 2024-03-27T07:21:23.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.961+0000 7f1ba2ffd640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1b980a3610 0x7f1b980a5ad0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1bac1993f0 tx=0x7f1b94005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:23.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:23.965+0000 7f1ba97fa640 1 -- 172.21.15.82:0/987843137 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1b9c0be6b0 con 0x7f1bac102670 2024-03-27T07:21:24.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.182+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/987843137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bac02d370 con 0x7f1bac102670 2024-03-27T07:21:24.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.183+0000 7f1ba97fa640 1 -- 172.21.15.82:0/987843137 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8824 (secure 0 0 0) 0x7f1b9c0bdfb0 con 0x7f1bac102670 2024-03-27T07:21:24.185 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:24.185 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-03-27T07:21:24.185 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 11 2024-03-27T07:21:24.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/987843137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1b980a3610 msgr2=0x7f1b980a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1b980a3610 0x7f1b980a5ad0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1bac1993f0 tx=0x7f1b94005e50 comp rx=0 tx=0).stop 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/987843137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bac102670 msgr2=0x7f1bac197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bac102670 0x7f1bac197ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009230 tx=0x7f1b9c005dd0 comp rx=0 tx=0).stop 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/987843137 shutdown_connections 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1b980a3610 0x7f1b980a5ad0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1bac1078d0 0x7f1bac19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1bac104fa0 0x7f1bac198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 --2- 172.21.15.82:0/987843137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1bac102670 0x7f1bac197ee0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/987843137 >> 172.21.15.82:0/987843137 conn(0x7f1bac0fc080 msgr2=0x7f1bac102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/987843137 shutdown_connections 2024-03-27T07:21:24.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:24.185+0000 7f1bb1ff7640 1 -- 172.21.15.82:0/987843137 wait complete. 2024-03-27T07:21:24.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:24 smithi082 ceph-mon[32178]: Deploying daemon mds.a on smithi082 2024-03-27T07:21:24.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:24 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.82:6838/908346783,v1:172.21.15.82:6839/908346783] up:boot 2024-03-27T07:21:24.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:24 smithi082 ceph-mon[32178]: fsmap 10 up:standby 2024-03-27T07:21:24.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:24 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-27T07:21:24.474 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:24 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/987843137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:24 smithi149 ceph-mon[36065]: Deploying daemon mds.a on smithi082 2024-03-27T07:21:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:24 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.82:6838/908346783,v1:172.21.15.82:6839/908346783] up:boot 2024-03-27T07:21:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:24 smithi149 ceph-mon[36065]: fsmap 10 up:standby 2024-03-27T07:21:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:24 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-27T07:21:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:24 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/987843137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:24.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:24 smithi153 ceph-mon[36179]: Deploying daemon mds.a on smithi082 2024-03-27T07:21:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:24 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.82:6838/908346783,v1:172.21.15.82:6839/908346783] up:boot 2024-03-27T07:21:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:24 smithi153 ceph-mon[36179]: fsmap 10 up:standby 2024-03-27T07:21:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:24 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-27T07:21:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:24 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/987843137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:25.432 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:25 smithi082 ceph-mon[32178]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:25.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:25 smithi149 ceph-mon[36065]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:25.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:25 smithi153 ceph-mon[36179]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:25.687 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 27 07:21:25 smithi082 systemd[1]: Started Ceph mds.a for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:26.198 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.305+0000 7f3ede39a640 1 -- 172.21.15.82:0/2911725400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed81025e0 msgr2=0x7f3ed81049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.305+0000 7f3ede39a640 1 --2- 172.21.15.82:0/2911725400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed81025e0 0x7f3ed81049d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009900 tx=0x7f3ec802bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.305+0000 7f3ede39a640 1 -- 172.21.15.82:0/2911725400 shutdown_connections 2024-03-27T07:21:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.305+0000 7f3ede39a640 1 --2- 172.21.15.82:0/2911725400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8107840 0x7f3ed8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.305+0000 7f3ede39a640 1 --2- 172.21.15.82:0/2911725400 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8104f10 0x7f3ed8107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.305+0000 7f3ede39a640 1 --2- 172.21.15.82:0/2911725400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed81025e0 0x7f3ed81049d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.305+0000 7f3ede39a640 1 -- 172.21.15.82:0/2911725400 >> 172.21.15.82:0/2911725400 conn(0x7f3ed80fbff0 msgr2=0x7f3ed80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.305+0000 7f3ede39a640 1 -- 172.21.15.82:0/2911725400 shutdown_connections 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.305+0000 7f3ede39a640 1 -- 172.21.15.82:0/2911725400 wait complete. 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3ede39a640 1 Processor -- start 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3ede39a640 1 -- start start 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3ede39a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed81025e0 0x7f3ed8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3ede39a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8104f10 0x7f3ed81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3ede39a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed8107840 0x7f3ed819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3ede39a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed810d800 con 0x7f3ed8107840 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3ede39a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed810d680 con 0x7f3ed8104f10 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3ede39a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed810d980 con 0x7f3ed81025e0 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3edc937640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed8107840 0x7f3ed819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3edc937640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed8107840 0x7f3ed819f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36844/0 (socket says 172.21.15.82:36844) 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3edc937640 1 -- 172.21.15.82:0/4124836874 learned_addr learned my addr 172.21.15.82:0/4124836874 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:26.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3ed77fe640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8104f10 0x7f3ed81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.306+0000 7f3ed7fff640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed81025e0 0x7f3ed8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3edc937640 1 -- 172.21.15.82:0/4124836874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed81025e0 msgr2=0x7f3ed8197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3edc937640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed81025e0 0x7f3ed8197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3edc937640 1 -- 172.21.15.82:0/4124836874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8104f10 msgr2=0x7f3ed81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3edc937640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8104f10 0x7f3ed81983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3edc937640 1 -- 172.21.15.82:0/4124836874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed819fac0 con 0x7f3ed8107840 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3edc937640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed8107840 0x7f3ed819f450 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000cad0 tx=0x7f3ed000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3ed57fa640 1 -- 172.21.15.82:0/4124836874 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed000ae20 con 0x7f3ed8107840 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3ed57fa640 1 -- 172.21.15.82:0/4124836874 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ed0005020 con 0x7f3ed8107840 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3ed57fa640 1 -- 172.21.15.82:0/4124836874 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed000f6f0 con 0x7f3ed8107840 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3ede39a640 1 -- 172.21.15.82:0/4124836874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed819fdb0 con 0x7f3ed8107840 2024-03-27T07:21:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.307+0000 7f3ede39a640 1 -- 172.21.15.82:0/4124836874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed81a02d0 con 0x7f3ed8107840 2024-03-27T07:21:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.308+0000 7f3ede39a640 1 -- 172.21.15.82:0/4124836874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed80fdae0 con 0x7f3ed8107840 2024-03-27T07:21:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.309+0000 7f3ed57fa640 1 -- 172.21.15.82:0/4124836874 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f3ed00051d0 con 0x7f3ed8107840 2024-03-27T07:21:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.310+0000 7f3ed57fa640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3ec00a3690 0x7f3ec00a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.310+0000 7f3ed7fff640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3ec00a3690 0x7f3ec00a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.310+0000 7f3ed57fa640 1 -- 172.21.15.82:0/4124836874 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f3ed00cfb40 con 0x7f3ed8107840 2024-03-27T07:21:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.310+0000 7f3ed7fff640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3ec00a3690 0x7f3ec00a5b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8006010 tx=0x7f3ec8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:26.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.313+0000 7f3ed57fa640 1 -- 172.21.15.82:0/4124836874 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f3ed0014030 con 0x7f3ed8107840 2024-03-27T07:21:26.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.531+0000 7f3ede39a640 1 -- 172.21.15.82:0/4124836874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3ed802d5c0 con 0x7f3ed8107840 2024-03-27T07:21:26.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.532+0000 7f3ed57fa640 1 -- 172.21.15.82:0/4124836874 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9644 (secure 0 0 0) 0x7f3ed009cc30 con 0x7f3ed8107840 2024-03-27T07:21:26.534 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:26.534 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-03-27T07:21:26.534 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 12 2024-03-27T07:21:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 -- 172.21.15.82:0/4124836874 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3ec00a3690 msgr2=0x7f3ec00a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3ec00a3690 0x7f3ec00a5b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8006010 tx=0x7f3ec8000bc0 comp rx=0 tx=0).stop 2024-03-27T07:21:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 -- 172.21.15.82:0/4124836874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed8107840 msgr2=0x7f3ed819f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed8107840 0x7f3ed819f450 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ed000cad0 tx=0x7f3ed000cf90 comp rx=0 tx=0).stop 2024-03-27T07:21:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 -- 172.21.15.82:0/4124836874 shutdown_connections 2024-03-27T07:21:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3ec00a3690 0x7f3ec00a5b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ed8107840 0x7f3ed819f450 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ed8104f10 0x7f3ed81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 --2- 172.21.15.82:0/4124836874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed81025e0 0x7f3ed8197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:26.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 -- 172.21.15.82:0/4124836874 >> 172.21.15.82:0/4124836874 conn(0x7f3ed80fbff0 msgr2=0x7f3ed8102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:26.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 -- 172.21.15.82:0/4124836874 shutdown_connections 2024-03-27T07:21:26.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:26.534+0000 7f3ede39a640 1 -- 172.21.15.82:0/4124836874 wait complete. 2024-03-27T07:21:26.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: Deploying daemon mds.b on smithi149 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.82:6840/31948189,v1:172.21.15.82:6841/31948189] up:boot 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: fsmap 11 up:standby 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:26 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4124836874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: Deploying daemon mds.b on smithi149 2024-03-27T07:21:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.82:6840/31948189,v1:172.21.15.82:6841/31948189] up:boot 2024-03-27T07:21:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: fsmap 11 up:standby 2024-03-27T07:21:27.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-27T07:21:27.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:27.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:26 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4124836874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T07:21:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T07:21:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: Deploying daemon mds.b on smithi149 2024-03-27T07:21:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.82:6840/31948189,v1:172.21.15.82:6841/31948189] up:boot 2024-03-27T07:21:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: fsmap 11 up:standby 2024-03-27T07:21:27.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-27T07:21:27.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:27.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:26 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4124836874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:28.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 -- 172.21.15.82:0/1722255538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9830102d60 msgr2=0x7f98301031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 --2- 172.21.15.82:0/1722255538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9830102d60 0x7f98301031e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9820009900 tx=0x7f982002bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 -- 172.21.15.82:0/1722255538 shutdown_connections 2024-03-27T07:21:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 --2- 172.21.15.82:0/1722255538 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9830102d60 0x7f98301031e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 --2- 172.21.15.82:0/1722255538 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830103720 0x7f9830109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 --2- 172.21.15.82:0/1722255538 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9830101b70 0x7f9830101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 -- 172.21.15.82:0/1722255538 >> 172.21.15.82:0/1722255538 conn(0x7f98300fd100 msgr2=0x7f98300ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 -- 172.21.15.82:0/1722255538 shutdown_connections 2024-03-27T07:21:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 -- 172.21.15.82:0/1722255538 wait complete. 2024-03-27T07:21:28.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 Processor -- start 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 -- start start 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9830101b70 0x7f9830197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830102d60 0x7f9830198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9830103720 0x7f983019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f983010d7d0 con 0x7f9830103720 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f983010d650 con 0x7f9830102d60 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.661+0000 7f98376af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f983010d950 con 0x7f9830101b70 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9835c4c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9830103720 0x7f983019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9835c4c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9830103720 0x7f983019f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52490/0 (socket says 172.21.15.82:52490) 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9835c4c640 1 -- 172.21.15.82:0/2012331712 learned_addr learned my addr 172.21.15.82:0/2012331712 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9834c4a640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830102d60 0x7f9830198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f983544b640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9830101b70 0x7f9830197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:28.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9835c4c640 1 -- 172.21.15.82:0/2012331712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9830101b70 msgr2=0x7f9830197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9835c4c640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9830101b70 0x7f9830197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9835c4c640 1 -- 172.21.15.82:0/2012331712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830102d60 msgr2=0x7f9830198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9835c4c640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830102d60 0x7f9830198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9835c4c640 1 -- 172.21.15.82:0/2012331712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983019fa60 con 0x7f9830103720 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f983544b640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9830101b70 0x7f9830197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9834c4a640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830102d60 0x7f9830198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f9835c4c640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9830103720 0x7f983019f3f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f982800cad0 tx=0x7f982800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f98267fc640 1 -- 172.21.15.82:0/2012331712 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982800ae20 con 0x7f9830103720 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f98267fc640 1 -- 172.21.15.82:0/2012331712 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9828005020 con 0x7f9830103720 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f98376af640 1 -- 172.21.15.82:0/2012331712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983019fd50 con 0x7f9830103720 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f98267fc640 1 -- 172.21.15.82:0/2012331712 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982800f6f0 con 0x7f9830103720 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.662+0000 7f98376af640 1 -- 172.21.15.82:0/2012331712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98301a01c0 con 0x7f9830103720 2024-03-27T07:21:28.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.663+0000 7f98376af640 1 -- 172.21.15.82:0/2012331712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9830108e90 con 0x7f9830103720 2024-03-27T07:21:28.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.665+0000 7f98267fc640 1 -- 172.21.15.82:0/2012331712 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f98280051d0 con 0x7f9830103720 2024-03-27T07:21:28.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.665+0000 7f98267fc640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f981c0a3610 0x7f981c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:28.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.665+0000 7f983544b640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f981c0a3610 0x7f981c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:28.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.666+0000 7f98267fc640 1 -- 172.21.15.82:0/2012331712 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f98280cfd40 con 0x7f9830103720 2024-03-27T07:21:28.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.666+0000 7f983544b640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f981c0a3610 0x7f981c0a5ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9830102bc0 tx=0x7f982c005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:28.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.669+0000 7f98267fc640 1 -- 172.21.15.82:0/2012331712 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9828014030 con 0x7f9830103720 2024-03-27T07:21:28.755 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:21:28 smithi149 systemd[1]: Started Ceph mds.b for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:21:28.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.902+0000 7f98376af640 1 -- 172.21.15.82:0/2012331712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f983002d370 con 0x7f9830103720 2024-03-27T07:21:28.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.902+0000 7f98267fc640 1 -- 172.21.15.82:0/2012331712 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9644 (secure 0 0 0) 0x7f982809cdb0 con 0x7f9830103720 2024-03-27T07:21:28.904 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:28.904 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-03-27T07:21:28.905 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 12 2024-03-27T07:21:28.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.904+0000 7f98376af640 1 -- 172.21.15.82:0/2012331712 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f981c0a3610 msgr2=0x7f981c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.904+0000 7f98376af640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f981c0a3610 0x7f981c0a5ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9830102bc0 tx=0x7f982c005db0 comp rx=0 tx=0).stop 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.905+0000 7f98376af640 1 -- 172.21.15.82:0/2012331712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9830103720 msgr2=0x7f983019f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.905+0000 7f98376af640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9830103720 0x7f983019f3f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f982800cad0 tx=0x7f982800cf90 comp rx=0 tx=0).stop 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.905+0000 7f98376af640 1 -- 172.21.15.82:0/2012331712 shutdown_connections 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.905+0000 7f98376af640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f981c0a3610 0x7f981c0a5ad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.905+0000 7f98376af640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9830103720 0x7f983019f3f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.905+0000 7f98376af640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9830102d60 0x7f9830198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.905+0000 7f98376af640 1 --2- 172.21.15.82:0/2012331712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9830101b70 0x7f9830197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.905+0000 7f98376af640 1 -- 172.21.15.82:0/2012331712 >> 172.21.15.82:0/2012331712 conn(0x7f98300fd100 msgr2=0x7f9830106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.905+0000 7f98376af640 1 -- 172.21.15.82:0/2012331712 shutdown_connections 2024-03-27T07:21:28.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:28.905+0000 7f98376af640 1 -- 172.21.15.82:0/2012331712 wait complete. 2024-03-27T07:21:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:29 smithi153 ceph-mon[36179]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:29 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2012331712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:29.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:29 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:21:29.795 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:29 smithi082 ceph-mon[32178]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:29.795 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.795 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.795 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.796 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.796 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.796 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:29 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2012331712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:29.796 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:29 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:21:29.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:29 smithi149 ceph-mon[36065]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:29.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:29.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:29 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2012331712' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:29.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:29 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:21:30.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:30 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] up:boot 2024-03-27T07:21:30.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:30 smithi153 ceph-mon[36179]: fsmap 12 up:standby 2024-03-27T07:21:30.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:30 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T07:21:30.920 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:30 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] up:boot 2024-03-27T07:21:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:30 smithi082 ceph-mon[32178]: fsmap 12 up:standby 2024-03-27T07:21:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:30 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T07:21:31.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:30 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] up:boot 2024-03-27T07:21:31.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:30 smithi149 ceph-mon[36065]: fsmap 12 up:standby 2024-03-27T07:21:31.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:30 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T07:21:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.024+0000 7f8221d5e640 1 -- 172.21.15.82:0/3543459290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f821c1025f0 msgr2=0x7f821c1049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.024+0000 7f8221d5e640 1 --2- 172.21.15.82:0/3543459290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f821c1025f0 0x7f821c1049e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f820c009900 tx=0x7f820c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.024+0000 7f8221d5e640 1 -- 172.21.15.82:0/3543459290 shutdown_connections 2024-03-27T07:21:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.024+0000 7f8221d5e640 1 --2- 172.21.15.82:0/3543459290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c107850 0x7f821c109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.024+0000 7f8221d5e640 1 --2- 172.21.15.82:0/3543459290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c104f20 0x7f821c107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.024+0000 7f8221d5e640 1 --2- 172.21.15.82:0/3543459290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f821c1025f0 0x7f821c1049e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.024+0000 7f8221d5e640 1 -- 172.21.15.82:0/3543459290 >> 172.21.15.82:0/3543459290 conn(0x7f821c0fbfe0 msgr2=0x7f821c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.024+0000 7f8221d5e640 1 -- 172.21.15.82:0/3543459290 shutdown_connections 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.024+0000 7f8221d5e640 1 -- 172.21.15.82:0/3543459290 wait complete. 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.025+0000 7f8221d5e640 1 Processor -- start 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.025+0000 7f8221d5e640 1 -- start start 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.025+0000 7f8221d5e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f821c1025f0 0x7f821c197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.025+0000 7f8221d5e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c104f20 0x7f821c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.025+0000 7f8221d5e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c107850 0x7f821c19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.025+0000 7f8221d5e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f821c10d860 con 0x7f821c1025f0 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.025+0000 7f8221d5e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f821c10d6e0 con 0x7f821c107850 2024-03-27T07:21:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.025+0000 7f8221d5e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f821c10d9e0 con 0x7f821c104f20 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.025+0000 7f821b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f821c1025f0 0x7f821c197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f821b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f821c1025f0 0x7f821c197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52510/0 (socket says 172.21.15.82:52510) 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f821b7fe640 1 -- 172.21.15.82:0/1037261224 learned_addr learned my addr 172.21.15.82:0/1037261224 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f821bfff640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c107850 0x7f821c19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f821affd640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c104f20 0x7f821c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f821b7fe640 1 -- 172.21.15.82:0/1037261224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c104f20 msgr2=0x7f821c1983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f821b7fe640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c104f20 0x7f821c1983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f821b7fe640 1 -- 172.21.15.82:0/1037261224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c107850 msgr2=0x7f821c19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f821b7fe640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c107850 0x7f821c19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f821b7fe640 1 -- 172.21.15.82:0/1037261224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821c19fad0 con 0x7f821c1025f0 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f821b7fe640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f821c1025f0 0x7f821c197eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f820c000c00 tx=0x7f820c02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f8218ff9640 1 -- 172.21.15.82:0/1037261224 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c043020 con 0x7f821c1025f0 2024-03-27T07:21:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f8218ff9640 1 -- 172.21.15.82:0/1037261224 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f820c0054e0 con 0x7f821c1025f0 2024-03-27T07:21:31.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f8221d5e640 1 -- 172.21.15.82:0/1037261224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821c19fd60 con 0x7f821c1025f0 2024-03-27T07:21:31.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f8218ff9640 1 -- 172.21.15.82:0/1037261224 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820c003c40 con 0x7f821c1025f0 2024-03-27T07:21:31.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.026+0000 7f8221d5e640 1 -- 172.21.15.82:0/1037261224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821c1a01f0 con 0x7f821c1025f0 2024-03-27T07:21:31.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.027+0000 7f8221d5e640 1 -- 172.21.15.82:0/1037261224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f821c0fdad0 con 0x7f821c1025f0 2024-03-27T07:21:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.028+0000 7f8218ff9640 1 -- 172.21.15.82:0/1037261224 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f820c046020 con 0x7f821c1025f0 2024-03-27T07:21:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.029+0000 7f8218ff9640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82040a3610 0x7f82040a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.029+0000 7f821affd640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82040a3610 0x7f82040a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.029+0000 7f8218ff9640 1 -- 172.21.15.82:0/1037261224 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f820c0f18f0 con 0x7f821c1025f0 2024-03-27T07:21:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.029+0000 7f821affd640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82040a3610 0x7f82040a5ad0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f821c1993c0 tx=0x7f8210005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.034+0000 7f8218ff9640 1 -- 172.21.15.82:0/1037261224 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f820c04d020 con 0x7f821c1025f0 2024-03-27T07:21:31.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.257+0000 7f8221d5e640 1 -- 172.21.15.82:0/1037261224 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f821c02d570 con 0x7f821c1025f0 2024-03-27T07:21:31.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.258+0000 7f8218ff9640 1 -- 172.21.15.82:0/1037261224 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10473 (secure 0 0 0) 0x7f820c0be960 con 0x7f821c1025f0 2024-03-27T07:21:31.260 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:31.260 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24460,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24470,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-03-27T07:21:31.260 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 13 2024-03-27T07:21:31.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 -- 172.21.15.82:0/1037261224 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82040a3610 msgr2=0x7f82040a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82040a3610 0x7f82040a5ad0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f821c1993c0 tx=0x7f8210005f90 comp rx=0 tx=0).stop 2024-03-27T07:21:31.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 -- 172.21.15.82:0/1037261224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f821c1025f0 msgr2=0x7f821c197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f821c1025f0 0x7f821c197eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f820c000c00 tx=0x7f820c02c650 comp rx=0 tx=0).stop 2024-03-27T07:21:31.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 -- 172.21.15.82:0/1037261224 shutdown_connections 2024-03-27T07:21:31.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82040a3610 0x7f82040a5ad0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f821c107850 0x7f821c19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f821c104f20 0x7f821c1983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 --2- 172.21.15.82:0/1037261224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f821c1025f0 0x7f821c197eb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 -- 172.21.15.82:0/1037261224 >> 172.21.15.82:0/1037261224 conn(0x7f821c0fbfe0 msgr2=0x7f821c103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:31.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 -- 172.21.15.82:0/1037261224 shutdown_connections 2024-03-27T07:21:31.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.260+0000 7f8221d5e640 1 -- 172.21.15.82:0/1037261224 wait complete. 2024-03-27T07:21:31.274 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:21:31.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.417+0000 7f40a7eeb640 1 -- 172.21.15.82:0/1933546888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0101c60 msgr2=0x7f40a01020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.417+0000 7f40a7eeb640 1 --2- 172.21.15.82:0/1933546888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0101c60 0x7f40a01020e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4090009900 tx=0x7f409002bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:31.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.417+0000 7f40a7eeb640 1 -- 172.21.15.82:0/1933546888 shutdown_connections 2024-03-27T07:21:31.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.417+0000 7f40a7eeb640 1 --2- 172.21.15.82:0/1933546888 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0101c60 0x7f40a01020e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.417+0000 7f40a7eeb640 1 --2- 172.21.15.82:0/1933546888 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a0102620 0x7f40a0108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.417+0000 7f40a7eeb640 1 --2- 172.21.15.82:0/1933546888 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0100a70 0x7f40a0100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.417+0000 7f40a7eeb640 1 -- 172.21.15.82:0/1933546888 >> 172.21.15.82:0/1933546888 conn(0x7f40a00fbfe0 msgr2=0x7f40a00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:31.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.417+0000 7f40a7eeb640 1 -- 172.21.15.82:0/1933546888 shutdown_connections 2024-03-27T07:21:31.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.417+0000 7f40a7eeb640 1 -- 172.21.15.82:0/1933546888 wait complete. 2024-03-27T07:21:31.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a7eeb640 1 Processor -- start 2024-03-27T07:21:31.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a7eeb640 1 -- start start 2024-03-27T07:21:31.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a7eeb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0100a70 0x7f40a0197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a7eeb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a0101c60 0x7f40a0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a7eeb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0102620 0x7f40a019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a7eeb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f40a010c6d0 con 0x7f40a0102620 2024-03-27T07:21:31.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a7eeb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f40a010c550 con 0x7f40a0100a70 2024-03-27T07:21:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a7eeb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40a010c850 con 0x7f40a0101c60 2024-03-27T07:21:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a6488640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0102620 0x7f40a019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a6488640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0102620 0x7f40a019f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52524/0 (socket says 172.21.15.82:52524) 2024-03-27T07:21:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a5c87640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0100a70 0x7f40a0197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.418+0000 7f40a6488640 1 -- 172.21.15.82:0/4192669759 learned_addr learned my addr 172.21.15.82:0/4192669759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f40a5486640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a0101c60 0x7f40a0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f40a5c87640 1 -- 172.21.15.82:0/4192669759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a0101c60 msgr2=0x7f40a0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f40a5c87640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a0101c60 0x7f40a0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f40a5c87640 1 -- 172.21.15.82:0/4192669759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0102620 msgr2=0x7f40a019f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f40a5c87640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0102620 0x7f40a019f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f40a5c87640 1 -- 172.21.15.82:0/4192669759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a019fb10 con 0x7f40a0100a70 2024-03-27T07:21:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f40a6488640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0102620 0x7f40a019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:21:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f40a5c87640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0100a70 0x7f40a0197ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f40a0101ac0 tx=0x7f409c00dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f4096ffd640 1 -- 172.21.15.82:0/4192669759 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c017070 con 0x7f40a0100a70 2024-03-27T07:21:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f4096ffd640 1 -- 172.21.15.82:0/4192669759 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f409c009c30 con 0x7f40a0100a70 2024-03-27T07:21:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f40a7eeb640 1 -- 172.21.15.82:0/4192669759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a019fe00 con 0x7f40a0100a70 2024-03-27T07:21:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f4096ffd640 1 -- 172.21.15.82:0/4192669759 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c00f620 con 0x7f40a0100a70 2024-03-27T07:21:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.419+0000 7f40a7eeb640 1 -- 172.21.15.82:0/4192669759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a01a0270 con 0x7f40a0100a70 2024-03-27T07:21:31.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.420+0000 7f40a7eeb640 1 -- 172.21.15.82:0/4192669759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a01a04a0 con 0x7f40a0100a70 2024-03-27T07:21:31.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.422+0000 7f4096ffd640 1 -- 172.21.15.82:0/4192669759 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f409c01a070 con 0x7f40a0100a70 2024-03-27T07:21:31.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.423+0000 7f4096ffd640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f408c0a3690 0x7f408c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.423+0000 7f40a5486640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f408c0a3690 0x7f408c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.423+0000 7f4096ffd640 1 -- 172.21.15.82:0/4192669759 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f409c0cf260 con 0x7f40a0100a70 2024-03-27T07:21:31.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.423+0000 7f40a5486640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f408c0a3690 0x7f408c0a5b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f409002c7b0 tx=0x7f4090005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:31.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.426+0000 7f4096ffd640 1 -- 172.21.15.82:0/4192669759 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f409c009de0 con 0x7f40a0100a70 2024-03-27T07:21:31.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.631+0000 7f40a7eeb640 1 -- 172.21.15.82:0/4192669759 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40a01a0830 con 0x7f40a0100a70 2024-03-27T07:21:31.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.632+0000 7f4096ffd640 1 -- 172.21.15.82:0/4192669759 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+18409 (secure 0 0 0) 0x7f409c09bd00 con 0x7f40a0100a70 2024-03-27T07:21:31.634 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:31.635 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:20:45.525020+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:21:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 -- 172.21.15.82:0/4192669759 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f408c0a3690 msgr2=0x7f408c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f408c0a3690 0x7f408c0a5b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f409002c7b0 tx=0x7f4090005fd0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 -- 172.21.15.82:0/4192669759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0100a70 msgr2=0x7f40a0197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0100a70 0x7f40a0197ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f40a0101ac0 tx=0x7f409c00dde0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 -- 172.21.15.82:0/4192669759 shutdown_connections 2024-03-27T07:21:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f408c0a3690 0x7f408c0a5b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40a0102620 0x7f40a019f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40a0101c60 0x7f40a0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 --2- 172.21.15.82:0/4192669759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40a0100a70 0x7f40a0197ef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 -- 172.21.15.82:0/4192669759 >> 172.21.15.82:0/4192669759 conn(0x7f40a00fbfe0 msgr2=0x7f40a00fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 -- 172.21.15.82:0/4192669759 shutdown_connections 2024-03-27T07:21:31.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.634+0000 7f40a7eeb640 1 -- 172.21.15.82:0/4192669759 wait complete. 2024-03-27T07:21:31.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:21:31.648 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:21:31.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.751+0000 7ff991f16640 1 -- 172.21.15.82:0/1517288653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff98c102d50 msgr2=0x7ff98c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.751+0000 7ff991f16640 1 --2- 172.21.15.82:0/1517288653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff98c102d50 0x7ff98c1031d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009900 tx=0x7ff97c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:31.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.751+0000 7ff991f16640 1 -- 172.21.15.82:0/1517288653 shutdown_connections 2024-03-27T07:21:31.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.751+0000 7ff991f16640 1 --2- 172.21.15.82:0/1517288653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff98c102d50 0x7ff98c1031d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.751+0000 7ff991f16640 1 --2- 172.21.15.82:0/1517288653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff98c103710 0x7ff98c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.751+0000 7ff991f16640 1 --2- 172.21.15.82:0/1517288653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c101b60 0x7ff98c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.751+0000 7ff991f16640 1 -- 172.21.15.82:0/1517288653 >> 172.21.15.82:0/1517288653 conn(0x7ff98c0fd0f0 msgr2=0x7ff98c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.751+0000 7ff991f16640 1 -- 172.21.15.82:0/1517288653 shutdown_connections 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.751+0000 7ff991f16640 1 -- 172.21.15.82:0/1517288653 wait complete. 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.751+0000 7ff991f16640 1 Processor -- start 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff991f16640 1 -- start start 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff991f16640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff98c101b60 0x7ff98c075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff991f16640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff98c102d50 0x7ff98c073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff991f16640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c103710 0x7ff98c074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff991f16640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c10d7e0 con 0x7ff98c101b60 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff991f16640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c10d660 con 0x7ff98c102d50 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff991f16640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c10d960 con 0x7ff98c103710 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff98c101b60 0x7ff98c075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff98c101b60 0x7ff98c075900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52548/0 (socket says 172.21.15.82:52548) 2024-03-27T07:21:31.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98b7fe640 1 -- 172.21.15.82:0/2054883615 learned_addr learned my addr 172.21.15.82:0/2054883615 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98affd640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff98c102d50 0x7ff98c073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98bfff640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c103710 0x7ff98c074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98b7fe640 1 -- 172.21.15.82:0/2054883615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c103710 msgr2=0x7ff98c074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98b7fe640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c103710 0x7ff98c074480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98b7fe640 1 -- 172.21.15.82:0/2054883615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff98c102d50 msgr2=0x7ff98c073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98b7fe640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff98c102d50 0x7ff98c073f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98b7fe640 1 -- 172.21.15.82:0/2054883615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c074d10 con 0x7ff98c101b60 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98bfff640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c103710 0x7ff98c074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98affd640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff98c102d50 0x7ff98c073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff98b7fe640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff98c101b60 0x7ff98c075900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff98000e9c0 tx=0x7ff98000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff988ff9640 1 -- 172.21.15.82:0/2054883615 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98000cd80 con 0x7ff98c101b60 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff988ff9640 1 -- 172.21.15.82:0/2054883615 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9800035f0 con 0x7ff98c101b60 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff991f16640 1 -- 172.21.15.82:0/2054883615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98c1a1fb0 con 0x7ff98c101b60 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff988ff9640 1 -- 172.21.15.82:0/2054883615 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980010690 con 0x7ff98c101b60 2024-03-27T07:21:31.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.752+0000 7ff991f16640 1 -- 172.21.15.82:0/2054883615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98c1a2360 con 0x7ff98c101b60 2024-03-27T07:21:31.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.753+0000 7ff991f16640 1 -- 172.21.15.82:0/2054883615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98c108f40 con 0x7ff98c101b60 2024-03-27T07:21:31.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.754+0000 7ff988ff9640 1 -- 172.21.15.82:0/2054883615 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7ff9800037a0 con 0x7ff98c101b60 2024-03-27T07:21:31.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.755+0000 7ff988ff9640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff9740a3610 0x7ff9740a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:31.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.755+0000 7ff98affd640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff9740a3610 0x7ff9740a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:31.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.755+0000 7ff988ff9640 1 -- 172.21.15.82:0/2054883615 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7ff9800cfdf0 con 0x7ff98c101b60 2024-03-27T07:21:31.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.755+0000 7ff98affd640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff9740a3610 0x7ff9740a5ad0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff97c006010 tx=0x7ff97c02c8a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:31.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.758+0000 7ff988ff9640 1 -- 172.21.15.82:0/2054883615 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ff98009ce60 con 0x7ff98c101b60 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1037261224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:31.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:31 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:31.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:31.789 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:21:31.790 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.790 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:21:31.790 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1037261224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:31.790 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:31 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.895 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:31.895 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.895 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.895 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.895 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.895 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.895 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.895 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:31.896 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:21:31.896 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.896 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:21:31.896 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1037261224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:31.896 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:31 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:31.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.945+0000 7ff991f16640 1 -- 172.21.15.82:0/2054883615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff98c02d370 con 0x7ff98c101b60 2024-03-27T07:21:31.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.946+0000 7ff988ff9640 1 -- 172.21.15.82:0/2054883615 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7ff98009c760 con 0x7ff98c101b60 2024-03-27T07:21:31.948 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:21:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 -- 172.21.15.82:0/2054883615 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff9740a3610 msgr2=0x7ff9740a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff9740a3610 0x7ff9740a5ad0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff97c006010 tx=0x7ff97c02c8a0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 -- 172.21.15.82:0/2054883615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff98c101b60 msgr2=0x7ff98c075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff98c101b60 0x7ff98c075900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff98000e9c0 tx=0x7ff98000ee80 comp rx=0 tx=0).stop 2024-03-27T07:21:31.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 -- 172.21.15.82:0/2054883615 shutdown_connections 2024-03-27T07:21:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff9740a3610 0x7ff9740a5ad0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff98c103710 0x7ff98c074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff98c102d50 0x7ff98c073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 --2- 172.21.15.82:0/2054883615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff98c101b60 0x7ff98c075900 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 -- 172.21.15.82:0/2054883615 >> 172.21.15.82:0/2054883615 conn(0x7ff98c0fd0f0 msgr2=0x7ff98c106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 -- 172.21.15.82:0/2054883615 shutdown_connections 2024-03-27T07:21:31.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:31.948+0000 7ff991f16640 1 -- 172.21.15.82:0/2054883615 wait complete. 2024-03-27T07:21:31.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-27T07:21:32.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.062+0000 7f014cf1e640 1 -- 172.21.15.82:0/1053201619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0148102620 msgr2=0x7f0148108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:32.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.062+0000 7f014cf1e640 1 --2- 172.21.15.82:0/1053201619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0148102620 0x7f0148108eb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0138009900 tx=0x7f013802bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:32.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 -- 172.21.15.82:0/1053201619 shutdown_connections 2024-03-27T07:21:32.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 --2- 172.21.15.82:0/1053201619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0148102620 0x7f0148108eb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 --2- 172.21.15.82:0/1053201619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0148101c60 0x7f01481020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 --2- 172.21.15.82:0/1053201619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0148100a70 0x7f0148100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 -- 172.21.15.82:0/1053201619 >> 172.21.15.82:0/1053201619 conn(0x7f01480fbfe0 msgr2=0x7f01480fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 -- 172.21.15.82:0/1053201619 shutdown_connections 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 -- 172.21.15.82:0/1053201619 wait complete. 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 Processor -- start 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 -- start start 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0148100a70 0x7f0148197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0148101c60 0x7f0148198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0148102620 0x7f014819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f014810c6d0 con 0x7f0148102620 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f014810c550 con 0x7f0148100a70 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.063+0000 7f014cf1e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f014810c850 con 0x7f0148101c60 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f0146d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0148102620 0x7f014819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f0146d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0148102620 0x7f014819f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52580/0 (socket says 172.21.15.82:52580) 2024-03-27T07:21:32.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f0146d9d640 1 -- 172.21.15.82:0/321295738 learned_addr learned my addr 172.21.15.82:0/321295738 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f014659c640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0148100a70 0x7f0148197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f0145d9b640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0148101c60 0x7f0148198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f0146d9d640 1 -- 172.21.15.82:0/321295738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0148101c60 msgr2=0x7f0148198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f0146d9d640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0148101c60 0x7f0148198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f0146d9d640 1 -- 172.21.15.82:0/321295738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0148100a70 msgr2=0x7f0148197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f0146d9d640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0148100a70 0x7f0148197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f0146d9d640 1 -- 172.21.15.82:0/321295738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014819fa40 con 0x7f0148102620 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f014659c640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0148100a70 0x7f0148197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f0146d9d640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0148102620 0x7f014819f3d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f013802ce70 tx=0x7f0138005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f013f7fe640 1 -- 172.21.15.82:0/321295738 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138041070 con 0x7f0148102620 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f014cf1e640 1 -- 172.21.15.82:0/321295738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014819fcd0 con 0x7f0148102620 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f013f7fe640 1 -- 172.21.15.82:0/321295738 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01380054e0 con 0x7f0148102620 2024-03-27T07:21:32.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f013f7fe640 1 -- 172.21.15.82:0/321295738 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01380344a0 con 0x7f0148102620 2024-03-27T07:21:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.064+0000 7f014cf1e640 1 -- 172.21.15.82:0/321295738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01481a01c0 con 0x7f0148102620 2024-03-27T07:21:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.065+0000 7f014cf1e640 1 -- 172.21.15.82:0/321295738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01481a0390 con 0x7f0148102620 2024-03-27T07:21:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.066+0000 7f013f7fe640 1 -- 172.21.15.82:0/321295738 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f0138044070 con 0x7f0148102620 2024-03-27T07:21:32.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.067+0000 7f013f7fe640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f01340a3610 0x7f01340a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:32.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.067+0000 7f014659c640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f01340a3610 0x7f01340a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:32.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.067+0000 7f013f7fe640 1 -- 172.21.15.82:0/321295738 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f01380f16b0 con 0x7f0148102620 2024-03-27T07:21:32.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.067+0000 7f014659c640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f01340a3610 0x7f01340a5ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0148101ac0 tx=0x7f01400095c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:32.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.071+0000 7f013f7fe640 1 -- 172.21.15.82:0/321295738 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f01380be720 con 0x7f0148102620 2024-03-27T07:21:32.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.254+0000 7f014cf1e640 1 -- 172.21.15.82:0/321295738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f01481a0720 con 0x7f0148102620 2024-03-27T07:21:32.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.254+0000 7f013f7fe640 1 -- 172.21.15.82:0/321295738 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) ==== 84+0+65 (secure 0 0 0) 0x7f01380be020 con 0x7f0148102620 2024-03-27T07:21:32.256 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:32.257 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-03-27T07:21:32.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:21:32.257 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-03-27T07:21:32.257 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-03-27T07:21:32.257 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:21:32.257 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-03-27T07:21:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 -- 172.21.15.82:0/321295738 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f01340a3610 msgr2=0x7f01340a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f01340a3610 0x7f01340a5ad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0148101ac0 tx=0x7f01400095c0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 -- 172.21.15.82:0/321295738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0148102620 msgr2=0x7f014819f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0148102620 0x7f014819f3d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f013802ce70 tx=0x7f0138005e40 comp rx=0 tx=0).stop 2024-03-27T07:21:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 -- 172.21.15.82:0/321295738 shutdown_connections 2024-03-27T07:21:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f01340a3610 0x7f01340a5ad0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0148102620 0x7f014819f3d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0148101c60 0x7f0148198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 --2- 172.21.15.82:0/321295738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0148100a70 0x7f0148197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 -- 172.21.15.82:0/321295738 >> 172.21.15.82:0/321295738 conn(0x7f01480fbfe0 msgr2=0x7f0148068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 -- 172.21.15.82:0/321295738 shutdown_connections 2024-03-27T07:21:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.256+0000 7f014cf1e640 1 -- 172.21.15.82:0/321295738 wait complete. 2024-03-27T07:21:32.271 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-27T07:21:32.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-27T07:21:32.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.381+0000 7f5096372640 1 -- 172.21.15.82:0/598536763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090102600 msgr2=0x7f5090108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:32.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.381+0000 7f5096372640 1 --2- 172.21.15.82:0/598536763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090102600 0x7f5090108e90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5088009ca0 tx=0x7f508802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.381+0000 7f5096372640 1 -- 172.21.15.82:0/598536763 shutdown_connections 2024-03-27T07:21:32.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.381+0000 7f5096372640 1 --2- 172.21.15.82:0/598536763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090102600 0x7f5090108e90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.381+0000 7f5096372640 1 --2- 172.21.15.82:0/598536763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5090101c40 0x7f50901020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.381+0000 7f5096372640 1 --2- 172.21.15.82:0/598536763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5090100a50 0x7f5090100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.381+0000 7f5096372640 1 -- 172.21.15.82:0/598536763 >> 172.21.15.82:0/598536763 conn(0x7f50900fbfe0 msgr2=0x7f50900fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:32.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.381+0000 7f5096372640 1 -- 172.21.15.82:0/598536763 shutdown_connections 2024-03-27T07:21:32.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.381+0000 7f5096372640 1 -- 172.21.15.82:0/598536763 wait complete. 2024-03-27T07:21:32.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.382+0000 7f5096372640 1 Processor -- start 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.382+0000 7f5096372640 1 -- start start 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f5096372640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5090100a50 0x7f5090196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f5096372640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5090101c40 0x7f5090197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f5096372640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090102600 0x7f509019e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f5096372640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f509010c6d0 con 0x7f5090102600 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f5096372640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f509010c550 con 0x7f5090101c40 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f5096372640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f509010c850 con 0x7f5090100a50 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f509490f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090102600 0x7f509019e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f509490f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090102600 0x7f509019e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52600/0 (socket says 172.21.15.82:52600) 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f509490f640 1 -- 172.21.15.82:0/4024729324 learned_addr learned my addr 172.21.15.82:0/4024729324 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f508f7fe640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5090101c40 0x7f5090197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:32.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f508ffff640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5090100a50 0x7f5090196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f509490f640 1 -- 172.21.15.82:0/4024729324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5090100a50 msgr2=0x7f5090196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f509490f640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5090100a50 0x7f5090196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f509490f640 1 -- 172.21.15.82:0/4024729324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5090101c40 msgr2=0x7f5090197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f509490f640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5090101c40 0x7f5090197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f509490f640 1 -- 172.21.15.82:0/4024729324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509019e960 con 0x7f5090102600 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f509490f640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090102600 0x7f509019e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5088037040 tx=0x7f5088032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f508d7fa640 1 -- 172.21.15.82:0/4024729324 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088041020 con 0x7f5090102600 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f5096372640 1 -- 172.21.15.82:0/4024729324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509019ebf0 con 0x7f5090102600 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f508d7fa640 1 -- 172.21.15.82:0/4024729324 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5088034d90 con 0x7f5090102600 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.383+0000 7f508d7fa640 1 -- 172.21.15.82:0/4024729324 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088039040 con 0x7f5090102600 2024-03-27T07:21:32.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.384+0000 7f5096372640 1 -- 172.21.15.82:0/4024729324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509019f130 con 0x7f5090102600 2024-03-27T07:21:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.385+0000 7f5096372640 1 -- 172.21.15.82:0/4024729324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5090107d70 con 0x7f5090102600 2024-03-27T07:21:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.386+0000 7f508d7fa640 1 -- 172.21.15.82:0/4024729324 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f5088044020 con 0x7f5090102600 2024-03-27T07:21:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.386+0000 7f508d7fa640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f50780a3610 0x7f50780a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.386+0000 7f508ffff640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f50780a3610 0x7f50780a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.386+0000 7f508d7fa640 1 -- 172.21.15.82:0/4024729324 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7127+0+0 (secure 0 0 0) 0x7f50880f1780 con 0x7f5090102600 2024-03-27T07:21:32.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.387+0000 7f508ffff640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f50780a3610 0x7f50780a5ad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5090101aa0 tx=0x7f5080005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:32.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.391+0000 7f508d7fa640 1 -- 172.21.15.82:0/4024729324 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f508804b020 con 0x7f5090102600 2024-03-27T07:21:32.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:32.588+0000 7f5096372640 1 -- 172.21.15.82:0/4024729324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f509002d370 con 0x7f5090102600 2024-03-27T07:21:32.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:32 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4192669759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:32.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:32 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2054883615' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:21:32.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:32 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/321295738' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-27T07:21:32.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:32 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4192669759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:32.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:32 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2054883615' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:21:32.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:32 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/321295738' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-27T07:21:33.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:32 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4192669759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:33.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:32 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2054883615' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:21:33.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:32 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/321295738' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-27T07:21:33.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.534+0000 7f508d7fa640 1 -- 172.21.15.82:0/4024729324 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) ==== 138+0+0 (secure 0 0 0) 0x7f50880be7f0 con 0x7f5090102600 2024-03-27T07:21:33.537 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 -- 172.21.15.82:0/4024729324 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f50780a3610 msgr2=0x7f50780a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f50780a3610 0x7f50780a5ad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5090101aa0 tx=0x7f5080005f90 comp rx=0 tx=0).stop 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 -- 172.21.15.82:0/4024729324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090102600 msgr2=0x7f509019e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090102600 0x7f509019e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5088037040 tx=0x7f5088032f20 comp rx=0 tx=0).stop 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 -- 172.21.15.82:0/4024729324 shutdown_connections 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f50780a3610 0x7f50780a5ad0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5090102600 0x7f509019e2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5090101c40 0x7f5090197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 --2- 172.21.15.82:0/4024729324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5090100a50 0x7f5090196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 -- 172.21.15.82:0/4024729324 >> 172.21.15.82:0/4024729324 conn(0x7f50900fbfe0 msgr2=0x7f5090104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:33.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 -- 172.21.15.82:0/4024729324 shutdown_connections 2024-03-27T07:21:33.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.538+0000 7f5096372640 1 -- 172.21.15.82:0/4024729324 wait complete. 2024-03-27T07:21:33.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-27T07:21:33.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.667+0000 7f74d779a640 1 -- 172.21.15.82:0/429813589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74d0102ea0 msgr2=0x7f74d0103320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:33.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.667+0000 7f74d779a640 1 --2- 172.21.15.82:0/429813589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74d0102ea0 0x7f74d0103320 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009900 tx=0x7f74c002bc80 comp rx=0 tx=0).stop 2024-03-27T07:21:33.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.667+0000 7f74d779a640 1 -- 172.21.15.82:0/429813589 shutdown_connections 2024-03-27T07:21:33.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.667+0000 7f74d779a640 1 --2- 172.21.15.82:0/429813589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74d0102ea0 0x7f74d0103320 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:33.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.667+0000 7f74d779a640 1 --2- 172.21.15.82:0/429813589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74d0103860 0x7f74d010a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:33.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.667+0000 7f74d779a640 1 --2- 172.21.15.82:0/429813589 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74d00ffe30 0x7f74d0100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:33.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.667+0000 7f74d779a640 1 -- 172.21.15.82:0/429813589 >> 172.21.15.82:0/429813589 conn(0x7f74d00fb780 msgr2=0x7f74d00fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:33.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.667+0000 7f74d779a640 1 -- 172.21.15.82:0/429813589 shutdown_connections 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.667+0000 7f74d779a640 1 -- 172.21.15.82:0/429813589 wait complete. 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.667+0000 7f74d779a640 1 Processor -- start 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d779a640 1 -- start start 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d779a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74d00ffe30 0x7f74d0197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d779a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74d0102ea0 0x7f74d01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d779a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74d0103860 0x7f74d019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d779a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f74d010d810 con 0x7f74d0102ea0 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d779a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f74d010d690 con 0x7f74d00ffe30 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d779a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f74d010d990 con 0x7f74d0103860 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d4d35640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74d0102ea0 0x7f74d01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d4d35640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74d0102ea0 0x7f74d01983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52614/0 (socket says 172.21.15.82:52614) 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d4d35640 1 -- 172.21.15.82:0/1384146137 learned_addr learned my addr 172.21.15.82:0/1384146137 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:33.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d5536640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74d00ffe30 0x7f74d0197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d5d37640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74d0103860 0x7f74d019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d4d35640 1 -- 172.21.15.82:0/1384146137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74d0103860 msgr2=0x7f74d019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d4d35640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74d0103860 0x7f74d019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d4d35640 1 -- 172.21.15.82:0/1384146137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74d00ffe30 msgr2=0x7f74d0197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d4d35640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74d00ffe30 0x7f74d0197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d4d35640 1 -- 172.21.15.82:0/1384146137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d019fab0 con 0x7f74d0102ea0 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d4d35640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74d0102ea0 0x7f74d01983d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009430 tx=0x7f74c0005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74c67fc640 1 -- 172.21.15.82:0/1384146137 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c0043020 con 0x7f74d0102ea0 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74c67fc640 1 -- 172.21.15.82:0/1384146137 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74c0004410 con 0x7f74d0102ea0 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74d779a640 1 -- 172.21.15.82:0/1384146137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d019fd40 con 0x7f74d0102ea0 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.668+0000 7f74c67fc640 1 -- 172.21.15.82:0/1384146137 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c0003e50 con 0x7f74d0102ea0 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.669+0000 7f74d779a640 1 -- 172.21.15.82:0/1384146137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d01a0230 con 0x7f74d0102ea0 2024-03-27T07:21:33.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.669+0000 7f74d779a640 1 -- 172.21.15.82:0/1384146137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74d0108fd0 con 0x7f74d0102ea0 2024-03-27T07:21:33.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.671+0000 7f74c67fc640 1 -- 172.21.15.82:0/1384146137 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f74c0046020 con 0x7f74d0102ea0 2024-03-27T07:21:33.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.671+0000 7f74c67fc640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f74bc0a37b0 0x7f74bc0a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:33.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.671+0000 7f74d5536640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f74bc0a37b0 0x7f74bc0a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:33.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.671+0000 7f74c67fc640 1 -- 172.21.15.82:0/1384146137 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7497+0+0 (secure 0 0 0) 0x7f74c00f1d90 con 0x7f74d0102ea0 2024-03-27T07:21:33.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.672+0000 7f74d5536640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f74bc0a37b0 0x7f74bc0a5c70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f74d0069f00 tx=0x7f74cc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:33.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.675+0000 7f74c67fc640 1 -- 172.21.15.82:0/1384146137 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f74c004d070 con 0x7f74d0102ea0 2024-03-27T07:21:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4024729324' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-27T07:21:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:33.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:21:33.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:33.854+0000 7f74d779a640 1 -- 172.21.15.82:0/1384146137 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f74d002d370 con 0x7f74d0102ea0 2024-03-27T07:21:33.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:33.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4024729324' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-27T07:21:33.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:21:33.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4024729324' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-27T07:21:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:34.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:34.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:21:34.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:21:34.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:21:34.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.541+0000 7f74c67fc640 1 -- 172.21.15.82:0/1384146137 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) ==== 170+0+0 (secure 0 0 0) 0x7f74c00bec90 con 0x7f74d0102ea0 2024-03-27T07:21:34.543 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 -- 172.21.15.82:0/1384146137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f74bc0a37b0 msgr2=0x7f74bc0a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f74bc0a37b0 0x7f74bc0a5c70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f74d0069f00 tx=0x7f74cc00b390 comp rx=0 tx=0).stop 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 -- 172.21.15.82:0/1384146137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74d0102ea0 msgr2=0x7f74d01983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74d0102ea0 0x7f74d01983d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009430 tx=0x7f74c0005dd0 comp rx=0 tx=0).stop 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 -- 172.21.15.82:0/1384146137 shutdown_connections 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f74bc0a37b0 0x7f74bc0a5c70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74d0102ea0 0x7f74d01983d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74d0103860 0x7f74d019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 --2- 172.21.15.82:0/1384146137 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74d00ffe30 0x7f74d0197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 -- 172.21.15.82:0/1384146137 >> 172.21.15.82:0/1384146137 conn(0x7f74d00fb780 msgr2=0x7f74d01061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 -- 172.21.15.82:0/1384146137 shutdown_connections 2024-03-27T07:21:34.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.544+0000 7f74d779a640 1 -- 172.21.15.82:0/1384146137 wait complete. 2024-03-27T07:21:34.567 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-27T07:21:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 -- 172.21.15.82:0/1007551275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7658102630 msgr2=0x7f7658104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 --2- 172.21.15.82:0/1007551275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7658102630 0x7f7658104a20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7648009900 tx=0x7f764802bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 -- 172.21.15.82:0/1007551275 shutdown_connections 2024-03-27T07:21:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 --2- 172.21.15.82:0/1007551275 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7658107890 0x7f7658109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 --2- 172.21.15.82:0/1007551275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7658104f60 0x7f7658107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 --2- 172.21.15.82:0/1007551275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7658102630 0x7f7658104a20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 -- 172.21.15.82:0/1007551275 >> 172.21.15.82:0/1007551275 conn(0x7f76580fbfe0 msgr2=0x7f76580fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 -- 172.21.15.82:0/1007551275 shutdown_connections 2024-03-27T07:21:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 -- 172.21.15.82:0/1007551275 wait complete. 2024-03-27T07:21:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 Processor -- start 2024-03-27T07:21:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.672+0000 7f765e84e640 1 -- start start 2024-03-27T07:21:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f765e84e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7658102630 0x7f7658197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f765e84e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7658104f60 0x7f7658198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f765e84e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7658107890 0x7f765819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f765e84e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f765810d840 con 0x7f7658102630 2024-03-27T07:21:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f765e84e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f765810d6c0 con 0x7f7658107890 2024-03-27T07:21:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f765e84e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f765810d9c0 con 0x7f7658104f60 2024-03-27T07:21:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7657fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7658102630 0x7f7658197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7657fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7658102630 0x7f7658197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52634/0 (socket says 172.21.15.82:52634) 2024-03-27T07:21:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7657fff640 1 -- 172.21.15.82:0/2158621420 learned_addr learned my addr 172.21.15.82:0/2158621420 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f764ffff640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7658104f60 0x7f7658198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f765cdeb640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7658107890 0x7f765819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7657fff640 1 -- 172.21.15.82:0/2158621420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7658104f60 msgr2=0x7f7658198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7657fff640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7658104f60 0x7f7658198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7657fff640 1 -- 172.21.15.82:0/2158621420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7658107890 msgr2=0x7f765819f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:34.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7657fff640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7658107890 0x7f765819f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7657fff640 1 -- 172.21.15.82:0/2158621420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f765819fae0 con 0x7f7658102630 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f765cdeb640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7658107890 0x7f765819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7657fff640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7658102630 0x7f7658197ec0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7648009230 tx=0x7f7648004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7655ffb640 1 -- 172.21.15.82:0/2158621420 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648041070 con 0x7f7658102630 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7655ffb640 1 -- 172.21.15.82:0/2158621420 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76480054e0 con 0x7f7658102630 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f765e84e640 1 -- 172.21.15.82:0/2158621420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f765819fd70 con 0x7f7658102630 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f7655ffb640 1 -- 172.21.15.82:0/2158621420 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76480346a0 con 0x7f7658102630 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.673+0000 7f765e84e640 1 -- 172.21.15.82:0/2158621420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76581a01b0 con 0x7f7658102630 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.674+0000 7f765e84e640 1 -- 172.21.15.82:0/2158621420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76580fdad0 con 0x7f7658102630 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.675+0000 7f7655ffb640 1 -- 172.21.15.82:0/2158621420 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f7648044070 con 0x7f7658102630 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.676+0000 7f7655ffb640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76440a3610 0x7f76440a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.676+0000 7f764ffff640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76440a3610 0x7f76440a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.676+0000 7f7655ffb640 1 -- 172.21.15.82:0/2158621420 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7879+0+0 (secure 0 0 0) 0x7f76480f1cf0 con 0x7f7658102630 2024-03-27T07:21:34.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.676+0000 7f764ffff640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76440a3610 0x7f76440a5ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76581993d0 tx=0x7f7640008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:34.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.680+0000 7f7655ffb640 1 -- 172.21.15.82:0/2158621420 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f76480bea70 con 0x7f7658102630 2024-03-27T07:21:34.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:34.900+0000 7f765e84e640 1 -- 172.21.15.82:0/2158621420 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f765802d370 con 0x7f7658102630 2024-03-27T07:21:34.914 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:34 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4024729324' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-27T07:21:34.914 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:34 smithi082 ceph-mon[32178]: osdmap e83: 12 total, 12 up, 12 in 2024-03-27T07:21:34.914 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:34 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1384146137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-27T07:21:35.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:34 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4024729324' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-27T07:21:35.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:34 smithi149 ceph-mon[36065]: osdmap e83: 12 total, 12 up, 12 in 2024-03-27T07:21:35.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:34 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1384146137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-27T07:21:35.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:34 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4024729324' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-27T07:21:35.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:34 smithi153 ceph-mon[36179]: osdmap e83: 12 total, 12 up, 12 in 2024-03-27T07:21:35.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:34 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1384146137' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-27T07:21:35.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.542+0000 7f7655ffb640 1 -- 172.21.15.82:0/2158621420 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f76480be370 con 0x7f7658102630 2024-03-27T07:21:35.544 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 2 and data pool 3 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 -- 172.21.15.82:0/2158621420 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76440a3610 msgr2=0x7f76440a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76440a3610 0x7f76440a5ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76581993d0 tx=0x7f7640008040 comp rx=0 tx=0).stop 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 -- 172.21.15.82:0/2158621420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7658102630 msgr2=0x7f7658197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7658102630 0x7f7658197ec0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7648009230 tx=0x7f7648004040 comp rx=0 tx=0).stop 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 -- 172.21.15.82:0/2158621420 shutdown_connections 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76440a3610 0x7f76440a5ad0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7658107890 0x7f765819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7658104f60 0x7f7658198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 --2- 172.21.15.82:0/2158621420 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7658102630 0x7f7658197ec0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 -- 172.21.15.82:0/2158621420 >> 172.21.15.82:0/2158621420 conn(0x7f76580fbfe0 msgr2=0x7f7658102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 -- 172.21.15.82:0/2158621420 shutdown_connections 2024-03-27T07:21:35.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.545+0000 7f765e84e640 1 -- 172.21.15.82:0/2158621420 wait complete. 2024-03-27T07:21:35.566 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:21:35.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 -- 172.21.15.82:0/3637124977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a4100a70 msgr2=0x7f10a4100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:35.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 --2- 172.21.15.82:0/3637124977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a4100a70 0x7f10a4100e90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1094009900 tx=0x7f109402bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 -- 172.21.15.82:0/3637124977 shutdown_connections 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 --2- 172.21.15.82:0/3637124977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10a4102620 0x7f10a4108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 --2- 172.21.15.82:0/3637124977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10a4101c60 0x7f10a41020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 --2- 172.21.15.82:0/3637124977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a4100a70 0x7f10a4100e90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 -- 172.21.15.82:0/3637124977 >> 172.21.15.82:0/3637124977 conn(0x7f10a40fbfe0 msgr2=0x7f10a40fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 -- 172.21.15.82:0/3637124977 shutdown_connections 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 -- 172.21.15.82:0/3637124977 wait complete. 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 Processor -- start 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.676+0000 7f10a8e84640 1 -- start start 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a8e84640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a4100a70 0x7f10a4197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a8e84640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10a4101c60 0x7f10a41983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a8e84640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10a4102620 0x7f10a419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a8e84640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10a410c6f0 con 0x7f10a4100a70 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a8e84640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10a410c570 con 0x7f10a4102620 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a8e84640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10a410c870 con 0x7f10a4101c60 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a4100a70 0x7f10a4197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a4100a70 0x7f10a4197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52646/0 (socket says 172.21.15.82:52646) 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a259c640 1 -- 172.21.15.82:0/1285219949 learned_addr learned my addr 172.21.15.82:0/1285219949 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f109bfff640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10a4101c60 0x7f10a41983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a259c640 1 -- 172.21.15.82:0/1285219949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10a4101c60 msgr2=0x7f10a41983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a259c640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10a4101c60 0x7f10a41983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a2d9d640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10a4102620 0x7f10a419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a259c640 1 -- 172.21.15.82:0/1285219949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10a4102620 msgr2=0x7f10a419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a259c640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10a4102620 0x7f10a419f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a259c640 1 -- 172.21.15.82:0/1285219949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a419fab0 con 0x7f10a4100a70 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f109bfff640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10a4101c60 0x7f10a41983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a259c640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a4100a70 0x7f10a4197e90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1094000c00 tx=0x7f1094005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f109b7fe640 1 -- 172.21.15.82:0/1285219949 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094041070 con 0x7f10a4100a70 2024-03-27T07:21:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f109b7fe640 1 -- 172.21.15.82:0/1285219949 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10940044d0 con 0x7f10a4100a70 2024-03-27T07:21:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a8e84640 1 -- 172.21.15.82:0/1285219949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a419fd40 con 0x7f10a4100a70 2024-03-27T07:21:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f109b7fe640 1 -- 172.21.15.82:0/1285219949 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094034440 con 0x7f10a4100a70 2024-03-27T07:21:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.677+0000 7f10a8e84640 1 -- 172.21.15.82:0/1285219949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a41a0180 con 0x7f10a4100a70 2024-03-27T07:21:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.678+0000 7f10a8e84640 1 -- 172.21.15.82:0/1285219949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a41a03b0 con 0x7f10a4100a70 2024-03-27T07:21:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.679+0000 7f109b7fe640 1 -- 172.21.15.82:0/1285219949 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f1094044070 con 0x7f10a4100a70 2024-03-27T07:21:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.680+0000 7f109b7fe640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10900a3610 0x7f10900a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.680+0000 7f109bfff640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10900a3610 0x7f10900a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.680+0000 7f109b7fe640 1 -- 172.21.15.82:0/1285219949 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f10940f1810 con 0x7f10a4100a70 2024-03-27T07:21:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.681+0000 7f109bfff640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10900a3610 0x7f10900a5ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f108c005d00 tx=0x7f108c005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:35.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.685+0000 7f109b7fe640 1 -- 172.21.15.82:0/1285219949 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f10940be530 con 0x7f10a4100a70 2024-03-27T07:21:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.870+0000 7f10a8e84640 1 -- 172.21.15.82:0/1285219949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10a41a0750 con 0x7f10a4100a70 2024-03-27T07:21:35.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.871+0000 7f109b7fe640 1 -- 172.21.15.82:0/1285219949 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22185 (secure 0 0 0) 0x7f10940bde30 con 0x7f10a4100a70 2024-03-27T07:21:35.875 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:35.875 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":85,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:21:34.901706+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 -- 172.21.15.82:0/1285219949 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10900a3610 msgr2=0x7f10900a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10900a3610 0x7f10900a5ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f108c005d00 tx=0x7f108c005ed0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 -- 172.21.15.82:0/1285219949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a4100a70 msgr2=0x7f10a4197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a4100a70 0x7f10a4197e90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1094000c00 tx=0x7f1094005d50 comp rx=0 tx=0).stop 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 -- 172.21.15.82:0/1285219949 shutdown_connections 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10900a3610 0x7f10900a5ad0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10a4102620 0x7f10a419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10a4101c60 0x7f10a41983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 --2- 172.21.15.82:0/1285219949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a4100a70 0x7f10a4197e90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 -- 172.21.15.82:0/1285219949 >> 172.21.15.82:0/1285219949 conn(0x7f10a40fbfe0 msgr2=0x7f10a4068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:35.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.873+0000 7f10a8e84640 1 -- 172.21.15.82:0/1285219949 shutdown_connections 2024-03-27T07:21:35.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.874+0000 7f10a8e84640 1 -- 172.21.15.82:0/1285219949 wait complete. 2024-03-27T07:21:35.885 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:35 smithi082 ceph-mon[32178]: pgmap v287: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:35.885 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:35 smithi082 ceph-mon[32178]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-27T07:21:35.886 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:35 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1384146137' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-27T07:21:35.886 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:35 smithi082 ceph-mon[32178]: osdmap e84: 12 total, 12 up, 12 in 2024-03-27T07:21:35.886 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:35 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2158621420' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-27T07:21:35.886 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:35 smithi082 ceph-mon[32178]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-27T07:21:35.889 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:21:35.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 -- 172.21.15.82:0/3725117718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c81025f0 msgr2=0x7f97c81049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:35.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 --2- 172.21.15.82:0/3725117718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c81025f0 0x7f97c81049e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009900 tx=0x7f97bc02bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:35.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 -- 172.21.15.82:0/3725117718 shutdown_connections 2024-03-27T07:21:35.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 --2- 172.21.15.82:0/3725117718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97c8107850 0x7f97c8109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 --2- 172.21.15.82:0/3725117718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c8104f20 0x7f97c8107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 --2- 172.21.15.82:0/3725117718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c81025f0 0x7f97c81049e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 -- 172.21.15.82:0/3725117718 >> 172.21.15.82:0/3725117718 conn(0x7f97c80fbfe0 msgr2=0x7f97c80fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:35.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 -- 172.21.15.82:0/3725117718 shutdown_connections 2024-03-27T07:21:35.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 -- 172.21.15.82:0/3725117718 wait complete. 2024-03-27T07:21:35.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 Processor -- start 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.989+0000 7f97ceec0640 1 -- start start 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97ceec0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97c81025f0 0x7f97c8197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97ceec0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8104f20 0x7f97c81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97ceec0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c8107850 0x7f97c819f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97ceec0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97c810d810 con 0x7f97c8104f20 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97ceec0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f97c810d690 con 0x7f97c8107850 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97ceec0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97c810d990 con 0x7f97c81025f0 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8104f20 0x7f97c81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8104f20 0x7f97c81983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52662/0 (socket says 172.21.15.82:52662) 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c7fff640 1 -- 172.21.15.82:0/2174555445 learned_addr learned my addr 172.21.15.82:0/2174555445 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97ccc5c640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97c81025f0 0x7f97c8197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:35.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97cd45d640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c8107850 0x7f97c819f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c7fff640 1 -- 172.21.15.82:0/2174555445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97c81025f0 msgr2=0x7f97c8197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c7fff640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97c81025f0 0x7f97c8197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c7fff640 1 -- 172.21.15.82:0/2174555445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c8107850 msgr2=0x7f97c819f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c7fff640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c8107850 0x7f97c819f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c7fff640 1 -- 172.21.15.82:0/2174555445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c819fab0 con 0x7f97c8104f20 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97cd45d640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c8107850 0x7f97c819f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97ccc5c640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97c81025f0 0x7f97c8197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c7fff640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8104f20 0x7f97c81983d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f97b400e9c0 tx=0x7f97b400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c5ffb640 1 -- 172.21.15.82:0/2174555445 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b400cd80 con 0x7f97c8104f20 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97ceec0640 1 -- 172.21.15.82:0/2174555445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c819fda0 con 0x7f97c8104f20 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c5ffb640 1 -- 172.21.15.82:0/2174555445 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97b4005500 con 0x7f97c8104f20 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.990+0000 7f97c5ffb640 1 -- 172.21.15.82:0/2174555445 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b4010690 con 0x7f97c8104f20 2024-03-27T07:21:35.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.991+0000 7f97ceec0640 1 -- 172.21.15.82:0/2174555445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c81a0270 con 0x7f97c8104f20 2024-03-27T07:21:35.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.992+0000 7f97ceec0640 1 -- 172.21.15.82:0/2174555445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c80fdad0 con 0x7f97c8104f20 2024-03-27T07:21:35.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.994+0000 7f97c5ffb640 1 -- 172.21.15.82:0/2174555445 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f97b40046c0 con 0x7f97c8104f20 2024-03-27T07:21:35.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.994+0000 7f97c5ffb640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97b80a3610 0x7f97b80a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:35.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.994+0000 7f97ccc5c640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97b80a3610 0x7f97b80a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:35.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.994+0000 7f97c5ffb640 1 -- 172.21.15.82:0/2174555445 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f97b40d0280 con 0x7f97c8104f20 2024-03-27T07:21:35.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.995+0000 7f97ccc5c640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97b80a3610 0x7f97b80a5ad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f97bc006010 tx=0x7f97bc02c8a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:35.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:35.997+0000 7f97c5ffb640 1 -- 172.21.15.82:0/2174555445 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f97b4053cb0 con 0x7f97c8104f20 2024-03-27T07:21:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:35 smithi149 ceph-mon[36065]: pgmap v287: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:35 smithi149 ceph-mon[36065]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-27T07:21:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:35 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1384146137' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-27T07:21:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:35 smithi149 ceph-mon[36065]: osdmap e84: 12 total, 12 up, 12 in 2024-03-27T07:21:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:35 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2158621420' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-27T07:21:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:35 smithi149 ceph-mon[36065]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-27T07:21:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:35 smithi153 ceph-mon[36179]: pgmap v287: 33 pgs: 4 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:21:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:35 smithi153 ceph-mon[36179]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-27T07:21:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:35 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1384146137' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-27T07:21:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:35 smithi153 ceph-mon[36179]: osdmap e84: 12 total, 12 up, 12 in 2024-03-27T07:21:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:35 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2158621420' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-27T07:21:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:35 smithi153 ceph-mon[36179]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-27T07:21:36.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.175+0000 7f97ceec0640 1 -- 172.21.15.82:0/2174555445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97c802d570 con 0x7f97c8104f20 2024-03-27T07:21:36.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.176+0000 7f97c5ffb640 1 -- 172.21.15.82:0/2174555445 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22185 (secure 0 0 0) 0x7f97b409cfa0 con 0x7f97c8104f20 2024-03-27T07:21:36.179 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:36.179 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":85,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:21:34.901706+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:21:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.178+0000 7f97ceec0640 1 -- 172.21.15.82:0/2174555445 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97b80a3610 msgr2=0x7f97b80a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.178+0000 7f97ceec0640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97b80a3610 0x7f97b80a5ad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f97bc006010 tx=0x7f97bc02c8a0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.178+0000 7f97ceec0640 1 -- 172.21.15.82:0/2174555445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8104f20 msgr2=0x7f97c81983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.178+0000 7f97ceec0640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8104f20 0x7f97c81983d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f97b400e9c0 tx=0x7f97b400ee80 comp rx=0 tx=0).stop 2024-03-27T07:21:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.178+0000 7f97ceec0640 1 -- 172.21.15.82:0/2174555445 shutdown_connections 2024-03-27T07:21:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.178+0000 7f97ceec0640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f97b80a3610 0x7f97b80a5ad0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.178+0000 7f97ceec0640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f97c8104f20 0x7f97c81983d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.178+0000 7f97ceec0640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f97c8107850 0x7f97c819f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.178+0000 7f97ceec0640 1 --2- 172.21.15.82:0/2174555445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97c81025f0 0x7f97c8197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.178+0000 7f97ceec0640 1 -- 172.21.15.82:0/2174555445 >> 172.21.15.82:0/2174555445 conn(0x7f97c80fbfe0 msgr2=0x7f97c8103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.179+0000 7f97ceec0640 1 -- 172.21.15.82:0/2174555445 shutdown_connections 2024-03-27T07:21:36.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.179+0000 7f97ceec0640 1 -- 172.21.15.82:0/2174555445 wait complete. 2024-03-27T07:21:36.192 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-27T07:21:36.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.294+0000 7f8e36f0d640 1 -- 172.21.15.82:0/2244883021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e30102600 msgr2=0x7f8e30108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:36.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.294+0000 7f8e36f0d640 1 --2- 172.21.15.82:0/2244883021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e30102600 0x7f8e30108e90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009900 tx=0x7f8e1802bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:36.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.294+0000 7f8e36f0d640 1 -- 172.21.15.82:0/2244883021 shutdown_connections 2024-03-27T07:21:36.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.294+0000 7f8e36f0d640 1 --2- 172.21.15.82:0/2244883021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e30102600 0x7f8e30108e90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.294+0000 7f8e36f0d640 1 --2- 172.21.15.82:0/2244883021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e30101c40 0x7f8e301020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.294+0000 7f8e36f0d640 1 --2- 172.21.15.82:0/2244883021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e30100a50 0x7f8e30100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 -- 172.21.15.82:0/2244883021 >> 172.21.15.82:0/2244883021 conn(0x7f8e300fbfc0 msgr2=0x7f8e300fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 -- 172.21.15.82:0/2244883021 shutdown_connections 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 -- 172.21.15.82:0/2244883021 wait complete. 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 Processor -- start 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 -- start start 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e30100a50 0x7f8e30197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e30101c40 0x7f8e30198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e30102600 0x7f8e3019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3010d870 con 0x7f8e30102600 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3010d6f0 con 0x7f8e30100a50 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e36f0d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3010d9f0 con 0x7f8e30101c40 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e354aa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e30102600 0x7f8e3019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e354aa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e30102600 0x7f8e3019f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52680/0 (socket says 172.21.15.82:52680) 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e354aa640 1 -- 172.21.15.82:0/3853423257 learned_addr learned my addr 172.21.15.82:0/3853423257 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.295+0000 7f8e34ca9640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e30100a50 0x7f8e30197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:36.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e354aa640 1 -- 172.21.15.82:0/3853423257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e30101c40 msgr2=0x7f8e30198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e2ffff640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e30101c40 0x7f8e30198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e354aa640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e30101c40 0x7f8e30198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e354aa640 1 -- 172.21.15.82:0/3853423257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e30100a50 msgr2=0x7f8e30197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e354aa640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e30100a50 0x7f8e30197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e354aa640 1 -- 172.21.15.82:0/3853423257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3019fa20 con 0x7f8e30102600 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e34ca9640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e30100a50 0x7f8e30197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e2ffff640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e30101c40 0x7f8e30198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e354aa640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e30102600 0x7f8e3019f3b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e18005ab0 tx=0x7f8e18005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e2dffb640 1 -- 172.21.15.82:0/3853423257 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18043020 con 0x7f8e30102600 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e2dffb640 1 -- 172.21.15.82:0/3853423257 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e180054e0 con 0x7f8e30102600 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e36f0d640 1 -- 172.21.15.82:0/3853423257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3019fcb0 con 0x7f8e30102600 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e2dffb640 1 -- 172.21.15.82:0/3853423257 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18003e20 con 0x7f8e30102600 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.296+0000 7f8e36f0d640 1 -- 172.21.15.82:0/3853423257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e301a01b0 con 0x7f8e30102600 2024-03-27T07:21:36.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.297+0000 7f8e36f0d640 1 -- 172.21.15.82:0/3853423257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e30107d10 con 0x7f8e30102600 2024-03-27T07:21:36.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.298+0000 7f8e2dffb640 1 -- 172.21.15.82:0/3853423257 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f8e18046020 con 0x7f8e30102600 2024-03-27T07:21:36.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.299+0000 7f8e2dffb640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e1c0a3610 0x7f8e1c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:36.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.299+0000 7f8e34ca9640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e1c0a3610 0x7f8e1c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:36.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.299+0000 7f8e2dffb640 1 -- 172.21.15.82:0/3853423257 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7979+0+0 (secure 0 0 0) 0x7f8e180f1f90 con 0x7f8e30102600 2024-03-27T07:21:36.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.299+0000 7f8e34ca9640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e1c0a3610 0x7f8e1c0a5ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8e280058c0 tx=0x7f8e28005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:36.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.303+0000 7f8e2dffb640 1 -- 172.21.15.82:0/3853423257 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8e1804d020 con 0x7f8e30102600 2024-03-27T07:21:36.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.520+0000 7f8e36f0d640 1 -- 172.21.15.82:0/3853423257 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8e3002d570 con 0x7f8e30102600 2024-03-27T07:21:36.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.559+0000 7f8e2dffb640 1 -- 172.21.15.82:0/3853423257 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f8e180becb0 con 0x7f8e30102600 2024-03-27T07:21:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 -- 172.21.15.82:0/3853423257 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e1c0a3610 msgr2=0x7f8e1c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e1c0a3610 0x7f8e1c0a5ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8e280058c0 tx=0x7f8e28005850 comp rx=0 tx=0).stop 2024-03-27T07:21:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 -- 172.21.15.82:0/3853423257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e30102600 msgr2=0x7f8e3019f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e30102600 0x7f8e3019f3b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e18005ab0 tx=0x7f8e18005dc0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 -- 172.21.15.82:0/3853423257 shutdown_connections 2024-03-27T07:21:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e1c0a3610 0x7f8e1c0a5ad0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e30102600 0x7f8e3019f3b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e30101c40 0x7f8e30198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 --2- 172.21.15.82:0/3853423257 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e30100a50 0x7f8e30197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 -- 172.21.15.82:0/3853423257 >> 172.21.15.82:0/3853423257 conn(0x7f8e300fbfc0 msgr2=0x7f8e30104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:36.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 -- 172.21.15.82:0/3853423257 shutdown_connections 2024-03-27T07:21:36.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.562+0000 7f8e36f0d640 1 -- 172.21.15.82:0/3853423257 wait complete. 2024-03-27T07:21:36.575 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-03-27T07:21:36.575 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.677+0000 7fda3ed08640 1 -- 172.21.15.82:0/3172392203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda38102ec0 msgr2=0x7fda38103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.677+0000 7fda3ed08640 1 --2- 172.21.15.82:0/3172392203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda38102ec0 0x7fda38103340 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fda24009930 tx=0x7fda2402bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 -- 172.21.15.82:0/3172392203 shutdown_connections 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 --2- 172.21.15.82:0/3172392203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda38102ec0 0x7fda38103340 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 --2- 172.21.15.82:0/3172392203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda38103880 0x7fda3810a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 --2- 172.21.15.82:0/3172392203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda380ffe50 0x7fda38100270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 -- 172.21.15.82:0/3172392203 >> 172.21.15.82:0/3172392203 conn(0x7fda380fb760 msgr2=0x7fda380fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 -- 172.21.15.82:0/3172392203 shutdown_connections 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 -- 172.21.15.82:0/3172392203 wait complete. 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 Processor -- start 2024-03-27T07:21:36.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 -- start start 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda380ffe50 0x7fda38197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda38102ec0 0x7fda381983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda38103880 0x7fda3819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda3810d800 con 0x7fda380ffe50 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fda3810d680 con 0x7fda38102ec0 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3ed08640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fda3810d980 con 0x7fda38103880 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3caa4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda380ffe50 0x7fda38197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3caa4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda380ffe50 0x7fda38197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52694/0 (socket says 172.21.15.82:52694) 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda3caa4640 1 -- 172.21.15.82:0/3267340998 learned_addr learned my addr 172.21.15.82:0/3267340998 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.678+0000 7fda37fff640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda38102ec0 0x7fda381983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda3d2a5640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda38103880 0x7fda3819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda3caa4640 1 -- 172.21.15.82:0/3267340998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda38103880 msgr2=0x7fda3819f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:36.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda3caa4640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda38103880 0x7fda3819f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda3caa4640 1 -- 172.21.15.82:0/3267340998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda38102ec0 msgr2=0x7fda381983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda3caa4640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda38102ec0 0x7fda381983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda3caa4640 1 -- 172.21.15.82:0/3267340998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3819fac0 con 0x7fda380ffe50 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda3d2a5640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda38103880 0x7fda3819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda3caa4640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda380ffe50 0x7fda38197ea0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00e9c0 tx=0x7fda2c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda35ffb640 1 -- 172.21.15.82:0/3267340998 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c00cd80 con 0x7fda380ffe50 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda35ffb640 1 -- 172.21.15.82:0/3267340998 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda2c0035f0 con 0x7fda380ffe50 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda3ed08640 1 -- 172.21.15.82:0/3267340998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3819fdb0 con 0x7fda380ffe50 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda35ffb640 1 -- 172.21.15.82:0/3267340998 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2c010690 con 0x7fda380ffe50 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.679+0000 7fda3ed08640 1 -- 172.21.15.82:0/3267340998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda381a0210 con 0x7fda380ffe50 2024-03-27T07:21:36.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.680+0000 7fda3ed08640 1 -- 172.21.15.82:0/3267340998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda38109070 con 0x7fda380ffe50 2024-03-27T07:21:36.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.681+0000 7fda35ffb640 1 -- 172.21.15.82:0/3267340998 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fda2c0037a0 con 0x7fda380ffe50 2024-03-27T07:21:36.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.682+0000 7fda35ffb640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fda280a3610 0x7fda280a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:36.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.682+0000 7fda37fff640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fda280a3610 0x7fda280a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:36.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.682+0000 7fda35ffb640 1 -- 172.21.15.82:0/3267340998 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fda2c0d0050 con 0x7fda380ffe50 2024-03-27T07:21:36.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.682+0000 7fda37fff640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fda280a3610 0x7fda280a5ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda24005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:36.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.686+0000 7fda35ffb640 1 -- 172.21.15.82:0/3267340998 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fda2c09cd70 con 0x7fda380ffe50 2024-03-27T07:21:36.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:36.905+0000 7fda3ed08640 1 -- 172.21.15.82:0/3267340998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fda38062780 con 0x7fda380ffe50 2024-03-27T07:21:36.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:36 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2158621420' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-27T07:21:36.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:36 smithi082 ceph-mon[32178]: osdmap e85: 12 total, 12 up, 12 in 2024-03-27T07:21:36.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:36 smithi082 ceph-mon[32178]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-27T07:21:36.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:36 smithi082 ceph-mon[32178]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-27T07:21:36.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:36 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1285219949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:36.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:36 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2174555445' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:36.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:36 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3853423257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-27T07:21:37.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:36 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2158621420' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-27T07:21:37.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:36 smithi149 ceph-mon[36065]: osdmap e85: 12 total, 12 up, 12 in 2024-03-27T07:21:37.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:36 smithi149 ceph-mon[36065]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-27T07:21:37.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:36 smithi149 ceph-mon[36065]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-27T07:21:37.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:36 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1285219949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:37.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:36 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2174555445' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:37.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:36 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3853423257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-27T07:21:37.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:36 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2158621420' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-27T07:21:37.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:36 smithi153 ceph-mon[36179]: osdmap e85: 12 total, 12 up, 12 in 2024-03-27T07:21:37.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:36 smithi153 ceph-mon[36179]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-27T07:21:37.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:36 smithi153 ceph-mon[36179]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-27T07:21:37.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:36 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1285219949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:37.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:36 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2174555445' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:37.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:36 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3853423257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-27T07:21:37.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.561+0000 7fda35ffb640 1 -- 172.21.15.82:0/3267340998 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v16) ==== 105+0+0 (secure 0 0 0) 0x7fda2c09c670 con 0x7fda380ffe50 2024-03-27T07:21:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 -- 172.21.15.82:0/3267340998 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fda280a3610 msgr2=0x7fda280a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fda280a3610 0x7fda280a5ad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda24005fd0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 -- 172.21.15.82:0/3267340998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda380ffe50 msgr2=0x7fda38197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda380ffe50 0x7fda38197ea0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00e9c0 tx=0x7fda2c00ee80 comp rx=0 tx=0).stop 2024-03-27T07:21:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 -- 172.21.15.82:0/3267340998 shutdown_connections 2024-03-27T07:21:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fda280a3610 0x7fda280a5ad0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda38103880 0x7fda3819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fda38102ec0 0x7fda381983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 --2- 172.21.15.82:0/3267340998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda380ffe50 0x7fda38197ea0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 -- 172.21.15.82:0/3267340998 >> 172.21.15.82:0/3267340998 conn(0x7fda380fb760 msgr2=0x7fda38106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:37.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 -- 172.21.15.82:0/3267340998 shutdown_connections 2024-03-27T07:21:37.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.565+0000 7fda3ed08640 1 -- 172.21.15.82:0/3267340998 wait complete. 2024-03-27T07:21:37.585 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-03-27T07:21:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 -- 172.21.15.82:0/70988992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1028102d40 msgr2=0x7f10281031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 --2- 172.21.15.82:0/70988992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1028102d40 0x7f10281031c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1018009ca0 tx=0x7f101802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 -- 172.21.15.82:0/70988992 shutdown_connections 2024-03-27T07:21:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 --2- 172.21.15.82:0/70988992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1028102d40 0x7f10281031c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 --2- 172.21.15.82:0/70988992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1028103700 0x7f1028109f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 --2- 172.21.15.82:0/70988992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1028101b50 0x7f1028101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 -- 172.21.15.82:0/70988992 >> 172.21.15.82:0/70988992 conn(0x7f10280fd0c0 msgr2=0x7f10280ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 -- 172.21.15.82:0/70988992 shutdown_connections 2024-03-27T07:21:37.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 -- 172.21.15.82:0/70988992 wait complete. 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 Processor -- start 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 -- start start 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1028101b50 0x7f1028197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.696+0000 7f102f1c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1028102d40 0x7f10281983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102f1c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1028103700 0x7f102819f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102f1c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f102810d7d0 con 0x7f1028103700 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102f1c9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f102810d650 con 0x7f1028101b50 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102f1c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f102810d950 con 0x7f1028102d40 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102d766640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1028103700 0x7f102819f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102d766640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1028103700 0x7f102819f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34858/0 (socket says 172.21.15.82:34858) 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102d766640 1 -- 172.21.15.82:0/1275575501 learned_addr learned my addr 172.21.15.82:0/1275575501 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:37.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102cf65640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1028101b50 0x7f1028197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f1027fff640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1028102d40 0x7f10281983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102d766640 1 -- 172.21.15.82:0/1275575501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1028102d40 msgr2=0x7f10281983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102d766640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1028102d40 0x7f10281983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102d766640 1 -- 172.21.15.82:0/1275575501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1028101b50 msgr2=0x7f1028197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102d766640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1028101b50 0x7f1028197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102d766640 1 -- 172.21.15.82:0/1275575501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f102819faa0 con 0x7f1028103700 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f1027fff640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1028102d40 0x7f10281983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102d766640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1028103700 0x7f102819f430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f101000c970 tx=0x7f101000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f1025ffb640 1 -- 172.21.15.82:0/1275575501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1010007bb0 con 0x7f1028103700 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f1025ffb640 1 -- 172.21.15.82:0/1275575501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1010007d50 con 0x7f1028103700 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102f1c9640 1 -- 172.21.15.82:0/1275575501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f102819fd90 con 0x7f1028103700 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f1025ffb640 1 -- 172.21.15.82:0/1275575501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101000f450 con 0x7f1028103700 2024-03-27T07:21:37.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.697+0000 7f102f1c9640 1 -- 172.21.15.82:0/1275575501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10281a02b0 con 0x7f1028103700 2024-03-27T07:21:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.699+0000 7f102f1c9640 1 -- 172.21.15.82:0/1275575501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1028108ef0 con 0x7f1028103700 2024-03-27T07:21:37.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.699+0000 7f1025ffb640 1 -- 172.21.15.82:0/1275575501 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f1010004f20 con 0x7f1028103700 2024-03-27T07:21:37.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.700+0000 7f1025ffb640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10140a3690 0x7f10140a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:37.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.700+0000 7f102cf65640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10140a3690 0x7f10140a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:37.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.700+0000 7f1025ffb640 1 -- 172.21.15.82:0/1275575501 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f10100cf7f0 con 0x7f1028103700 2024-03-27T07:21:37.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.700+0000 7f102cf65640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10140a3690 0x7f10140a5b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1028102ba0 tx=0x7f1020005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:37.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.704+0000 7f1025ffb640 1 -- 172.21.15.82:0/1275575501 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1010014030 con 0x7f1028103700 2024-03-27T07:21:37.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:37.920+0000 7f102f1c9640 1 -- 172.21.15.82:0/1275575501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f102802d370 con 0x7f1028103700 2024-03-27T07:21:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:37 smithi082 ceph-mon[32178]: pgmap v290: 97 pgs: 11 active+clean, 22 creating+peering, 64 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-03-27T07:21:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:37 smithi082 ceph-mon[32178]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-27T07:21:37.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:37 smithi082 ceph-mon[32178]: Cluster is now healthy 2024-03-27T07:21:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:37 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3853423257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-27T07:21:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:37 smithi082 ceph-mon[32178]: osdmap e86: 12 total, 12 up, 12 in 2024-03-27T07:21:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:37 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] up:active 2024-03-27T07:21:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:37 smithi082 ceph-mon[32178]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T07:21:37.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:37 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3267340998' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-27T07:21:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:37 smithi149 ceph-mon[36065]: pgmap v290: 97 pgs: 11 active+clean, 22 creating+peering, 64 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-03-27T07:21:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:37 smithi149 ceph-mon[36065]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-27T07:21:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:37 smithi149 ceph-mon[36065]: Cluster is now healthy 2024-03-27T07:21:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:37 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3853423257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-27T07:21:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:37 smithi149 ceph-mon[36065]: osdmap e86: 12 total, 12 up, 12 in 2024-03-27T07:21:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:37 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] up:active 2024-03-27T07:21:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:37 smithi149 ceph-mon[36065]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T07:21:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:37 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3267340998' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-27T07:21:38.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:37 smithi153 ceph-mon[36179]: pgmap v290: 97 pgs: 11 active+clean, 22 creating+peering, 64 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 3 op/s 2024-03-27T07:21:38.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:37 smithi153 ceph-mon[36179]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-27T07:21:38.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:37 smithi153 ceph-mon[36179]: Cluster is now healthy 2024-03-27T07:21:38.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:37 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3853423257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-27T07:21:38.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:37 smithi153 ceph-mon[36179]: osdmap e86: 12 total, 12 up, 12 in 2024-03-27T07:21:38.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:37 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] up:active 2024-03-27T07:21:38.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:37 smithi153 ceph-mon[36179]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T07:21:38.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:37 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3267340998' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-27T07:21:38.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.578+0000 7f1025ffb640 1 -- 172.21.15.82:0/1275575501 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f101009c510 con 0x7f1028103700 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.580+0000 7f102f1c9640 1 -- 172.21.15.82:0/1275575501 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10140a3690 msgr2=0x7f10140a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10140a3690 0x7f10140a5b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1028102ba0 tx=0x7f1020005f90 comp rx=0 tx=0).stop 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 -- 172.21.15.82:0/1275575501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1028103700 msgr2=0x7f102819f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1028103700 0x7f102819f430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f101000c970 tx=0x7f101000ce30 comp rx=0 tx=0).stop 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 -- 172.21.15.82:0/1275575501 shutdown_connections 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10140a3690 0x7f10140a5b50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1028103700 0x7f102819f430 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1028102d40 0x7f10281983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 --2- 172.21.15.82:0/1275575501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1028101b50 0x7f1028197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 -- 172.21.15.82:0/1275575501 >> 172.21.15.82:0/1275575501 conn(0x7f10280fd0c0 msgr2=0x7f10281060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 -- 172.21.15.82:0/1275575501 shutdown_connections 2024-03-27T07:21:38.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.581+0000 7f102f1c9640 1 -- 172.21.15.82:0/1275575501 wait complete. 2024-03-27T07:21:38.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-27T07:21:38.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.707+0000 7f10b6440640 1 -- 172.21.15.82:0/3816675106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b0100a70 msgr2=0x7f10b0100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:38.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.707+0000 7f10b6440640 1 --2- 172.21.15.82:0/3816675106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b0100a70 0x7f10b0100e90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009900 tx=0x7f10a002bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:38.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.707+0000 7f10b6440640 1 -- 172.21.15.82:0/3816675106 shutdown_connections 2024-03-27T07:21:38.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.707+0000 7f10b6440640 1 --2- 172.21.15.82:0/3816675106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10b0102620 0x7f10b0108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.707+0000 7f10b6440640 1 --2- 172.21.15.82:0/3816675106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b0101c60 0x7f10b01020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.707+0000 7f10b6440640 1 --2- 172.21.15.82:0/3816675106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b0100a70 0x7f10b0100e90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.707+0000 7f10b6440640 1 -- 172.21.15.82:0/3816675106 >> 172.21.15.82:0/3816675106 conn(0x7f10b00fc000 msgr2=0x7f10b00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.707+0000 7f10b6440640 1 -- 172.21.15.82:0/3816675106 shutdown_connections 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.707+0000 7f10b6440640 1 -- 172.21.15.82:0/3816675106 wait complete. 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b6440640 1 Processor -- start 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b6440640 1 -- start start 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b6440640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10b0100a70 0x7f10b0197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b6440640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b0101c60 0x7f10b0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b6440640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b0102620 0x7f10b019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b6440640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10b006af60 con 0x7f10b0102620 2024-03-27T07:21:38.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b6440640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10b006ade0 con 0x7f10b0100a70 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b6440640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10b019fa90 con 0x7f10b0101c60 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b49dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b0102620 0x7f10b019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10affff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10b0100a70 0x7f10b0197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b49dd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b0102620 0x7f10b019f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34884/0 (socket says 172.21.15.82:34884) 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b49dd640 1 -- 172.21.15.82:0/4018444527 learned_addr learned my addr 172.21.15.82:0/4018444527 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10af7fe640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b0101c60 0x7f10b0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b49dd640 1 -- 172.21.15.82:0/4018444527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b0101c60 msgr2=0x7f10b0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b49dd640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b0101c60 0x7f10b0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b49dd640 1 -- 172.21.15.82:0/4018444527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10b0100a70 msgr2=0x7f10b0197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b49dd640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10b0100a70 0x7f10b0197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b49dd640 1 -- 172.21.15.82:0/4018444527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b019fc90 con 0x7f10b0102620 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10affff640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10b0100a70 0x7f10b0197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.708+0000 7f10b49dd640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b0102620 0x7f10b019f4a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10a800eb10 tx=0x7f10a800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:38.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.709+0000 7f10ad7fa640 1 -- 172.21.15.82:0/4018444527 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8004b20 con 0x7f10b0102620 2024-03-27T07:21:38.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.709+0000 7f10ad7fa640 1 -- 172.21.15.82:0/4018444527 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10a8004cc0 con 0x7f10b0102620 2024-03-27T07:21:38.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.709+0000 7f10ad7fa640 1 -- 172.21.15.82:0/4018444527 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8010760 con 0x7f10b0102620 2024-03-27T07:21:38.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.709+0000 7f10b6440640 1 -- 172.21.15.82:0/4018444527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b019ff80 con 0x7f10b0102620 2024-03-27T07:21:38.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.709+0000 7f10b6440640 1 -- 172.21.15.82:0/4018444527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b01a03f0 con 0x7f10b0102620 2024-03-27T07:21:38.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.710+0000 7f10b6440640 1 -- 172.21.15.82:0/4018444527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b0068d90 con 0x7f10b0102620 2024-03-27T07:21:38.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.711+0000 7f10ad7fa640 1 -- 172.21.15.82:0/4018444527 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f10a8010900 con 0x7f10b0102620 2024-03-27T07:21:38.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.711+0000 7f10ad7fa640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10980a3610 0x7f10980a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:38.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.712+0000 7f10affff640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10980a3610 0x7f10980a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:38.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.712+0000 7f10ad7fa640 1 -- 172.21.15.82:0/4018444527 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f10a80d0340 con 0x7f10b0102620 2024-03-27T07:21:38.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.712+0000 7f10affff640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10980a3610 0x7f10980a5ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f10a002c170 tx=0x7f10a002df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:38.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.715+0000 7f10ad7fa640 1 -- 172.21.15.82:0/4018444527 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f10a8053cb0 con 0x7f10b0102620 2024-03-27T07:21:38.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:38.934+0000 7f10b6440640 1 -- 172.21.15.82:0/4018444527 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f10b0107d90 con 0x7f10b0102620 2024-03-27T07:21:38.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:38 smithi082 ceph-mon[32178]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-27T07:21:38.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:38 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3267340998' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-27T07:21:38.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:38 smithi082 ceph-mon[32178]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-27T07:21:38.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:38 smithi082 ceph-mon[32178]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T07:21:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:38 smithi082 ceph-mon[32178]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-27T07:21:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:38 smithi082 ceph-mon[32178]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-27T07:21:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:38 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1275575501' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-27T07:21:39.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:38 smithi149 ceph-mon[36065]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-27T07:21:39.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:38 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3267340998' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-27T07:21:39.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:38 smithi149 ceph-mon[36065]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-27T07:21:39.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:38 smithi149 ceph-mon[36065]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T07:21:39.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:38 smithi149 ceph-mon[36065]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-27T07:21:39.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:38 smithi149 ceph-mon[36065]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-27T07:21:39.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:38 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1275575501' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-27T07:21:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:38 smithi153 ceph-mon[36179]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-27T07:21:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:38 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3267340998' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-27T07:21:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:38 smithi153 ceph-mon[36179]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-27T07:21:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:38 smithi153 ceph-mon[36179]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T07:21:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:38 smithi153 ceph-mon[36179]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-03-27T07:21:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:38 smithi153 ceph-mon[36179]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-03-27T07:21:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:38 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1275575501' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-27T07:21:39.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.586+0000 7f10ad7fa640 1 -- 172.21.15.82:0/4018444527 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7f10b0107d90 con 0x7f10b0102620 2024-03-27T07:21:39.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.588+0000 7f10b6440640 1 -- 172.21.15.82:0/4018444527 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10980a3610 msgr2=0x7f10980a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:39.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.588+0000 7f10b6440640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10980a3610 0x7f10980a5ad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f10a002c170 tx=0x7f10a002df90 comp rx=0 tx=0).stop 2024-03-27T07:21:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.588+0000 7f10b6440640 1 -- 172.21.15.82:0/4018444527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b0102620 msgr2=0x7f10b019f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.588+0000 7f10b6440640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b0102620 0x7f10b019f4a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10a800eb10 tx=0x7f10a800c2d0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.588+0000 7f10b6440640 1 -- 172.21.15.82:0/4018444527 shutdown_connections 2024-03-27T07:21:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.588+0000 7f10b6440640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f10980a3610 0x7f10980a5ad0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.588+0000 7f10b6440640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10b0102620 0x7f10b019f4a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.588+0000 7f10b6440640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10b0101c60 0x7f10b0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.588+0000 7f10b6440640 1 --2- 172.21.15.82:0/4018444527 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10b0100a70 0x7f10b0197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.588+0000 7f10b6440640 1 -- 172.21.15.82:0/4018444527 >> 172.21.15.82:0/4018444527 conn(0x7f10b00fc000 msgr2=0x7f10b0104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.589+0000 7f10b6440640 1 -- 172.21.15.82:0/4018444527 shutdown_connections 2024-03-27T07:21:39.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.589+0000 7f10b6440640 1 -- 172.21.15.82:0/4018444527 wait complete. 2024-03-27T07:21:39.603 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-03-27T07:21:39.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-03-27T07:21:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.711+0000 7fa8acfc9640 1 -- 172.21.15.82:0/2137401634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a81005e0 msgr2=0x7fa8a8100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.711+0000 7fa8acfc9640 1 --2- 172.21.15.82:0/2137401634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a81005e0 0x7fa8a8100a50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa898009ca0 tx=0x7fa89802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.711+0000 7fa8acfc9640 1 -- 172.21.15.82:0/2137401634 shutdown_connections 2024-03-27T07:21:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.711+0000 7fa8acfc9640 1 --2- 172.21.15.82:0/2137401634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a81005e0 0x7fa8a8100a50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.711+0000 7fa8acfc9640 1 --2- 172.21.15.82:0/2137401634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a80ffc20 0x7fa8a81000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.711+0000 7fa8acfc9640 1 --2- 172.21.15.82:0/2137401634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a81020a0 0x7fa8a81024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.711+0000 7fa8acfc9640 1 -- 172.21.15.82:0/2137401634 >> 172.21.15.82:0/2137401634 conn(0x7fa8a80fb780 msgr2=0x7fa8a80fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.711+0000 7fa8acfc9640 1 -- 172.21.15.82:0/2137401634 shutdown_connections 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.711+0000 7fa8acfc9640 1 -- 172.21.15.82:0/2137401634 wait complete. 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8acfc9640 1 Processor -- start 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8acfc9640 1 -- start start 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8acfc9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a80ffc20 0x7fa8a8199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8acfc9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a81005e0 0x7fa8a819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8acfc9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a81020a0 0x7fa8a81a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8acfc9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a810fa30 con 0x7fa8a80ffc20 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8acfc9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a810f8b0 con 0x7fa8a81005e0 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8acfc9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a810fbb0 con 0x7fa8a81020a0 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8a659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a80ffc20 0x7fa8a8199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8a659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a80ffc20 0x7fa8a8199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34902/0 (socket says 172.21.15.82:34902) 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8a659c640 1 -- 172.21.15.82:0/3833534383 learned_addr learned my addr 172.21.15.82:0/3833534383 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.712+0000 7fa8a5d9b640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a81005e0 0x7fa8a819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8a6d9d640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a81020a0 0x7fa8a81a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8a659c640 1 -- 172.21.15.82:0/3833534383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a81020a0 msgr2=0x7fa8a81a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8a659c640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a81020a0 0x7fa8a81a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8a659c640 1 -- 172.21.15.82:0/3833534383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a81005e0 msgr2=0x7fa8a819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8a659c640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a81005e0 0x7fa8a819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8a659c640 1 -- 172.21.15.82:0/3833534383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a81a1bf0 con 0x7fa8a80ffc20 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8a659c640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a80ffc20 0x7fa8a8199fd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000e9c0 tx=0x7fa8a000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8977fe640 1 -- 172.21.15.82:0/3833534383 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000cd80 con 0x7fa8a80ffc20 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8977fe640 1 -- 172.21.15.82:0/3833534383 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa8a00035f0 con 0x7fa8a80ffc20 2024-03-27T07:21:39.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8977fe640 1 -- 172.21.15.82:0/3833534383 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0010690 con 0x7fa8a80ffc20 2024-03-27T07:21:39.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8acfc9640 1 -- 172.21.15.82:0/3833534383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a81a1ee0 con 0x7fa8a80ffc20 2024-03-27T07:21:39.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.713+0000 7fa8acfc9640 1 -- 172.21.15.82:0/3833534383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a81a2340 con 0x7fa8a80ffc20 2024-03-27T07:21:39.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.714+0000 7fa8acfc9640 1 -- 172.21.15.82:0/3833534383 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8a810bb50 con 0x7fa8a80ffc20 2024-03-27T07:21:39.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.715+0000 7fa8977fe640 1 -- 172.21.15.82:0/3833534383 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fa8a00037a0 con 0x7fa8a80ffc20 2024-03-27T07:21:39.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.716+0000 7fa8977fe640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa8900a3610 0x7fa8900a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:39.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.716+0000 7fa8a5d9b640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa8900a3610 0x7fa8900a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:39.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.716+0000 7fa8977fe640 1 -- 172.21.15.82:0/3833534383 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fa8a00d0040 con 0x7fa8a80ffc20 2024-03-27T07:21:39.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.716+0000 7fa8a5d9b640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa8900a3610 0x7fa8900a5ad0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0095f0 tx=0x7fa89c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:39.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.719+0000 7fa8977fe640 1 -- 172.21.15.82:0/3833534383 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa8a009cdf0 con 0x7fa8a80ffc20 2024-03-27T07:21:39.906 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: 2024-03-27T07:21:39.520+0000 7f077cf2a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-27T07:21:39.906 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: 2024-03-27T07:21:39.520+0000 7f077cf2a700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-27T07:21:39.906 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-mon[36065]: pgmap v292: 97 pgs: 48 active+clean, 22 creating+peering, 27 unknown; 580 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 9 op/s 2024-03-27T07:21:39.906 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1275575501' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-27T07:21:39.906 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] up:active 2024-03-27T07:21:39.907 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-mon[36065]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-27T07:21:39.907 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-mon[36065]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-27T07:21:39.907 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-mon[36065]: Cluster is now healthy 2024-03-27T07:21:39.907 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-mon[36065]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-27T07:21:39.907 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-03-27T07:21:39.907 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-mon[36065]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-03-27T07:21:39.907 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:39 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4018444527' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-27T07:21:39.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.923+0000 7fa8acfc9640 1 -- 172.21.15.82:0/3833534383 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa8a8061f90 con 0x7fa8900a3610 2024-03-27T07:21:39.930 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-mon[32178]: pgmap v292: 97 pgs: 48 active+clean, 22 creating+peering, 27 unknown; 580 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 9 op/s 2024-03-27T07:21:39.930 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1275575501' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-27T07:21:39.930 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] up:active 2024-03-27T07:21:39.930 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-mon[32178]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-27T07:21:39.930 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-mon[32178]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-27T07:21:39.930 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-mon[32178]: Cluster is now healthy 2024-03-27T07:21:39.930 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-mon[32178]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-27T07:21:39.930 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-03-27T07:21:39.930 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-mon[32178]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-03-27T07:21:39.930 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4018444527' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-27T07:21:39.939 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:39 smithi153 ceph-mon[36179]: pgmap v292: 97 pgs: 48 active+clean, 22 creating+peering, 27 unknown; 580 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 9 op/s 2024-03-27T07:21:39.939 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:39 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1275575501' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-27T07:21:39.939 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:39 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] up:active 2024-03-27T07:21:39.939 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:39 smithi153 ceph-mon[36179]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-27T07:21:39.939 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:39 smithi153 ceph-mon[36179]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-27T07:21:39.939 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:39 smithi153 ceph-mon[36179]: Cluster is now healthy 2024-03-27T07:21:39.939 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:39 smithi153 ceph-mon[36179]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-03-27T07:21:39.939 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:39 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-03-27T07:21:39.939 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:39 smithi153 ceph-mon[36179]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-03-27T07:21:39.939 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:39 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4018444527' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-27T07:21:39.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.946+0000 7fa8977fe640 1 -- 172.21.15.82:0/3833534383 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa8a8061f90 con 0x7fa8900a3610 2024-03-27T07:21:39.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.948+0000 7fa8acfc9640 1 -- 172.21.15.82:0/3833534383 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa8900a3610 msgr2=0x7fa8900a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:39.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.948+0000 7fa8acfc9640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa8900a3610 0x7fa8900a5ad0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0095f0 tx=0x7fa89c005f90 comp rx=0 tx=0).stop 2024-03-27T07:21:39.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.948+0000 7fa8acfc9640 1 -- 172.21.15.82:0/3833534383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a80ffc20 msgr2=0x7fa8a8199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:39.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.948+0000 7fa8acfc9640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a80ffc20 0x7fa8a8199fd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000e9c0 tx=0x7fa8a000ee80 comp rx=0 tx=0).stop 2024-03-27T07:21:39.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.948+0000 7fa8acfc9640 1 -- 172.21.15.82:0/3833534383 shutdown_connections 2024-03-27T07:21:39.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.948+0000 7fa8acfc9640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fa8900a3610 0x7fa8900a5ad0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.948+0000 7fa8acfc9640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8a81020a0 0x7fa8a81a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.948+0000 7fa8acfc9640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa8a81005e0 0x7fa8a819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.948+0000 7fa8acfc9640 1 --2- 172.21.15.82:0/3833534383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8a80ffc20 0x7fa8a8199fd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:39.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.949+0000 7fa8acfc9640 1 -- 172.21.15.82:0/3833534383 >> 172.21.15.82:0/3833534383 conn(0x7fa8a80fb780 msgr2=0x7fa8a80fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:39.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.949+0000 7fa8acfc9640 1 -- 172.21.15.82:0/3833534383 shutdown_connections 2024-03-27T07:21:39.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:39.949+0000 7fa8acfc9640 1 -- 172.21.15.82:0/3833534383 wait complete. 2024-03-27T07:21:39.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-03-27T07:21:40.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.066+0000 7f2bb6c76640 1 -- 172.21.15.82:0/3362135055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0102650 msgr2=0x7f2bb0104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.066+0000 7f2bb6c76640 1 --2- 172.21.15.82:0/3362135055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0102650 0x7f2bb0104a40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009900 tx=0x7f2ba402bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:40.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.066+0000 7f2bb6c76640 1 -- 172.21.15.82:0/3362135055 shutdown_connections 2024-03-27T07:21:40.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.066+0000 7f2bb6c76640 1 --2- 172.21.15.82:0/3362135055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb01078b0 0x7f2bb0109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.066+0000 7f2bb6c76640 1 --2- 172.21.15.82:0/3362135055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb0104f80 0x7f2bb0107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.066+0000 7f2bb6c76640 1 --2- 172.21.15.82:0/3362135055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0102650 0x7f2bb0104a40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.066+0000 7f2bb6c76640 1 -- 172.21.15.82:0/3362135055 >> 172.21.15.82:0/3362135055 conn(0x7f2bb00fc000 msgr2=0x7f2bb00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.066+0000 7f2bb6c76640 1 -- 172.21.15.82:0/3362135055 shutdown_connections 2024-03-27T07:21:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.066+0000 7f2bb6c76640 1 -- 172.21.15.82:0/3362135055 wait complete. 2024-03-27T07:21:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb6c76640 1 Processor -- start 2024-03-27T07:21:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb6c76640 1 -- start start 2024-03-27T07:21:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb6c76640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb0102650 0x7f2bb0197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb6c76640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0104f80 0x7f2bb0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb6c76640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb01078b0 0x7f2bb019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb6c76640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb010d810 con 0x7f2bb0104f80 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb6c76640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb010d690 con 0x7f2bb0102650 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb6c76640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb010d990 con 0x7f2bb01078b0 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2baffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0104f80 0x7f2bb0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2baffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0104f80 0x7f2bb0198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34938/0 (socket says 172.21.15.82:34938) 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2baffff640 1 -- 172.21.15.82:0/1018056448 learned_addr learned my addr 172.21.15.82:0/1018056448 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb5213640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb01078b0 0x7f2bb019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb4a12640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb0102650 0x7f2bb0197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2baffff640 1 -- 172.21.15.82:0/1018056448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb01078b0 msgr2=0x7f2bb019f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2baffff640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb01078b0 0x7f2bb019f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2baffff640 1 -- 172.21.15.82:0/1018056448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb0102650 msgr2=0x7f2bb0197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2baffff640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb0102650 0x7f2bb0197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2baffff640 1 -- 172.21.15.82:0/1018056448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb019fb00 con 0x7f2bb0104f80 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb4a12640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb0102650 0x7f2bb0197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2baffff640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0104f80 0x7f2bb0198420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00e9f0 tx=0x7f2b9c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2badffb640 1 -- 172.21.15.82:0/1018056448 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c00ccc0 con 0x7f2bb0104f80 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2badffb640 1 -- 172.21.15.82:0/1018056448 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b9c005500 con 0x7f2bb0104f80 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2badffb640 1 -- 172.21.15.82:0/1018056448 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c010690 con 0x7f2bb0104f80 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.067+0000 7f2bb6c76640 1 -- 172.21.15.82:0/1018056448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb019fdf0 con 0x7f2bb0104f80 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.068+0000 7f2bb6c76640 1 -- 172.21.15.82:0/1018056448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb01a02b0 con 0x7f2bb0104f80 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.069+0000 7f2bb6c76640 1 -- 172.21.15.82:0/1018056448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb00fdaf0 con 0x7f2bb0104f80 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.069+0000 7f2badffb640 1 -- 172.21.15.82:0/1018056448 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f2b9c0046c0 con 0x7f2bb0104f80 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.070+0000 7f2badffb640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2ba00a3690 0x7f2ba00a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.070+0000 7f2bb4a12640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2ba00a3690 0x7f2ba00a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.070+0000 7f2badffb640 1 -- 172.21.15.82:0/1018056448 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f2b9c0cff30 con 0x7f2bb0104f80 2024-03-27T07:21:40.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.070+0000 7f2bb4a12640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2ba00a3690 0x7f2ba00a5b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4006010 tx=0x7f2ba402c8a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:40.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.074+0000 7f2badffb640 1 -- 172.21.15.82:0/1018056448 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2b9c09cc50 con 0x7f2bb0104f80 2024-03-27T07:21:40.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:21:39.927+0000 7f1e00c7a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:21:40.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:21:39.927+0000 7f1e00c7a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:21:40.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:21:39.927+0000 7f1e00c7a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:21:40.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:21:39.927+0000 7f1e00c7a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:21:40.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:21:39 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:21:39.927+0000 7f1e00c7a700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:21:40.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.280+0000 7f2bb6c76640 1 -- 172.21.15.82:0/1018056448 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2bb0061f90 con 0x7f2ba00a3690 2024-03-27T07:21:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.306+0000 7f2badffb640 1 -- 172.21.15.82:0/1018056448 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2bb0061f90 con 0x7f2ba00a3690 2024-03-27T07:21:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.308+0000 7f2bb6c76640 1 -- 172.21.15.82:0/1018056448 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2ba00a3690 msgr2=0x7f2ba00a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.308+0000 7f2bb6c76640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2ba00a3690 0x7f2ba00a5b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4006010 tx=0x7f2ba402c8a0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.308+0000 7f2bb6c76640 1 -- 172.21.15.82:0/1018056448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0104f80 msgr2=0x7f2bb0198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.308+0000 7f2bb6c76640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0104f80 0x7f2bb0198420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00e9f0 tx=0x7f2b9c00eeb0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.308+0000 7f2bb6c76640 1 -- 172.21.15.82:0/1018056448 shutdown_connections 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.308+0000 7f2bb6c76640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2ba00a3690 0x7f2ba00a5b50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.308+0000 7f2bb6c76640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0104f80 0x7f2bb0198420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.308+0000 7f2bb6c76640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb01078b0 0x7f2bb019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.308+0000 7f2bb6c76640 1 --2- 172.21.15.82:0/1018056448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb0102650 0x7f2bb0197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.308+0000 7f2bb6c76640 1 -- 172.21.15.82:0/1018056448 >> 172.21.15.82:0/1018056448 conn(0x7f2bb00fc000 msgr2=0x7f2bb01030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.309+0000 7f2bb6c76640 1 -- 172.21.15.82:0/1018056448 shutdown_connections 2024-03-27T07:21:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.309+0000 7f2bb6c76640 1 -- 172.21.15.82:0/1018056448 wait complete. 2024-03-27T07:21:40.321 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-03-27T07:21:40.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 -- 172.21.15.82:0/50488060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3c8102600 msgr2=0x7fd3c8108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 --2- 172.21.15.82:0/50488060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3c8102600 0x7fd3c8108e90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009860 tx=0x7fd3c002bb70 comp rx=0 tx=0).stop 2024-03-27T07:21:40.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 -- 172.21.15.82:0/50488060 shutdown_connections 2024-03-27T07:21:40.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 --2- 172.21.15.82:0/50488060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3c8102600 0x7fd3c8108e90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 --2- 172.21.15.82:0/50488060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c8101c40 0x7fd3c81020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 --2- 172.21.15.82:0/50488060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c8100a50 0x7fd3c8100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 -- 172.21.15.82:0/50488060 >> 172.21.15.82:0/50488060 conn(0x7fd3c80fbfe0 msgr2=0x7fd3c80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:40.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 -- 172.21.15.82:0/50488060 shutdown_connections 2024-03-27T07:21:40.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 -- 172.21.15.82:0/50488060 wait complete. 2024-03-27T07:21:40.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 Processor -- start 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.426+0000 7fd3cf664640 1 -- start start 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cf664640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3c8100a50 0x7fd3c8196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cf664640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c8101c40 0x7fd3c8197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cf664640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c8102600 0x7fd3c819e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cf664640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c810c6b0 con 0x7fd3c8100a50 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cf664640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c810c530 con 0x7fd3c8102600 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cf664640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c810c830 con 0x7fd3c8101c40 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cd400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3c8100a50 0x7fd3c8196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cd400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3c8100a50 0x7fd3c8196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34958/0 (socket says 172.21.15.82:34958) 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cd400640 1 -- 172.21.15.82:0/2540398797 learned_addr learned my addr 172.21.15.82:0/2540398797 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3ccbff640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c8101c40 0x7fd3c8197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cdc01640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c8102600 0x7fd3c819e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cd400640 1 -- 172.21.15.82:0/2540398797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c8101c40 msgr2=0x7fd3c8197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cd400640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c8101c40 0x7fd3c8197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cd400640 1 -- 172.21.15.82:0/2540398797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c8102600 msgr2=0x7fd3c819e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cd400640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c8102600 0x7fd3c819e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cd400640 1 -- 172.21.15.82:0/2540398797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c819e970 con 0x7fd3c8100a50 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cd400640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3c8100a50 0x7fd3c8196d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400ebc0 tx=0x7fd3c400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3be7fc640 1 -- 172.21.15.82:0/2540398797 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4003970 con 0x7fd3c8100a50 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3be7fc640 1 -- 172.21.15.82:0/2540398797 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3c4004030 con 0x7fd3c8100a50 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cf664640 1 -- 172.21.15.82:0/2540398797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c819ec60 con 0x7fd3c8100a50 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3be7fc640 1 -- 172.21.15.82:0/2540398797 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c40197b0 con 0x7fd3c8100a50 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.427+0000 7fd3cf664640 1 -- 172.21.15.82:0/2540398797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c819f1b0 con 0x7fd3c8100a50 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.428+0000 7fd3cf664640 1 -- 172.21.15.82:0/2540398797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c8107d70 con 0x7fd3c8100a50 2024-03-27T07:21:40.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.429+0000 7fd3be7fc640 1 -- 172.21.15.82:0/2540398797 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fd3c40041e0 con 0x7fd3c8100a50 2024-03-27T07:21:40.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.430+0000 7fd3be7fc640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd3b40a3690 0x7fd3b40a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.430+0000 7fd3ccbff640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd3b40a3690 0x7fd3b40a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.430+0000 7fd3be7fc640 1 -- 172.21.15.82:0/2540398797 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fd3c40d0430 con 0x7fd3c8100a50 2024-03-27T07:21:40.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.430+0000 7fd3ccbff640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd3b40a3690 0x7fd3b40a5b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8198260 tx=0x7fd3b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:40.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.434+0000 7fd3be7fc640 1 -- 172.21.15.82:0/2540398797 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd3c409d150 con 0x7fd3c8100a50 2024-03-27T07:21:40.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.643+0000 7fd3cf664640 1 -- 172.21.15.82:0/2540398797 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fd3c8061f90 con 0x7fd3b40a3690 2024-03-27T07:21:40.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.648+0000 7fd3be7fc640 1 -- 172.21.15.82:0/2540398797 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd3c8061f90 con 0x7fd3b40a3690 2024-03-27T07:21:40.650 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_0/4490e8d8-60c6-4c27-8ab0-f5222fab7d71 2024-03-27T07:21:40.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 -- 172.21.15.82:0/2540398797 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd3b40a3690 msgr2=0x7fd3b40a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd3b40a3690 0x7fd3b40a5b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8198260 tx=0x7fd3b8009260 comp rx=0 tx=0).stop 2024-03-27T07:21:40.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 -- 172.21.15.82:0/2540398797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3c8100a50 msgr2=0x7fd3c8196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3c8100a50 0x7fd3c8196d50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400ebc0 tx=0x7fd3c400c2d0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 -- 172.21.15.82:0/2540398797 shutdown_connections 2024-03-27T07:21:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd3b40a3690 0x7fd3b40a5b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd3c8102600 0x7fd3c819e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c8101c40 0x7fd3c8197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 --2- 172.21.15.82:0/2540398797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3c8100a50 0x7fd3c8196d50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 -- 172.21.15.82:0/2540398797 >> 172.21.15.82:0/2540398797 conn(0x7fd3c80fbfe0 msgr2=0x7fd3c8104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 -- 172.21.15.82:0/2540398797 shutdown_connections 2024-03-27T07:21:40.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.651+0000 7fd3cf664640 1 -- 172.21.15.82:0/2540398797 wait complete. 2024-03-27T07:21:40.664 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-03-27T07:21:40.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.768+0000 7efd0fa39640 1 -- 172.21.15.82:0/2622141540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08101b60 msgr2=0x7efd08101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.768+0000 7efd0fa39640 1 --2- 172.21.15.82:0/2622141540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08101b60 0x7efd08101f80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efd04009900 tx=0x7efd0402bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:40.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.768+0000 7efd0fa39640 1 -- 172.21.15.82:0/2622141540 shutdown_connections 2024-03-27T07:21:40.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.768+0000 7efd0fa39640 1 --2- 172.21.15.82:0/2622141540 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd08103710 0x7efd08109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.768+0000 7efd0fa39640 1 --2- 172.21.15.82:0/2622141540 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd08102d50 0x7efd081031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.768+0000 7efd0fa39640 1 --2- 172.21.15.82:0/2622141540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08101b60 0x7efd08101f80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.768+0000 7efd0fa39640 1 -- 172.21.15.82:0/2622141540 >> 172.21.15.82:0/2622141540 conn(0x7efd080fd0f0 msgr2=0x7efd080ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:40.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.768+0000 7efd0fa39640 1 -- 172.21.15.82:0/2622141540 shutdown_connections 2024-03-27T07:21:40.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.768+0000 7efd0fa39640 1 -- 172.21.15.82:0/2622141540 wait complete. 2024-03-27T07:21:40.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0fa39640 1 Processor -- start 2024-03-27T07:21:40.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0fa39640 1 -- start start 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0fa39640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd08101b60 0x7efd08075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0fa39640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd08102d50 0x7efd08073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0fa39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08103710 0x7efd08074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0fa39640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd0810d7d0 con 0x7efd08103710 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0fa39640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd0810d650 con 0x7efd08101b60 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0fa39640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd0810d950 con 0x7efd08102d50 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0dfd6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08103710 0x7efd08074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0dfd6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08103710 0x7efd08074480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34970/0 (socket says 172.21.15.82:34970) 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0dfd6640 1 -- 172.21.15.82:0/3996514458 learned_addr learned my addr 172.21.15.82:0/3996514458 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0d7d5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd08101b60 0x7efd08075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0cfd4640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd08102d50 0x7efd08073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0dfd6640 1 -- 172.21.15.82:0/3996514458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd08102d50 msgr2=0x7efd08073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0dfd6640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd08102d50 0x7efd08073f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0dfd6640 1 -- 172.21.15.82:0/3996514458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd08101b60 msgr2=0x7efd08075900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0dfd6640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd08101b60 0x7efd08075900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0dfd6640 1 -- 172.21.15.82:0/3996514458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd08074d10 con 0x7efd08103710 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efd0dfd6640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08103710 0x7efd08074480 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efd0000eb10 tx=0x7efd0000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.769+0000 7efcfe7fc640 1 -- 172.21.15.82:0/3996514458 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00004b20 con 0x7efd08103710 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.770+0000 7efd0fa39640 1 -- 172.21.15.82:0/3996514458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd081a1ff0 con 0x7efd08103710 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.770+0000 7efcfe7fc640 1 -- 172.21.15.82:0/3996514458 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd00004cc0 con 0x7efd08103710 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.770+0000 7efcfe7fc640 1 -- 172.21.15.82:0/3996514458 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00010760 con 0x7efd08103710 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.770+0000 7efd0fa39640 1 -- 172.21.15.82:0/3996514458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd081a2400 con 0x7efd08103710 2024-03-27T07:21:40.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.771+0000 7efd0fa39640 1 -- 172.21.15.82:0/3996514458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd08108ef0 con 0x7efd08103710 2024-03-27T07:21:40.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.771+0000 7efcfe7fc640 1 -- 172.21.15.82:0/3996514458 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7efd00005020 con 0x7efd08103710 2024-03-27T07:21:40.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.772+0000 7efcfe7fc640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7efcf40a3610 0x7efcf40a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:40.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.772+0000 7efd0d7d5640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7efcf40a3610 0x7efcf40a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:40.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.772+0000 7efcfe7fc640 1 -- 172.21.15.82:0/3996514458 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7efd000d0140 con 0x7efd08103710 2024-03-27T07:21:40.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.772+0000 7efd0d7d5640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7efcf40a3610 0x7efcf40a5ad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd04000c00 tx=0x7efd04005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:40.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.776+0000 7efcfe7fc640 1 -- 172.21.15.82:0/3996514458 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7efd0009ce60 con 0x7efd08103710 2024-03-27T07:21:40.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:40 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4018444527' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-27T07:21:40.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:40 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] up:active 2024-03-27T07:21:40.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:40 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-03-27T07:21:40.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:40 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:21:40.958 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:40 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4018444527' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-27T07:21:40.958 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:40 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] up:active 2024-03-27T07:21:40.958 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:40 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-03-27T07:21:40.958 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:40 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:21:40.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:40.980+0000 7efd0fa39640 1 -- 172.21.15.82:0/3996514458 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7efd08062020 con 0x7efcf40a3610 2024-03-27T07:21:41.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:40 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4018444527' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-27T07:21:41.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:40 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] up:active 2024-03-27T07:21:41.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:40 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-03-27T07:21:41.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:40 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:21:41.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.012+0000 7efcfe7fc640 1 -- 172.21.15.82:0/3996514458 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efd08062020 con 0x7efcf40a3610 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 -- 172.21.15.82:0/3996514458 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7efcf40a3610 msgr2=0x7efcf40a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7efcf40a3610 0x7efcf40a5ad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efd04000c00 tx=0x7efd04005fd0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 -- 172.21.15.82:0/3996514458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08103710 msgr2=0x7efd08074480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08103710 0x7efd08074480 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efd0000eb10 tx=0x7efd0000c2d0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 -- 172.21.15.82:0/3996514458 shutdown_connections 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7efcf40a3610 0x7efcf40a5ad0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd08103710 0x7efd08074480 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd08102d50 0x7efd08073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 --2- 172.21.15.82:0/3996514458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd08101b60 0x7efd08075900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 -- 172.21.15.82:0/3996514458 >> 172.21.15.82:0/3996514458 conn(0x7efd080fd0f0 msgr2=0x7efd081060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:41.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 -- 172.21.15.82:0/3996514458 shutdown_connections 2024-03-27T07:21:41.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.014+0000 7efd0fa39640 1 -- 172.21.15.82:0/3996514458 wait complete. 2024-03-27T07:21:41.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-03-27T07:21:41.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.131+0000 7fb903beb640 1 -- 172.21.15.82:0/2421520968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8fc100a60 msgr2=0x7fb8fc100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.131+0000 7fb903beb640 1 --2- 172.21.15.82:0/2421520968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8fc100a60 0x7fb8fc100e80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009900 tx=0x7fb8f802bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:41.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.131+0000 7fb903beb640 1 -- 172.21.15.82:0/2421520968 shutdown_connections 2024-03-27T07:21:41.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.131+0000 7fb903beb640 1 --2- 172.21.15.82:0/2421520968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8fc102610 0x7fb8fc108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.131+0000 7fb903beb640 1 --2- 172.21.15.82:0/2421520968 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc101c50 0x7fb8fc1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.131+0000 7fb903beb640 1 --2- 172.21.15.82:0/2421520968 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8fc100a60 0x7fb8fc100e80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.131+0000 7fb903beb640 1 -- 172.21.15.82:0/2421520968 >> 172.21.15.82:0/2421520968 conn(0x7fb8fc0fbff0 msgr2=0x7fb8fc0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.131+0000 7fb903beb640 1 -- 172.21.15.82:0/2421520968 shutdown_connections 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.131+0000 7fb903beb640 1 -- 172.21.15.82:0/2421520968 wait complete. 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.131+0000 7fb903beb640 1 Processor -- start 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb903beb640 1 -- start start 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb903beb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc100a60 0x7fb8fc06ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb903beb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8fc101c50 0x7fb8fc19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb903beb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8fc102610 0x7fb8fc19f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb903beb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc10c6b0 con 0x7fb8fc101c50 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb903beb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc10c530 con 0x7fb8fc100a60 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb903beb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc10c830 con 0x7fb8fc102610 2024-03-27T07:21:41.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb901186640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8fc101c50 0x7fb8fc19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb901186640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8fc101c50 0x7fb8fc19cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34986/0 (socket says 172.21.15.82:34986) 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb901186640 1 -- 172.21.15.82:0/570325770 learned_addr learned my addr 172.21.15.82:0/570325770 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb901987640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc100a60 0x7fb8fc06ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb902188640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8fc102610 0x7fb8fc19f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb901186640 1 -- 172.21.15.82:0/570325770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8fc102610 msgr2=0x7fb8fc19f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb901186640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8fc102610 0x7fb8fc19f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb901186640 1 -- 172.21.15.82:0/570325770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc100a60 msgr2=0x7fb8fc06ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb901186640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc100a60 0x7fb8fc06ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb901186640 1 -- 172.21.15.82:0/570325770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc19faf0 con 0x7fb8fc101c50 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb901186640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8fc101c50 0x7fb8fc19cbc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00e9f0 tx=0x7fb8ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb8f2ffd640 1 -- 172.21.15.82:0/570325770 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00cd80 con 0x7fb8fc101c50 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb903beb640 1 -- 172.21.15.82:0/570325770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc19fde0 con 0x7fb8fc101c50 2024-03-27T07:21:41.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb8f2ffd640 1 -- 172.21.15.82:0/570325770 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb8ec010910 con 0x7fb8fc101c50 2024-03-27T07:21:41.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb8f2ffd640 1 -- 172.21.15.82:0/570325770 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0188f0 con 0x7fb8fc101c50 2024-03-27T07:21:41.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.132+0000 7fb903beb640 1 -- 172.21.15.82:0/570325770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc1a02a0 con 0x7fb8fc101c50 2024-03-27T07:21:41.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.133+0000 7fb903beb640 1 -- 172.21.15.82:0/570325770 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc107e20 con 0x7fb8fc101c50 2024-03-27T07:21:41.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.135+0000 7fb8f2ffd640 1 -- 172.21.15.82:0/570325770 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7fb8ec010ac0 con 0x7fb8fc101c50 2024-03-27T07:21:41.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.135+0000 7fb8f2ffd640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb8e80a3610 0x7fb8e80a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.135+0000 7fb901987640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb8e80a3610 0x7fb8e80a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.135+0000 7fb8f2ffd640 1 -- 172.21.15.82:0/570325770 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fb8ec0cff80 con 0x7fb8fc101c50 2024-03-27T07:21:41.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.135+0000 7fb901987640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb8e80a3610 0x7fb8e80a5ad0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8000c00 tx=0x7fb8f8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:41.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.139+0000 7fb8f2ffd640 1 -- 172.21.15.82:0/570325770 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb8ec09c650 con 0x7fb8fc101c50 2024-03-27T07:21:41.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.343+0000 7fb903beb640 1 -- 172.21.15.82:0/570325770 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fb8fc062020 con 0x7fb8e80a3610 2024-03-27T07:21:41.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.348+0000 7fb8f2ffd640 1 -- 172.21.15.82:0/570325770 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fb8fc062020 con 0x7fb8e80a3610 2024-03-27T07:21:41.350 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5 2024-03-27T07:21:41.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.350+0000 7fb903beb640 1 -- 172.21.15.82:0/570325770 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb8e80a3610 msgr2=0x7fb8e80a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.350+0000 7fb903beb640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb8e80a3610 0x7fb8e80a5ad0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8000c00 tx=0x7fb8f8005fd0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.350+0000 7fb903beb640 1 -- 172.21.15.82:0/570325770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8fc101c50 msgr2=0x7fb8fc19cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.350+0000 7fb903beb640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8fc101c50 0x7fb8fc19cbc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00e9f0 tx=0x7fb8ec00eeb0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.351+0000 7fb903beb640 1 -- 172.21.15.82:0/570325770 shutdown_connections 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.351+0000 7fb903beb640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb8e80a3610 0x7fb8e80a5ad0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.351+0000 7fb903beb640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb8fc101c50 0x7fb8fc19cbc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.351+0000 7fb903beb640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8fc102610 0x7fb8fc19f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.351+0000 7fb903beb640 1 --2- 172.21.15.82:0/570325770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb8fc100a60 0x7fb8fc06ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.351+0000 7fb903beb640 1 -- 172.21.15.82:0/570325770 >> 172.21.15.82:0/570325770 conn(0x7fb8fc0fbff0 msgr2=0x7fb8fc104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.351+0000 7fb903beb640 1 -- 172.21.15.82:0/570325770 shutdown_connections 2024-03-27T07:21:41.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.351+0000 7fb903beb640 1 -- 172.21.15.82:0/570325770 wait complete. 2024-03-27T07:21:41.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:21:41.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.461+0000 7f6250bb5640 1 -- 172.21.15.82:0/2067376609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f624c102620 msgr2=0x7f624c108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.461+0000 7f6250bb5640 1 --2- 172.21.15.82:0/2067376609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f624c102620 0x7f624c108eb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6244009ca0 tx=0x7f624402c0f0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 -- 172.21.15.82:0/2067376609 shutdown_connections 2024-03-27T07:21:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 --2- 172.21.15.82:0/2067376609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f624c102620 0x7f624c108eb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 --2- 172.21.15.82:0/2067376609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624c101c60 0x7f624c1020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 --2- 172.21.15.82:0/2067376609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f624c100a70 0x7f624c100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 -- 172.21.15.82:0/2067376609 >> 172.21.15.82:0/2067376609 conn(0x7f624c0fbfe0 msgr2=0x7f624c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 -- 172.21.15.82:0/2067376609 shutdown_connections 2024-03-27T07:21:41.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 -- 172.21.15.82:0/2067376609 wait complete. 2024-03-27T07:21:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 Processor -- start 2024-03-27T07:21:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 -- start start 2024-03-27T07:21:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624c100a70 0x7f624c197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.462+0000 7f6250bb5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f624c101c60 0x7f624c1983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f6250bb5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f624c102620 0x7f624c19f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f6250bb5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f624c10c6f0 con 0x7f624c102620 2024-03-27T07:21:41.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f6250bb5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f624c10c570 con 0x7f624c100a70 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f6250bb5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f624c10c870 con 0x7f624c101c60 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f624ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f624c102620 0x7f624c19f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f624ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f624c102620 0x7f624c19f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34990/0 (socket says 172.21.15.82:34990) 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f624ad9d640 1 -- 172.21.15.82:0/447295713 learned_addr learned my addr 172.21.15.82:0/447295713 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f624a59c640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624c100a70 0x7f624c197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f6249d9b640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f624c101c60 0x7f624c1983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f624ad9d640 1 -- 172.21.15.82:0/447295713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f624c101c60 msgr2=0x7f624c1983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f624ad9d640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f624c101c60 0x7f624c1983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f624ad9d640 1 -- 172.21.15.82:0/447295713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624c100a70 msgr2=0x7f624c197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f624ad9d640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624c100a70 0x7f624c197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f624ad9d640 1 -- 172.21.15.82:0/447295713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c19fa80 con 0x7f624c102620 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f624ad9d640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f624c102620 0x7f624c19f410 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6244037040 tx=0x7f6244032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:41.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f623b7fe640 1 -- 172.21.15.82:0/447295713 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244041020 con 0x7f624c102620 2024-03-27T07:21:41.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f623b7fe640 1 -- 172.21.15.82:0/447295713 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6244034cd0 con 0x7f624c102620 2024-03-27T07:21:41.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f6250bb5640 1 -- 172.21.15.82:0/447295713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c19fd10 con 0x7f624c102620 2024-03-27T07:21:41.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f623b7fe640 1 -- 172.21.15.82:0/447295713 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244039040 con 0x7f624c102620 2024-03-27T07:21:41.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.463+0000 7f6250bb5640 1 -- 172.21.15.82:0/447295713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c1a01b0 con 0x7f624c102620 2024-03-27T07:21:41.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.464+0000 7f6250bb5640 1 -- 172.21.15.82:0/447295713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624c1a03e0 con 0x7f624c102620 2024-03-27T07:21:41.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.465+0000 7f623b7fe640 1 -- 172.21.15.82:0/447295713 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 138370+0+0 (secure 0 0 0) 0x7f6244044020 con 0x7f624c102620 2024-03-27T07:21:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.466+0000 7f623b7fe640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f62340a3610 0x7f62340a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.466+0000 7f624a59c640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f62340a3610 0x7f62340a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.466+0000 7f623b7fe640 1 -- 172.21.15.82:0/447295713 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f62440f1a50 con 0x7f624c102620 2024-03-27T07:21:41.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.466+0000 7f624a59c640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f62340a3610 0x7f62340a5ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f624c101ac0 tx=0x7f6240005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:41.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.470+0000 7f623b7fe640 1 -- 172.21.15.82:0/447295713 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f624404b020 con 0x7f624c102620 2024-03-27T07:21:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.609+0000 7f623b7fe640 1 -- 172.21.15.82:0/447295713 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f62440ba770 con 0x7f624c102620 2024-03-27T07:21:41.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:41 smithi082 ceph-mon[32178]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:41.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:41 smithi082 ceph-mon[32178]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:41.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:41 smithi082 ceph-mon[32178]: pgmap v293: 97 pgs: 90 active+clean, 7 creating+peering; 580 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 12 op/s 2024-03-27T07:21:41.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:41 smithi082 ceph-mon[32178]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:41.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.692+0000 7f6250bb5640 1 -- 172.21.15.82:0/447295713 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f624c1a0770 con 0x7f624c102620 2024-03-27T07:21:41.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.693+0000 7f623b7fe640 1 -- 172.21.15.82:0/447295713 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f62440be800 con 0x7f624c102620 2024-03-27T07:21:41.696 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:41.696 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:21:39.590410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24470,24484]},"id":1}]} 2024-03-27T07:21:41.696 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 21 2024-03-27T07:21:41.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 -- 172.21.15.82:0/447295713 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f62340a3610 msgr2=0x7f62340a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f62340a3610 0x7f62340a5ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f624c101ac0 tx=0x7f6240005f90 comp rx=0 tx=0).stop 2024-03-27T07:21:41.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 -- 172.21.15.82:0/447295713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f624c102620 msgr2=0x7f624c19f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f624c102620 0x7f624c19f410 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6244037040 tx=0x7f6244032f40 comp rx=0 tx=0).stop 2024-03-27T07:21:41.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 -- 172.21.15.82:0/447295713 shutdown_connections 2024-03-27T07:21:41.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f62340a3610 0x7f62340a5ad0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f624c102620 0x7f624c19f410 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f624c101c60 0x7f624c1983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 --2- 172.21.15.82:0/447295713 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f624c100a70 0x7f624c197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 -- 172.21.15.82:0/447295713 >> 172.21.15.82:0/447295713 conn(0x7f624c0fbfe0 msgr2=0x7f624c068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:41.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 -- 172.21.15.82:0/447295713 shutdown_connections 2024-03-27T07:21:41.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.695+0000 7f6250bb5640 1 -- 172.21.15.82:0/447295713 wait complete. 2024-03-27T07:21:41.708 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:21:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.808+0000 7f2424c0e640 1 -- 172.21.15.82:0/3237869053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2420101c70 msgr2=0x7f24201020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.808+0000 7f2424c0e640 1 --2- 172.21.15.82:0/3237869053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2420101c70 0x7f24201020f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2408009900 tx=0x7f240802bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.808+0000 7f2424c0e640 1 -- 172.21.15.82:0/3237869053 shutdown_connections 2024-03-27T07:21:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.808+0000 7f2424c0e640 1 --2- 172.21.15.82:0/3237869053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2420101c70 0x7f24201020f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.808+0000 7f2424c0e640 1 --2- 172.21.15.82:0/3237869053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2420102630 0x7f2420108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.808+0000 7f2424c0e640 1 --2- 172.21.15.82:0/3237869053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2420100a80 0x7f2420100ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.808+0000 7f2424c0e640 1 -- 172.21.15.82:0/3237869053 >> 172.21.15.82:0/3237869053 conn(0x7f24200fc030 msgr2=0x7f24200fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.808+0000 7f2424c0e640 1 -- 172.21.15.82:0/3237869053 shutdown_connections 2024-03-27T07:21:41.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.808+0000 7f2424c0e640 1 -- 172.21.15.82:0/3237869053 wait complete. 2024-03-27T07:21:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.808+0000 7f2424c0e640 1 Processor -- start 2024-03-27T07:21:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f2424c0e640 1 -- start start 2024-03-27T07:21:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f2424c0e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2420100a80 0x7f2420196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f2424c0e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2420101c70 0x7f24201972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f2424c0e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2420102630 0x7f242019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f2424c0e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f242010c6e0 con 0x7f2420102630 2024-03-27T07:21:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f2424c0e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f242010c560 con 0x7f2420100a80 2024-03-27T07:21:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f2424c0e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f242010c860 con 0x7f2420101c70 2024-03-27T07:21:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2420102630 0x7f242019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2420102630 0x7f242019e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35014/0 (socket says 172.21.15.82:35014) 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241ed9d640 1 -- 172.21.15.82:0/4187868534 learned_addr learned my addr 172.21.15.82:0/4187868534 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241e59c640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2420100a80 0x7f2420196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241dd9b640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2420101c70 0x7f24201972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241ed9d640 1 -- 172.21.15.82:0/4187868534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2420101c70 msgr2=0x7f24201972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241ed9d640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2420101c70 0x7f24201972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241ed9d640 1 -- 172.21.15.82:0/4187868534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2420100a80 msgr2=0x7f2420196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241ed9d640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2420100a80 0x7f2420196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241ed9d640 1 -- 172.21.15.82:0/4187868534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242019e9c0 con 0x7f2420102630 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f241ed9d640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2420102630 0x7f242019e320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f241000eb00 tx=0x7f241000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f24177fe640 1 -- 172.21.15.82:0/4187868534 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241000bbb0 con 0x7f2420102630 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f24177fe640 1 -- 172.21.15.82:0/4187868534 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f241000bd50 con 0x7f2420102630 2024-03-27T07:21:41.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f24177fe640 1 -- 172.21.15.82:0/4187868534 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2410017410 con 0x7f2420102630 2024-03-27T07:21:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f2424c0e640 1 -- 172.21.15.82:0/4187868534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242006a200 con 0x7f2420102630 2024-03-27T07:21:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.809+0000 7f2424c0e640 1 -- 172.21.15.82:0/4187868534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f242006a750 con 0x7f2420102630 2024-03-27T07:21:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.810+0000 7f2424c0e640 1 -- 172.21.15.82:0/4187868534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2420068d90 con 0x7f2420102630 2024-03-27T07:21:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.811+0000 7f24177fe640 1 -- 172.21.15.82:0/4187868534 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f2410004fa0 con 0x7f2420102630 2024-03-27T07:21:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.812+0000 7f24177fe640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f240c0a3720 0x7f240c0a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.812+0000 7f241e59c640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f240c0a3720 0x7f240c0a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.812+0000 7f24177fe640 1 -- 172.21.15.82:0/4187868534 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f24100d1430 con 0x7f2420102630 2024-03-27T07:21:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.812+0000 7f241e59c640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f240c0a3720 0x7f240c0a5be0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2420198280 tx=0x7f2418009720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:41.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.816+0000 7f24177fe640 1 -- 172.21.15.82:0/4187868534 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f241009da00 con 0x7f2420102630 2024-03-27T07:21:41.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.995+0000 7f2424c0e640 1 -- 172.21.15.82:0/4187868534 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2420107ac0 con 0x7f2420102630 2024-03-27T07:21:41.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.997+0000 7f24177fe640 1 -- 172.21.15.82:0/4187868534 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22172 (secure 0 0 0) 0x7f24100a1d00 con 0x7f2420102630 2024-03-27T07:21:41.999 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:41.999 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":86,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:21:36.555279+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:21:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 -- 172.21.15.82:0/4187868534 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f240c0a3720 msgr2=0x7f240c0a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f240c0a3720 0x7f240c0a5be0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2420198280 tx=0x7f2418009720 comp rx=0 tx=0).stop 2024-03-27T07:21:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 -- 172.21.15.82:0/4187868534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2420102630 msgr2=0x7f242019e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2420102630 0x7f242019e320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f241000eb00 tx=0x7f241000ef00 comp rx=0 tx=0).stop 2024-03-27T07:21:42.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 -- 172.21.15.82:0/4187868534 shutdown_connections 2024-03-27T07:21:42.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f240c0a3720 0x7f240c0a5be0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2420102630 0x7f242019e320 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2420101c70 0x7f24201972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 --2- 172.21.15.82:0/4187868534 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2420100a80 0x7f2420196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 -- 172.21.15.82:0/4187868534 >> 172.21.15.82:0/4187868534 conn(0x7f24200fc030 msgr2=0x7f2420104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:42.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 -- 172.21.15.82:0/4187868534 shutdown_connections 2024-03-27T07:21:42.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:41.999+0000 7f2424c0e640 1 -- 172.21.15.82:0/4187868534 wait complete. 2024-03-27T07:21:42.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:41 smithi149 ceph-mon[36065]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:42.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:41 smithi149 ceph-mon[36065]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:42.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:41 smithi149 ceph-mon[36065]: pgmap v293: 97 pgs: 90 active+clean, 7 creating+peering; 580 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 12 op/s 2024-03-27T07:21:42.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:41 smithi149 ceph-mon[36065]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:42.012 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-27T07:21:42.012 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T07:21:42.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:41 smithi153 ceph-mon[36179]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:42.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:41 smithi153 ceph-mon[36179]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:42.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:41 smithi153 ceph-mon[36179]: pgmap v293: 97 pgs: 90 active+clean, 7 creating+peering; 580 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 12 op/s 2024-03-27T07:21:42.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:41 smithi153 ceph-mon[36179]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:42.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.112+0000 7f20e1b3e640 1 -- 172.21.15.82:0/110105490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20dc101c80 msgr2=0x7f20dc102100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.112+0000 7f20e1b3e640 1 --2- 172.21.15.82:0/110105490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20dc101c80 0x7f20dc102100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009900 tx=0x7f20d002bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.112+0000 7f20e1b3e640 1 -- 172.21.15.82:0/110105490 shutdown_connections 2024-03-27T07:21:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.112+0000 7f20e1b3e640 1 --2- 172.21.15.82:0/110105490 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20dc101c80 0x7f20dc102100 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.112+0000 7f20e1b3e640 1 --2- 172.21.15.82:0/110105490 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc102640 0x7f20dc108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.112+0000 7f20e1b3e640 1 --2- 172.21.15.82:0/110105490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20dc100a90 0x7f20dc100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.112+0000 7f20e1b3e640 1 -- 172.21.15.82:0/110105490 >> 172.21.15.82:0/110105490 conn(0x7f20dc0fc000 msgr2=0x7f20dc0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.112+0000 7f20e1b3e640 1 -- 172.21.15.82:0/110105490 shutdown_connections 2024-03-27T07:21:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.112+0000 7f20e1b3e640 1 -- 172.21.15.82:0/110105490 wait complete. 2024-03-27T07:21:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20e1b3e640 1 Processor -- start 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20e1b3e640 1 -- start start 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20e1b3e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20dc100a90 0x7f20dc10b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20e1b3e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20dc101c80 0x7f20dc109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20e1b3e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc102640 0x7f20dc109f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20e1b3e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10d830 con 0x7f20dc101c80 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20e1b3e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10d6b0 con 0x7f20dc102640 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20e1b3e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20dc10d9b0 con 0x7f20dc100a90 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20daffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20dc101c80 0x7f20dc109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20daffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20dc101c80 0x7f20dc109a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35030/0 (socket says 172.21.15.82:35030) 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20daffd640 1 -- 172.21.15.82:0/1531714355 learned_addr learned my addr 172.21.15.82:0/1531714355 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20db7fe640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20dc100a90 0x7f20dc10b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.113+0000 7f20dbfff640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc102640 0x7f20dc109f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20daffd640 1 -- 172.21.15.82:0/1531714355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20dc100a90 msgr2=0x7f20dc10b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20daffd640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20dc100a90 0x7f20dc10b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20daffd640 1 -- 172.21.15.82:0/1531714355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc102640 msgr2=0x7f20dc109f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20daffd640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc102640 0x7f20dc109f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20daffd640 1 -- 172.21.15.82:0/1531714355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20dc10a820 con 0x7f20dc101c80 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20daffd640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20dc101c80 0x7f20dc109a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009230 tx=0x7f20d002c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20d8ff9640 1 -- 172.21.15.82:0/1531714355 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0041070 con 0x7f20dc101c80 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20d8ff9640 1 -- 172.21.15.82:0/1531714355 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20d0004450 con 0x7f20dc101c80 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20e1b3e640 1 -- 172.21.15.82:0/1531714355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20dc1a1f10 con 0x7f20dc101c80 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20d8ff9640 1 -- 172.21.15.82:0/1531714355 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0003e20 con 0x7f20dc101c80 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.114+0000 7f20e1b3e640 1 -- 172.21.15.82:0/1531714355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20dc1a2370 con 0x7f20dc101c80 2024-03-27T07:21:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.115+0000 7f20e1b3e640 1 -- 172.21.15.82:0/1531714355 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20dc107db0 con 0x7f20dc101c80 2024-03-27T07:21:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.116+0000 7f20d8ff9640 1 -- 172.21.15.82:0/1531714355 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f20d0044070 con 0x7f20dc101c80 2024-03-27T07:21:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.116+0000 7f20d8ff9640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20c40a36a0 0x7f20c40a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.116+0000 7f20db7fe640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20c40a36a0 0x7f20c40a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.117+0000 7f20d8ff9640 1 -- 172.21.15.82:0/1531714355 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f20d00f16c0 con 0x7f20dc101c80 2024-03-27T07:21:42.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.117+0000 7f20db7fe640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20c40a36a0 0x7f20c40a5b60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20dc101ae0 tx=0x7f20cc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:42.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.121+0000 7f20d8ff9640 1 -- 172.21.15.82:0/1531714355 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f20d00bdda0 con 0x7f20dc101c80 2024-03-27T07:21:42.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.295+0000 7f20e1b3e640 1 -- 172.21.15.82:0/1531714355 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20dc061f90 con 0x7f20c40a36a0 2024-03-27T07:21:42.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.302+0000 7f20d8ff9640 1 -- 172.21.15.82:0/1531714355 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258324 (secure 0 0 0) 0x7f20dc061f90 con 0x7f20c40a36a0 2024-03-27T07:21:42.307 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:42.309 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 -- 172.21.15.82:0/1531714355 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20c40a36a0 msgr2=0x7f20c40a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20c40a36a0 0x7f20c40a5b60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f20dc101ae0 tx=0x7f20cc005f90 comp rx=0 tx=0).stop 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 -- 172.21.15.82:0/1531714355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20dc101c80 msgr2=0x7f20dc109a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20dc101c80 0x7f20dc109a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009230 tx=0x7f20d002c650 comp rx=0 tx=0).stop 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 -- 172.21.15.82:0/1531714355 shutdown_connections 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f20c40a36a0 0x7f20c40a5b60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20dc101c80 0x7f20dc109a50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20dc102640 0x7f20dc109f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 --2- 172.21.15.82:0/1531714355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20dc100a90 0x7f20dc10b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 -- 172.21.15.82:0/1531714355 >> 172.21.15.82:0/1531714355 conn(0x7f20dc0fc000 msgr2=0x7f20dc104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:42.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 -- 172.21.15.82:0/1531714355 shutdown_connections 2024-03-27T07:21:42.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.305+0000 7f20e1b3e640 1 -- 172.21.15.82:0/1531714355 wait complete. 2024-03-27T07:21:42.318 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":293,"stamp":"2024-03-27T07:21:40.459490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594162,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":254,"num_write_kb":2957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356144,"kb_used_data":11072,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585680,"statfs":{"total":1151940427776,"available":1151575736320,"internally_reserved":0,"allocated":11337728,"data_stored":7064745,"data_compressed":107082,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19139,"internal_metadata":353154365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3794,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001305"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-03-27T07:21:34.554200+0000","last_change":"2024-03-27T07:21:34.554200+0000","last_active":"2024-03-27T07:21:34.536282+0000","last_peered":"2024-03-27T07:21:34.536282+0000","last_clean":"2024-03-27T07:21:34.536282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T07:21:34.554200+0000","last_undegraded":"2024-03-27T07:21:34.554200+0000","last_fullsized":"2024-03-27T07:21:34.554200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578201+0000","last_change":"2024-03-27T07:21:35.576197+0000","last_active":"2024-03-27T07:21:37.578201+0000","last_peered":"2024-03-27T07:21:37.578201+0000","last_clean":"2024-03-27T07:21:37.578201+0000","last_became_active":"2024-03-27T07:21:35.575876+0000","last_became_peered":"2024-03-27T07:21:35.575876+0000","last_unstale":"2024-03-27T07:21:37.578201+0000","last_undegraded":"2024-03-27T07:21:37.578201+0000","last_fullsized":"2024-03-27T07:21:37.578201+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:23:12.589029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578853+0000","last_change":"2024-03-27T07:21:35.582045+0000","last_active":"2024-03-27T07:21:37.578853+0000","last_peered":"2024-03-27T07:21:37.578853+0000","last_clean":"2024-03-27T07:21:37.578853+0000","last_became_active":"2024-03-27T07:21:35.581710+0000","last_became_peered":"2024-03-27T07:21:35.581710+0000","last_unstale":"2024-03-27T07:21:37.578853+0000","last_undegraded":"2024-03-27T07:21:37.578853+0000","last_fullsized":"2024-03-27T07:21:37.578853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:47:39.004986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.564071+0000","last_change":"2024-03-27T07:21:35.573522+0000","last_active":"2024-03-27T07:21:36.564071+0000","last_peered":"2024-03-27T07:21:36.564071+0000","last_clean":"2024-03-27T07:21:36.564071+0000","last_became_active":"2024-03-27T07:21:35.573169+0000","last_became_peered":"2024-03-27T07:21:35.573169+0000","last_unstale":"2024-03-27T07:21:36.564071+0000","last_undegraded":"2024-03-27T07:21:36.564071+0000","last_fullsized":"2024-03-27T07:21:36.564071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:40:02.621208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.573602+0000","last_change":"2024-03-27T07:21:35.568964+0000","last_active":"2024-03-27T07:21:35.573602+0000","last_peered":"2024-03-27T07:21:35.573602+0000","last_clean":"2024-03-27T07:21:35.573602+0000","last_became_active":"2024-03-27T07:21:35.568607+0000","last_became_peered":"2024-03-27T07:21:35.568607+0000","last_unstale":"2024-03-27T07:21:35.573602+0000","last_undegraded":"2024-03-27T07:21:35.573602+0000","last_fullsized":"2024-03-27T07:21:35.573602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:14:39.650109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.576326+0000","last_change":"2024-03-27T07:21:35.575915+0000","last_active":"2024-03-27T07:21:35.576326+0000","last_peered":"2024-03-27T07:21:35.576326+0000","last_clean":"2024-03-27T07:21:35.576326+0000","last_became_active":"2024-03-27T07:21:35.575604+0000","last_became_peered":"2024-03-27T07:21:35.575604+0000","last_unstale":"2024-03-27T07:21:35.576326+0000","last_undegraded":"2024-03-27T07:21:35.576326+0000","last_fullsized":"2024-03-27T07:21:35.576326+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:35:29.032980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947651+0000","last_change":"2024-03-27T07:21:35.570762+0000","last_active":"2024-03-27T07:21:36.947651+0000","last_peered":"2024-03-27T07:21:36.947651+0000","last_clean":"2024-03-27T07:21:36.947651+0000","last_became_active":"2024-03-27T07:21:35.570380+0000","last_became_peered":"2024-03-27T07:21:35.570380+0000","last_unstale":"2024-03-27T07:21:36.947651+0000","last_undegraded":"2024-03-27T07:21:36.947651+0000","last_fullsized":"2024-03-27T07:21:36.947651+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:35:04.463674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.562414+0000","last_change":"2024-03-27T07:21:35.573220+0000","last_active":"2024-03-27T07:21:36.562414+0000","last_peered":"2024-03-27T07:21:36.562414+0000","last_clean":"2024-03-27T07:21:36.562414+0000","last_became_active":"2024-03-27T07:21:35.572909+0000","last_became_peered":"2024-03-27T07:21:35.572909+0000","last_unstale":"2024-03-27T07:21:36.562414+0000","last_undegraded":"2024-03-27T07:21:36.562414+0000","last_fullsized":"2024-03-27T07:21:36.562414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:49:51.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740793+0000","last_change":"2024-03-27T07:21:35.559298+0000","last_active":"2024-03-27T07:21:36.740793+0000","last_peered":"2024-03-27T07:21:36.740793+0000","last_clean":"2024-03-27T07:21:36.740793+0000","last_became_active":"2024-03-27T07:21:35.558968+0000","last_became_peered":"2024-03-27T07:21:35.558968+0000","last_unstale":"2024-03-27T07:21:36.740793+0000","last_undegraded":"2024-03-27T07:21:36.740793+0000","last_fullsized":"2024-03-27T07:21:36.740793+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:12:31.027411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.577675+0000","last_change":"2024-03-27T07:21:35.577015+0000","last_active":"2024-03-27T07:21:35.577675+0000","last_peered":"2024-03-27T07:21:35.577675+0000","last_clean":"2024-03-27T07:21:35.577675+0000","last_became_active":"2024-03-27T07:21:35.576599+0000","last_became_peered":"2024-03-27T07:21:35.576599+0000","last_unstale":"2024-03-27T07:21:35.577675+0000","last_undegraded":"2024-03-27T07:21:35.577675+0000","last_fullsized":"2024-03-27T07:21:35.577675+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:00:53.546213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948163+0000","last_change":"2024-03-27T07:21:35.576540+0000","last_active":"2024-03-27T07:21:36.948163+0000","last_peered":"2024-03-27T07:21:36.948163+0000","last_clean":"2024-03-27T07:21:36.948163+0000","last_became_active":"2024-03-27T07:21:35.576101+0000","last_became_peered":"2024-03-27T07:21:35.576101+0000","last_unstale":"2024-03-27T07:21:36.948163+0000","last_undegraded":"2024-03-27T07:21:36.948163+0000","last_fullsized":"2024-03-27T07:21:36.948163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:13.654970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.564099+0000","last_change":"2024-03-27T07:21:35.574029+0000","last_active":"2024-03-27T07:21:36.564099+0000","last_peered":"2024-03-27T07:21:36.564099+0000","last_clean":"2024-03-27T07:21:36.564099+0000","last_became_active":"2024-03-27T07:21:35.573697+0000","last_became_peered":"2024-03-27T07:21:35.573697+0000","last_unstale":"2024-03-27T07:21:36.564099+0000","last_undegraded":"2024-03-27T07:21:36.564099+0000","last_fullsized":"2024-03-27T07:21:36.564099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:25:45.911184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947944+0000","last_change":"2024-03-27T07:21:35.559726+0000","last_active":"2024-03-27T07:21:36.947944+0000","last_peered":"2024-03-27T07:21:36.947944+0000","last_clean":"2024-03-27T07:21:36.947944+0000","last_became_active":"2024-03-27T07:21:35.559294+0000","last_became_peered":"2024-03-27T07:21:35.559294+0000","last_unstale":"2024-03-27T07:21:36.947944+0000","last_undegraded":"2024-03-27T07:21:36.947944+0000","last_fullsized":"2024-03-27T07:21:36.947944+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:27:00.364447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.577852+0000","last_change":"2024-03-27T07:21:35.577959+0000","last_active":"2024-03-27T07:21:37.577852+0000","last_peered":"2024-03-27T07:21:37.577852+0000","last_clean":"2024-03-27T07:21:37.577852+0000","last_became_active":"2024-03-27T07:21:35.577642+0000","last_became_peered":"2024-03-27T07:21:35.577642+0000","last_unstale":"2024-03-27T07:21:37.577852+0000","last_undegraded":"2024-03-27T07:21:37.577852+0000","last_fullsized":"2024-03-27T07:21:37.577852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:07:44.836888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578426+0000","last_change":"2024-03-27T07:21:35.580901+0000","last_active":"2024-03-27T07:21:37.578426+0000","last_peered":"2024-03-27T07:21:37.578426+0000","last_clean":"2024-03-27T07:21:37.578426+0000","last_became_active":"2024-03-27T07:21:35.579456+0000","last_became_peered":"2024-03-27T07:21:35.579456+0000","last_unstale":"2024-03-27T07:21:37.578426+0000","last_undegraded":"2024-03-27T07:21:37.578426+0000","last_fullsized":"2024-03-27T07:21:37.578426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:35:54.722160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740269+0000","last_change":"2024-03-27T07:21:35.574462+0000","last_active":"2024-03-27T07:21:36.740269+0000","last_peered":"2024-03-27T07:21:36.740269+0000","last_clean":"2024-03-27T07:21:36.740269+0000","last_became_active":"2024-03-27T07:21:35.574158+0000","last_became_peered":"2024-03-27T07:21:35.574158+0000","last_unstale":"2024-03-27T07:21:36.740269+0000","last_undegraded":"2024-03-27T07:21:36.740269+0000","last_fullsized":"2024-03-27T07:21:36.740269+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:16:18.756955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-03-27T07:21:34.553142+0000","last_change":"2024-03-27T07:21:34.553142+0000","last_active":"2024-03-27T07:21:34.536282+0000","last_peered":"2024-03-27T07:21:34.536282+0000","last_clean":"2024-03-27T07:21:34.536282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T07:21:34.553142+0000","last_undegraded":"2024-03-27T07:21:34.553142+0000","last_fullsized":"2024-03-27T07:21:34.553142+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.574344+0000","last_change":"2024-03-27T07:21:35.570650+0000","last_active":"2024-03-27T07:21:35.574344+0000","last_peered":"2024-03-27T07:21:35.574344+0000","last_clean":"2024-03-27T07:21:35.574344+0000","last_became_active":"2024-03-27T07:21:35.569850+0000","last_became_peered":"2024-03-27T07:21:35.569850+0000","last_unstale":"2024-03-27T07:21:35.574344+0000","last_undegraded":"2024-03-27T07:21:35.574344+0000","last_fullsized":"2024-03-27T07:21:35.574344+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:08:16.860638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948245+0000","last_change":"2024-03-27T07:21:35.566322+0000","last_active":"2024-03-27T07:21:36.948245+0000","last_peered":"2024-03-27T07:21:36.948245+0000","last_clean":"2024-03-27T07:21:36.948245+0000","last_became_active":"2024-03-27T07:21:35.565947+0000","last_became_peered":"2024-03-27T07:21:35.565947+0000","last_unstale":"2024-03-27T07:21:36.948245+0000","last_undegraded":"2024-03-27T07:21:36.948245+0000","last_fullsized":"2024-03-27T07:21:36.948245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:58:34.151735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.578285+0000","last_change":"2024-03-27T07:21:34.563517+0000","last_active":"2024-03-27T07:21:35.578285+0000","last_peered":"2024-03-27T07:21:35.578285+0000","last_clean":"2024-03-27T07:21:35.578285+0000","last_became_active":"2024-03-27T07:21:34.563169+0000","last_became_peered":"2024-03-27T07:21:34.563169+0000","last_unstale":"2024-03-27T07:21:35.578285+0000","last_undegraded":"2024-03-27T07:21:35.578285+0000","last_fullsized":"2024-03-27T07:21:35.578285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:27.818864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563000+0000","last_change":"2024-03-27T07:21:35.576918+0000","last_active":"2024-03-27T07:21:36.563000+0000","last_peered":"2024-03-27T07:21:36.563000+0000","last_clean":"2024-03-27T07:21:36.563000+0000","last_became_active":"2024-03-27T07:21:35.576581+0000","last_became_peered":"2024-03-27T07:21:35.576581+0000","last_unstale":"2024-03-27T07:21:36.563000+0000","last_undegraded":"2024-03-27T07:21:36.563000+0000","last_fullsized":"2024-03-27T07:21:36.563000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:31:54.813459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563302+0000","last_change":"2024-03-27T07:21:34.560583+0000","last_active":"2024-03-27T07:21:36.563302+0000","last_peered":"2024-03-27T07:21:36.563302+0000","last_clean":"2024-03-27T07:21:36.563302+0000","last_became_active":"2024-03-27T07:21:34.560257+0000","last_became_peered":"2024-03-27T07:21:34.560257+0000","last_unstale":"2024-03-27T07:21:36.563302+0000","last_undegraded":"2024-03-27T07:21:36.563302+0000","last_fullsized":"2024-03-27T07:21:36.563302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:25:27.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578733+0000","last_change":"2024-03-27T07:21:35.573251+0000","last_active":"2024-03-27T07:21:37.578733+0000","last_peered":"2024-03-27T07:21:37.578733+0000","last_clean":"2024-03-27T07:21:37.578733+0000","last_became_active":"2024-03-27T07:21:35.572890+0000","last_became_peered":"2024-03-27T07:21:35.572890+0000","last_unstale":"2024-03-27T07:21:37.578733+0000","last_undegraded":"2024-03-27T07:21:37.578733+0000","last_fullsized":"2024-03-27T07:21:37.578733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:49.317704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.583391+0000","last_change":"2024-03-27T07:21:34.567140+0000","last_active":"2024-03-27T07:21:35.583391+0000","last_peered":"2024-03-27T07:21:35.583391+0000","last_clean":"2024-03-27T07:21:35.583391+0000","last_became_active":"2024-03-27T07:21:34.566689+0000","last_became_peered":"2024-03-27T07:21:34.566689+0000","last_unstale":"2024-03-27T07:21:35.583391+0000","last_undegraded":"2024-03-27T07:21:35.583391+0000","last_fullsized":"2024-03-27T07:21:35.583391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:50:54.656277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740436+0000","last_change":"2024-03-27T07:21:35.565259+0000","last_active":"2024-03-27T07:21:36.740436+0000","last_peered":"2024-03-27T07:21:36.740436+0000","last_clean":"2024-03-27T07:21:36.740436+0000","last_became_active":"2024-03-27T07:21:35.564954+0000","last_became_peered":"2024-03-27T07:21:35.564954+0000","last_unstale":"2024-03-27T07:21:36.740436+0000","last_undegraded":"2024-03-27T07:21:36.740436+0000","last_fullsized":"2024-03-27T07:21:36.740436+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:02.950515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.580564+0000","last_change":"2024-03-27T07:21:34.558887+0000","last_active":"2024-03-27T07:21:35.580564+0000","last_peered":"2024-03-27T07:21:35.580564+0000","last_clean":"2024-03-27T07:21:35.580564+0000","last_became_active":"2024-03-27T07:21:34.556689+0000","last_became_peered":"2024-03-27T07:21:34.556689+0000","last_unstale":"2024-03-27T07:21:35.580564+0000","last_undegraded":"2024-03-27T07:21:35.580564+0000","last_fullsized":"2024-03-27T07:21:35.580564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:37.162440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563667+0000","last_change":"2024-03-27T07:21:35.576346+0000","last_active":"2024-03-27T07:21:36.563667+0000","last_peered":"2024-03-27T07:21:36.563667+0000","last_clean":"2024-03-27T07:21:36.563667+0000","last_became_active":"2024-03-27T07:21:35.572774+0000","last_became_peered":"2024-03-27T07:21:35.572774+0000","last_unstale":"2024-03-27T07:21:36.563667+0000","last_undegraded":"2024-03-27T07:21:36.563667+0000","last_fullsized":"2024-03-27T07:21:36.563667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:12:44.181603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.581807+0000","last_change":"2024-03-27T07:21:34.562208+0000","last_active":"2024-03-27T07:21:37.581807+0000","last_peered":"2024-03-27T07:21:37.581807+0000","last_clean":"2024-03-27T07:21:37.581807+0000","last_became_active":"2024-03-27T07:21:34.561829+0000","last_became_peered":"2024-03-27T07:21:34.561829+0000","last_unstale":"2024-03-27T07:21:37.581807+0000","last_undegraded":"2024-03-27T07:21:37.581807+0000","last_fullsized":"2024-03-27T07:21:37.581807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:01:48.845075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.576530+0000","last_change":"2024-03-27T07:21:35.575384+0000","last_active":"2024-03-27T07:21:35.576530+0000","last_peered":"2024-03-27T07:21:35.576530+0000","last_clean":"2024-03-27T07:21:35.576530+0000","last_became_active":"2024-03-27T07:21:35.574928+0000","last_became_peered":"2024-03-27T07:21:35.574928+0000","last_unstale":"2024-03-27T07:21:35.576530+0000","last_undegraded":"2024-03-27T07:21:35.576530+0000","last_fullsized":"2024-03-27T07:21:35.576530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:10.583071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.573024+0000","last_change":"2024-03-27T07:21:34.562791+0000","last_active":"2024-03-27T07:21:35.573024+0000","last_peered":"2024-03-27T07:21:35.573024+0000","last_clean":"2024-03-27T07:21:35.573024+0000","last_became_active":"2024-03-27T07:21:34.562441+0000","last_became_peered":"2024-03-27T07:21:34.562441+0000","last_unstale":"2024-03-27T07:21:35.573024+0000","last_undegraded":"2024-03-27T07:21:35.573024+0000","last_fullsized":"2024-03-27T07:21:35.573024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:44:42.509635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563629+0000","last_change":"2024-03-27T07:21:35.578022+0000","last_active":"2024-03-27T07:21:36.563629+0000","last_peered":"2024-03-27T07:21:36.563629+0000","last_clean":"2024-03-27T07:21:36.563629+0000","last_became_active":"2024-03-27T07:21:35.577665+0000","last_became_peered":"2024-03-27T07:21:35.577665+0000","last_unstale":"2024-03-27T07:21:36.563629+0000","last_undegraded":"2024-03-27T07:21:36.563629+0000","last_fullsized":"2024-03-27T07:21:36.563629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:05:40.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:38.597278+0000","last_change":"2024-03-27T07:21:34.557610+0000","last_active":"2024-03-27T07:21:38.597278+0000","last_peered":"2024-03-27T07:21:38.597278+0000","last_clean":"2024-03-27T07:21:38.597278+0000","last_became_active":"2024-03-27T07:21:34.557295+0000","last_became_peered":"2024-03-27T07:21:34.557295+0000","last_unstale":"2024-03-27T07:21:38.597278+0000","last_undegraded":"2024-03-27T07:21:38.597278+0000","last_fullsized":"2024-03-27T07:21:38.597278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:38:40.291447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.562493+0000","last_change":"2024-03-27T07:21:35.568910+0000","last_active":"2024-03-27T07:21:36.562493+0000","last_peered":"2024-03-27T07:21:36.562493+0000","last_clean":"2024-03-27T07:21:36.562493+0000","last_became_active":"2024-03-27T07:21:35.568606+0000","last_became_peered":"2024-03-27T07:21:35.568606+0000","last_unstale":"2024-03-27T07:21:36.562493+0000","last_undegraded":"2024-03-27T07:21:36.562493+0000","last_fullsized":"2024-03-27T07:21:36.562493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:04:54.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578268+0000","last_change":"2024-03-27T07:21:34.563096+0000","last_active":"2024-03-27T07:21:37.578268+0000","last_peered":"2024-03-27T07:21:37.578268+0000","last_clean":"2024-03-27T07:21:37.578268+0000","last_became_active":"2024-03-27T07:21:34.562721+0000","last_became_peered":"2024-03-27T07:21:34.562721+0000","last_unstale":"2024-03-27T07:21:37.578268+0000","last_undegraded":"2024-03-27T07:21:37.578268+0000","last_fullsized":"2024-03-27T07:21:37.578268+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:42:43.902139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.574305+0000","last_change":"2024-03-27T07:21:35.571386+0000","last_active":"2024-03-27T07:21:35.574305+0000","last_peered":"2024-03-27T07:21:35.574305+0000","last_clean":"2024-03-27T07:21:35.574305+0000","last_became_active":"2024-03-27T07:21:35.571061+0000","last_became_peered":"2024-03-27T07:21:35.571061+0000","last_unstale":"2024-03-27T07:21:35.574305+0000","last_undegraded":"2024-03-27T07:21:35.574305+0000","last_fullsized":"2024-03-27T07:21:35.574305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:42:11.223537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.554118+0000","last_change":"2024-03-27T07:21:34.561401+0000","last_active":"2024-03-27T07:21:35.554118+0000","last_peered":"2024-03-27T07:21:35.554118+0000","last_clean":"2024-03-27T07:21:35.554118+0000","last_became_active":"2024-03-27T07:21:34.561071+0000","last_became_peered":"2024-03-27T07:21:34.561071+0000","last_unstale":"2024-03-27T07:21:35.554118+0000","last_undegraded":"2024-03-27T07:21:35.554118+0000","last_fullsized":"2024-03-27T07:21:35.554118+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:41.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740661+0000","last_change":"2024-03-27T07:21:35.561505+0000","last_active":"2024-03-27T07:21:36.740661+0000","last_peered":"2024-03-27T07:21:36.740661+0000","last_clean":"2024-03-27T07:21:36.740661+0000","last_became_active":"2024-03-27T07:21:35.561166+0000","last_became_peered":"2024-03-27T07:21:35.561166+0000","last_unstale":"2024-03-27T07:21:36.740661+0000","last_undegraded":"2024-03-27T07:21:36.740661+0000","last_fullsized":"2024-03-27T07:21:36.740661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:59.179147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.579377+0000","last_change":"2024-03-27T07:21:34.565463+0000","last_active":"2024-03-27T07:21:37.579377+0000","last_peered":"2024-03-27T07:21:37.579377+0000","last_clean":"2024-03-27T07:21:37.579377+0000","last_became_active":"2024-03-27T07:21:34.565054+0000","last_became_peered":"2024-03-27T07:21:34.565054+0000","last_unstale":"2024-03-27T07:21:37.579377+0000","last_undegraded":"2024-03-27T07:21:37.579377+0000","last_fullsized":"2024-03-27T07:21:37.579377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:19:16.820790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578536+0000","last_change":"2024-03-27T07:21:35.574795+0000","last_active":"2024-03-27T07:21:37.578536+0000","last_peered":"2024-03-27T07:21:37.578536+0000","last_clean":"2024-03-27T07:21:37.578536+0000","last_became_active":"2024-03-27T07:21:35.574534+0000","last_became_peered":"2024-03-27T07:21:35.574534+0000","last_unstale":"2024-03-27T07:21:37.578536+0000","last_undegraded":"2024-03-27T07:21:37.578536+0000","last_fullsized":"2024-03-27T07:21:37.578536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:46:44.777575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.580591+0000","last_change":"2024-03-27T07:21:34.555772+0000","last_active":"2024-03-27T07:21:37.580591+0000","last_peered":"2024-03-27T07:21:37.580591+0000","last_clean":"2024-03-27T07:21:37.580591+0000","last_became_active":"2024-03-27T07:21:34.555430+0000","last_became_peered":"2024-03-27T07:21:34.555430+0000","last_unstale":"2024-03-27T07:21:37.580591+0000","last_undegraded":"2024-03-27T07:21:37.580591+0000","last_fullsized":"2024-03-27T07:21:37.580591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:11:48.058887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740553+0000","last_change":"2024-03-27T07:21:35.573184+0000","last_active":"2024-03-27T07:21:36.740553+0000","last_peered":"2024-03-27T07:21:36.740553+0000","last_clean":"2024-03-27T07:21:36.740553+0000","last_became_active":"2024-03-27T07:21:35.572776+0000","last_became_peered":"2024-03-27T07:21:35.572776+0000","last_unstale":"2024-03-27T07:21:36.740553+0000","last_undegraded":"2024-03-27T07:21:36.740553+0000","last_fullsized":"2024-03-27T07:21:36.740553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:03.122229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.581627+0000","last_change":"2024-03-27T07:21:34.563221+0000","last_active":"2024-03-27T07:21:35.581627+0000","last_peered":"2024-03-27T07:21:35.581627+0000","last_clean":"2024-03-27T07:21:35.581627+0000","last_became_active":"2024-03-27T07:21:34.562679+0000","last_became_peered":"2024-03-27T07:21:34.562679+0000","last_unstale":"2024-03-27T07:21:35.581627+0000","last_undegraded":"2024-03-27T07:21:35.581627+0000","last_fullsized":"2024-03-27T07:21:35.581627+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:59.795906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.575969+0000","last_change":"2024-03-27T07:21:35.573408+0000","last_active":"2024-03-27T07:21:35.575969+0000","last_peered":"2024-03-27T07:21:35.575969+0000","last_clean":"2024-03-27T07:21:35.575969+0000","last_became_active":"2024-03-27T07:21:35.572912+0000","last_became_peered":"2024-03-27T07:21:35.572912+0000","last_unstale":"2024-03-27T07:21:35.575969+0000","last_undegraded":"2024-03-27T07:21:35.575969+0000","last_fullsized":"2024-03-27T07:21:35.575969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:37:30.762275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578957+0000","last_change":"2024-03-27T07:21:34.562237+0000","last_active":"2024-03-27T07:21:37.578957+0000","last_peered":"2024-03-27T07:21:37.578957+0000","last_clean":"2024-03-27T07:21:37.578957+0000","last_became_active":"2024-03-27T07:21:34.561895+0000","last_became_peered":"2024-03-27T07:21:34.561895+0000","last_unstale":"2024-03-27T07:21:37.578957+0000","last_undegraded":"2024-03-27T07:21:37.578957+0000","last_fullsized":"2024-03-27T07:21:37.578957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:39:09.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947877+0000","last_change":"2024-03-27T07:21:35.571870+0000","last_active":"2024-03-27T07:21:36.947877+0000","last_peered":"2024-03-27T07:21:36.947877+0000","last_clean":"2024-03-27T07:21:36.947877+0000","last_became_active":"2024-03-27T07:21:35.571272+0000","last_became_peered":"2024-03-27T07:21:35.571272+0000","last_unstale":"2024-03-27T07:21:36.947877+0000","last_undegraded":"2024-03-27T07:21:36.947877+0000","last_fullsized":"2024-03-27T07:21:36.947877+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:08:08.374114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578734+0000","last_change":"2024-03-27T07:21:34.563257+0000","last_active":"2024-03-27T07:21:37.578734+0000","last_peered":"2024-03-27T07:21:37.578734+0000","last_clean":"2024-03-27T07:21:37.578734+0000","last_became_active":"2024-03-27T07:21:34.562777+0000","last_became_peered":"2024-03-27T07:21:34.562777+0000","last_unstale":"2024-03-27T07:21:37.578734+0000","last_undegraded":"2024-03-27T07:21:37.578734+0000","last_fullsized":"2024-03-27T07:21:37.578734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:03.873185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947682+0000","last_change":"2024-03-27T07:21:35.568039+0000","last_active":"2024-03-27T07:21:36.947682+0000","last_peered":"2024-03-27T07:21:36.947682+0000","last_clean":"2024-03-27T07:21:36.947682+0000","last_became_active":"2024-03-27T07:21:35.567680+0000","last_became_peered":"2024-03-27T07:21:35.567680+0000","last_unstale":"2024-03-27T07:21:36.947682+0000","last_undegraded":"2024-03-27T07:21:36.947682+0000","last_fullsized":"2024-03-27T07:21:36.947682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:51:31.223267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563639+0000","last_change":"2024-03-27T07:21:34.560885+0000","last_active":"2024-03-27T07:21:36.563639+0000","last_peered":"2024-03-27T07:21:36.563639+0000","last_clean":"2024-03-27T07:21:36.563639+0000","last_became_active":"2024-03-27T07:21:34.560431+0000","last_became_peered":"2024-03-27T07:21:34.560431+0000","last_unstale":"2024-03-27T07:21:36.563639+0000","last_undegraded":"2024-03-27T07:21:36.563639+0000","last_fullsized":"2024-03-27T07:21:36.563639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:19:00.526827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947110+0000","last_change":"2024-03-27T07:21:35.569293+0000","last_active":"2024-03-27T07:21:36.947110+0000","last_peered":"2024-03-27T07:21:36.947110+0000","last_clean":"2024-03-27T07:21:36.947110+0000","last_became_active":"2024-03-27T07:21:35.568962+0000","last_became_peered":"2024-03-27T07:21:35.568962+0000","last_unstale":"2024-03-27T07:21:36.947110+0000","last_undegraded":"2024-03-27T07:21:36.947110+0000","last_fullsized":"2024-03-27T07:21:36.947110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:14:09.947298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.584640+0000","last_change":"2024-03-27T07:21:34.569232+0000","last_active":"2024-03-27T07:21:35.584640+0000","last_peered":"2024-03-27T07:21:35.584640+0000","last_clean":"2024-03-27T07:21:35.584640+0000","last_became_active":"2024-03-27T07:21:34.568900+0000","last_became_peered":"2024-03-27T07:21:34.568900+0000","last_unstale":"2024-03-27T07:21:35.584640+0000","last_undegraded":"2024-03-27T07:21:35.584640+0000","last_fullsized":"2024-03-27T07:21:35.584640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:27:55.489262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563174+0000","last_change":"2024-03-27T07:21:35.577020+0000","last_active":"2024-03-27T07:21:36.563174+0000","last_peered":"2024-03-27T07:21:36.563174+0000","last_clean":"2024-03-27T07:21:36.563174+0000","last_became_active":"2024-03-27T07:21:35.576696+0000","last_became_peered":"2024-03-27T07:21:35.576696+0000","last_unstale":"2024-03-27T07:21:36.563174+0000","last_undegraded":"2024-03-27T07:21:36.563174+0000","last_fullsized":"2024-03-27T07:21:36.563174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:37:35.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.580184+0000","last_change":"2024-03-27T07:21:34.562496+0000","last_active":"2024-03-27T07:21:35.580184+0000","last_peered":"2024-03-27T07:21:35.580184+0000","last_clean":"2024-03-27T07:21:35.580184+0000","last_became_active":"2024-03-27T07:21:34.562166+0000","last_became_peered":"2024-03-27T07:21:34.562166+0000","last_unstale":"2024-03-27T07:21:35.580184+0000","last_undegraded":"2024-03-27T07:21:35.580184+0000","last_fullsized":"2024-03-27T07:21:35.580184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:38.828496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-03-27T07:21:34.553619+0000","last_change":"2024-03-27T07:21:34.553619+0000","last_active":"2024-03-27T07:21:34.536282+0000","last_peered":"2024-03-27T07:21:34.536282+0000","last_clean":"2024-03-27T07:21:34.536282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T07:21:34.553619+0000","last_undegraded":"2024-03-27T07:21:34.553619+0000","last_fullsized":"2024-03-27T07:21:34.553619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.553596+0000","last_change":"2024-03-27T07:21:34.560289+0000","last_active":"2024-03-27T07:21:35.553596+0000","last_peered":"2024-03-27T07:21:35.553596+0000","last_clean":"2024-03-27T07:21:35.553596+0000","last_became_active":"2024-03-27T07:21:34.559985+0000","last_became_peered":"2024-03-27T07:21:34.559985+0000","last_unstale":"2024-03-27T07:21:35.553596+0000","last_undegraded":"2024-03-27T07:21:35.553596+0000","last_fullsized":"2024-03-27T07:21:35.553596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:45:46.611725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.580496+0000","last_change":"2024-03-27T07:21:35.579626+0000","last_active":"2024-03-27T07:21:35.580496+0000","last_peered":"2024-03-27T07:21:35.580496+0000","last_clean":"2024-03-27T07:21:35.580496+0000","last_became_active":"2024-03-27T07:21:35.579173+0000","last_became_peered":"2024-03-27T07:21:35.579173+0000","last_unstale":"2024-03-27T07:21:35.580496+0000","last_undegraded":"2024-03-27T07:21:35.580496+0000","last_fullsized":"2024-03-27T07:21:35.580496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:26:34.449939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947263+0000","last_change":"2024-03-27T07:21:34.568216+0000","last_active":"2024-03-27T07:21:36.947263+0000","last_peered":"2024-03-27T07:21:36.947263+0000","last_clean":"2024-03-27T07:21:36.947263+0000","last_became_active":"2024-03-27T07:21:34.567468+0000","last_became_peered":"2024-03-27T07:21:34.567468+0000","last_unstale":"2024-03-27T07:21:36.947263+0000","last_undegraded":"2024-03-27T07:21:36.947263+0000","last_fullsized":"2024-03-27T07:21:36.947263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:44:50.359865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.575106+0000","last_change":"2024-03-27T07:21:35.574614+0000","last_active":"2024-03-27T07:21:35.575106+0000","last_peered":"2024-03-27T07:21:35.575106+0000","last_clean":"2024-03-27T07:21:35.575106+0000","last_became_active":"2024-03-27T07:21:35.574274+0000","last_became_peered":"2024-03-27T07:21:35.574274+0000","last_unstale":"2024-03-27T07:21:35.575106+0000","last_undegraded":"2024-03-27T07:21:35.575106+0000","last_fullsized":"2024-03-27T07:21:35.575106+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:14:33.765586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563530+0000","last_change":"2024-03-27T07:21:35.573196+0000","last_active":"2024-03-27T07:21:36.563530+0000","last_peered":"2024-03-27T07:21:36.563530+0000","last_clean":"2024-03-27T07:21:36.563530+0000","last_became_active":"2024-03-27T07:21:35.572852+0000","last_became_peered":"2024-03-27T07:21:35.572852+0000","last_unstale":"2024-03-27T07:21:36.563530+0000","last_undegraded":"2024-03-27T07:21:36.563530+0000","last_fullsized":"2024-03-27T07:21:36.563530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:00.478573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:38.597421+0000","last_change":"2024-03-27T07:21:34.566380+0000","last_active":"2024-03-27T07:21:38.597421+0000","last_peered":"2024-03-27T07:21:38.597421+0000","last_clean":"2024-03-27T07:21:38.597421+0000","last_became_active":"2024-03-27T07:21:34.566034+0000","last_became_peered":"2024-03-27T07:21:34.566034+0000","last_unstale":"2024-03-27T07:21:38.597421+0000","last_undegraded":"2024-03-27T07:21:38.597421+0000","last_fullsized":"2024-03-27T07:21:38.597421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:06.470957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.562958+0000","last_change":"2024-03-27T07:21:35.576149+0000","last_active":"2024-03-27T07:21:36.562958+0000","last_peered":"2024-03-27T07:21:36.562958+0000","last_clean":"2024-03-27T07:21:36.562958+0000","last_became_active":"2024-03-27T07:21:35.573628+0000","last_became_peered":"2024-03-27T07:21:35.573628+0000","last_unstale":"2024-03-27T07:21:36.562958+0000","last_undegraded":"2024-03-27T07:21:36.562958+0000","last_fullsized":"2024-03-27T07:21:36.562958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:37:06.571848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563783+0000","last_change":"2024-03-27T07:21:34.555206+0000","last_active":"2024-03-27T07:21:36.563783+0000","last_peered":"2024-03-27T07:21:36.563783+0000","last_clean":"2024-03-27T07:21:36.563783+0000","last_became_active":"2024-03-27T07:21:34.554789+0000","last_became_peered":"2024-03-27T07:21:34.554789+0000","last_unstale":"2024-03-27T07:21:36.563783+0000","last_undegraded":"2024-03-27T07:21:36.563783+0000","last_fullsized":"2024-03-27T07:21:36.563783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:24:37.211394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947067+0000","last_change":"2024-03-27T07:20:20.641816+0000","last_active":"2024-03-27T07:21:36.947067+0000","last_peered":"2024-03-27T07:21:36.947067+0000","last_clean":"2024-03-27T07:21:36.947067+0000","last_became_active":"2024-03-27T07:20:20.641398+0000","last_became_peered":"2024-03-27T07:20:20.641398+0000","last_unstale":"2024-03-27T07:21:36.947067+0000","last_undegraded":"2024-03-27T07:21:36.947067+0000","last_fullsized":"2024-03-27T07:21:36.947067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_clean_scrub_stamp":"2024-03-27T07:16:54.496466+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:52:56.728469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947605+0000","last_change":"2024-03-27T07:21:35.562594+0000","last_active":"2024-03-27T07:21:36.947605+0000","last_peered":"2024-03-27T07:21:36.947605+0000","last_clean":"2024-03-27T07:21:36.947605+0000","last_became_active":"2024-03-27T07:21:35.562287+0000","last_became_peered":"2024-03-27T07:21:35.562287+0000","last_unstale":"2024-03-27T07:21:36.947605+0000","last_undegraded":"2024-03-27T07:21:36.947605+0000","last_fullsized":"2024-03-27T07:21:36.947605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:38:25.172452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:38.594311+0000","last_change":"2024-03-27T07:21:34.564569+0000","last_active":"2024-03-27T07:21:38.594311+0000","last_peered":"2024-03-27T07:21:38.594311+0000","last_clean":"2024-03-27T07:21:38.594311+0000","last_became_active":"2024-03-27T07:21:34.563830+0000","last_became_peered":"2024-03-27T07:21:34.563830+0000","last_unstale":"2024-03-27T07:21:38.594311+0000","last_undegraded":"2024-03-27T07:21:38.594311+0000","last_fullsized":"2024-03-27T07:21:38.594311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:46:19.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.561239+0000","last_change":"2024-03-27T07:21:34.569447+0000","last_active":"2024-03-27T07:21:35.561239+0000","last_peered":"2024-03-27T07:21:35.561239+0000","last_clean":"2024-03-27T07:21:35.561239+0000","last_became_active":"2024-03-27T07:21:34.569096+0000","last_became_peered":"2024-03-27T07:21:34.569096+0000","last_unstale":"2024-03-27T07:21:35.561239+0000","last_undegraded":"2024-03-27T07:21:35.561239+0000","last_fullsized":"2024-03-27T07:21:35.561239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:49:00.695556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947772+0000","last_change":"2024-03-27T07:21:35.558620+0000","last_active":"2024-03-27T07:21:36.947772+0000","last_peered":"2024-03-27T07:21:36.947772+0000","last_clean":"2024-03-27T07:21:36.947772+0000","last_became_active":"2024-03-27T07:21:35.557559+0000","last_became_peered":"2024-03-27T07:21:35.557559+0000","last_unstale":"2024-03-27T07:21:36.947772+0000","last_undegraded":"2024-03-27T07:21:36.947772+0000","last_fullsized":"2024-03-27T07:21:36.947772+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:09:03.236893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.553416+0000","last_change":"2024-03-27T07:21:34.557388+0000","last_active":"2024-03-27T07:21:35.553416+0000","last_peered":"2024-03-27T07:21:35.553416+0000","last_clean":"2024-03-27T07:21:35.553416+0000","last_became_active":"2024-03-27T07:21:34.557051+0000","last_became_peered":"2024-03-27T07:21:34.557051+0000","last_unstale":"2024-03-27T07:21:35.553416+0000","last_undegraded":"2024-03-27T07:21:35.553416+0000","last_fullsized":"2024-03-27T07:21:35.553416+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:43:35.184715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563180+0000","last_change":"2024-03-27T07:21:35.573345+0000","last_active":"2024-03-27T07:21:36.563180+0000","last_peered":"2024-03-27T07:21:36.563180+0000","last_clean":"2024-03-27T07:21:36.563180+0000","last_became_active":"2024-03-27T07:21:35.573037+0000","last_became_peered":"2024-03-27T07:21:35.573037+0000","last_unstale":"2024-03-27T07:21:36.563180+0000","last_undegraded":"2024-03-27T07:21:36.563180+0000","last_fullsized":"2024-03-27T07:21:36.563180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:07:49.834272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563971+0000","last_change":"2024-03-27T07:21:34.558738+0000","last_active":"2024-03-27T07:21:36.563971+0000","last_peered":"2024-03-27T07:21:36.563971+0000","last_clean":"2024-03-27T07:21:36.563971+0000","last_became_active":"2024-03-27T07:21:34.558353+0000","last_became_peered":"2024-03-27T07:21:34.558353+0000","last_unstale":"2024-03-27T07:21:36.563971+0000","last_undegraded":"2024-03-27T07:21:36.563971+0000","last_fullsized":"2024-03-27T07:21:36.563971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:46:07.816121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578414+0000","last_change":"2024-03-27T07:21:35.575747+0000","last_active":"2024-03-27T07:21:37.578414+0000","last_peered":"2024-03-27T07:21:37.578414+0000","last_clean":"2024-03-27T07:21:37.578414+0000","last_became_active":"2024-03-27T07:21:35.575382+0000","last_became_peered":"2024-03-27T07:21:35.575382+0000","last_unstale":"2024-03-27T07:21:37.578414+0000","last_undegraded":"2024-03-27T07:21:37.578414+0000","last_fullsized":"2024-03-27T07:21:37.578414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:10:03.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.580116+0000","last_change":"2024-03-27T07:21:34.563713+0000","last_active":"2024-03-27T07:21:37.580116+0000","last_peered":"2024-03-27T07:21:37.580116+0000","last_clean":"2024-03-27T07:21:37.580116+0000","last_became_active":"2024-03-27T07:21:34.563356+0000","last_became_peered":"2024-03-27T07:21:34.563356+0000","last_unstale":"2024-03-27T07:21:37.580116+0000","last_undegraded":"2024-03-27T07:21:37.580116+0000","last_fullsized":"2024-03-27T07:21:37.580116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:48:11.366029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.574321+0000","last_change":"2024-03-27T07:21:35.569912+0000","last_active":"2024-03-27T07:21:35.574321+0000","last_peered":"2024-03-27T07:21:35.574321+0000","last_clean":"2024-03-27T07:21:35.574321+0000","last_became_active":"2024-03-27T07:21:35.569546+0000","last_became_peered":"2024-03-27T07:21:35.569546+0000","last_unstale":"2024-03-27T07:21:35.574321+0000","last_undegraded":"2024-03-27T07:21:35.574321+0000","last_fullsized":"2024-03-27T07:21:35.574321+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:59:21.283438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.580211+0000","last_change":"2024-03-27T07:21:34.557719+0000","last_active":"2024-03-27T07:21:37.580211+0000","last_peered":"2024-03-27T07:21:37.580211+0000","last_clean":"2024-03-27T07:21:37.580211+0000","last_became_active":"2024-03-27T07:21:34.557360+0000","last_became_peered":"2024-03-27T07:21:34.557360+0000","last_unstale":"2024-03-27T07:21:37.580211+0000","last_undegraded":"2024-03-27T07:21:37.580211+0000","last_fullsized":"2024-03-27T07:21:37.580211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:24:47.002674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-03-27T07:21:34.551445+0000","last_change":"2024-03-27T07:21:34.551445+0000","last_active":"2024-03-27T07:21:34.536282+0000","last_peered":"2024-03-27T07:21:34.536282+0000","last_clean":"2024-03-27T07:21:34.536282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T07:21:34.551445+0000","last_undegraded":"2024-03-27T07:21:34.551445+0000","last_fullsized":"2024-03-27T07:21:34.551445+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947599+0000","last_change":"2024-03-27T07:21:34.559276+0000","last_active":"2024-03-27T07:21:36.947599+0000","last_peered":"2024-03-27T07:21:36.947599+0000","last_clean":"2024-03-27T07:21:36.947599+0000","last_became_active":"2024-03-27T07:21:34.558643+0000","last_became_peered":"2024-03-27T07:21:34.558643+0000","last_unstale":"2024-03-27T07:21:36.947599+0000","last_undegraded":"2024-03-27T07:21:36.947599+0000","last_fullsized":"2024-03-27T07:21:36.947599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:57:10.034983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.562929+0000","last_change":"2024-03-27T07:21:35.577445+0000","last_active":"2024-03-27T07:21:36.562929+0000","last_peered":"2024-03-27T07:21:36.562929+0000","last_clean":"2024-03-27T07:21:36.562929+0000","last_became_active":"2024-03-27T07:21:35.577110+0000","last_became_peered":"2024-03-27T07:21:35.577110+0000","last_unstale":"2024-03-27T07:21:36.562929+0000","last_undegraded":"2024-03-27T07:21:36.562929+0000","last_fullsized":"2024-03-27T07:21:36.562929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:36:45.919519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-03-27T07:21:35.582096+0000","last_change":"2024-03-27T07:21:34.567744+0000","last_active":"2024-03-27T07:21:35.582096+0000","last_peered":"2024-03-27T07:21:35.582096+0000","last_clean":"2024-03-27T07:21:35.582096+0000","last_became_active":"2024-03-27T07:21:34.567412+0000","last_became_peered":"2024-03-27T07:21:34.567412+0000","last_unstale":"2024-03-27T07:21:35.582096+0000","last_undegraded":"2024-03-27T07:21:35.582096+0000","last_fullsized":"2024-03-27T07:21:35.582096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:37:07.075048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947419+0000","last_change":"2024-03-27T07:21:35.570287+0000","last_active":"2024-03-27T07:21:36.947419+0000","last_peered":"2024-03-27T07:21:36.947419+0000","last_clean":"2024-03-27T07:21:36.947419+0000","last_became_active":"2024-03-27T07:21:35.569194+0000","last_became_peered":"2024-03-27T07:21:35.569194+0000","last_unstale":"2024-03-27T07:21:36.947419+0000","last_undegraded":"2024-03-27T07:21:36.947419+0000","last_fullsized":"2024-03-27T07:21:36.947419+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:01:44.155291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947803+0000","last_change":"2024-03-27T07:21:34.561420+0000","last_active":"2024-03-27T07:21:36.947803+0000","last_peered":"2024-03-27T07:21:36.947803+0000","last_clean":"2024-03-27T07:21:36.947803+0000","last_became_active":"2024-03-27T07:21:34.560923+0000","last_became_peered":"2024-03-27T07:21:34.560923+0000","last_unstale":"2024-03-27T07:21:36.947803+0000","last_undegraded":"2024-03-27T07:21:36.947803+0000","last_fullsized":"2024-03-27T07:21:36.947803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:39:48.256790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948330+0000","last_change":"2024-03-27T07:21:35.571317+0000","last_active":"2024-03-27T07:21:36.948330+0000","last_peered":"2024-03-27T07:21:36.948330+0000","last_clean":"2024-03-27T07:21:36.948330+0000","last_became_active":"2024-03-27T07:21:35.570237+0000","last_became_peered":"2024-03-27T07:21:35.570237+0000","last_unstale":"2024-03-27T07:21:36.948330+0000","last_undegraded":"2024-03-27T07:21:36.948330+0000","last_fullsized":"2024-03-27T07:21:36.948330+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:09:53.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563562+0000","last_change":"2024-03-27T07:21:34.553377+0000","last_active":"2024-03-27T07:21:36.563562+0000","last_peered":"2024-03-27T07:21:36.563562+0000","last_clean":"2024-03-27T07:21:36.563562+0000","last_became_active":"2024-03-27T07:21:34.553050+0000","last_became_peered":"2024-03-27T07:21:34.553050+0000","last_unstale":"2024-03-27T07:21:36.563562+0000","last_undegraded":"2024-03-27T07:21:36.563562+0000","last_fullsized":"2024-03-27T07:21:36.563562+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:03.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947556+0000","last_change":"2024-03-27T07:21:35.572384+0000","last_active":"2024-03-27T07:21:36.947556+0000","last_peered":"2024-03-27T07:21:36.947556+0000","last_clean":"2024-03-27T07:21:36.947556+0000","last_became_active":"2024-03-27T07:21:35.572071+0000","last_became_peered":"2024-03-27T07:21:35.572071+0000","last_unstale":"2024-03-27T07:21:36.947556+0000","last_undegraded":"2024-03-27T07:21:36.947556+0000","last_fullsized":"2024-03-27T07:21:36.947556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:03:04.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947554+0000","last_change":"2024-03-27T07:21:34.559187+0000","last_active":"2024-03-27T07:21:36.947554+0000","last_peered":"2024-03-27T07:21:36.947554+0000","last_clean":"2024-03-27T07:21:36.947554+0000","last_became_active":"2024-03-27T07:21:34.558675+0000","last_became_peered":"2024-03-27T07:21:34.558675+0000","last_unstale":"2024-03-27T07:21:36.947554+0000","last_undegraded":"2024-03-27T07:21:36.947554+0000","last_fullsized":"2024-03-27T07:21:36.947554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:41.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947853+0000","last_change":"2024-03-27T07:21:35.576440+0000","last_active":"2024-03-27T07:21:36.947853+0000","last_peered":"2024-03-27T07:21:36.947853+0000","last_clean":"2024-03-27T07:21:36.947853+0000","last_became_active":"2024-03-27T07:21:35.576143+0000","last_became_peered":"2024-03-27T07:21:35.576143+0000","last_unstale":"2024-03-27T07:21:36.947853+0000","last_undegraded":"2024-03-27T07:21:36.947853+0000","last_fullsized":"2024-03-27T07:21:36.947853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:31:29.400053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-03-27T07:21:34.552083+0000","last_change":"2024-03-27T07:21:34.552083+0000","last_active":"2024-03-27T07:21:34.536282+0000","last_peered":"2024-03-27T07:21:34.536282+0000","last_clean":"2024-03-27T07:21:34.536282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T07:21:34.552083+0000","last_undegraded":"2024-03-27T07:21:34.552083+0000","last_fullsized":"2024-03-27T07:21:34.552083+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947631+0000","last_change":"2024-03-27T07:21:35.564100+0000","last_active":"2024-03-27T07:21:36.947631+0000","last_peered":"2024-03-27T07:21:36.947631+0000","last_clean":"2024-03-27T07:21:36.947631+0000","last_became_active":"2024-03-27T07:21:35.563748+0000","last_became_peered":"2024-03-27T07:21:35.563748+0000","last_unstale":"2024-03-27T07:21:36.947631+0000","last_undegraded":"2024-03-27T07:21:36.947631+0000","last_fullsized":"2024-03-27T07:21:36.947631+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:19:30.742692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947613+0000","last_change":"2024-03-27T07:21:35.575036+0000","last_active":"2024-03-27T07:21:36.947613+0000","last_peered":"2024-03-27T07:21:36.947613+0000","last_clean":"2024-03-27T07:21:36.947613+0000","last_became_active":"2024-03-27T07:21:35.574689+0000","last_became_peered":"2024-03-27T07:21:35.574689+0000","last_unstale":"2024-03-27T07:21:36.947613+0000","last_undegraded":"2024-03-27T07:21:36.947613+0000","last_fullsized":"2024-03-27T07:21:36.947613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:50:40.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.579017+0000","last_change":"2024-03-27T07:21:35.577814+0000","last_active":"2024-03-27T07:21:37.579017+0000","last_peered":"2024-03-27T07:21:37.579017+0000","last_clean":"2024-03-27T07:21:37.579017+0000","last_became_active":"2024-03-27T07:21:35.576265+0000","last_became_peered":"2024-03-27T07:21:35.576265+0000","last_unstale":"2024-03-27T07:21:37.579017+0000","last_undegraded":"2024-03-27T07:21:37.579017+0000","last_fullsized":"2024-03-27T07:21:37.579017+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:04.523768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948012+0000","last_change":"2024-03-27T07:21:35.568753+0000","last_active":"2024-03-27T07:21:36.948012+0000","last_peered":"2024-03-27T07:21:36.948012+0000","last_clean":"2024-03-27T07:21:36.948012+0000","last_became_active":"2024-03-27T07:21:35.568441+0000","last_became_peered":"2024-03-27T07:21:35.568441+0000","last_unstale":"2024-03-27T07:21:36.948012+0000","last_undegraded":"2024-03-27T07:21:36.948012+0000","last_fullsized":"2024-03-27T07:21:36.948012+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:32:54.294960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-03-27T07:21:34.553100+0000","last_change":"2024-03-27T07:21:34.553100+0000","last_active":"2024-03-27T07:21:34.536282+0000","last_peered":"2024-03-27T07:21:34.536282+0000","last_clean":"2024-03-27T07:21:34.536282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T07:21:34.553100+0000","last_undegraded":"2024-03-27T07:21:34.553100+0000","last_fullsized":"2024-03-27T07:21:34.553100+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948138+0000","last_change":"2024-03-27T07:21:35.580647+0000","last_active":"2024-03-27T07:21:36.948138+0000","last_peered":"2024-03-27T07:21:36.948138+0000","last_clean":"2024-03-27T07:21:36.948138+0000","last_became_active":"2024-03-27T07:21:35.580230+0000","last_became_peered":"2024-03-27T07:21:35.580230+0000","last_unstale":"2024-03-27T07:21:36.948138+0000","last_undegraded":"2024-03-27T07:21:36.948138+0000","last_fullsized":"2024-03-27T07:21:36.948138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:04:37.573021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563204+0000","last_change":"2024-03-27T07:21:35.568859+0000","last_active":"2024-03-27T07:21:36.563204+0000","last_peered":"2024-03-27T07:21:36.563204+0000","last_clean":"2024-03-27T07:21:36.563204+0000","last_became_active":"2024-03-27T07:21:35.568468+0000","last_became_peered":"2024-03-27T07:21:35.568468+0000","last_unstale":"2024-03-27T07:21:36.563204+0000","last_undegraded":"2024-03-27T07:21:36.563204+0000","last_fullsized":"2024-03-27T07:21:36.563204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:44:59.875882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563129+0000","last_change":"2024-03-27T07:21:35.568485+0000","last_active":"2024-03-27T07:21:36.563129+0000","last_peered":"2024-03-27T07:21:36.563129+0000","last_clean":"2024-03-27T07:21:36.563129+0000","last_became_active":"2024-03-27T07:21:35.568154+0000","last_became_peered":"2024-03-27T07:21:35.568154+0000","last_unstale":"2024-03-27T07:21:36.563129+0000","last_undegraded":"2024-03-27T07:21:36.563129+0000","last_fullsized":"2024-03-27T07:21:36.563129+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:08:29.418189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.562698+0000","last_change":"2024-03-27T07:21:35.567369+0000","last_active":"2024-03-27T07:21:36.562698+0000","last_peered":"2024-03-27T07:21:36.562698+0000","last_clean":"2024-03-27T07:21:36.562698+0000","last_became_active":"2024-03-27T07:21:35.564602+0000","last_became_peered":"2024-03-27T07:21:35.564602+0000","last_unstale":"2024-03-27T07:21:36.562698+0000","last_undegraded":"2024-03-27T07:21:36.562698+0000","last_fullsized":"2024-03-27T07:21:36.562698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:23:15.123502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740456+0000","last_change":"2024-03-27T07:21:35.572580+0000","last_active":"2024-03-27T07:21:36.740456+0000","last_peered":"2024-03-27T07:21:36.740456+0000","last_clean":"2024-03-27T07:21:36.740456+0000","last_became_active":"2024-03-27T07:21:35.572245+0000","last_became_peered":"2024-03-27T07:21:35.572245+0000","last_unstale":"2024-03-27T07:21:36.740456+0000","last_undegraded":"2024-03-27T07:21:36.740456+0000","last_fullsized":"2024-03-27T07:21:36.740456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:45:56.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947887+0000","last_change":"2024-03-27T07:21:35.584975+0000","last_active":"2024-03-27T07:21:36.947887+0000","last_peered":"2024-03-27T07:21:36.947887+0000","last_clean":"2024-03-27T07:21:36.947887+0000","last_became_active":"2024-03-27T07:21:35.584579+0000","last_became_peered":"2024-03-27T07:21:35.584579+0000","last_unstale":"2024-03-27T07:21:36.947887+0000","last_undegraded":"2024-03-27T07:21:36.947887+0000","last_fullsized":"2024-03-27T07:21:36.947887+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:22:44.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":84,"state":"creating+peering","last_fresh":"2024-03-27T07:21:34.552011+0000","last_change":"2024-03-27T07:21:34.552011+0000","last_active":"2024-03-27T07:21:34.536282+0000","last_peered":"2024-03-27T07:21:34.536282+0000","last_clean":"2024-03-27T07:21:34.536282+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T07:21:34.552011+0000","last_undegraded":"2024-03-27T07:21:34.552011+0000","last_fullsized":"2024-03-27T07:21:34.552011+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280632,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3794,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":167936,"data_stored":11924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66,"ondisk_log_size":66,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350989,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":426232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612626,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":1027483,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776152,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":435891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037789,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":921600,"data_stored":435913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299427,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":1036039,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":443879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":445491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":954368,"data_stored":445357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":950272,"data_stored":446147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":443983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920818,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":929792,"data_stored":443901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":1034429,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T07:21:42.323 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T07:21:42.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.459+0000 7f1517e40640 1 -- 172.21.15.82:0/2279059046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1510101b70 msgr2=0x7f1510101f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.459+0000 7f1517e40640 1 --2- 172.21.15.82:0/2279059046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1510101b70 0x7f1510101f90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f150c009900 tx=0x7f150c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.459+0000 7f1517e40640 1 -- 172.21.15.82:0/2279059046 shutdown_connections 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.459+0000 7f1517e40640 1 --2- 172.21.15.82:0/2279059046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1510103720 0x7f1510109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.459+0000 7f1517e40640 1 --2- 172.21.15.82:0/2279059046 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510102d60 0x7f15101031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.459+0000 7f1517e40640 1 --2- 172.21.15.82:0/2279059046 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1510101b70 0x7f1510101f90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.459+0000 7f1517e40640 1 -- 172.21.15.82:0/2279059046 >> 172.21.15.82:0/2279059046 conn(0x7f15100fd100 msgr2=0x7f15100ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.459+0000 7f1517e40640 1 -- 172.21.15.82:0/2279059046 shutdown_connections 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.459+0000 7f1517e40640 1 -- 172.21.15.82:0/2279059046 wait complete. 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1517e40640 1 Processor -- start 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1517e40640 1 -- start start 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1517e40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1510101b70 0x7f151019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:42.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1517e40640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1510102d60 0x7f151019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1517e40640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510103720 0x7f15101a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1517e40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15100747d0 con 0x7f1510101b70 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1517e40640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1510074650 con 0x7f1510103720 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1517e40640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1510074950 con 0x7f1510102d60 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1515bdc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1510101b70 0x7f151019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1515bdc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1510101b70 0x7f151019a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35040/0 (socket says 172.21.15.82:35040) 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1515bdc640 1 -- 172.21.15.82:0/902491213 learned_addr learned my addr 172.21.15.82:0/902491213 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f15153db640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1510102d60 0x7f151019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f15163dd640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510103720 0x7f15101a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1515bdc640 1 -- 172.21.15.82:0/902491213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1510102d60 msgr2=0x7f151019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1515bdc640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1510102d60 0x7f151019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1515bdc640 1 -- 172.21.15.82:0/902491213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510103720 msgr2=0x7f15101a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1515bdc640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510103720 0x7f15101a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.460+0000 7f1515bdc640 1 -- 172.21.15.82:0/902491213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15101a1c70 con 0x7f1510101b70 2024-03-27T07:21:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.461+0000 7f1515bdc640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1510101b70 0x7f151019a050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f150c000c00 tx=0x7f150c02c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.461+0000 7f1506ffd640 1 -- 172.21.15.82:0/902491213 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c041070 con 0x7f1510101b70 2024-03-27T07:21:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.461+0000 7f1506ffd640 1 -- 172.21.15.82:0/902491213 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f150c004450 con 0x7f1510101b70 2024-03-27T07:21:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.461+0000 7f1517e40640 1 -- 172.21.15.82:0/902491213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15101a1f00 con 0x7f1510101b70 2024-03-27T07:21:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.461+0000 7f1506ffd640 1 -- 172.21.15.82:0/902491213 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c034440 con 0x7f1510101b70 2024-03-27T07:21:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.461+0000 7f1517e40640 1 -- 172.21.15.82:0/902491213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15101a2310 con 0x7f1510101b70 2024-03-27T07:21:42.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.462+0000 7f1517e40640 1 -- 172.21.15.82:0/902491213 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15101a25a0 con 0x7f1510101b70 2024-03-27T07:21:42.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.463+0000 7f1506ffd640 1 -- 172.21.15.82:0/902491213 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f150c044070 con 0x7f1510101b70 2024-03-27T07:21:42.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.463+0000 7f1506ffd640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14fc0a36a0 0x7f14fc0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:42.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.463+0000 7f15153db640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14fc0a36a0 0x7f14fc0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:42.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.464+0000 7f1506ffd640 1 -- 172.21.15.82:0/902491213 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f150c0f16b0 con 0x7f1510101b70 2024-03-27T07:21:42.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.464+0000 7f15153db640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14fc0a36a0 0x7f14fc0a5b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f15000095f0 tx=0x7f1500005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:42.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.468+0000 7f1506ffd640 1 -- 172.21.15.82:0/902491213 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f150c0bde20 con 0x7f1510101b70 2024-03-27T07:21:42.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.645+0000 7f1517e40640 1 -- 172.21.15.82:0/902491213 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f15100fe100 con 0x7f14fc0a36a0 2024-03-27T07:21:42.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.653+0000 7f1506ffd640 1 -- 172.21.15.82:0/902491213 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258928 (secure 0 0 0) 0x7f15100fe100 con 0x7f14fc0a36a0 2024-03-27T07:21:42.657 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:42.658 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-27T07:21:42.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.655+0000 7f1517e40640 1 -- 172.21.15.82:0/902491213 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14fc0a36a0 msgr2=0x7f14fc0a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.655+0000 7f1517e40640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14fc0a36a0 0x7f14fc0a5b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f15000095f0 tx=0x7f1500005f90 comp rx=0 tx=0).stop 2024-03-27T07:21:42.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.655+0000 7f1517e40640 1 -- 172.21.15.82:0/902491213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1510101b70 msgr2=0x7f151019a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:42.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.655+0000 7f1517e40640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1510101b70 0x7f151019a050 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f150c000c00 tx=0x7f150c02c640 comp rx=0 tx=0).stop 2024-03-27T07:21:42.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.656+0000 7f1517e40640 1 -- 172.21.15.82:0/902491213 shutdown_connections 2024-03-27T07:21:42.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.656+0000 7f1517e40640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f14fc0a36a0 0x7f14fc0a5b60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.656+0000 7f1517e40640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1510103720 0x7f15101a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.656+0000 7f1517e40640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1510102d60 0x7f151019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.656+0000 7f1517e40640 1 --2- 172.21.15.82:0/902491213 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1510101b70 0x7f151019a050 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:42.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.656+0000 7f1517e40640 1 -- 172.21.15.82:0/902491213 >> 172.21.15.82:0/902491213 conn(0x7f15100fd100 msgr2=0x7f15100fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:42.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.656+0000 7f1517e40640 1 -- 172.21.15.82:0/902491213 shutdown_connections 2024-03-27T07:21:42.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:42.656+0000 7f1517e40640 1 -- 172.21.15.82:0/902491213 wait complete. 2024-03-27T07:21:42.668 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2024-03-27T07:21:42.459928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":631706,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":164,"num_read_kb":175,"num_write":314,"num_write_kb":3016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":253,"ondisk_log_size":253,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":236,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356260,"kb_used_data":11228,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585564,"statfs":{"total":1151940427776,"available":1151575617536,"internally_reserved":0,"allocated":11497472,"data_stored":7147758,"data_compressed":108951,"data_compressed_allocated":139264,"data_compressed_original":1777664,"omap_allocated":19139,"internal_metadata":353154365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41338,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":28,"num_read_kb":56,"num_write":133,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.917251"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948527+0000","last_change":"2024-03-27T07:21:35.577169+0000","last_active":"2024-03-27T07:21:36.948527+0000","last_peered":"2024-03-27T07:21:36.948527+0000","last_clean":"2024-03-27T07:21:36.948527+0000","last_became_active":"2024-03-27T07:21:35.576737+0000","last_became_peered":"2024-03-27T07:21:35.576737+0000","last_unstale":"2024-03-27T07:21:36.948527+0000","last_undegraded":"2024-03-27T07:21:36.948527+0000","last_fullsized":"2024-03-27T07:21:36.948527+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:58:55.152543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578201+0000","last_change":"2024-03-27T07:21:35.576197+0000","last_active":"2024-03-27T07:21:37.578201+0000","last_peered":"2024-03-27T07:21:37.578201+0000","last_clean":"2024-03-27T07:21:37.578201+0000","last_became_active":"2024-03-27T07:21:35.575876+0000","last_became_peered":"2024-03-27T07:21:35.575876+0000","last_unstale":"2024-03-27T07:21:37.578201+0000","last_undegraded":"2024-03-27T07:21:37.578201+0000","last_fullsized":"2024-03-27T07:21:37.578201+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:23:12.589029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578853+0000","last_change":"2024-03-27T07:21:35.582045+0000","last_active":"2024-03-27T07:21:37.578853+0000","last_peered":"2024-03-27T07:21:37.578853+0000","last_clean":"2024-03-27T07:21:37.578853+0000","last_became_active":"2024-03-27T07:21:35.581710+0000","last_became_peered":"2024-03-27T07:21:35.581710+0000","last_unstale":"2024-03-27T07:21:37.578853+0000","last_undegraded":"2024-03-27T07:21:37.578853+0000","last_fullsized":"2024-03-27T07:21:37.578853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:47:39.004986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.564071+0000","last_change":"2024-03-27T07:21:35.573522+0000","last_active":"2024-03-27T07:21:36.564071+0000","last_peered":"2024-03-27T07:21:36.564071+0000","last_clean":"2024-03-27T07:21:36.564071+0000","last_became_active":"2024-03-27T07:21:35.573169+0000","last_became_peered":"2024-03-27T07:21:35.573169+0000","last_unstale":"2024-03-27T07:21:36.564071+0000","last_undegraded":"2024-03-27T07:21:36.564071+0000","last_fullsized":"2024-03-27T07:21:36.564071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:40:02.621208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.850869+0000","last_change":"2024-03-27T07:21:35.568964+0000","last_active":"2024-03-27T07:21:36.850869+0000","last_peered":"2024-03-27T07:21:36.850869+0000","last_clean":"2024-03-27T07:21:36.850869+0000","last_became_active":"2024-03-27T07:21:35.568607+0000","last_became_peered":"2024-03-27T07:21:35.568607+0000","last_unstale":"2024-03-27T07:21:36.850869+0000","last_undegraded":"2024-03-27T07:21:36.850869+0000","last_fullsized":"2024-03-27T07:21:36.850869+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:26:32.122422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947762+0000","last_change":"2024-03-27T07:21:35.575915+0000","last_active":"2024-03-27T07:21:36.947762+0000","last_peered":"2024-03-27T07:21:36.947762+0000","last_clean":"2024-03-27T07:21:36.947762+0000","last_became_active":"2024-03-27T07:21:35.575604+0000","last_became_peered":"2024-03-27T07:21:35.575604+0000","last_unstale":"2024-03-27T07:21:36.947762+0000","last_undegraded":"2024-03-27T07:21:36.947762+0000","last_fullsized":"2024-03-27T07:21:36.947762+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:19:12.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947651+0000","last_change":"2024-03-27T07:21:35.570762+0000","last_active":"2024-03-27T07:21:36.947651+0000","last_peered":"2024-03-27T07:21:36.947651+0000","last_clean":"2024-03-27T07:21:36.947651+0000","last_became_active":"2024-03-27T07:21:35.570380+0000","last_became_peered":"2024-03-27T07:21:35.570380+0000","last_unstale":"2024-03-27T07:21:36.947651+0000","last_undegraded":"2024-03-27T07:21:36.947651+0000","last_fullsized":"2024-03-27T07:21:36.947651+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:35:04.463674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.562414+0000","last_change":"2024-03-27T07:21:35.573220+0000","last_active":"2024-03-27T07:21:36.562414+0000","last_peered":"2024-03-27T07:21:36.562414+0000","last_clean":"2024-03-27T07:21:36.562414+0000","last_became_active":"2024-03-27T07:21:35.572909+0000","last_became_peered":"2024-03-27T07:21:35.572909+0000","last_unstale":"2024-03-27T07:21:36.562414+0000","last_undegraded":"2024-03-27T07:21:36.562414+0000","last_fullsized":"2024-03-27T07:21:36.562414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:49:51.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740793+0000","last_change":"2024-03-27T07:21:35.559298+0000","last_active":"2024-03-27T07:21:36.740793+0000","last_peered":"2024-03-27T07:21:36.740793+0000","last_clean":"2024-03-27T07:21:36.740793+0000","last_became_active":"2024-03-27T07:21:35.558968+0000","last_became_peered":"2024-03-27T07:21:35.558968+0000","last_unstale":"2024-03-27T07:21:36.740793+0000","last_undegraded":"2024-03-27T07:21:36.740793+0000","last_fullsized":"2024-03-27T07:21:36.740793+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:12:31.027411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948114+0000","last_change":"2024-03-27T07:21:35.577015+0000","last_active":"2024-03-27T07:21:36.948114+0000","last_peered":"2024-03-27T07:21:36.948114+0000","last_clean":"2024-03-27T07:21:36.948114+0000","last_became_active":"2024-03-27T07:21:35.576599+0000","last_became_peered":"2024-03-27T07:21:35.576599+0000","last_unstale":"2024-03-27T07:21:36.948114+0000","last_undegraded":"2024-03-27T07:21:36.948114+0000","last_fullsized":"2024-03-27T07:21:36.948114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:03.138951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948163+0000","last_change":"2024-03-27T07:21:35.576540+0000","last_active":"2024-03-27T07:21:36.948163+0000","last_peered":"2024-03-27T07:21:36.948163+0000","last_clean":"2024-03-27T07:21:36.948163+0000","last_became_active":"2024-03-27T07:21:35.576101+0000","last_became_peered":"2024-03-27T07:21:35.576101+0000","last_unstale":"2024-03-27T07:21:36.948163+0000","last_undegraded":"2024-03-27T07:21:36.948163+0000","last_fullsized":"2024-03-27T07:21:36.948163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:13.654970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.564099+0000","last_change":"2024-03-27T07:21:35.574029+0000","last_active":"2024-03-27T07:21:36.564099+0000","last_peered":"2024-03-27T07:21:36.564099+0000","last_clean":"2024-03-27T07:21:36.564099+0000","last_became_active":"2024-03-27T07:21:35.573697+0000","last_became_peered":"2024-03-27T07:21:35.573697+0000","last_unstale":"2024-03-27T07:21:36.564099+0000","last_undegraded":"2024-03-27T07:21:36.564099+0000","last_fullsized":"2024-03-27T07:21:36.564099+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:25:45.911184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947944+0000","last_change":"2024-03-27T07:21:35.559726+0000","last_active":"2024-03-27T07:21:36.947944+0000","last_peered":"2024-03-27T07:21:36.947944+0000","last_clean":"2024-03-27T07:21:36.947944+0000","last_became_active":"2024-03-27T07:21:35.559294+0000","last_became_peered":"2024-03-27T07:21:35.559294+0000","last_unstale":"2024-03-27T07:21:36.947944+0000","last_undegraded":"2024-03-27T07:21:36.947944+0000","last_fullsized":"2024-03-27T07:21:36.947944+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:27:00.364447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.577852+0000","last_change":"2024-03-27T07:21:35.577959+0000","last_active":"2024-03-27T07:21:37.577852+0000","last_peered":"2024-03-27T07:21:37.577852+0000","last_clean":"2024-03-27T07:21:37.577852+0000","last_became_active":"2024-03-27T07:21:35.577642+0000","last_became_peered":"2024-03-27T07:21:35.577642+0000","last_unstale":"2024-03-27T07:21:37.577852+0000","last_undegraded":"2024-03-27T07:21:37.577852+0000","last_fullsized":"2024-03-27T07:21:37.577852+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:07:44.836888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578426+0000","last_change":"2024-03-27T07:21:35.580901+0000","last_active":"2024-03-27T07:21:37.578426+0000","last_peered":"2024-03-27T07:21:37.578426+0000","last_clean":"2024-03-27T07:21:37.578426+0000","last_became_active":"2024-03-27T07:21:35.579456+0000","last_became_peered":"2024-03-27T07:21:35.579456+0000","last_unstale":"2024-03-27T07:21:37.578426+0000","last_undegraded":"2024-03-27T07:21:37.578426+0000","last_fullsized":"2024-03-27T07:21:37.578426+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:35:54.722160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740269+0000","last_change":"2024-03-27T07:21:35.574462+0000","last_active":"2024-03-27T07:21:36.740269+0000","last_peered":"2024-03-27T07:21:36.740269+0000","last_clean":"2024-03-27T07:21:36.740269+0000","last_became_active":"2024-03-27T07:21:35.574158+0000","last_became_peered":"2024-03-27T07:21:35.574158+0000","last_unstale":"2024-03-27T07:21:36.740269+0000","last_undegraded":"2024-03-27T07:21:36.740269+0000","last_fullsized":"2024-03-27T07:21:36.740269+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:16:18.756955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948643+0000","last_change":"2024-03-27T07:21:35.576808+0000","last_active":"2024-03-27T07:21:36.948643+0000","last_peered":"2024-03-27T07:21:36.948643+0000","last_clean":"2024-03-27T07:21:36.948643+0000","last_became_active":"2024-03-27T07:21:35.574819+0000","last_became_peered":"2024-03-27T07:21:35.574819+0000","last_unstale":"2024-03-27T07:21:36.948643+0000","last_undegraded":"2024-03-27T07:21:36.948643+0000","last_fullsized":"2024-03-27T07:21:36.948643+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:29:06.137201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947548+0000","last_change":"2024-03-27T07:21:35.570650+0000","last_active":"2024-03-27T07:21:36.947548+0000","last_peered":"2024-03-27T07:21:36.947548+0000","last_clean":"2024-03-27T07:21:36.947548+0000","last_became_active":"2024-03-27T07:21:35.569850+0000","last_became_peered":"2024-03-27T07:21:35.569850+0000","last_unstale":"2024-03-27T07:21:36.947548+0000","last_undegraded":"2024-03-27T07:21:36.947548+0000","last_fullsized":"2024-03-27T07:21:36.947548+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:22:39.829648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948245+0000","last_change":"2024-03-27T07:21:35.566322+0000","last_active":"2024-03-27T07:21:36.948245+0000","last_peered":"2024-03-27T07:21:36.948245+0000","last_clean":"2024-03-27T07:21:36.948245+0000","last_became_active":"2024-03-27T07:21:35.565947+0000","last_became_peered":"2024-03-27T07:21:35.565947+0000","last_unstale":"2024-03-27T07:21:36.948245+0000","last_undegraded":"2024-03-27T07:21:36.948245+0000","last_fullsized":"2024-03-27T07:21:36.948245+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:58:34.151735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:38.595660+0000","last_change":"2024-03-27T07:21:34.563517+0000","last_active":"2024-03-27T07:21:38.595660+0000","last_peered":"2024-03-27T07:21:38.595660+0000","last_clean":"2024-03-27T07:21:38.595660+0000","last_became_active":"2024-03-27T07:21:34.563169+0000","last_became_peered":"2024-03-27T07:21:34.563169+0000","last_unstale":"2024-03-27T07:21:38.595660+0000","last_undegraded":"2024-03-27T07:21:38.595660+0000","last_fullsized":"2024-03-27T07:21:38.595660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:27.818864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563000+0000","last_change":"2024-03-27T07:21:35.576918+0000","last_active":"2024-03-27T07:21:36.563000+0000","last_peered":"2024-03-27T07:21:36.563000+0000","last_clean":"2024-03-27T07:21:36.563000+0000","last_became_active":"2024-03-27T07:21:35.576581+0000","last_became_peered":"2024-03-27T07:21:35.576581+0000","last_unstale":"2024-03-27T07:21:36.563000+0000","last_undegraded":"2024-03-27T07:21:36.563000+0000","last_fullsized":"2024-03-27T07:21:36.563000+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:31:54.813459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563302+0000","last_change":"2024-03-27T07:21:34.560583+0000","last_active":"2024-03-27T07:21:36.563302+0000","last_peered":"2024-03-27T07:21:36.563302+0000","last_clean":"2024-03-27T07:21:36.563302+0000","last_became_active":"2024-03-27T07:21:34.560257+0000","last_became_peered":"2024-03-27T07:21:34.560257+0000","last_unstale":"2024-03-27T07:21:36.563302+0000","last_undegraded":"2024-03-27T07:21:36.563302+0000","last_fullsized":"2024-03-27T07:21:36.563302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:25:27.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578733+0000","last_change":"2024-03-27T07:21:35.573251+0000","last_active":"2024-03-27T07:21:37.578733+0000","last_peered":"2024-03-27T07:21:37.578733+0000","last_clean":"2024-03-27T07:21:37.578733+0000","last_became_active":"2024-03-27T07:21:35.572890+0000","last_became_peered":"2024-03-27T07:21:35.572890+0000","last_unstale":"2024-03-27T07:21:37.578733+0000","last_undegraded":"2024-03-27T07:21:37.578733+0000","last_fullsized":"2024-03-27T07:21:37.578733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:49.317704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:38.594378+0000","last_change":"2024-03-27T07:21:34.567140+0000","last_active":"2024-03-27T07:21:38.594378+0000","last_peered":"2024-03-27T07:21:38.594378+0000","last_clean":"2024-03-27T07:21:38.594378+0000","last_became_active":"2024-03-27T07:21:34.566689+0000","last_became_peered":"2024-03-27T07:21:34.566689+0000","last_unstale":"2024-03-27T07:21:38.594378+0000","last_undegraded":"2024-03-27T07:21:38.594378+0000","last_fullsized":"2024-03-27T07:21:38.594378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:50:54.656277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740436+0000","last_change":"2024-03-27T07:21:35.565259+0000","last_active":"2024-03-27T07:21:36.740436+0000","last_peered":"2024-03-27T07:21:36.740436+0000","last_clean":"2024-03-27T07:21:36.740436+0000","last_became_active":"2024-03-27T07:21:35.564954+0000","last_became_peered":"2024-03-27T07:21:35.564954+0000","last_unstale":"2024-03-27T07:21:36.740436+0000","last_undegraded":"2024-03-27T07:21:36.740436+0000","last_fullsized":"2024-03-27T07:21:36.740436+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:02.950515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.850999+0000","last_change":"2024-03-27T07:21:34.558887+0000","last_active":"2024-03-27T07:21:36.850999+0000","last_peered":"2024-03-27T07:21:36.850999+0000","last_clean":"2024-03-27T07:21:36.850999+0000","last_became_active":"2024-03-27T07:21:34.556689+0000","last_became_peered":"2024-03-27T07:21:34.556689+0000","last_unstale":"2024-03-27T07:21:36.850999+0000","last_undegraded":"2024-03-27T07:21:36.850999+0000","last_fullsized":"2024-03-27T07:21:36.850999+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:37.162440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563667+0000","last_change":"2024-03-27T07:21:35.576346+0000","last_active":"2024-03-27T07:21:36.563667+0000","last_peered":"2024-03-27T07:21:36.563667+0000","last_clean":"2024-03-27T07:21:36.563667+0000","last_became_active":"2024-03-27T07:21:35.572774+0000","last_became_peered":"2024-03-27T07:21:35.572774+0000","last_unstale":"2024-03-27T07:21:36.563667+0000","last_undegraded":"2024-03-27T07:21:36.563667+0000","last_fullsized":"2024-03-27T07:21:36.563667+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:12:44.181603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.581807+0000","last_change":"2024-03-27T07:21:34.562208+0000","last_active":"2024-03-27T07:21:37.581807+0000","last_peered":"2024-03-27T07:21:37.581807+0000","last_clean":"2024-03-27T07:21:37.581807+0000","last_became_active":"2024-03-27T07:21:34.561829+0000","last_became_peered":"2024-03-27T07:21:34.561829+0000","last_unstale":"2024-03-27T07:21:37.581807+0000","last_undegraded":"2024-03-27T07:21:37.581807+0000","last_fullsized":"2024-03-27T07:21:37.581807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:01:48.845075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.851120+0000","last_change":"2024-03-27T07:21:35.575384+0000","last_active":"2024-03-27T07:21:36.851120+0000","last_peered":"2024-03-27T07:21:36.851120+0000","last_clean":"2024-03-27T07:21:36.851120+0000","last_became_active":"2024-03-27T07:21:35.574928+0000","last_became_peered":"2024-03-27T07:21:35.574928+0000","last_unstale":"2024-03-27T07:21:36.851120+0000","last_undegraded":"2024-03-27T07:21:36.851120+0000","last_fullsized":"2024-03-27T07:21:36.851120+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:34.034114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:38.592631+0000","last_change":"2024-03-27T07:21:34.562791+0000","last_active":"2024-03-27T07:21:38.592631+0000","last_peered":"2024-03-27T07:21:38.592631+0000","last_clean":"2024-03-27T07:21:38.592631+0000","last_became_active":"2024-03-27T07:21:34.562441+0000","last_became_peered":"2024-03-27T07:21:34.562441+0000","last_unstale":"2024-03-27T07:21:38.592631+0000","last_undegraded":"2024-03-27T07:21:38.592631+0000","last_fullsized":"2024-03-27T07:21:38.592631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:44:42.509635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563629+0000","last_change":"2024-03-27T07:21:35.578022+0000","last_active":"2024-03-27T07:21:36.563629+0000","last_peered":"2024-03-27T07:21:36.563629+0000","last_clean":"2024-03-27T07:21:36.563629+0000","last_became_active":"2024-03-27T07:21:35.577665+0000","last_became_peered":"2024-03-27T07:21:35.577665+0000","last_unstale":"2024-03-27T07:21:36.563629+0000","last_undegraded":"2024-03-27T07:21:36.563629+0000","last_fullsized":"2024-03-27T07:21:36.563629+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:05:40.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:38.597278+0000","last_change":"2024-03-27T07:21:34.557610+0000","last_active":"2024-03-27T07:21:38.597278+0000","last_peered":"2024-03-27T07:21:38.597278+0000","last_clean":"2024-03-27T07:21:38.597278+0000","last_became_active":"2024-03-27T07:21:34.557295+0000","last_became_peered":"2024-03-27T07:21:34.557295+0000","last_unstale":"2024-03-27T07:21:38.597278+0000","last_undegraded":"2024-03-27T07:21:38.597278+0000","last_fullsized":"2024-03-27T07:21:38.597278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:38:40.291447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.562493+0000","last_change":"2024-03-27T07:21:35.568910+0000","last_active":"2024-03-27T07:21:36.562493+0000","last_peered":"2024-03-27T07:21:36.562493+0000","last_clean":"2024-03-27T07:21:36.562493+0000","last_became_active":"2024-03-27T07:21:35.568606+0000","last_became_peered":"2024-03-27T07:21:35.568606+0000","last_unstale":"2024-03-27T07:21:36.562493+0000","last_undegraded":"2024-03-27T07:21:36.562493+0000","last_fullsized":"2024-03-27T07:21:36.562493+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:04:54.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578268+0000","last_change":"2024-03-27T07:21:34.563096+0000","last_active":"2024-03-27T07:21:37.578268+0000","last_peered":"2024-03-27T07:21:37.578268+0000","last_clean":"2024-03-27T07:21:37.578268+0000","last_became_active":"2024-03-27T07:21:34.562721+0000","last_became_peered":"2024-03-27T07:21:34.562721+0000","last_unstale":"2024-03-27T07:21:37.578268+0000","last_undegraded":"2024-03-27T07:21:37.578268+0000","last_fullsized":"2024-03-27T07:21:37.578268+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:42:43.902139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947349+0000","last_change":"2024-03-27T07:21:35.571386+0000","last_active":"2024-03-27T07:21:36.947349+0000","last_peered":"2024-03-27T07:21:36.947349+0000","last_clean":"2024-03-27T07:21:36.947349+0000","last_became_active":"2024-03-27T07:21:35.571061+0000","last_became_peered":"2024-03-27T07:21:35.571061+0000","last_unstale":"2024-03-27T07:21:36.947349+0000","last_undegraded":"2024-03-27T07:21:36.947349+0000","last_fullsized":"2024-03-27T07:21:36.947349+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:15:06.887550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:40.600147+0000","last_change":"2024-03-27T07:21:34.561401+0000","last_active":"2024-03-27T07:21:40.600147+0000","last_peered":"2024-03-27T07:21:40.600147+0000","last_clean":"2024-03-27T07:21:40.600147+0000","last_became_active":"2024-03-27T07:21:34.561071+0000","last_became_peered":"2024-03-27T07:21:34.561071+0000","last_unstale":"2024-03-27T07:21:40.600147+0000","last_undegraded":"2024-03-27T07:21:40.600147+0000","last_fullsized":"2024-03-27T07:21:40.600147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:41.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740661+0000","last_change":"2024-03-27T07:21:35.561505+0000","last_active":"2024-03-27T07:21:36.740661+0000","last_peered":"2024-03-27T07:21:36.740661+0000","last_clean":"2024-03-27T07:21:36.740661+0000","last_became_active":"2024-03-27T07:21:35.561166+0000","last_became_peered":"2024-03-27T07:21:35.561166+0000","last_unstale":"2024-03-27T07:21:36.740661+0000","last_undegraded":"2024-03-27T07:21:36.740661+0000","last_fullsized":"2024-03-27T07:21:36.740661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:59.179147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.579377+0000","last_change":"2024-03-27T07:21:34.565463+0000","last_active":"2024-03-27T07:21:37.579377+0000","last_peered":"2024-03-27T07:21:37.579377+0000","last_clean":"2024-03-27T07:21:37.579377+0000","last_became_active":"2024-03-27T07:21:34.565054+0000","last_became_peered":"2024-03-27T07:21:34.565054+0000","last_unstale":"2024-03-27T07:21:37.579377+0000","last_undegraded":"2024-03-27T07:21:37.579377+0000","last_fullsized":"2024-03-27T07:21:37.579377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:19:16.820790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578536+0000","last_change":"2024-03-27T07:21:35.574795+0000","last_active":"2024-03-27T07:21:37.578536+0000","last_peered":"2024-03-27T07:21:37.578536+0000","last_clean":"2024-03-27T07:21:37.578536+0000","last_became_active":"2024-03-27T07:21:35.574534+0000","last_became_peered":"2024-03-27T07:21:35.574534+0000","last_unstale":"2024-03-27T07:21:37.578536+0000","last_undegraded":"2024-03-27T07:21:37.578536+0000","last_fullsized":"2024-03-27T07:21:37.578536+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:46:44.777575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.580591+0000","last_change":"2024-03-27T07:21:34.555772+0000","last_active":"2024-03-27T07:21:37.580591+0000","last_peered":"2024-03-27T07:21:37.580591+0000","last_clean":"2024-03-27T07:21:37.580591+0000","last_became_active":"2024-03-27T07:21:34.555430+0000","last_became_peered":"2024-03-27T07:21:34.555430+0000","last_unstale":"2024-03-27T07:21:37.580591+0000","last_undegraded":"2024-03-27T07:21:37.580591+0000","last_fullsized":"2024-03-27T07:21:37.580591+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:11:48.058887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740553+0000","last_change":"2024-03-27T07:21:35.573184+0000","last_active":"2024-03-27T07:21:36.740553+0000","last_peered":"2024-03-27T07:21:36.740553+0000","last_clean":"2024-03-27T07:21:36.740553+0000","last_became_active":"2024-03-27T07:21:35.572776+0000","last_became_peered":"2024-03-27T07:21:35.572776+0000","last_unstale":"2024-03-27T07:21:36.740553+0000","last_undegraded":"2024-03-27T07:21:36.740553+0000","last_fullsized":"2024-03-27T07:21:36.740553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:03.122229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'19","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:41.603790+0000","last_change":"2024-03-27T07:21:34.563221+0000","last_active":"2024-03-27T07:21:41.603790+0000","last_peered":"2024-03-27T07:21:41.603790+0000","last_clean":"2024-03-27T07:21:41.603790+0000","last_became_active":"2024-03-27T07:21:34.562679+0000","last_became_peered":"2024-03-27T07:21:34.562679+0000","last_unstale":"2024-03-27T07:21:41.603790+0000","last_undegraded":"2024-03-27T07:21:41.603790+0000","last_fullsized":"2024-03-27T07:21:41.603790+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:59.795906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38193,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":10,"num_read_kb":41,"num_write":20,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.851059+0000","last_change":"2024-03-27T07:21:35.573408+0000","last_active":"2024-03-27T07:21:36.851059+0000","last_peered":"2024-03-27T07:21:36.851059+0000","last_clean":"2024-03-27T07:21:36.851059+0000","last_became_active":"2024-03-27T07:21:35.572912+0000","last_became_peered":"2024-03-27T07:21:35.572912+0000","last_unstale":"2024-03-27T07:21:36.851059+0000","last_undegraded":"2024-03-27T07:21:36.851059+0000","last_fullsized":"2024-03-27T07:21:36.851059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:13.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578957+0000","last_change":"2024-03-27T07:21:34.562237+0000","last_active":"2024-03-27T07:21:37.578957+0000","last_peered":"2024-03-27T07:21:37.578957+0000","last_clean":"2024-03-27T07:21:37.578957+0000","last_became_active":"2024-03-27T07:21:34.561895+0000","last_became_peered":"2024-03-27T07:21:34.561895+0000","last_unstale":"2024-03-27T07:21:37.578957+0000","last_undegraded":"2024-03-27T07:21:37.578957+0000","last_fullsized":"2024-03-27T07:21:37.578957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:39:09.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947877+0000","last_change":"2024-03-27T07:21:35.571870+0000","last_active":"2024-03-27T07:21:36.947877+0000","last_peered":"2024-03-27T07:21:36.947877+0000","last_clean":"2024-03-27T07:21:36.947877+0000","last_became_active":"2024-03-27T07:21:35.571272+0000","last_became_peered":"2024-03-27T07:21:35.571272+0000","last_unstale":"2024-03-27T07:21:36.947877+0000","last_undegraded":"2024-03-27T07:21:36.947877+0000","last_fullsized":"2024-03-27T07:21:36.947877+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:08:08.374114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578734+0000","last_change":"2024-03-27T07:21:34.563257+0000","last_active":"2024-03-27T07:21:37.578734+0000","last_peered":"2024-03-27T07:21:37.578734+0000","last_clean":"2024-03-27T07:21:37.578734+0000","last_became_active":"2024-03-27T07:21:34.562777+0000","last_became_peered":"2024-03-27T07:21:34.562777+0000","last_unstale":"2024-03-27T07:21:37.578734+0000","last_undegraded":"2024-03-27T07:21:37.578734+0000","last_fullsized":"2024-03-27T07:21:37.578734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:03.873185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947682+0000","last_change":"2024-03-27T07:21:35.568039+0000","last_active":"2024-03-27T07:21:36.947682+0000","last_peered":"2024-03-27T07:21:36.947682+0000","last_clean":"2024-03-27T07:21:36.947682+0000","last_became_active":"2024-03-27T07:21:35.567680+0000","last_became_peered":"2024-03-27T07:21:35.567680+0000","last_unstale":"2024-03-27T07:21:36.947682+0000","last_undegraded":"2024-03-27T07:21:36.947682+0000","last_fullsized":"2024-03-27T07:21:36.947682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:51:31.223267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:40.601780+0000","last_change":"2024-03-27T07:21:34.560885+0000","last_active":"2024-03-27T07:21:40.601780+0000","last_peered":"2024-03-27T07:21:40.601780+0000","last_clean":"2024-03-27T07:21:40.601780+0000","last_became_active":"2024-03-27T07:21:34.560431+0000","last_became_peered":"2024-03-27T07:21:34.560431+0000","last_unstale":"2024-03-27T07:21:40.601780+0000","last_undegraded":"2024-03-27T07:21:40.601780+0000","last_fullsized":"2024-03-27T07:21:40.601780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:19:00.526827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947110+0000","last_change":"2024-03-27T07:21:35.569293+0000","last_active":"2024-03-27T07:21:36.947110+0000","last_peered":"2024-03-27T07:21:36.947110+0000","last_clean":"2024-03-27T07:21:36.947110+0000","last_became_active":"2024-03-27T07:21:35.568962+0000","last_became_peered":"2024-03-27T07:21:35.568962+0000","last_unstale":"2024-03-27T07:21:36.947110+0000","last_undegraded":"2024-03-27T07:21:36.947110+0000","last_fullsized":"2024-03-27T07:21:36.947110+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:14:09.947298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:38.597064+0000","last_change":"2024-03-27T07:21:34.569232+0000","last_active":"2024-03-27T07:21:38.597064+0000","last_peered":"2024-03-27T07:21:38.597064+0000","last_clean":"2024-03-27T07:21:38.597064+0000","last_became_active":"2024-03-27T07:21:34.568900+0000","last_became_peered":"2024-03-27T07:21:34.568900+0000","last_unstale":"2024-03-27T07:21:38.597064+0000","last_undegraded":"2024-03-27T07:21:38.597064+0000","last_fullsized":"2024-03-27T07:21:38.597064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:27:55.489262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563174+0000","last_change":"2024-03-27T07:21:35.577020+0000","last_active":"2024-03-27T07:21:36.563174+0000","last_peered":"2024-03-27T07:21:36.563174+0000","last_clean":"2024-03-27T07:21:36.563174+0000","last_became_active":"2024-03-27T07:21:35.576696+0000","last_became_peered":"2024-03-27T07:21:35.576696+0000","last_unstale":"2024-03-27T07:21:36.563174+0000","last_undegraded":"2024-03-27T07:21:36.563174+0000","last_fullsized":"2024-03-27T07:21:36.563174+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:37:35.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:39.590104+0000","last_change":"2024-03-27T07:21:34.562496+0000","last_active":"2024-03-27T07:21:39.590104+0000","last_peered":"2024-03-27T07:21:39.590104+0000","last_clean":"2024-03-27T07:21:39.590104+0000","last_became_active":"2024-03-27T07:21:34.562166+0000","last_became_peered":"2024-03-27T07:21:34.562166+0000","last_unstale":"2024-03-27T07:21:39.590104+0000","last_undegraded":"2024-03-27T07:21:39.590104+0000","last_fullsized":"2024-03-27T07:21:39.590104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:38.828496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948300+0000","last_change":"2024-03-27T07:21:35.569991+0000","last_active":"2024-03-27T07:21:36.948300+0000","last_peered":"2024-03-27T07:21:36.948300+0000","last_clean":"2024-03-27T07:21:36.948300+0000","last_became_active":"2024-03-27T07:21:35.569552+0000","last_became_peered":"2024-03-27T07:21:35.569552+0000","last_unstale":"2024-03-27T07:21:36.948300+0000","last_undegraded":"2024-03-27T07:21:36.948300+0000","last_fullsized":"2024-03-27T07:21:36.948300+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:02:15.511538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947420+0000","last_change":"2024-03-27T07:21:34.560289+0000","last_active":"2024-03-27T07:21:36.947420+0000","last_peered":"2024-03-27T07:21:36.947420+0000","last_clean":"2024-03-27T07:21:36.947420+0000","last_became_active":"2024-03-27T07:21:34.559985+0000","last_became_peered":"2024-03-27T07:21:34.559985+0000","last_unstale":"2024-03-27T07:21:36.947420+0000","last_undegraded":"2024-03-27T07:21:36.947420+0000","last_fullsized":"2024-03-27T07:21:36.947420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:45:46.611725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948153+0000","last_change":"2024-03-27T07:21:35.579626+0000","last_active":"2024-03-27T07:21:36.948153+0000","last_peered":"2024-03-27T07:21:36.948153+0000","last_clean":"2024-03-27T07:21:36.948153+0000","last_became_active":"2024-03-27T07:21:35.579173+0000","last_became_peered":"2024-03-27T07:21:35.579173+0000","last_unstale":"2024-03-27T07:21:36.948153+0000","last_undegraded":"2024-03-27T07:21:36.948153+0000","last_fullsized":"2024-03-27T07:21:36.948153+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:56:48.015958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947263+0000","last_change":"2024-03-27T07:21:34.568216+0000","last_active":"2024-03-27T07:21:36.947263+0000","last_peered":"2024-03-27T07:21:36.947263+0000","last_clean":"2024-03-27T07:21:36.947263+0000","last_became_active":"2024-03-27T07:21:34.567468+0000","last_became_peered":"2024-03-27T07:21:34.567468+0000","last_unstale":"2024-03-27T07:21:36.947263+0000","last_undegraded":"2024-03-27T07:21:36.947263+0000","last_fullsized":"2024-03-27T07:21:36.947263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:44:50.359865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947939+0000","last_change":"2024-03-27T07:21:35.574614+0000","last_active":"2024-03-27T07:21:36.947939+0000","last_peered":"2024-03-27T07:21:36.947939+0000","last_clean":"2024-03-27T07:21:36.947939+0000","last_became_active":"2024-03-27T07:21:35.574274+0000","last_became_peered":"2024-03-27T07:21:35.574274+0000","last_unstale":"2024-03-27T07:21:36.947939+0000","last_undegraded":"2024-03-27T07:21:36.947939+0000","last_fullsized":"2024-03-27T07:21:36.947939+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:57.744066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563530+0000","last_change":"2024-03-27T07:21:35.573196+0000","last_active":"2024-03-27T07:21:36.563530+0000","last_peered":"2024-03-27T07:21:36.563530+0000","last_clean":"2024-03-27T07:21:36.563530+0000","last_became_active":"2024-03-27T07:21:35.572852+0000","last_became_peered":"2024-03-27T07:21:35.572852+0000","last_unstale":"2024-03-27T07:21:36.563530+0000","last_undegraded":"2024-03-27T07:21:36.563530+0000","last_fullsized":"2024-03-27T07:21:36.563530+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:00.478573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:38.597421+0000","last_change":"2024-03-27T07:21:34.566380+0000","last_active":"2024-03-27T07:21:38.597421+0000","last_peered":"2024-03-27T07:21:38.597421+0000","last_clean":"2024-03-27T07:21:38.597421+0000","last_became_active":"2024-03-27T07:21:34.566034+0000","last_became_peered":"2024-03-27T07:21:34.566034+0000","last_unstale":"2024-03-27T07:21:38.597421+0000","last_undegraded":"2024-03-27T07:21:38.597421+0000","last_fullsized":"2024-03-27T07:21:38.597421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:06.470957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.562958+0000","last_change":"2024-03-27T07:21:35.576149+0000","last_active":"2024-03-27T07:21:36.562958+0000","last_peered":"2024-03-27T07:21:36.562958+0000","last_clean":"2024-03-27T07:21:36.562958+0000","last_became_active":"2024-03-27T07:21:35.573628+0000","last_became_peered":"2024-03-27T07:21:35.573628+0000","last_unstale":"2024-03-27T07:21:36.562958+0000","last_undegraded":"2024-03-27T07:21:36.562958+0000","last_fullsized":"2024-03-27T07:21:36.562958+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:37:06.571848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:39.596827+0000","last_change":"2024-03-27T07:21:34.555206+0000","last_active":"2024-03-27T07:21:39.596827+0000","last_peered":"2024-03-27T07:21:39.596827+0000","last_clean":"2024-03-27T07:21:39.596827+0000","last_became_active":"2024-03-27T07:21:34.554789+0000","last_became_peered":"2024-03-27T07:21:34.554789+0000","last_unstale":"2024-03-27T07:21:39.596827+0000","last_undegraded":"2024-03-27T07:21:39.596827+0000","last_fullsized":"2024-03-27T07:21:39.596827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:24:37.211394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":350,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947067+0000","last_change":"2024-03-27T07:20:20.641816+0000","last_active":"2024-03-27T07:21:36.947067+0000","last_peered":"2024-03-27T07:21:36.947067+0000","last_clean":"2024-03-27T07:21:36.947067+0000","last_became_active":"2024-03-27T07:20:20.641398+0000","last_became_peered":"2024-03-27T07:20:20.641398+0000","last_unstale":"2024-03-27T07:21:36.947067+0000","last_undegraded":"2024-03-27T07:21:36.947067+0000","last_fullsized":"2024-03-27T07:21:36.947067+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_clean_scrub_stamp":"2024-03-27T07:16:54.496466+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:52:56.728469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947605+0000","last_change":"2024-03-27T07:21:35.562594+0000","last_active":"2024-03-27T07:21:36.947605+0000","last_peered":"2024-03-27T07:21:36.947605+0000","last_clean":"2024-03-27T07:21:36.947605+0000","last_became_active":"2024-03-27T07:21:35.562287+0000","last_became_peered":"2024-03-27T07:21:35.562287+0000","last_unstale":"2024-03-27T07:21:36.947605+0000","last_undegraded":"2024-03-27T07:21:36.947605+0000","last_fullsized":"2024-03-27T07:21:36.947605+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:38:25.172452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:38.594311+0000","last_change":"2024-03-27T07:21:34.564569+0000","last_active":"2024-03-27T07:21:38.594311+0000","last_peered":"2024-03-27T07:21:38.594311+0000","last_clean":"2024-03-27T07:21:38.594311+0000","last_became_active":"2024-03-27T07:21:34.563830+0000","last_became_peered":"2024-03-27T07:21:34.563830+0000","last_unstale":"2024-03-27T07:21:38.594311+0000","last_undegraded":"2024-03-27T07:21:38.594311+0000","last_fullsized":"2024-03-27T07:21:38.594311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:46:19.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.579103+0000","last_change":"2024-03-27T07:21:34.569447+0000","last_active":"2024-03-27T07:21:37.579103+0000","last_peered":"2024-03-27T07:21:37.579103+0000","last_clean":"2024-03-27T07:21:37.579103+0000","last_became_active":"2024-03-27T07:21:34.569096+0000","last_became_peered":"2024-03-27T07:21:34.569096+0000","last_unstale":"2024-03-27T07:21:37.579103+0000","last_undegraded":"2024-03-27T07:21:37.579103+0000","last_fullsized":"2024-03-27T07:21:37.579103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:49:00.695556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947772+0000","last_change":"2024-03-27T07:21:35.558620+0000","last_active":"2024-03-27T07:21:36.947772+0000","last_peered":"2024-03-27T07:21:36.947772+0000","last_clean":"2024-03-27T07:21:36.947772+0000","last_became_active":"2024-03-27T07:21:35.557559+0000","last_became_peered":"2024-03-27T07:21:35.557559+0000","last_unstale":"2024-03-27T07:21:36.947772+0000","last_undegraded":"2024-03-27T07:21:36.947772+0000","last_fullsized":"2024-03-27T07:21:36.947772+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:09:03.236893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:40.551910+0000","last_change":"2024-03-27T07:21:34.557388+0000","last_active":"2024-03-27T07:21:40.551910+0000","last_peered":"2024-03-27T07:21:40.551910+0000","last_clean":"2024-03-27T07:21:40.551910+0000","last_became_active":"2024-03-27T07:21:34.557051+0000","last_became_peered":"2024-03-27T07:21:34.557051+0000","last_unstale":"2024-03-27T07:21:40.551910+0000","last_undegraded":"2024-03-27T07:21:40.551910+0000","last_fullsized":"2024-03-27T07:21:40.551910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:43:35.184715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563180+0000","last_change":"2024-03-27T07:21:35.573345+0000","last_active":"2024-03-27T07:21:36.563180+0000","last_peered":"2024-03-27T07:21:36.563180+0000","last_clean":"2024-03-27T07:21:36.563180+0000","last_became_active":"2024-03-27T07:21:35.573037+0000","last_became_peered":"2024-03-27T07:21:35.573037+0000","last_unstale":"2024-03-27T07:21:36.563180+0000","last_undegraded":"2024-03-27T07:21:36.563180+0000","last_fullsized":"2024-03-27T07:21:36.563180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:07:49.834272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.576424+0000","last_change":"2024-03-27T07:21:34.558738+0000","last_active":"2024-03-27T07:21:37.576424+0000","last_peered":"2024-03-27T07:21:37.576424+0000","last_clean":"2024-03-27T07:21:37.576424+0000","last_became_active":"2024-03-27T07:21:34.558353+0000","last_became_peered":"2024-03-27T07:21:34.558353+0000","last_unstale":"2024-03-27T07:21:37.576424+0000","last_undegraded":"2024-03-27T07:21:37.576424+0000","last_fullsized":"2024-03-27T07:21:37.576424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:46:07.816121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.578414+0000","last_change":"2024-03-27T07:21:35.575747+0000","last_active":"2024-03-27T07:21:37.578414+0000","last_peered":"2024-03-27T07:21:37.578414+0000","last_clean":"2024-03-27T07:21:37.578414+0000","last_became_active":"2024-03-27T07:21:35.575382+0000","last_became_peered":"2024-03-27T07:21:35.575382+0000","last_unstale":"2024-03-27T07:21:37.578414+0000","last_undegraded":"2024-03-27T07:21:37.578414+0000","last_fullsized":"2024-03-27T07:21:37.578414+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:10:03.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.580116+0000","last_change":"2024-03-27T07:21:34.563713+0000","last_active":"2024-03-27T07:21:37.580116+0000","last_peered":"2024-03-27T07:21:37.580116+0000","last_clean":"2024-03-27T07:21:37.580116+0000","last_became_active":"2024-03-27T07:21:34.563356+0000","last_became_peered":"2024-03-27T07:21:34.563356+0000","last_unstale":"2024-03-27T07:21:37.580116+0000","last_undegraded":"2024-03-27T07:21:37.580116+0000","last_fullsized":"2024-03-27T07:21:37.580116+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:48:11.366029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.850738+0000","last_change":"2024-03-27T07:21:35.569912+0000","last_active":"2024-03-27T07:21:36.850738+0000","last_peered":"2024-03-27T07:21:36.850738+0000","last_clean":"2024-03-27T07:21:36.850738+0000","last_became_active":"2024-03-27T07:21:35.569546+0000","last_became_peered":"2024-03-27T07:21:35.569546+0000","last_unstale":"2024-03-27T07:21:36.850738+0000","last_undegraded":"2024-03-27T07:21:36.850738+0000","last_fullsized":"2024-03-27T07:21:36.850738+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:45:18.146654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.580211+0000","last_change":"2024-03-27T07:21:34.557719+0000","last_active":"2024-03-27T07:21:37.580211+0000","last_peered":"2024-03-27T07:21:37.580211+0000","last_clean":"2024-03-27T07:21:37.580211+0000","last_became_active":"2024-03-27T07:21:34.557360+0000","last_became_peered":"2024-03-27T07:21:34.557360+0000","last_unstale":"2024-03-27T07:21:37.580211+0000","last_undegraded":"2024-03-27T07:21:37.580211+0000","last_fullsized":"2024-03-27T07:21:37.580211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:24:47.002674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948128+0000","last_change":"2024-03-27T07:21:35.578259+0000","last_active":"2024-03-27T07:21:36.948128+0000","last_peered":"2024-03-27T07:21:36.948128+0000","last_clean":"2024-03-27T07:21:36.948128+0000","last_became_active":"2024-03-27T07:21:35.574765+0000","last_became_peered":"2024-03-27T07:21:35.574765+0000","last_unstale":"2024-03-27T07:21:36.948128+0000","last_undegraded":"2024-03-27T07:21:36.948128+0000","last_fullsized":"2024-03-27T07:21:36.948128+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:34:49.358416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947599+0000","last_change":"2024-03-27T07:21:34.559276+0000","last_active":"2024-03-27T07:21:36.947599+0000","last_peered":"2024-03-27T07:21:36.947599+0000","last_clean":"2024-03-27T07:21:36.947599+0000","last_became_active":"2024-03-27T07:21:34.558643+0000","last_became_peered":"2024-03-27T07:21:34.558643+0000","last_unstale":"2024-03-27T07:21:36.947599+0000","last_undegraded":"2024-03-27T07:21:36.947599+0000","last_fullsized":"2024-03-27T07:21:36.947599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:57:10.034983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.562929+0000","last_change":"2024-03-27T07:21:35.577445+0000","last_active":"2024-03-27T07:21:36.562929+0000","last_peered":"2024-03-27T07:21:36.562929+0000","last_clean":"2024-03-27T07:21:36.562929+0000","last_became_active":"2024-03-27T07:21:35.577110+0000","last_became_peered":"2024-03-27T07:21:35.577110+0000","last_unstale":"2024-03-27T07:21:36.562929+0000","last_undegraded":"2024-03-27T07:21:36.562929+0000","last_fullsized":"2024-03-27T07:21:36.562929+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:36:45.919519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.580248+0000","last_change":"2024-03-27T07:21:34.567744+0000","last_active":"2024-03-27T07:21:37.580248+0000","last_peered":"2024-03-27T07:21:37.580248+0000","last_clean":"2024-03-27T07:21:37.580248+0000","last_became_active":"2024-03-27T07:21:34.567412+0000","last_became_peered":"2024-03-27T07:21:34.567412+0000","last_unstale":"2024-03-27T07:21:37.580248+0000","last_undegraded":"2024-03-27T07:21:37.580248+0000","last_fullsized":"2024-03-27T07:21:37.580248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:37:07.075048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947419+0000","last_change":"2024-03-27T07:21:35.570287+0000","last_active":"2024-03-27T07:21:36.947419+0000","last_peered":"2024-03-27T07:21:36.947419+0000","last_clean":"2024-03-27T07:21:36.947419+0000","last_became_active":"2024-03-27T07:21:35.569194+0000","last_became_peered":"2024-03-27T07:21:35.569194+0000","last_unstale":"2024-03-27T07:21:36.947419+0000","last_undegraded":"2024-03-27T07:21:36.947419+0000","last_fullsized":"2024-03-27T07:21:36.947419+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:01:44.155291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947803+0000","last_change":"2024-03-27T07:21:34.561420+0000","last_active":"2024-03-27T07:21:36.947803+0000","last_peered":"2024-03-27T07:21:36.947803+0000","last_clean":"2024-03-27T07:21:36.947803+0000","last_became_active":"2024-03-27T07:21:34.560923+0000","last_became_peered":"2024-03-27T07:21:34.560923+0000","last_unstale":"2024-03-27T07:21:36.947803+0000","last_undegraded":"2024-03-27T07:21:36.947803+0000","last_fullsized":"2024-03-27T07:21:36.947803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:39:48.256790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948330+0000","last_change":"2024-03-27T07:21:35.571317+0000","last_active":"2024-03-27T07:21:36.948330+0000","last_peered":"2024-03-27T07:21:36.948330+0000","last_clean":"2024-03-27T07:21:36.948330+0000","last_became_active":"2024-03-27T07:21:35.570237+0000","last_became_peered":"2024-03-27T07:21:35.570237+0000","last_unstale":"2024-03-27T07:21:36.948330+0000","last_undegraded":"2024-03-27T07:21:36.948330+0000","last_fullsized":"2024-03-27T07:21:36.948330+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:09:53.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563562+0000","last_change":"2024-03-27T07:21:34.553377+0000","last_active":"2024-03-27T07:21:36.563562+0000","last_peered":"2024-03-27T07:21:36.563562+0000","last_clean":"2024-03-27T07:21:36.563562+0000","last_became_active":"2024-03-27T07:21:34.553050+0000","last_became_peered":"2024-03-27T07:21:34.553050+0000","last_unstale":"2024-03-27T07:21:36.563562+0000","last_undegraded":"2024-03-27T07:21:36.563562+0000","last_fullsized":"2024-03-27T07:21:36.563562+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:03.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947556+0000","last_change":"2024-03-27T07:21:35.572384+0000","last_active":"2024-03-27T07:21:36.947556+0000","last_peered":"2024-03-27T07:21:36.947556+0000","last_clean":"2024-03-27T07:21:36.947556+0000","last_became_active":"2024-03-27T07:21:35.572071+0000","last_became_peered":"2024-03-27T07:21:35.572071+0000","last_unstale":"2024-03-27T07:21:36.947556+0000","last_undegraded":"2024-03-27T07:21:36.947556+0000","last_fullsized":"2024-03-27T07:21:36.947556+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:03:04.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947554+0000","last_change":"2024-03-27T07:21:34.559187+0000","last_active":"2024-03-27T07:21:36.947554+0000","last_peered":"2024-03-27T07:21:36.947554+0000","last_clean":"2024-03-27T07:21:36.947554+0000","last_became_active":"2024-03-27T07:21:34.558675+0000","last_became_peered":"2024-03-27T07:21:34.558675+0000","last_unstale":"2024-03-27T07:21:36.947554+0000","last_undegraded":"2024-03-27T07:21:36.947554+0000","last_fullsized":"2024-03-27T07:21:36.947554+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:41.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947853+0000","last_change":"2024-03-27T07:21:35.576440+0000","last_active":"2024-03-27T07:21:36.947853+0000","last_peered":"2024-03-27T07:21:36.947853+0000","last_clean":"2024-03-27T07:21:36.947853+0000","last_became_active":"2024-03-27T07:21:35.576143+0000","last_became_peered":"2024-03-27T07:21:35.576143+0000","last_unstale":"2024-03-27T07:21:36.947853+0000","last_undegraded":"2024-03-27T07:21:36.947853+0000","last_fullsized":"2024-03-27T07:21:36.947853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:31:29.400053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948307+0000","last_change":"2024-03-27T07:21:35.565760+0000","last_active":"2024-03-27T07:21:36.948307+0000","last_peered":"2024-03-27T07:21:36.948307+0000","last_clean":"2024-03-27T07:21:36.948307+0000","last_became_active":"2024-03-27T07:21:35.565351+0000","last_became_peered":"2024-03-27T07:21:35.565351+0000","last_unstale":"2024-03-27T07:21:36.948307+0000","last_undegraded":"2024-03-27T07:21:36.948307+0000","last_fullsized":"2024-03-27T07:21:36.948307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:16.871912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947631+0000","last_change":"2024-03-27T07:21:35.564100+0000","last_active":"2024-03-27T07:21:36.947631+0000","last_peered":"2024-03-27T07:21:36.947631+0000","last_clean":"2024-03-27T07:21:36.947631+0000","last_became_active":"2024-03-27T07:21:35.563748+0000","last_became_peered":"2024-03-27T07:21:35.563748+0000","last_unstale":"2024-03-27T07:21:36.947631+0000","last_undegraded":"2024-03-27T07:21:36.947631+0000","last_fullsized":"2024-03-27T07:21:36.947631+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:19:30.742692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947613+0000","last_change":"2024-03-27T07:21:35.575036+0000","last_active":"2024-03-27T07:21:36.947613+0000","last_peered":"2024-03-27T07:21:36.947613+0000","last_clean":"2024-03-27T07:21:36.947613+0000","last_became_active":"2024-03-27T07:21:35.574689+0000","last_became_peered":"2024-03-27T07:21:35.574689+0000","last_unstale":"2024-03-27T07:21:36.947613+0000","last_undegraded":"2024-03-27T07:21:36.947613+0000","last_fullsized":"2024-03-27T07:21:36.947613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:50:40.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:37.579017+0000","last_change":"2024-03-27T07:21:35.577814+0000","last_active":"2024-03-27T07:21:37.579017+0000","last_peered":"2024-03-27T07:21:37.579017+0000","last_clean":"2024-03-27T07:21:37.579017+0000","last_became_active":"2024-03-27T07:21:35.576265+0000","last_became_peered":"2024-03-27T07:21:35.576265+0000","last_unstale":"2024-03-27T07:21:37.579017+0000","last_undegraded":"2024-03-27T07:21:37.579017+0000","last_fullsized":"2024-03-27T07:21:37.579017+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:04.523768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948012+0000","last_change":"2024-03-27T07:21:35.568753+0000","last_active":"2024-03-27T07:21:36.948012+0000","last_peered":"2024-03-27T07:21:36.948012+0000","last_clean":"2024-03-27T07:21:36.948012+0000","last_became_active":"2024-03-27T07:21:35.568441+0000","last_became_peered":"2024-03-27T07:21:35.568441+0000","last_unstale":"2024-03-27T07:21:36.948012+0000","last_undegraded":"2024-03-27T07:21:36.948012+0000","last_fullsized":"2024-03-27T07:21:36.948012+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:32:54.294960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948363+0000","last_change":"2024-03-27T07:21:35.573094+0000","last_active":"2024-03-27T07:21:36.948363+0000","last_peered":"2024-03-27T07:21:36.948363+0000","last_clean":"2024-03-27T07:21:36.948363+0000","last_became_active":"2024-03-27T07:21:35.572739+0000","last_became_peered":"2024-03-27T07:21:35.572739+0000","last_unstale":"2024-03-27T07:21:36.948363+0000","last_undegraded":"2024-03-27T07:21:36.948363+0000","last_fullsized":"2024-03-27T07:21:36.948363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:02.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948138+0000","last_change":"2024-03-27T07:21:35.580647+0000","last_active":"2024-03-27T07:21:36.948138+0000","last_peered":"2024-03-27T07:21:36.948138+0000","last_clean":"2024-03-27T07:21:36.948138+0000","last_became_active":"2024-03-27T07:21:35.580230+0000","last_became_peered":"2024-03-27T07:21:35.580230+0000","last_unstale":"2024-03-27T07:21:36.948138+0000","last_undegraded":"2024-03-27T07:21:36.948138+0000","last_fullsized":"2024-03-27T07:21:36.948138+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:04:37.573021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563204+0000","last_change":"2024-03-27T07:21:35.568859+0000","last_active":"2024-03-27T07:21:36.563204+0000","last_peered":"2024-03-27T07:21:36.563204+0000","last_clean":"2024-03-27T07:21:36.563204+0000","last_became_active":"2024-03-27T07:21:35.568468+0000","last_became_peered":"2024-03-27T07:21:35.568468+0000","last_unstale":"2024-03-27T07:21:36.563204+0000","last_undegraded":"2024-03-27T07:21:36.563204+0000","last_fullsized":"2024-03-27T07:21:36.563204+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:44:59.875882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.563129+0000","last_change":"2024-03-27T07:21:35.568485+0000","last_active":"2024-03-27T07:21:36.563129+0000","last_peered":"2024-03-27T07:21:36.563129+0000","last_clean":"2024-03-27T07:21:36.563129+0000","last_became_active":"2024-03-27T07:21:35.568154+0000","last_became_peered":"2024-03-27T07:21:35.568154+0000","last_unstale":"2024-03-27T07:21:36.563129+0000","last_undegraded":"2024-03-27T07:21:36.563129+0000","last_fullsized":"2024-03-27T07:21:36.563129+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:08:29.418189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.562698+0000","last_change":"2024-03-27T07:21:35.567369+0000","last_active":"2024-03-27T07:21:36.562698+0000","last_peered":"2024-03-27T07:21:36.562698+0000","last_clean":"2024-03-27T07:21:36.562698+0000","last_became_active":"2024-03-27T07:21:35.564602+0000","last_became_peered":"2024-03-27T07:21:35.564602+0000","last_unstale":"2024-03-27T07:21:36.562698+0000","last_undegraded":"2024-03-27T07:21:36.562698+0000","last_fullsized":"2024-03-27T07:21:36.562698+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:23:15.123502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.740456+0000","last_change":"2024-03-27T07:21:35.572580+0000","last_active":"2024-03-27T07:21:36.740456+0000","last_peered":"2024-03-27T07:21:36.740456+0000","last_clean":"2024-03-27T07:21:36.740456+0000","last_became_active":"2024-03-27T07:21:35.572245+0000","last_became_peered":"2024-03-27T07:21:35.572245+0000","last_unstale":"2024-03-27T07:21:36.740456+0000","last_undegraded":"2024-03-27T07:21:36.740456+0000","last_fullsized":"2024-03-27T07:21:36.740456+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:45:56.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.947887+0000","last_change":"2024-03-27T07:21:35.584975+0000","last_active":"2024-03-27T07:21:36.947887+0000","last_peered":"2024-03-27T07:21:36.947887+0000","last_clean":"2024-03-27T07:21:36.947887+0000","last_became_active":"2024-03-27T07:21:35.584579+0000","last_became_peered":"2024-03-27T07:21:35.584579+0000","last_unstale":"2024-03-27T07:21:36.947887+0000","last_undegraded":"2024-03-27T07:21:36.947887+0000","last_fullsized":"2024-03-27T07:21:36.947887+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:22:44.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-03-27T07:21:36.948202+0000","last_change":"2024-03-27T07:21:35.573496+0000","last_active":"2024-03-27T07:21:36.948202+0000","last_peered":"2024-03-27T07:21:36.948202+0000","last_clean":"2024-03-27T07:21:36.948202+0000","last_became_active":"2024-03-27T07:21:35.572946+0000","last_became_peered":"2024-03-27T07:21:35.572946+0000","last_unstale":"2024-03-27T07:21:36.948202+0000","last_undegraded":"2024-03-27T07:21:36.948202+0000","last_fullsized":"2024-03-27T07:21:36.948202+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:37:50.236828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280632,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":41221,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":28,"num_read_kb":56,"num_write":132,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":51463,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350990,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":444461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612627,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":1074135,"data_compressed":37563,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776153,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":946176,"data_stored":444697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037790,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":444617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299427,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":1036039,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":443879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":445491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":954368,"data_stored":445357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32104,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713048,"statfs":{"total":95995035648,"available":95962161152,"internally_reserved":0,"allocated":950272,"data_stored":446147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":443983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920819,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":444523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757292,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":987136,"data_stored":1034429,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":39771,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T07:21:42.674 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-27T07:21:42.674 INFO:tasks.cephadm:Setting up client nodes... 2024-03-27T07:21:42.675 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-27T07:21:42.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:42 smithi082 ceph-mon[32178]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:42.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:42 smithi082 ceph-mon[32178]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:42.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:42 smithi082 ceph-mon[32178]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-27T07:21:42.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:42 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/447295713' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:42.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:42 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4187868534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:42.947 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:43.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:42 smithi149 ceph-mon[36065]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:43.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:42 smithi149 ceph-mon[36065]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:43.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:42 smithi149 ceph-mon[36065]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-27T07:21:43.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:42 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/447295713' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:43.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:42 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4187868534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:43.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:42 smithi153 ceph-mon[36179]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:43.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:42 smithi153 ceph-mon[36179]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:21:43.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:42 smithi153 ceph-mon[36179]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-03-27T07:21:43.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:42 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/447295713' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:21:43.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:42 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4187868534' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:43.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:43 smithi082 ceph-mon[32178]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:21:43.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:43 smithi082 ceph-mon[32178]: pgmap v294: 97 pgs: 97 active+clean; 617 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 9.9 KiB/s wr, 20 op/s 2024-03-27T07:21:43.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:43 smithi082 ceph-mon[32178]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:21:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:43 smithi149 ceph-mon[36065]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:21:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:43 smithi149 ceph-mon[36065]: pgmap v294: 97 pgs: 97 active+clean; 617 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 9.9 KiB/s wr, 20 op/s 2024-03-27T07:21:44.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:43 smithi149 ceph-mon[36065]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:21:44.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:43 smithi153 ceph-mon[36179]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:21:44.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:43 smithi153 ceph-mon[36179]: pgmap v294: 97 pgs: 97 active+clean; 617 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 9.9 KiB/s wr, 20 op/s 2024-03-27T07:21:44.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:43 smithi153 ceph-mon[36179]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:21:44.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.624+0000 7f96fce53700 1 -- 172.21.15.82:0/696611413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f8103130 msgr2=0x7f96f8105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:44.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.624+0000 7f96fce53700 1 --2- 172.21.15.82:0/696611413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f8103130 0x7f96f8105520 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009990 tx=0x7f96e8009ca0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.624+0000 7f96fce53700 1 -- 172.21.15.82:0/696611413 shutdown_connections 2024-03-27T07:21:44.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.624+0000 7f96fce53700 1 --2- 172.21.15.82:0/696611413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96f8108390 0x7f96f810a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.624+0000 7f96fce53700 1 --2- 172.21.15.82:0/696611413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f8103130 0x7f96f8105520 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.624+0000 7f96fce53700 1 --2- 172.21.15.82:0/696611413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f8105a60 0x7f96f8107e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.624+0000 7f96fce53700 1 -- 172.21.15.82:0/696611413 >> 172.21.15.82:0/696611413 conn(0x7f96f80fcb60 msgr2=0x7f96f80fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:44.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.624+0000 7f96fce53700 1 -- 172.21.15.82:0/696611413 shutdown_connections 2024-03-27T07:21:44.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.624+0000 7f96fce53700 1 -- 172.21.15.82:0/696611413 wait complete. 2024-03-27T07:21:44.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96fce53700 1 Processor -- start 2024-03-27T07:21:44.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96fce53700 1 -- start start 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96fce53700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96f8103130 0x7f96f8102a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96fce53700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f8105a60 0x7f96f81010e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96fce53700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f8108390 0x7f96f8101620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96fce53700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96f810e290 con 0x7f96f8108390 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96fce53700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f96f810e110 con 0x7f96f8105a60 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96fce53700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f96f810e410 con 0x7f96f8103130 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96f6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f8108390 0x7f96f8101620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96f659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96f8103130 0x7f96f8102a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96f6d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f8108390 0x7f96f8101620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35046/0 (socket says 172.21.15.82:35046) 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96f5d9b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f8105a60 0x7f96f81010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96f6d9d700 1 -- 172.21.15.82:0/878314461 learned_addr learned my addr 172.21.15.82:0/878314461 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96f659c700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96f8103130 0x7f96f8102a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:40182/0 (socket says 172.21.15.82:40182) 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96f659c700 1 -- 172.21.15.82:0/878314461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f8105a60 msgr2=0x7f96f81010e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:44.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96f659c700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f8105a60 0x7f96f81010e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96f659c700 1 -- 172.21.15.82:0/878314461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f8108390 msgr2=0x7f96f8101620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.625+0000 7f96f659c700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f8108390 0x7f96f8101620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.626+0000 7f96f659c700 1 -- 172.21.15.82:0/878314461 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96f8101ed0 con 0x7f96f8103130 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.626+0000 7f96f6d9d700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f8108390 0x7f96f8101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.626+0000 7f96f659c700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96f8103130 0x7f96f8102a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96e8000c00 tx=0x7f96e800bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.626+0000 7f96e77fe700 1 -- 172.21.15.82:0/878314461 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8026070 con 0x7f96f8103130 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.626+0000 7f96e77fe700 1 -- 172.21.15.82:0/878314461 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96e800f460 con 0x7f96f8103130 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.626+0000 7f96fce53700 1 -- 172.21.15.82:0/878314461 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96f81a28e0 con 0x7f96f8103130 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.626+0000 7f96e77fe700 1 -- 172.21.15.82:0/878314461 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e8021670 con 0x7f96f8103130 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.626+0000 7f96fce53700 1 -- 172.21.15.82:0/878314461 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96f81a2d30 con 0x7f96f8103130 2024-03-27T07:21:44.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.627+0000 7f96fce53700 1 -- 172.21.15.82:0/878314461 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96f8050b50 con 0x7f96f8103130 2024-03-27T07:21:44.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.628+0000 7f96e77fe700 1 -- 172.21.15.82:0/878314461 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f96e8029070 con 0x7f96f8103130 2024-03-27T07:21:44.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.628+0000 7f96e77fe700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f96e00a37e0 0x7f96e00a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:44.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.629+0000 7f96f5d9b700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f96e00a37e0 0x7f96e00a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:44.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.629+0000 7f96e77fe700 1 -- 172.21.15.82:0/878314461 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f96e80d0ab0 con 0x7f96f8103130 2024-03-27T07:21:44.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.629+0000 7f96f5d9b700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f96e00a37e0 0x7f96e00a5ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009c60 tx=0x7f96ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:44.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.633+0000 7f96e77fe700 1 -- 172.21.15.82:0/878314461 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f96e805dcb0 con 0x7f96f8103130 2024-03-27T07:21:44.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.913+0000 7f96fce53700 1 -- 172.21.15.82:0/878314461 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f96f802dd30 con 0x7f96f8103130 2024-03-27T07:21:44.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.917+0000 7f96e77fe700 1 -- 172.21.15.82:0/878314461 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f96e8013070 con 0x7f96f8103130 2024-03-27T07:21:44.919 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-03-27T07:21:44.919 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQAIyQNmOTCFNhAAvd06ASnc7dVmMWbDnKtlrQ== 2024-03-27T07:21:44.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.919+0000 7f96fce53700 1 -- 172.21.15.82:0/878314461 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f96e00a37e0 msgr2=0x7f96e00a5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:44.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f96e00a37e0 0x7f96e00a5ca0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f96ec009c60 tx=0x7f96ec009260 comp rx=0 tx=0).stop 2024-03-27T07:21:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 -- 172.21.15.82:0/878314461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96f8103130 msgr2=0x7f96f8102a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96f8103130 0x7f96f8102a90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96e8000c00 tx=0x7f96e800bbb0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 -- 172.21.15.82:0/878314461 shutdown_connections 2024-03-27T07:21:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f96e00a37e0 0x7f96e00a5ca0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96f8103130 0x7f96f8102a90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96f8108390 0x7f96f8101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 --2- 172.21.15.82:0/878314461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f96f8105a60 0x7f96f81010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 -- 172.21.15.82:0/878314461 >> 172.21.15.82:0/878314461 conn(0x7f96f80fcb60 msgr2=0x7f96f8103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 -- 172.21.15.82:0/878314461 shutdown_connections 2024-03-27T07:21:44.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:44.920+0000 7f96fce53700 1 -- 172.21.15.82:0/878314461 wait complete. 2024-03-27T07:21:45.519 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:21:45.519 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-27T07:21:45.519 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-27T07:21:45.561 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-27T07:21:45.562 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-27T07:21:45.562 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph mgr dump --format=json 2024-03-27T07:21:45.840 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:45.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:45 smithi082 ceph-mon[32178]: pgmap v295: 97 pgs: 97 active+clean; 618 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.0 KiB/s wr, 20 op/s 2024-03-27T07:21:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:45 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/878314461' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-27T07:21:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:45 smithi082 ceph-mon[32178]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-27T07:21:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:45 smithi082 ceph-mon[32178]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-27T07:21:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:45 smithi149 ceph-mon[36065]: pgmap v295: 97 pgs: 97 active+clean; 618 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.0 KiB/s wr, 20 op/s 2024-03-27T07:21:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:45 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/878314461' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-27T07:21:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:45 smithi149 ceph-mon[36065]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-27T07:21:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:45 smithi149 ceph-mon[36065]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-27T07:21:46.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:45 smithi153 ceph-mon[36179]: pgmap v295: 97 pgs: 97 active+clean; 618 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.0 KiB/s wr, 20 op/s 2024-03-27T07:21:46.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:45 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/878314461' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-27T07:21:46.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:45 smithi153 ceph-mon[36179]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-27T07:21:46.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:45 smithi153 ceph-mon[36179]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-27T07:21:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.581+0000 7ffb998bc700 1 -- 172.21.15.82:0/1862205782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb94101540 msgr2=0x7ffb941019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.581+0000 7ffb998bc700 1 --2- 172.21.15.82:0/1862205782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb94101540 0x7ffb941019c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009990 tx=0x7ffb88009ca0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.581+0000 7ffb998bc700 1 -- 172.21.15.82:0/1862205782 shutdown_connections 2024-03-27T07:21:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.581+0000 7ffb998bc700 1 --2- 172.21.15.82:0/1862205782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb94101f00 0x7ffb9410e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.581+0000 7ffb998bc700 1 --2- 172.21.15.82:0/1862205782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb94107550 0x7ffb94107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.581+0000 7ffb998bc700 1 --2- 172.21.15.82:0/1862205782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb94101540 0x7ffb941019c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.581+0000 7ffb998bc700 1 -- 172.21.15.82:0/1862205782 >> 172.21.15.82:0/1862205782 conn(0x7ffb94078470 msgr2=0x7ffb94078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.581+0000 7ffb998bc700 1 -- 172.21.15.82:0/1862205782 shutdown_connections 2024-03-27T07:21:47.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.581+0000 7ffb998bc700 1 -- 172.21.15.82:0/1862205782 wait complete. 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb998bc700 1 Processor -- start 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb998bc700 1 -- start start 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb998bc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb94101540 0x7ffb9419d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb998bc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb94101f00 0x7ffb9419ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb998bc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb94107550 0x7ffb94197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb998bc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffb941117e0 con 0x7ffb94101540 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb998bc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ffb94111660 con 0x7ffb94107550 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb998bc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ffb94111960 con 0x7ffb94101f00 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb92ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb94101540 0x7ffb9419d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb92ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb94101540 0x7ffb9419d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46276/0 (socket says 172.21.15.82:46276) 2024-03-27T07:21:47.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb92ffd700 1 -- 172.21.15.82:0/3366146216 learned_addr learned my addr 172.21.15.82:0/3366146216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb927fc700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb94101f00 0x7ffb9419ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb937fe700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb94107550 0x7ffb94197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb92ffd700 1 -- 172.21.15.82:0/3366146216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb94101f00 msgr2=0x7ffb9419ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb92ffd700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb94101f00 0x7ffb9419ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb92ffd700 1 -- 172.21.15.82:0/3366146216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb94107550 msgr2=0x7ffb94197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb92ffd700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb94107550 0x7ffb94197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.582+0000 7ffb92ffd700 1 -- 172.21.15.82:0/3366146216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb941981a0 con 0x7ffb94101540 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.583+0000 7ffb92ffd700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb94101540 0x7ffb9419d880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400ef10 tx=0x7ffb8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.583+0000 7ffb988ba700 1 -- 172.21.15.82:0/3366146216 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8400c9c0 con 0x7ffb94101540 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.583+0000 7ffb998bc700 1 -- 172.21.15.82:0/3366146216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb94198430 con 0x7ffb94101540 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.583+0000 7ffb988ba700 1 -- 172.21.15.82:0/3366146216 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb84019070 con 0x7ffb94101540 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.583+0000 7ffb988ba700 1 -- 172.21.15.82:0/3366146216 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb84007e60 con 0x7ffb94101540 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.583+0000 7ffb998bc700 1 -- 172.21.15.82:0/3366146216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb941a4750 con 0x7ffb94101540 2024-03-27T07:21:47.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.584+0000 7ffb998bc700 1 -- 172.21.15.82:0/3366146216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb94069300 con 0x7ffb94101540 2024-03-27T07:21:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.586+0000 7ffb988ba700 1 -- 172.21.15.82:0/3366146216 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7ffb84012050 con 0x7ffb94101540 2024-03-27T07:21:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.586+0000 7ffb988ba700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ffb7c0a3730 0x7ffb7c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:47.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.586+0000 7ffb927fc700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ffb7c0a3730 0x7ffb7c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.586+0000 7ffb988ba700 1 -- 172.21.15.82:0/3366146216 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7ffb840d02c0 con 0x7ffb94101540 2024-03-27T07:21:47.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.587+0000 7ffb927fc700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ffb7c0a3730 0x7ffb7c0a5bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800b2e0 tx=0x7ffb88005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:47.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.590+0000 7ffb988ba700 1 -- 172.21.15.82:0/3366146216 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ffb84010040 con 0x7ffb94101540 2024-03-27T07:21:47.850 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:47 smithi082 ceph-mon[32178]: pgmap v296: 97 pgs: 97 active+clean; 618 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.0 KiB/s wr, 16 op/s 2024-03-27T07:21:47.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.848+0000 7ffb998bc700 1 -- 172.21.15.82:0/3366146216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ffb9402dd30 con 0x7ffb94101540 2024-03-27T07:21:47.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.853+0000 7ffb988ba700 1 -- 172.21.15.82:0/3366146216 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264395 (secure 0 0 0) 0x7ffb8409cee0 con 0x7ffb94101540 2024-03-27T07:21:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:47.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 -- 172.21.15.82:0/3366146216 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ffb7c0a3730 msgr2=0x7ffb7c0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:47.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ffb7c0a3730 0x7ffb7c0a5bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffb8800b2e0 tx=0x7ffb88005960 comp rx=0 tx=0).stop 2024-03-27T07:21:47.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 -- 172.21.15.82:0/3366146216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb94101540 msgr2=0x7ffb9419d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:47.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb94101540 0x7ffb9419d880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400ef10 tx=0x7ffb8400c3a0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 -- 172.21.15.82:0/3366146216 shutdown_connections 2024-03-27T07:21:47.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ffb7c0a3730 0x7ffb7c0a5bf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ffb94107550 0x7ffb94197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffb94101540 0x7ffb9419d880 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 --2- 172.21.15.82:0/3366146216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffb94101f00 0x7ffb9419ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:47.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 -- 172.21.15.82:0/3366146216 >> 172.21.15.82:0/3366146216 conn(0x7ffb94078470 msgr2=0x7ffb94100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:47.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 -- 172.21.15.82:0/3366146216 shutdown_connections 2024-03-27T07:21:47.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:47.856+0000 7ffb998bc700 1 -- 172.21.15.82:0/3366146216 wait complete. 2024-03-27T07:21:48.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:47 smithi149 ceph-mon[36065]: pgmap v296: 97 pgs: 97 active+clean; 618 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.0 KiB/s wr, 16 op/s 2024-03-27T07:21:48.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:47 smithi153 ceph-mon[36179]: pgmap v296: 97 pgs: 97 active+clean; 618 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 8.0 KiB/s wr, 16 op/s 2024-03-27T07:21:48.513 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":3599330107},{"type":"v1","addr":"172.21.15.82:6801","nonce":3599330107}]},"active_addr":"172.21.15.82:6801/3599330107","active_change":"2024-03-27T07:14:26.376053+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24118,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.82:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2476913094}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3910998089}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1643774131}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1969604742}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":2605641112}]}]} 2024-03-27T07:21:48.519 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-27T07:21:48.519 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-27T07:21:48.519 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-27T07:21:48.762 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:48.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:48 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3366146216' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-27T07:21:49.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:48 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3366146216' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-27T07:21:49.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:48 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3366146216' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-27T07:21:49.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:49 smithi082 ceph-mon[32178]: pgmap v297: 97 pgs: 97 active+clean; 623 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2024-03-27T07:21:50.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:49 smithi149 ceph-mon[36065]: pgmap v297: 97 pgs: 97 active+clean; 623 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2024-03-27T07:21:50.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:49 smithi153 ceph-mon[36179]: pgmap v297: 97 pgs: 97 active+clean; 623 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2024-03-27T07:21:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.438+0000 7f48ed9b7700 1 -- 172.21.15.82:0/3641350978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8108620 msgr2=0x7f48e8108a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.438+0000 7f48ed9b7700 1 --2- 172.21.15.82:0/3641350978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8108620 0x7f48e8108a00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009990 tx=0x7f48d8009ca0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.438+0000 7f48ed9b7700 1 -- 172.21.15.82:0/3641350978 shutdown_connections 2024-03-27T07:21:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.438+0000 7f48ed9b7700 1 --2- 172.21.15.82:0/3641350978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e8102fe0 0x7f48e810f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.438+0000 7f48ed9b7700 1 --2- 172.21.15.82:0/3641350978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8108620 0x7f48e8108a00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.438+0000 7f48ed9b7700 1 --2- 172.21.15.82:0/3641350978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48e8102620 0x7f48e8102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.438+0000 7f48ed9b7700 1 -- 172.21.15.82:0/3641350978 >> 172.21.15.82:0/3641350978 conn(0x7f48e80fe0f0 msgr2=0x7f48e8100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.438+0000 7f48ed9b7700 1 -- 172.21.15.82:0/3641350978 shutdown_connections 2024-03-27T07:21:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.438+0000 7f48ed9b7700 1 -- 172.21.15.82:0/3641350978 wait complete. 2024-03-27T07:21:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48ed9b7700 1 Processor -- start 2024-03-27T07:21:50.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48ed9b7700 1 -- start start 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48ed9b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e8102620 0x7f48e8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48ed9b7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48e8102fe0 0x7f48e81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48ed9b7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8108620 0x7f48e819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48ed9b7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48e8112970 con 0x7f48e8108620 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48ed9b7700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f48e81127f0 con 0x7f48e8102fe0 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48ed9b7700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f48e8112af0 con 0x7f48e8102620 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48e77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8108620 0x7f48e819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48e77fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8108620 0x7f48e819d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46296/0 (socket says 172.21.15.82:46296) 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e8102620 0x7f48e8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48de7fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48e8102fe0 0x7f48e81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:50.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48e77fe700 1 -- 172.21.15.82:0/4057939837 learned_addr learned my addr 172.21.15.82:0/4057939837 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48e77fe700 1 -- 172.21.15.82:0/4057939837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e8102620 msgr2=0x7f48e8198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48e77fe700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e8102620 0x7f48e8198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48e77fe700 1 -- 172.21.15.82:0/4057939837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48e8102fe0 msgr2=0x7f48e81992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48e77fe700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48e8102fe0 0x7f48e81992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.439+0000 7f48e77fe700 1 -- 172.21.15.82:0/4057939837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e819ddb0 con 0x7f48e8108620 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.440+0000 7f48de7fc700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48e8102fe0 0x7f48e81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.440+0000 7f48e77fe700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8108620 0x7f48e819d670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f48e000ef30 tx=0x7f48e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.440+0000 7f48ec9b5700 1 -- 172.21.15.82:0/4057939837 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e00092e0 con 0x7f48e8108620 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.440+0000 7f48ec9b5700 1 -- 172.21.15.82:0/4057939837 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f48e0004bb0 con 0x7f48e8108620 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.440+0000 7f48ec9b5700 1 -- 172.21.15.82:0/4057939837 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0004280 con 0x7f48e8108620 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.440+0000 7f48ed9b7700 1 -- 172.21.15.82:0/4057939837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e819e040 con 0x7f48e8108620 2024-03-27T07:21:50.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.440+0000 7f48ed9b7700 1 -- 172.21.15.82:0/4057939837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e81a5920 con 0x7f48e8108620 2024-03-27T07:21:50.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.441+0000 7f48ed9b7700 1 -- 172.21.15.82:0/4057939837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e8069300 con 0x7f48e8108620 2024-03-27T07:21:50.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.442+0000 7f48ec9b5700 1 -- 172.21.15.82:0/4057939837 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f48e001b030 con 0x7f48e8108620 2024-03-27T07:21:50.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.442+0000 7f48ec9b5700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f48d40a37b0 0x7f48d40a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:50.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.443+0000 7f48e6ffd700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f48d40a37b0 0x7f48d40a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:50.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.443+0000 7f48ec9b5700 1 -- 172.21.15.82:0/4057939837 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f48e00d0080 con 0x7f48e8108620 2024-03-27T07:21:50.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.443+0000 7f48e6ffd700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f48d40a37b0 0x7f48d40a5c70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f48d800b2e0 tx=0x7f48d8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:50.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.446+0000 7f48ec9b5700 1 -- 172.21.15.82:0/4057939837 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f48e0022020 con 0x7f48e8108620 2024-03-27T07:21:50.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.653+0000 7f48ed9b7700 1 -- 172.21.15.82:0/4057939837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48e802dd30 con 0x7f48e8108620 2024-03-27T07:21:50.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.654+0000 7f48ec9b5700 1 -- 172.21.15.82:0/4057939837 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22172 (secure 0 0 0) 0x7f48e0010040 con 0x7f48e8108620 2024-03-27T07:21:50.656 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:50.657 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":86,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:21:36.555279+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:21:50.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.656+0000 7f48ed9b7700 1 -- 172.21.15.82:0/4057939837 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f48d40a37b0 msgr2=0x7f48d40a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:50.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.656+0000 7f48ed9b7700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f48d40a37b0 0x7f48d40a5c70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f48d800b2e0 tx=0x7f48d8005960 comp rx=0 tx=0).stop 2024-03-27T07:21:50.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.656+0000 7f48ed9b7700 1 -- 172.21.15.82:0/4057939837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8108620 msgr2=0x7f48e819d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:50.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.656+0000 7f48ed9b7700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8108620 0x7f48e819d670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f48e000ef30 tx=0x7f48e000c3a0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.656+0000 7f48ed9b7700 1 -- 172.21.15.82:0/4057939837 shutdown_connections 2024-03-27T07:21:50.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.656+0000 7f48ed9b7700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f48d40a37b0 0x7f48d40a5c70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.656+0000 7f48ed9b7700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e8102620 0x7f48e8198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.656+0000 7f48ed9b7700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48e8108620 0x7f48e819d670 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.657+0000 7f48ed9b7700 1 --2- 172.21.15.82:0/4057939837 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f48e8102fe0 0x7f48e81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:50.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.657+0000 7f48ed9b7700 1 -- 172.21.15.82:0/4057939837 >> 172.21.15.82:0/4057939837 conn(0x7f48e80fe0f0 msgr2=0x7f48e80fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:50.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.657+0000 7f48ed9b7700 1 -- 172.21.15.82:0/4057939837 shutdown_connections 2024-03-27T07:21:50.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:50.657+0000 7f48ed9b7700 1 -- 172.21.15.82:0/4057939837 wait complete. 2024-03-27T07:21:51.405 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-27T07:21:51.405 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-27T07:21:51.648 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:51.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:51 smithi082 ceph-mon[32178]: pgmap v298: 97 pgs: 97 active+clean; 623 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-03-27T07:21:51.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:51 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4057939837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:51 smithi149 ceph-mon[36065]: pgmap v298: 97 pgs: 97 active+clean; 623 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-03-27T07:21:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:51 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4057939837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:51 smithi153 ceph-mon[36179]: pgmap v298: 97 pgs: 97 active+clean; 623 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-03-27T07:21:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:51 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4057939837' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.248+0000 7f00390bb700 1 -- 172.21.15.82:0/1667392877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00341011e0 msgr2=0x7f00341015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.248+0000 7f00390bb700 1 --2- 172.21.15.82:0/1667392877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00341011e0 0x7f00341015c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f002c00b0d0 tx=0x7f002c00b3e0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.248+0000 7f00390bb700 1 -- 172.21.15.82:0/1667392877 shutdown_connections 2024-03-27T07:21:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.248+0000 7f00390bb700 1 --2- 172.21.15.82:0/1667392877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0034107a00 0x7f003410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.248+0000 7f00390bb700 1 --2- 172.21.15.82:0/1667392877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00341011e0 0x7f00341015c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.248+0000 7f00390bb700 1 --2- 172.21.15.82:0/1667392877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0034101b90 0x7f00341072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.248+0000 7f00390bb700 1 -- 172.21.15.82:0/1667392877 >> 172.21.15.82:0/1667392877 conn(0x7f00340768a0 msgr2=0x7f0034076cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:53.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.248+0000 7f00390bb700 1 -- 172.21.15.82:0/1667392877 shutdown_connections 2024-03-27T07:21:53.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.248+0000 7f00390bb700 1 -- 172.21.15.82:0/1667392877 wait complete. 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.249+0000 7f00390bb700 1 Processor -- start 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.249+0000 7f00390bb700 1 -- start start 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f00390bb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00341011e0 0x7f0034198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f00390bb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0034101b90 0x7f0034199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f00390bb700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0034107a00 0x7f003419d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f00390bb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00341129b0 con 0x7f0034101b90 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f00390bb700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0034112830 con 0x7f0034107a00 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f00390bb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0034112b30 con 0x7f00341011e0 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f003259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0034101b90 0x7f0034199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f003259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0034101b90 0x7f0034199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46312/0 (socket says 172.21.15.82:46312) 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f003259c700 1 -- 172.21.15.82:0/586825249 learned_addr learned my addr 172.21.15.82:0/586825249 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:21:53.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f0032d9d700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00341011e0 0x7f0034198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f003359e700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0034107a00 0x7f003419d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f003259c700 1 -- 172.21.15.82:0/586825249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00341011e0 msgr2=0x7f0034198ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f003259c700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00341011e0 0x7f0034198ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f003259c700 1 -- 172.21.15.82:0/586825249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0034107a00 msgr2=0x7f003419d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f003259c700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0034107a00 0x7f003419d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f003259c700 1 -- 172.21.15.82:0/586825249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003419ded0 con 0x7f0034101b90 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f003259c700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0034101b90 0x7f0034199400 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f001c00e9c0 tx=0x7f001c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f002bfff700 1 -- 172.21.15.82:0/586825249 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c004a30 con 0x7f0034101b90 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f002bfff700 1 -- 172.21.15.82:0/586825249 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f001c00cca0 con 0x7f0034101b90 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f00390bb700 1 -- 172.21.15.82:0/586825249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003419e1c0 con 0x7f0034101b90 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f002bfff700 1 -- 172.21.15.82:0/586825249 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f001c005690 con 0x7f0034101b90 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.250+0000 7f00390bb700 1 -- 172.21.15.82:0/586825249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00341a5a40 con 0x7f0034101b90 2024-03-27T07:21:53.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.251+0000 7f00390bb700 1 -- 172.21.15.82:0/586825249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0034069300 con 0x7f0034101b90 2024-03-27T07:21:53.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.253+0000 7f002bfff700 1 -- 172.21.15.82:0/586825249 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f001c004cf0 con 0x7f0034101b90 2024-03-27T07:21:53.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.253+0000 7f002bfff700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f00200a3730 0x7f00200a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:21:53.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.254+0000 7f0032d9d700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f00200a3730 0x7f00200a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:21:53.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.254+0000 7f002bfff700 1 -- 172.21.15.82:0/586825249 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f001c0d0070 con 0x7f0034101b90 2024-03-27T07:21:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.254+0000 7f0032d9d700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f00200a3730 0x7f00200a5bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f002c009fd0 tx=0x7f002c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:21:53.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.257+0000 7f002bfff700 1 -- 172.21.15.82:0/586825249 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f001c053cb0 con 0x7f0034101b90 2024-03-27T07:21:53.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.456+0000 7f00390bb700 1 -- 172.21.15.82:0/586825249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f003402dd30 con 0x7f0034101b90 2024-03-27T07:21:53.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.458+0000 7f002bfff700 1 -- 172.21.15.82:0/586825249 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+22172 (secure 0 0 0) 0x7f001c09cc90 con 0x7f0034101b90 2024-03-27T07:21:53.460 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:21:53.460 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":86,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:21:36.555279+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:21:53.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 -- 172.21.15.82:0/586825249 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f00200a3730 msgr2=0x7f00200a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:53.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f00200a3730 0x7f00200a5bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f002c009fd0 tx=0x7f002c00b040 comp rx=0 tx=0).stop 2024-03-27T07:21:53.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 -- 172.21.15.82:0/586825249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0034101b90 msgr2=0x7f0034199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:21:53.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0034101b90 0x7f0034199400 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f001c00e9c0 tx=0x7f001c00ecd0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 -- 172.21.15.82:0/586825249 shutdown_connections 2024-03-27T07:21:53.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f00200a3730 0x7f00200a5bf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00341011e0 0x7f0034198ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0034107a00 0x7f003419d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 --2- 172.21.15.82:0/586825249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0034101b90 0x7f0034199400 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:21:53.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 -- 172.21.15.82:0/586825249 >> 172.21.15.82:0/586825249 conn(0x7f00340768a0 msgr2=0x7f00340ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:21:53.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 -- 172.21.15.82:0/586825249 shutdown_connections 2024-03-27T07:21:53.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:21:53.460+0000 7f00390bb700 1 -- 172.21.15.82:0/586825249 wait complete. 2024-03-27T07:21:53.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:53 smithi082 ceph-mon[32178]: pgmap v299: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.0 KiB/s wr, 14 op/s 2024-03-27T07:21:53.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:53 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/586825249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:54.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:53 smithi149 ceph-mon[36065]: pgmap v299: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.0 KiB/s wr, 14 op/s 2024-03-27T07:21:54.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:53 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/586825249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:54.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:53 smithi153 ceph-mon[36179]: pgmap v299: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 7.0 KiB/s wr, 14 op/s 2024-03-27T07:21:54.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:53 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/586825249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:21:54.200 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-27T07:21:54.200 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-27T07:21:54.201 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-27T07:21:54.201 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-27T07:21:54.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-27T07:21:54.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-27T07:21:54.202 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-27T07:21:54.203 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-27T07:21:54.203 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2024-03-27T07:21:54.204 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2024-03-27T07:21:54.204 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2024-03-27T07:21:54.204 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2024-03-27T07:21:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.351 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.351 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.352 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.352 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.460 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.462 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.464 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.565 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:55 smithi082 ceph-mon[32178]: pgmap v300: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-03-27T07:21:55.895 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:55.896 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:21:56.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:55 smithi149 ceph-mon[36065]: pgmap v300: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-03-27T07:21:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:55 smithi153 ceph-mon[36179]: pgmap v300: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 8 op/s 2024-03-27T07:21:57.916 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:57 smithi082 ceph-mon[32178]: pgmap v301: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-03-27T07:21:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:57 smithi149 ceph-mon[36065]: pgmap v301: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-03-27T07:21:58.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:57 smithi153 ceph-mon[36179]: pgmap v301: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-03-27T07:21:59.801 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:21:59 smithi082 ceph-mon[32178]: pgmap v302: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-27T07:22:00.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:21:59 smithi149 ceph-mon[36065]: pgmap v302: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-27T07:22:00.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:21:59 smithi153 ceph-mon[36179]: pgmap v302: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-03-27T07:22:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.692+0000 7f3716225700 1 -- 172.21.15.82:0/1107157557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3710101570 msgr2=0x7f37101019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.692+0000 7f3716225700 1 --2- 172.21.15.82:0/1107157557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3710101570 0x7f37101019f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f36f80099c0 tx=0x7f36f8009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.692+0000 7f3716225700 1 -- 172.21.15.82:0/1107157557 shutdown_connections 2024-03-27T07:22:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.692+0000 7f3716225700 1 --2- 172.21.15.82:0/1107157557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37101075b0 0x7f3710107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.692+0000 7f3716225700 1 --2- 172.21.15.82:0/1107157557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710101f30 0x7f371010e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.692+0000 7f3716225700 1 --2- 172.21.15.82:0/1107157557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3710101570 0x7f37101019f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:01.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.692+0000 7f3716225700 1 -- 172.21.15.82:0/1107157557 >> 172.21.15.82:0/1107157557 conn(0x7f3710077590 msgr2=0x7f37100779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.693+0000 7f3716225700 1 -- 172.21.15.82:0/1107157557 shutdown_connections 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.693+0000 7f3716225700 1 -- 172.21.15.82:0/1107157557 wait complete. 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.693+0000 7f3716225700 1 Processor -- start 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.693+0000 7f3716225700 1 -- start start 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.693+0000 7f3716225700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710101570 0x7f3710199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.693+0000 7f3716225700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3710101f30 0x7f371019a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.693+0000 7f3716225700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37101075b0 0x7f37101a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.693+0000 7f3716225700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3710111810 con 0x7f37101075b0 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.693+0000 7f3716225700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3710111690 con 0x7f3710101570 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.693+0000 7f3716225700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3710111990 con 0x7f3710101f30 2024-03-27T07:22:01.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710101570 0x7f3710199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f3707fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3710101f30 0x7f371019a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370f7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710101570 0x7f3710199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:59560/0 (socket says 172.21.15.82:59560) 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370f7fe700 1 -- 172.21.15.82:0/2355622468 learned_addr learned my addr 172.21.15.82:0/2355622468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370ffff700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37101075b0 0x7f37101a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370f7fe700 1 -- 172.21.15.82:0/2355622468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3710101f30 msgr2=0x7f371019a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370f7fe700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3710101f30 0x7f371019a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370f7fe700 1 -- 172.21.15.82:0/2355622468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37101075b0 msgr2=0x7f37101a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370f7fe700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f37101075b0 0x7f37101a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370f7fe700 1 -- 172.21.15.82:0/2355622468 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37101a51b0 con 0x7f3710101570 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f3707fff700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3710101f30 0x7f371019a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370f7fe700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710101570 0x7f3710199bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f370000e9c0 tx=0x7f370000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370d7fa700 1 -- 172.21.15.82:0/2355622468 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370000cbd0 con 0x7f3710101570 2024-03-27T07:22:01.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37101a53e0 con 0x7f3710101570 2024-03-27T07:22:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370d7fa700 1 -- 172.21.15.82:0/2355622468 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f370000ee60 con 0x7f3710101570 2024-03-27T07:22:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f370d7fa700 1 -- 172.21.15.82:0/2355622468 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3700005630 con 0x7f3710101570 2024-03-27T07:22:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.694+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37101a58f0 con 0x7f3710101570 2024-03-27T07:22:01.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.695+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3710062d50 con 0x7f3710101570 2024-03-27T07:22:01.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.696+0000 7f370d7fa700 1 -- 172.21.15.82:0/2355622468 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f3700004750 con 0x7f3710101570 2024-03-27T07:22:01.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.697+0000 7f370d7fa700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f36fc0a3730 0x7f36fc0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:01.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.697+0000 7f3707fff700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f36fc0a3730 0x7f36fc0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:01.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.697+0000 7f370d7fa700 1 -- 172.21.15.82:0/2355622468 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f37000d0400 con 0x7f3710101570 2024-03-27T07:22:01.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.697+0000 7f370d7fa700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] conn(0x7f36fc0acf10 0x7f36fc0af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:01.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.697+0000 7f370d7fa700 1 -- 172.21.15.82:0/2355622468 --> [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3700001d30 con 0x7f36fc0acf10 2024-03-27T07:22:01.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.697+0000 7f370d7fa700 1 -- 172.21.15.82:0/2355622468 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f37000d07b0 con 0x7f3710101570 2024-03-27T07:22:01.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.697+0000 7f3707fff700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f36fc0a3730 0x7f36fc0a5bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f371006b6d0 tx=0x7f36f8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:01.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.697+0000 7f370ffff700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] conn(0x7f36fc0acf10 0x7f36fc0af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:01.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.698+0000 7f370ffff700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] conn(0x7f36fc0acf10 0x7f36fc0af330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:01.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.698+0000 7f370d7fa700 1 -- 172.21.15.82:0/2355622468 <== osd.8 v2:172.21.15.153:6816/3435360108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3700001d30 con 0x7f36fc0acf10 2024-03-27T07:22:01.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.714+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 --> [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37100631d0 con 0x7f36fc0acf10 2024-03-27T07:22:01.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.714+0000 7f370d7fa700 1 -- 172.21.15.82:0/2355622468 <== osd.8 v2:172.21.15.153:6816/3435360108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f37100631d0 con 0x7f36fc0acf10 2024-03-27T07:22:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 >> [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] conn(0x7f36fc0acf10 msgr2=0x7f36fc0af330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f3716225700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] conn(0x7f36fc0acf10 0x7f36fc0af330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f36fc0a3730 msgr2=0x7f36fc0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f3716225700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f36fc0a3730 0x7f36fc0a5bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f371006b6d0 tx=0x7f36f8005fb0 comp rx=0 tx=0).stop 2024-03-27T07:22:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710101570 msgr2=0x7f3710199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:01.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f3716225700 1 --2- 172.21.15.82:0/2355622468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3710101570 0x7f3710199bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f370000e9c0 tx=0x7f370000ecd0 comp rx=0 tx=0).stop 2024-03-27T07:22:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f370ffff700 1 -- 172.21.15.82:0/2355622468 reap_dead start 2024-03-27T07:22:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 shutdown_connections 2024-03-27T07:22:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 >> 172.21.15.82:0/2355622468 conn(0x7f3710077590 msgr2=0x7f3710100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 shutdown_connections 2024-03-27T07:22:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:01.715+0000 7f3716225700 1 -- 172.21.15.82:0/2355622468 wait complete. 2024-03-27T07:22:01.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:01 smithi082 ceph-mon[32178]: pgmap v303: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-27T07:22:02.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:01 smithi149 ceph-mon[36065]: pgmap v303: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-27T07:22:02.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:01 smithi153 ceph-mon[36179]: pgmap v303: 97 pgs: 97 active+clean; 635 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-03-27T07:22:03.859 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:03 smithi082 ceph-mon[32178]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-27T07:22:04.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:03 smithi149 ceph-mon[36065]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-27T07:22:04.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:03 smithi153 ceph-mon[36179]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-27T07:22:05.357 INFO:teuthology.orchestra.run.smithi082.stdout:257698037795 2024-03-27T07:22:05.358 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.8 2024-03-27T07:22:05.845 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:05 smithi082 ceph-mon[32178]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:22:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:05 smithi149 ceph-mon[36065]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:22:06.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:05 smithi153 ceph-mon[36179]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:22:06.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.364+0000 7f885218b700 1 -- 172.21.15.82:0/3671006788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c101b80 msgr2=0x7f884c1072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:06.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.364+0000 7f885218b700 1 --2- 172.21.15.82:0/3671006788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c101b80 0x7f884c1072c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f88400099c0 tx=0x7f8840009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:06.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.364+0000 7f885218b700 1 -- 172.21.15.82:0/3671006788 shutdown_connections 2024-03-27T07:22:06.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.364+0000 7f885218b700 1 --2- 172.21.15.82:0/3671006788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f884c1011d0 0x7f884c1015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:06.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.364+0000 7f885218b700 1 --2- 172.21.15.82:0/3671006788 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f884c1079f0 0x7f884c10f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:06.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.364+0000 7f885218b700 1 --2- 172.21.15.82:0/3671006788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c101b80 0x7f884c1072c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:06.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.364+0000 7f885218b700 1 -- 172.21.15.82:0/3671006788 >> 172.21.15.82:0/3671006788 conn(0x7f884c076870 msgr2=0x7f884c076c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:06.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.365+0000 7f885218b700 1 -- 172.21.15.82:0/3671006788 shutdown_connections 2024-03-27T07:22:06.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.365+0000 7f885218b700 1 -- 172.21.15.82:0/3671006788 wait complete. 2024-03-27T07:22:06.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.365+0000 7f885218b700 1 Processor -- start 2024-03-27T07:22:06.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.365+0000 7f885218b700 1 -- start start 2024-03-27T07:22:06.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f885218b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c1011d0 0x7f884c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:06.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f885218b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f884c101b80 0x7f884c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:06.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f885218b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f884c1079f0 0x7f884c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:06.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f885218b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f884c112960 con 0x7f884c1011d0 2024-03-27T07:22:06.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f885218b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f884c1127e0 con 0x7f884c101b80 2024-03-27T07:22:06.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f885218b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f884c112ae0 con 0x7f884c1079f0 2024-03-27T07:22:06.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c1011d0 0x7f884c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:06.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c1011d0 0x7f884c198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59226/0 (socket says 172.21.15.82:59226) 2024-03-27T07:22:06.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884affd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f884c101b80 0x7f884c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884b7fe700 1 -- 172.21.15.82:0/629775581 learned_addr learned my addr 172.21.15.82:0/629775581 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884bfff700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f884c1079f0 0x7f884c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884b7fe700 1 -- 172.21.15.82:0/629775581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f884c1079f0 msgr2=0x7f884c19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884b7fe700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f884c1079f0 0x7f884c19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884b7fe700 1 -- 172.21.15.82:0/629775581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f884c101b80 msgr2=0x7f884c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884b7fe700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f884c101b80 0x7f884c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884b7fe700 1 -- 172.21.15.82:0/629775581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c19de40 con 0x7f884c1011d0 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f884b7fe700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c1011d0 0x7f884c198e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f883c00d980 tx=0x7f883c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f8848ff9700 1 -- 172.21.15.82:0/629775581 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c017070 con 0x7f884c1011d0 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884c19e130 con 0x7f884c1011d0 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.366+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884c1a59b0 con 0x7f884c1011d0 2024-03-27T07:22:06.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.367+0000 7f8848ff9700 1 -- 172.21.15.82:0/629775581 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f883c005020 con 0x7f884c1011d0 2024-03-27T07:22:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.367+0000 7f8848ff9700 1 -- 172.21.15.82:0/629775581 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c00fa70 con 0x7f884c1011d0 2024-03-27T07:22:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.367+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8838001030 con 0x7f884c1011d0 2024-03-27T07:22:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.368+0000 7f8848ff9700 1 -- 172.21.15.82:0/629775581 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f883c00fc10 con 0x7f884c1011d0 2024-03-27T07:22:06.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.369+0000 7f8848ff9700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f88340a37b0 0x7f88340a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:06.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.369+0000 7f884affd700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f88340a37b0 0x7f88340a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:06.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.369+0000 7f8848ff9700 1 -- 172.21.15.82:0/629775581 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f883c0cff30 con 0x7f884c1011d0 2024-03-27T07:22:06.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.369+0000 7f8848ff9700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] conn(0x7f88340acf90 0x7f88340af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:06.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.369+0000 7f8848ff9700 1 -- 172.21.15.82:0/629775581 --> [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f883c015e80 con 0x7f88340acf90 2024-03-27T07:22:06.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.369+0000 7f8848ff9700 1 -- 172.21.15.82:0/629775581 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f883c0d0410 con 0x7f884c1011d0 2024-03-27T07:22:06.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.369+0000 7f884affd700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f88340a37b0 0x7f88340a5c70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8840009990 tx=0x7f8840005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:06.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.369+0000 7f884bfff700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] conn(0x7f88340acf90 0x7f88340af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:06.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.370+0000 7f884bfff700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] conn(0x7f88340acf90 0x7f88340af3b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:06.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.371+0000 7f8848ff9700 1 -- 172.21.15.82:0/629775581 <== osd.10 v2:172.21.15.149:6824/42810131 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f883c015e80 con 0x7f88340acf90 2024-03-27T07:22:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.387+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 --> [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8838002e60 con 0x7f88340acf90 2024-03-27T07:22:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.387+0000 7f8848ff9700 1 -- 172.21.15.82:0/629775581 <== osd.10 v2:172.21.15.149:6824/42810131 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8838002e60 con 0x7f88340acf90 2024-03-27T07:22:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 >> [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] conn(0x7f88340acf90 msgr2=0x7f88340af3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f885218b700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] conn(0x7f88340acf90 0x7f88340af3b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f88340a37b0 msgr2=0x7f88340a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f885218b700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f88340a37b0 0x7f88340a5c70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8840009990 tx=0x7f8840005fb0 comp rx=0 tx=0).stop 2024-03-27T07:22:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c1011d0 msgr2=0x7f884c198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f885218b700 1 --2- 172.21.15.82:0/629775581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f884c1011d0 0x7f884c198e30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f883c00d980 tx=0x7f883c00dc90 comp rx=0 tx=0).stop 2024-03-27T07:22:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f884bfff700 1 -- 172.21.15.82:0/629775581 reap_dead start 2024-03-27T07:22:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 shutdown_connections 2024-03-27T07:22:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 >> 172.21.15.82:0/629775581 conn(0x7f884c076870 msgr2=0x7f884c1006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 shutdown_connections 2024-03-27T07:22:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:06.388+0000 7f885218b700 1 -- 172.21.15.82:0/629775581 wait complete. 2024-03-27T07:22:07.796 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:07 smithi082 ceph-mon[32178]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:22:08.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:07 smithi149 ceph-mon[36065]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:22:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:07 smithi153 ceph-mon[36179]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:22:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.066+0000 7f2bba462700 1 -- 172.21.15.82:0/1840371442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb41064d0 msgr2=0x7f2bb41068b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.066+0000 7f2bba462700 1 --2- 172.21.15.82:0/1840371442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb41064d0 0x7f2bb41068b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ba40099c0 tx=0x7f2ba4009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.066+0000 7f2bba462700 1 -- 172.21.15.82:0/1840371442 shutdown_connections 2024-03-27T07:22:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.066+0000 7f2bba462700 1 --2- 172.21.15.82:0/1840371442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb4101ee0 0x7f2bb410e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.066+0000 7f2bba462700 1 --2- 172.21.15.82:0/1840371442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb41064d0 0x7f2bb41068b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.066+0000 7f2bba462700 1 --2- 172.21.15.82:0/1840371442 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb4101520 0x7f2bb41019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.066+0000 7f2bba462700 1 -- 172.21.15.82:0/1840371442 >> 172.21.15.82:0/1840371442 conn(0x7f2bb4078550 msgr2=0x7f2bb4078960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.067+0000 7f2bba462700 1 -- 172.21.15.82:0/1840371442 shutdown_connections 2024-03-27T07:22:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.067+0000 7f2bba462700 1 -- 172.21.15.82:0/1840371442 wait complete. 2024-03-27T07:22:09.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.067+0000 7f2bba462700 1 Processor -- start 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.067+0000 7f2bba462700 1 -- start start 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.067+0000 7f2bba462700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb4101520 0x7f2bb4197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.067+0000 7f2bba462700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb4101ee0 0x7f2bb4197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.067+0000 7f2bba462700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb41064d0 0x7f2bb41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.067+0000 7f2bba462700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb4111840 con 0x7f2bb4101ee0 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.067+0000 7f2bba462700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb41116c0 con 0x7f2bb41064d0 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.067+0000 7f2bba462700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb41119c0 con 0x7f2bb4101520 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb4101ee0 0x7f2bb4197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb37fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb4101ee0 0x7f2bb4197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36992/0 (socket says 172.21.15.82:36992) 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb37fe700 1 -- 172.21.15.82:0/2414054959 learned_addr learned my addr 172.21.15.82:0/2414054959 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb89ff700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb41064d0 0x7f2bb41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb3fff700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb4101520 0x7f2bb4197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb37fe700 1 -- 172.21.15.82:0/2414054959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb4101520 msgr2=0x7f2bb4197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb37fe700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bb4101520 0x7f2bb4197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb37fe700 1 -- 172.21.15.82:0/2414054959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb41064d0 msgr2=0x7f2bb41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb37fe700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2bb41064d0 0x7f2bb41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb37fe700 1 -- 172.21.15.82:0/2414054959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb41a72a0 con 0x7f2bb4101ee0 2024-03-27T07:22:09.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb37fe700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb4101ee0 0x7f2bb4197f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800d950 tx=0x7f2ba800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:09.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb17fa700 1 -- 172.21.15.82:0/2414054959 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8016070 con 0x7f2bb4101ee0 2024-03-27T07:22:09.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb17fa700 1 -- 172.21.15.82:0/2414054959 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ba800fd70 con 0x7f2bb4101ee0 2024-03-27T07:22:09.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb41a7590 con 0x7f2bb4101ee0 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bb17fa700 1 -- 172.21.15.82:0/2414054959 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800e610 con 0x7f2bb4101ee0 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.068+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb41a7ad0 con 0x7f2bb4101ee0 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.069+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2bb4062dd0 con 0x7f2bb4101ee0 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.070+0000 7f2bb17fa700 1 -- 172.21.15.82:0/2414054959 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f2ba8019070 con 0x7f2bb4101ee0 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.071+0000 7f2bb17fa700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b9c0a3730 0x7f2b9c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.071+0000 7f2bb3fff700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b9c0a3730 0x7f2b9c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.071+0000 7f2bb17fa700 1 -- 172.21.15.82:0/2414054959 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f2ba80cfcc0 con 0x7f2bb4101ee0 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.071+0000 7f2bb17fa700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] conn(0x7f2b9c0acf10 0x7f2b9c0af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.071+0000 7f2bb17fa700 1 -- 172.21.15.82:0/2414054959 --> [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ba8005690 con 0x7f2b9c0acf10 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.071+0000 7f2bb17fa700 1 -- 172.21.15.82:0/2414054959 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f2ba80d01a0 con 0x7f2bb4101ee0 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.071+0000 7f2bb3fff700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b9c0a3730 0x7f2b9c0a5bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4000c00 tx=0x7f2ba4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.071+0000 7f2bb89ff700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] conn(0x7f2b9c0acf10 0x7f2b9c0af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:09.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.072+0000 7f2bb89ff700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] conn(0x7f2b9c0acf10 0x7f2b9c0af330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.073+0000 7f2bb17fa700 1 -- 172.21.15.82:0/2414054959 <== osd.7 v2:172.21.15.149:6816/688070751 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2ba8005690 con 0x7f2b9c0acf10 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.089+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 --> [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2bb4063250 con 0x7f2b9c0acf10 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bb17fa700 1 -- 172.21.15.82:0/2414054959 <== osd.7 v2:172.21.15.149:6816/688070751 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2bb4063250 con 0x7f2b9c0acf10 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 >> [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] conn(0x7f2b9c0acf10 msgr2=0x7f2b9c0af330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bba462700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] conn(0x7f2b9c0acf10 0x7f2b9c0af330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b9c0a3730 msgr2=0x7f2b9c0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bba462700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b9c0a3730 0x7f2b9c0a5bf0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4000c00 tx=0x7f2ba4005fb0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb4101ee0 msgr2=0x7f2bb4197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bba462700 1 --2- 172.21.15.82:0/2414054959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb4101ee0 0x7f2bb4197f70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800d950 tx=0x7f2ba800dc60 comp rx=0 tx=0).stop 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bb89ff700 1 -- 172.21.15.82:0/2414054959 reap_dead start 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 shutdown_connections 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 >> 172.21.15.82:0/2414054959 conn(0x7f2bb4078550 msgr2=0x7f2bb40ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 shutdown_connections 2024-03-27T07:22:09.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.090+0000 7f2bba462700 1 -- 172.21.15.82:0/2414054959 wait complete. 2024-03-27T07:22:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 -- 172.21.15.82:0/1607335222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc4101bf0 msgr2=0x7f6cc4107330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 --2- 172.21.15.82:0/1607335222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc4101bf0 0x7f6cc4107330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6cb80099c0 tx=0x7f6cb8009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 -- 172.21.15.82:0/1607335222 shutdown_connections 2024-03-27T07:22:09.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 --2- 172.21.15.82:0/1607335222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cc4107a10 0x7f6cc410f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 --2- 172.21.15.82:0/1607335222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cc4101240 0x7f6cc4101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 --2- 172.21.15.82:0/1607335222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc4101bf0 0x7f6cc4107330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 -- 172.21.15.82:0/1607335222 >> 172.21.15.82:0/1607335222 conn(0x7f6cc40768c0 msgr2=0x7f6cc4076cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 -- 172.21.15.82:0/1607335222 shutdown_connections 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 -- 172.21.15.82:0/1607335222 wait complete. 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 Processor -- start 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.176+0000 7f6cca5fc700 1 -- start start 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cca5fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc4101240 0x7f6cc41021c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cca5fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cc4101bf0 0x7f6cc4102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cca5fc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cc4107a10 0x7f6cc4102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cca5fc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4112a10 con 0x7f6cc4101240 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cca5fc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4112890 con 0x7f6cc4107a10 2024-03-27T07:22:09.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cca5fc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6cc4112b90 con 0x7f6cc4101bf0 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc4101240 0x7f6cc41021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc3fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc4101240 0x7f6cc41021c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37010/0 (socket says 172.21.15.82:37010) 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc3fff700 1 -- 172.21.15.82:0/2207439887 learned_addr learned my addr 172.21.15.82:0/2207439887 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc37fe700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cc4101bf0 0x7f6cc4102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc8b99700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cc4107a10 0x7f6cc4102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc3fff700 1 -- 172.21.15.82:0/2207439887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cc4101bf0 msgr2=0x7f6cc4102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc3fff700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cc4101bf0 0x7f6cc4102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc3fff700 1 -- 172.21.15.82:0/2207439887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cc4107a10 msgr2=0x7f6cc4102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc3fff700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6cc4107a10 0x7f6cc4102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc3fff700 1 -- 172.21.15.82:0/2207439887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cc41a7410 con 0x7f6cc4101240 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc37fe700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cc4101bf0 0x7f6cc4102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:22:09.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc3fff700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc4101240 0x7f6cc41021c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400e9a0 tx=0x7f6cb400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc17fa700 1 -- 172.21.15.82:0/2207439887 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400cbd0 con 0x7f6cc4101240 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc17fa700 1 -- 172.21.15.82:0/2207439887 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cb400cd70 con 0x7f6cc4101240 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cc41a7700 con 0x7f6cc4101240 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.177+0000 7f6cc17fa700 1 -- 172.21.15.82:0/2207439887 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40187c0 con 0x7f6cc4101240 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.178+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cc41a7c60 con 0x7f6cc4101240 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.178+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6cc4062d50 con 0x7f6cc4101240 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.179+0000 7f6cc17fa700 1 -- 172.21.15.82:0/2207439887 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f6cb4010430 con 0x7f6cc4101240 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.180+0000 7f6cc17fa700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6cac0a37b0 0x7f6cac0a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.180+0000 7f6cc37fe700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6cac0a37b0 0x7f6cac0a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.180+0000 7f6cc17fa700 1 -- 172.21.15.82:0/2207439887 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f6cb40d0730 con 0x7f6cc4101240 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.180+0000 7f6cc17fa700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] conn(0x7f6cac0acf90 0x7f6cac0af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.180+0000 7f6cc17fa700 1 -- 172.21.15.82:0/2207439887 --> [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cac0afa60 con 0x7f6cac0acf90 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.180+0000 7f6cc17fa700 1 -- 172.21.15.82:0/2207439887 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f6cb40d0c10 con 0x7f6cc4101240 2024-03-27T07:22:09.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.180+0000 7f6cc37fe700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6cac0a37b0 0x7f6cac0a5c70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8000c00 tx=0x7f6cb8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.181+0000 7f6cc8b99700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] conn(0x7f6cac0acf90 0x7f6cac0af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.181+0000 7f6cc8b99700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] conn(0x7f6cac0acf90 0x7f6cac0af3b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.182+0000 7f6cc17fa700 1 -- 172.21.15.82:0/2207439887 <== osd.11 v2:172.21.15.153:6824/4155977568 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6cac0afa60 con 0x7f6cac0acf90 2024-03-27T07:22:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 --> [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6cc4063150 con 0x7f6cac0acf90 2024-03-27T07:22:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cc17fa700 1 -- 172.21.15.82:0/2207439887 <== osd.11 v2:172.21.15.153:6824/4155977568 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6cc4063150 con 0x7f6cac0acf90 2024-03-27T07:22:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 >> [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] conn(0x7f6cac0acf90 msgr2=0x7f6cac0af3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cca5fc700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] conn(0x7f6cac0acf90 0x7f6cac0af3b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6cac0a37b0 msgr2=0x7f6cac0a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cca5fc700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6cac0a37b0 0x7f6cac0a5c70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8000c00 tx=0x7f6cb8005fd0 comp rx=0 tx=0).stop 2024-03-27T07:22:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc4101240 msgr2=0x7f6cc41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cca5fc700 1 --2- 172.21.15.82:0/2207439887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6cc4101240 0x7f6cc41021c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400e9a0 tx=0x7f6cb400ed60 comp rx=0 tx=0).stop 2024-03-27T07:22:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cc8b99700 1 -- 172.21.15.82:0/2207439887 reap_dead start 2024-03-27T07:22:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 shutdown_connections 2024-03-27T07:22:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.198+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 >> 172.21.15.82:0/2207439887 conn(0x7f6cc40768c0 msgr2=0x7f6cc40ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.199+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 shutdown_connections 2024-03-27T07:22:09.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:09.199+0000 7f6cca5fc700 1 -- 172.21.15.82:0/2207439887 wait complete. 2024-03-27T07:22:09.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:09 smithi082 ceph-mon[32178]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:22:10.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:09 smithi149 ceph-mon[36065]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:22:10.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:09 smithi153 ceph-mon[36179]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:22:10.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/2428478246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b74101520 msgr2=0x7f4b741019a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:10.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 --2- 172.21.15.82:0/2428478246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b74101520 0x7f4b741019a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4b680099c0 tx=0x7f4b68009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:10.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/2428478246 shutdown_connections 2024-03-27T07:22:10.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 --2- 172.21.15.82:0/2428478246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b74101ee0 0x7f4b7410e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:10.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 --2- 172.21.15.82:0/2428478246 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b741064d0 0x7f4b741068b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:10.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 --2- 172.21.15.82:0/2428478246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b74101520 0x7f4b741019a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/2428478246 >> 172.21.15.82:0/2428478246 conn(0x7f4b74078550 msgr2=0x7f4b74078960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/2428478246 shutdown_connections 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/2428478246 wait complete. 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 Processor -- start 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.080+0000 7f4b7a9c4700 1 -- start start 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b7a9c4700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b74101520 0x7f4b74103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b7a9c4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b74101ee0 0x7f4b741036a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b7a9c4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b741064d0 0x7f4b74103be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b7a9c4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4b74111860 con 0x7f4b74101ee0 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b7a9c4700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4b741116e0 con 0x7f4b74101520 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b7a9c4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4b741119e0 con 0x7f4b741064d0 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b737fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b74101ee0 0x7f4b741036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b73fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b74101520 0x7f4b74103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b73fff700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b74101520 0x7f4b74103160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:41678/0 (socket says 172.21.15.82:41678) 2024-03-27T07:22:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b73fff700 1 -- 172.21.15.82:0/4201349774 learned_addr learned my addr 172.21.15.82:0/4201349774 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b737fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b74101ee0 0x7f4b741036a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36970/0 (socket says 172.21.15.82:36970) 2024-03-27T07:22:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b78f61700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b741064d0 0x7f4b74103be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b73fff700 1 -- 172.21.15.82:0/4201349774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b741064d0 msgr2=0x7f4b74103be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b73fff700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b741064d0 0x7f4b74103be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b73fff700 1 -- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b74101ee0 msgr2=0x7f4b741036a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b73fff700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b74101ee0 0x7f4b741036a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b73fff700 1 -- 172.21.15.82:0/4201349774 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b741a7390 con 0x7f4b74101520 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.081+0000 7f4b737fe700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b74101ee0 0x7f4b741036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.082+0000 7f4b73fff700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b74101520 0x7f4b74103160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400e970 tx=0x7f4b6400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.082+0000 7f4b717fa700 1 -- 172.21.15.82:0/4201349774 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64004220 con 0x7f4b74101520 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.082+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b741a7680 con 0x7f4b74101520 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.082+0000 7f4b717fa700 1 -- 172.21.15.82:0/4201349774 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b640043c0 con 0x7f4b74101520 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.082+0000 7f4b717fa700 1 -- 172.21.15.82:0/4201349774 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64003dc0 con 0x7f4b74101520 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.082+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b741a7be0 con 0x7f4b74101520 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.082+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b74062d50 con 0x7f4b74101520 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.084+0000 7f4b717fa700 1 -- 172.21.15.82:0/4201349774 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f4b6400c7e0 con 0x7f4b74101520 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.084+0000 7f4b717fa700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4b5c0a3730 0x7f4b5c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.084+0000 7f4b737fe700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4b5c0a3730 0x7f4b5c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.085+0000 7f4b717fa700 1 -- 172.21.15.82:0/4201349774 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f4b640d0170 con 0x7f4b74101520 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.085+0000 7f4b717fa700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] conn(0x7f4b5c0acf10 0x7f4b5c0af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.085+0000 7f4b717fa700 1 -- 172.21.15.82:0/4201349774 --> [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b64012ec0 con 0x7f4b5c0acf10 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.085+0000 7f4b717fa700 1 -- 172.21.15.82:0/4201349774 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f4b640d05d0 con 0x7f4b74101520 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.085+0000 7f4b737fe700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4b5c0a3730 0x7f4b5c0a5bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b74104ba0 tx=0x7f4b68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.085+0000 7f4b78f61700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] conn(0x7f4b5c0acf10 0x7f4b5c0af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.085+0000 7f4b78f61700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] conn(0x7f4b5c0acf10 0x7f4b5c0af330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.086+0000 7f4b717fa700 1 -- 172.21.15.82:0/4201349774 <== osd.3 v2:172.21.15.82:6810/590021111 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b64012ec0 con 0x7f4b5c0acf10 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 --> [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4b74063150 con 0x7f4b5c0acf10 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b717fa700 1 -- 172.21.15.82:0/4201349774 <== osd.3 v2:172.21.15.82:6810/590021111 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4b74063150 con 0x7f4b5c0acf10 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] conn(0x7f4b5c0acf10 msgr2=0x7f4b5c0af330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] conn(0x7f4b5c0acf10 0x7f4b5c0af330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4b5c0a3730 msgr2=0x7f4b5c0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4b5c0a3730 0x7f4b5c0a5bf0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b74104ba0 tx=0x7f4b68005fb0 comp rx=0 tx=0).stop 2024-03-27T07:22:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b74101520 msgr2=0x7f4b74103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 --2- 172.21.15.82:0/4201349774 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4b74101520 0x7f4b74103160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400e970 tx=0x7f4b6400ec80 comp rx=0 tx=0).stop 2024-03-27T07:22:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b78f61700 1 -- 172.21.15.82:0/4201349774 reap_dead start 2024-03-27T07:22:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 shutdown_connections 2024-03-27T07:22:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 >> 172.21.15.82:0/4201349774 conn(0x7f4b74078550 msgr2=0x7f4b7406b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 shutdown_connections 2024-03-27T07:22:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:08.102+0000 7f4b7a9c4700 1 -- 172.21.15.82:0/4201349774 wait complete. 2024-03-27T07:22:11.122 INFO:teuthology.orchestra.run.smithi082.stdout:107374182462 2024-03-27T07:22:11.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-27T07:22:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:11 smithi082 ceph-mon[32178]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-03-27T07:22:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:11 smithi149 ceph-mon[36065]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-03-27T07:22:12.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:11 smithi153 ceph-mon[36179]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-03-27T07:22:13.228 INFO:teuthology.orchestra.run.smithi082.stdout:313532612632 2024-03-27T07:22:13.228 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.10 2024-03-27T07:22:13.897 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:13 smithi082 ceph-mon[32178]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 596 B/s wr, 6 op/s 2024-03-27T07:22:14.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:13 smithi149 ceph-mon[36065]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 596 B/s wr, 6 op/s 2024-03-27T07:22:14.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:13 smithi153 ceph-mon[36179]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 596 B/s wr, 6 op/s 2024-03-27T07:22:14.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.682+0000 7fefa3ca1700 1 -- 172.21.15.82:0/1362138996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c108670 msgr2=0x7fef9c108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.682+0000 7fefa3ca1700 1 --2- 172.21.15.82:0/1362138996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c108670 0x7fef9c108a50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fef980099c0 tx=0x7fef98009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.682+0000 7fefa3ca1700 1 -- 172.21.15.82:0/1362138996 shutdown_connections 2024-03-27T07:22:14.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.682+0000 7fefa3ca1700 1 --2- 172.21.15.82:0/1362138996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9c06b750 0x7fef9c10f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.682+0000 7fefa3ca1700 1 --2- 172.21.15.82:0/1362138996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c108670 0x7fef9c108a50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.682+0000 7fefa3ca1700 1 --2- 172.21.15.82:0/1362138996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef9c06ad90 0x7fef9c06b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.682+0000 7fefa3ca1700 1 -- 172.21.15.82:0/1362138996 >> 172.21.15.82:0/1362138996 conn(0x7fef9c078550 msgr2=0x7fef9c078960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.682+0000 7fefa3ca1700 1 -- 172.21.15.82:0/1362138996 shutdown_connections 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.682+0000 7fefa3ca1700 1 -- 172.21.15.82:0/1362138996 wait complete. 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa3ca1700 1 Processor -- start 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa3ca1700 1 -- start start 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa3ca1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef9c06ad90 0x7fef9c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa3ca1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c06b750 0x7fef9c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa3ca1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9c108670 0x7fef9c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa3ca1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c1128f0 con 0x7fef9c06b750 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa3ca1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c112770 con 0x7fef9c108670 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa3ca1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c112a70 con 0x7fef9c06ad90 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa123c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c06b750 0x7fef9c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa123c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c06b750 0x7fef9c1992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37020/0 (socket says 172.21.15.82:37020) 2024-03-27T07:22:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa123c700 1 -- 172.21.15.82:0/3923794707 learned_addr learned my addr 172.21.15.82:0/3923794707 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:14.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa1a3d700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef9c06ad90 0x7fef9c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:14.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa223e700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9c108670 0x7fef9c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:14.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa123c700 1 -- 172.21.15.82:0/3923794707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef9c06ad90 msgr2=0x7fef9c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa123c700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef9c06ad90 0x7fef9c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa123c700 1 -- 172.21.15.82:0/3923794707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9c108670 msgr2=0x7fef9c19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa123c700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fef9c108670 0x7fef9c19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa123c700 1 -- 172.21.15.82:0/3923794707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9c19dd90 con 0x7fef9c06b750 2024-03-27T07:22:14.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.683+0000 7fefa123c700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c06b750 0x7fef9c1992c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00d980 tx=0x7fef8c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.684+0000 7fef92ffd700 1 -- 172.21.15.82:0/3923794707 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c016070 con 0x7fef9c06b750 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.684+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9c19e080 con 0x7fef9c06b750 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.684+0000 7fef92ffd700 1 -- 172.21.15.82:0/3923794707 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef8c004d10 con 0x7fef9c06b750 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.684+0000 7fef92ffd700 1 -- 172.21.15.82:0/3923794707 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c005670 con 0x7fef9c06b750 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.684+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef9c1a5900 con 0x7fef9c06b750 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.684+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef9c062dd0 con 0x7fef9c06b750 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.686+0000 7fef92ffd700 1 -- 172.21.15.82:0/3923794707 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7fef8c004750 con 0x7fef9c06b750 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.686+0000 7fef92ffd700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fef880a3730 0x7fef880a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.686+0000 7fefa1a3d700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fef880a3730 0x7fef880a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.687+0000 7fef92ffd700 1 -- 172.21.15.82:0/3923794707 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7fef8c0d0140 con 0x7fef9c06b750 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.687+0000 7fef92ffd700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] conn(0x7fef880acf10 0x7fef880af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:14.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.687+0000 7fef92ffd700 1 -- 172.21.15.82:0/3923794707 --> [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef8c015ec0 con 0x7fef880acf10 2024-03-27T07:22:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.687+0000 7fef92ffd700 1 -- 172.21.15.82:0/3923794707 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fef8c0d0620 con 0x7fef9c06b750 2024-03-27T07:22:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.687+0000 7fefa1a3d700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fef880a3730 0x7fef880a5bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef98000c00 tx=0x7fef98005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.687+0000 7fefa223e700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] conn(0x7fef880acf10 0x7fef880af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.687+0000 7fefa223e700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] conn(0x7fef880acf10 0x7fef880af330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.688+0000 7fef92ffd700 1 -- 172.21.15.82:0/3923794707 <== osd.2 v2:172.21.15.153:6800/2925402990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef8c015ec0 con 0x7fef880acf10 2024-03-27T07:22:14.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.704+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 --> [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef9c063250 con 0x7fef880acf10 2024-03-27T07:22:14.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.704+0000 7fef92ffd700 1 -- 172.21.15.82:0/3923794707 <== osd.2 v2:172.21.15.153:6800/2925402990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fef9c063250 con 0x7fef880acf10 2024-03-27T07:22:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 >> [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] conn(0x7fef880acf10 msgr2=0x7fef880af330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa3ca1700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] conn(0x7fef880acf10 0x7fef880af330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fef880a3730 msgr2=0x7fef880a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa3ca1700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fef880a3730 0x7fef880a5bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fef98000c00 tx=0x7fef98005fb0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c06b750 msgr2=0x7fef9c1992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa3ca1700 1 --2- 172.21.15.82:0/3923794707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fef9c06b750 0x7fef9c1992c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00d980 tx=0x7fef8c00dc90 comp rx=0 tx=0).stop 2024-03-27T07:22:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa223e700 1 -- 172.21.15.82:0/3923794707 reap_dead start 2024-03-27T07:22:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 shutdown_connections 2024-03-27T07:22:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 >> 172.21.15.82:0/3923794707 conn(0x7fef9c078550 msgr2=0x7fef9c1002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 shutdown_connections 2024-03-27T07:22:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.705+0000 7fefa3ca1700 1 -- 172.21.15.82:0/3923794707 wait complete. 2024-03-27T07:22:14.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.864+0000 7f950cddd700 1 -- 172.21.15.82:0/2900083188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9508101040 msgr2=0x7f95081014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.864+0000 7f950cddd700 1 --2- 172.21.15.82:0/2900083188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9508101040 0x7f95081014c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0099c0 tx=0x7f94fc009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.864+0000 7f950cddd700 1 -- 172.21.15.82:0/2900083188 shutdown_connections 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.864+0000 7f950cddd700 1 --2- 172.21.15.82:0/2900083188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9508107710 0x7f9508107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.864+0000 7f950cddd700 1 --2- 172.21.15.82:0/2900083188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9508101a00 0x7f950810f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.864+0000 7f950cddd700 1 --2- 172.21.15.82:0/2900083188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9508101040 0x7f95081014c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.864+0000 7f950cddd700 1 -- 172.21.15.82:0/2900083188 >> 172.21.15.82:0/2900083188 conn(0x7f9508076890 msgr2=0x7f9508076ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.864+0000 7f950cddd700 1 -- 172.21.15.82:0/2900083188 shutdown_connections 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.864+0000 7f950cddd700 1 -- 172.21.15.82:0/2900083188 wait complete. 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950cddd700 1 Processor -- start 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950cddd700 1 -- start start 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950cddd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9508101040 0x7f9508102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950cddd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9508101a00 0x7f9508102760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:14.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950cddd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9508107710 0x7f9508102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950cddd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95081129e0 con 0x7f9508101040 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950cddd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9508112860 con 0x7f9508101a00 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950cddd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9508112b60 con 0x7f9508107710 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9508101040 0x7f9508102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9508101040 0x7f9508102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37040/0 (socket says 172.21.15.82:37040) 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950659c700 1 -- 172.21.15.82:0/2849838123 learned_addr learned my addr 172.21.15.82:0/2849838123 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f9505d9b700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9508101a00 0x7f9508102760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f9506d9d700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9508107710 0x7f9508102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f9505d9b700 1 -- 172.21.15.82:0/2849838123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9508107710 msgr2=0x7f9508102ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f9505d9b700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9508107710 0x7f9508102ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f9505d9b700 1 -- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9508101040 msgr2=0x7f9508102220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f9505d9b700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9508101040 0x7f9508102220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f9505d9b700 1 -- 172.21.15.82:0/2849838123 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95081a7300 con 0x7f9508101a00 2024-03-27T07:22:14.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.865+0000 7f950659c700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9508101040 0x7f9508102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:14.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.866+0000 7f9505d9b700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9508101a00 0x7f9508102760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0098e0 tx=0x7f94fc005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:14.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.866+0000 7f94f77fe700 1 -- 172.21.15.82:0/2849838123 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc027070 con 0x7f9508101a00 2024-03-27T07:22:14.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.866+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95081a7590 con 0x7f9508101a00 2024-03-27T07:22:14.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.866+0000 7f94f77fe700 1 -- 172.21.15.82:0/2849838123 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94fc003680 con 0x7f9508101a00 2024-03-27T07:22:14.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.866+0000 7f94f77fe700 1 -- 172.21.15.82:0/2849838123 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94fc022e10 con 0x7f9508101a00 2024-03-27T07:22:14.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.866+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95081a79e0 con 0x7f9508101a00 2024-03-27T07:22:14.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.866+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95080ff8f0 con 0x7f9508101a00 2024-03-27T07:22:14.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.868+0000 7f94f77fe700 1 -- 172.21.15.82:0/2849838123 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f94fc02a070 con 0x7f9508101a00 2024-03-27T07:22:14.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.869+0000 7f94f77fe700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f00a3730 0x7f94f00a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:14.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.869+0000 7f950659c700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f00a3730 0x7f94f00a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:14.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.869+0000 7f94f77fe700 1 -- 172.21.15.82:0/2849838123 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f94fc0d0ea0 con 0x7f9508101a00 2024-03-27T07:22:14.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.869+0000 7f94f77fe700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] conn(0x7f94f00acf10 0x7f94f00af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:14.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.869+0000 7f94f77fe700 1 -- 172.21.15.82:0/2849838123 --> [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f94f00af9e0 con 0x7f94f00acf10 2024-03-27T07:22:14.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.869+0000 7f94f77fe700 1 -- 172.21.15.82:0/2849838123 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f94fc0d1380 con 0x7f9508101a00 2024-03-27T07:22:14.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.869+0000 7f9506d9d700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] conn(0x7f94f00acf10 0x7f94f00af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:14.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.869+0000 7f950659c700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f00a3730 0x7f94f00a5bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f94f8011550 tx=0x7f94f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:14.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.870+0000 7f9506d9d700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] conn(0x7f94f00acf10 0x7f94f00af330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:14.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.870+0000 7f94f77fe700 1 -- 172.21.15.82:0/2849838123 <== osd.9 v2:172.21.15.82:6826/1945187916 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f94f00af9e0 con 0x7f94f00acf10 2024-03-27T07:22:14.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.886+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 --> [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f950806a7c0 con 0x7f94f00acf10 2024-03-27T07:22:14.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f94f77fe700 1 -- 172.21.15.82:0/2849838123 <== osd.9 v2:172.21.15.82:6826/1945187916 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f950806a7c0 con 0x7f94f00acf10 2024-03-27T07:22:14.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] conn(0x7f94f00acf10 msgr2=0x7f94f00af330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f950cddd700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] conn(0x7f94f00acf10 0x7f94f00af330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:14.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f00a3730 msgr2=0x7f94f00a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f950cddd700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f00a3730 0x7f94f00a5bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f94f8011550 tx=0x7f94f8009260 comp rx=0 tx=0).stop 2024-03-27T07:22:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9508101a00 msgr2=0x7f9508102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f950cddd700 1 --2- 172.21.15.82:0/2849838123 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9508101a00 0x7f9508102760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0098e0 tx=0x7f94fc005f10 comp rx=0 tx=0).stop 2024-03-27T07:22:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f9506d9d700 1 -- 172.21.15.82:0/2849838123 reap_dead start 2024-03-27T07:22:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 shutdown_connections 2024-03-27T07:22:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 >> 172.21.15.82:0/2849838123 conn(0x7f9508076890 msgr2=0x7f95080fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 shutdown_connections 2024-03-27T07:22:14.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:14.887+0000 7f950cddd700 1 -- 172.21.15.82:0/2849838123 wait complete. 2024-03-27T07:22:15.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 -- 172.21.15.82:0/1493268113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c102690 msgr2=0x7f291c102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:15.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 --2- 172.21.15.82:0/1493268113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c102690 0x7f291c102b10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f290c0099c0 tx=0x7f290c009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:15.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 -- 172.21.15.82:0/1493268113 shutdown_connections 2024-03-27T07:22:15.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 --2- 172.21.15.82:0/1493268113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c108670 0x7f291c108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:15.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 --2- 172.21.15.82:0/1493268113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f291c103050 0x7f291c10f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 --2- 172.21.15.82:0/1493268113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c102690 0x7f291c102b10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 -- 172.21.15.82:0/1493268113 >> 172.21.15.82:0/1493268113 conn(0x7f291c079770 msgr2=0x7f291c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 -- 172.21.15.82:0/1493268113 shutdown_connections 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 -- 172.21.15.82:0/1493268113 wait complete. 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 Processor -- start 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 -- start start 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f291c102690 0x7f291c074940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.428+0000 7f292465c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c103050 0x7f291c074e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f292465c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c108670 0x7f291c0753c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f292465c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1128f0 con 0x7f291c103050 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f292465c700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f291c112770 con 0x7f291c102690 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f292465c700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f291c112a70 con 0x7f291c108670 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f2921bf7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c103050 0x7f291c074e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:15.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29223f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f291c102690 0x7f291c074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29223f8700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f291c102690 0x7f291c074940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:41798/0 (socket says 172.21.15.82:41798) 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29223f8700 1 -- 172.21.15.82:0/2390798609 learned_addr learned my addr 172.21.15.82:0/2390798609 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f2922bf9700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c108670 0x7f291c0753c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29223f8700 1 -- 172.21.15.82:0/2390798609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c108670 msgr2=0x7f291c0753c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29223f8700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f291c108670 0x7f291c0753c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29223f8700 1 -- 172.21.15.82:0/2390798609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c103050 msgr2=0x7f291c074e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29223f8700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c103050 0x7f291c074e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29223f8700 1 -- 172.21.15.82:0/2390798609 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c1a7390 con 0x7f291c102690 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f2921bf7700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f291c103050 0x7f291c074e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29223f8700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f291c102690 0x7f291c074940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f291800e9a0 tx=0x7f291800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29137fe700 1 -- 172.21.15.82:0/2390798609 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291800ca10 con 0x7f291c102690 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291c1a7680 con 0x7f291c102690 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29137fe700 1 -- 172.21.15.82:0/2390798609 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f291800cbb0 con 0x7f291c102690 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f29137fe700 1 -- 172.21.15.82:0/2390798609 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2918018680 con 0x7f291c102690 2024-03-27T07:22:15.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.429+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291c1a7be0 con 0x7f291c102690 2024-03-27T07:22:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.430+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f291c062d50 con 0x7f291c102690 2024-03-27T07:22:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.431+0000 7f29137fe700 1 -- 172.21.15.82:0/2390798609 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f2918010430 con 0x7f291c102690 2024-03-27T07:22:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.432+0000 7f29137fe700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29080a3730 0x7f29080a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.432+0000 7f2921bf7700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29080a3730 0x7f29080a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.432+0000 7f29137fe700 1 -- 172.21.15.82:0/2390798609 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f29180d0780 con 0x7f291c102690 2024-03-27T07:22:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.432+0000 7f29137fe700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] conn(0x7f29080acf10 0x7f29080af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.432+0000 7f29137fe700 1 -- 172.21.15.82:0/2390798609 --> [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f291801bec0 con 0x7f29080acf10 2024-03-27T07:22:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.432+0000 7f29137fe700 1 -- 172.21.15.82:0/2390798609 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f29180d0b30 con 0x7f291c102690 2024-03-27T07:22:15.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.432+0000 7f2921bf7700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29080a3730 0x7f29080a5bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f291c0763d0 tx=0x7f290c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:15.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.432+0000 7f2922bf9700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] conn(0x7f29080acf10 0x7f29080af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:15.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.433+0000 7f2922bf9700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] conn(0x7f29080acf10 0x7f29080af330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:15.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.433+0000 7f29137fe700 1 -- 172.21.15.82:0/2390798609 <== osd.1 v2:172.21.15.149:6800/828199566 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f291801bec0 con 0x7f29080acf10 2024-03-27T07:22:15.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.449+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 --> [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f291c063150 con 0x7f29080acf10 2024-03-27T07:22:15.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f29137fe700 1 -- 172.21.15.82:0/2390798609 <== osd.1 v2:172.21.15.149:6800/828199566 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f291c063150 con 0x7f29080acf10 2024-03-27T07:22:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 >> [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] conn(0x7f29080acf10 msgr2=0x7f29080af330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f292465c700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] conn(0x7f29080acf10 0x7f29080af330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29080a3730 msgr2=0x7f29080a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:15.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f292465c700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29080a3730 0x7f29080a5bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f291c0763d0 tx=0x7f290c005fb0 comp rx=0 tx=0).stop 2024-03-27T07:22:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f291c102690 msgr2=0x7f291c074940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f292465c700 1 --2- 172.21.15.82:0/2390798609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f291c102690 0x7f291c074940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f291800e9a0 tx=0x7f291800ecb0 comp rx=0 tx=0).stop 2024-03-27T07:22:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f2922bf9700 1 -- 172.21.15.82:0/2390798609 reap_dead start 2024-03-27T07:22:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 shutdown_connections 2024-03-27T07:22:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 >> 172.21.15.82:0/2390798609 conn(0x7f291c079770 msgr2=0x7f291c101430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 shutdown_connections 2024-03-27T07:22:15.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:15.450+0000 7f292465c700 1 -- 172.21.15.82:0/2390798609 wait complete. 2024-03-27T07:22:15.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:15 smithi082 ceph-mon[32178]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-27T07:22:16.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:15 smithi149 ceph-mon[36065]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-27T07:22:16.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:15 smithi153 ceph-mon[36179]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-27T07:22:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 -- 172.21.15.82:0/2015133015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35681064d0 msgr2=0x7f35681068b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 --2- 172.21.15.82:0/2015133015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35681064d0 0x7f35681068b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f356000b0d0 tx=0x7f356000b3e0 comp rx=0 tx=0).stop 2024-03-27T07:22:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 -- 172.21.15.82:0/2015133015 shutdown_connections 2024-03-27T07:22:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 --2- 172.21.15.82:0/2015133015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3568101ee0 0x7f356810e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 --2- 172.21.15.82:0/2015133015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35681064d0 0x7f35681068b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 --2- 172.21.15.82:0/2015133015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3568101520 0x7f35681019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 -- 172.21.15.82:0/2015133015 >> 172.21.15.82:0/2015133015 conn(0x7f3568078550 msgr2=0x7f3568078960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:16.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 -- 172.21.15.82:0/2015133015 shutdown_connections 2024-03-27T07:22:16.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 -- 172.21.15.82:0/2015133015 wait complete. 2024-03-27T07:22:16.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 Processor -- start 2024-03-27T07:22:16.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.174+0000 7f356db36700 1 -- start start 2024-03-27T07:22:16.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f356db36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3568101520 0x7f3568103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f356db36700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3568101ee0 0x7f35681036a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f356db36700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35681064d0 0x7f3568103be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f356db36700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3568111860 con 0x7f35681064d0 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f356db36700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f35681116e0 con 0x7f3568101ee0 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f356db36700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f35681119e0 con 0x7f3568101520 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3567fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35681064d0 0x7f3568103be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3567fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35681064d0 0x7f3568103be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37074/0 (socket says 172.21.15.82:37074) 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3567fff700 1 -- 172.21.15.82:0/1044641744 learned_addr learned my addr 172.21.15.82:0/1044641744 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3566ffd700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3568101ee0 0x7f35681036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f35677fe700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3568101520 0x7f3568103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3566ffd700 1 -- 172.21.15.82:0/1044641744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3568101520 msgr2=0x7f3568103160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3566ffd700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3568101520 0x7f3568103160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3566ffd700 1 -- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35681064d0 msgr2=0x7f3568103be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3566ffd700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35681064d0 0x7f3568103be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3566ffd700 1 -- 172.21.15.82:0/1044641744 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35681a7390 con 0x7f3568101ee0 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3567fff700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f35681064d0 0x7f3568103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f35677fe700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3568101520 0x7f3568103160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3566ffd700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3568101ee0 0x7f35681036a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f355c00e9f0 tx=0x7f355c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.175+0000 7f3564ff9700 1 -- 172.21.15.82:0/1044641744 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c00c9c0 con 0x7f3568101ee0 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.176+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35681a7680 con 0x7f3568101ee0 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.176+0000 7f3564ff9700 1 -- 172.21.15.82:0/1044641744 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f355c00cb60 con 0x7f3568101ee0 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.176+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35681a7c10 con 0x7f3568101ee0 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.176+0000 7f3564ff9700 1 -- 172.21.15.82:0/1044641744 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c018680 con 0x7f3568101ee0 2024-03-27T07:22:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.176+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3568062d50 con 0x7f3568101ee0 2024-03-27T07:22:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.178+0000 7f3564ff9700 1 -- 172.21.15.82:0/1044641744 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f355c010430 con 0x7f3568101ee0 2024-03-27T07:22:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.178+0000 7f3564ff9700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f35500a3730 0x7f35500a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.178+0000 7f35677fe700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f35500a3730 0x7f35500a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.178+0000 7f3564ff9700 1 -- 172.21.15.82:0/1044641744 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f355c0d0350 con 0x7f3568101ee0 2024-03-27T07:22:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.178+0000 7f3564ff9700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] conn(0x7f35500acf10 0x7f35500af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.178+0000 7f3564ff9700 1 -- 172.21.15.82:0/1044641744 --> [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35500af9e0 con 0x7f35500acf10 2024-03-27T07:22:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.178+0000 7f3564ff9700 1 -- 172.21.15.82:0/1044641744 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f355c0d0700 con 0x7f3568101ee0 2024-03-27T07:22:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.179+0000 7f3567fff700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] conn(0x7f35500acf10 0x7f35500af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.179+0000 7f35677fe700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f35500a3730 0x7f35500a5bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3560009fd0 tx=0x7f356000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:16.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.179+0000 7f3567fff700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] conn(0x7f35500acf10 0x7f35500af330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:16.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.180+0000 7f3564ff9700 1 -- 172.21.15.82:0/1044641744 <== osd.0 v2:172.21.15.82:6802/546346020 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35500af9e0 con 0x7f35500acf10 2024-03-27T07:22:16.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.195+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 --> [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3568063150 con 0x7f35500acf10 2024-03-27T07:22:16.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f3564ff9700 1 -- 172.21.15.82:0/1044641744 <== osd.0 v2:172.21.15.82:6802/546346020 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3568063150 con 0x7f35500acf10 2024-03-27T07:22:16.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] conn(0x7f35500acf10 msgr2=0x7f35500af330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:16.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f356db36700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] conn(0x7f35500acf10 0x7f35500af330 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:16.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f35500a3730 msgr2=0x7f35500a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:16.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f356db36700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f35500a3730 0x7f35500a5bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3560009fd0 tx=0x7f356000b040 comp rx=0 tx=0).stop 2024-03-27T07:22:16.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3568101ee0 msgr2=0x7f35681036a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:16.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f356db36700 1 --2- 172.21.15.82:0/1044641744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3568101ee0 0x7f35681036a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f355c00e9f0 tx=0x7f355c00ed00 comp rx=0 tx=0).stop 2024-03-27T07:22:16.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f3567fff700 1 -- 172.21.15.82:0/1044641744 reap_dead start 2024-03-27T07:22:16.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 shutdown_connections 2024-03-27T07:22:16.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 >> 172.21.15.82:0/1044641744 conn(0x7f3568078550 msgr2=0x7f356806b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:16.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 shutdown_connections 2024-03-27T07:22:16.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:16.196+0000 7f356db36700 1 -- 172.21.15.82:0/1044641744 wait complete. 2024-03-27T07:22:16.844 INFO:teuthology.orchestra.run.smithi082.stdout:347892350996 2024-03-27T07:22:16.845 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.11 2024-03-27T07:22:16.861 INFO:teuthology.orchestra.run.smithi082.stdout:292057776160 2024-03-27T07:22:16.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.9 2024-03-27T07:22:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.436+0000 7f182c9a2700 1 -- 172.21.15.82:0/3742418835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18281079c0 msgr2=0x7f182810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.436+0000 7f182c9a2700 1 --2- 172.21.15.82:0/3742418835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18281079c0 0x7f182810f5d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f182000b0d0 tx=0x7f182000b3e0 comp rx=0 tx=0).stop 2024-03-27T07:22:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.436+0000 7f182c9a2700 1 -- 172.21.15.82:0/3742418835 shutdown_connections 2024-03-27T07:22:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.436+0000 7f182c9a2700 1 --2- 172.21.15.82:0/3742418835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1828100e90 0x7f1828101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.436+0000 7f182c9a2700 1 --2- 172.21.15.82:0/3742418835 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18281079c0 0x7f182810f5d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.436+0000 7f182c9a2700 1 --2- 172.21.15.82:0/3742418835 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1828101840 0x7f1828107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.436+0000 7f182c9a2700 1 -- 172.21.15.82:0/3742418835 >> 172.21.15.82:0/3742418835 conn(0x7f1828077b40 msgr2=0x7f18280fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.436+0000 7f182c9a2700 1 -- 172.21.15.82:0/3742418835 shutdown_connections 2024-03-27T07:22:17.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.436+0000 7f182c9a2700 1 -- 172.21.15.82:0/3742418835 wait complete. 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.437+0000 7f182c9a2700 1 Processor -- start 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.437+0000 7f182c9a2700 1 -- start start 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.437+0000 7f182c9a2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1828100e90 0x7f1828198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.437+0000 7f182c9a2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1828101840 0x7f18281992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.437+0000 7f182c9a2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18281079c0 0x7f182819d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182c9a2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18281129c0 con 0x7f18281079c0 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182c9a2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1828112840 con 0x7f1828100e90 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182c9a2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1828112b40 con 0x7f1828101840 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1828100e90 0x7f1828198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f1826d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18281079c0 0x7f182819d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f1825d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1828101840 0x7f18281992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182659c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1828100e90 0x7f1828198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:41832/0 (socket says 172.21.15.82:41832) 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182659c700 1 -- 172.21.15.82:0/3407014183 learned_addr learned my addr 172.21.15.82:0/3407014183 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f1826d9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18281079c0 0x7f182819d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37094/0 (socket says 172.21.15.82:37094) 2024-03-27T07:22:17.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182659c700 1 -- 172.21.15.82:0/3407014183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1828101840 msgr2=0x7f18281992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182659c700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1828101840 0x7f18281992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182659c700 1 -- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18281079c0 msgr2=0x7f182819d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182659c700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18281079c0 0x7f182819d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182659c700 1 -- 172.21.15.82:0/3407014183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182819dd30 con 0x7f1828100e90 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f1826d9d700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18281079c0 0x7f182819d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f1825d9b700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1828101840 0x7f18281992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182659c700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1828100e90 0x7f1828198d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f181c00e9c0 tx=0x7f181c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f18177fe700 1 -- 172.21.15.82:0/3407014183 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c00cbd0 con 0x7f1828100e90 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f18177fe700 1 -- 172.21.15.82:0/3407014183 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f181c00ee60 con 0x7f1828100e90 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182819e020 con 0x7f1828100e90 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f18177fe700 1 -- 172.21.15.82:0/3407014183 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c005630 con 0x7f1828100e90 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.438+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18281a58a0 con 0x7f1828100e90 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.439+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1828062d50 con 0x7f1828100e90 2024-03-27T07:22:17.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.440+0000 7f18177fe700 1 -- 172.21.15.82:0/3407014183 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f181c004750 con 0x7f1828100e90 2024-03-27T07:22:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.441+0000 7f18177fe700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f18100a3730 0x7f18100a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.441+0000 7f1825d9b700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f18100a3730 0x7f18100a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.441+0000 7f18177fe700 1 -- 172.21.15.82:0/3407014183 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f181c0d06c0 con 0x7f1828100e90 2024-03-27T07:22:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.441+0000 7f18177fe700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] conn(0x7f18100acf10 0x7f18100af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.441+0000 7f18177fe700 1 -- 172.21.15.82:0/3407014183 --> [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f181c012ec0 con 0x7f18100acf10 2024-03-27T07:22:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.441+0000 7f18177fe700 1 -- 172.21.15.82:0/3407014183 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f181c0d0a70 con 0x7f1828100e90 2024-03-27T07:22:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.441+0000 7f1825d9b700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f18100a3730 0x7f18100a5bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f18281050a0 tx=0x7f1818009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.441+0000 7f1826d9d700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] conn(0x7f18100acf10 0x7f18100af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.442+0000 7f1826d9d700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] conn(0x7f18100acf10 0x7f18100af330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:17.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.442+0000 7f18177fe700 1 -- 172.21.15.82:0/3407014183 <== osd.6 v2:172.21.15.82:6818/2410451909 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f181c012ec0 con 0x7f18100acf10 2024-03-27T07:22:17.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.459+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 --> [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f18280631d0 con 0x7f18100acf10 2024-03-27T07:22:17.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f18177fe700 1 -- 172.21.15.82:0/3407014183 <== osd.6 v2:172.21.15.82:6818/2410451909 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f18280631d0 con 0x7f18100acf10 2024-03-27T07:22:17.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] conn(0x7f18100acf10 msgr2=0x7f18100af330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:17.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f182c9a2700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] conn(0x7f18100acf10 0x7f18100af330 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:17.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f18100a3730 msgr2=0x7f18100a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:17.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f182c9a2700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f18100a3730 0x7f18100a5bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f18281050a0 tx=0x7f1818009260 comp rx=0 tx=0).stop 2024-03-27T07:22:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1828100e90 msgr2=0x7f1828198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f182c9a2700 1 --2- 172.21.15.82:0/3407014183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1828100e90 0x7f1828198d70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f181c00e9c0 tx=0x7f181c00ecd0 comp rx=0 tx=0).stop 2024-03-27T07:22:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f1826d9d700 1 -- 172.21.15.82:0/3407014183 reap_dead start 2024-03-27T07:22:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 shutdown_connections 2024-03-27T07:22:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 >> 172.21.15.82:0/3407014183 conn(0x7f1828077b40 msgr2=0x7f18280fef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 shutdown_connections 2024-03-27T07:22:17.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:17.460+0000 7f182c9a2700 1 -- 172.21.15.82:0/3407014183 wait complete. 2024-03-27T07:22:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:17 smithi082 ceph-mon[32178]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-03-27T07:22:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:17 smithi149 ceph-mon[36065]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-03-27T07:22:18.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:17 smithi153 ceph-mon[36179]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 170 B/s wr, 4 op/s 2024-03-27T07:22:18.633 INFO:teuthology.orchestra.run.smithi082.stdout:223338299433 2024-03-27T07:22:18.633 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-27T07:22:18.753 INFO:teuthology.orchestra.run.smithi082.stdout:77309411396 2024-03-27T07:22:18.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-27T07:22:19.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.085+0000 7f0d343c1700 1 -- 172.21.15.82:0/1790487229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2c106570 msgr2=0x7f0d2c106950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:19.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.085+0000 7f0d343c1700 1 --2- 172.21.15.82:0/1790487229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2c106570 0x7f0d2c106950 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400b0a0 tx=0x7f0d2400b3b0 comp rx=0 tx=0).stop 2024-03-27T07:22:19.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.085+0000 7f0d343c1700 1 -- 172.21.15.82:0/1790487229 shutdown_connections 2024-03-27T07:22:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.085+0000 7f0d343c1700 1 --2- 172.21.15.82:0/1790487229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c102ab0 0x7f0d2c10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.085+0000 7f0d343c1700 1 --2- 172.21.15.82:0/1790487229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2c106570 0x7f0d2c106950 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.085+0000 7f0d343c1700 1 --2- 172.21.15.82:0/1790487229 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d2c1020f0 0x7f0d2c102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.085+0000 7f0d343c1700 1 -- 172.21.15.82:0/1790487229 >> 172.21.15.82:0/1790487229 conn(0x7f0d2c0768c0 msgr2=0x7f0d2c076cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.085+0000 7f0d343c1700 1 -- 172.21.15.82:0/1790487229 shutdown_connections 2024-03-27T07:22:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.085+0000 7f0d343c1700 1 -- 172.21.15.82:0/1790487229 wait complete. 2024-03-27T07:22:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d343c1700 1 Processor -- start 2024-03-27T07:22:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d343c1700 1 -- start start 2024-03-27T07:22:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d343c1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c1020f0 0x7f0d2c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:19.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d343c1700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d2c102ab0 0x7f0d2c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:19.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d343c1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2c106570 0x7f0d2c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:19.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d343c1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c1129a0 con 0x7f0d2c106570 2024-03-27T07:22:19.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d343c1700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c112820 con 0x7f0d2c102ab0 2024-03-27T07:22:19.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d343c1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c112b20 con 0x7f0d2c1020f0 2024-03-27T07:22:19.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d3295e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2c106570 0x7f0d2c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:19.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d3215d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c1020f0 0x7f0d2c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:19.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d3295e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2c106570 0x7f0d2c19d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48790/0 (socket says 172.21.15.82:48790) 2024-03-27T07:22:19.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d3295e700 1 -- 172.21.15.82:0/2144442860 learned_addr learned my addr 172.21.15.82:0/2144442860 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:19.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.086+0000 7f0d3195c700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d2c102ab0 0x7f0d2c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:19.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d3215d700 1 -- 172.21.15.82:0/2144442860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d2c102ab0 msgr2=0x7f0d2c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:19.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d3215d700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0d2c102ab0 0x7f0d2c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:19.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d3215d700 1 -- 172.21.15.82:0/2144442860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2c106570 msgr2=0x7f0d2c19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:19.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d3215d700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2c106570 0x7f0d2c19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:19.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d3215d700 1 -- 172.21.15.82:0/2144442860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2c19de40 con 0x7f0d2c1020f0 2024-03-27T07:22:19.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d3295e700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d2c106570 0x7f0d2c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:19.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d3215d700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c1020f0 0x7f0d2c198e30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400b070 tx=0x7f0d24004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:19.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d2b7fe700 1 -- 172.21.15.82:0/2144442860 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24021070 con 0x7f0d2c1020f0 2024-03-27T07:22:19.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d2b7fe700 1 -- 172.21.15.82:0/2144442860 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d24007b80 con 0x7f0d2c1020f0 2024-03-27T07:22:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2c19e0d0 con 0x7f0d2c1020f0 2024-03-27T07:22:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d2b7fe700 1 -- 172.21.15.82:0/2144442860 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24005040 con 0x7f0d2c1020f0 2024-03-27T07:22:19.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.087+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2c1a59b0 con 0x7f0d2c1020f0 2024-03-27T07:22:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.088+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d2c062d10 con 0x7f0d2c1020f0 2024-03-27T07:22:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.089+0000 7f0d2b7fe700 1 -- 172.21.15.82:0/2144442860 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f0d24024070 con 0x7f0d2c1020f0 2024-03-27T07:22:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.089+0000 7f0d2b7fe700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0d140a3730 0x7f0d140a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.090+0000 7f0d3195c700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0d140a3730 0x7f0d140a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.090+0000 7f0d2b7fe700 1 -- 172.21.15.82:0/2144442860 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f0d2400f020 con 0x7f0d2c1020f0 2024-03-27T07:22:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.090+0000 7f0d2b7fe700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] conn(0x7f0d140acde0 0x7f0d140af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.090+0000 7f0d2b7fe700 1 -- 172.21.15.82:0/2144442860 --> [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d240020b0 con 0x7f0d140acde0 2024-03-27T07:22:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.090+0000 7f0d2b7fe700 1 -- 172.21.15.82:0/2144442860 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f0d240d15e0 con 0x7f0d2c1020f0 2024-03-27T07:22:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.090+0000 7f0d3195c700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0d140a3730 0x7f0d140a5bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c076e70 tx=0x7f0d20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.090+0000 7f0d3295e700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] conn(0x7f0d140acde0 0x7f0d140af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.090+0000 7f0d3295e700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] conn(0x7f0d140acde0 0x7f0d140af200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.091+0000 7f0d2b7fe700 1 -- 172.21.15.82:0/2144442860 <== osd.4 v2:172.21.15.149:6808/1568090772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d240020b0 con 0x7f0d140acde0 2024-03-27T07:22:19.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.107+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 --> [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0d2c063190 con 0x7f0d140acde0 2024-03-27T07:22:19.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.107+0000 7f0d2b7fe700 1 -- 172.21.15.82:0/2144442860 <== osd.4 v2:172.21.15.149:6808/1568090772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0d2c063190 con 0x7f0d140acde0 2024-03-27T07:22:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 >> [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] conn(0x7f0d140acde0 msgr2=0x7f0d140af200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d343c1700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] conn(0x7f0d140acde0 0x7f0d140af200 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0d140a3730 msgr2=0x7f0d140a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d343c1700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0d140a3730 0x7f0d140a5bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c076e70 tx=0x7f0d20009260 comp rx=0 tx=0).stop 2024-03-27T07:22:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c1020f0 msgr2=0x7f0d2c198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:19.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d343c1700 1 --2- 172.21.15.82:0/2144442860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d2c1020f0 0x7f0d2c198e30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400b070 tx=0x7f0d24004d00 comp rx=0 tx=0).stop 2024-03-27T07:22:19.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d3295e700 1 -- 172.21.15.82:0/2144442860 reap_dead start 2024-03-27T07:22:19.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 shutdown_connections 2024-03-27T07:22:19.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 >> 172.21.15.82:0/2144442860 conn(0x7f0d2c0768c0 msgr2=0x7f0d2c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:19.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 shutdown_connections 2024-03-27T07:22:19.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:19.108+0000 7f0d343c1700 1 -- 172.21.15.82:0/2144442860 wait complete. 2024-03-27T07:22:19.848 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:19 smithi082 ceph-mon[32178]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:22:19.879 INFO:teuthology.orchestra.run.smithi082.stdout:55834574920 2024-03-27T07:22:19.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-27T07:22:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:19 smithi149 ceph-mon[36065]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:22:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:19 smithi153 ceph-mon[36179]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:22:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.267+0000 7f5e14a73700 1 -- 172.21.15.82:0/2992221639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e101026c0 msgr2=0x7f5e10102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.267+0000 7f5e14a73700 1 --2- 172.21.15.82:0/2992221639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e101026c0 0x7f5e10102b40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009990 tx=0x7f5e04009ca0 comp rx=0 tx=0).stop 2024-03-27T07:22:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.267+0000 7f5e14a73700 1 -- 172.21.15.82:0/2992221639 shutdown_connections 2024-03-27T07:22:20.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.267+0000 7f5e14a73700 1 --2- 172.21.15.82:0/2992221639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e101086b0 0x7f5e10108a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.267+0000 7f5e14a73700 1 --2- 172.21.15.82:0/2992221639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e10103080 0x7f5e1010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.267+0000 7f5e14a73700 1 --2- 172.21.15.82:0/2992221639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e101026c0 0x7f5e10102b40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.267+0000 7f5e14a73700 1 -- 172.21.15.82:0/2992221639 >> 172.21.15.82:0/2992221639 conn(0x7f5e100796d0 msgr2=0x7f5e10079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.267+0000 7f5e14a73700 1 -- 172.21.15.82:0/2992221639 shutdown_connections 2024-03-27T07:22:20.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.267+0000 7f5e14a73700 1 -- 172.21.15.82:0/2992221639 wait complete. 2024-03-27T07:22:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e14a73700 1 Processor -- start 2024-03-27T07:22:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e14a73700 1 -- start start 2024-03-27T07:22:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e14a73700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e101026c0 0x7f5e10198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e14a73700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e10103080 0x7f5e101993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e14a73700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e101086b0 0x7f5e1019d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e14a73700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e10112930 con 0x7f5e10103080 2024-03-27T07:22:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e14a73700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e101127b0 con 0x7f5e101026c0 2024-03-27T07:22:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e14a73700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5e10112ab0 con 0x7f5e101086b0 2024-03-27T07:22:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e0dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e10103080 0x7f5e101993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:20.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e0dd9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e10103080 0x7f5e101993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48806/0 (socket says 172.21.15.82:48806) 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e0dd9b700 1 -- 172.21.15.82:0/2227092784 learned_addr learned my addr 172.21.15.82:0/2227092784 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e0e59c700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e101026c0 0x7f5e10198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.268+0000 7f5e0ed9d700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e101086b0 0x7f5e1019d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5e0dd9b700 1 -- 172.21.15.82:0/2227092784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e101086b0 msgr2=0x7f5e1019d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5e0dd9b700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e101086b0 0x7f5e1019d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5e0dd9b700 1 -- 172.21.15.82:0/2227092784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e101026c0 msgr2=0x7f5e10198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5e0dd9b700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e101026c0 0x7f5e10198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5e0dd9b700 1 -- 172.21.15.82:0/2227092784 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1019de70 con 0x7f5e10103080 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5e0dd9b700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e10103080 0x7f5e101993a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5e04000c00 tx=0x7f5e0400bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5dff7fe700 1 -- 172.21.15.82:0/2227092784 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04027070 con 0x7f5e10103080 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5dff7fe700 1 -- 172.21.15.82:0/2227092784 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e04003d70 con 0x7f5e10103080 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1019e100 con 0x7f5e10103080 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5dff7fe700 1 -- 172.21.15.82:0/2227092784 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400f460 con 0x7f5e10103080 2024-03-27T07:22:20.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.269+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e101a59e0 con 0x7f5e10103080 2024-03-27T07:22:20.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.270+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e10062d50 con 0x7f5e10103080 2024-03-27T07:22:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.271+0000 7f5dff7fe700 1 -- 172.21.15.82:0/2227092784 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f5e0402a070 con 0x7f5e10103080 2024-03-27T07:22:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.271+0000 7f5dff7fe700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5df80a3730 0x7f5df80a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.272+0000 7f5e0e59c700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5df80a3730 0x7f5df80a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.272+0000 7f5dff7fe700 1 -- 172.21.15.82:0/2227092784 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f5e040d10e0 con 0x7f5e10103080 2024-03-27T07:22:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.272+0000 7f5dff7fe700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] conn(0x7f5df80acf10 0x7f5df80af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.272+0000 7f5dff7fe700 1 -- 172.21.15.82:0/2227092784 --> [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e04009030 con 0x7f5df80acf10 2024-03-27T07:22:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.272+0000 7f5dff7fe700 1 -- 172.21.15.82:0/2227092784 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f5e040d15c0 con 0x7f5e10103080 2024-03-27T07:22:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.272+0000 7f5e0e59c700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5df80a3730 0x7f5df80a5bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009be0 tx=0x7f5e00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.272+0000 7f5e0ed9d700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] conn(0x7f5df80acf10 0x7f5df80af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:20.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.272+0000 7f5e0ed9d700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] conn(0x7f5df80acf10 0x7f5df80af330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:20.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.274+0000 7f5dff7fe700 1 -- 172.21.15.82:0/2227092784 <== osd.5 v2:172.21.15.153:6808/588711733 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e04009030 con 0x7f5df80acf10 2024-03-27T07:22:20.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.289+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 --> [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e100631d0 con 0x7f5df80acf10 2024-03-27T07:22:20.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5dff7fe700 1 -- 172.21.15.82:0/2227092784 <== osd.5 v2:172.21.15.153:6808/588711733 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5e100631d0 con 0x7f5df80acf10 2024-03-27T07:22:20.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 >> [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] conn(0x7f5df80acf10 msgr2=0x7f5df80af330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e14a73700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] conn(0x7f5df80acf10 0x7f5df80af330 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5df80a3730 msgr2=0x7f5df80a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e14a73700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5df80a3730 0x7f5df80a5bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009be0 tx=0x7f5e00009260 comp rx=0 tx=0).stop 2024-03-27T07:22:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e10103080 msgr2=0x7f5e101993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e14a73700 1 --2- 172.21.15.82:0/2227092784 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e10103080 0x7f5e101993a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5e04000c00 tx=0x7f5e0400bab0 comp rx=0 tx=0).stop 2024-03-27T07:22:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e0ed9d700 1 -- 172.21.15.82:0/2227092784 reap_dead start 2024-03-27T07:22:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 shutdown_connections 2024-03-27T07:22:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 >> 172.21.15.82:0/2227092784 conn(0x7f5e100796d0 msgr2=0x7f5e10101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 shutdown_connections 2024-03-27T07:22:20.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:20.290+0000 7f5e14a73700 1 -- 172.21.15.82:0/2227092784 wait complete. 2024-03-27T07:22:20.721 INFO:teuthology.orchestra.run.smithi082.stdout:141733920827 2024-03-27T07:22:20.721 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-27T07:22:21.184 INFO:teuthology.orchestra.run.smithi082.stdout:197568495663 2024-03-27T07:22:21.184 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-27T07:22:21.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:21 smithi082 ceph-mon[32178]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-27T07:22:21.875 INFO:teuthology.orchestra.run.smithi082.stdout:34359738446 2024-03-27T07:22:21.875 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-27T07:22:22.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:21 smithi149 ceph-mon[36065]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-27T07:22:22.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:21 smithi153 ceph-mon[36179]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-27T07:22:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:22.336 INFO:teuthology.orchestra.run.smithi082.stdout:163208757301 2024-03-27T07:22:22.337 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-27T07:22:22.340 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:22.346 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:22.346 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:23.319 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:23.753 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:23.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:23 smithi082 ceph-mon[32178]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:22:24.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:23 smithi149 ceph-mon[36065]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:22:24.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:23 smithi153 ceph-mon[36179]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:22:24.506 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:24.507 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:24.507 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:24.512 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:25.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.688+0000 7f6a26c44700 1 -- 172.21.15.82:0/4277155480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a201075b0 msgr2=0x7f6a20107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:25.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.688+0000 7f6a26c44700 1 --2- 172.21.15.82:0/4277155480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a201075b0 0x7f6a20107990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800b0d0 tx=0x7f6a1800b3e0 comp rx=0 tx=0).stop 2024-03-27T07:22:25.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.688+0000 7f6a26c44700 1 -- 172.21.15.82:0/4277155480 shutdown_connections 2024-03-27T07:22:25.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.688+0000 7f6a26c44700 1 --2- 172.21.15.82:0/4277155480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20101f30 0x7f6a2010e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:25.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.688+0000 7f6a26c44700 1 --2- 172.21.15.82:0/4277155480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a201075b0 0x7f6a20107990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:25.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.688+0000 7f6a26c44700 1 --2- 172.21.15.82:0/4277155480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a20101570 0x7f6a201019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:25.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.688+0000 7f6a26c44700 1 -- 172.21.15.82:0/4277155480 >> 172.21.15.82:0/4277155480 conn(0x7f6a20077590 msgr2=0x7f6a200779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:25.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:25 smithi082 ceph-mon[32178]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:25.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.688+0000 7f6a26c44700 1 -- 172.21.15.82:0/4277155480 shutdown_connections 2024-03-27T07:22:25.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.688+0000 7f6a26c44700 1 -- 172.21.15.82:0/4277155480 wait complete. 2024-03-27T07:22:25.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a26c44700 1 Processor -- start 2024-03-27T07:22:25.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a26c44700 1 -- start start 2024-03-27T07:22:25.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a26c44700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a20101570 0x7f6a2010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:25.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a26c44700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20101f30 0x7f6a2010dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:25.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a26c44700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a201075b0 0x7f6a201a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:25.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a26c44700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a20112930 con 0x7f6a201075b0 2024-03-27T07:22:25.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a26c44700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a201127b0 con 0x7f6a20101570 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a26c44700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a20112ab0 con 0x7f6a20101f30 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a251e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a201075b0 0x7f6a201a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a251e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a201075b0 0x7f6a201a3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48822/0 (socket says 172.21.15.82:48822) 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a251e1700 1 -- 172.21.15.82:0/2645685799 learned_addr learned my addr 172.21.15.82:0/2645685799 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a249e0700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a20101570 0x7f6a2010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.689+0000 7f6a1ffff700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20101f30 0x7f6a2010dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a251e1700 1 -- 172.21.15.82:0/2645685799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20101f30 msgr2=0x7f6a2010dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a251e1700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20101f30 0x7f6a2010dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a251e1700 1 -- 172.21.15.82:0/2645685799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a20101570 msgr2=0x7f6a2010d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a251e1700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a20101570 0x7f6a2010d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a251e1700 1 -- 172.21.15.82:0/2645685799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a201a4390 con 0x7f6a201075b0 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a249e0700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a20101570 0x7f6a2010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:25.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a1ffff700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20101f30 0x7f6a2010dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:25.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a251e1700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a201075b0 0x7f6a201a3c50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000d980 tx=0x7f6a1000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:25.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a1dffb700 1 -- 172.21.15.82:0/2645685799 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a10017070 con 0x7f6a201075b0 2024-03-27T07:22:25.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a26c44700 1 -- 172.21.15.82:0/2645685799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a201a4680 con 0x7f6a201075b0 2024-03-27T07:22:25.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a1dffb700 1 -- 172.21.15.82:0/2645685799 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a10005020 con 0x7f6a201075b0 2024-03-27T07:22:25.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a1dffb700 1 -- 172.21.15.82:0/2645685799 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000fbf0 con 0x7f6a201075b0 2024-03-27T07:22:25.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.690+0000 7f6a26c44700 1 -- 172.21.15.82:0/2645685799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a201abf00 con 0x7f6a201075b0 2024-03-27T07:22:25.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.692+0000 7f6a26c44700 1 -- 172.21.15.82:0/2645685799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a20069300 con 0x7f6a201075b0 2024-03-27T07:22:25.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.692+0000 7f6a1dffb700 1 -- 172.21.15.82:0/2645685799 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f6a100051d0 con 0x7f6a201075b0 2024-03-27T07:22:25.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.693+0000 7f6a1dffb700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6a0c0a37b0 0x7f6a0c0a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:25.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.693+0000 7f6a249e0700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6a0c0a37b0 0x7f6a0c0a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:25.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.693+0000 7f6a1dffb700 1 -- 172.21.15.82:0/2645685799 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7979+0+0 (secure 0 0 0) 0x7f6a100cfa20 con 0x7f6a201075b0 2024-03-27T07:22:25.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.694+0000 7f6a249e0700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6a0c0a37b0 0x7f6a0c0a5c70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009fd0 tx=0x7f6a1800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:25.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.698+0000 7f6a1dffb700 1 -- 172.21.15.82:0/2645685799 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f6a10020020 con 0x7f6a201075b0 2024-03-27T07:22:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.898+0000 7f6a26c44700 1 -- 172.21.15.82:0/2645685799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6a201ac0d0 con 0x7f6a201075b0 2024-03-27T07:22:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.898+0000 7f6a1dffb700 1 -- 172.21.15.82:0/2645685799 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a1009c5c0 con 0x7f6a201075b0 2024-03-27T07:22:25.900 INFO:teuthology.orchestra.run.smithi082.stdout:55834574922 2024-03-27T07:22:25.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.900+0000 7f6a26c44700 1 -- 172.21.15.82:0/2645685799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6a0c0a37b0 msgr2=0x7f6a0c0a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:25.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.900+0000 7f6a26c44700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6a0c0a37b0 0x7f6a0c0a5c70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009fd0 tx=0x7f6a1800b040 comp rx=0 tx=0).stop 2024-03-27T07:22:25.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.900+0000 7f6a26c44700 1 -- 172.21.15.82:0/2645685799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a201075b0 msgr2=0x7f6a201a3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:25.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.900+0000 7f6a26c44700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a201075b0 0x7f6a201a3c50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6a1000d980 tx=0x7f6a1000dc90 comp rx=0 tx=0).stop 2024-03-27T07:22:25.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.900+0000 7f6a26c44700 1 -- 172.21.15.82:0/2645685799 shutdown_connections 2024-03-27T07:22:25.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.900+0000 7f6a26c44700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f6a0c0a37b0 0x7f6a0c0a5c70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:25.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.900+0000 7f6a26c44700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a201075b0 0x7f6a201a3c50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:25.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.900+0000 7f6a26c44700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a20101570 0x7f6a2010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:25.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.900+0000 7f6a26c44700 1 --2- 172.21.15.82:0/2645685799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a20101f30 0x7f6a2010dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:25.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.900+0000 7f6a26c44700 1 -- 172.21.15.82:0/2645685799 >> 172.21.15.82:0/2645685799 conn(0x7f6a20077590 msgr2=0x7f6a200ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:25.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.901+0000 7f6a26c44700 1 -- 172.21.15.82:0/2645685799 shutdown_connections 2024-03-27T07:22:25.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:25.901+0000 7f6a26c44700 1 -- 172.21.15.82:0/2645685799 wait complete. 2024-03-27T07:22:26.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:25 smithi149 ceph-mon[36065]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:25 smithi153 ceph-mon[36179]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:26.890 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:26 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2645685799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-27T07:22:26.890 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-03-27T07:22:26.890 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-27T07:22:26.890 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-03-27T07:22:26.890 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-03-27T07:22:26.890 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-03-27T07:22:26.890 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-03-27T07:22:26.890 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:26 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-03-27T07:22:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:26 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2645685799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-27T07:22:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-03-27T07:22:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-27T07:22:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-03-27T07:22:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-03-27T07:22:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-03-27T07:22:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-03-27T07:22:27.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:26 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-03-27T07:22:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:26 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2645685799' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-27T07:22:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-03-27T07:22:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-27T07:22:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-03-27T07:22:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]: dispatch 2024-03-27T07:22:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-03-27T07:22:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-03-27T07:22:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:26 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-03-27T07:22:27.875 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574922 for osd.1 2024-03-27T07:22:27.875 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:27.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:27 smithi082 ceph-mon[32178]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:22:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-03-27T07:22:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-27T07:22:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-03-27T07:22:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-03-27T07:22:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-03-27T07:22:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-03-27T07:22:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:27 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-03-27T07:22:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:27 smithi082 ceph-mon[32178]: osdmap e87: 12 total, 12 up, 12 in 2024-03-27T07:22:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:27 smithi149 ceph-mon[36065]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:22:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-03-27T07:22:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-27T07:22:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-03-27T07:22:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-03-27T07:22:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-03-27T07:22:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-03-27T07:22:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:27 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-03-27T07:22:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:27 smithi149 ceph-mon[36065]: osdmap e87: 12 total, 12 up, 12 in 2024-03-27T07:22:28.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:27 smithi153 ceph-mon[36179]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:22:28.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-03-27T07:22:28.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-27T07:22:28.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-03-27T07:22:28.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 4]}]': finished 2024-03-27T07:22:28.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-03-27T07:22:28.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-03-27T07:22:28.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:27 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-03-27T07:22:28.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:27 smithi153 ceph-mon[36179]: osdmap e87: 12 total, 12 up, 12 in 2024-03-27T07:22:28.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:28 smithi082 ceph-mon[32178]: osdmap e88: 12 total, 12 up, 12 in 2024-03-27T07:22:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:28 smithi149 ceph-mon[36065]: osdmap e88: 12 total, 12 up, 12 in 2024-03-27T07:22:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:28 smithi153 ceph-mon[36179]: osdmap e88: 12 total, 12 up, 12 in 2024-03-27T07:22:29.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:29 smithi082 ceph-mon[32178]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-27T07:22:29.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.950+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3854286054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e68101570 msgr2=0x7f3e681019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:29.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.950+0000 7f3e6d1bc700 1 --2- 172.21.15.82:0/3854286054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e68101570 0x7f3e681019f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c0099c0 tx=0x7f3e5c009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:29.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.950+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3854286054 shutdown_connections 2024-03-27T07:22:29.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.950+0000 7f3e6d1bc700 1 --2- 172.21.15.82:0/3854286054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e68101f30 0x7f3e6810e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:29.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.950+0000 7f3e6d1bc700 1 --2- 172.21.15.82:0/3854286054 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e681075b0 0x7f3e68107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:29.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.950+0000 7f3e6d1bc700 1 --2- 172.21.15.82:0/3854286054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e68101570 0x7f3e681019f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:29.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.950+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3854286054 >> 172.21.15.82:0/3854286054 conn(0x7f3e68077590 msgr2=0x7f3e680779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:29.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.950+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3854286054 shutdown_connections 2024-03-27T07:22:29.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.950+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3854286054 wait complete. 2024-03-27T07:22:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6d1bc700 1 Processor -- start 2024-03-27T07:22:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6d1bc700 1 -- start start 2024-03-27T07:22:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6d1bc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e68101570 0x7f3e68199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6d1bc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e68101f30 0x7f3e6819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6d1bc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e681075b0 0x7f3e681a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6d1bc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e681117f0 con 0x7f3e68101f30 2024-03-27T07:22:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6d1bc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3e68111670 con 0x7f3e681075b0 2024-03-27T07:22:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6d1bc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3e68111970 con 0x7f3e68101570 2024-03-27T07:22:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e68101f30 0x7f3e6819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:29.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e66d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e68101570 0x7f3e68199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e68101f30 0x7f3e6819a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41306/0 (socket says 172.21.15.82:41306) 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6659c700 1 -- 172.21.15.82:0/3430023958 learned_addr learned my addr 172.21.15.82:0/3430023958 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e6759e700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e681075b0 0x7f3e681a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e66d9d700 1 -- 172.21.15.82:0/3430023958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e681075b0 msgr2=0x7f3e681a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.951+0000 7f3e66d9d700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e681075b0 0x7f3e681a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.952+0000 7f3e66d9d700 1 -- 172.21.15.82:0/3430023958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e68101f30 msgr2=0x7f3e6819a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.952+0000 7f3e66d9d700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e68101f30 0x7f3e6819a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.952+0000 7f3e66d9d700 1 -- 172.21.15.82:0/3430023958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e681a50f0 con 0x7f3e68101570 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.952+0000 7f3e6659c700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e68101f30 0x7f3e6819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.952+0000 7f3e66d9d700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e68101570 0x7f3e68199b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800e9f0 tx=0x7f3e5800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.952+0000 7f3e4ffff700 1 -- 172.21.15.82:0/3430023958 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800c9c0 con 0x7f3e68101570 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.952+0000 7f3e4ffff700 1 -- 172.21.15.82:0/3430023958 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e5800cb60 con 0x7f3e68101570 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.952+0000 7f3e4ffff700 1 -- 172.21.15.82:0/3430023958 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e58018680 con 0x7f3e68101570 2024-03-27T07:22:29.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.952+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3430023958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e68197980 con 0x7f3e68101570 2024-03-27T07:22:29.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.952+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3430023958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e68197ee0 con 0x7f3e68101570 2024-03-27T07:22:29.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.953+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3430023958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e68102c20 con 0x7f3e68101570 2024-03-27T07:22:29.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.954+0000 7f3e4ffff700 1 -- 172.21.15.82:0/3430023958 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f3e58010430 con 0x7f3e68101570 2024-03-27T07:22:29.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.954+0000 7f3e4ffff700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3e500a37b0 0x7f3e500a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:29.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.955+0000 7f3e6659c700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3e500a37b0 0x7f3e500a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.955+0000 7f3e4ffff700 1 -- 172.21.15.82:0/3430023958 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f3e580cfe60 con 0x7f3e68101570 2024-03-27T07:22:29.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.955+0000 7f3e6659c700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3e500a37b0 0x7f3e500a5c70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3e6806b6f0 tx=0x7f3e5c005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:29.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:29.959+0000 7f3e4ffff700 1 -- 172.21.15.82:0/3430023958 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f3e5809c900 con 0x7f3e68101570 2024-03-27T07:22:30.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:29 smithi149 ceph-mon[36065]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-27T07:22:30.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:29 smithi153 ceph-mon[36179]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-03-27T07:22:30.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.162+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3430023958 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f3e6802dd30 con 0x7f3e68101570 2024-03-27T07:22:30.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.163+0000 7f3e4ffff700 1 -- 172.21.15.82:0/3430023958 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3e5809c200 con 0x7f3e68101570 2024-03-27T07:22:30.165 INFO:teuthology.orchestra.run.smithi082.stdout:347892351000 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3430023958 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3e500a37b0 msgr2=0x7f3e500a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3e500a37b0 0x7f3e500a5c70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3e6806b6f0 tx=0x7f3e5c005040 comp rx=0 tx=0).stop 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3430023958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e68101570 msgr2=0x7f3e68199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e68101570 0x7f3e68199b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800e9f0 tx=0x7f3e5800ed00 comp rx=0 tx=0).stop 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3430023958 shutdown_connections 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f3e500a37b0 0x7f3e500a5c70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e68101570 0x7f3e68199b30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e681075b0 0x7f3e681a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 --2- 172.21.15.82:0/3430023958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e68101f30 0x7f3e6819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3430023958 >> 172.21.15.82:0/3430023958 conn(0x7f3e68077590 msgr2=0x7f3e681001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3430023958 shutdown_connections 2024-03-27T07:22:30.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:30.165+0000 7f3e6d1bc700 1 -- 172.21.15.82:0/3430023958 wait complete. 2024-03-27T07:22:30.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:30 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3430023958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-27T07:22:31.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:30 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3430023958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-27T07:22:31.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:30 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3430023958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-27T07:22:31.863 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:31 smithi082 ceph-mon[32178]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-03-27T07:22:32.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:31 smithi149 ceph-mon[36065]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-03-27T07:22:32.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:31 smithi153 ceph-mon[36179]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s; 0 B/s, 0 objects/s recovering 2024-03-27T07:22:32.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:32 smithi082 ceph-mon[32178]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 72 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:33.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:32 smithi149 ceph-mon[36065]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 72 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:33.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:32 smithi153 ceph-mon[36179]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 72 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:33.401 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350996 got 347892351000 for osd.11 2024-03-27T07:22:33.401 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:34.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:33 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:22:34.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:33 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:22:34.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:33 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:22:34.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.214+0000 7fb78cadc700 1 -- 172.21.15.82:0/47165923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb788107a00 msgr2=0x7fb78810f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:34.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.214+0000 7fb78cadc700 1 --2- 172.21.15.82:0/47165923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb788107a00 0x7fb78810f580 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb78000b0d0 tx=0x7fb78000b3e0 comp rx=0 tx=0).stop 2024-03-27T07:22:34.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.214+0000 7fb78cadc700 1 -- 172.21.15.82:0/47165923 shutdown_connections 2024-03-27T07:22:34.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.214+0000 7fb78cadc700 1 --2- 172.21.15.82:0/47165923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7881011e0 0x7fb7881015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:34.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.214+0000 7fb78cadc700 1 --2- 172.21.15.82:0/47165923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb788107a00 0x7fb78810f580 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:34.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.214+0000 7fb78cadc700 1 --2- 172.21.15.82:0/47165923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb788101b90 0x7fb7881072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:34.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.214+0000 7fb78cadc700 1 -- 172.21.15.82:0/47165923 >> 172.21.15.82:0/47165923 conn(0x7fb7880768a0 msgr2=0x7fb788076cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:34.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.214+0000 7fb78cadc700 1 -- 172.21.15.82:0/47165923 shutdown_connections 2024-03-27T07:22:34.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.214+0000 7fb78cadc700 1 -- 172.21.15.82:0/47165923 wait complete. 2024-03-27T07:22:34.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.215+0000 7fb78cadc700 1 Processor -- start 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.215+0000 7fb78cadc700 1 -- start start 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.215+0000 7fb78cadc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7881011e0 0x7fb788198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.215+0000 7fb78cadc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb788101b90 0x7fb788199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.215+0000 7fb78cadc700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb788107a00 0x7fb78819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.215+0000 7fb78cadc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7881129b0 con 0x7fb788101b90 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.215+0000 7fb78cadc700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb788112830 con 0x7fb788107a00 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.215+0000 7fb78cadc700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb788112b30 con 0x7fb7881011e0 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.215+0000 7fb785d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb788101b90 0x7fb788199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb785d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb788101b90 0x7fb788199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41326/0 (socket says 172.21.15.82:41326) 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb78659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7881011e0 0x7fb788198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:34.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb785d9b700 1 -- 172.21.15.82:0/1336104069 learned_addr learned my addr 172.21.15.82:0/1336104069 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:34.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb786d9d700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb788107a00 0x7fb78819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:34.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb785d9b700 1 -- 172.21.15.82:0/1336104069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7881011e0 msgr2=0x7fb788198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:34.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb785d9b700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7881011e0 0x7fb788198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:34.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb785d9b700 1 -- 172.21.15.82:0/1336104069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb788107a00 msgr2=0x7fb78819d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:34.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb785d9b700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb788107a00 0x7fb78819d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:34.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb785d9b700 1 -- 172.21.15.82:0/1336104069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78819ddf0 con 0x7fb788101b90 2024-03-27T07:22:34.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb78659c700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7881011e0 0x7fb788198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:34.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb785d9b700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb788101b90 0x7fb788199320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00d950 tx=0x7fb77c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:34.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb7777fe700 1 -- 172.21.15.82:0/1336104069 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c017070 con 0x7fb788101b90 2024-03-27T07:22:34.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb78cadc700 1 -- 172.21.15.82:0/1336104069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78819e0e0 con 0x7fb788101b90 2024-03-27T07:22:34.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb7777fe700 1 -- 172.21.15.82:0/1336104069 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb77c00fd70 con 0x7fb788101b90 2024-03-27T07:22:34.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb7777fe700 1 -- 172.21.15.82:0/1336104069 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77c00e3b0 con 0x7fb788101b90 2024-03-27T07:22:34.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.216+0000 7fb78cadc700 1 -- 172.21.15.82:0/1336104069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7881a5960 con 0x7fb788101b90 2024-03-27T07:22:34.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.217+0000 7fb78cadc700 1 -- 172.21.15.82:0/1336104069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78810ac40 con 0x7fb788101b90 2024-03-27T07:22:34.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.218+0000 7fb7777fe700 1 -- 172.21.15.82:0/1336104069 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7fb77c01a070 con 0x7fb788101b90 2024-03-27T07:22:34.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.219+0000 7fb7777fe700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb7700a3730 0x7fb7700a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:34.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.219+0000 7fb78659c700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb7700a3730 0x7fb7700a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:34.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.219+0000 7fb7777fe700 1 -- 172.21.15.82:0/1336104069 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fb77c0cf5c0 con 0x7fb788101b90 2024-03-27T07:22:34.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.219+0000 7fb78659c700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb7700a3730 0x7fb7700a5bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb778011490 tx=0x7fb778009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:34.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.224+0000 7fb7777fe700 1 -- 172.21.15.82:0/1336104069 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb77c09c060 con 0x7fb788101b90 2024-03-27T07:22:34.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.436+0000 7fb78cadc700 1 -- 172.21.15.82:0/1336104069 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb78819a140 con 0x7fb788101b90 2024-03-27T07:22:34.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.436+0000 7fb7777fe700 1 -- 172.21.15.82:0/1336104069 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb77c09b960 con 0x7fb788101b90 2024-03-27T07:22:34.438 INFO:teuthology.orchestra.run.smithi082.stdout:77309411399 2024-03-27T07:22:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 -- 172.21.15.82:0/1336104069 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb7700a3730 msgr2=0x7fb7700a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb7700a3730 0x7fb7700a5bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb778011490 tx=0x7fb778009260 comp rx=0 tx=0).stop 2024-03-27T07:22:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 -- 172.21.15.82:0/1336104069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb788101b90 msgr2=0x7fb788199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb788101b90 0x7fb788199320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00d950 tx=0x7fb77c00dc60 comp rx=0 tx=0).stop 2024-03-27T07:22:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 -- 172.21.15.82:0/1336104069 shutdown_connections 2024-03-27T07:22:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb7700a3730 0x7fb7700a5bf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7881011e0 0x7fb788198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb788107a00 0x7fb78819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:34.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 --2- 172.21.15.82:0/1336104069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb788101b90 0x7fb788199320 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:34.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 -- 172.21.15.82:0/1336104069 >> 172.21.15.82:0/1336104069 conn(0x7fb7880768a0 msgr2=0x7fb7880fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:34.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 -- 172.21.15.82:0/1336104069 shutdown_connections 2024-03-27T07:22:34.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:34.438+0000 7fb78cadc700 1 -- 172.21.15.82:0/1336104069 wait complete. 2024-03-27T07:22:34.887 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:34 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1336104069' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-27T07:22:34.888 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:34 smithi082 ceph-mon[32178]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 72 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:35.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:34 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1336104069' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-27T07:22:35.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:34 smithi149 ceph-mon[36065]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 72 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:35.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:34 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1336104069' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-27T07:22:35.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:34 smithi153 ceph-mon[36179]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 72 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.721+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/2345457944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8101240 msgr2=0x7f5dc8101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.721+0000 7f5dcf6f0700 1 --2- 172.21.15.82:0/2345457944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8101240 0x7f5dc8101620 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5dc40099c0 tx=0x7f5dc4009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.721+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/2345457944 shutdown_connections 2024-03-27T07:22:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.721+0000 7f5dcf6f0700 1 --2- 172.21.15.82:0/2345457944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dc8107a10 0x7f5dc810f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.721+0000 7f5dcf6f0700 1 --2- 172.21.15.82:0/2345457944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8101240 0x7f5dc8101620 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.721+0000 7f5dcf6f0700 1 --2- 172.21.15.82:0/2345457944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc8101bf0 0x7f5dc8107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.721+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/2345457944 >> 172.21.15.82:0/2345457944 conn(0x7f5dc80768c0 msgr2=0x7f5dc8076cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:35.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.721+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/2345457944 shutdown_connections 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.721+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/2345457944 wait complete. 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcf6f0700 1 Processor -- start 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcf6f0700 1 -- start start 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcf6f0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8101240 0x7f5dc8198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcf6f0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dc8101bf0 0x7f5dc81993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcf6f0700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc8107a10 0x7f5dc819d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcf6f0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc8112a50 con 0x7f5dc8101240 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcf6f0700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc81128d0 con 0x7f5dc8107a10 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcf6f0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc8112bd0 con 0x7f5dc8101bf0 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcd48c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8101240 0x7f5dc8198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcd48c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8101240 0x7f5dc8198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41354/0 (socket says 172.21.15.82:41354) 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.722+0000 7f5dcdc8d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc8107a10 0x7f5dc819d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:35.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dcd48c700 1 -- 172.21.15.82:0/4208658980 learned_addr learned my addr 172.21.15.82:0/4208658980 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dccc8b700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dc8101bf0 0x7f5dc81993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dcdc8d700 1 -- 172.21.15.82:0/4208658980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dc8101bf0 msgr2=0x7f5dc81993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dcdc8d700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dc8101bf0 0x7f5dc81993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dcdc8d700 1 -- 172.21.15.82:0/4208658980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8101240 msgr2=0x7f5dc8198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dcdc8d700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8101240 0x7f5dc8198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dcdc8d700 1 -- 172.21.15.82:0/4208658980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc819deb0 con 0x7f5dc8107a10 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dccc8b700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dc8101bf0 0x7f5dc81993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dcd48c700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8101240 0x7f5dc8198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dcdc8d700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc8107a10 0x7f5dc819d770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000efc0 tx=0x7f5dc000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dbe7fc700 1 -- 172.21.15.82:0/4208658980 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00092e0 con 0x7f5dc8107a10 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/4208658980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc819e140 con 0x7f5dc8107a10 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dbe7fc700 1 -- 172.21.15.82:0/4208658980 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dc0004bb0 con 0x7f5dc8107a10 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dbe7fc700 1 -- 172.21.15.82:0/4208658980 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0004280 con 0x7f5dc8107a10 2024-03-27T07:22:35.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.723+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/4208658980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc81a5a20 con 0x7f5dc8107a10 2024-03-27T07:22:35.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.724+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/4208658980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc810aca0 con 0x7f5dc8107a10 2024-03-27T07:22:35.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.725+0000 7f5dbe7fc700 1 -- 172.21.15.82:0/4208658980 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f5dc001b030 con 0x7f5dc8107a10 2024-03-27T07:22:35.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.726+0000 7f5dbe7fc700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5db40a3730 0x7f5db40a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:35.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.726+0000 7f5dcd48c700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5db40a3730 0x7f5db40a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:35.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.726+0000 7f5dbe7fc700 1 -- 172.21.15.82:0/4208658980 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f5dc00d0340 con 0x7f5dc8107a10 2024-03-27T07:22:35.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.726+0000 7f5dcd48c700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5db40a3730 0x7f5db40a5bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009990 tx=0x7f5dc4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:35.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.729+0000 7f5dbe7fc700 1 -- 172.21.15.82:0/4208658980 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f5dc0022020 con 0x7f5dc8107a10 2024-03-27T07:22:35.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:35.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:35.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:35.847 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:35 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:35.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.935+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/4208658980 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5dc819a200 con 0x7f5dc8107a10 2024-03-27T07:22:35.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.936+0000 7f5dbe7fc700 1 -- 172.21.15.82:0/4208658980 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5dc0010040 con 0x7f5dc8107a10 2024-03-27T07:22:35.938 INFO:teuthology.orchestra.run.smithi082.stdout:223338299438 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/4208658980 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5db40a3730 msgr2=0x7f5db40a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5db40a3730 0x7f5db40a5bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009990 tx=0x7f5dc4005960 comp rx=0 tx=0).stop 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/4208658980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc8107a10 msgr2=0x7f5dc819d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc8107a10 0x7f5dc819d770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000efc0 tx=0x7f5dc000c3a0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/4208658980 shutdown_connections 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5db40a3730 0x7f5db40a5bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5dc8107a10 0x7f5dc819d770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5dc8101240 0x7f5dc8198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 --2- 172.21.15.82:0/4208658980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dc8101bf0 0x7f5dc81993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/4208658980 >> 172.21.15.82:0/4208658980 conn(0x7f5dc80768c0 msgr2=0x7f5dc80ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/4208658980 shutdown_connections 2024-03-27T07:22:35.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:35.938+0000 7f5dcf6f0700 1 -- 172.21.15.82:0/4208658980 wait complete. 2024-03-27T07:22:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:36.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:35 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:35 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:36.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.580+0000 7f5500482700 1 -- 172.21.15.82:0/577833819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f810afe0 msgr2=0x7f54f810b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:36.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.580+0000 7f5500482700 1 --2- 172.21.15.82:0/577833819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f810afe0 0x7f54f810b3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009990 tx=0x7f54f4009ca0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.580+0000 7f5500482700 1 -- 172.21.15.82:0/577833819 shutdown_connections 2024-03-27T07:22:36.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.580+0000 7f5500482700 1 --2- 172.21.15.82:0/577833819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f8114590 0x7f54f8116980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.580+0000 7f5500482700 1 --2- 172.21.15.82:0/577833819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f810afe0 0x7f54f810b3c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.580+0000 7f5500482700 1 --2- 172.21.15.82:0/577833819 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f810b900 0x7f54f8114050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.580+0000 7f5500482700 1 -- 172.21.15.82:0/577833819 >> 172.21.15.82:0/577833819 conn(0x7f54f806d780 msgr2=0x7f54f806db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.580+0000 7f5500482700 1 -- 172.21.15.82:0/577833819 shutdown_connections 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.580+0000 7f5500482700 1 -- 172.21.15.82:0/577833819 wait complete. 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f5500482700 1 Processor -- start 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f5500482700 1 -- start start 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f5500482700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f810afe0 0x7f54f81a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f5500482700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f810b900 0x7f54f81a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f5500482700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f8114590 0x7f54f81a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f5500482700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f54f811a060 con 0x7f54f810afe0 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f5500482700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f54f8119ee0 con 0x7f54f810b900 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f5500482700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f54f811a1e0 con 0x7f54f8114590 2024-03-27T07:22:36.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f54fe21e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f810afe0 0x7f54f81a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f54fe21e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f810afe0 0x7f54f81a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41364/0 (socket says 172.21.15.82:41364) 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f54fe21e700 1 -- 172.21.15.82:0/3155664669 learned_addr learned my addr 172.21.15.82:0/3155664669 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f54fea1f700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f8114590 0x7f54f81a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.581+0000 7f54fda1d700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f810b900 0x7f54f81a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f54fe21e700 1 -- 172.21.15.82:0/3155664669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f8114590 msgr2=0x7f54f81a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f54fe21e700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f8114590 0x7f54f81a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f54fe21e700 1 -- 172.21.15.82:0/3155664669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f810b900 msgr2=0x7f54f81a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f54fe21e700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f810b900 0x7f54f81a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f54fe21e700 1 -- 172.21.15.82:0/3155664669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f81a65f0 con 0x7f54f810afe0 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f54fe21e700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f810afe0 0x7f54f81a15e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f54f4000c00 tx=0x7f54f400bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:36.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f54ef7fe700 1 -- 172.21.15.82:0/3155664669 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4003a90 con 0x7f54f810afe0 2024-03-27T07:22:36.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f5500482700 1 -- 172.21.15.82:0/3155664669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f81a6880 con 0x7f54f810afe0 2024-03-27T07:22:36.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f54ef7fe700 1 -- 172.21.15.82:0/3155664669 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f54f4003c30 con 0x7f54f810afe0 2024-03-27T07:22:36.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f54ef7fe700 1 -- 172.21.15.82:0/3155664669 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f400f840 con 0x7f54f810afe0 2024-03-27T07:22:36.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.582+0000 7f5500482700 1 -- 172.21.15.82:0/3155664669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f80711b0 con 0x7f54f810afe0 2024-03-27T07:22:36.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.583+0000 7f5500482700 1 -- 172.21.15.82:0/3155664669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f806ece0 con 0x7f54f810afe0 2024-03-27T07:22:36.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.584+0000 7f54ef7fe700 1 -- 172.21.15.82:0/3155664669 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f54f4009d10 con 0x7f54f810afe0 2024-03-27T07:22:36.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.585+0000 7f54ef7fe700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f54e40a3730 0x7f54e40a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:36.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.585+0000 7f54fda1d700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f54e40a3730 0x7f54e40a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:36.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.585+0000 7f54ef7fe700 1 -- 172.21.15.82:0/3155664669 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f54f40d5970 con 0x7f54f810afe0 2024-03-27T07:22:36.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.585+0000 7f54fda1d700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f54e40a3730 0x7f54e40a5bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f54f8116400 tx=0x7f54e80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:36.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.588+0000 7f54ef7fe700 1 -- 172.21.15.82:0/3155664669 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f54f4023070 con 0x7f54f810afe0 2024-03-27T07:22:36.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.792+0000 7f5500482700 1 -- 172.21.15.82:0/3155664669 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f54f8069300 con 0x7f54f810afe0 2024-03-27T07:22:36.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.792+0000 7f54ef7fe700 1 -- 172.21.15.82:0/3155664669 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f54f4013070 con 0x7f54f810afe0 2024-03-27T07:22:36.794 INFO:teuthology.orchestra.run.smithi082.stdout:141733920830 2024-03-27T07:22:36.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.794+0000 7f5500482700 1 -- 172.21.15.82:0/3155664669 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f54e40a3730 msgr2=0x7f54e40a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:36.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.794+0000 7f5500482700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f54e40a3730 0x7f54e40a5bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f54f8116400 tx=0x7f54e80073d0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.794+0000 7f5500482700 1 -- 172.21.15.82:0/3155664669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f810afe0 msgr2=0x7f54f81a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.794+0000 7f5500482700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f810afe0 0x7f54f81a15e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f54f4000c00 tx=0x7f54f400bab0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.794+0000 7f5500482700 1 -- 172.21.15.82:0/3155664669 shutdown_connections 2024-03-27T07:22:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.794+0000 7f5500482700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f54e40a3730 0x7f54e40a5bf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.794+0000 7f5500482700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54f8114590 0x7f54f81a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.794+0000 7f5500482700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f54f810afe0 0x7f54f81a15e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.794+0000 7f5500482700 1 --2- 172.21.15.82:0/3155664669 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f54f810b900 0x7f54f81a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.795+0000 7f5500482700 1 -- 172.21.15.82:0/3155664669 >> 172.21.15.82:0/3155664669 conn(0x7f54f806d780 msgr2=0x7f54f810a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.795+0000 7f5500482700 1 -- 172.21.15.82:0/3155664669 shutdown_connections 2024-03-27T07:22:36.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:36.795+0000 7f5500482700 1 -- 172.21.15.82:0/3155664669 wait complete. 2024-03-27T07:22:36.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:36 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4208658980' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-27T07:22:36.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:36 smithi082 ceph-mon[32178]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s; 59 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:37.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:36 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4208658980' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-27T07:22:37.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:36 smithi149 ceph-mon[36065]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s; 59 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:37.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:36 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4208658980' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-27T07:22:37.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:36 smithi153 ceph-mon[36179]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4 op/s; 59 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:37.481 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411396 got 77309411399 for osd.2 2024-03-27T07:22:37.482 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:37.925 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920827 got 141733920830 for osd.4 2024-03-27T07:22:37.926 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:38.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:37 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3155664669' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-27T07:22:38.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:37 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3155664669' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-27T07:22:38.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:37 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3155664669' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-27T07:22:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.116+0000 7f5407e87700 1 -- 172.21.15.82:0/2566990062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006b540 msgr2=0x7f540010f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.116+0000 7f5407e87700 1 --2- 172.21.15.82:0/2566990062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006b540 0x7f540010f4c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f53f800b0a0 tx=0x7f53f800b3b0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.116+0000 7f5407e87700 1 -- 172.21.15.82:0/2566990062 shutdown_connections 2024-03-27T07:22:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.116+0000 7f5407e87700 1 --2- 172.21.15.82:0/2566990062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006b540 0x7f540010f4c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.116+0000 7f5407e87700 1 --2- 172.21.15.82:0/2566990062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5400108680 0x7f5400108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.116+0000 7f5407e87700 1 --2- 172.21.15.82:0/2566990062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540006ab80 0x7f540006b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.116+0000 7f5407e87700 1 -- 172.21.15.82:0/2566990062 >> 172.21.15.82:0/2566990062 conn(0x7f5400077590 msgr2=0x7f54000779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.116+0000 7f5407e87700 1 -- 172.21.15.82:0/2566990062 shutdown_connections 2024-03-27T07:22:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.116+0000 7f5407e87700 1 -- 172.21.15.82:0/2566990062 wait complete. 2024-03-27T07:22:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5407e87700 1 Processor -- start 2024-03-27T07:22:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5407e87700 1 -- start start 2024-03-27T07:22:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5407e87700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006ab80 0x7f540019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5407e87700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f540006b540 0x7f540019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5407e87700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5400108680 0x7f5400198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5407e87700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5400112940 con 0x7f540006ab80 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5407e87700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f54001127c0 con 0x7f540006b540 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5407e87700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5400112ac0 con 0x7f5400108680 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5405c23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006ab80 0x7f540019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5405c23700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006ab80 0x7f540019e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48282/0 (socket says 172.21.15.82:48282) 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5405c23700 1 -- 172.21.15.82:0/1148642810 learned_addr learned my addr 172.21.15.82:0/1148642810 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5405422700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f540006b540 0x7f540019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5406424700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5400108680 0x7f5400198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5405c23700 1 -- 172.21.15.82:0/1148642810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5400108680 msgr2=0x7f5400198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5405c23700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5400108680 0x7f5400198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5405c23700 1 -- 172.21.15.82:0/1148642810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f540006b540 msgr2=0x7f540019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5405c23700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f540006b540 0x7f540019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5405c23700 1 -- 172.21.15.82:0/1148642810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5400199240 con 0x7f540006ab80 2024-03-27T07:22:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.117+0000 7f5405c23700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006ab80 0x7f540019e920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00e970 tx=0x7f53fc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.118+0000 7f53f6ffd700 1 -- 172.21.15.82:0/1148642810 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc004220 con 0x7f540006ab80 2024-03-27T07:22:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.118+0000 7f53f6ffd700 1 -- 172.21.15.82:0/1148642810 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f53fc0043c0 con 0x7f540006ab80 2024-03-27T07:22:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.118+0000 7f5407e87700 1 -- 172.21.15.82:0/1148642810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5400199530 con 0x7f540006ab80 2024-03-27T07:22:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.118+0000 7f53f6ffd700 1 -- 172.21.15.82:0/1148642810 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53fc003dc0 con 0x7f540006ab80 2024-03-27T07:22:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.118+0000 7f5407e87700 1 -- 172.21.15.82:0/1148642810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54001a57f0 con 0x7f540006ab80 2024-03-27T07:22:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.119+0000 7f5407e87700 1 -- 172.21.15.82:0/1148642810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5400069300 con 0x7f540006ab80 2024-03-27T07:22:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.121+0000 7f53f6ffd700 1 -- 172.21.15.82:0/1148642810 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f53fc00c7e0 con 0x7f540006ab80 2024-03-27T07:22:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.121+0000 7f53f6ffd700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f53ec0a3730 0x7f53ec0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.121+0000 7f5405422700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f53ec0a3730 0x7f53ec0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.121+0000 7f53f6ffd700 1 -- 172.21.15.82:0/1148642810 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f53fc0d00e0 con 0x7f540006ab80 2024-03-27T07:22:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.122+0000 7f5405422700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f53ec0a3730 0x7f53ec0a5bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5400077b70 tx=0x7f53f00073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:38.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.125+0000 7f53f6ffd700 1 -- 172.21.15.82:0/1148642810 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f53fc09cc10 con 0x7f540006ab80 2024-03-27T07:22:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 -- 172.21.15.82:0/319155700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce48101570 msgr2=0x7fce481019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 --2- 172.21.15.82:0/319155700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce48101570 0x7fce481019f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fce38009920 tx=0x7fce38009c30 comp rx=0 tx=0).stop 2024-03-27T07:22:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 -- 172.21.15.82:0/319155700 shutdown_connections 2024-03-27T07:22:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 --2- 172.21.15.82:0/319155700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce481075b0 0x7fce48107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 --2- 172.21.15.82:0/319155700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce48101f30 0x7fce4810e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 --2- 172.21.15.82:0/319155700 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce48101570 0x7fce481019f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 -- 172.21.15.82:0/319155700 >> 172.21.15.82:0/319155700 conn(0x7fce48077590 msgr2=0x7fce480779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 -- 172.21.15.82:0/319155700 shutdown_connections 2024-03-27T07:22:38.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 -- 172.21.15.82:0/319155700 wait complete. 2024-03-27T07:22:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 Processor -- start 2024-03-27T07:22:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.325+0000 7fce4f616700 1 -- start start 2024-03-27T07:22:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4f616700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce48101570 0x7fce48199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:38.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4f616700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce48101f30 0x7fce4819a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4f616700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce481075b0 0x7fce481a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4f616700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fce481117f0 con 0x7fce48101f30 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4f616700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fce48111670 con 0x7fce48101570 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4f616700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fce48111970 con 0x7fce481075b0 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4cbb1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce48101f30 0x7fce4819a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4cbb1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce48101f30 0x7fce4819a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48298/0 (socket says 172.21.15.82:48298) 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4cbb1700 1 -- 172.21.15.82:0/3808081321 learned_addr learned my addr 172.21.15.82:0/3808081321 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4d3b2700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce48101570 0x7fce48199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4dbb3700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce481075b0 0x7fce481a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4cbb1700 1 -- 172.21.15.82:0/3808081321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce481075b0 msgr2=0x7fce481a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4cbb1700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce481075b0 0x7fce481a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4cbb1700 1 -- 172.21.15.82:0/3808081321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce48101570 msgr2=0x7fce48199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4cbb1700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce48101570 0x7fce48199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4cbb1700 1 -- 172.21.15.82:0/3808081321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce481a5310 con 0x7fce48101f30 2024-03-27T07:22:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4d3b2700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce48101570 0x7fce48199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce4cbb1700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce48101f30 0x7fce4819a290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fce38005e90 tx=0x7fce3800fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce3e7fc700 1 -- 172.21.15.82:0/3808081321 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce380050c0 con 0x7fce48101f30 2024-03-27T07:22:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.326+0000 7fce3e7fc700 1 -- 172.21.15.82:0/3808081321 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce3800b560 con 0x7fce48101f30 2024-03-27T07:22:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.327+0000 7fce4f616700 1 -- 172.21.15.82:0/3808081321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce48197b40 con 0x7fce48101f30 2024-03-27T07:22:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.327+0000 7fce4f616700 1 -- 172.21.15.82:0/3808081321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce48198020 con 0x7fce48101f30 2024-03-27T07:22:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.327+0000 7fce3e7fc700 1 -- 172.21.15.82:0/3808081321 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38003af0 con 0x7fce48101f30 2024-03-27T07:22:38.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.327+0000 7fce4f616700 1 -- 172.21.15.82:0/3808081321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce48069300 con 0x7fce48101f30 2024-03-27T07:22:38.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.329+0000 7fce3e7fc700 1 -- 172.21.15.82:0/3808081321 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7fce3800baa0 con 0x7fce48101f30 2024-03-27T07:22:38.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.329+0000 7fce3e7fc700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fce340a3730 0x7fce340a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:38.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.330+0000 7fce4d3b2700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fce340a3730 0x7fce340a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:38.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.330+0000 7fce3e7fc700 1 -- 172.21.15.82:0/3808081321 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fce380d1000 con 0x7fce48101f30 2024-03-27T07:22:38.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.330+0000 7fce4d3b2700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fce340a3730 0x7fce340a5bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fce44009fd0 tx=0x7fce44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:38.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.333+0000 7fce3e7fc700 1 -- 172.21.15.82:0/3808081321 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fce38013030 con 0x7fce48101f30 2024-03-27T07:22:38.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.334+0000 7f5407e87700 1 -- 172.21.15.82:0/1148642810 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f540002dd30 con 0x7f540006ab80 2024-03-27T07:22:38.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.334+0000 7f53f6ffd700 1 -- 172.21.15.82:0/1148642810 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f53fc09c510 con 0x7f540006ab80 2024-03-27T07:22:38.336 INFO:teuthology.orchestra.run.smithi082.stdout:197568495667 2024-03-27T07:22:38.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.336+0000 7f5407e87700 1 -- 172.21.15.82:0/1148642810 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f53ec0a3730 msgr2=0x7f53ec0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:38.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.336+0000 7f5407e87700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f53ec0a3730 0x7f53ec0a5bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5400077b70 tx=0x7f53f00073d0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.336+0000 7f5407e87700 1 -- 172.21.15.82:0/1148642810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006ab80 msgr2=0x7f540019e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:38.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.336+0000 7f5407e87700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006ab80 0x7f540019e920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00e970 tx=0x7f53fc00ec80 comp rx=0 tx=0).stop 2024-03-27T07:22:38.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.337+0000 7f5407e87700 1 -- 172.21.15.82:0/1148642810 shutdown_connections 2024-03-27T07:22:38.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.337+0000 7f5407e87700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f53ec0a3730 0x7f53ec0a5bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.337+0000 7f5407e87700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5400108680 0x7f5400198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.337+0000 7f5407e87700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f540006ab80 0x7f540019e920 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00e970 tx=0x7f53fc00ec80 comp rx=0 tx=0).stop 2024-03-27T07:22:38.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.337+0000 7f5407e87700 1 --2- 172.21.15.82:0/1148642810 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f540006b540 0x7f540019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.337+0000 7f5407e87700 1 -- 172.21.15.82:0/1148642810 >> 172.21.15.82:0/1148642810 conn(0x7f5400077590 msgr2=0x7f54001001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:38.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.338+0000 7f5407e87700 1 -- 172.21.15.82:0/1148642810 shutdown_connections 2024-03-27T07:22:38.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.338+0000 7f5407e87700 1 -- 172.21.15.82:0/1148642810 wait complete. 2024-03-27T07:22:38.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.540+0000 7fce4f616700 1 -- 172.21.15.82:0/3808081321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fce4802dd30 con 0x7fce48101f30 2024-03-27T07:22:38.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.540+0000 7fce3e7fc700 1 -- 172.21.15.82:0/3808081321 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fce3809db30 con 0x7fce48101f30 2024-03-27T07:22:38.542 INFO:teuthology.orchestra.run.smithi082.stdout:292057776164 2024-03-27T07:22:38.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 -- 172.21.15.82:0/3808081321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fce340a3730 msgr2=0x7fce340a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:38.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fce340a3730 0x7fce340a5bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fce44009fd0 tx=0x7fce44009260 comp rx=0 tx=0).stop 2024-03-27T07:22:38.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 -- 172.21.15.82:0/3808081321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce48101f30 msgr2=0x7fce4819a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce48101f30 0x7fce4819a290 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fce38005e90 tx=0x7fce3800fa90 comp rx=0 tx=0).stop 2024-03-27T07:22:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 -- 172.21.15.82:0/3808081321 shutdown_connections 2024-03-27T07:22:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fce340a3730 0x7fce340a5bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce481075b0 0x7fce481a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fce48101570 0x7fce48199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 --2- 172.21.15.82:0/3808081321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fce48101f30 0x7fce4819a290 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 -- 172.21.15.82:0/3808081321 >> 172.21.15.82:0/3808081321 conn(0x7fce48077590 msgr2=0x7fce481002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 -- 172.21.15.82:0/3808081321 shutdown_connections 2024-03-27T07:22:38.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:38.542+0000 7fce4f616700 1 -- 172.21.15.82:0/3808081321 wait complete. 2024-03-27T07:22:38.784 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299433 got 223338299438 for osd.7 2024-03-27T07:22:38.784 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:39.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:38 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1148642810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-27T07:22:39.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:38 smithi082 ceph-mon[32178]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s; 53 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:39.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:38 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3808081321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-27T07:22:39.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:38 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1148642810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-27T07:22:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:38 smithi153 ceph-mon[36179]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s; 53 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:38 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3808081321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-27T07:22:39.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:38 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1148642810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-27T07:22:39.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:38 smithi149 ceph-mon[36065]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s; 53 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:39.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:38 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3808081321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-27T07:22:39.420 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495663 got 197568495667 for osd.6 2024-03-27T07:22:39.420 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:41.106 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776160 got 292057776164 for osd.9 2024-03-27T07:22:41.106 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:41.637 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:41 smithi082 ceph-mon[32178]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:41.957 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:41 smithi149 ceph-mon[36065]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:42.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:41 smithi153 ceph-mon[36179]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:42.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.499+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/1074661859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78101540 msgr2=0x7f8c781019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:42.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.499+0000 7f8c7dbc2700 1 --2- 172.21.15.82:0/1074661859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78101540 0x7f8c781019c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009990 tx=0x7f8c6c009ca0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.499+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/1074661859 shutdown_connections 2024-03-27T07:22:42.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.499+0000 7f8c7dbc2700 1 --2- 172.21.15.82:0/1074661859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c78101f00 0x7f8c7810e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.499+0000 7f8c7dbc2700 1 --2- 172.21.15.82:0/1074661859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c78107550 0x7f8c78107930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.499+0000 7f8c7dbc2700 1 --2- 172.21.15.82:0/1074661859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78101540 0x7f8c781019c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.499+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/1074661859 >> 172.21.15.82:0/1074661859 conn(0x7f8c78078470 msgr2=0x7f8c78078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:42.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.499+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/1074661859 shutdown_connections 2024-03-27T07:22:42.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.499+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/1074661859 wait complete. 2024-03-27T07:22:42.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.500+0000 7f8c7dbc2700 1 Processor -- start 2024-03-27T07:22:42.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.500+0000 7f8c7dbc2700 1 -- start start 2024-03-27T07:22:42.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.500+0000 7f8c7dbc2700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c78101540 0x7f8c7819ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:42.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.500+0000 7f8c7dbc2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78101f00 0x7f8c7819ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:42.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.500+0000 7f8c7dbc2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c78107550 0x7f8c78198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:42.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.500+0000 7f8c7dbc2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c781128e0 con 0x7f8c78101f00 2024-03-27T07:22:42.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.500+0000 7f8c7dbc2700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78112760 con 0x7f8c78101540 2024-03-27T07:22:42.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.500+0000 7f8c7dbc2700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c78112a60 con 0x7f8c78107550 2024-03-27T07:22:42.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.500+0000 7f8c76ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78101f00 0x7f8c7819ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:42.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c76ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78101f00 0x7f8c7819ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48318/0 (socket says 172.21.15.82:48318) 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c76ffd700 1 -- 172.21.15.82:0/4147158388 learned_addr learned my addr 172.21.15.82:0/4147158388 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c777fe700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c78101540 0x7f8c7819ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c77fff700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c78107550 0x7f8c78198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c76ffd700 1 -- 172.21.15.82:0/4147158388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c78107550 msgr2=0x7f8c78198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c76ffd700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c78107550 0x7f8c78198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c76ffd700 1 -- 172.21.15.82:0/4147158388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c78101540 msgr2=0x7f8c7819ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c76ffd700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c78101540 0x7f8c7819ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c76ffd700 1 -- 172.21.15.82:0/4147158388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c78199400 con 0x7f8c78101f00 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c777fe700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c78101540 0x7f8c7819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c76ffd700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78101f00 0x7f8c7819ef90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c000c00 tx=0x7f8c6c00bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c74ff9700 1 -- 172.21.15.82:0/4147158388 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c027070 con 0x7f8c78101f00 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/4147158388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c78199690 con 0x7f8c78101f00 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c74ff9700 1 -- 172.21.15.82:0/4147158388 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c6c003d70 con 0x7f8c78101f00 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c74ff9700 1 -- 172.21.15.82:0/4147158388 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00f460 con 0x7f8c78101f00 2024-03-27T07:22:42.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.501+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/4147158388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c781a59d0 con 0x7f8c78101f00 2024-03-27T07:22:42.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.502+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/4147158388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c78102c30 con 0x7f8c78101f00 2024-03-27T07:22:42.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.503+0000 7f8c74ff9700 1 -- 172.21.15.82:0/4147158388 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f8c6c02a070 con 0x7f8c78101f00 2024-03-27T07:22:42.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.504+0000 7f8c74ff9700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c600a3730 0x7f8c600a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:42.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.504+0000 7f8c777fe700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c600a3730 0x7f8c600a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:42.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.504+0000 7f8c74ff9700 1 -- 172.21.15.82:0/4147158388 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f8c6c0d0c00 con 0x7f8c78101f00 2024-03-27T07:22:42.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.504+0000 7f8c777fe700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c600a3730 0x7f8c600a5bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8c68011490 tx=0x7f8c68009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:42.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.509+0000 7f8c74ff9700 1 -- 172.21.15.82:0/4147158388 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8c6c013070 con 0x7f8c78101f00 2024-03-27T07:22:42.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.714+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/4147158388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8c78069300 con 0x7f8c78101f00 2024-03-27T07:22:42.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.714+0000 7f8c74ff9700 1 -- 172.21.15.82:0/4147158388 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8c6c09d730 con 0x7f8c78101f00 2024-03-27T07:22:42.716 INFO:teuthology.orchestra.run.smithi082.stdout:107374182468 2024-03-27T07:22:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/4147158388 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c600a3730 msgr2=0x7f8c600a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c600a3730 0x7f8c600a5bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8c68011490 tx=0x7f8c68009260 comp rx=0 tx=0).stop 2024-03-27T07:22:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/4147158388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78101f00 msgr2=0x7f8c7819ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78101f00 0x7f8c7819ef90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c000c00 tx=0x7f8c6c00bab0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/4147158388 shutdown_connections 2024-03-27T07:22:42.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c600a3730 0x7f8c600a5bf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c78107550 0x7f8c78198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c78101540 0x7f8c7819ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 --2- 172.21.15.82:0/4147158388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c78101f00 0x7f8c7819ef90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/4147158388 >> 172.21.15.82:0/4147158388 conn(0x7f8c78078470 msgr2=0x7f8c78100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/4147158388 shutdown_connections 2024-03-27T07:22:42.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:42.716+0000 7f8c7dbc2700 1 -- 172.21.15.82:0/4147158388 wait complete. 2024-03-27T07:22:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:43 smithi082 ceph-mon[32178]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:43 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4147158388' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-27T07:22:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:43 smithi149 ceph-mon[36065]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:43 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4147158388' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-27T07:22:44.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:43 smithi153 ceph-mon[36179]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s; 48 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T07:22:44.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:43 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4147158388' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-27T07:22:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.282+0000 7fc091185700 1 -- 172.21.15.82:0/1745979914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c06ab80 msgr2=0x7fc08c06b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.282+0000 7fc091185700 1 --2- 172.21.15.82:0/1745979914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c06ab80 0x7fc08c06b000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc080009990 tx=0x7fc080009ca0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.282+0000 7fc091185700 1 -- 172.21.15.82:0/1745979914 shutdown_connections 2024-03-27T07:22:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.282+0000 7fc091185700 1 --2- 172.21.15.82:0/1745979914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc08c06b540 0x7fc08c10f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.282+0000 7fc091185700 1 --2- 172.21.15.82:0/1745979914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c108680 0x7fc08c108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.282+0000 7fc091185700 1 --2- 172.21.15.82:0/1745979914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c06ab80 0x7fc08c06b000 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.282+0000 7fc091185700 1 -- 172.21.15.82:0/1745979914 >> 172.21.15.82:0/1745979914 conn(0x7fc08c077590 msgr2=0x7fc08c0779a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:44.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.282+0000 7fc091185700 1 -- 172.21.15.82:0/1745979914 shutdown_connections 2024-03-27T07:22:44.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.282+0000 7fc091185700 1 -- 172.21.15.82:0/1745979914 wait complete. 2024-03-27T07:22:44.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc091185700 1 Processor -- start 2024-03-27T07:22:44.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc091185700 1 -- start start 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc091185700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc08c06ab80 0x7fc08c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc091185700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c06b540 0x7fc08c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc091185700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c108680 0x7fc08c19d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc091185700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c1129a0 con 0x7fc08c06b540 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc091185700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c112820 con 0x7fc08c108680 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc091185700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c112b20 con 0x7fc08c06ab80 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc08ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc08c06ab80 0x7fc08c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc08ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc08c06ab80 0x7fc08c198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:38400/0 (socket says 172.21.15.82:38400) 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc08ad9d700 1 -- 172.21.15.82:0/2426541793 learned_addr learned my addr 172.21.15.82:0/2426541793 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.283+0000 7fc08b59e700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c108680 0x7fc08c19d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc08ad9d700 1 -- 172.21.15.82:0/2426541793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c108680 msgr2=0x7fc08c19d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc08ad9d700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c108680 0x7fc08c19d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc08ad9d700 1 -- 172.21.15.82:0/2426541793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c06b540 msgr2=0x7fc08c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:44.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc08ad9d700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c06b540 0x7fc08c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc08ad9d700 1 -- 172.21.15.82:0/2426541793 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c19de40 con 0x7fc08c06ab80 2024-03-27T07:22:44.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc08ad9d700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc08c06ab80 0x7fc08c198e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00b500 tx=0x7fc07c00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:44.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc073fff700 1 -- 172.21.15.82:0/2426541793 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c015020 con 0x7fc08c06ab80 2024-03-27T07:22:44.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc073fff700 1 -- 172.21.15.82:0/2426541793 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc07c011d10 con 0x7fc08c06ab80 2024-03-27T07:22:44.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc091185700 1 -- 172.21.15.82:0/2426541793 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c19e130 con 0x7fc08c06ab80 2024-03-27T07:22:44.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc073fff700 1 -- 172.21.15.82:0/2426541793 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c010e50 con 0x7fc08c06ab80 2024-03-27T07:22:44.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.284+0000 7fc091185700 1 -- 172.21.15.82:0/2426541793 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c1a59b0 con 0x7fc08c06ab80 2024-03-27T07:22:44.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.285+0000 7fc091185700 1 -- 172.21.15.82:0/2426541793 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08c069300 con 0x7fc08c06ab80 2024-03-27T07:22:44.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.286+0000 7fc073fff700 1 -- 172.21.15.82:0/2426541793 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7fc07c018020 con 0x7fc08c06ab80 2024-03-27T07:22:44.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.287+0000 7fc073fff700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc0740a38d0 0x7fc0740a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:44.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.287+0000 7fc08a59c700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc0740a38d0 0x7fc0740a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:44.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.287+0000 7fc073fff700 1 -- 172.21.15.82:0/2426541793 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fc07c0cf530 con 0x7fc08c06ab80 2024-03-27T07:22:44.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.287+0000 7fc08a59c700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc0740a38d0 0x7fc0740a5d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0800098e0 tx=0x7fc080005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:44.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.292+0000 7fc073fff700 1 -- 172.21.15.82:0/2426541793 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc07c01f020 con 0x7fc08c06ab80 2024-03-27T07:22:44.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.498+0000 7fc091185700 1 -- 172.21.15.82:0/2426541793 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fc08c02dd30 con 0x7fc08c06ab80 2024-03-27T07:22:44.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.499+0000 7fc073fff700 1 -- 172.21.15.82:0/2426541793 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc07c09c0e0 con 0x7fc08c06ab80 2024-03-27T07:22:44.501 INFO:teuthology.orchestra.run.smithi082.stdout:313532612640 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 -- 172.21.15.82:0/2426541793 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc0740a38d0 msgr2=0x7fc0740a5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc0740a38d0 0x7fc0740a5d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0800098e0 tx=0x7fc080005fb0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 -- 172.21.15.82:0/2426541793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc08c06ab80 msgr2=0x7fc08c198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc08c06ab80 0x7fc08c198e30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00b500 tx=0x7fc07c00b810 comp rx=0 tx=0).stop 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 -- 172.21.15.82:0/2426541793 shutdown_connections 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc0740a38d0 0x7fc0740a5d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc08c06ab80 0x7fc08c198e30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc08c108680 0x7fc08c19d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 --2- 172.21.15.82:0/2426541793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc08c06b540 0x7fc08c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 -- 172.21.15.82:0/2426541793 >> 172.21.15.82:0/2426541793 conn(0x7fc08c077590 msgr2=0x7fc08c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 -- 172.21.15.82:0/2426541793 shutdown_connections 2024-03-27T07:22:44.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:44.501+0000 7fc091185700 1 -- 172.21.15.82:0/2426541793 wait complete. 2024-03-27T07:22:44.880 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:44 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2426541793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-27T07:22:45.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:44 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2426541793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-27T07:22:45.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:44 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2426541793' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-27T07:22:45.331 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612632 got 313532612640 for osd.10 2024-03-27T07:22:45.331 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:45.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 -- 172.21.15.82:0/83776449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24a4101bf0 msgr2=0x7f24a4107330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:45.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 --2- 172.21.15.82:0/83776449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24a4101bf0 0x7f24a4107330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24980099c0 tx=0x7f2498009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 -- 172.21.15.82:0/83776449 shutdown_connections 2024-03-27T07:22:45.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 --2- 172.21.15.82:0/83776449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24a4107a10 0x7f24a410f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 --2- 172.21.15.82:0/83776449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a4101240 0x7f24a4101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 --2- 172.21.15.82:0/83776449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24a4101bf0 0x7f24a4107330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 -- 172.21.15.82:0/83776449 >> 172.21.15.82:0/83776449 conn(0x7f24a40768c0 msgr2=0x7f24a4076cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:45.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 -- 172.21.15.82:0/83776449 shutdown_connections 2024-03-27T07:22:45.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 -- 172.21.15.82:0/83776449 wait complete. 2024-03-27T07:22:45.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 Processor -- start 2024-03-27T07:22:45.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.506+0000 7f24aa666700 1 -- start start 2024-03-27T07:22:45.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24aa666700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24a4101240 0x7f24a4198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:45.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24aa666700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a4101bf0 0x7f24a4199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24aa666700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24a4107a10 0x7f24a419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24aa666700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4112a10 con 0x7f24a4107a10 2024-03-27T07:22:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24aa666700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4112890 con 0x7f24a4101bf0 2024-03-27T07:22:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24aa666700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4112b90 con 0x7f24a4101240 2024-03-27T07:22:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24a4101240 0x7f24a4198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a8c03700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24a4107a10 0x7f24a419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24a4101240 0x7f24a4198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:38414/0 (socket says 172.21.15.82:38414) 2024-03-27T07:22:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a3fff700 1 -- 172.21.15.82:0/1353119366 learned_addr learned my addr 172.21.15.82:0/1353119366 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:45.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a37fe700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a4101bf0 0x7f24a4199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a3fff700 1 -- 172.21.15.82:0/1353119366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a4101bf0 msgr2=0x7f24a4199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a3fff700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a4101bf0 0x7f24a4199420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a3fff700 1 -- 172.21.15.82:0/1353119366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24a4107a10 msgr2=0x7f24a419d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a3fff700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24a4107a10 0x7f24a419d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a3fff700 1 -- 172.21.15.82:0/1353119366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a419def0 con 0x7f24a4101240 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.507+0000 7f24a8c03700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24a4107a10 0x7f24a419d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.508+0000 7f24a3fff700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24a4101240 0x7f24a4198ee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f249400e9a0 tx=0x7f249400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.508+0000 7f24a17fa700 1 -- 172.21.15.82:0/1353119366 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249400ca10 con 0x7f24a4101240 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.508+0000 7f24a17fa700 1 -- 172.21.15.82:0/1353119366 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f249400cbb0 con 0x7f24a4101240 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.508+0000 7f24aa666700 1 -- 172.21.15.82:0/1353119366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a419e1e0 con 0x7f24a4101240 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.508+0000 7f24a17fa700 1 -- 172.21.15.82:0/1353119366 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2494018680 con 0x7f24a4101240 2024-03-27T07:22:45.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.508+0000 7f24aa666700 1 -- 172.21.15.82:0/1353119366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a41a5a60 con 0x7f24a4101240 2024-03-27T07:22:45.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.509+0000 7f24aa666700 1 -- 172.21.15.82:0/1353119366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a4069300 con 0x7f24a4101240 2024-03-27T07:22:45.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.510+0000 7f24a17fa700 1 -- 172.21.15.82:0/1353119366 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f2494010430 con 0x7f24a4101240 2024-03-27T07:22:45.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.511+0000 7f24a17fa700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f248c0a37b0 0x7f248c0a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:45.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.511+0000 7f24a37fe700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f248c0a37b0 0x7f248c0a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:45.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.511+0000 7f24a17fa700 1 -- 172.21.15.82:0/1353119366 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f24940cff90 con 0x7f24a4101240 2024-03-27T07:22:45.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.512+0000 7f24a37fe700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f248c0a37b0 0x7f248c0a5c70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2498000c00 tx=0x7f2498005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:45.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.516+0000 7f24a17fa700 1 -- 172.21.15.82:0/1353119366 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f249409cad0 con 0x7f24a4101240 2024-03-27T07:22:45.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.724+0000 7f24aa666700 1 -- 172.21.15.82:0/1353119366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f24a402dd30 con 0x7f24a4101240 2024-03-27T07:22:45.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.724+0000 7f24a17fa700 1 -- 172.21.15.82:0/1353119366 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f249409c3d0 con 0x7f24a4101240 2024-03-27T07:22:45.726 INFO:teuthology.orchestra.run.smithi082.stdout:34359738451 2024-03-27T07:22:45.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 -- 172.21.15.82:0/1353119366 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f248c0a37b0 msgr2=0x7f248c0a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:45.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f248c0a37b0 0x7f248c0a5c70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2498000c00 tx=0x7f2498005fb0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 -- 172.21.15.82:0/1353119366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24a4101240 msgr2=0x7f24a4198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:45.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24a4101240 0x7f24a4198ee0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f249400e9a0 tx=0x7f249400ecb0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 -- 172.21.15.82:0/1353119366 shutdown_connections 2024-03-27T07:22:45.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f248c0a37b0 0x7f248c0a5c70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24a4101240 0x7f24a4198ee0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24a4107a10 0x7f24a419d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 --2- 172.21.15.82:0/1353119366 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f24a4101bf0 0x7f24a4199420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:45.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 -- 172.21.15.82:0/1353119366 >> 172.21.15.82:0/1353119366 conn(0x7f24a40768c0 msgr2=0x7f24a40ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:45.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 -- 172.21.15.82:0/1353119366 shutdown_connections 2024-03-27T07:22:45.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:45.727+0000 7f24aa666700 1 -- 172.21.15.82:0/1353119366 wait complete. 2024-03-27T07:22:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:45 smithi082 ceph-mon[32178]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:46.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:45 smithi149 ceph-mon[36065]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:46.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:45 smithi153 ceph-mon[36179]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:46.343 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182462 got 107374182468 for osd.3 2024-03-27T07:22:46.343 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:46.565 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:46 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1353119366' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-27T07:22:47.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:46 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1353119366' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-27T07:22:47.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:46 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1353119366' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-27T07:22:47.584 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738451 for osd.0 2024-03-27T07:22:47.584 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:47.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:47 smithi082 ceph-mon[32178]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:22:47.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.805+0000 7fc80d37b700 1 -- 172.21.15.82:0/2677449211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc808103050 msgr2=0x7fc80810f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.805+0000 7fc80d37b700 1 --2- 172.21.15.82:0/2677449211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc808103050 0x7fc80810f490 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc80000b0d0 tx=0x7fc80000b3e0 comp rx=0 tx=0).stop 2024-03-27T07:22:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.805+0000 7fc80d37b700 1 -- 172.21.15.82:0/2677449211 shutdown_connections 2024-03-27T07:22:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.805+0000 7fc80d37b700 1 --2- 172.21.15.82:0/2677449211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc808108670 0x7fc808108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.805+0000 7fc80d37b700 1 --2- 172.21.15.82:0/2677449211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc808103050 0x7fc80810f490 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.805+0000 7fc80d37b700 1 --2- 172.21.15.82:0/2677449211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc808102690 0x7fc808102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.805+0000 7fc80d37b700 1 -- 172.21.15.82:0/2677449211 >> 172.21.15.82:0/2677449211 conn(0x7fc808079770 msgr2=0x7fc808079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.805+0000 7fc80d37b700 1 -- 172.21.15.82:0/2677449211 shutdown_connections 2024-03-27T07:22:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.805+0000 7fc80d37b700 1 -- 172.21.15.82:0/2677449211 wait complete. 2024-03-27T07:22:47.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.806+0000 7fc80d37b700 1 Processor -- start 2024-03-27T07:22:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.806+0000 7fc80d37b700 1 -- start start 2024-03-27T07:22:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.806+0000 7fc80d37b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc808102690 0x7fc808198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.806+0000 7fc80d37b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc808103050 0x7fc808199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.806+0000 7fc80d37b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc808108670 0x7fc80819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.806+0000 7fc80d37b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8081128f0 con 0x7fc808103050 2024-03-27T07:22:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.806+0000 7fc80d37b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc808112770 con 0x7fc808108670 2024-03-27T07:22:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.806+0000 7fc80d37b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc808112a70 con 0x7fc808102690 2024-03-27T07:22:47.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.806+0000 7fc8067fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc808103050 0x7fc808199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc8067fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc808103050 0x7fc808199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54294/0 (socket says 172.21.15.82:54294) 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc806ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc808102690 0x7fc808198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc8067fc700 1 -- 172.21.15.82:0/4094497687 learned_addr learned my addr 172.21.15.82:0/4094497687 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc8077fe700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc808108670 0x7fc80819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc8067fc700 1 -- 172.21.15.82:0/4094497687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc808102690 msgr2=0x7fc808198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc8067fc700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc808102690 0x7fc808198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc8067fc700 1 -- 172.21.15.82:0/4094497687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc808108670 msgr2=0x7fc80819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc8067fc700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc808108670 0x7fc80819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc8067fc700 1 -- 172.21.15.82:0/4094497687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80819dd80 con 0x7fc808103050 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc8077fe700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc808108670 0x7fc80819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc8067fc700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc808103050 0x7fc808199300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00e9a0 tx=0x7fc7fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc7effff700 1 -- 172.21.15.82:0/4094497687 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00ca10 con 0x7fc808103050 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc80d37b700 1 -- 172.21.15.82:0/4094497687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80819e070 con 0x7fc808103050 2024-03-27T07:22:47.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc80d37b700 1 -- 172.21.15.82:0/4094497687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8081a58f0 con 0x7fc808103050 2024-03-27T07:22:47.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc7effff700 1 -- 172.21.15.82:0/4094497687 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7fc00cbb0 con 0x7fc808103050 2024-03-27T07:22:47.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.807+0000 7fc7effff700 1 -- 172.21.15.82:0/4094497687 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc018680 con 0x7fc808103050 2024-03-27T07:22:47.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.808+0000 7fc80d37b700 1 -- 172.21.15.82:0/4094497687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f4005330 con 0x7fc808103050 2024-03-27T07:22:47.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.809+0000 7fc7effff700 1 -- 172.21.15.82:0/4094497687 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7fc7fc018820 con 0x7fc808103050 2024-03-27T07:22:47.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.810+0000 7fc7effff700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc7f00a37b0 0x7fc7f00a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:47.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.810+0000 7fc806ffd700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc7f00a37b0 0x7fc7f00a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:47.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.810+0000 7fc7effff700 1 -- 172.21.15.82:0/4094497687 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fc7fc0cfe10 con 0x7fc808103050 2024-03-27T07:22:47.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.810+0000 7fc806ffd700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc7f00a37b0 0x7fc7f00a5c70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009be0 tx=0x7fc7f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:47.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:47.814+0000 7fc7effff700 1 -- 172.21.15.82:0/4094497687 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc7fc09c9c0 con 0x7fc808103050 2024-03-27T07:22:48.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:47 smithi149 ceph-mon[36065]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:22:48.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.010+0000 7fdd690dd700 1 -- 172.21.15.82:0/2905121254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd64108710 msgr2=0x7fdd64108af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:48.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.010+0000 7fdd690dd700 1 --2- 172.21.15.82:0/2905121254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd64108710 0x7fdd64108af0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdd540099c0 tx=0x7fdd54009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.010+0000 7fdd690dd700 1 -- 172.21.15.82:0/2905121254 shutdown_connections 2024-03-27T07:22:48.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.010+0000 7fdd690dd700 1 --2- 172.21.15.82:0/2905121254 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd64103080 0x7fdd6410f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.011+0000 7fdd690dd700 1 --2- 172.21.15.82:0/2905121254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd64108710 0x7fdd64108af0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.011+0000 7fdd690dd700 1 --2- 172.21.15.82:0/2905121254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd641026c0 0x7fdd64102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.011+0000 7fdd690dd700 1 -- 172.21.15.82:0/2905121254 >> 172.21.15.82:0/2905121254 conn(0x7fdd64079710 msgr2=0x7fdd64079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:48.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.011+0000 7fdd690dd700 1 -- 172.21.15.82:0/2905121254 shutdown_connections 2024-03-27T07:22:48.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.011+0000 7fdd690dd700 1 -- 172.21.15.82:0/2905121254 wait complete. 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.011+0000 7fdd690dd700 1 Processor -- start 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.011+0000 7fdd690dd700 1 -- start start 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd690dd700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd641026c0 0x7fdd64198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd690dd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd64103080 0x7fdd64199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd690dd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd64108710 0x7fdd6419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd690dd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdd641128d0 con 0x7fdd64103080 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd690dd700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdd64112750 con 0x7fdd641026c0 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd690dd700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdd64112a50 con 0x7fdd64108710 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd64103080 0x7fdd64199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6259c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd64103080 0x7fdd64199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54314/0 (socket says 172.21.15.82:54314) 2024-03-27T07:22:48.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6259c700 1 -- 172.21.15.82:0/3983736161 learned_addr learned my addr 172.21.15.82:0/3983736161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6359e700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd64108710 0x7fdd6419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd62d9d700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd641026c0 0x7fdd64198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6259c700 1 -- 172.21.15.82:0/3983736161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd64108710 msgr2=0x7fdd6419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6259c700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd64108710 0x7fdd6419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6259c700 1 -- 172.21.15.82:0/3983736161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd641026c0 msgr2=0x7fdd64198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6259c700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd641026c0 0x7fdd64198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6259c700 1 -- 172.21.15.82:0/3983736161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6419dd80 con 0x7fdd64103080 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6359e700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd64108710 0x7fdd6419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd6259c700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd64103080 0x7fdd64199300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800e9a0 tx=0x7fdd5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.012+0000 7fdd4bfff700 1 -- 172.21.15.82:0/3983736161 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800ca10 con 0x7fdd64103080 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.013+0000 7fdd690dd700 1 -- 172.21.15.82:0/3983736161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6419e070 con 0x7fdd64103080 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.013+0000 7fdd4bfff700 1 -- 172.21.15.82:0/3983736161 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd5800cbb0 con 0x7fdd64103080 2024-03-27T07:22:48.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.013+0000 7fdd4bfff700 1 -- 172.21.15.82:0/3983736161 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58018680 con 0x7fdd64103080 2024-03-27T07:22:48.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.013+0000 7fdd690dd700 1 -- 172.21.15.82:0/3983736161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd641a58f0 con 0x7fdd64103080 2024-03-27T07:22:48.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.013+0000 7fdd690dd700 1 -- 172.21.15.82:0/3983736161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd64069300 con 0x7fdd64103080 2024-03-27T07:22:48.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.015+0000 7fdd4bfff700 1 -- 172.21.15.82:0/3983736161 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7fdd58010430 con 0x7fdd64103080 2024-03-27T07:22:48.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.015+0000 7fdd4bfff700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdd4c0a7b40 0x7fdd4c0aa000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:48.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.015+0000 7fdd62d9d700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdd4c0a7b40 0x7fdd4c0aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:48.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.016+0000 7fdd4bfff700 1 -- 172.21.15.82:0/3983736161 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fdd580d0530 con 0x7fdd64103080 2024-03-27T07:22:48.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.016+0000 7fdd62d9d700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdd4c0a7b40 0x7fdd4c0aa000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdd54000c00 tx=0x7fdd54005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:48.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.023+0000 7fdd4bfff700 1 -- 172.21.15.82:0/3983736161 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fdd5809cfd0 con 0x7fdd64103080 2024-03-27T07:22:48.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.024+0000 7fc80d37b700 1 -- 172.21.15.82:0/4094497687 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fc7f40058f0 con 0x7fc808103050 2024-03-27T07:22:48.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.024+0000 7fc7effff700 1 -- 172.21.15.82:0/4094497687 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc7fc09c2c0 con 0x7fc808103050 2024-03-27T07:22:48.026 INFO:teuthology.orchestra.run.smithi082.stdout:257698037804 2024-03-27T07:22:48.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 -- 172.21.15.82:0/4094497687 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc7f00a37b0 msgr2=0x7fc7f00a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:48.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc7f00a37b0 0x7fc7f00a5c70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8009be0 tx=0x7fc7f8009260 comp rx=0 tx=0).stop 2024-03-27T07:22:48.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 -- 172.21.15.82:0/4094497687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc808103050 msgr2=0x7fc808199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:48.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc808103050 0x7fc808199300 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00e9a0 tx=0x7fc7fc00ecb0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 -- 172.21.15.82:0/4094497687 shutdown_connections 2024-03-27T07:22:48.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc7f00a37b0 0x7fc7f00a5c70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc808102690 0x7fc808198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc808108670 0x7fc80819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 --2- 172.21.15.82:0/4094497687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc808103050 0x7fc808199300 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 -- 172.21.15.82:0/4094497687 >> 172.21.15.82:0/4094497687 conn(0x7fc808079770 msgr2=0x7fc808101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:48.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 -- 172.21.15.82:0/4094497687 shutdown_connections 2024-03-27T07:22:48.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.027+0000 7fc80d37b700 1 -- 172.21.15.82:0/4094497687 wait complete. 2024-03-27T07:22:48.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:47 smithi153 ceph-mon[36179]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:22:48.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.234+0000 7fdd690dd700 1 -- 172.21.15.82:0/3983736161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdd6402dd30 con 0x7fdd64103080 2024-03-27T07:22:48.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.235+0000 7fdd4bfff700 1 -- 172.21.15.82:0/3983736161 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdd5809c8d0 con 0x7fdd64103080 2024-03-27T07:22:48.237 INFO:teuthology.orchestra.run.smithi082.stdout:163208757306 2024-03-27T07:22:48.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 -- 172.21.15.82:0/3983736161 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdd4c0a7b40 msgr2=0x7fdd4c0aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:48.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdd4c0a7b40 0x7fdd4c0aa000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdd54000c00 tx=0x7fdd54005fb0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 -- 172.21.15.82:0/3983736161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd64103080 msgr2=0x7fdd64199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:48.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd64103080 0x7fdd64199300 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800e9a0 tx=0x7fdd5800ecb0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 -- 172.21.15.82:0/3983736161 shutdown_connections 2024-03-27T07:22:48.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdd4c0a7b40 0x7fdd4c0aa000 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd64108710 0x7fdd6419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdd641026c0 0x7fdd64198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 --2- 172.21.15.82:0/3983736161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd64103080 0x7fdd64199300 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:48.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 -- 172.21.15.82:0/3983736161 >> 172.21.15.82:0/3983736161 conn(0x7fdd64079710 msgr2=0x7fdd64101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:48.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 -- 172.21.15.82:0/3983736161 shutdown_connections 2024-03-27T07:22:48.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:48.237+0000 7fdd690dd700 1 -- 172.21.15.82:0/3983736161 wait complete. 2024-03-27T07:22:48.833 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:48 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4094497687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-27T07:22:48.833 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:48 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3983736161' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-27T07:22:48.859 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757301 got 163208757306 for osd.5 2024-03-27T07:22:48.859 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:49.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:48 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4094497687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-27T07:22:49.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:48 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3983736161' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-27T07:22:49.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:48 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4094497687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-27T07:22:49.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:48 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3983736161' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-27T07:22:49.305 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037795 got 257698037804 for osd.8 2024-03-27T07:22:49.305 DEBUG:teuthology.parallel:result is None 2024-03-27T07:22:49.305 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-27T07:22:49.305 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph pg dump --format=json 2024-03-27T07:22:49.564 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:49.827 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:49 smithi082 ceph-mon[32178]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-03-27T07:22:50.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:49 smithi149 ceph-mon[36065]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-03-27T07:22:50.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:49 smithi153 ceph-mon[36179]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-03-27T07:22:51.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.195+0000 7f4da30ac700 1 -- 172.21.15.82:0/3179026475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c103050 msgr2=0x7f4d9c10f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.195+0000 7f4da30ac700 1 --2- 172.21.15.82:0/3179026475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c103050 0x7f4d9c10f490 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400b0d0 tx=0x7f4d9400b3e0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.195+0000 7f4da30ac700 1 -- 172.21.15.82:0/3179026475 shutdown_connections 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.195+0000 7f4da30ac700 1 --2- 172.21.15.82:0/3179026475 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c103050 0x7f4d9c10f490 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.195+0000 7f4da30ac700 1 --2- 172.21.15.82:0/3179026475 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d9c108670 0x7f4d9c108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.195+0000 7f4da30ac700 1 --2- 172.21.15.82:0/3179026475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c102690 0x7f4d9c102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.195+0000 7f4da30ac700 1 -- 172.21.15.82:0/3179026475 >> 172.21.15.82:0/3179026475 conn(0x7f4d9c079770 msgr2=0x7f4d9c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.195+0000 7f4da30ac700 1 -- 172.21.15.82:0/3179026475 shutdown_connections 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.195+0000 7f4da30ac700 1 -- 172.21.15.82:0/3179026475 wait complete. 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da30ac700 1 Processor -- start 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da30ac700 1 -- start start 2024-03-27T07:22:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da30ac700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c102690 0x7f4d9c198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da30ac700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c103050 0x7f4d9c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da30ac700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d9c108670 0x7f4d9c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da30ac700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c112920 con 0x7f4d9c102690 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da30ac700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c1127a0 con 0x7f4d9c108670 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da30ac700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9c112aa0 con 0x7f4d9c103050 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da0e48700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c102690 0x7f4d9c198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da0e48700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c102690 0x7f4d9c198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54334/0 (socket says 172.21.15.82:54334) 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da0e48700 1 -- 172.21.15.82:0/2905250154 learned_addr learned my addr 172.21.15.82:0/2905250154 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4da1649700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d9c108670 0x7f4d9c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.196+0000 7f4d9bfff700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c103050 0x7f4d9c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4da0e48700 1 -- 172.21.15.82:0/2905250154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c103050 msgr2=0x7f4d9c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4da0e48700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c103050 0x7f4d9c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4da0e48700 1 -- 172.21.15.82:0/2905250154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d9c108670 msgr2=0x7f4d9c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4da0e48700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d9c108670 0x7f4d9c19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4da0e48700 1 -- 172.21.15.82:0/2905250154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c19de00 con 0x7f4d9c102690 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4da0e48700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c102690 0x7f4d9c198df0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000e9a0 tx=0x7f4d9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4d99ffb700 1 -- 172.21.15.82:0/2905250154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000ca10 con 0x7f4d9c102690 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4da30ac700 1 -- 172.21.15.82:0/2905250154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d9c19e0f0 con 0x7f4d9c102690 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4d99ffb700 1 -- 172.21.15.82:0/2905250154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d9000cbb0 con 0x7f4d9c102690 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4d99ffb700 1 -- 172.21.15.82:0/2905250154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90018680 con 0x7f4d9c102690 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.197+0000 7f4da30ac700 1 -- 172.21.15.82:0/2905250154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d9c1a5970 con 0x7f4d9c102690 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.198+0000 7f4da30ac700 1 -- 172.21.15.82:0/2905250154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9c069300 con 0x7f4d9c102690 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.199+0000 7f4d99ffb700 1 -- 172.21.15.82:0/2905250154 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f4d90010430 con 0x7f4d9c102690 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.200+0000 7f4d99ffb700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4d8c0a3730 0x7f4d8c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.200+0000 7f4d9bfff700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4d8c0a3730 0x7f4d8c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:51.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.200+0000 7f4d99ffb700 1 -- 172.21.15.82:0/2905250154 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f4d900cff80 con 0x7f4d9c102690 2024-03-27T07:22:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.200+0000 7f4d9bfff700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4d8c0a3730 0x7f4d8c0a5bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c079e00 tx=0x7f4d88009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.204+0000 7f4d99ffb700 1 -- 172.21.15.82:0/2905250154 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4d9009cac0 con 0x7f4d9c102690 2024-03-27T07:22:51.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.409+0000 7f4da30ac700 1 -- 172.21.15.82:0/2905250154 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d9c062a80 con 0x7f4d8c0a3730 2024-03-27T07:22:51.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.416+0000 7f4d99ffb700 1 -- 172.21.15.82:0/2905250154 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258935 (secure 0 0 0) 0x7f4d9c062a80 con 0x7f4d8c0a3730 2024-03-27T07:22:51.422 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:22:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 -- 172.21.15.82:0/2905250154 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4d8c0a3730 msgr2=0x7f4d8c0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4d8c0a3730 0x7f4d8c0a5bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c079e00 tx=0x7f4d88009260 comp rx=0 tx=0).stop 2024-03-27T07:22:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 -- 172.21.15.82:0/2905250154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c102690 msgr2=0x7f4d9c198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c102690 0x7f4d9c198df0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000e9a0 tx=0x7f4d9000ecb0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 -- 172.21.15.82:0/2905250154 shutdown_connections 2024-03-27T07:22:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f4d8c0a3730 0x7f4d8c0a5bf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4d9c108670 0x7f4d9c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4d9c102690 0x7f4d9c198df0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 --2- 172.21.15.82:0/2905250154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d9c103050 0x7f4d9c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 -- 172.21.15.82:0/2905250154 >> 172.21.15.82:0/2905250154 conn(0x7f4d9c079770 msgr2=0x7f4d9c101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.419+0000 7f4da30ac700 1 -- 172.21.15.82:0/2905250154 shutdown_connections 2024-03-27T07:22:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:51.420+0000 7f4da30ac700 1 -- 172.21.15.82:0/2905250154 wait complete. 2024-03-27T07:22:51.425 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-27T07:22:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:51 smithi082 ceph-mon[32178]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:51 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:51.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:51 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:51 smithi149 ceph-mon[36065]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:51 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:51 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:51 smithi153 ceph-mon[36179]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:51 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:51 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:52.092 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2024-03-27T07:22:50.492949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655649,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":571,"num_read_kb":405,"num_write":339,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181318,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356764,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585060,"statfs":{"total":1151940427776,"available":1151575101440,"internally_reserved":0,"allocated":11980800,"data_stored":7497387,"data_compressed":112689,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19139,"internal_metadata":353154365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002885"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664551+0000","last_change":"2024-03-27T07:21:35.577169+0000","last_active":"2024-03-27T07:22:27.664551+0000","last_peered":"2024-03-27T07:22:27.664551+0000","last_clean":"2024-03-27T07:22:27.664551+0000","last_became_active":"2024-03-27T07:21:35.576737+0000","last_became_peered":"2024-03-27T07:21:35.576737+0000","last_unstale":"2024-03-27T07:22:27.664551+0000","last_undegraded":"2024-03-27T07:22:27.664551+0000","last_fullsized":"2024-03-27T07:22:27.664551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:58:55.152543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408731+0000","last_change":"2024-03-27T07:21:35.576197+0000","last_active":"2024-03-27T07:22:28.408731+0000","last_peered":"2024-03-27T07:22:28.408731+0000","last_clean":"2024-03-27T07:22:28.408731+0000","last_became_active":"2024-03-27T07:21:35.575876+0000","last_became_peered":"2024-03-27T07:21:35.575876+0000","last_unstale":"2024-03-27T07:22:28.408731+0000","last_undegraded":"2024-03-27T07:22:28.408731+0000","last_fullsized":"2024-03-27T07:22:28.408731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:23:12.589029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408769+0000","last_change":"2024-03-27T07:21:35.582045+0000","last_active":"2024-03-27T07:22:28.408769+0000","last_peered":"2024-03-27T07:22:28.408769+0000","last_clean":"2024-03-27T07:22:28.408769+0000","last_became_active":"2024-03-27T07:21:35.581710+0000","last_became_peered":"2024-03-27T07:21:35.581710+0000","last_unstale":"2024-03-27T07:22:28.408769+0000","last_undegraded":"2024-03-27T07:22:28.408769+0000","last_fullsized":"2024-03-27T07:22:28.408769+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:47:39.004986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.672301+0000","last_change":"2024-03-27T07:22:27.670513+0000","last_active":"2024-03-27T07:22:27.672301+0000","last_peered":"2024-03-27T07:22:27.672301+0000","last_clean":"2024-03-27T07:22:27.672301+0000","last_became_active":"2024-03-27T07:22:27.670263+0000","last_became_peered":"2024-03-27T07:22:27.670263+0000","last_unstale":"2024-03-27T07:22:27.672301+0000","last_undegraded":"2024-03-27T07:22:27.672301+0000","last_fullsized":"2024-03-27T07:22:27.672301+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:32:43.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666242+0000","last_change":"2024-03-27T07:21:35.568964+0000","last_active":"2024-03-27T07:22:27.666242+0000","last_peered":"2024-03-27T07:22:27.666242+0000","last_clean":"2024-03-27T07:22:27.666242+0000","last_became_active":"2024-03-27T07:21:35.568607+0000","last_became_peered":"2024-03-27T07:21:35.568607+0000","last_unstale":"2024-03-27T07:22:27.666242+0000","last_undegraded":"2024-03-27T07:22:27.666242+0000","last_fullsized":"2024-03-27T07:22:27.666242+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:26:32.122422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.665021+0000","last_change":"2024-03-27T07:21:35.575915+0000","last_active":"2024-03-27T07:22:27.665021+0000","last_peered":"2024-03-27T07:22:27.665021+0000","last_clean":"2024-03-27T07:22:27.665021+0000","last_became_active":"2024-03-27T07:21:35.575604+0000","last_became_peered":"2024-03-27T07:21:35.575604+0000","last_unstale":"2024-03-27T07:22:27.665021+0000","last_undegraded":"2024-03-27T07:22:27.665021+0000","last_fullsized":"2024-03-27T07:22:27.665021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:19:12.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668235+0000","last_change":"2024-03-27T07:21:35.570762+0000","last_active":"2024-03-27T07:22:27.668235+0000","last_peered":"2024-03-27T07:22:27.668235+0000","last_clean":"2024-03-27T07:22:27.668235+0000","last_became_active":"2024-03-27T07:21:35.570380+0000","last_became_peered":"2024-03-27T07:21:35.570380+0000","last_unstale":"2024-03-27T07:22:27.668235+0000","last_undegraded":"2024-03-27T07:22:27.668235+0000","last_fullsized":"2024-03-27T07:22:27.668235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:35:04.463674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666164+0000","last_change":"2024-03-27T07:21:35.573220+0000","last_active":"2024-03-27T07:22:27.666164+0000","last_peered":"2024-03-27T07:22:27.666164+0000","last_clean":"2024-03-27T07:22:27.666164+0000","last_became_active":"2024-03-27T07:21:35.572909+0000","last_became_peered":"2024-03-27T07:21:35.572909+0000","last_unstale":"2024-03-27T07:22:27.666164+0000","last_undegraded":"2024-03-27T07:22:27.666164+0000","last_fullsized":"2024-03-27T07:22:27.666164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:49:51.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.670307+0000","last_change":"2024-03-27T07:21:35.559298+0000","last_active":"2024-03-27T07:22:27.670307+0000","last_peered":"2024-03-27T07:22:27.670307+0000","last_clean":"2024-03-27T07:22:27.670307+0000","last_became_active":"2024-03-27T07:21:35.558968+0000","last_became_peered":"2024-03-27T07:21:35.558968+0000","last_unstale":"2024-03-27T07:22:27.670307+0000","last_undegraded":"2024-03-27T07:22:27.670307+0000","last_fullsized":"2024-03-27T07:22:27.670307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:12:31.027411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.665161+0000","last_change":"2024-03-27T07:21:35.577015+0000","last_active":"2024-03-27T07:22:27.665161+0000","last_peered":"2024-03-27T07:22:27.665161+0000","last_clean":"2024-03-27T07:22:27.665161+0000","last_became_active":"2024-03-27T07:21:35.576599+0000","last_became_peered":"2024-03-27T07:21:35.576599+0000","last_unstale":"2024-03-27T07:22:27.665161+0000","last_undegraded":"2024-03-27T07:22:27.665161+0000","last_fullsized":"2024-03-27T07:22:27.665161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:03.138951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668507+0000","last_change":"2024-03-27T07:21:35.576540+0000","last_active":"2024-03-27T07:22:27.668507+0000","last_peered":"2024-03-27T07:22:27.668507+0000","last_clean":"2024-03-27T07:22:27.668507+0000","last_became_active":"2024-03-27T07:21:35.576101+0000","last_became_peered":"2024-03-27T07:21:35.576101+0000","last_unstale":"2024-03-27T07:22:27.668507+0000","last_undegraded":"2024-03-27T07:22:27.668507+0000","last_fullsized":"2024-03-27T07:22:27.668507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:13.654970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.669626+0000","last_change":"2024-03-27T07:22:27.669089+0000","last_active":"2024-03-27T07:22:27.669626+0000","last_peered":"2024-03-27T07:22:27.669626+0000","last_clean":"2024-03-27T07:22:27.669626+0000","last_became_active":"2024-03-27T07:22:27.668715+0000","last_became_peered":"2024-03-27T07:22:27.668715+0000","last_unstale":"2024-03-27T07:22:27.669626+0000","last_undegraded":"2024-03-27T07:22:27.669626+0000","last_fullsized":"2024-03-27T07:22:27.669626+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:44:33.732968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408472+0000","last_change":"2024-03-27T07:21:35.559726+0000","last_active":"2024-03-27T07:22:28.408472+0000","last_peered":"2024-03-27T07:22:28.408472+0000","last_clean":"2024-03-27T07:22:28.408472+0000","last_became_active":"2024-03-27T07:21:35.559294+0000","last_became_peered":"2024-03-27T07:21:35.559294+0000","last_unstale":"2024-03-27T07:22:28.408472+0000","last_undegraded":"2024-03-27T07:22:28.408472+0000","last_fullsized":"2024-03-27T07:22:28.408472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:27:00.364447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408473+0000","last_change":"2024-03-27T07:21:35.577959+0000","last_active":"2024-03-27T07:22:28.408473+0000","last_peered":"2024-03-27T07:22:28.408473+0000","last_clean":"2024-03-27T07:22:28.408473+0000","last_became_active":"2024-03-27T07:21:35.577642+0000","last_became_peered":"2024-03-27T07:21:35.577642+0000","last_unstale":"2024-03-27T07:22:28.408473+0000","last_undegraded":"2024-03-27T07:22:28.408473+0000","last_fullsized":"2024-03-27T07:22:28.408473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:07:44.836888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408334+0000","last_change":"2024-03-27T07:21:35.580901+0000","last_active":"2024-03-27T07:22:28.408334+0000","last_peered":"2024-03-27T07:22:28.408334+0000","last_clean":"2024-03-27T07:22:28.408334+0000","last_became_active":"2024-03-27T07:21:35.579456+0000","last_became_peered":"2024-03-27T07:21:35.579456+0000","last_unstale":"2024-03-27T07:22:28.408334+0000","last_undegraded":"2024-03-27T07:22:28.408334+0000","last_fullsized":"2024-03-27T07:22:28.408334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:35:54.722160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.669825+0000","last_change":"2024-03-27T07:21:35.574462+0000","last_active":"2024-03-27T07:22:27.669825+0000","last_peered":"2024-03-27T07:22:27.669825+0000","last_clean":"2024-03-27T07:22:27.669825+0000","last_became_active":"2024-03-27T07:21:35.574158+0000","last_became_peered":"2024-03-27T07:21:35.574158+0000","last_unstale":"2024-03-27T07:22:27.669825+0000","last_undegraded":"2024-03-27T07:22:27.669825+0000","last_fullsized":"2024-03-27T07:22:27.669825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:16:18.756955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664637+0000","last_change":"2024-03-27T07:21:35.576808+0000","last_active":"2024-03-27T07:22:27.664637+0000","last_peered":"2024-03-27T07:22:27.664637+0000","last_clean":"2024-03-27T07:22:27.664637+0000","last_became_active":"2024-03-27T07:21:35.574819+0000","last_became_peered":"2024-03-27T07:21:35.574819+0000","last_unstale":"2024-03-27T07:22:27.664637+0000","last_undegraded":"2024-03-27T07:22:27.664637+0000","last_fullsized":"2024-03-27T07:22:27.664637+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:29:06.137201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668117+0000","last_change":"2024-03-27T07:21:35.570650+0000","last_active":"2024-03-27T07:22:27.668117+0000","last_peered":"2024-03-27T07:22:27.668117+0000","last_clean":"2024-03-27T07:22:27.668117+0000","last_became_active":"2024-03-27T07:21:35.569850+0000","last_became_peered":"2024-03-27T07:21:35.569850+0000","last_unstale":"2024-03-27T07:22:27.668117+0000","last_undegraded":"2024-03-27T07:22:27.668117+0000","last_fullsized":"2024-03-27T07:22:27.668117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:22:39.829648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666732+0000","last_change":"2024-03-27T07:21:35.566322+0000","last_active":"2024-03-27T07:22:27.666732+0000","last_peered":"2024-03-27T07:22:27.666732+0000","last_clean":"2024-03-27T07:22:27.666732+0000","last_became_active":"2024-03-27T07:21:35.565947+0000","last_became_peered":"2024-03-27T07:21:35.565947+0000","last_unstale":"2024-03-27T07:22:27.666732+0000","last_undegraded":"2024-03-27T07:22:27.666732+0000","last_fullsized":"2024-03-27T07:22:27.666732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:58:34.151735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.702687+0000","last_change":"2024-03-27T07:22:27.702687+0000","last_active":"2024-03-27T07:22:27.702687+0000","last_peered":"2024-03-27T07:22:27.702687+0000","last_clean":"2024-03-27T07:22:27.702687+0000","last_became_active":"2024-03-27T07:22:27.696358+0000","last_became_peered":"2024-03-27T07:22:27.696358+0000","last_unstale":"2024-03-27T07:22:27.702687+0000","last_undegraded":"2024-03-27T07:22:27.702687+0000","last_fullsized":"2024-03-27T07:22:27.702687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:30:28.499338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666292+0000","last_change":"2024-03-27T07:21:35.576918+0000","last_active":"2024-03-27T07:22:27.666292+0000","last_peered":"2024-03-27T07:22:27.666292+0000","last_clean":"2024-03-27T07:22:27.666292+0000","last_became_active":"2024-03-27T07:21:35.576581+0000","last_became_peered":"2024-03-27T07:21:35.576581+0000","last_unstale":"2024-03-27T07:22:27.666292+0000","last_undegraded":"2024-03-27T07:22:27.666292+0000","last_fullsized":"2024-03-27T07:22:27.666292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:31:54.813459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666851+0000","last_change":"2024-03-27T07:21:34.560583+0000","last_active":"2024-03-27T07:22:27.666851+0000","last_peered":"2024-03-27T07:22:27.666851+0000","last_clean":"2024-03-27T07:22:27.666851+0000","last_became_active":"2024-03-27T07:21:34.560257+0000","last_became_peered":"2024-03-27T07:21:34.560257+0000","last_unstale":"2024-03-27T07:22:27.666851+0000","last_undegraded":"2024-03-27T07:22:27.666851+0000","last_fullsized":"2024-03-27T07:22:27.666851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:25:27.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408841+0000","last_change":"2024-03-27T07:21:35.573251+0000","last_active":"2024-03-27T07:22:28.408841+0000","last_peered":"2024-03-27T07:22:28.408841+0000","last_clean":"2024-03-27T07:22:28.408841+0000","last_became_active":"2024-03-27T07:21:35.572890+0000","last_became_peered":"2024-03-27T07:21:35.572890+0000","last_unstale":"2024-03-27T07:22:28.408841+0000","last_undegraded":"2024-03-27T07:22:28.408841+0000","last_fullsized":"2024-03-27T07:22:28.408841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:49.317704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666574+0000","last_change":"2024-03-27T07:21:34.567140+0000","last_active":"2024-03-27T07:22:27.666574+0000","last_peered":"2024-03-27T07:22:27.666574+0000","last_clean":"2024-03-27T07:22:27.666574+0000","last_became_active":"2024-03-27T07:21:34.566689+0000","last_became_peered":"2024-03-27T07:21:34.566689+0000","last_unstale":"2024-03-27T07:22:27.666574+0000","last_undegraded":"2024-03-27T07:22:27.666574+0000","last_fullsized":"2024-03-27T07:22:27.666574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:50:54.656277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.670053+0000","last_change":"2024-03-27T07:21:35.565259+0000","last_active":"2024-03-27T07:22:27.670053+0000","last_peered":"2024-03-27T07:22:27.670053+0000","last_clean":"2024-03-27T07:22:27.670053+0000","last_became_active":"2024-03-27T07:21:35.564954+0000","last_became_peered":"2024-03-27T07:21:35.564954+0000","last_unstale":"2024-03-27T07:22:27.670053+0000","last_undegraded":"2024-03-27T07:22:27.670053+0000","last_fullsized":"2024-03-27T07:22:27.670053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:02.950515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666631+0000","last_change":"2024-03-27T07:21:34.558887+0000","last_active":"2024-03-27T07:22:27.666631+0000","last_peered":"2024-03-27T07:22:27.666631+0000","last_clean":"2024-03-27T07:22:27.666631+0000","last_became_active":"2024-03-27T07:21:34.556689+0000","last_became_peered":"2024-03-27T07:21:34.556689+0000","last_unstale":"2024-03-27T07:22:27.666631+0000","last_undegraded":"2024-03-27T07:22:27.666631+0000","last_fullsized":"2024-03-27T07:22:27.666631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:37.162440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.939017+0000","last_change":"2024-03-27T07:21:35.576346+0000","last_active":"2024-03-27T07:22:27.939017+0000","last_peered":"2024-03-27T07:22:27.939017+0000","last_clean":"2024-03-27T07:22:27.939017+0000","last_became_active":"2024-03-27T07:21:35.572774+0000","last_became_peered":"2024-03-27T07:21:35.572774+0000","last_unstale":"2024-03-27T07:22:27.939017+0000","last_undegraded":"2024-03-27T07:22:27.939017+0000","last_fullsized":"2024-03-27T07:22:27.939017+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:12:44.181603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:46.669017+0000","last_change":"2024-03-27T07:21:34.562208+0000","last_active":"2024-03-27T07:22:46.669017+0000","last_peered":"2024-03-27T07:22:46.669017+0000","last_clean":"2024-03-27T07:22:46.669017+0000","last_became_active":"2024-03-27T07:21:34.561829+0000","last_became_peered":"2024-03-27T07:21:34.561829+0000","last_unstale":"2024-03-27T07:22:46.669017+0000","last_undegraded":"2024-03-27T07:22:46.669017+0000","last_fullsized":"2024-03-27T07:22:46.669017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:01:48.845075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666297+0000","last_change":"2024-03-27T07:21:35.575384+0000","last_active":"2024-03-27T07:22:27.666297+0000","last_peered":"2024-03-27T07:22:27.666297+0000","last_clean":"2024-03-27T07:22:27.666297+0000","last_became_active":"2024-03-27T07:21:35.574928+0000","last_became_peered":"2024-03-27T07:21:35.574928+0000","last_unstale":"2024-03-27T07:22:27.666297+0000","last_undegraded":"2024-03-27T07:22:27.666297+0000","last_fullsized":"2024-03-27T07:22:27.666297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:34.034114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.665030+0000","last_change":"2024-03-27T07:21:34.562791+0000","last_active":"2024-03-27T07:22:27.665030+0000","last_peered":"2024-03-27T07:22:27.665030+0000","last_clean":"2024-03-27T07:22:27.665030+0000","last_became_active":"2024-03-27T07:21:34.562441+0000","last_became_peered":"2024-03-27T07:21:34.562441+0000","last_unstale":"2024-03-27T07:22:27.665030+0000","last_undegraded":"2024-03-27T07:22:27.665030+0000","last_fullsized":"2024-03-27T07:22:27.665030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:44:42.509635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938758+0000","last_change":"2024-03-27T07:21:35.578022+0000","last_active":"2024-03-27T07:22:27.938758+0000","last_peered":"2024-03-27T07:22:27.938758+0000","last_clean":"2024-03-27T07:22:27.938758+0000","last_became_active":"2024-03-27T07:21:35.577665+0000","last_became_peered":"2024-03-27T07:21:35.577665+0000","last_unstale":"2024-03-27T07:22:27.938758+0000","last_undegraded":"2024-03-27T07:22:27.938758+0000","last_fullsized":"2024-03-27T07:22:27.938758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:05:40.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408103+0000","last_change":"2024-03-27T07:21:34.557610+0000","last_active":"2024-03-27T07:22:28.408103+0000","last_peered":"2024-03-27T07:22:28.408103+0000","last_clean":"2024-03-27T07:22:28.408103+0000","last_became_active":"2024-03-27T07:21:34.557295+0000","last_became_peered":"2024-03-27T07:21:34.557295+0000","last_unstale":"2024-03-27T07:22:28.408103+0000","last_undegraded":"2024-03-27T07:22:28.408103+0000","last_fullsized":"2024-03-27T07:22:28.408103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:38:40.291447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666218+0000","last_change":"2024-03-27T07:21:35.568910+0000","last_active":"2024-03-27T07:22:27.666218+0000","last_peered":"2024-03-27T07:22:27.666218+0000","last_clean":"2024-03-27T07:22:27.666218+0000","last_became_active":"2024-03-27T07:21:35.568606+0000","last_became_peered":"2024-03-27T07:21:35.568606+0000","last_unstale":"2024-03-27T07:22:27.666218+0000","last_undegraded":"2024-03-27T07:22:27.666218+0000","last_fullsized":"2024-03-27T07:22:27.666218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:04:54.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938414+0000","last_change":"2024-03-27T07:21:34.563096+0000","last_active":"2024-03-27T07:22:27.938414+0000","last_peered":"2024-03-27T07:22:27.938414+0000","last_clean":"2024-03-27T07:22:27.938414+0000","last_became_active":"2024-03-27T07:21:34.562721+0000","last_became_peered":"2024-03-27T07:21:34.562721+0000","last_unstale":"2024-03-27T07:22:27.938414+0000","last_undegraded":"2024-03-27T07:22:27.938414+0000","last_fullsized":"2024-03-27T07:22:27.938414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:42:43.902139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.667436+0000","last_change":"2024-03-27T07:21:35.571386+0000","last_active":"2024-03-27T07:22:27.667436+0000","last_peered":"2024-03-27T07:22:27.667436+0000","last_clean":"2024-03-27T07:22:27.667436+0000","last_became_active":"2024-03-27T07:21:35.571061+0000","last_became_peered":"2024-03-27T07:21:35.571061+0000","last_unstale":"2024-03-27T07:22:27.667436+0000","last_undegraded":"2024-03-27T07:22:27.667436+0000","last_fullsized":"2024-03-27T07:22:27.667436+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:15:06.887550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":89,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:44.666483+0000","last_change":"2024-03-27T07:21:34.561401+0000","last_active":"2024-03-27T07:22:44.666483+0000","last_peered":"2024-03-27T07:22:44.666483+0000","last_clean":"2024-03-27T07:22:44.666483+0000","last_became_active":"2024-03-27T07:21:34.561071+0000","last_became_peered":"2024-03-27T07:21:34.561071+0000","last_unstale":"2024-03-27T07:22:44.666483+0000","last_undegraded":"2024-03-27T07:22:44.666483+0000","last_fullsized":"2024-03-27T07:22:44.666483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:41.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.670543+0000","last_change":"2024-03-27T07:21:35.561505+0000","last_active":"2024-03-27T07:22:27.670543+0000","last_peered":"2024-03-27T07:22:27.670543+0000","last_clean":"2024-03-27T07:22:27.670543+0000","last_became_active":"2024-03-27T07:21:35.561166+0000","last_became_peered":"2024-03-27T07:21:35.561166+0000","last_unstale":"2024-03-27T07:22:27.670543+0000","last_undegraded":"2024-03-27T07:22:27.670543+0000","last_fullsized":"2024-03-27T07:22:27.670543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:59.179147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.704448+0000","last_change":"2024-03-27T07:22:27.704448+0000","last_active":"2024-03-27T07:22:27.704448+0000","last_peered":"2024-03-27T07:22:27.704448+0000","last_clean":"2024-03-27T07:22:27.704448+0000","last_became_active":"2024-03-27T07:22:27.696496+0000","last_became_peered":"2024-03-27T07:22:27.696496+0000","last_unstale":"2024-03-27T07:22:27.704448+0000","last_undegraded":"2024-03-27T07:22:27.704448+0000","last_fullsized":"2024-03-27T07:22:27.704448+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:05.114224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408810+0000","last_change":"2024-03-27T07:21:35.574795+0000","last_active":"2024-03-27T07:22:28.408810+0000","last_peered":"2024-03-27T07:22:28.408810+0000","last_clean":"2024-03-27T07:22:28.408810+0000","last_became_active":"2024-03-27T07:21:35.574534+0000","last_became_peered":"2024-03-27T07:21:35.574534+0000","last_unstale":"2024-03-27T07:22:28.408810+0000","last_undegraded":"2024-03-27T07:22:28.408810+0000","last_fullsized":"2024-03-27T07:22:28.408810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:46:44.777575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.939062+0000","last_change":"2024-03-27T07:21:34.555772+0000","last_active":"2024-03-27T07:22:27.939062+0000","last_peered":"2024-03-27T07:22:27.939062+0000","last_clean":"2024-03-27T07:22:27.939062+0000","last_became_active":"2024-03-27T07:21:34.555430+0000","last_became_peered":"2024-03-27T07:21:34.555430+0000","last_unstale":"2024-03-27T07:22:27.939062+0000","last_undegraded":"2024-03-27T07:22:27.939062+0000","last_fullsized":"2024-03-27T07:22:27.939062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:11:48.058887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.670156+0000","last_change":"2024-03-27T07:21:35.573184+0000","last_active":"2024-03-27T07:22:27.670156+0000","last_peered":"2024-03-27T07:22:27.670156+0000","last_clean":"2024-03-27T07:22:27.670156+0000","last_became_active":"2024-03-27T07:21:35.572776+0000","last_became_peered":"2024-03-27T07:21:35.572776+0000","last_unstale":"2024-03-27T07:22:27.670156+0000","last_undegraded":"2024-03-27T07:22:27.670156+0000","last_fullsized":"2024-03-27T07:22:27.670156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:03.122229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'28","reported_seq":189,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:45.667530+0000","last_change":"2024-03-27T07:21:34.563221+0000","last_active":"2024-03-27T07:22:45.667530+0000","last_peered":"2024-03-27T07:22:45.667530+0000","last_clean":"2024-03-27T07:22:45.667530+0000","last_became_active":"2024-03-27T07:21:34.562679+0000","last_became_peered":"2024-03-27T07:21:34.562679+0000","last_unstale":"2024-03-27T07:22:45.667530+0000","last_undegraded":"2024-03-27T07:22:45.667530+0000","last_fullsized":"2024-03-27T07:22:45.667530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:59.795906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61046,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":130,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666325+0000","last_change":"2024-03-27T07:21:35.573408+0000","last_active":"2024-03-27T07:22:27.666325+0000","last_peered":"2024-03-27T07:22:27.666325+0000","last_clean":"2024-03-27T07:22:27.666325+0000","last_became_active":"2024-03-27T07:21:35.572912+0000","last_became_peered":"2024-03-27T07:21:35.572912+0000","last_unstale":"2024-03-27T07:22:27.666325+0000","last_undegraded":"2024-03-27T07:22:27.666325+0000","last_fullsized":"2024-03-27T07:22:27.666325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:13.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666665+0000","last_change":"2024-03-27T07:21:34.562237+0000","last_active":"2024-03-27T07:22:27.666665+0000","last_peered":"2024-03-27T07:22:27.666665+0000","last_clean":"2024-03-27T07:22:27.666665+0000","last_became_active":"2024-03-27T07:21:34.561895+0000","last_became_peered":"2024-03-27T07:21:34.561895+0000","last_unstale":"2024-03-27T07:22:27.666665+0000","last_undegraded":"2024-03-27T07:22:27.666665+0000","last_fullsized":"2024-03-27T07:22:27.666665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:39:09.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408121+0000","last_change":"2024-03-27T07:21:35.571870+0000","last_active":"2024-03-27T07:22:28.408121+0000","last_peered":"2024-03-27T07:22:28.408121+0000","last_clean":"2024-03-27T07:22:28.408121+0000","last_became_active":"2024-03-27T07:21:35.571272+0000","last_became_peered":"2024-03-27T07:21:35.571272+0000","last_unstale":"2024-03-27T07:22:28.408121+0000","last_undegraded":"2024-03-27T07:22:28.408121+0000","last_fullsized":"2024-03-27T07:22:28.408121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:08:08.374114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938765+0000","last_change":"2024-03-27T07:21:34.563257+0000","last_active":"2024-03-27T07:22:27.938765+0000","last_peered":"2024-03-27T07:22:27.938765+0000","last_clean":"2024-03-27T07:22:27.938765+0000","last_became_active":"2024-03-27T07:21:34.562777+0000","last_became_peered":"2024-03-27T07:21:34.562777+0000","last_unstale":"2024-03-27T07:22:27.938765+0000","last_undegraded":"2024-03-27T07:22:27.938765+0000","last_fullsized":"2024-03-27T07:22:27.938765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:03.873185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668453+0000","last_change":"2024-03-27T07:21:35.568039+0000","last_active":"2024-03-27T07:22:27.668453+0000","last_peered":"2024-03-27T07:22:27.668453+0000","last_clean":"2024-03-27T07:22:27.668453+0000","last_became_active":"2024-03-27T07:21:35.567680+0000","last_became_peered":"2024-03-27T07:21:35.567680+0000","last_unstale":"2024-03-27T07:22:27.668453+0000","last_undegraded":"2024-03-27T07:22:27.668453+0000","last_fullsized":"2024-03-27T07:22:27.668453+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:51:31.223267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":92,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:45.668993+0000","last_change":"2024-03-27T07:21:34.560885+0000","last_active":"2024-03-27T07:22:45.668993+0000","last_peered":"2024-03-27T07:22:45.668993+0000","last_clean":"2024-03-27T07:22:45.668993+0000","last_became_active":"2024-03-27T07:21:34.560431+0000","last_became_peered":"2024-03-27T07:21:34.560431+0000","last_unstale":"2024-03-27T07:22:45.668993+0000","last_undegraded":"2024-03-27T07:22:45.668993+0000","last_fullsized":"2024-03-27T07:22:45.668993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:19:00.526827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668107+0000","last_change":"2024-03-27T07:21:35.569293+0000","last_active":"2024-03-27T07:22:27.668107+0000","last_peered":"2024-03-27T07:22:27.668107+0000","last_clean":"2024-03-27T07:22:27.668107+0000","last_became_active":"2024-03-27T07:21:35.568962+0000","last_became_peered":"2024-03-27T07:21:35.568962+0000","last_unstale":"2024-03-27T07:22:27.668107+0000","last_undegraded":"2024-03-27T07:22:27.668107+0000","last_fullsized":"2024-03-27T07:22:27.668107+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:14:09.947298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666012+0000","last_change":"2024-03-27T07:21:34.569232+0000","last_active":"2024-03-27T07:22:27.666012+0000","last_peered":"2024-03-27T07:22:27.666012+0000","last_clean":"2024-03-27T07:22:27.666012+0000","last_became_active":"2024-03-27T07:21:34.568900+0000","last_became_peered":"2024-03-27T07:21:34.568900+0000","last_unstale":"2024-03-27T07:22:27.666012+0000","last_undegraded":"2024-03-27T07:22:27.666012+0000","last_fullsized":"2024-03-27T07:22:27.666012+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:27:55.489262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938538+0000","last_change":"2024-03-27T07:21:35.577020+0000","last_active":"2024-03-27T07:22:27.938538+0000","last_peered":"2024-03-27T07:22:27.938538+0000","last_clean":"2024-03-27T07:22:27.938538+0000","last_became_active":"2024-03-27T07:21:35.576696+0000","last_became_peered":"2024-03-27T07:21:35.576696+0000","last_unstale":"2024-03-27T07:22:27.938538+0000","last_undegraded":"2024-03-27T07:22:27.938538+0000","last_fullsized":"2024-03-27T07:22:27.938538+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:37:35.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666399+0000","last_change":"2024-03-27T07:21:34.562496+0000","last_active":"2024-03-27T07:22:27.666399+0000","last_peered":"2024-03-27T07:22:27.666399+0000","last_clean":"2024-03-27T07:22:27.666399+0000","last_became_active":"2024-03-27T07:21:34.562166+0000","last_became_peered":"2024-03-27T07:21:34.562166+0000","last_unstale":"2024-03-27T07:22:27.666399+0000","last_undegraded":"2024-03-27T07:22:27.666399+0000","last_fullsized":"2024-03-27T07:22:27.666399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:38.828496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.696771+0000","last_change":"2024-03-27T07:22:27.696771+0000","last_active":"2024-03-27T07:22:27.696771+0000","last_peered":"2024-03-27T07:22:27.696771+0000","last_clean":"2024-03-27T07:22:27.696771+0000","last_became_active":"2024-03-27T07:22:27.696289+0000","last_became_peered":"2024-03-27T07:22:27.696289+0000","last_unstale":"2024-03-27T07:22:27.696771+0000","last_undegraded":"2024-03-27T07:22:27.696771+0000","last_fullsized":"2024-03-27T07:22:27.696771+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:46.675105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.667875+0000","last_change":"2024-03-27T07:21:34.560289+0000","last_active":"2024-03-27T07:22:27.667875+0000","last_peered":"2024-03-27T07:22:27.667875+0000","last_clean":"2024-03-27T07:22:27.667875+0000","last_became_active":"2024-03-27T07:21:34.559985+0000","last_became_peered":"2024-03-27T07:21:34.559985+0000","last_unstale":"2024-03-27T07:22:27.667875+0000","last_undegraded":"2024-03-27T07:22:27.667875+0000","last_fullsized":"2024-03-27T07:22:27.667875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:45:46.611725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.665029+0000","last_change":"2024-03-27T07:21:35.579626+0000","last_active":"2024-03-27T07:22:27.665029+0000","last_peered":"2024-03-27T07:22:27.665029+0000","last_clean":"2024-03-27T07:22:27.665029+0000","last_became_active":"2024-03-27T07:21:35.579173+0000","last_became_peered":"2024-03-27T07:21:35.579173+0000","last_unstale":"2024-03-27T07:22:27.665029+0000","last_undegraded":"2024-03-27T07:22:27.665029+0000","last_fullsized":"2024-03-27T07:22:27.665029+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:56:48.015958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668261+0000","last_change":"2024-03-27T07:21:34.568216+0000","last_active":"2024-03-27T07:22:27.668261+0000","last_peered":"2024-03-27T07:22:27.668261+0000","last_clean":"2024-03-27T07:22:27.668261+0000","last_became_active":"2024-03-27T07:21:34.567468+0000","last_became_peered":"2024-03-27T07:21:34.567468+0000","last_unstale":"2024-03-27T07:22:27.668261+0000","last_undegraded":"2024-03-27T07:22:27.668261+0000","last_fullsized":"2024-03-27T07:22:27.668261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:44:50.359865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.665276+0000","last_change":"2024-03-27T07:21:35.574614+0000","last_active":"2024-03-27T07:22:27.665276+0000","last_peered":"2024-03-27T07:22:27.665276+0000","last_clean":"2024-03-27T07:22:27.665276+0000","last_became_active":"2024-03-27T07:21:35.574274+0000","last_became_peered":"2024-03-27T07:21:35.574274+0000","last_unstale":"2024-03-27T07:22:27.665276+0000","last_undegraded":"2024-03-27T07:22:27.665276+0000","last_fullsized":"2024-03-27T07:22:27.665276+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:57.744066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938529+0000","last_change":"2024-03-27T07:21:35.573196+0000","last_active":"2024-03-27T07:22:27.938529+0000","last_peered":"2024-03-27T07:22:27.938529+0000","last_clean":"2024-03-27T07:22:27.938529+0000","last_became_active":"2024-03-27T07:21:35.572852+0000","last_became_peered":"2024-03-27T07:21:35.572852+0000","last_unstale":"2024-03-27T07:22:27.938529+0000","last_undegraded":"2024-03-27T07:22:27.938529+0000","last_fullsized":"2024-03-27T07:22:27.938529+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:00.478573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:47.670500+0000","last_change":"2024-03-27T07:21:34.566380+0000","last_active":"2024-03-27T07:22:47.670500+0000","last_peered":"2024-03-27T07:22:47.670500+0000","last_clean":"2024-03-27T07:22:47.670500+0000","last_became_active":"2024-03-27T07:21:34.566034+0000","last_became_peered":"2024-03-27T07:21:34.566034+0000","last_unstale":"2024-03-27T07:22:47.670500+0000","last_undegraded":"2024-03-27T07:22:47.670500+0000","last_fullsized":"2024-03-27T07:22:47.670500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:06.470957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666480+0000","last_change":"2024-03-27T07:21:35.576149+0000","last_active":"2024-03-27T07:22:27.666480+0000","last_peered":"2024-03-27T07:22:27.666480+0000","last_clean":"2024-03-27T07:22:27.666480+0000","last_became_active":"2024-03-27T07:21:35.573628+0000","last_became_peered":"2024-03-27T07:21:35.573628+0000","last_unstale":"2024-03-27T07:22:27.666480+0000","last_undegraded":"2024-03-27T07:22:27.666480+0000","last_fullsized":"2024-03-27T07:22:27.666480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:37:06.571848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.695256+0000","last_change":"2024-03-27T07:21:34.555206+0000","last_active":"2024-03-27T07:22:27.695256+0000","last_peered":"2024-03-27T07:22:27.695256+0000","last_clean":"2024-03-27T07:22:27.695256+0000","last_became_active":"2024-03-27T07:21:34.554789+0000","last_became_peered":"2024-03-27T07:21:34.554789+0000","last_unstale":"2024-03-27T07:22:27.695256+0000","last_undegraded":"2024-03-27T07:22:27.695256+0000","last_fullsized":"2024-03-27T07:22:27.695256+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:24:37.211394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668193+0000","last_change":"2024-03-27T07:20:20.641816+0000","last_active":"2024-03-27T07:22:27.668193+0000","last_peered":"2024-03-27T07:22:27.668193+0000","last_clean":"2024-03-27T07:22:27.668193+0000","last_became_active":"2024-03-27T07:20:20.641398+0000","last_became_peered":"2024-03-27T07:20:20.641398+0000","last_unstale":"2024-03-27T07:22:27.668193+0000","last_undegraded":"2024-03-27T07:22:27.668193+0000","last_fullsized":"2024-03-27T07:22:27.668193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_clean_scrub_stamp":"2024-03-27T07:16:54.496466+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:52:56.728469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.407982+0000","last_change":"2024-03-27T07:21:35.562594+0000","last_active":"2024-03-27T07:22:28.407982+0000","last_peered":"2024-03-27T07:22:28.407982+0000","last_clean":"2024-03-27T07:22:28.407982+0000","last_became_active":"2024-03-27T07:21:35.562287+0000","last_became_peered":"2024-03-27T07:21:35.562287+0000","last_unstale":"2024-03-27T07:22:28.407982+0000","last_undegraded":"2024-03-27T07:22:28.407982+0000","last_fullsized":"2024-03-27T07:22:28.407982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:38:25.172452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668266+0000","last_change":"2024-03-27T07:21:34.564569+0000","last_active":"2024-03-27T07:22:27.668266+0000","last_peered":"2024-03-27T07:22:27.668266+0000","last_clean":"2024-03-27T07:22:27.668266+0000","last_became_active":"2024-03-27T07:21:34.563830+0000","last_became_peered":"2024-03-27T07:21:34.563830+0000","last_unstale":"2024-03-27T07:22:27.668266+0000","last_undegraded":"2024-03-27T07:22:27.668266+0000","last_fullsized":"2024-03-27T07:22:27.668266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:46:19.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666421+0000","last_change":"2024-03-27T07:21:34.569447+0000","last_active":"2024-03-27T07:22:27.666421+0000","last_peered":"2024-03-27T07:22:27.666421+0000","last_clean":"2024-03-27T07:22:27.666421+0000","last_became_active":"2024-03-27T07:21:34.569096+0000","last_became_peered":"2024-03-27T07:21:34.569096+0000","last_unstale":"2024-03-27T07:22:27.666421+0000","last_undegraded":"2024-03-27T07:22:27.666421+0000","last_fullsized":"2024-03-27T07:22:27.666421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:49:00.695556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408221+0000","last_change":"2024-03-27T07:21:35.558620+0000","last_active":"2024-03-27T07:22:28.408221+0000","last_peered":"2024-03-27T07:22:28.408221+0000","last_clean":"2024-03-27T07:22:28.408221+0000","last_became_active":"2024-03-27T07:21:35.557559+0000","last_became_peered":"2024-03-27T07:21:35.557559+0000","last_unstale":"2024-03-27T07:22:28.408221+0000","last_undegraded":"2024-03-27T07:22:28.408221+0000","last_fullsized":"2024-03-27T07:22:28.408221+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:09:03.236893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'8","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.674005+0000","last_change":"2024-03-27T07:22:27.674005+0000","last_active":"2024-03-27T07:22:27.674005+0000","last_peered":"2024-03-27T07:22:27.674005+0000","last_clean":"2024-03-27T07:22:27.674005+0000","last_became_active":"2024-03-27T07:22:27.670596+0000","last_became_peered":"2024-03-27T07:22:27.670596+0000","last_unstale":"2024-03-27T07:22:27.674005+0000","last_undegraded":"2024-03-27T07:22:27.674005+0000","last_fullsized":"2024-03-27T07:22:27.674005+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:38:43.398885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666911+0000","last_change":"2024-03-27T07:21:35.573345+0000","last_active":"2024-03-27T07:22:27.666911+0000","last_peered":"2024-03-27T07:22:27.666911+0000","last_clean":"2024-03-27T07:22:27.666911+0000","last_became_active":"2024-03-27T07:21:35.573037+0000","last_became_peered":"2024-03-27T07:21:35.573037+0000","last_unstale":"2024-03-27T07:22:27.666911+0000","last_undegraded":"2024-03-27T07:22:27.666911+0000","last_fullsized":"2024-03-27T07:22:27.666911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:07:49.834272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.695526+0000","last_change":"2024-03-27T07:21:34.558738+0000","last_active":"2024-03-27T07:22:27.695526+0000","last_peered":"2024-03-27T07:22:27.695526+0000","last_clean":"2024-03-27T07:22:27.695526+0000","last_became_active":"2024-03-27T07:21:34.558353+0000","last_became_peered":"2024-03-27T07:21:34.558353+0000","last_unstale":"2024-03-27T07:22:27.695526+0000","last_undegraded":"2024-03-27T07:22:27.695526+0000","last_fullsized":"2024-03-27T07:22:27.695526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:46:07.816121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408732+0000","last_change":"2024-03-27T07:21:35.575747+0000","last_active":"2024-03-27T07:22:28.408732+0000","last_peered":"2024-03-27T07:22:28.408732+0000","last_clean":"2024-03-27T07:22:28.408732+0000","last_became_active":"2024-03-27T07:21:35.575382+0000","last_became_peered":"2024-03-27T07:21:35.575382+0000","last_unstale":"2024-03-27T07:22:28.408732+0000","last_undegraded":"2024-03-27T07:22:28.408732+0000","last_fullsized":"2024-03-27T07:22:28.408732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:10:03.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.669858+0000","last_change":"2024-03-27T07:21:34.563713+0000","last_active":"2024-03-27T07:22:27.669858+0000","last_peered":"2024-03-27T07:22:27.669858+0000","last_clean":"2024-03-27T07:22:27.669858+0000","last_became_active":"2024-03-27T07:21:34.563356+0000","last_became_peered":"2024-03-27T07:21:34.563356+0000","last_unstale":"2024-03-27T07:22:27.669858+0000","last_undegraded":"2024-03-27T07:22:27.669858+0000","last_fullsized":"2024-03-27T07:22:27.669858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:48:11.366029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666139+0000","last_change":"2024-03-27T07:21:35.569912+0000","last_active":"2024-03-27T07:22:27.666139+0000","last_peered":"2024-03-27T07:22:27.666139+0000","last_clean":"2024-03-27T07:22:27.666139+0000","last_became_active":"2024-03-27T07:21:35.569546+0000","last_became_peered":"2024-03-27T07:21:35.569546+0000","last_unstale":"2024-03-27T07:22:27.666139+0000","last_undegraded":"2024-03-27T07:22:27.666139+0000","last_fullsized":"2024-03-27T07:22:27.666139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:45:18.146654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666414+0000","last_change":"2024-03-27T07:21:34.557719+0000","last_active":"2024-03-27T07:22:27.666414+0000","last_peered":"2024-03-27T07:22:27.666414+0000","last_clean":"2024-03-27T07:22:27.666414+0000","last_became_active":"2024-03-27T07:21:34.557360+0000","last_became_peered":"2024-03-27T07:21:34.557360+0000","last_unstale":"2024-03-27T07:22:27.666414+0000","last_undegraded":"2024-03-27T07:22:27.666414+0000","last_fullsized":"2024-03-27T07:22:27.666414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:24:47.002674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664218+0000","last_change":"2024-03-27T07:21:35.578259+0000","last_active":"2024-03-27T07:22:27.664218+0000","last_peered":"2024-03-27T07:22:27.664218+0000","last_clean":"2024-03-27T07:22:27.664218+0000","last_became_active":"2024-03-27T07:21:35.574765+0000","last_became_peered":"2024-03-27T07:21:35.574765+0000","last_unstale":"2024-03-27T07:22:27.664218+0000","last_undegraded":"2024-03-27T07:22:27.664218+0000","last_fullsized":"2024-03-27T07:22:27.664218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:34:49.358416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.671569+0000","last_change":"2024-03-27T07:22:27.671151+0000","last_active":"2024-03-27T07:22:27.671569+0000","last_peered":"2024-03-27T07:22:27.671569+0000","last_clean":"2024-03-27T07:22:27.671569+0000","last_became_active":"2024-03-27T07:22:27.667575+0000","last_became_peered":"2024-03-27T07:22:27.667575+0000","last_unstale":"2024-03-27T07:22:27.671569+0000","last_undegraded":"2024-03-27T07:22:27.671569+0000","last_fullsized":"2024-03-27T07:22:27.671569+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:20:51.954730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666804+0000","last_change":"2024-03-27T07:21:35.577445+0000","last_active":"2024-03-27T07:22:27.666804+0000","last_peered":"2024-03-27T07:22:27.666804+0000","last_clean":"2024-03-27T07:22:27.666804+0000","last_became_active":"2024-03-27T07:21:35.577110+0000","last_became_peered":"2024-03-27T07:21:35.577110+0000","last_unstale":"2024-03-27T07:22:27.666804+0000","last_undegraded":"2024-03-27T07:22:27.666804+0000","last_fullsized":"2024-03-27T07:22:27.666804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:36:45.919519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666360+0000","last_change":"2024-03-27T07:21:34.567744+0000","last_active":"2024-03-27T07:22:27.666360+0000","last_peered":"2024-03-27T07:22:27.666360+0000","last_clean":"2024-03-27T07:22:27.666360+0000","last_became_active":"2024-03-27T07:21:34.567412+0000","last_became_peered":"2024-03-27T07:21:34.567412+0000","last_unstale":"2024-03-27T07:22:27.666360+0000","last_undegraded":"2024-03-27T07:22:27.666360+0000","last_fullsized":"2024-03-27T07:22:27.666360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:37:07.075048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668417+0000","last_change":"2024-03-27T07:21:35.570287+0000","last_active":"2024-03-27T07:22:27.668417+0000","last_peered":"2024-03-27T07:22:27.668417+0000","last_clean":"2024-03-27T07:22:27.668417+0000","last_became_active":"2024-03-27T07:21:35.569194+0000","last_became_peered":"2024-03-27T07:21:35.569194+0000","last_unstale":"2024-03-27T07:22:27.668417+0000","last_undegraded":"2024-03-27T07:22:27.668417+0000","last_fullsized":"2024-03-27T07:22:27.668417+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:01:44.155291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666937+0000","last_change":"2024-03-27T07:21:34.561420+0000","last_active":"2024-03-27T07:22:27.666937+0000","last_peered":"2024-03-27T07:22:27.666937+0000","last_clean":"2024-03-27T07:22:27.666937+0000","last_became_active":"2024-03-27T07:21:34.560923+0000","last_became_peered":"2024-03-27T07:21:34.560923+0000","last_unstale":"2024-03-27T07:22:27.666937+0000","last_undegraded":"2024-03-27T07:22:27.666937+0000","last_fullsized":"2024-03-27T07:22:27.666937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:39:48.256790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668647+0000","last_change":"2024-03-27T07:21:35.571317+0000","last_active":"2024-03-27T07:22:27.668647+0000","last_peered":"2024-03-27T07:22:27.668647+0000","last_clean":"2024-03-27T07:22:27.668647+0000","last_became_active":"2024-03-27T07:21:35.570237+0000","last_became_peered":"2024-03-27T07:21:35.570237+0000","last_unstale":"2024-03-27T07:22:27.668647+0000","last_undegraded":"2024-03-27T07:22:27.668647+0000","last_fullsized":"2024-03-27T07:22:27.668647+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:09:53.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938914+0000","last_change":"2024-03-27T07:21:34.553377+0000","last_active":"2024-03-27T07:22:27.938914+0000","last_peered":"2024-03-27T07:22:27.938914+0000","last_clean":"2024-03-27T07:22:27.938914+0000","last_became_active":"2024-03-27T07:21:34.553050+0000","last_became_peered":"2024-03-27T07:21:34.553050+0000","last_unstale":"2024-03-27T07:22:27.938914+0000","last_undegraded":"2024-03-27T07:22:27.938914+0000","last_fullsized":"2024-03-27T07:22:27.938914+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:03.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668394+0000","last_change":"2024-03-27T07:21:35.572384+0000","last_active":"2024-03-27T07:22:27.668394+0000","last_peered":"2024-03-27T07:22:27.668394+0000","last_clean":"2024-03-27T07:22:27.668394+0000","last_became_active":"2024-03-27T07:21:35.572071+0000","last_became_peered":"2024-03-27T07:21:35.572071+0000","last_unstale":"2024-03-27T07:22:27.668394+0000","last_undegraded":"2024-03-27T07:22:27.668394+0000","last_fullsized":"2024-03-27T07:22:27.668394+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:03:04.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408306+0000","last_change":"2024-03-27T07:21:34.559187+0000","last_active":"2024-03-27T07:22:28.408306+0000","last_peered":"2024-03-27T07:22:28.408306+0000","last_clean":"2024-03-27T07:22:28.408306+0000","last_became_active":"2024-03-27T07:21:34.558675+0000","last_became_peered":"2024-03-27T07:21:34.558675+0000","last_unstale":"2024-03-27T07:22:28.408306+0000","last_undegraded":"2024-03-27T07:22:28.408306+0000","last_fullsized":"2024-03-27T07:22:28.408306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:41.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668781+0000","last_change":"2024-03-27T07:21:35.576440+0000","last_active":"2024-03-27T07:22:27.668781+0000","last_peered":"2024-03-27T07:22:27.668781+0000","last_clean":"2024-03-27T07:22:27.668781+0000","last_became_active":"2024-03-27T07:21:35.576143+0000","last_became_peered":"2024-03-27T07:21:35.576143+0000","last_unstale":"2024-03-27T07:22:27.668781+0000","last_undegraded":"2024-03-27T07:22:27.668781+0000","last_fullsized":"2024-03-27T07:22:27.668781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:31:29.400053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664282+0000","last_change":"2024-03-27T07:21:35.565760+0000","last_active":"2024-03-27T07:22:27.664282+0000","last_peered":"2024-03-27T07:22:27.664282+0000","last_clean":"2024-03-27T07:22:27.664282+0000","last_became_active":"2024-03-27T07:21:35.565351+0000","last_became_peered":"2024-03-27T07:21:35.565351+0000","last_unstale":"2024-03-27T07:22:27.664282+0000","last_undegraded":"2024-03-27T07:22:27.664282+0000","last_fullsized":"2024-03-27T07:22:27.664282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:16.871912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666312+0000","last_change":"2024-03-27T07:21:35.564100+0000","last_active":"2024-03-27T07:22:27.666312+0000","last_peered":"2024-03-27T07:22:27.666312+0000","last_clean":"2024-03-27T07:22:27.666312+0000","last_became_active":"2024-03-27T07:21:35.563748+0000","last_became_peered":"2024-03-27T07:21:35.563748+0000","last_unstale":"2024-03-27T07:22:27.666312+0000","last_undegraded":"2024-03-27T07:22:27.666312+0000","last_fullsized":"2024-03-27T07:22:27.666312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:19:30.742692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666144+0000","last_change":"2024-03-27T07:21:35.575036+0000","last_active":"2024-03-27T07:22:27.666144+0000","last_peered":"2024-03-27T07:22:27.666144+0000","last_clean":"2024-03-27T07:22:27.666144+0000","last_became_active":"2024-03-27T07:21:35.574689+0000","last_became_peered":"2024-03-27T07:21:35.574689+0000","last_unstale":"2024-03-27T07:22:27.666144+0000","last_undegraded":"2024-03-27T07:22:27.666144+0000","last_fullsized":"2024-03-27T07:22:27.666144+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:50:40.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408602+0000","last_change":"2024-03-27T07:21:35.577814+0000","last_active":"2024-03-27T07:22:28.408602+0000","last_peered":"2024-03-27T07:22:28.408602+0000","last_clean":"2024-03-27T07:22:28.408602+0000","last_became_active":"2024-03-27T07:21:35.576265+0000","last_became_peered":"2024-03-27T07:21:35.576265+0000","last_unstale":"2024-03-27T07:22:28.408602+0000","last_undegraded":"2024-03-27T07:22:28.408602+0000","last_fullsized":"2024-03-27T07:22:28.408602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:04.523768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408270+0000","last_change":"2024-03-27T07:21:35.568753+0000","last_active":"2024-03-27T07:22:28.408270+0000","last_peered":"2024-03-27T07:22:28.408270+0000","last_clean":"2024-03-27T07:22:28.408270+0000","last_became_active":"2024-03-27T07:21:35.568441+0000","last_became_peered":"2024-03-27T07:21:35.568441+0000","last_unstale":"2024-03-27T07:22:28.408270+0000","last_undegraded":"2024-03-27T07:22:28.408270+0000","last_fullsized":"2024-03-27T07:22:28.408270+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:32:54.294960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664441+0000","last_change":"2024-03-27T07:21:35.573094+0000","last_active":"2024-03-27T07:22:27.664441+0000","last_peered":"2024-03-27T07:22:27.664441+0000","last_clean":"2024-03-27T07:22:27.664441+0000","last_became_active":"2024-03-27T07:21:35.572739+0000","last_became_peered":"2024-03-27T07:21:35.572739+0000","last_unstale":"2024-03-27T07:22:27.664441+0000","last_undegraded":"2024-03-27T07:22:27.664441+0000","last_fullsized":"2024-03-27T07:22:27.664441+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:02.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.667200+0000","last_change":"2024-03-27T07:21:35.580647+0000","last_active":"2024-03-27T07:22:27.667200+0000","last_peered":"2024-03-27T07:22:27.667200+0000","last_clean":"2024-03-27T07:22:27.667200+0000","last_became_active":"2024-03-27T07:21:35.580230+0000","last_became_peered":"2024-03-27T07:21:35.580230+0000","last_unstale":"2024-03-27T07:22:27.667200+0000","last_undegraded":"2024-03-27T07:22:27.667200+0000","last_fullsized":"2024-03-27T07:22:27.667200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:04:37.573021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666787+0000","last_change":"2024-03-27T07:21:35.568859+0000","last_active":"2024-03-27T07:22:27.666787+0000","last_peered":"2024-03-27T07:22:27.666787+0000","last_clean":"2024-03-27T07:22:27.666787+0000","last_became_active":"2024-03-27T07:21:35.568468+0000","last_became_peered":"2024-03-27T07:21:35.568468+0000","last_unstale":"2024-03-27T07:22:27.666787+0000","last_undegraded":"2024-03-27T07:22:27.666787+0000","last_fullsized":"2024-03-27T07:22:27.666787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:44:59.875882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938458+0000","last_change":"2024-03-27T07:21:35.568485+0000","last_active":"2024-03-27T07:22:27.938458+0000","last_peered":"2024-03-27T07:22:27.938458+0000","last_clean":"2024-03-27T07:22:27.938458+0000","last_became_active":"2024-03-27T07:21:35.568154+0000","last_became_peered":"2024-03-27T07:21:35.568154+0000","last_unstale":"2024-03-27T07:22:27.938458+0000","last_undegraded":"2024-03-27T07:22:27.938458+0000","last_fullsized":"2024-03-27T07:22:27.938458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:08:29.418189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666303+0000","last_change":"2024-03-27T07:21:35.567369+0000","last_active":"2024-03-27T07:22:27.666303+0000","last_peered":"2024-03-27T07:22:27.666303+0000","last_clean":"2024-03-27T07:22:27.666303+0000","last_became_active":"2024-03-27T07:21:35.564602+0000","last_became_peered":"2024-03-27T07:21:35.564602+0000","last_unstale":"2024-03-27T07:22:27.666303+0000","last_undegraded":"2024-03-27T07:22:27.666303+0000","last_fullsized":"2024-03-27T07:22:27.666303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:23:15.123502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.670246+0000","last_change":"2024-03-27T07:21:35.572580+0000","last_active":"2024-03-27T07:22:27.670246+0000","last_peered":"2024-03-27T07:22:27.670246+0000","last_clean":"2024-03-27T07:22:27.670246+0000","last_became_active":"2024-03-27T07:21:35.572245+0000","last_became_peered":"2024-03-27T07:21:35.572245+0000","last_unstale":"2024-03-27T07:22:27.670246+0000","last_undegraded":"2024-03-27T07:22:27.670246+0000","last_fullsized":"2024-03-27T07:22:27.670246+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:45:56.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408272+0000","last_change":"2024-03-27T07:21:35.584975+0000","last_active":"2024-03-27T07:22:28.408272+0000","last_peered":"2024-03-27T07:22:28.408272+0000","last_clean":"2024-03-27T07:22:28.408272+0000","last_became_active":"2024-03-27T07:21:35.584579+0000","last_became_peered":"2024-03-27T07:21:35.584579+0000","last_unstale":"2024-03-27T07:22:28.408272+0000","last_undegraded":"2024-03-27T07:22:28.408272+0000","last_fullsized":"2024-03-27T07:22:28.408272+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:22:44.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664339+0000","last_change":"2024-03-27T07:21:35.573496+0000","last_active":"2024-03-27T07:22:27.664339+0000","last_peered":"2024-03-27T07:22:27.664339+0000","last_clean":"2024-03-27T07:22:27.664339+0000","last_became_active":"2024-03-27T07:21:35.572946+0000","last_became_peered":"2024-03-27T07:21:35.572946+0000","last_unstale":"2024-03-27T07:22:27.664339+0000","last_undegraded":"2024-03-27T07:22:27.664339+0000","last_fullsized":"2024-03-27T07:22:27.664339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:37:50.236828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280632,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65047,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":435,"num_read_kb":286,"num_write":156,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":582,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":195141,"data_compressed":5607,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351004,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":954368,"data_stored":461452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612641,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1101824,"data_stored":1113979,"data_compressed":37563,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":970752,"data_stored":461688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037804,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":461026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":1053538,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":461077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":521916,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":978944,"data_stored":462348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1040384,"data_stored":523657,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":461388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920833,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":462096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757307,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":1053222,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61046,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62787,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":62624,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T07:22:52.096 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph pg dump --format=json 2024-03-27T07:22:52.345 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:52.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:52 smithi082 ceph-mon[32178]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:22:52.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:52 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:22:52.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:52 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:22:52.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:52 smithi082 ceph-mon[32178]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:53.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:52 smithi149 ceph-mon[36065]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:22:53.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:52 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:22:53.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:52 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:22:53.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:52 smithi149 ceph-mon[36065]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:53.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:52 smithi153 ceph-mon[36179]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:22:53.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:52 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:22:53.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:52 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:22:53.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:52 smithi153 ceph-mon[36179]: from='mgr.14152 172.21.15.82:0/3746152074' entity='mgr.x' 2024-03-27T07:22:53.798 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:53 smithi082 ceph-mon[32178]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T07:22:54.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:53 smithi149 ceph-mon[36065]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T07:22:54.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.022+0000 7f7c44571700 1 -- 172.21.15.82:0/145926691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c3c101b90 msgr2=0x7f7c3c1072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.022+0000 7f7c44571700 1 --2- 172.21.15.82:0/145926691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c3c101b90 0x7f7c3c1072d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0099c0 tx=0x7f7c2c009cd0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 -- 172.21.15.82:0/145926691 shutdown_connections 2024-03-27T07:22:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 --2- 172.21.15.82:0/145926691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c3c107a00 0x7f7c3c10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 --2- 172.21.15.82:0/145926691 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c3c1011e0 0x7f7c3c1015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 --2- 172.21.15.82:0/145926691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c3c101b90 0x7f7c3c1072d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 -- 172.21.15.82:0/145926691 >> 172.21.15.82:0/145926691 conn(0x7f7c3c076880 msgr2=0x7f7c3c076c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 -- 172.21.15.82:0/145926691 shutdown_connections 2024-03-27T07:22:54.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 -- 172.21.15.82:0/145926691 wait complete. 2024-03-27T07:22:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 Processor -- start 2024-03-27T07:22:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 -- start start 2024-03-27T07:22:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c3c1011e0 0x7f7c3c198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c3c101b90 0x7f7c3c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c3c107a00 0x7f7c3c19d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3c112980 con 0x7f7c3c107a00 2024-03-27T07:22:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3c112800 con 0x7f7c3c101b90 2024-03-27T07:22:54.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.023+0000 7f7c44571700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3c112b00 con 0x7f7c3c1011e0 2024-03-27T07:22:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c42b0e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c3c107a00 0x7f7c3c19d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c42b0e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c3c107a00 0x7f7c3c19d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54346/0 (socket says 172.21.15.82:54346) 2024-03-27T07:22:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c4230d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c3c1011e0 0x7f7c3c198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c41b0c700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c3c101b90 0x7f7c3c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c42b0e700 1 -- 172.21.15.82:0/1271060028 learned_addr learned my addr 172.21.15.82:0/1271060028 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c42b0e700 1 -- 172.21.15.82:0/1271060028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c3c1011e0 msgr2=0x7f7c3c198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c42b0e700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c3c1011e0 0x7f7c3c198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c42b0e700 1 -- 172.21.15.82:0/1271060028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c3c101b90 msgr2=0x7f7c3c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c42b0e700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c3c101b90 0x7f7c3c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c42b0e700 1 -- 172.21.15.82:0/1271060028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3c19de20 con 0x7f7c3c107a00 2024-03-27T07:22:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c42b0e700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c3c107a00 0x7f7c3c19d6e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400ef30 tx=0x7f7c3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c337fe700 1 -- 172.21.15.82:0/1271060028 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c340092e0 con 0x7f7c3c107a00 2024-03-27T07:22:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c44571700 1 -- 172.21.15.82:0/1271060028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3c19e0b0 con 0x7f7c3c107a00 2024-03-27T07:22:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c337fe700 1 -- 172.21.15.82:0/1271060028 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c34004bb0 con 0x7f7c3c107a00 2024-03-27T07:22:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c337fe700 1 -- 172.21.15.82:0/1271060028 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c34004280 con 0x7f7c3c107a00 2024-03-27T07:22:54.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.024+0000 7f7c44571700 1 -- 172.21.15.82:0/1271060028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c3c1a5990 con 0x7f7c3c107a00 2024-03-27T07:22:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.025+0000 7f7c44571700 1 -- 172.21.15.82:0/1271060028 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c3c10ac40 con 0x7f7c3c107a00 2024-03-27T07:22:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.026+0000 7f7c337fe700 1 -- 172.21.15.82:0/1271060028 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f7c3401b030 con 0x7f7c3c107a00 2024-03-27T07:22:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.027+0000 7f7c337fe700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7c280a3730 0x7f7c280a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.027+0000 7f7c4230d700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7c280a3730 0x7f7c280a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.027+0000 7f7c337fe700 1 -- 172.21.15.82:0/1271060028 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f7c340d0280 con 0x7f7c3c107a00 2024-03-27T07:22:54.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.027+0000 7f7c4230d700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7c280a3730 0x7f7c280a5bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009c60 tx=0x7f7c38009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:54.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.031+0000 7f7c337fe700 1 -- 172.21.15.82:0/1271060028 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7c34022020 con 0x7f7c3c107a00 2024-03-27T07:22:54.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:53 smithi153 ceph-mon[36179]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T07:22:54.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.223+0000 7f7c44571700 1 -- 172.21.15.82:0/1271060028 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7c3c062a80 con 0x7f7c280a3730 2024-03-27T07:22:54.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.230+0000 7f7c337fe700 1 -- 172.21.15.82:0/1271060028 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258935 (secure 0 0 0) 0x7f7c3c062a80 con 0x7f7c280a3730 2024-03-27T07:22:54.236 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:22:54.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 -- 172.21.15.82:0/1271060028 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7c280a3730 msgr2=0x7f7c280a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7c280a3730 0x7f7c280a5bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7c38009c60 tx=0x7f7c38009260 comp rx=0 tx=0).stop 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 -- 172.21.15.82:0/1271060028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c3c107a00 msgr2=0x7f7c3c19d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c3c107a00 0x7f7c3c19d6e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400ef30 tx=0x7f7c3400c3a0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 -- 172.21.15.82:0/1271060028 shutdown_connections 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7c280a3730 0x7f7c280a5bf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c3c1011e0 0x7f7c3c198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c3c107a00 0x7f7c3c19d6e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 --2- 172.21.15.82:0/1271060028 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c3c101b90 0x7f7c3c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 -- 172.21.15.82:0/1271060028 >> 172.21.15.82:0/1271060028 conn(0x7f7c3c076880 msgr2=0x7f7c3c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 -- 172.21.15.82:0/1271060028 shutdown_connections 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:54.233+0000 7f7c44571700 1 -- 172.21.15.82:0/1271060028 wait complete. 2024-03-27T07:22:54.238 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-27T07:22:54.898 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-03-27T07:22:52.493452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655649,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":591,"num_read_kb":415,"num_write":339,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181318,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":274,"ondisk_log_size":274,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356764,"kb_used_data":11700,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585060,"statfs":{"total":1151940427776,"available":1151575101440,"internally_reserved":0,"allocated":11980800,"data_stored":7497387,"data_compressed":112689,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19139,"internal_metadata":353154365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002942"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664551+0000","last_change":"2024-03-27T07:21:35.577169+0000","last_active":"2024-03-27T07:22:27.664551+0000","last_peered":"2024-03-27T07:22:27.664551+0000","last_clean":"2024-03-27T07:22:27.664551+0000","last_became_active":"2024-03-27T07:21:35.576737+0000","last_became_peered":"2024-03-27T07:21:35.576737+0000","last_unstale":"2024-03-27T07:22:27.664551+0000","last_undegraded":"2024-03-27T07:22:27.664551+0000","last_fullsized":"2024-03-27T07:22:27.664551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:58:55.152543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408731+0000","last_change":"2024-03-27T07:21:35.576197+0000","last_active":"2024-03-27T07:22:28.408731+0000","last_peered":"2024-03-27T07:22:28.408731+0000","last_clean":"2024-03-27T07:22:28.408731+0000","last_became_active":"2024-03-27T07:21:35.575876+0000","last_became_peered":"2024-03-27T07:21:35.575876+0000","last_unstale":"2024-03-27T07:22:28.408731+0000","last_undegraded":"2024-03-27T07:22:28.408731+0000","last_fullsized":"2024-03-27T07:22:28.408731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:23:12.589029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408769+0000","last_change":"2024-03-27T07:21:35.582045+0000","last_active":"2024-03-27T07:22:28.408769+0000","last_peered":"2024-03-27T07:22:28.408769+0000","last_clean":"2024-03-27T07:22:28.408769+0000","last_became_active":"2024-03-27T07:21:35.581710+0000","last_became_peered":"2024-03-27T07:21:35.581710+0000","last_unstale":"2024-03-27T07:22:28.408769+0000","last_undegraded":"2024-03-27T07:22:28.408769+0000","last_fullsized":"2024-03-27T07:22:28.408769+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:47:39.004986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.672301+0000","last_change":"2024-03-27T07:22:27.670513+0000","last_active":"2024-03-27T07:22:27.672301+0000","last_peered":"2024-03-27T07:22:27.672301+0000","last_clean":"2024-03-27T07:22:27.672301+0000","last_became_active":"2024-03-27T07:22:27.670263+0000","last_became_peered":"2024-03-27T07:22:27.670263+0000","last_unstale":"2024-03-27T07:22:27.672301+0000","last_undegraded":"2024-03-27T07:22:27.672301+0000","last_fullsized":"2024-03-27T07:22:27.672301+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:32:43.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666242+0000","last_change":"2024-03-27T07:21:35.568964+0000","last_active":"2024-03-27T07:22:27.666242+0000","last_peered":"2024-03-27T07:22:27.666242+0000","last_clean":"2024-03-27T07:22:27.666242+0000","last_became_active":"2024-03-27T07:21:35.568607+0000","last_became_peered":"2024-03-27T07:21:35.568607+0000","last_unstale":"2024-03-27T07:22:27.666242+0000","last_undegraded":"2024-03-27T07:22:27.666242+0000","last_fullsized":"2024-03-27T07:22:27.666242+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:26:32.122422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.665021+0000","last_change":"2024-03-27T07:21:35.575915+0000","last_active":"2024-03-27T07:22:27.665021+0000","last_peered":"2024-03-27T07:22:27.665021+0000","last_clean":"2024-03-27T07:22:27.665021+0000","last_became_active":"2024-03-27T07:21:35.575604+0000","last_became_peered":"2024-03-27T07:21:35.575604+0000","last_unstale":"2024-03-27T07:22:27.665021+0000","last_undegraded":"2024-03-27T07:22:27.665021+0000","last_fullsized":"2024-03-27T07:22:27.665021+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:19:12.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668235+0000","last_change":"2024-03-27T07:21:35.570762+0000","last_active":"2024-03-27T07:22:27.668235+0000","last_peered":"2024-03-27T07:22:27.668235+0000","last_clean":"2024-03-27T07:22:27.668235+0000","last_became_active":"2024-03-27T07:21:35.570380+0000","last_became_peered":"2024-03-27T07:21:35.570380+0000","last_unstale":"2024-03-27T07:22:27.668235+0000","last_undegraded":"2024-03-27T07:22:27.668235+0000","last_fullsized":"2024-03-27T07:22:27.668235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:35:04.463674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666164+0000","last_change":"2024-03-27T07:21:35.573220+0000","last_active":"2024-03-27T07:22:27.666164+0000","last_peered":"2024-03-27T07:22:27.666164+0000","last_clean":"2024-03-27T07:22:27.666164+0000","last_became_active":"2024-03-27T07:21:35.572909+0000","last_became_peered":"2024-03-27T07:21:35.572909+0000","last_unstale":"2024-03-27T07:22:27.666164+0000","last_undegraded":"2024-03-27T07:22:27.666164+0000","last_fullsized":"2024-03-27T07:22:27.666164+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:49:51.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.670307+0000","last_change":"2024-03-27T07:21:35.559298+0000","last_active":"2024-03-27T07:22:27.670307+0000","last_peered":"2024-03-27T07:22:27.670307+0000","last_clean":"2024-03-27T07:22:27.670307+0000","last_became_active":"2024-03-27T07:21:35.558968+0000","last_became_peered":"2024-03-27T07:21:35.558968+0000","last_unstale":"2024-03-27T07:22:27.670307+0000","last_undegraded":"2024-03-27T07:22:27.670307+0000","last_fullsized":"2024-03-27T07:22:27.670307+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:12:31.027411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.665161+0000","last_change":"2024-03-27T07:21:35.577015+0000","last_active":"2024-03-27T07:22:27.665161+0000","last_peered":"2024-03-27T07:22:27.665161+0000","last_clean":"2024-03-27T07:22:27.665161+0000","last_became_active":"2024-03-27T07:21:35.576599+0000","last_became_peered":"2024-03-27T07:21:35.576599+0000","last_unstale":"2024-03-27T07:22:27.665161+0000","last_undegraded":"2024-03-27T07:22:27.665161+0000","last_fullsized":"2024-03-27T07:22:27.665161+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:03.138951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668507+0000","last_change":"2024-03-27T07:21:35.576540+0000","last_active":"2024-03-27T07:22:27.668507+0000","last_peered":"2024-03-27T07:22:27.668507+0000","last_clean":"2024-03-27T07:22:27.668507+0000","last_became_active":"2024-03-27T07:21:35.576101+0000","last_became_peered":"2024-03-27T07:21:35.576101+0000","last_unstale":"2024-03-27T07:22:27.668507+0000","last_undegraded":"2024-03-27T07:22:27.668507+0000","last_fullsized":"2024-03-27T07:22:27.668507+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:13.654970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.669626+0000","last_change":"2024-03-27T07:22:27.669089+0000","last_active":"2024-03-27T07:22:27.669626+0000","last_peered":"2024-03-27T07:22:27.669626+0000","last_clean":"2024-03-27T07:22:27.669626+0000","last_became_active":"2024-03-27T07:22:27.668715+0000","last_became_peered":"2024-03-27T07:22:27.668715+0000","last_unstale":"2024-03-27T07:22:27.669626+0000","last_undegraded":"2024-03-27T07:22:27.669626+0000","last_fullsized":"2024-03-27T07:22:27.669626+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:44:33.732968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408472+0000","last_change":"2024-03-27T07:21:35.559726+0000","last_active":"2024-03-27T07:22:28.408472+0000","last_peered":"2024-03-27T07:22:28.408472+0000","last_clean":"2024-03-27T07:22:28.408472+0000","last_became_active":"2024-03-27T07:21:35.559294+0000","last_became_peered":"2024-03-27T07:21:35.559294+0000","last_unstale":"2024-03-27T07:22:28.408472+0000","last_undegraded":"2024-03-27T07:22:28.408472+0000","last_fullsized":"2024-03-27T07:22:28.408472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:27:00.364447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408473+0000","last_change":"2024-03-27T07:21:35.577959+0000","last_active":"2024-03-27T07:22:28.408473+0000","last_peered":"2024-03-27T07:22:28.408473+0000","last_clean":"2024-03-27T07:22:28.408473+0000","last_became_active":"2024-03-27T07:21:35.577642+0000","last_became_peered":"2024-03-27T07:21:35.577642+0000","last_unstale":"2024-03-27T07:22:28.408473+0000","last_undegraded":"2024-03-27T07:22:28.408473+0000","last_fullsized":"2024-03-27T07:22:28.408473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:07:44.836888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408334+0000","last_change":"2024-03-27T07:21:35.580901+0000","last_active":"2024-03-27T07:22:28.408334+0000","last_peered":"2024-03-27T07:22:28.408334+0000","last_clean":"2024-03-27T07:22:28.408334+0000","last_became_active":"2024-03-27T07:21:35.579456+0000","last_became_peered":"2024-03-27T07:21:35.579456+0000","last_unstale":"2024-03-27T07:22:28.408334+0000","last_undegraded":"2024-03-27T07:22:28.408334+0000","last_fullsized":"2024-03-27T07:22:28.408334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:35:54.722160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.669825+0000","last_change":"2024-03-27T07:21:35.574462+0000","last_active":"2024-03-27T07:22:27.669825+0000","last_peered":"2024-03-27T07:22:27.669825+0000","last_clean":"2024-03-27T07:22:27.669825+0000","last_became_active":"2024-03-27T07:21:35.574158+0000","last_became_peered":"2024-03-27T07:21:35.574158+0000","last_unstale":"2024-03-27T07:22:27.669825+0000","last_undegraded":"2024-03-27T07:22:27.669825+0000","last_fullsized":"2024-03-27T07:22:27.669825+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:16:18.756955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664637+0000","last_change":"2024-03-27T07:21:35.576808+0000","last_active":"2024-03-27T07:22:27.664637+0000","last_peered":"2024-03-27T07:22:27.664637+0000","last_clean":"2024-03-27T07:22:27.664637+0000","last_became_active":"2024-03-27T07:21:35.574819+0000","last_became_peered":"2024-03-27T07:21:35.574819+0000","last_unstale":"2024-03-27T07:22:27.664637+0000","last_undegraded":"2024-03-27T07:22:27.664637+0000","last_fullsized":"2024-03-27T07:22:27.664637+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:29:06.137201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668117+0000","last_change":"2024-03-27T07:21:35.570650+0000","last_active":"2024-03-27T07:22:27.668117+0000","last_peered":"2024-03-27T07:22:27.668117+0000","last_clean":"2024-03-27T07:22:27.668117+0000","last_became_active":"2024-03-27T07:21:35.569850+0000","last_became_peered":"2024-03-27T07:21:35.569850+0000","last_unstale":"2024-03-27T07:22:27.668117+0000","last_undegraded":"2024-03-27T07:22:27.668117+0000","last_fullsized":"2024-03-27T07:22:27.668117+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:22:39.829648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666732+0000","last_change":"2024-03-27T07:21:35.566322+0000","last_active":"2024-03-27T07:22:27.666732+0000","last_peered":"2024-03-27T07:22:27.666732+0000","last_clean":"2024-03-27T07:22:27.666732+0000","last_became_active":"2024-03-27T07:21:35.565947+0000","last_became_peered":"2024-03-27T07:21:35.565947+0000","last_unstale":"2024-03-27T07:22:27.666732+0000","last_undegraded":"2024-03-27T07:22:27.666732+0000","last_fullsized":"2024-03-27T07:22:27.666732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:58:34.151735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.702687+0000","last_change":"2024-03-27T07:22:27.702687+0000","last_active":"2024-03-27T07:22:27.702687+0000","last_peered":"2024-03-27T07:22:27.702687+0000","last_clean":"2024-03-27T07:22:27.702687+0000","last_became_active":"2024-03-27T07:22:27.696358+0000","last_became_peered":"2024-03-27T07:22:27.696358+0000","last_unstale":"2024-03-27T07:22:27.702687+0000","last_undegraded":"2024-03-27T07:22:27.702687+0000","last_fullsized":"2024-03-27T07:22:27.702687+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:30:28.499338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666292+0000","last_change":"2024-03-27T07:21:35.576918+0000","last_active":"2024-03-27T07:22:27.666292+0000","last_peered":"2024-03-27T07:22:27.666292+0000","last_clean":"2024-03-27T07:22:27.666292+0000","last_became_active":"2024-03-27T07:21:35.576581+0000","last_became_peered":"2024-03-27T07:21:35.576581+0000","last_unstale":"2024-03-27T07:22:27.666292+0000","last_undegraded":"2024-03-27T07:22:27.666292+0000","last_fullsized":"2024-03-27T07:22:27.666292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:31:54.813459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666851+0000","last_change":"2024-03-27T07:21:34.560583+0000","last_active":"2024-03-27T07:22:27.666851+0000","last_peered":"2024-03-27T07:22:27.666851+0000","last_clean":"2024-03-27T07:22:27.666851+0000","last_became_active":"2024-03-27T07:21:34.560257+0000","last_became_peered":"2024-03-27T07:21:34.560257+0000","last_unstale":"2024-03-27T07:22:27.666851+0000","last_undegraded":"2024-03-27T07:22:27.666851+0000","last_fullsized":"2024-03-27T07:22:27.666851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:25:27.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408841+0000","last_change":"2024-03-27T07:21:35.573251+0000","last_active":"2024-03-27T07:22:28.408841+0000","last_peered":"2024-03-27T07:22:28.408841+0000","last_clean":"2024-03-27T07:22:28.408841+0000","last_became_active":"2024-03-27T07:21:35.572890+0000","last_became_peered":"2024-03-27T07:21:35.572890+0000","last_unstale":"2024-03-27T07:22:28.408841+0000","last_undegraded":"2024-03-27T07:22:28.408841+0000","last_fullsized":"2024-03-27T07:22:28.408841+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:49.317704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666574+0000","last_change":"2024-03-27T07:21:34.567140+0000","last_active":"2024-03-27T07:22:27.666574+0000","last_peered":"2024-03-27T07:22:27.666574+0000","last_clean":"2024-03-27T07:22:27.666574+0000","last_became_active":"2024-03-27T07:21:34.566689+0000","last_became_peered":"2024-03-27T07:21:34.566689+0000","last_unstale":"2024-03-27T07:22:27.666574+0000","last_undegraded":"2024-03-27T07:22:27.666574+0000","last_fullsized":"2024-03-27T07:22:27.666574+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:50:54.656277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.670053+0000","last_change":"2024-03-27T07:21:35.565259+0000","last_active":"2024-03-27T07:22:27.670053+0000","last_peered":"2024-03-27T07:22:27.670053+0000","last_clean":"2024-03-27T07:22:27.670053+0000","last_became_active":"2024-03-27T07:21:35.564954+0000","last_became_peered":"2024-03-27T07:21:35.564954+0000","last_unstale":"2024-03-27T07:22:27.670053+0000","last_undegraded":"2024-03-27T07:22:27.670053+0000","last_fullsized":"2024-03-27T07:22:27.670053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:02.950515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666631+0000","last_change":"2024-03-27T07:21:34.558887+0000","last_active":"2024-03-27T07:22:27.666631+0000","last_peered":"2024-03-27T07:22:27.666631+0000","last_clean":"2024-03-27T07:22:27.666631+0000","last_became_active":"2024-03-27T07:21:34.556689+0000","last_became_peered":"2024-03-27T07:21:34.556689+0000","last_unstale":"2024-03-27T07:22:27.666631+0000","last_undegraded":"2024-03-27T07:22:27.666631+0000","last_fullsized":"2024-03-27T07:22:27.666631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:37.162440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.939017+0000","last_change":"2024-03-27T07:21:35.576346+0000","last_active":"2024-03-27T07:22:27.939017+0000","last_peered":"2024-03-27T07:22:27.939017+0000","last_clean":"2024-03-27T07:22:27.939017+0000","last_became_active":"2024-03-27T07:21:35.572774+0000","last_became_peered":"2024-03-27T07:21:35.572774+0000","last_unstale":"2024-03-27T07:22:27.939017+0000","last_undegraded":"2024-03-27T07:22:27.939017+0000","last_fullsized":"2024-03-27T07:22:27.939017+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:12:44.181603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:46.669017+0000","last_change":"2024-03-27T07:21:34.562208+0000","last_active":"2024-03-27T07:22:46.669017+0000","last_peered":"2024-03-27T07:22:46.669017+0000","last_clean":"2024-03-27T07:22:46.669017+0000","last_became_active":"2024-03-27T07:21:34.561829+0000","last_became_peered":"2024-03-27T07:21:34.561829+0000","last_unstale":"2024-03-27T07:22:46.669017+0000","last_undegraded":"2024-03-27T07:22:46.669017+0000","last_fullsized":"2024-03-27T07:22:46.669017+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:01:48.845075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666297+0000","last_change":"2024-03-27T07:21:35.575384+0000","last_active":"2024-03-27T07:22:27.666297+0000","last_peered":"2024-03-27T07:22:27.666297+0000","last_clean":"2024-03-27T07:22:27.666297+0000","last_became_active":"2024-03-27T07:21:35.574928+0000","last_became_peered":"2024-03-27T07:21:35.574928+0000","last_unstale":"2024-03-27T07:22:27.666297+0000","last_undegraded":"2024-03-27T07:22:27.666297+0000","last_fullsized":"2024-03-27T07:22:27.666297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:34.034114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.665030+0000","last_change":"2024-03-27T07:21:34.562791+0000","last_active":"2024-03-27T07:22:27.665030+0000","last_peered":"2024-03-27T07:22:27.665030+0000","last_clean":"2024-03-27T07:22:27.665030+0000","last_became_active":"2024-03-27T07:21:34.562441+0000","last_became_peered":"2024-03-27T07:21:34.562441+0000","last_unstale":"2024-03-27T07:22:27.665030+0000","last_undegraded":"2024-03-27T07:22:27.665030+0000","last_fullsized":"2024-03-27T07:22:27.665030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:44:42.509635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938758+0000","last_change":"2024-03-27T07:21:35.578022+0000","last_active":"2024-03-27T07:22:27.938758+0000","last_peered":"2024-03-27T07:22:27.938758+0000","last_clean":"2024-03-27T07:22:27.938758+0000","last_became_active":"2024-03-27T07:21:35.577665+0000","last_became_peered":"2024-03-27T07:21:35.577665+0000","last_unstale":"2024-03-27T07:22:27.938758+0000","last_undegraded":"2024-03-27T07:22:27.938758+0000","last_fullsized":"2024-03-27T07:22:27.938758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:05:40.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408103+0000","last_change":"2024-03-27T07:21:34.557610+0000","last_active":"2024-03-27T07:22:28.408103+0000","last_peered":"2024-03-27T07:22:28.408103+0000","last_clean":"2024-03-27T07:22:28.408103+0000","last_became_active":"2024-03-27T07:21:34.557295+0000","last_became_peered":"2024-03-27T07:21:34.557295+0000","last_unstale":"2024-03-27T07:22:28.408103+0000","last_undegraded":"2024-03-27T07:22:28.408103+0000","last_fullsized":"2024-03-27T07:22:28.408103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:38:40.291447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666218+0000","last_change":"2024-03-27T07:21:35.568910+0000","last_active":"2024-03-27T07:22:27.666218+0000","last_peered":"2024-03-27T07:22:27.666218+0000","last_clean":"2024-03-27T07:22:27.666218+0000","last_became_active":"2024-03-27T07:21:35.568606+0000","last_became_peered":"2024-03-27T07:21:35.568606+0000","last_unstale":"2024-03-27T07:22:27.666218+0000","last_undegraded":"2024-03-27T07:22:27.666218+0000","last_fullsized":"2024-03-27T07:22:27.666218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:04:54.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938414+0000","last_change":"2024-03-27T07:21:34.563096+0000","last_active":"2024-03-27T07:22:27.938414+0000","last_peered":"2024-03-27T07:22:27.938414+0000","last_clean":"2024-03-27T07:22:27.938414+0000","last_became_active":"2024-03-27T07:21:34.562721+0000","last_became_peered":"2024-03-27T07:21:34.562721+0000","last_unstale":"2024-03-27T07:22:27.938414+0000","last_undegraded":"2024-03-27T07:22:27.938414+0000","last_fullsized":"2024-03-27T07:22:27.938414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:42:43.902139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.667436+0000","last_change":"2024-03-27T07:21:35.571386+0000","last_active":"2024-03-27T07:22:27.667436+0000","last_peered":"2024-03-27T07:22:27.667436+0000","last_clean":"2024-03-27T07:22:27.667436+0000","last_became_active":"2024-03-27T07:21:35.571061+0000","last_became_peered":"2024-03-27T07:21:35.571061+0000","last_unstale":"2024-03-27T07:22:27.667436+0000","last_undegraded":"2024-03-27T07:22:27.667436+0000","last_fullsized":"2024-03-27T07:22:27.667436+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:15:06.887550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'3","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:49.671727+0000","last_change":"2024-03-27T07:21:34.561401+0000","last_active":"2024-03-27T07:22:49.671727+0000","last_peered":"2024-03-27T07:22:49.671727+0000","last_clean":"2024-03-27T07:22:49.671727+0000","last_became_active":"2024-03-27T07:21:34.561071+0000","last_became_peered":"2024-03-27T07:21:34.561071+0000","last_unstale":"2024-03-27T07:22:49.671727+0000","last_undegraded":"2024-03-27T07:22:49.671727+0000","last_fullsized":"2024-03-27T07:22:49.671727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:41.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.670543+0000","last_change":"2024-03-27T07:21:35.561505+0000","last_active":"2024-03-27T07:22:27.670543+0000","last_peered":"2024-03-27T07:22:27.670543+0000","last_clean":"2024-03-27T07:22:27.670543+0000","last_became_active":"2024-03-27T07:21:35.561166+0000","last_became_peered":"2024-03-27T07:21:35.561166+0000","last_unstale":"2024-03-27T07:22:27.670543+0000","last_undegraded":"2024-03-27T07:22:27.670543+0000","last_fullsized":"2024-03-27T07:22:27.670543+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:59.179147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.704448+0000","last_change":"2024-03-27T07:22:27.704448+0000","last_active":"2024-03-27T07:22:27.704448+0000","last_peered":"2024-03-27T07:22:27.704448+0000","last_clean":"2024-03-27T07:22:27.704448+0000","last_became_active":"2024-03-27T07:22:27.696496+0000","last_became_peered":"2024-03-27T07:22:27.696496+0000","last_unstale":"2024-03-27T07:22:27.704448+0000","last_undegraded":"2024-03-27T07:22:27.704448+0000","last_fullsized":"2024-03-27T07:22:27.704448+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:05.114224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408810+0000","last_change":"2024-03-27T07:21:35.574795+0000","last_active":"2024-03-27T07:22:28.408810+0000","last_peered":"2024-03-27T07:22:28.408810+0000","last_clean":"2024-03-27T07:22:28.408810+0000","last_became_active":"2024-03-27T07:21:35.574534+0000","last_became_peered":"2024-03-27T07:21:35.574534+0000","last_unstale":"2024-03-27T07:22:28.408810+0000","last_undegraded":"2024-03-27T07:22:28.408810+0000","last_fullsized":"2024-03-27T07:22:28.408810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:46:44.777575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.939062+0000","last_change":"2024-03-27T07:21:34.555772+0000","last_active":"2024-03-27T07:22:27.939062+0000","last_peered":"2024-03-27T07:22:27.939062+0000","last_clean":"2024-03-27T07:22:27.939062+0000","last_became_active":"2024-03-27T07:21:34.555430+0000","last_became_peered":"2024-03-27T07:21:34.555430+0000","last_unstale":"2024-03-27T07:22:27.939062+0000","last_undegraded":"2024-03-27T07:22:27.939062+0000","last_fullsized":"2024-03-27T07:22:27.939062+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:11:48.058887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.670156+0000","last_change":"2024-03-27T07:21:35.573184+0000","last_active":"2024-03-27T07:22:27.670156+0000","last_peered":"2024-03-27T07:22:27.670156+0000","last_clean":"2024-03-27T07:22:27.670156+0000","last_became_active":"2024-03-27T07:21:35.572776+0000","last_became_peered":"2024-03-27T07:21:35.572776+0000","last_unstale":"2024-03-27T07:22:27.670156+0000","last_undegraded":"2024-03-27T07:22:27.670156+0000","last_fullsized":"2024-03-27T07:22:27.670156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:03.122229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'28","reported_seq":199,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:50.672767+0000","last_change":"2024-03-27T07:21:34.563221+0000","last_active":"2024-03-27T07:22:50.672767+0000","last_peered":"2024-03-27T07:22:50.672767+0000","last_clean":"2024-03-27T07:22:50.672767+0000","last_became_active":"2024-03-27T07:21:34.562679+0000","last_became_peered":"2024-03-27T07:21:34.562679+0000","last_unstale":"2024-03-27T07:22:50.672767+0000","last_undegraded":"2024-03-27T07:22:50.672767+0000","last_fullsized":"2024-03-27T07:22:50.672767+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:59.795906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61046,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666325+0000","last_change":"2024-03-27T07:21:35.573408+0000","last_active":"2024-03-27T07:22:27.666325+0000","last_peered":"2024-03-27T07:22:27.666325+0000","last_clean":"2024-03-27T07:22:27.666325+0000","last_became_active":"2024-03-27T07:21:35.572912+0000","last_became_peered":"2024-03-27T07:21:35.572912+0000","last_unstale":"2024-03-27T07:22:27.666325+0000","last_undegraded":"2024-03-27T07:22:27.666325+0000","last_fullsized":"2024-03-27T07:22:27.666325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:13.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":26,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666665+0000","last_change":"2024-03-27T07:21:34.562237+0000","last_active":"2024-03-27T07:22:27.666665+0000","last_peered":"2024-03-27T07:22:27.666665+0000","last_clean":"2024-03-27T07:22:27.666665+0000","last_became_active":"2024-03-27T07:21:34.561895+0000","last_became_peered":"2024-03-27T07:21:34.561895+0000","last_unstale":"2024-03-27T07:22:27.666665+0000","last_undegraded":"2024-03-27T07:22:27.666665+0000","last_fullsized":"2024-03-27T07:22:27.666665+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:39:09.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408121+0000","last_change":"2024-03-27T07:21:35.571870+0000","last_active":"2024-03-27T07:22:28.408121+0000","last_peered":"2024-03-27T07:22:28.408121+0000","last_clean":"2024-03-27T07:22:28.408121+0000","last_became_active":"2024-03-27T07:21:35.571272+0000","last_became_peered":"2024-03-27T07:21:35.571272+0000","last_unstale":"2024-03-27T07:22:28.408121+0000","last_undegraded":"2024-03-27T07:22:28.408121+0000","last_fullsized":"2024-03-27T07:22:28.408121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:08:08.374114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938765+0000","last_change":"2024-03-27T07:21:34.563257+0000","last_active":"2024-03-27T07:22:27.938765+0000","last_peered":"2024-03-27T07:22:27.938765+0000","last_clean":"2024-03-27T07:22:27.938765+0000","last_became_active":"2024-03-27T07:21:34.562777+0000","last_became_peered":"2024-03-27T07:21:34.562777+0000","last_unstale":"2024-03-27T07:22:27.938765+0000","last_undegraded":"2024-03-27T07:22:27.938765+0000","last_fullsized":"2024-03-27T07:22:27.938765+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:03.873185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668453+0000","last_change":"2024-03-27T07:21:35.568039+0000","last_active":"2024-03-27T07:22:27.668453+0000","last_peered":"2024-03-27T07:22:27.668453+0000","last_clean":"2024-03-27T07:22:27.668453+0000","last_became_active":"2024-03-27T07:21:35.567680+0000","last_became_peered":"2024-03-27T07:21:35.567680+0000","last_unstale":"2024-03-27T07:22:27.668453+0000","last_undegraded":"2024-03-27T07:22:27.668453+0000","last_fullsized":"2024-03-27T07:22:27.668453+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:51:31.223267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'3","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:50.673993+0000","last_change":"2024-03-27T07:21:34.560885+0000","last_active":"2024-03-27T07:22:50.673993+0000","last_peered":"2024-03-27T07:22:50.673993+0000","last_clean":"2024-03-27T07:22:50.673993+0000","last_became_active":"2024-03-27T07:21:34.560431+0000","last_became_peered":"2024-03-27T07:21:34.560431+0000","last_unstale":"2024-03-27T07:22:50.673993+0000","last_undegraded":"2024-03-27T07:22:50.673993+0000","last_fullsized":"2024-03-27T07:22:50.673993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:19:00.526827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668107+0000","last_change":"2024-03-27T07:21:35.569293+0000","last_active":"2024-03-27T07:22:27.668107+0000","last_peered":"2024-03-27T07:22:27.668107+0000","last_clean":"2024-03-27T07:22:27.668107+0000","last_became_active":"2024-03-27T07:21:35.568962+0000","last_became_peered":"2024-03-27T07:21:35.568962+0000","last_unstale":"2024-03-27T07:22:27.668107+0000","last_undegraded":"2024-03-27T07:22:27.668107+0000","last_fullsized":"2024-03-27T07:22:27.668107+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:14:09.947298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":35,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666012+0000","last_change":"2024-03-27T07:21:34.569232+0000","last_active":"2024-03-27T07:22:27.666012+0000","last_peered":"2024-03-27T07:22:27.666012+0000","last_clean":"2024-03-27T07:22:27.666012+0000","last_became_active":"2024-03-27T07:21:34.568900+0000","last_became_peered":"2024-03-27T07:21:34.568900+0000","last_unstale":"2024-03-27T07:22:27.666012+0000","last_undegraded":"2024-03-27T07:22:27.666012+0000","last_fullsized":"2024-03-27T07:22:27.666012+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:27:55.489262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938538+0000","last_change":"2024-03-27T07:21:35.577020+0000","last_active":"2024-03-27T07:22:27.938538+0000","last_peered":"2024-03-27T07:22:27.938538+0000","last_clean":"2024-03-27T07:22:27.938538+0000","last_became_active":"2024-03-27T07:21:35.576696+0000","last_became_peered":"2024-03-27T07:21:35.576696+0000","last_unstale":"2024-03-27T07:22:27.938538+0000","last_undegraded":"2024-03-27T07:22:27.938538+0000","last_fullsized":"2024-03-27T07:22:27.938538+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:37:35.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666399+0000","last_change":"2024-03-27T07:21:34.562496+0000","last_active":"2024-03-27T07:22:27.666399+0000","last_peered":"2024-03-27T07:22:27.666399+0000","last_clean":"2024-03-27T07:22:27.666399+0000","last_became_active":"2024-03-27T07:21:34.562166+0000","last_became_peered":"2024-03-27T07:21:34.562166+0000","last_unstale":"2024-03-27T07:22:27.666399+0000","last_undegraded":"2024-03-27T07:22:27.666399+0000","last_fullsized":"2024-03-27T07:22:27.666399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:38.828496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.696771+0000","last_change":"2024-03-27T07:22:27.696771+0000","last_active":"2024-03-27T07:22:27.696771+0000","last_peered":"2024-03-27T07:22:27.696771+0000","last_clean":"2024-03-27T07:22:27.696771+0000","last_became_active":"2024-03-27T07:22:27.696289+0000","last_became_peered":"2024-03-27T07:22:27.696289+0000","last_unstale":"2024-03-27T07:22:27.696771+0000","last_undegraded":"2024-03-27T07:22:27.696771+0000","last_fullsized":"2024-03-27T07:22:27.696771+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:46.675105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.667875+0000","last_change":"2024-03-27T07:21:34.560289+0000","last_active":"2024-03-27T07:22:27.667875+0000","last_peered":"2024-03-27T07:22:27.667875+0000","last_clean":"2024-03-27T07:22:27.667875+0000","last_became_active":"2024-03-27T07:21:34.559985+0000","last_became_peered":"2024-03-27T07:21:34.559985+0000","last_unstale":"2024-03-27T07:22:27.667875+0000","last_undegraded":"2024-03-27T07:22:27.667875+0000","last_fullsized":"2024-03-27T07:22:27.667875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:45:46.611725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.665029+0000","last_change":"2024-03-27T07:21:35.579626+0000","last_active":"2024-03-27T07:22:27.665029+0000","last_peered":"2024-03-27T07:22:27.665029+0000","last_clean":"2024-03-27T07:22:27.665029+0000","last_became_active":"2024-03-27T07:21:35.579173+0000","last_became_peered":"2024-03-27T07:21:35.579173+0000","last_unstale":"2024-03-27T07:22:27.665029+0000","last_undegraded":"2024-03-27T07:22:27.665029+0000","last_fullsized":"2024-03-27T07:22:27.665029+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:56:48.015958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668261+0000","last_change":"2024-03-27T07:21:34.568216+0000","last_active":"2024-03-27T07:22:27.668261+0000","last_peered":"2024-03-27T07:22:27.668261+0000","last_clean":"2024-03-27T07:22:27.668261+0000","last_became_active":"2024-03-27T07:21:34.567468+0000","last_became_peered":"2024-03-27T07:21:34.567468+0000","last_unstale":"2024-03-27T07:22:27.668261+0000","last_undegraded":"2024-03-27T07:22:27.668261+0000","last_fullsized":"2024-03-27T07:22:27.668261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:44:50.359865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.665276+0000","last_change":"2024-03-27T07:21:35.574614+0000","last_active":"2024-03-27T07:22:27.665276+0000","last_peered":"2024-03-27T07:22:27.665276+0000","last_clean":"2024-03-27T07:22:27.665276+0000","last_became_active":"2024-03-27T07:21:35.574274+0000","last_became_peered":"2024-03-27T07:21:35.574274+0000","last_unstale":"2024-03-27T07:22:27.665276+0000","last_undegraded":"2024-03-27T07:22:27.665276+0000","last_fullsized":"2024-03-27T07:22:27.665276+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:57.744066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938529+0000","last_change":"2024-03-27T07:21:35.573196+0000","last_active":"2024-03-27T07:22:27.938529+0000","last_peered":"2024-03-27T07:22:27.938529+0000","last_clean":"2024-03-27T07:22:27.938529+0000","last_became_active":"2024-03-27T07:21:35.572852+0000","last_became_peered":"2024-03-27T07:21:35.572852+0000","last_unstale":"2024-03-27T07:22:27.938529+0000","last_undegraded":"2024-03-27T07:22:27.938529+0000","last_fullsized":"2024-03-27T07:22:27.938529+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:00.478573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'4","reported_seq":93,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:47.670500+0000","last_change":"2024-03-27T07:21:34.566380+0000","last_active":"2024-03-27T07:22:47.670500+0000","last_peered":"2024-03-27T07:22:47.670500+0000","last_clean":"2024-03-27T07:22:47.670500+0000","last_became_active":"2024-03-27T07:21:34.566034+0000","last_became_peered":"2024-03-27T07:21:34.566034+0000","last_unstale":"2024-03-27T07:22:47.670500+0000","last_undegraded":"2024-03-27T07:22:47.670500+0000","last_fullsized":"2024-03-27T07:22:47.670500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:06.470957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666480+0000","last_change":"2024-03-27T07:21:35.576149+0000","last_active":"2024-03-27T07:22:27.666480+0000","last_peered":"2024-03-27T07:22:27.666480+0000","last_clean":"2024-03-27T07:22:27.666480+0000","last_became_active":"2024-03-27T07:21:35.573628+0000","last_became_peered":"2024-03-27T07:21:35.573628+0000","last_unstale":"2024-03-27T07:22:27.666480+0000","last_undegraded":"2024-03-27T07:22:27.666480+0000","last_fullsized":"2024-03-27T07:22:27.666480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:37:06.571848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.695256+0000","last_change":"2024-03-27T07:21:34.555206+0000","last_active":"2024-03-27T07:22:27.695256+0000","last_peered":"2024-03-27T07:22:27.695256+0000","last_clean":"2024-03-27T07:22:27.695256+0000","last_became_active":"2024-03-27T07:21:34.554789+0000","last_became_peered":"2024-03-27T07:21:34.554789+0000","last_unstale":"2024-03-27T07:22:27.695256+0000","last_undegraded":"2024-03-27T07:22:27.695256+0000","last_fullsized":"2024-03-27T07:22:27.695256+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:24:37.211394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":354,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668193+0000","last_change":"2024-03-27T07:20:20.641816+0000","last_active":"2024-03-27T07:22:27.668193+0000","last_peered":"2024-03-27T07:22:27.668193+0000","last_clean":"2024-03-27T07:22:27.668193+0000","last_became_active":"2024-03-27T07:20:20.641398+0000","last_became_peered":"2024-03-27T07:20:20.641398+0000","last_unstale":"2024-03-27T07:22:27.668193+0000","last_undegraded":"2024-03-27T07:22:27.668193+0000","last_fullsized":"2024-03-27T07:22:27.668193+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_clean_scrub_stamp":"2024-03-27T07:16:54.496466+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:52:56.728469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.407982+0000","last_change":"2024-03-27T07:21:35.562594+0000","last_active":"2024-03-27T07:22:28.407982+0000","last_peered":"2024-03-27T07:22:28.407982+0000","last_clean":"2024-03-27T07:22:28.407982+0000","last_became_active":"2024-03-27T07:21:35.562287+0000","last_became_peered":"2024-03-27T07:21:35.562287+0000","last_unstale":"2024-03-27T07:22:28.407982+0000","last_undegraded":"2024-03-27T07:22:28.407982+0000","last_fullsized":"2024-03-27T07:22:28.407982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:38:25.172452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668266+0000","last_change":"2024-03-27T07:21:34.564569+0000","last_active":"2024-03-27T07:22:27.668266+0000","last_peered":"2024-03-27T07:22:27.668266+0000","last_clean":"2024-03-27T07:22:27.668266+0000","last_became_active":"2024-03-27T07:21:34.563830+0000","last_became_peered":"2024-03-27T07:21:34.563830+0000","last_unstale":"2024-03-27T07:22:27.668266+0000","last_undegraded":"2024-03-27T07:22:27.668266+0000","last_fullsized":"2024-03-27T07:22:27.668266+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:46:19.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666421+0000","last_change":"2024-03-27T07:21:34.569447+0000","last_active":"2024-03-27T07:22:27.666421+0000","last_peered":"2024-03-27T07:22:27.666421+0000","last_clean":"2024-03-27T07:22:27.666421+0000","last_became_active":"2024-03-27T07:21:34.569096+0000","last_became_peered":"2024-03-27T07:21:34.569096+0000","last_unstale":"2024-03-27T07:22:27.666421+0000","last_undegraded":"2024-03-27T07:22:27.666421+0000","last_fullsized":"2024-03-27T07:22:27.666421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:49:00.695556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408221+0000","last_change":"2024-03-27T07:21:35.558620+0000","last_active":"2024-03-27T07:22:28.408221+0000","last_peered":"2024-03-27T07:22:28.408221+0000","last_clean":"2024-03-27T07:22:28.408221+0000","last_became_active":"2024-03-27T07:21:35.557559+0000","last_became_peered":"2024-03-27T07:21:35.557559+0000","last_unstale":"2024-03-27T07:22:28.408221+0000","last_undegraded":"2024-03-27T07:22:28.408221+0000","last_fullsized":"2024-03-27T07:22:28.408221+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:09:03.236893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'8","reported_seq":39,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.674005+0000","last_change":"2024-03-27T07:22:27.674005+0000","last_active":"2024-03-27T07:22:27.674005+0000","last_peered":"2024-03-27T07:22:27.674005+0000","last_clean":"2024-03-27T07:22:27.674005+0000","last_became_active":"2024-03-27T07:22:27.670596+0000","last_became_peered":"2024-03-27T07:22:27.670596+0000","last_unstale":"2024-03-27T07:22:27.674005+0000","last_undegraded":"2024-03-27T07:22:27.674005+0000","last_fullsized":"2024-03-27T07:22:27.674005+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:38:43.398885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666911+0000","last_change":"2024-03-27T07:21:35.573345+0000","last_active":"2024-03-27T07:22:27.666911+0000","last_peered":"2024-03-27T07:22:27.666911+0000","last_clean":"2024-03-27T07:22:27.666911+0000","last_became_active":"2024-03-27T07:21:35.573037+0000","last_became_peered":"2024-03-27T07:21:35.573037+0000","last_unstale":"2024-03-27T07:22:27.666911+0000","last_undegraded":"2024-03-27T07:22:27.666911+0000","last_fullsized":"2024-03-27T07:22:27.666911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:07:49.834272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.695526+0000","last_change":"2024-03-27T07:21:34.558738+0000","last_active":"2024-03-27T07:22:27.695526+0000","last_peered":"2024-03-27T07:22:27.695526+0000","last_clean":"2024-03-27T07:22:27.695526+0000","last_became_active":"2024-03-27T07:21:34.558353+0000","last_became_peered":"2024-03-27T07:21:34.558353+0000","last_unstale":"2024-03-27T07:22:27.695526+0000","last_undegraded":"2024-03-27T07:22:27.695526+0000","last_fullsized":"2024-03-27T07:22:27.695526+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:46:07.816121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408732+0000","last_change":"2024-03-27T07:21:35.575747+0000","last_active":"2024-03-27T07:22:28.408732+0000","last_peered":"2024-03-27T07:22:28.408732+0000","last_clean":"2024-03-27T07:22:28.408732+0000","last_became_active":"2024-03-27T07:21:35.575382+0000","last_became_peered":"2024-03-27T07:21:35.575382+0000","last_unstale":"2024-03-27T07:22:28.408732+0000","last_undegraded":"2024-03-27T07:22:28.408732+0000","last_fullsized":"2024-03-27T07:22:28.408732+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:10:03.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.669858+0000","last_change":"2024-03-27T07:21:34.563713+0000","last_active":"2024-03-27T07:22:27.669858+0000","last_peered":"2024-03-27T07:22:27.669858+0000","last_clean":"2024-03-27T07:22:27.669858+0000","last_became_active":"2024-03-27T07:21:34.563356+0000","last_became_peered":"2024-03-27T07:21:34.563356+0000","last_unstale":"2024-03-27T07:22:27.669858+0000","last_undegraded":"2024-03-27T07:22:27.669858+0000","last_fullsized":"2024-03-27T07:22:27.669858+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:48:11.366029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666139+0000","last_change":"2024-03-27T07:21:35.569912+0000","last_active":"2024-03-27T07:22:27.666139+0000","last_peered":"2024-03-27T07:22:27.666139+0000","last_clean":"2024-03-27T07:22:27.666139+0000","last_became_active":"2024-03-27T07:21:35.569546+0000","last_became_peered":"2024-03-27T07:21:35.569546+0000","last_unstale":"2024-03-27T07:22:27.666139+0000","last_undegraded":"2024-03-27T07:22:27.666139+0000","last_fullsized":"2024-03-27T07:22:27.666139+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:45:18.146654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666414+0000","last_change":"2024-03-27T07:21:34.557719+0000","last_active":"2024-03-27T07:22:27.666414+0000","last_peered":"2024-03-27T07:22:27.666414+0000","last_clean":"2024-03-27T07:22:27.666414+0000","last_became_active":"2024-03-27T07:21:34.557360+0000","last_became_peered":"2024-03-27T07:21:34.557360+0000","last_unstale":"2024-03-27T07:22:27.666414+0000","last_undegraded":"2024-03-27T07:22:27.666414+0000","last_fullsized":"2024-03-27T07:22:27.666414+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:24:47.002674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664218+0000","last_change":"2024-03-27T07:21:35.578259+0000","last_active":"2024-03-27T07:22:27.664218+0000","last_peered":"2024-03-27T07:22:27.664218+0000","last_clean":"2024-03-27T07:22:27.664218+0000","last_became_active":"2024-03-27T07:21:35.574765+0000","last_became_peered":"2024-03-27T07:21:35.574765+0000","last_unstale":"2024-03-27T07:22:27.664218+0000","last_undegraded":"2024-03-27T07:22:27.664218+0000","last_fullsized":"2024-03-27T07:22:27.664218+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:34:49.358416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.671569+0000","last_change":"2024-03-27T07:22:27.671151+0000","last_active":"2024-03-27T07:22:27.671569+0000","last_peered":"2024-03-27T07:22:27.671569+0000","last_clean":"2024-03-27T07:22:27.671569+0000","last_became_active":"2024-03-27T07:22:27.667575+0000","last_became_peered":"2024-03-27T07:22:27.667575+0000","last_unstale":"2024-03-27T07:22:27.671569+0000","last_undegraded":"2024-03-27T07:22:27.671569+0000","last_fullsized":"2024-03-27T07:22:27.671569+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:20:51.954730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666804+0000","last_change":"2024-03-27T07:21:35.577445+0000","last_active":"2024-03-27T07:22:27.666804+0000","last_peered":"2024-03-27T07:22:27.666804+0000","last_clean":"2024-03-27T07:22:27.666804+0000","last_became_active":"2024-03-27T07:21:35.577110+0000","last_became_peered":"2024-03-27T07:21:35.577110+0000","last_unstale":"2024-03-27T07:22:27.666804+0000","last_undegraded":"2024-03-27T07:22:27.666804+0000","last_fullsized":"2024-03-27T07:22:27.666804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:36:45.919519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666360+0000","last_change":"2024-03-27T07:21:34.567744+0000","last_active":"2024-03-27T07:22:27.666360+0000","last_peered":"2024-03-27T07:22:27.666360+0000","last_clean":"2024-03-27T07:22:27.666360+0000","last_became_active":"2024-03-27T07:21:34.567412+0000","last_became_peered":"2024-03-27T07:21:34.567412+0000","last_unstale":"2024-03-27T07:22:27.666360+0000","last_undegraded":"2024-03-27T07:22:27.666360+0000","last_fullsized":"2024-03-27T07:22:27.666360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:37:07.075048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668417+0000","last_change":"2024-03-27T07:21:35.570287+0000","last_active":"2024-03-27T07:22:27.668417+0000","last_peered":"2024-03-27T07:22:27.668417+0000","last_clean":"2024-03-27T07:22:27.668417+0000","last_became_active":"2024-03-27T07:21:35.569194+0000","last_became_peered":"2024-03-27T07:21:35.569194+0000","last_unstale":"2024-03-27T07:22:27.668417+0000","last_undegraded":"2024-03-27T07:22:27.668417+0000","last_fullsized":"2024-03-27T07:22:27.668417+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:01:44.155291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666937+0000","last_change":"2024-03-27T07:21:34.561420+0000","last_active":"2024-03-27T07:22:27.666937+0000","last_peered":"2024-03-27T07:22:27.666937+0000","last_clean":"2024-03-27T07:22:27.666937+0000","last_became_active":"2024-03-27T07:21:34.560923+0000","last_became_peered":"2024-03-27T07:21:34.560923+0000","last_unstale":"2024-03-27T07:22:27.666937+0000","last_undegraded":"2024-03-27T07:22:27.666937+0000","last_fullsized":"2024-03-27T07:22:27.666937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:39:48.256790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668647+0000","last_change":"2024-03-27T07:21:35.571317+0000","last_active":"2024-03-27T07:22:27.668647+0000","last_peered":"2024-03-27T07:22:27.668647+0000","last_clean":"2024-03-27T07:22:27.668647+0000","last_became_active":"2024-03-27T07:21:35.570237+0000","last_became_peered":"2024-03-27T07:21:35.570237+0000","last_unstale":"2024-03-27T07:22:27.668647+0000","last_undegraded":"2024-03-27T07:22:27.668647+0000","last_fullsized":"2024-03-27T07:22:27.668647+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:09:53.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'1","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938914+0000","last_change":"2024-03-27T07:21:34.553377+0000","last_active":"2024-03-27T07:22:27.938914+0000","last_peered":"2024-03-27T07:22:27.938914+0000","last_clean":"2024-03-27T07:22:27.938914+0000","last_became_active":"2024-03-27T07:21:34.553050+0000","last_became_peered":"2024-03-27T07:21:34.553050+0000","last_unstale":"2024-03-27T07:22:27.938914+0000","last_undegraded":"2024-03-27T07:22:27.938914+0000","last_fullsized":"2024-03-27T07:22:27.938914+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:03.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'1","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668394+0000","last_change":"2024-03-27T07:21:35.572384+0000","last_active":"2024-03-27T07:22:27.668394+0000","last_peered":"2024-03-27T07:22:27.668394+0000","last_clean":"2024-03-27T07:22:27.668394+0000","last_became_active":"2024-03-27T07:21:35.572071+0000","last_became_peered":"2024-03-27T07:21:35.572071+0000","last_unstale":"2024-03-27T07:22:27.668394+0000","last_undegraded":"2024-03-27T07:22:27.668394+0000","last_fullsized":"2024-03-27T07:22:27.668394+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:03:04.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408306+0000","last_change":"2024-03-27T07:21:34.559187+0000","last_active":"2024-03-27T07:22:28.408306+0000","last_peered":"2024-03-27T07:22:28.408306+0000","last_clean":"2024-03-27T07:22:28.408306+0000","last_became_active":"2024-03-27T07:21:34.558675+0000","last_became_peered":"2024-03-27T07:21:34.558675+0000","last_unstale":"2024-03-27T07:22:28.408306+0000","last_undegraded":"2024-03-27T07:22:28.408306+0000","last_fullsized":"2024-03-27T07:22:28.408306+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:41.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.668781+0000","last_change":"2024-03-27T07:21:35.576440+0000","last_active":"2024-03-27T07:22:27.668781+0000","last_peered":"2024-03-27T07:22:27.668781+0000","last_clean":"2024-03-27T07:22:27.668781+0000","last_became_active":"2024-03-27T07:21:35.576143+0000","last_became_peered":"2024-03-27T07:21:35.576143+0000","last_unstale":"2024-03-27T07:22:27.668781+0000","last_undegraded":"2024-03-27T07:22:27.668781+0000","last_fullsized":"2024-03-27T07:22:27.668781+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:31:29.400053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664282+0000","last_change":"2024-03-27T07:21:35.565760+0000","last_active":"2024-03-27T07:22:27.664282+0000","last_peered":"2024-03-27T07:22:27.664282+0000","last_clean":"2024-03-27T07:22:27.664282+0000","last_became_active":"2024-03-27T07:21:35.565351+0000","last_became_peered":"2024-03-27T07:21:35.565351+0000","last_unstale":"2024-03-27T07:22:27.664282+0000","last_undegraded":"2024-03-27T07:22:27.664282+0000","last_fullsized":"2024-03-27T07:22:27.664282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:16.871912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666312+0000","last_change":"2024-03-27T07:21:35.564100+0000","last_active":"2024-03-27T07:22:27.666312+0000","last_peered":"2024-03-27T07:22:27.666312+0000","last_clean":"2024-03-27T07:22:27.666312+0000","last_became_active":"2024-03-27T07:21:35.563748+0000","last_became_peered":"2024-03-27T07:21:35.563748+0000","last_unstale":"2024-03-27T07:22:27.666312+0000","last_undegraded":"2024-03-27T07:22:27.666312+0000","last_fullsized":"2024-03-27T07:22:27.666312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:19:30.742692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666144+0000","last_change":"2024-03-27T07:21:35.575036+0000","last_active":"2024-03-27T07:22:27.666144+0000","last_peered":"2024-03-27T07:22:27.666144+0000","last_clean":"2024-03-27T07:22:27.666144+0000","last_became_active":"2024-03-27T07:21:35.574689+0000","last_became_peered":"2024-03-27T07:21:35.574689+0000","last_unstale":"2024-03-27T07:22:27.666144+0000","last_undegraded":"2024-03-27T07:22:27.666144+0000","last_fullsized":"2024-03-27T07:22:27.666144+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:50:40.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408602+0000","last_change":"2024-03-27T07:21:35.577814+0000","last_active":"2024-03-27T07:22:28.408602+0000","last_peered":"2024-03-27T07:22:28.408602+0000","last_clean":"2024-03-27T07:22:28.408602+0000","last_became_active":"2024-03-27T07:21:35.576265+0000","last_became_peered":"2024-03-27T07:21:35.576265+0000","last_unstale":"2024-03-27T07:22:28.408602+0000","last_undegraded":"2024-03-27T07:22:28.408602+0000","last_fullsized":"2024-03-27T07:22:28.408602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:04.523768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408270+0000","last_change":"2024-03-27T07:21:35.568753+0000","last_active":"2024-03-27T07:22:28.408270+0000","last_peered":"2024-03-27T07:22:28.408270+0000","last_clean":"2024-03-27T07:22:28.408270+0000","last_became_active":"2024-03-27T07:21:35.568441+0000","last_became_peered":"2024-03-27T07:21:35.568441+0000","last_unstale":"2024-03-27T07:22:28.408270+0000","last_undegraded":"2024-03-27T07:22:28.408270+0000","last_fullsized":"2024-03-27T07:22:28.408270+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:32:54.294960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664441+0000","last_change":"2024-03-27T07:21:35.573094+0000","last_active":"2024-03-27T07:22:27.664441+0000","last_peered":"2024-03-27T07:22:27.664441+0000","last_clean":"2024-03-27T07:22:27.664441+0000","last_became_active":"2024-03-27T07:21:35.572739+0000","last_became_peered":"2024-03-27T07:21:35.572739+0000","last_unstale":"2024-03-27T07:22:27.664441+0000","last_undegraded":"2024-03-27T07:22:27.664441+0000","last_fullsized":"2024-03-27T07:22:27.664441+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:02.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.667200+0000","last_change":"2024-03-27T07:21:35.580647+0000","last_active":"2024-03-27T07:22:27.667200+0000","last_peered":"2024-03-27T07:22:27.667200+0000","last_clean":"2024-03-27T07:22:27.667200+0000","last_became_active":"2024-03-27T07:21:35.580230+0000","last_became_peered":"2024-03-27T07:21:35.580230+0000","last_unstale":"2024-03-27T07:22:27.667200+0000","last_undegraded":"2024-03-27T07:22:27.667200+0000","last_fullsized":"2024-03-27T07:22:27.667200+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:04:37.573021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666787+0000","last_change":"2024-03-27T07:21:35.568859+0000","last_active":"2024-03-27T07:22:27.666787+0000","last_peered":"2024-03-27T07:22:27.666787+0000","last_clean":"2024-03-27T07:22:27.666787+0000","last_became_active":"2024-03-27T07:21:35.568468+0000","last_became_peered":"2024-03-27T07:21:35.568468+0000","last_unstale":"2024-03-27T07:22:27.666787+0000","last_undegraded":"2024-03-27T07:22:27.666787+0000","last_fullsized":"2024-03-27T07:22:27.666787+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:44:59.875882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.938458+0000","last_change":"2024-03-27T07:21:35.568485+0000","last_active":"2024-03-27T07:22:27.938458+0000","last_peered":"2024-03-27T07:22:27.938458+0000","last_clean":"2024-03-27T07:22:27.938458+0000","last_became_active":"2024-03-27T07:21:35.568154+0000","last_became_peered":"2024-03-27T07:21:35.568154+0000","last_unstale":"2024-03-27T07:22:27.938458+0000","last_undegraded":"2024-03-27T07:22:27.938458+0000","last_fullsized":"2024-03-27T07:22:27.938458+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:08:29.418189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.666303+0000","last_change":"2024-03-27T07:21:35.567369+0000","last_active":"2024-03-27T07:22:27.666303+0000","last_peered":"2024-03-27T07:22:27.666303+0000","last_clean":"2024-03-27T07:22:27.666303+0000","last_became_active":"2024-03-27T07:21:35.564602+0000","last_became_peered":"2024-03-27T07:21:35.564602+0000","last_unstale":"2024-03-27T07:22:27.666303+0000","last_undegraded":"2024-03-27T07:22:27.666303+0000","last_fullsized":"2024-03-27T07:22:27.666303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:23:15.123502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.670246+0000","last_change":"2024-03-27T07:21:35.572580+0000","last_active":"2024-03-27T07:22:27.670246+0000","last_peered":"2024-03-27T07:22:27.670246+0000","last_clean":"2024-03-27T07:22:27.670246+0000","last_became_active":"2024-03-27T07:21:35.572245+0000","last_became_peered":"2024-03-27T07:21:35.572245+0000","last_unstale":"2024-03-27T07:22:27.670246+0000","last_undegraded":"2024-03-27T07:22:27.670246+0000","last_fullsized":"2024-03-27T07:22:27.670246+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:45:56.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:28.408272+0000","last_change":"2024-03-27T07:21:35.584975+0000","last_active":"2024-03-27T07:22:28.408272+0000","last_peered":"2024-03-27T07:22:28.408272+0000","last_clean":"2024-03-27T07:22:28.408272+0000","last_became_active":"2024-03-27T07:21:35.584579+0000","last_became_peered":"2024-03-27T07:21:35.584579+0000","last_unstale":"2024-03-27T07:22:28.408272+0000","last_undegraded":"2024-03-27T07:22:28.408272+0000","last_fullsized":"2024-03-27T07:22:28.408272+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:22:44.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T07:22:27.664339+0000","last_change":"2024-03-27T07:21:35.573496+0000","last_active":"2024-03-27T07:22:27.664339+0000","last_peered":"2024-03-27T07:22:27.664339+0000","last_clean":"2024-03-27T07:22:27.664339+0000","last_became_active":"2024-03-27T07:21:35.572946+0000","last_became_peered":"2024-03-27T07:21:35.572946+0000","last_unstale":"2024-03-27T07:22:27.664339+0000","last_undegraded":"2024-03-27T07:22:27.664339+0000","last_fullsized":"2024-03-27T07:22:27.664339+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:37:50.236828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":280632,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65047,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":455,"num_read_kb":296,"num_write":156,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":582,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":195141,"data_compressed":5607,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":954368,"data_stored":461452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612642,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1101824,"data_stored":1113979,"data_compressed":37563,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776168,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":970752,"data_stored":461688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037805,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":461026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":1053538,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":461077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":521916,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":978944,"data_stored":462348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1040384,"data_stored":523657,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182470,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":974848,"data_stored":461388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920834,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":462096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757307,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":1053222,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34054,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61046,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62787,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":62624,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T07:22:54.902 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-27T07:22:54.903 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-27T07:22:54.903 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-27T07:22:54.903 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph health --format=json 2024-03-27T07:22:55.144 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:22:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:55 smithi082 ceph-mon[32178]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:22:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:55 smithi082 ceph-mon[32178]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:56.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:55 smithi149 ceph-mon[36065]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:22:56.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:55 smithi149 ceph-mon[36065]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:55 smithi153 ceph-mon[36179]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:22:56.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:55 smithi153 ceph-mon[36179]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:22:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.871+0000 7f0448aae700 1 -- 172.21.15.82:0/2622643992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0444101ee0 msgr2=0x7f044410e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.871+0000 7f0448aae700 1 --2- 172.21.15.82:0/2622643992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0444101ee0 0x7f044410e3d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f043c00b0d0 tx=0x7f043c00b3e0 comp rx=0 tx=0).stop 2024-03-27T07:22:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.871+0000 7f0448aae700 1 -- 172.21.15.82:0/2622643992 shutdown_connections 2024-03-27T07:22:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.871+0000 7f0448aae700 1 --2- 172.21.15.82:0/2622643992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0444101ee0 0x7f044410e3d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.871+0000 7f0448aae700 1 --2- 172.21.15.82:0/2622643992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04441064d0 0x7f04441068b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.871+0000 7f0448aae700 1 --2- 172.21.15.82:0/2622643992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0444101520 0x7f04441019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.871+0000 7f0448aae700 1 -- 172.21.15.82:0/2622643992 >> 172.21.15.82:0/2622643992 conn(0x7f0444078550 msgr2=0x7f0444078960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.871+0000 7f0448aae700 1 -- 172.21.15.82:0/2622643992 shutdown_connections 2024-03-27T07:22:56.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.871+0000 7f0448aae700 1 -- 172.21.15.82:0/2622643992 wait complete. 2024-03-27T07:22:56.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.872+0000 7f0448aae700 1 Processor -- start 2024-03-27T07:22:56.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.872+0000 7f0448aae700 1 -- start start 2024-03-27T07:22:56.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.872+0000 7f0448aae700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0444101520 0x7f0444103160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.872+0000 7f0448aae700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0444101ee0 0x7f04441036a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.872+0000 7f0448aae700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04441064d0 0x7f0444103be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.872+0000 7f0448aae700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0444111860 con 0x7f0444101ee0 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.872+0000 7f0448aae700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f04441116e0 con 0x7f04441064d0 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.872+0000 7f0448aae700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f04441119e0 con 0x7f0444101520 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f0441d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0444101ee0 0x7f04441036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f044259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0444101520 0x7f0444103160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f0441d9b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0444101ee0 0x7f04441036a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54366/0 (socket says 172.21.15.82:54366) 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f0441d9b700 1 -- 172.21.15.82:0/3340640289 learned_addr learned my addr 172.21.15.82:0/3340640289 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f0442d9d700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04441064d0 0x7f0444103be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f044259c700 1 -- 172.21.15.82:0/3340640289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04441064d0 msgr2=0x7f0444103be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f044259c700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04441064d0 0x7f0444103be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f044259c700 1 -- 172.21.15.82:0/3340640289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0444101ee0 msgr2=0x7f04441036a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:56.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f044259c700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0444101ee0 0x7f04441036a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f044259c700 1 -- 172.21.15.82:0/3340640289 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04441a72b0 con 0x7f0444101520 2024-03-27T07:22:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f0442d9d700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04441064d0 0x7f0444103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f0441d9b700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0444101ee0 0x7f04441036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f044259c700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0444101520 0x7f0444103160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f043400e9c0 tx=0x7f043400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f04337fe700 1 -- 172.21.15.82:0/3340640289 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434004220 con 0x7f0444101520 2024-03-27T07:22:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f0448aae700 1 -- 172.21.15.82:0/3340640289 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04441a75a0 con 0x7f0444101520 2024-03-27T07:22:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f04337fe700 1 -- 172.21.15.82:0/3340640289 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f04340043c0 con 0x7f0444101520 2024-03-27T07:22:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f04337fe700 1 -- 172.21.15.82:0/3340640289 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0434003cc0 con 0x7f0444101520 2024-03-27T07:22:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.873+0000 7f0448aae700 1 -- 172.21.15.82:0/3340640289 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04441a7b30 con 0x7f0444101520 2024-03-27T07:22:56.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.874+0000 7f0448aae700 1 -- 172.21.15.82:0/3340640289 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0444069300 con 0x7f0444101520 2024-03-27T07:22:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.875+0000 7f04337fe700 1 -- 172.21.15.82:0/3340640289 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 17) ==== 138421+0+0 (secure 0 0 0) 0x7f043400c7c0 con 0x7f0444101520 2024-03-27T07:22:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.876+0000 7f04337fe700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f042c0a3730 0x7f042c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.876+0000 7f0441d9b700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f042c0a3730 0x7f042c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.876+0000 7f04337fe700 1 -- 172.21.15.82:0/3340640289 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f04340d0190 con 0x7f0444101520 2024-03-27T07:22:56.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.876+0000 7f0441d9b700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f042c0a3730 0x7f042c0a5bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0444078ba0 tx=0x7f0438009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:56.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:56.879+0000 7f04337fe700 1 -- 172.21.15.82:0/3340640289 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f043409cc60 con 0x7f0444101520 2024-03-27T07:22:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.122+0000 7f0448aae700 1 -- 172.21.15.82:0/3340640289 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f044402dd30 con 0x7f0444101520 2024-03-27T07:22:57.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.122+0000 7f04337fe700 1 -- 172.21.15.82:0/3340640289 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f043409c560 con 0x7f0444101520 2024-03-27T07:22:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:22:57.126 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-27T07:22:57.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.124+0000 7f0448aae700 1 -- 172.21.15.82:0/3340640289 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f042c0a3730 msgr2=0x7f042c0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.124+0000 7f0448aae700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f042c0a3730 0x7f042c0a5bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0444078ba0 tx=0x7f0438009260 comp rx=0 tx=0).stop 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.125+0000 7f0448aae700 1 -- 172.21.15.82:0/3340640289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0444101520 msgr2=0x7f0444103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.125+0000 7f0448aae700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0444101520 0x7f0444103160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f043400e9c0 tx=0x7f043400ecd0 comp rx=0 tx=0).stop 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.125+0000 7f0448aae700 1 -- 172.21.15.82:0/3340640289 shutdown_connections 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.125+0000 7f0448aae700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f042c0a3730 0x7f042c0a5bf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.125+0000 7f0448aae700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0444101520 0x7f0444103160 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.125+0000 7f0448aae700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f04441064d0 0x7f0444103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.125+0000 7f0448aae700 1 --2- 172.21.15.82:0/3340640289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0444101ee0 0x7f04441036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.125+0000 7f0448aae700 1 -- 172.21.15.82:0/3340640289 >> 172.21.15.82:0/3340640289 conn(0x7f0444078550 msgr2=0x7f044406afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.125+0000 7f0448aae700 1 -- 172.21.15.82:0/3340640289 shutdown_connections 2024-03-27T07:22:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.125+0000 7f0448aae700 1 -- 172.21.15.82:0/3340640289 wait complete. 2024-03-27T07:22:57.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:57 smithi082 ceph-mon[32178]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:22:57.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:57 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3340640289' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-27T07:22:57.774 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-27T07:22:57.775 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:22:57.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.880+0000 7fd424901640 1 -- 172.21.15.82:0/3815741902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420100a70 msgr2=0x7fd420100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:57.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.880+0000 7fd424901640 1 --2- 172.21.15.82:0/3815741902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420100a70 0x7fd420100e90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd410009900 tx=0x7fd41002bc30 comp rx=0 tx=0).stop 2024-03-27T07:22:57.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.880+0000 7fd424901640 1 -- 172.21.15.82:0/3815741902 shutdown_connections 2024-03-27T07:22:57.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.880+0000 7fd424901640 1 --2- 172.21.15.82:0/3815741902 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420102620 0x7fd420108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:57.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.880+0000 7fd424901640 1 --2- 172.21.15.82:0/3815741902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd420101c60 0x7fd4201020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:57.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.880+0000 7fd424901640 1 --2- 172.21.15.82:0/3815741902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420100a70 0x7fd420100e90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:57.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.880+0000 7fd424901640 1 -- 172.21.15.82:0/3815741902 >> 172.21.15.82:0/3815741902 conn(0x7fd4200fbfe0 msgr2=0x7fd4200fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:57.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.880+0000 7fd424901640 1 -- 172.21.15.82:0/3815741902 shutdown_connections 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.880+0000 7fd424901640 1 -- 172.21.15.82:0/3815741902 wait complete. 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd424901640 1 Processor -- start 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd424901640 1 -- start start 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd424901640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd420100a70 0x7fd420197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd424901640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420101c60 0x7fd4201983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd424901640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420102620 0x7fd42019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd424901640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd42010d810 con 0x7fd420102620 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd424901640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd42010d690 con 0x7fd420101c60 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd424901640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd42010d990 con 0x7fd420100a70 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd41ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420102620 0x7fd42019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd41ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420102620 0x7fd42019f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34122/0 (socket says 172.21.15.82:34122) 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd41ed9d640 1 -- 172.21.15.82:0/2018031339 learned_addr learned my addr 172.21.15.82:0/2018031339 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd41e59c640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd420100a70 0x7fd420197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:57.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.881+0000 7fd41dd9b640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420101c60 0x7fd4201983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd41ed9d640 1 -- 172.21.15.82:0/2018031339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd420100a70 msgr2=0x7fd420197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd41ed9d640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd420100a70 0x7fd420197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd41ed9d640 1 -- 172.21.15.82:0/2018031339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420101c60 msgr2=0x7fd4201983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd41ed9d640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420101c60 0x7fd4201983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd41ed9d640 1 -- 172.21.15.82:0/2018031339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42019fac0 con 0x7fd420102620 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd41ed9d640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420102620 0x7fd42019f450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd41800eb10 tx=0x7fd41800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd40f7fe640 1 -- 172.21.15.82:0/2018031339 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418004b20 con 0x7fd420102620 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd40f7fe640 1 -- 172.21.15.82:0/2018031339 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd418004cc0 con 0x7fd420102620 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd424901640 1 -- 172.21.15.82:0/2018031339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42019fdb0 con 0x7fd420102620 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd40f7fe640 1 -- 172.21.15.82:0/2018031339 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418010760 con 0x7fd420102620 2024-03-27T07:22:57.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.882+0000 7fd424901640 1 -- 172.21.15.82:0/2018031339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4201a0220 con 0x7fd420102620 2024-03-27T07:22:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.883+0000 7fd424901640 1 -- 172.21.15.82:0/2018031339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd420107e10 con 0x7fd420102620 2024-03-27T07:22:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.884+0000 7fd40f7fe640 1 -- 172.21.15.82:0/2018031339 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7fd418005020 con 0x7fd420102620 2024-03-27T07:22:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.885+0000 7fd40f7fe640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4080a3610 0x7fd4080a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.885+0000 7fd41e59c640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4080a3610 0x7fd4080a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:57.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.885+0000 7fd40f7fe640 1 -- 172.21.15.82:0/2018031339 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fd4180d0250 con 0x7fd420102620 2024-03-27T07:22:57.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.885+0000 7fd41e59c640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4080a3610 0x7fd4080a5ad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd410000c00 tx=0x7fd410005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:57.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:57.889+0000 7fd40f7fe640 1 -- 172.21.15.82:0/2018031339 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd41809ce50 con 0x7fd420102620 2024-03-27T07:22:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:57 smithi149 ceph-mon[36065]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:22:58.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:57 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3340640289' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-27T07:22:58.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:57 smithi153 ceph-mon[36179]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:22:58.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:57 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3340640289' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-27T07:22:58.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.071+0000 7fd424901640 1 -- 172.21.15.82:0/2018031339 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4200627f0 con 0x7fd420102620 2024-03-27T07:22:58.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.073+0000 7fd40f7fe640 1 -- 172.21.15.82:0/2018031339 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22502 (secure 0 0 0) 0x7fd41809c750 con 0x7fd420102620 2024-03-27T07:22:58.075 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:22:58.075 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:22:27.661407+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:22:58.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 -- 172.21.15.82:0/2018031339 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4080a3610 msgr2=0x7fd4080a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4080a3610 0x7fd4080a5ad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd410000c00 tx=0x7fd410005fd0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 -- 172.21.15.82:0/2018031339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420102620 msgr2=0x7fd42019f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420102620 0x7fd42019f450 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd41800eb10 tx=0x7fd41800c2d0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 -- 172.21.15.82:0/2018031339 shutdown_connections 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd4080a3610 0x7fd4080a5ad0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420102620 0x7fd42019f450 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd420101c60 0x7fd4201983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 --2- 172.21.15.82:0/2018031339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd420100a70 0x7fd420197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 -- 172.21.15.82:0/2018031339 >> 172.21.15.82:0/2018031339 conn(0x7fd4200fbfe0 msgr2=0x7fd420104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 -- 172.21.15.82:0/2018031339 shutdown_connections 2024-03-27T07:22:58.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.075+0000 7fd424901640 1 -- 172.21.15.82:0/2018031339 wait complete. 2024-03-27T07:22:58.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T07:21:32.592597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T07:21:33.858606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:22:58.089 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:22:58.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.192+0000 7fec7d2c2640 1 -- 172.21.15.82:0/1759364643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78104fc0 msgr2=0x7fec781073b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.192+0000 7fec7d2c2640 1 --2- 172.21.15.82:0/1759364643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78104fc0 0x7fec781073b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fec68009900 tx=0x7fec6802bc30 comp rx=0 tx=0).stop 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.192+0000 7fec7d2c2640 1 -- 172.21.15.82:0/1759364643 shutdown_connections 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.192+0000 7fec7d2c2640 1 --2- 172.21.15.82:0/1759364643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78104fc0 0x7fec781073b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.192+0000 7fec7d2c2640 1 --2- 172.21.15.82:0/1759364643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec781078f0 0x7fec78109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.192+0000 7fec7d2c2640 1 --2- 172.21.15.82:0/1759364643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78102690 0x7fec78104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.192+0000 7fec7d2c2640 1 -- 172.21.15.82:0/1759364643 >> 172.21.15.82:0/1759364643 conn(0x7fec780fc000 msgr2=0x7fec780fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.192+0000 7fec7d2c2640 1 -- 172.21.15.82:0/1759364643 shutdown_connections 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.192+0000 7fec7d2c2640 1 -- 172.21.15.82:0/1759364643 wait complete. 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec7d2c2640 1 Processor -- start 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec7d2c2640 1 -- start start 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec7d2c2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78102690 0x7fec78197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec7d2c2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78104fc0 0x7fec78198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec7d2c2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec781078f0 0x7fec7819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec7d2c2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810d7c0 con 0x7fec781078f0 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec7d2c2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810d640 con 0x7fec78104fc0 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec7d2c2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810d940 con 0x7fec78102690 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec781078f0 0x7fec7819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec781078f0 0x7fec7819f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34150/0 (socket says 172.21.15.82:34150) 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec777fe640 1 -- 172.21.15.82:0/3052334409 learned_addr learned my addr 172.21.15.82:0/3052334409 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec76ffd640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78102690 0x7fec78197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.193+0000 7fec767fc640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78104fc0 0x7fec78198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec777fe640 1 -- 172.21.15.82:0/3052334409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78102690 msgr2=0x7fec78197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec777fe640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78102690 0x7fec78197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec777fe640 1 -- 172.21.15.82:0/3052334409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78104fc0 msgr2=0x7fec78198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec777fe640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78104fc0 0x7fec78198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec777fe640 1 -- 172.21.15.82:0/3052334409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7819fae0 con 0x7fec781078f0 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec777fe640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec781078f0 0x7fec7819f470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fec7000efd0 tx=0x7fec7000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:58.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec5ffff640 1 -- 172.21.15.82:0/3052334409 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70003b70 con 0x7fec781078f0 2024-03-27T07:22:58.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec7d2c2640 1 -- 172.21.15.82:0/3052334409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7819fdd0 con 0x7fec781078f0 2024-03-27T07:22:58.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec5ffff640 1 -- 172.21.15.82:0/3052334409 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec70003d10 con 0x7fec781078f0 2024-03-27T07:22:58.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec5ffff640 1 -- 172.21.15.82:0/3052334409 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec700109f0 con 0x7fec781078f0 2024-03-27T07:22:58.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.194+0000 7fec7d2c2640 1 -- 172.21.15.82:0/3052334409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec781a0290 con 0x7fec781078f0 2024-03-27T07:22:58.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.195+0000 7fec7d2c2640 1 -- 172.21.15.82:0/3052334409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec780fdaf0 con 0x7fec781078f0 2024-03-27T07:22:58.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.196+0000 7fec5ffff640 1 -- 172.21.15.82:0/3052334409 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7fec70010b90 con 0x7fec781078f0 2024-03-27T07:22:58.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.197+0000 7fec5ffff640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec600a3610 0x7fec600a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.197+0000 7fec76ffd640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec600a3610 0x7fec600a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.197+0000 7fec5ffff640 1 -- 172.21.15.82:0/3052334409 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fec700d0470 con 0x7fec781078f0 2024-03-27T07:22:58.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.197+0000 7fec76ffd640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec600a3610 0x7fec600a5ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009bd0 tx=0x7fec6c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:58.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.201+0000 7fec5ffff640 1 -- 172.21.15.82:0/3052334409 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fec7009d070 con 0x7fec781078f0 2024-03-27T07:22:58.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.384+0000 7fec7d2c2640 1 -- 172.21.15.82:0/3052334409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec7802d520 con 0x7fec781078f0 2024-03-27T07:22:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.385+0000 7fec5ffff640 1 -- 172.21.15.82:0/3052334409 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fec7009c970 con 0x7fec781078f0 2024-03-27T07:22:58.387 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:22:58.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 -- 172.21.15.82:0/3052334409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec600a3610 msgr2=0x7fec600a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec600a3610 0x7fec600a5ad0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009bd0 tx=0x7fec6c005f90 comp rx=0 tx=0).stop 2024-03-27T07:22:58.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 -- 172.21.15.82:0/3052334409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec781078f0 msgr2=0x7fec7819f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec781078f0 0x7fec7819f470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fec7000efd0 tx=0x7fec7000c6a0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 -- 172.21.15.82:0/3052334409 shutdown_connections 2024-03-27T07:22:58.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec600a3610 0x7fec600a5ad0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec781078f0 0x7fec7819f470 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78104fc0 0x7fec78198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 --2- 172.21.15.82:0/3052334409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78102690 0x7fec78197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 -- 172.21.15.82:0/3052334409 >> 172.21.15.82:0/3052334409 conn(0x7fec780fc000 msgr2=0x7fec78103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:58.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 -- 172.21.15.82:0/3052334409 shutdown_connections 2024-03-27T07:22:58.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.387+0000 7fec7d2c2640 1 -- 172.21.15.82:0/3052334409 wait complete. 2024-03-27T07:22:58.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T07:22:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 -- 172.21.15.82:0/1545588269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8924102600 msgr2=0x7f8924108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 --2- 172.21.15.82:0/1545588269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8924102600 0x7f8924108e90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8914009ca0 tx=0x7f891402c0f0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 -- 172.21.15.82:0/1545588269 shutdown_connections 2024-03-27T07:22:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 --2- 172.21.15.82:0/1545588269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8924102600 0x7f8924108e90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 --2- 172.21.15.82:0/1545588269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8924101c40 0x7f89241020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 --2- 172.21.15.82:0/1545588269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8924100a50 0x7f8924100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 -- 172.21.15.82:0/1545588269 >> 172.21.15.82:0/1545588269 conn(0x7f89240fbfe0 msgr2=0x7f89240fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 -- 172.21.15.82:0/1545588269 shutdown_connections 2024-03-27T07:22:58.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 -- 172.21.15.82:0/1545588269 wait complete. 2024-03-27T07:22:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 Processor -- start 2024-03-27T07:22:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 -- start start 2024-03-27T07:22:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8924100a50 0x7f8924069840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8924101c40 0x7f892419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8924102600 0x7f892419f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.504+0000 7f8929bd7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f892410c6d0 con 0x7f8924102600 2024-03-27T07:22:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8929bd7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f892410c550 con 0x7f8924100a50 2024-03-27T07:22:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8929bd7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f892410c850 con 0x7f8924101c40 2024-03-27T07:22:58.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8923fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8924102600 0x7f892419f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8923fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8924102600 0x7f892419f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34164/0 (socket says 172.21.15.82:34164) 2024-03-27T07:22:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8923fff640 1 -- 172.21.15.82:0/4132003979 learned_addr learned my addr 172.21.15.82:0/4132003979 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f89237fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8924100a50 0x7f8924069840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8922ffd640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8924101c40 0x7f892419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8923fff640 1 -- 172.21.15.82:0/4132003979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8924101c40 msgr2=0x7f892419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8923fff640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8924101c40 0x7f892419cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8923fff640 1 -- 172.21.15.82:0/4132003979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8924100a50 msgr2=0x7f8924069840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8923fff640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8924100a50 0x7f8924069840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8923fff640 1 -- 172.21.15.82:0/4132003979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892419fa70 con 0x7f8924102600 2024-03-27T07:22:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8923fff640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8924102600 0x7f892419f1b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8914037040 tx=0x7f8914032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8920ff9640 1 -- 172.21.15.82:0/4132003979 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914041020 con 0x7f8924102600 2024-03-27T07:22:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8920ff9640 1 -- 172.21.15.82:0/4132003979 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8914034cd0 con 0x7f8924102600 2024-03-27T07:22:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8929bd7640 1 -- 172.21.15.82:0/4132003979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892419fd00 con 0x7f8924102600 2024-03-27T07:22:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8920ff9640 1 -- 172.21.15.82:0/4132003979 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914039040 con 0x7f8924102600 2024-03-27T07:22:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.505+0000 7f8929bd7640 1 -- 172.21.15.82:0/4132003979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89241a01f0 con 0x7f8924102600 2024-03-27T07:22:58.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.506+0000 7f8929bd7640 1 -- 172.21.15.82:0/4132003979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8924107d70 con 0x7f8924102600 2024-03-27T07:22:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.507+0000 7f8920ff9640 1 -- 172.21.15.82:0/4132003979 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f8914044020 con 0x7f8924102600 2024-03-27T07:22:58.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.508+0000 7f8920ff9640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 0x7f89100a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.508+0000 7f89237fe640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 0x7f89100a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.508+0000 7f8920ff9640 1 -- 172.21.15.82:0/4132003979 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f89140f1b00 con 0x7f8924102600 2024-03-27T07:22:58.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.508+0000 7f89237fe640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 0x7f89100a5ad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8924101aa0 tx=0x7f891c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:58.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.512+0000 7f8920ff9640 1 -- 172.21.15.82:0/4132003979 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f891404b020 con 0x7f8924102600 2024-03-27T07:22:58.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:58 smithi082 ceph-mon[32178]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-27T07:22:58.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:58 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2018031339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:22:58.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:58 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3052334409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:22:58.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.690+0000 7f8929bd7640 1 -- 172.21.15.82:0/4132003979 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8924062750 con 0x7f8924102600 2024-03-27T07:22:58.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.690+0000 7f8920ff9640 1 -- 172.21.15.82:0/4132003979 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f89140be790 con 0x7f8924102600 2024-03-27T07:22:58.692 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-27T07:22:58.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 -- 172.21.15.82:0/4132003979 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 msgr2=0x7f89100a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 0x7f89100a5ad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8924101aa0 tx=0x7f891c005f90 comp rx=0 tx=0).stop 2024-03-27T07:22:58.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 -- 172.21.15.82:0/4132003979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8924102600 msgr2=0x7f892419f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8924102600 0x7f892419f1b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8914037040 tx=0x7f8914032f40 comp rx=0 tx=0).stop 2024-03-27T07:22:58.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 -- 172.21.15.82:0/4132003979 shutdown_connections 2024-03-27T07:22:58.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f89100a3610 0x7f89100a5ad0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8924102600 0x7f892419f1b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8924101c40 0x7f892419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 --2- 172.21.15.82:0/4132003979 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8924100a50 0x7f8924069840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 -- 172.21.15.82:0/4132003979 >> 172.21.15.82:0/4132003979 conn(0x7f89240fbfe0 msgr2=0x7f8924104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:58.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 -- 172.21.15.82:0/4132003979 shutdown_connections 2024-03-27T07:22:58.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.692+0000 7f8929bd7640 1 -- 172.21.15.82:0/4132003979 wait complete. 2024-03-27T07:22:58.705 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T07:22:58.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 -- 172.21.15.82:0/413044265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c102d50 msgr2=0x7f7e8c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 --2- 172.21.15.82:0/413044265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c102d50 0x7f7e8c1031d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009900 tx=0x7f7e7802bc30 comp rx=0 tx=0).stop 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 -- 172.21.15.82:0/413044265 shutdown_connections 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 --2- 172.21.15.82:0/413044265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c102d50 0x7f7e8c1031d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 --2- 172.21.15.82:0/413044265 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c103710 0x7f7e8c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 --2- 172.21.15.82:0/413044265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8c101b60 0x7f7e8c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 -- 172.21.15.82:0/413044265 >> 172.21.15.82:0/413044265 conn(0x7f7e8c0fd0f0 msgr2=0x7f7e8c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 -- 172.21.15.82:0/413044265 shutdown_connections 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 -- 172.21.15.82:0/413044265 wait complete. 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 Processor -- start 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.806+0000 7f7e931c7640 1 -- start start 2024-03-27T07:22:58.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e931c7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8c101b60 0x7f7e8c197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e931c7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c102d50 0x7f7e8c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e931c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c103710 0x7f7e8c19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e931c7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c10d7e0 con 0x7f7e8c103710 2024-03-27T07:22:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e931c7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c10d660 con 0x7f7e8c102d50 2024-03-27T07:22:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e931c7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8c10d960 con 0x7f7e8c101b60 2024-03-27T07:22:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e91764640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c103710 0x7f7e8c19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e91764640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c103710 0x7f7e8c19f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34178/0 (socket says 172.21.15.82:34178) 2024-03-27T07:22:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e91764640 1 -- 172.21.15.82:0/1147290171 learned_addr learned my addr 172.21.15.82:0/1147290171 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:58.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e90f63640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8c101b60 0x7f7e8c197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e8bfff640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c102d50 0x7f7e8c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e91764640 1 -- 172.21.15.82:0/1147290171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8c101b60 msgr2=0x7f7e8c197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e91764640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8c101b60 0x7f7e8c197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e91764640 1 -- 172.21.15.82:0/1147290171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c102d50 msgr2=0x7f7e8c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e91764640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c102d50 0x7f7e8c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e91764640 1 -- 172.21.15.82:0/1147290171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8c19fab0 con 0x7f7e8c103710 2024-03-27T07:22:58.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e91764640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c103710 0x7f7e8c19f440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400eb10 tx=0x7f7e8400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:58.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e89ffb640 1 -- 172.21.15.82:0/1147290171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84004b20 con 0x7f7e8c103710 2024-03-27T07:22:58.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e89ffb640 1 -- 172.21.15.82:0/1147290171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e84004cc0 con 0x7f7e8c103710 2024-03-27T07:22:58.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e931c7640 1 -- 172.21.15.82:0/1147290171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e8c19fda0 con 0x7f7e8c103710 2024-03-27T07:22:58.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.807+0000 7f7e89ffb640 1 -- 172.21.15.82:0/1147290171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e84010760 con 0x7f7e8c103710 2024-03-27T07:22:58.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.808+0000 7f7e931c7640 1 -- 172.21.15.82:0/1147290171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e8c1a0210 con 0x7f7e8c103710 2024-03-27T07:22:58.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.809+0000 7f7e931c7640 1 -- 172.21.15.82:0/1147290171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e8c108ef0 con 0x7f7e8c103710 2024-03-27T07:22:58.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.809+0000 7f7e89ffb640 1 -- 172.21.15.82:0/1147290171 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f7e84005020 con 0x7f7e8c103710 2024-03-27T07:22:58.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.810+0000 7f7e89ffb640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e7c0a3610 0x7f7e7c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:58.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.810+0000 7f7e90f63640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e7c0a3610 0x7f7e7c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:58.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.810+0000 7f7e89ffb640 1 -- 172.21.15.82:0/1147290171 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f7e840d0250 con 0x7f7e8c103710 2024-03-27T07:22:58.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.810+0000 7f7e90f63640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e7c0a3610 0x7f7e7c0a5ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c102bb0 tx=0x7f7e80005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:58.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.814+0000 7f7e89ffb640 1 -- 172.21.15.82:0/1147290171 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7e8409ce50 con 0x7f7e8c103710 2024-03-27T07:22:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.991+0000 7f7e931c7640 1 -- 172.21.15.82:0/1147290171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7e8c02d370 con 0x7f7e8c103710 2024-03-27T07:22:58.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.991+0000 7f7e89ffb640 1 -- 172.21.15.82:0/1147290171 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f7e8409c750 con 0x7f7e8c103710 2024-03-27T07:22:58.993 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.993+0000 7f7e931c7640 1 -- 172.21.15.82:0/1147290171 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e7c0a3610 msgr2=0x7f7e7c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.993+0000 7f7e931c7640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e7c0a3610 0x7f7e7c0a5ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c102bb0 tx=0x7f7e80005f90 comp rx=0 tx=0).stop 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.993+0000 7f7e931c7640 1 -- 172.21.15.82:0/1147290171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c103710 msgr2=0x7f7e8c19f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.993+0000 7f7e931c7640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c103710 0x7f7e8c19f440 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400eb10 tx=0x7f7e8400c2d0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.993+0000 7f7e931c7640 1 -- 172.21.15.82:0/1147290171 shutdown_connections 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.993+0000 7f7e931c7640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f7e7c0a3610 0x7f7e7c0a5ad0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.993+0000 7f7e931c7640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7e8c103710 0x7f7e8c19f440 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.993+0000 7f7e931c7640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7e8c102d50 0x7f7e8c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.994+0000 7f7e931c7640 1 --2- 172.21.15.82:0/1147290171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e8c101b60 0x7f7e8c197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.994+0000 7f7e931c7640 1 -- 172.21.15.82:0/1147290171 >> 172.21.15.82:0/1147290171 conn(0x7f7e8c0fd0f0 msgr2=0x7f7e8c1060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.994+0000 7f7e931c7640 1 -- 172.21.15.82:0/1147290171 shutdown_connections 2024-03-27T07:22:58.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:58.994+0000 7f7e931c7640 1 -- 172.21.15.82:0/1147290171 wait complete. 2024-03-27T07:22:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:58 smithi149 ceph-mon[36065]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-27T07:22:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:58 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2018031339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:22:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:58 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3052334409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:22:59.006 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:22:59.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:58 smithi153 ceph-mon[36179]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-03-27T07:22:59.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:58 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2018031339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:22:59.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:58 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3052334409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:22:59.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.105+0000 7f7594ed6640 1 -- 172.21.15.82:0/738969675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7590101b70 msgr2=0x7f7590101f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.105+0000 7f7594ed6640 1 --2- 172.21.15.82:0/738969675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7590101b70 0x7f7590101f90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7588009ca0 tx=0x7f758802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.105+0000 7f7594ed6640 1 -- 172.21.15.82:0/738969675 shutdown_connections 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.105+0000 7f7594ed6640 1 --2- 172.21.15.82:0/738969675 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7590103720 0x7f7590109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.105+0000 7f7594ed6640 1 --2- 172.21.15.82:0/738969675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7590102d60 0x7f75901031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.105+0000 7f7594ed6640 1 --2- 172.21.15.82:0/738969675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7590101b70 0x7f7590101f90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.105+0000 7f7594ed6640 1 -- 172.21.15.82:0/738969675 >> 172.21.15.82:0/738969675 conn(0x7f75900fd100 msgr2=0x7f75900ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.105+0000 7f7594ed6640 1 -- 172.21.15.82:0/738969675 shutdown_connections 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.105+0000 7f7594ed6640 1 -- 172.21.15.82:0/738969675 wait complete. 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f7594ed6640 1 Processor -- start 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f7594ed6640 1 -- start start 2024-03-27T07:22:59.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f7594ed6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7590101b70 0x7f7590197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f7594ed6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7590102d60 0x7f75901983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f7594ed6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7590103720 0x7f759019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f7594ed6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f759010d7c0 con 0x7f7590102d60 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f7594ed6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f759010d640 con 0x7f7590103720 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f7594ed6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f759010d940 con 0x7f7590101b70 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7590102d60 0x7f75901983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758dd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7590102d60 0x7f75901983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34206/0 (socket says 172.21.15.82:34206) 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758dd9b640 1 -- 172.21.15.82:0/3420313064 learned_addr learned my addr 172.21.15.82:0/3420313064 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758e59c640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7590101b70 0x7f7590197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758ed9d640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7590103720 0x7f759019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758dd9b640 1 -- 172.21.15.82:0/3420313064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7590101b70 msgr2=0x7f7590197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758dd9b640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7590101b70 0x7f7590197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758dd9b640 1 -- 172.21.15.82:0/3420313064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7590103720 msgr2=0x7f759019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758dd9b640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7590103720 0x7f759019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758dd9b640 1 -- 172.21.15.82:0/3420313064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759019fab0 con 0x7f7590102d60 2024-03-27T07:22:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f758dd9b640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7590102d60 0x7f75901983d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f758400ea60 tx=0x7f758400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f757f7fe640 1 -- 172.21.15.82:0/3420313064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758400cde0 con 0x7f7590102d60 2024-03-27T07:22:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f757f7fe640 1 -- 172.21.15.82:0/3420313064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75840035f0 con 0x7f7590102d60 2024-03-27T07:22:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f7594ed6640 1 -- 172.21.15.82:0/3420313064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759019fda0 con 0x7f7590102d60 2024-03-27T07:22:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.106+0000 7f757f7fe640 1 -- 172.21.15.82:0/3420313064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7584010670 con 0x7f7590102d60 2024-03-27T07:22:59.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.107+0000 7f7594ed6640 1 -- 172.21.15.82:0/3420313064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75901a0270 con 0x7f7590102d60 2024-03-27T07:22:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.107+0000 7f7594ed6640 1 -- 172.21.15.82:0/3420313064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7590108ee0 con 0x7f7590102d60 2024-03-27T07:22:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.108+0000 7f757f7fe640 1 -- 172.21.15.82:0/3420313064 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f75840037a0 con 0x7f7590102d60 2024-03-27T07:22:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.109+0000 7f757f7fe640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f75780a3690 0x7f75780a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.109+0000 7f758e59c640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f75780a3690 0x7f75780a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.109+0000 7f757f7fe640 1 -- 172.21.15.82:0/3420313064 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f75840cff00 con 0x7f7590102d60 2024-03-27T07:22:59.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.109+0000 7f758e59c640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f75780a3690 0x7f75780a5b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f758802c700 tx=0x7f7588032590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:59.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.113+0000 7f757f7fe640 1 -- 172.21.15.82:0/3420313064 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f758409cb00 con 0x7f7590102d60 2024-03-27T07:22:59.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.328+0000 7f7594ed6640 1 -- 172.21.15.82:0/3420313064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f759002d370 con 0x7f7590102d60 2024-03-27T07:22:59.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.329+0000 7f757f7fe640 1 -- 172.21.15.82:0/3420313064 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f758409c400 con 0x7f7590102d60 2024-03-27T07:22:59.331 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:22:59.331 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:21:39.590410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24470,24484]},"id":1}]} 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 21 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 -- 172.21.15.82:0/3420313064 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f75780a3690 msgr2=0x7f75780a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f75780a3690 0x7f75780a5b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f758802c700 tx=0x7f7588032590 comp rx=0 tx=0).stop 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 -- 172.21.15.82:0/3420313064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7590102d60 msgr2=0x7f75901983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7590102d60 0x7f75901983d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f758400ea60 tx=0x7f758400ef20 comp rx=0 tx=0).stop 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 -- 172.21.15.82:0/3420313064 shutdown_connections 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f75780a3690 0x7f75780a5b50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7590102d60 0x7f75901983d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7590103720 0x7f759019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 --2- 172.21.15.82:0/3420313064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7590101b70 0x7f7590197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 -- 172.21.15.82:0/3420313064 >> 172.21.15.82:0/3420313064 conn(0x7f75900fd100 msgr2=0x7f75901060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:59.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 -- 172.21.15.82:0/3420313064 shutdown_connections 2024-03-27T07:22:59.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.331+0000 7f7594ed6640 1 -- 172.21.15.82:0/3420313064 wait complete. 2024-03-27T07:22:59.344 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:22:59.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.444+0000 7f44e74c0640 1 -- 172.21.15.82:0/842394608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0104fe0 msgr2=0x7f44e01073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.444+0000 7f44e74c0640 1 --2- 172.21.15.82:0/842394608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0104fe0 0x7f44e01073d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009900 tx=0x7f44d002bc30 comp rx=0 tx=0).stop 2024-03-27T07:22:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.444+0000 7f44e74c0640 1 -- 172.21.15.82:0/842394608 shutdown_connections 2024-03-27T07:22:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.444+0000 7f44e74c0640 1 --2- 172.21.15.82:0/842394608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e0104fe0 0x7f44e01073d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.444+0000 7f44e74c0640 1 --2- 172.21.15.82:0/842394608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44e0107910 0x7f44e0109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.444+0000 7f44e74c0640 1 --2- 172.21.15.82:0/842394608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e01026b0 0x7f44e0104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.444+0000 7f44e74c0640 1 -- 172.21.15.82:0/842394608 >> 172.21.15.82:0/842394608 conn(0x7f44e00fbfe0 msgr2=0x7f44e00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.444+0000 7f44e74c0640 1 -- 172.21.15.82:0/842394608 shutdown_connections 2024-03-27T07:22:59.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.444+0000 7f44e74c0640 1 -- 172.21.15.82:0/842394608 wait complete. 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e74c0640 1 Processor -- start 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e74c0640 1 -- start start 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e74c0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e01026b0 0x7f44e0197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e74c0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e0104fe0 0x7f44e01983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e74c0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44e0107910 0x7f44e019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e74c0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44e010d7d0 con 0x7f44e01026b0 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e74c0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f44e010d650 con 0x7f44e0104fe0 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e74c0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f44e010d950 con 0x7f44e0107910 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e525c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e01026b0 0x7f44e0197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e525c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e01026b0 0x7f44e0197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34216/0 (socket says 172.21.15.82:34216) 2024-03-27T07:22:59.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e525c640 1 -- 172.21.15.82:0/1941242462 learned_addr learned my addr 172.21.15.82:0/1941242462 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e5a5d640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44e0107910 0x7f44e019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e4a5b640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e0104fe0 0x7f44e01983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e525c640 1 -- 172.21.15.82:0/1941242462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44e0107910 msgr2=0x7f44e019f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e525c640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44e0107910 0x7f44e019f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e525c640 1 -- 172.21.15.82:0/1941242462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e0104fe0 msgr2=0x7f44e01983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e525c640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e0104fe0 0x7f44e01983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e525c640 1 -- 172.21.15.82:0/1941242462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e019fac0 con 0x7f44e01026b0 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e525c640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e01026b0 0x7f44e0197ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00e9f0 tx=0x7f44dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44d67fc640 1 -- 172.21.15.82:0/1941242462 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00ccc0 con 0x7f44e01026b0 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44d67fc640 1 -- 172.21.15.82:0/1941242462 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44dc010910 con 0x7f44e01026b0 2024-03-27T07:22:59.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.445+0000 7f44e74c0640 1 -- 172.21.15.82:0/1941242462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e019fdb0 con 0x7f44e01026b0 2024-03-27T07:22:59.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.446+0000 7f44d67fc640 1 -- 172.21.15.82:0/1941242462 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44dc0188a0 con 0x7f44e01026b0 2024-03-27T07:22:59.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.446+0000 7f44e74c0640 1 -- 172.21.15.82:0/1941242462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e01a0270 con 0x7f44e01026b0 2024-03-27T07:22:59.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.447+0000 7f44e74c0640 1 -- 172.21.15.82:0/1941242462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e00fdad0 con 0x7f44e01026b0 2024-03-27T07:22:59.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.448+0000 7f44d67fc640 1 -- 172.21.15.82:0/1941242462 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f44dc010ac0 con 0x7f44e01026b0 2024-03-27T07:22:59.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.448+0000 7f44d67fc640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f44cc0a3690 0x7f44cc0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.448+0000 7f44e4a5b640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f44cc0a3690 0x7f44cc0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.448+0000 7f44d67fc640 1 -- 172.21.15.82:0/1941242462 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f44dc0d0090 con 0x7f44e01026b0 2024-03-27T07:22:59.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.449+0000 7f44e4a5b640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f44cc0a3690 0x7f44cc0a5b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f44d0000c00 tx=0x7f44d0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:59.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.453+0000 7f44d67fc640 1 -- 172.21.15.82:0/1941242462 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f44dc09cc90 con 0x7f44e01026b0 2024-03-27T07:22:59.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.633+0000 7f44e74c0640 1 -- 172.21.15.82:0/1941242462 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44e00627f0 con 0x7f44e01026b0 2024-03-27T07:22:59.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.634+0000 7f44d67fc640 1 -- 172.21.15.82:0/1941242462 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22502 (secure 0 0 0) 0x7f44dc09c590 con 0x7f44e01026b0 2024-03-27T07:22:59.636 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:22:59.637 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:22:27.661407+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 -- 172.21.15.82:0/1941242462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f44cc0a3690 msgr2=0x7f44cc0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f44cc0a3690 0x7f44cc0a5b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f44d0000c00 tx=0x7f44d0005fd0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 -- 172.21.15.82:0/1941242462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e01026b0 msgr2=0x7f44e0197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e01026b0 0x7f44e0197ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00e9f0 tx=0x7f44dc00edf0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 -- 172.21.15.82:0/1941242462 shutdown_connections 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f44cc0a3690 0x7f44cc0a5b50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44e0107910 0x7f44e019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f44e0104fe0 0x7f44e01983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 --2- 172.21.15.82:0/1941242462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e01026b0 0x7f44e0197ea0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 -- 172.21.15.82:0/1941242462 >> 172.21.15.82:0/1941242462 conn(0x7f44e00fbfe0 msgr2=0x7f44e0102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 -- 172.21.15.82:0/1941242462 shutdown_connections 2024-03-27T07:22:59.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.637+0000 7f44e74c0640 1 -- 172.21.15.82:0/1941242462 wait complete. 2024-03-27T07:22:59.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:59 smithi082 ceph-mon[32178]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:22:59.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:59 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4132003979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:22:59.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:59 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1147290171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:22:59.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:22:59 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3420313064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:22:59.650 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T07:21:32.592597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T07:21:33.858606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:22:59.650 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:22:59.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 -- 172.21.15.82:0/2282235146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78102600 msgr2=0x7fec78108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 --2- 172.21.15.82:0/2282235146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78102600 0x7fec78108e90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fec70009ca0 tx=0x7fec7002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 -- 172.21.15.82:0/2282235146 shutdown_connections 2024-03-27T07:22:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 --2- 172.21.15.82:0/2282235146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78102600 0x7fec78108e90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 --2- 172.21.15.82:0/2282235146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78101c40 0x7fec781020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 --2- 172.21.15.82:0/2282235146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78100a50 0x7fec78100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 -- 172.21.15.82:0/2282235146 >> 172.21.15.82:0/2282235146 conn(0x7fec780fbfe0 msgr2=0x7fec780fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 -- 172.21.15.82:0/2282235146 shutdown_connections 2024-03-27T07:22:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 -- 172.21.15.82:0/2282235146 wait complete. 2024-03-27T07:22:59.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 Processor -- start 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 -- start start 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78100a50 0x7fec78197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78101c40 0x7fec78198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78102600 0x7fec7819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810c6b0 con 0x7fec78101c40 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810c530 con 0x7fec78100a50 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec7f15e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec7810c830 con 0x7fec78102600 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.754+0000 7fec77fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78101c40 0x7fec78198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec7cefa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78100a50 0x7fec78197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec77fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78101c40 0x7fec78198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34246/0 (socket says 172.21.15.82:34246) 2024-03-27T07:22:59.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec77fff640 1 -- 172.21.15.82:0/2710350876 learned_addr learned my addr 172.21.15.82:0/2710350876 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec7d6fb640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78102600 0x7fec7819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec77fff640 1 -- 172.21.15.82:0/2710350876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78102600 msgr2=0x7fec7819f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec77fff640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78102600 0x7fec7819f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec77fff640 1 -- 172.21.15.82:0/2710350876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78100a50 msgr2=0x7fec78197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec77fff640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78100a50 0x7fec78197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec77fff640 1 -- 172.21.15.82:0/2710350876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7819fa60 con 0x7fec78101c40 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec7cefa640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78100a50 0x7fec78197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec77fff640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78101c40 0x7fec78198380 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fec6400e9f0 tx=0x7fec6400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec75ffb640 1 -- 172.21.15.82:0/2710350876 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6400cd80 con 0x7fec78101c40 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec75ffb640 1 -- 172.21.15.82:0/2710350876 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec64010910 con 0x7fec78101c40 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec7f15e640 1 -- 172.21.15.82:0/2710350876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7819fd50 con 0x7fec78101c40 2024-03-27T07:22:59.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec75ffb640 1 -- 172.21.15.82:0/2710350876 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64018990 con 0x7fec78101c40 2024-03-27T07:22:59.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.755+0000 7fec7f15e640 1 -- 172.21.15.82:0/2710350876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec781a0240 con 0x7fec78101c40 2024-03-27T07:22:59.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.756+0000 7fec7f15e640 1 -- 172.21.15.82:0/2710350876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec781a0470 con 0x7fec78101c40 2024-03-27T07:22:59.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.757+0000 7fec75ffb640 1 -- 172.21.15.82:0/2710350876 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7fec64010ac0 con 0x7fec78101c40 2024-03-27T07:22:59.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.758+0000 7fec75ffb640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec680a3610 0x7fec680a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:22:59.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.758+0000 7fec75ffb640 1 -- 172.21.15.82:0/2710350876 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fec640cff70 con 0x7fec78101c40 2024-03-27T07:22:59.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.758+0000 7fec7cefa640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec680a3610 0x7fec680a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:22:59.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.758+0000 7fec7cefa640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec680a3610 0x7fec680a5ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec78101aa0 tx=0x7fec6c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:22:59.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.762+0000 7fec75ffb640 1 -- 172.21.15.82:0/2710350876 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fec6409c5c0 con 0x7fec78101c40 2024-03-27T07:22:59.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.937+0000 7fec7f15e640 1 -- 172.21.15.82:0/2710350876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec781a0640 con 0x7fec78101c40 2024-03-27T07:22:59.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.938+0000 7fec75ffb640 1 -- 172.21.15.82:0/2710350876 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fec640a08c0 con 0x7fec78101c40 2024-03-27T07:22:59.939 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:22:59.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.939+0000 7fec7f15e640 1 -- 172.21.15.82:0/2710350876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec680a3610 msgr2=0x7fec680a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.939+0000 7fec7f15e640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec680a3610 0x7fec680a5ad0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fec78101aa0 tx=0x7fec6c005f90 comp rx=0 tx=0).stop 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.939+0000 7fec7f15e640 1 -- 172.21.15.82:0/2710350876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78101c40 msgr2=0x7fec78198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.939+0000 7fec7f15e640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78101c40 0x7fec78198380 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fec6400e9f0 tx=0x7fec6400eeb0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.940+0000 7fec7f15e640 1 -- 172.21.15.82:0/2710350876 shutdown_connections 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.940+0000 7fec7f15e640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fec680a3610 0x7fec680a5ad0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.940+0000 7fec7f15e640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec78101c40 0x7fec78198380 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.940+0000 7fec7f15e640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fec78102600 0x7fec7819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.940+0000 7fec7f15e640 1 --2- 172.21.15.82:0/2710350876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fec78100a50 0x7fec78197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.940+0000 7fec7f15e640 1 -- 172.21.15.82:0/2710350876 >> 172.21.15.82:0/2710350876 conn(0x7fec780fbfe0 msgr2=0x7fec780fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.940+0000 7fec7f15e640 1 -- 172.21.15.82:0/2710350876 shutdown_connections 2024-03-27T07:22:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:22:59.940+0000 7fec7f15e640 1 -- 172.21.15.82:0/2710350876 wait complete. 2024-03-27T07:22:59.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T07:23:00.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:59 smithi149 ceph-mon[36065]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:23:00.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:59 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4132003979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:00.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:59 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1147290171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:00.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:22:59 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3420313064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:00.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:59 smithi153 ceph-mon[36179]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:23:00.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:59 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4132003979' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:00.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:59 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1147290171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:00.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:22:59 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3420313064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:00.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.055+0000 7f4071a40640 1 -- 172.21.15.82:0/283128117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f406c101b60 msgr2=0x7f406c101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.055+0000 7f4071a40640 1 --2- 172.21.15.82:0/283128117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f406c101b60 0x7f406c101f80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f405c009860 tx=0x7f405c02bb70 comp rx=0 tx=0).stop 2024-03-27T07:23:00.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.055+0000 7f4071a40640 1 -- 172.21.15.82:0/283128117 shutdown_connections 2024-03-27T07:23:00.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.055+0000 7f4071a40640 1 --2- 172.21.15.82:0/283128117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f406c103710 0x7f406c109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.055+0000 7f4071a40640 1 --2- 172.21.15.82:0/283128117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f406c102d50 0x7f406c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.055+0000 7f4071a40640 1 --2- 172.21.15.82:0/283128117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f406c101b60 0x7f406c101f80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.055+0000 7f4071a40640 1 -- 172.21.15.82:0/283128117 >> 172.21.15.82:0/283128117 conn(0x7f406c0fd0f0 msgr2=0x7f406c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:00.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.055+0000 7f4071a40640 1 -- 172.21.15.82:0/283128117 shutdown_connections 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.055+0000 7f4071a40640 1 -- 172.21.15.82:0/283128117 wait complete. 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4071a40640 1 Processor -- start 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4071a40640 1 -- start start 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4071a40640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f406c101b60 0x7f406c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4071a40640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f406c102d50 0x7f406c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4071a40640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f406c103710 0x7f406c19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4071a40640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f406c10d7d0 con 0x7f406c102d50 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4071a40640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f406c10d650 con 0x7f406c101b60 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4071a40640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f406c10d950 con 0x7f406c103710 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4063fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f406c102d50 0x7f406c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4063fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f406c102d50 0x7f406c1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34254/0 (socket says 172.21.15.82:34254) 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4063fff640 1 -- 172.21.15.82:0/1051802182 learned_addr learned my addr 172.21.15.82:0/1051802182 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f406b7fe640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f406c103710 0x7f406c19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f406affd640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f406c101b60 0x7f406c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4063fff640 1 -- 172.21.15.82:0/1051802182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f406c103710 msgr2=0x7f406c19f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4063fff640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f406c103710 0x7f406c19f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4063fff640 1 -- 172.21.15.82:0/1051802182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f406c101b60 msgr2=0x7f406c197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.056+0000 7f4063fff640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f406c101b60 0x7f406c197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.057+0000 7f4063fff640 1 -- 172.21.15.82:0/1051802182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406c19fac0 con 0x7f406c102d50 2024-03-27T07:23:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.057+0000 7f4063fff640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f406c102d50 0x7f406c1983e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f405400e9f0 tx=0x7f405400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.057+0000 7f4070a3e640 1 -- 172.21.15.82:0/1051802182 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405400cd80 con 0x7f406c102d50 2024-03-27T07:23:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.057+0000 7f4071a40640 1 -- 172.21.15.82:0/1051802182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f406c19fdb0 con 0x7f406c102d50 2024-03-27T07:23:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.057+0000 7f4070a3e640 1 -- 172.21.15.82:0/1051802182 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4054005500 con 0x7f406c102d50 2024-03-27T07:23:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.057+0000 7f4070a3e640 1 -- 172.21.15.82:0/1051802182 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054010690 con 0x7f406c102d50 2024-03-27T07:23:00.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.057+0000 7f4071a40640 1 -- 172.21.15.82:0/1051802182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f406c1a0270 con 0x7f406c102d50 2024-03-27T07:23:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.058+0000 7f4071a40640 1 -- 172.21.15.82:0/1051802182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f406c108ef0 con 0x7f406c102d50 2024-03-27T07:23:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.059+0000 7f4070a3e640 1 -- 172.21.15.82:0/1051802182 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f40540046c0 con 0x7f406c102d50 2024-03-27T07:23:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.059+0000 7f4070a3e640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f40580a3610 0x7f40580a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.060+0000 7f406affd640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f40580a3610 0x7f40580a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.060+0000 7f4070a3e640 1 -- 172.21.15.82:0/1051802182 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f40540d00f0 con 0x7f406c102d50 2024-03-27T07:23:00.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.060+0000 7f406affd640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f40580a3610 0x7f40580a5ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f405c009830 tx=0x7f405c034ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:00.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.064+0000 7f4070a3e640 1 -- 172.21.15.82:0/1051802182 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f405409cc90 con 0x7f406c102d50 2024-03-27T07:23:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.238+0000 7f4071a40640 1 -- 172.21.15.82:0/1051802182 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f406c062750 con 0x7f406c102d50 2024-03-27T07:23:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.239+0000 7f4070a3e640 1 -- 172.21.15.82:0/1051802182 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f405409c590 con 0x7f406c102d50 2024-03-27T07:23:00.241 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-27T07:23:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 -- 172.21.15.82:0/1051802182 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f40580a3610 msgr2=0x7f40580a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f40580a3610 0x7f40580a5ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f405c009830 tx=0x7f405c034ad0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 -- 172.21.15.82:0/1051802182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f406c102d50 msgr2=0x7f406c1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f406c102d50 0x7f406c1983e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f405400e9f0 tx=0x7f405400edf0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 -- 172.21.15.82:0/1051802182 shutdown_connections 2024-03-27T07:23:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f40580a3610 0x7f40580a5ad0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f406c102d50 0x7f406c1983e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f406c103710 0x7f406c19f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 --2- 172.21.15.82:0/1051802182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f406c101b60 0x7f406c197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 -- 172.21.15.82:0/1051802182 >> 172.21.15.82:0/1051802182 conn(0x7f406c0fd0f0 msgr2=0x7f406c1060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 -- 172.21.15.82:0/1051802182 shutdown_connections 2024-03-27T07:23:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.241+0000 7f4071a40640 1 -- 172.21.15.82:0/1051802182 wait complete. 2024-03-27T07:23:00.254 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.357+0000 7fdff7e4e640 1 -- 172.21.15.82:0/1531041322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdff0100a60 msgr2=0x7fdff0100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.357+0000 7fdff7e4e640 1 --2- 172.21.15.82:0/1531041322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdff0100a60 0x7fdff0100e80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009be0 tx=0x7fdfec02bef0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.357+0000 7fdff7e4e640 1 -- 172.21.15.82:0/1531041322 shutdown_connections 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.357+0000 7fdff7e4e640 1 --2- 172.21.15.82:0/1531041322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdff0101c50 0x7fdff01020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.357+0000 7fdff7e4e640 1 --2- 172.21.15.82:0/1531041322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff0102610 0x7fdff0108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.357+0000 7fdff7e4e640 1 --2- 172.21.15.82:0/1531041322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdff0100a60 0x7fdff0100e80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.357+0000 7fdff7e4e640 1 -- 172.21.15.82:0/1531041322 >> 172.21.15.82:0/1531041322 conn(0x7fdff00fbff0 msgr2=0x7fdff00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.357+0000 7fdff7e4e640 1 -- 172.21.15.82:0/1531041322 shutdown_connections 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.357+0000 7fdff7e4e640 1 -- 172.21.15.82:0/1531041322 wait complete. 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff7e4e640 1 Processor -- start 2024-03-27T07:23:00.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff7e4e640 1 -- start start 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff7e4e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdff0100a60 0x7fdff006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff7e4e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdff0101c50 0x7fdff019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff7e4e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff0102610 0x7fdff019f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff7e4e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdff010c6e0 con 0x7fdff0101c50 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff7e4e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdff010c560 con 0x7fdff0102610 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff7e4e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdff010c860 con 0x7fdff0100a60 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff53e9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdff0101c50 0x7fdff019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff53e9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdff0101c50 0x7fdff019cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34266/0 (socket says 172.21.15.82:34266) 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff53e9640 1 -- 172.21.15.82:0/149550300 learned_addr learned my addr 172.21.15.82:0/149550300 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff5bea640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdff0100a60 0x7fdff006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff63eb640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff0102610 0x7fdff019f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff53e9640 1 -- 172.21.15.82:0/149550300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdff0100a60 msgr2=0x7fdff006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff53e9640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdff0100a60 0x7fdff006acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff53e9640 1 -- 172.21.15.82:0/149550300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff0102610 msgr2=0x7fdff019f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff53e9640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff0102610 0x7fdff019f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff53e9640 1 -- 172.21.15.82:0/149550300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff019fae0 con 0x7fdff0101c50 2024-03-27T07:23:00.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff63eb640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff0102610 0x7fdff019f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:23:00.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff53e9640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdff0101c50 0x7fdff019cbe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000e9c0 tx=0x7fdfe000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:00.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdfe6ffd640 1 -- 172.21.15.82:0/149550300 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000cde0 con 0x7fdff0101c50 2024-03-27T07:23:00.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff7e4e640 1 -- 172.21.15.82:0/149550300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff019fdd0 con 0x7fdff0101c50 2024-03-27T07:23:00.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdfe6ffd640 1 -- 172.21.15.82:0/149550300 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfe00035f0 con 0x7fdff0101c50 2024-03-27T07:23:00.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdfe6ffd640 1 -- 172.21.15.82:0/149550300 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0010650 con 0x7fdff0101c50 2024-03-27T07:23:00.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.358+0000 7fdff7e4e640 1 -- 172.21.15.82:0/149550300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff01a0290 con 0x7fdff0101c50 2024-03-27T07:23:00.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.359+0000 7fdff7e4e640 1 -- 172.21.15.82:0/149550300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff0107e20 con 0x7fdff0101c50 2024-03-27T07:23:00.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.360+0000 7fdfe6ffd640 1 -- 172.21.15.82:0/149550300 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7fdfe00037a0 con 0x7fdff0101c50 2024-03-27T07:23:00.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.361+0000 7fdfe6ffd640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdfdc0a3610 0x7fdfdc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.361+0000 7fdff5bea640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdfdc0a3610 0x7fdfdc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.361+0000 7fdfe6ffd640 1 -- 172.21.15.82:0/149550300 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fdfe00d00a0 con 0x7fdff0101c50 2024-03-27T07:23:00.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.361+0000 7fdff5bea640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdfdc0a3610 0x7fdfdc0a5ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdfec006010 tx=0x7fdfec000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:00.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.366+0000 7fdfe6ffd640 1 -- 172.21.15.82:0/149550300 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fdfe009cca0 con 0x7fdff0101c50 2024-03-27T07:23:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.541+0000 7fdff7e4e640 1 -- 172.21.15.82:0/149550300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdff00627f0 con 0x7fdff0101c50 2024-03-27T07:23:00.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.542+0000 7fdfe6ffd640 1 -- 172.21.15.82:0/149550300 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7fdfe009c5a0 con 0x7fdff0101c50 2024-03-27T07:23:00.544 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-27T07:23:00.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 -- 172.21.15.82:0/149550300 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdfdc0a3610 msgr2=0x7fdfdc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdfdc0a3610 0x7fdfdc0a5ad0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdfec006010 tx=0x7fdfec000f40 comp rx=0 tx=0).stop 2024-03-27T07:23:00.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 -- 172.21.15.82:0/149550300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdff0101c50 msgr2=0x7fdff019cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdff0101c50 0x7fdff019cbe0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000e9c0 tx=0x7fdfe000ee80 comp rx=0 tx=0).stop 2024-03-27T07:23:00.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 -- 172.21.15.82:0/149550300 shutdown_connections 2024-03-27T07:23:00.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdfdc0a3610 0x7fdfdc0a5ad0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdff0101c50 0x7fdff019cbe0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdff0102610 0x7fdff019f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 --2- 172.21.15.82:0/149550300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdff0100a60 0x7fdff006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 -- 172.21.15.82:0/149550300 >> 172.21.15.82:0/149550300 conn(0x7fdff00fbff0 msgr2=0x7fdff0104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:00.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 -- 172.21.15.82:0/149550300 shutdown_connections 2024-03-27T07:23:00.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.544+0000 7fdff7e4e640 1 -- 172.21.15.82:0/149550300 wait complete. 2024-03-27T07:23:00.556 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:23:00.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 -- 172.21.15.82:0/3833474744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb58102620 msgr2=0x7fdb58108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 --2- 172.21.15.82:0/3833474744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb58102620 0x7fdb58108eb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009ca0 tx=0x7fdb5002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 -- 172.21.15.82:0/3833474744 shutdown_connections 2024-03-27T07:23:00.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 --2- 172.21.15.82:0/3833474744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb58102620 0x7fdb58108eb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 --2- 172.21.15.82:0/3833474744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101c60 0x7fdb581020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 --2- 172.21.15.82:0/3833474744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58100a70 0x7fdb58100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 -- 172.21.15.82:0/3833474744 >> 172.21.15.82:0/3833474744 conn(0x7fdb580fbfe0 msgr2=0x7fdb580fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 -- 172.21.15.82:0/3833474744 shutdown_connections 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 -- 172.21.15.82:0/3833474744 wait complete. 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 Processor -- start 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.657+0000 7fdb604f4640 1 -- start start 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb604f4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb58100a70 0x7fdb58069840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb604f4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101c60 0x7fdb5819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb604f4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58102620 0x7fdb5819f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb604f4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5810c6f0 con 0x7fdb58100a70 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb604f4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5810c570 con 0x7fdb58101c60 2024-03-27T07:23:00.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb604f4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdb5810c870 con 0x7fdb58102620 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5e290640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb58100a70 0x7fdb58069840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5e290640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb58100a70 0x7fdb58069840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34270/0 (socket says 172.21.15.82:34270) 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5e290640 1 -- 172.21.15.82:0/1573166391 learned_addr learned my addr 172.21.15.82:0/1573166391 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5da8f640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101c60 0x7fdb5819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5ea91640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58102620 0x7fdb5819f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5e290640 1 -- 172.21.15.82:0/1573166391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58102620 msgr2=0x7fdb5819f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5e290640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58102620 0x7fdb5819f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5e290640 1 -- 172.21.15.82:0/1573166391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101c60 msgr2=0x7fdb5819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5e290640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101c60 0x7fdb5819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5e290640 1 -- 172.21.15.82:0/1573166391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5819fa90 con 0x7fdb58100a70 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5ea91640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58102620 0x7fdb5819f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:23:00.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb5e290640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb58100a70 0x7fdb58069840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400e9c0 tx=0x7fdb5400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb4f7fe640 1 -- 172.21.15.82:0/1573166391 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400cd80 con 0x7fdb58100a70 2024-03-27T07:23:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb4f7fe640 1 -- 172.21.15.82:0/1573166391 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb540035f0 con 0x7fdb58100a70 2024-03-27T07:23:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb604f4640 1 -- 172.21.15.82:0/1573166391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5819fd80 con 0x7fdb58100a70 2024-03-27T07:23:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb4f7fe640 1 -- 172.21.15.82:0/1573166391 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb54010690 con 0x7fdb58100a70 2024-03-27T07:23:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.658+0000 7fdb604f4640 1 -- 172.21.15.82:0/1573166391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb581a0270 con 0x7fdb58100a70 2024-03-27T07:23:00.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.659+0000 7fdb604f4640 1 -- 172.21.15.82:0/1573166391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb58107d90 con 0x7fdb58100a70 2024-03-27T07:23:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.660+0000 7fdb4f7fe640 1 -- 172.21.15.82:0/1573166391 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7fdb540037a0 con 0x7fdb58100a70 2024-03-27T07:23:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.661+0000 7fdb4f7fe640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdb440a3690 0x7fdb440a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.661+0000 7fdb5da8f640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdb440a3690 0x7fdb440a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.661+0000 7fdb4f7fe640 1 -- 172.21.15.82:0/1573166391 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fdb540d0070 con 0x7fdb58100a70 2024-03-27T07:23:00.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.661+0000 7fdb5da8f640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdb440a3690 0x7fdb440a5b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdb580695b0 tx=0x7fdb4800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:00.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.665+0000 7fdb4f7fe640 1 -- 172.21.15.82:0/1573166391 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fdb5409cc70 con 0x7fdb58100a70 2024-03-27T07:23:00.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.885+0000 7fdb604f4640 1 -- 172.21.15.82:0/1573166391 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb5802d370 con 0x7fdb58100a70 2024-03-27T07:23:00.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.886+0000 7fdb4f7fe640 1 -- 172.21.15.82:0/1573166391 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fdb540b0e20 con 0x7fdb58100a70 2024-03-27T07:23:00.888 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:00.888 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:21:39.590410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24470,24484]},"id":1}]} 2024-03-27T07:23:00.888 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 21 2024-03-27T07:23:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 -- 172.21.15.82:0/1573166391 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdb440a3690 msgr2=0x7fdb440a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdb440a3690 0x7fdb440a5b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdb580695b0 tx=0x7fdb4800b410 comp rx=0 tx=0).stop 2024-03-27T07:23:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 -- 172.21.15.82:0/1573166391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb58100a70 msgr2=0x7fdb58069840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb58100a70 0x7fdb58069840 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400e9c0 tx=0x7fdb5400ee80 comp rx=0 tx=0).stop 2024-03-27T07:23:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 -- 172.21.15.82:0/1573166391 shutdown_connections 2024-03-27T07:23:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fdb440a3690 0x7fdb440a5b50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb58102620 0x7fdb5819f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdb58101c60 0x7fdb5819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 --2- 172.21.15.82:0/1573166391 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb58100a70 0x7fdb58069840 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:00.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 -- 172.21.15.82:0/1573166391 >> 172.21.15.82:0/1573166391 conn(0x7fdb580fbfe0 msgr2=0x7fdb58104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:00.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 -- 172.21.15.82:0/1573166391 shutdown_connections 2024-03-27T07:23:00.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:00.888+0000 7fdb604f4640 1 -- 172.21.15.82:0/1573166391 wait complete. 2024-03-27T07:23:00.899 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:00 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1941242462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:00.899 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:00 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2710350876' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:00.899 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:00 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1051802182' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:00.900 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:00 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/149550300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:00.901 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:23:01.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.001+0000 7f7634513640 1 -- 172.21.15.82:0/2602593914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762c102d60 msgr2=0x7f762c1031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.001+0000 7f7634513640 1 --2- 172.21.15.82:0/2602593914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762c102d60 0x7f762c1031e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f761c009900 tx=0x7f761c02bc50 comp rx=0 tx=0).stop 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.001+0000 7f7634513640 1 -- 172.21.15.82:0/2602593914 shutdown_connections 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.001+0000 7f7634513640 1 --2- 172.21.15.82:0/2602593914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762c102d60 0x7f762c1031e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.001+0000 7f7634513640 1 --2- 172.21.15.82:0/2602593914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c103720 0x7f762c109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.001+0000 7f7634513640 1 --2- 172.21.15.82:0/2602593914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f762c101b70 0x7f762c101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.001+0000 7f7634513640 1 -- 172.21.15.82:0/2602593914 >> 172.21.15.82:0/2602593914 conn(0x7f762c0fd100 msgr2=0x7f762c0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.001+0000 7f7634513640 1 -- 172.21.15.82:0/2602593914 shutdown_connections 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.001+0000 7f7634513640 1 -- 172.21.15.82:0/2602593914 wait complete. 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.001+0000 7f7634513640 1 Processor -- start 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f7634513640 1 -- start start 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f7634513640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762c101b70 0x7f762c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f7634513640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c102d60 0x7f762c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f7634513640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f762c103720 0x7f762c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f7634513640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f762c10d890 con 0x7f762c101b70 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f7634513640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f762c10d710 con 0x7f762c103720 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f7634513640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f762c10da10 con 0x7f762c102d60 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76322af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762c101b70 0x7f762c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76322af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762c101b70 0x7f762c197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34282/0 (socket says 172.21.15.82:34282) 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76322af640 1 -- 172.21.15.82:0/3440204918 learned_addr learned my addr 172.21.15.82:0/3440204918 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76322af640 1 -- 172.21.15.82:0/3440204918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c102d60 msgr2=0x7f762c1984b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76322af640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c102d60 0x7f762c1984b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76322af640 1 -- 172.21.15.82:0/3440204918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f762c103720 msgr2=0x7f762c19f520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76322af640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f762c103720 0x7f762c19f520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76322af640 1 -- 172.21.15.82:0/3440204918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c19fb90 con 0x7f762c101b70 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76322af640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762c101b70 0x7f762c197f70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f762800b470 tx=0x7f762800b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76237fe640 1 -- 172.21.15.82:0/3440204918 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628015020 con 0x7f762c101b70 2024-03-27T07:23:01.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76237fe640 1 -- 172.21.15.82:0/3440204918 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7628011d70 con 0x7f762c101b70 2024-03-27T07:23:01.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f7634513640 1 -- 172.21.15.82:0/3440204918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762c19fe80 con 0x7f762c101b70 2024-03-27T07:23:01.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f76237fe640 1 -- 172.21.15.82:0/3440204918 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762800f340 con 0x7f762c101b70 2024-03-27T07:23:01.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.002+0000 7f7634513640 1 -- 172.21.15.82:0/3440204918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762c1a0340 con 0x7f762c101b70 2024-03-27T07:23:01.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:00 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1941242462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:01.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:00 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2710350876' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:01.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:00 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1051802182' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:01.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:00 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/149550300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:01.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.003+0000 7f7634513640 1 -- 172.21.15.82:0/3440204918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762c108e30 con 0x7f762c101b70 2024-03-27T07:23:01.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.004+0000 7f76237fe640 1 -- 172.21.15.82:0/3440204918 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f7628018020 con 0x7f762c101b70 2024-03-27T07:23:01.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.005+0000 7f76237fe640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76180a3690 0x7f76180a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.005+0000 7f7631aae640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76180a3690 0x7f76180a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.005+0000 7f76237fe640 1 -- 172.21.15.82:0/3440204918 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f76280cf7a0 con 0x7f762c101b70 2024-03-27T07:23:01.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.005+0000 7f7631aae640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76180a3690 0x7f76180a5b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f761c02c730 tx=0x7f761c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.009+0000 7f76237fe640 1 -- 172.21.15.82:0/3440204918 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f762801f020 con 0x7f762c101b70 2024-03-27T07:23:01.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:00 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1941242462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:01.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:00 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2710350876' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:01.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:00 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1051802182' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:01.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:00 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/149550300' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:01.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.187+0000 7f7634513640 1 -- 172.21.15.82:0/3440204918 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f762c062850 con 0x7f762c101b70 2024-03-27T07:23:01.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.189+0000 7f76237fe640 1 -- 172.21.15.82:0/3440204918 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22502 (secure 0 0 0) 0x7f762800d040 con 0x7f762c101b70 2024-03-27T07:23:01.191 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:01.191 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:22:27.661407+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:23:01.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.190+0000 7f7634513640 1 -- 172.21.15.82:0/3440204918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76180a3690 msgr2=0x7f76180a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.190+0000 7f7634513640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76180a3690 0x7f76180a5b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f761c02c730 tx=0x7f761c005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.191+0000 7f7634513640 1 -- 172.21.15.82:0/3440204918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762c101b70 msgr2=0x7f762c197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.191+0000 7f7634513640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762c101b70 0x7f762c197f70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f762800b470 tx=0x7f762800b930 comp rx=0 tx=0).stop 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.191+0000 7f7634513640 1 -- 172.21.15.82:0/3440204918 shutdown_connections 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.191+0000 7f7634513640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f76180a3690 0x7f76180a5b50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.191+0000 7f7634513640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f762c103720 0x7f762c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.191+0000 7f7634513640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f762c102d60 0x7f762c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.191+0000 7f7634513640 1 --2- 172.21.15.82:0/3440204918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f762c101b70 0x7f762c197f70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.191+0000 7f7634513640 1 -- 172.21.15.82:0/3440204918 >> 172.21.15.82:0/3440204918 conn(0x7f762c0fd100 msgr2=0x7f762c106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.191+0000 7f7634513640 1 -- 172.21.15.82:0/3440204918 shutdown_connections 2024-03-27T07:23:01.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.191+0000 7f7634513640 1 -- 172.21.15.82:0/3440204918 wait complete. 2024-03-27T07:23:01.204 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:23:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.303+0000 7ff1b193e640 1 -- 172.21.15.82:0/2735054215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1ac104f20 msgr2=0x7ff1ac107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.303+0000 7ff1b193e640 1 --2- 172.21.15.82:0/2735054215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1ac104f20 0x7ff1ac107310 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009900 tx=0x7ff1a002bc50 comp rx=0 tx=0).stop 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.303+0000 7ff1b193e640 1 -- 172.21.15.82:0/2735054215 shutdown_connections 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.303+0000 7ff1b193e640 1 --2- 172.21.15.82:0/2735054215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1ac104f20 0x7ff1ac107310 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.303+0000 7ff1b193e640 1 --2- 172.21.15.82:0/2735054215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1ac107850 0x7ff1ac109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.303+0000 7ff1b193e640 1 --2- 172.21.15.82:0/2735054215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1ac1025f0 0x7ff1ac1049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.303+0000 7ff1b193e640 1 -- 172.21.15.82:0/2735054215 >> 172.21.15.82:0/2735054215 conn(0x7ff1ac0fbfe0 msgr2=0x7ff1ac0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.303+0000 7ff1b193e640 1 -- 172.21.15.82:0/2735054215 shutdown_connections 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.303+0000 7ff1b193e640 1 -- 172.21.15.82:0/2735054215 wait complete. 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1b193e640 1 Processor -- start 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1b193e640 1 -- start start 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1b193e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1ac1025f0 0x7ff1ac198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1b193e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1ac104f20 0x7ff1ac198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1b193e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1ac107850 0x7ff1ac19f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1b193e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac10d870 con 0x7ff1ac1025f0 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1b193e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac10d6f0 con 0x7ff1ac104f20 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1b193e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1ac10d9f0 con 0x7ff1ac107850 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1ac1025f0 0x7ff1ac198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1ac1025f0 0x7ff1ac198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34304/0 (socket says 172.21.15.82:34304) 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aaffd640 1 -- 172.21.15.82:0/121808333 learned_addr learned my addr 172.21.15.82:0/121808333 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aa7fc640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1ac104f20 0x7ff1ac198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1ab7fe640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1ac107850 0x7ff1ac19f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aaffd640 1 -- 172.21.15.82:0/121808333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1ac107850 msgr2=0x7ff1ac19f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aaffd640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1ac107850 0x7ff1ac19f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aaffd640 1 -- 172.21.15.82:0/121808333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1ac104f20 msgr2=0x7ff1ac198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aaffd640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1ac104f20 0x7ff1ac198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aaffd640 1 -- 172.21.15.82:0/121808333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1ac19fc30 con 0x7ff1ac1025f0 2024-03-27T07:23:01.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aa7fc640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1ac104f20 0x7ff1ac198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:23:01.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.304+0000 7ff1aaffd640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1ac1025f0 0x7ff1ac198010 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00ba50 tx=0x7ff19c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.305+0000 7ff1b093c640 1 -- 172.21.15.82:0/121808333 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c019070 con 0x7ff1ac1025f0 2024-03-27T07:23:01.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.305+0000 7ff1b093c640 1 -- 172.21.15.82:0/121808333 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff19c00cc10 con 0x7ff1ac1025f0 2024-03-27T07:23:01.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.305+0000 7ff1b193e640 1 -- 172.21.15.82:0/121808333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1ac19ff20 con 0x7ff1ac1025f0 2024-03-27T07:23:01.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.305+0000 7ff1b093c640 1 -- 172.21.15.82:0/121808333 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0076a0 con 0x7ff1ac1025f0 2024-03-27T07:23:01.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.305+0000 7ff1b193e640 1 -- 172.21.15.82:0/121808333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1ac1a0330 con 0x7ff1ac1025f0 2024-03-27T07:23:01.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.306+0000 7ff1b193e640 1 -- 172.21.15.82:0/121808333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ac0fdad0 con 0x7ff1ac1025f0 2024-03-27T07:23:01.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.307+0000 7ff1b093c640 1 -- 172.21.15.82:0/121808333 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7ff19c01c070 con 0x7ff1ac1025f0 2024-03-27T07:23:01.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.307+0000 7ff1b093c640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1940a3610 0x7ff1940a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.307+0000 7ff1aa7fc640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1940a3610 0x7ff1940a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.308+0000 7ff1b093c640 1 -- 172.21.15.82:0/121808333 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7ff19c0cf410 con 0x7ff1ac1025f0 2024-03-27T07:23:01.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.308+0000 7ff1aa7fc640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1940a3610 0x7ff1940a5ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff1a002c7d0 tx=0x7ff1a0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.312+0000 7ff1b093c640 1 -- 172.21.15.82:0/121808333 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ff19c09c010 con 0x7ff1ac1025f0 2024-03-27T07:23:01.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.530+0000 7ff1b193e640 1 -- 172.21.15.82:0/121808333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1ac02d370 con 0x7ff1ac1025f0 2024-03-27T07:23:01.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.531+0000 7ff1b093c640 1 -- 172.21.15.82:0/121808333 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7ff19c09b910 con 0x7ff1ac1025f0 2024-03-27T07:23:01.533 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:01.533 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:21:39.590410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24470,24484]},"id":1}]} 2024-03-27T07:23:01.533 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 21 2024-03-27T07:23:01.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 -- 172.21.15.82:0/121808333 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1940a3610 msgr2=0x7ff1940a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1940a3610 0x7ff1940a5ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff1a002c7d0 tx=0x7ff1a0005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 -- 172.21.15.82:0/121808333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1ac1025f0 msgr2=0x7ff1ac198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1ac1025f0 0x7ff1ac198010 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00ba50 tx=0x7ff19c00bf10 comp rx=0 tx=0).stop 2024-03-27T07:23:01.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 -- 172.21.15.82:0/121808333 shutdown_connections 2024-03-27T07:23:01.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1940a3610 0x7ff1940a5ad0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1ac107850 0x7ff1ac19f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1ac104f20 0x7ff1ac198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 --2- 172.21.15.82:0/121808333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1ac1025f0 0x7ff1ac198010 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 -- 172.21.15.82:0/121808333 >> 172.21.15.82:0/121808333 conn(0x7ff1ac0fbfe0 msgr2=0x7ff1ac102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 -- 172.21.15.82:0/121808333 shutdown_connections 2024-03-27T07:23:01.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.533+0000 7ff1b193e640 1 -- 172.21.15.82:0/121808333 wait complete. 2024-03-27T07:23:01.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-27T07:21:34.901653+0000', 'modified': '2024-03-27T07:21:39.590410+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24497, 'mds_1': 24484, 'mds_2': 24470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.149:6835/227197026', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 227197026}, {'type': 'v1', 'addr': '172.21.15.149:6835', 'nonce': 227197026}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6835/1080332547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 1080332547}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 1080332547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6837/1290254754', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 1290254754}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 1290254754}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.149:6837/4121570293', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6836', 'nonce': 4121570293}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 4121570293}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'i', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.153:6839/1505538081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 1505538081}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 1505538081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6839/3930771704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6838', 'nonce': 3930771704}, {'type': 'v1', 'addr': '172.21.15.149:6839', 'nonce': 3930771704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497, 24470, 24484]} 2024-03-27T07:23:01.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-03-27T07:23:01.546 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-27T07:23:01.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.648+0000 7fc134cb5640 1 -- 172.21.15.82:0/3562888039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc130102620 msgr2=0x7fc130108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.648+0000 7fc134cb5640 1 --2- 172.21.15.82:0/3562888039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc130102620 0x7fc130108eb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc128009ca0 tx=0x7fc12802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.648+0000 7fc134cb5640 1 -- 172.21.15.82:0/3562888039 shutdown_connections 2024-03-27T07:23:01.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.648+0000 7fc134cb5640 1 --2- 172.21.15.82:0/3562888039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc130102620 0x7fc130108eb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.648+0000 7fc134cb5640 1 --2- 172.21.15.82:0/3562888039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc130101c60 0x7fc1301020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.648+0000 7fc134cb5640 1 --2- 172.21.15.82:0/3562888039 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc130100a70 0x7fc130100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.648+0000 7fc134cb5640 1 -- 172.21.15.82:0/3562888039 >> 172.21.15.82:0/3562888039 conn(0x7fc1300fc000 msgr2=0x7fc1300fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.648+0000 7fc134cb5640 1 -- 172.21.15.82:0/3562888039 shutdown_connections 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.648+0000 7fc134cb5640 1 -- 172.21.15.82:0/3562888039 wait complete. 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc134cb5640 1 Processor -- start 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc134cb5640 1 -- start start 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc134cb5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc130100a70 0x7fc130197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc134cb5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc130101c60 0x7fc130198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc134cb5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc130102620 0x7fc13019f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc134cb5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc13010c6d0 con 0x7fc130101c60 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc134cb5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc13010c550 con 0x7fc130102620 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc134cb5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc13010c850 con 0x7fc130100a70 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc125d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc130101c60 0x7fc130198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc125d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc130101c60 0x7fc130198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34324/0 (socket says 172.21.15.82:34324) 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc125d9b640 1 -- 172.21.15.82:0/2356588188 learned_addr learned my addr 172.21.15.82:0/2356588188 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc12e59c640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc130100a70 0x7fc130197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc130102620 0x7fc13019f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc125d9b640 1 -- 172.21.15.82:0/2356588188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc130100a70 msgr2=0x7fc130197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc125d9b640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc130100a70 0x7fc130197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc125d9b640 1 -- 172.21.15.82:0/2356588188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc130102620 msgr2=0x7fc13019f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc125d9b640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc130102620 0x7fc13019f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc125d9b640 1 -- 172.21.15.82:0/2356588188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13019fa40 con 0x7fc130101c60 2024-03-27T07:23:01.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.649+0000 7fc125d9b640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc130101c60 0x7fc130198360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc11800d950 tx=0x7fc11800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.650+0000 7fc127fff640 1 -- 172.21.15.82:0/2356588188 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118017030 con 0x7fc130101c60 2024-03-27T07:23:01.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.650+0000 7fc134cb5640 1 -- 172.21.15.82:0/2356588188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13019fd30 con 0x7fc130101c60 2024-03-27T07:23:01.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.650+0000 7fc127fff640 1 -- 172.21.15.82:0/2356588188 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc118004020 con 0x7fc130101c60 2024-03-27T07:23:01.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.650+0000 7fc127fff640 1 -- 172.21.15.82:0/2356588188 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1180047a0 con 0x7fc130101c60 2024-03-27T07:23:01.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.650+0000 7fc134cb5640 1 -- 172.21.15.82:0/2356588188 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1301a0220 con 0x7fc130101c60 2024-03-27T07:23:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.652+0000 7fc127fff640 1 -- 172.21.15.82:0/2356588188 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7fc1180041d0 con 0x7fc130101c60 2024-03-27T07:23:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc13797a740 1 Processor -- start 2024-03-27T07:23:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc13797a740 1 -- start start 2024-03-27T07:23:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc13797a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a314fd0 0x55e65a3153f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc13797a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a3159c0 0x55e65a31a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc13797a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a31ab30 0x55e65a31cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc13797a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e65a27a010 con 0x55e65a314fd0 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc13797a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e65a222770 con 0x55e65a31ab30 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc13797a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e65a275fc0 con 0x55e65a3159c0 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc127fff640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc11c0a3610 0x7fc11c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc12ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a314fd0 0x55e65a3153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc12ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a314fd0 0x55e65a3153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34336/0 (socket says 172.21.15.82:34336) 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc12ed9d640 1 -- 172.21.15.82:0/2084162282 learned_addr learned my addr 172.21.15.82:0/2084162282 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc125d9b640 1 --2- 172.21.15.82:0/2084162282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a31ab30 0x55e65a31cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc12e59c640 1 --2- 172.21.15.82:0/2084162282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a3159c0 0x55e65a31a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc11c0a3610 0x7fc11c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc127fff640 1 -- 172.21.15.82:0/2356588188 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fc1180cf610 con 0x7fc130101c60 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc12ed9d640 1 -- 172.21.15.82:0/2084162282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a3159c0 msgr2=0x55e65a31a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/2084162282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a3159c0 0x55e65a31a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc12ed9d640 1 -- 172.21.15.82:0/2084162282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a31ab30 msgr2=0x55e65a31cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/2084162282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a31ab30 0x55e65a31cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.653+0000 7fc12ed9d640 1 -- 172.21.15.82:0/2084162282 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e65a241330 con 0x55e65a314fd0 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.654+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/2084162282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a314fd0 0x55e65a3153f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc1280324c0 tx=0x7fc12802ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701f377a626b742a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.654+0000 7fc124d99640 1 -- 172.21.15.82:0/2084162282 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128050070 con 0x55e65a314fd0 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.654+0000 7fc124d99640 1 -- 172.21.15.82:0/2084162282 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc128003b70 con 0x55e65a314fd0 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.654+0000 7fc124d99640 1 -- 172.21.15.82:0/2084162282 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128039040 con 0x55e65a314fd0 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.654+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc11c0a3610 0x7fc11c0a5ad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc12804d000 tx=0x7fc128048000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.654+0000 7fc13797a740 1 -- 172.21.15.82:0/2084162282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a314fd0 msgr2=0x55e65a3153f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.654+0000 7fc13797a740 1 --2- 172.21.15.82:0/2084162282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a314fd0 0x55e65a3153f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc1280324c0 tx=0x7fc12802ceb0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 -- 172.21.15.82:0/2084162282 shutdown_connections 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 --2- 172.21.15.82:0/2084162282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a31ab30 0x55e65a31cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 --2- 172.21.15.82:0/2084162282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a3159c0 0x55e65a31a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 --2- 172.21.15.82:0/2084162282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a314fd0 0x55e65a3153f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 -- 172.21.15.82:0/2084162282 >> 172.21.15.82:0/2084162282 conn(0x55e65a2dcb20 msgr2=0x55e65a310940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 -- 172.21.15.82:0/2084162282 shutdown_connections 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 -- 172.21.15.82:0/2084162282 wait complete. 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 -- start start 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 Processor -- start 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a31f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a31fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a326ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e65a31dae0 con 0x55e65a31ab30 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e65a235b30 con 0x55e65a3159c0 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e65a31dc60 con 0x55e65a314fd0 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc13797a740 10 client.0 _ll_register_callbacks cb 0x55e65a2711a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc12ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a326ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc12ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a326ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34338/0 (socket says 172.21.15.82:34338) 2024-03-27T07:23:01.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc12ed9d640 1 -- 172.21.15.82:0/661657847 learned_addr learned my addr 172.21.15.82:0/661657847 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc12e59c640 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a31f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.655+0000 7fc125d9b640 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a31fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc12ed9d640 1 -- 172.21.15.82:0/661657847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 msgr2=0x55e65a31f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a31f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc12ed9d640 1 -- 172.21.15.82:0/661657847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 msgr2=0x55e65a31fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a31fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc12ed9d640 1 -- 172.21.15.82:0/661657847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e659f8e2d0 con 0x55e65a31ab30 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a326ac0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc1280325d0 tx=0x7fc128004450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1ea0e2eb307541 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc115ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc115ffb640 1 -- 172.21.15.82:0/661657847 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128058020 con 0x55e65a31ab30 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc115ffb640 1 -- 172.21.15.82:0/661657847 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fc128003d20 con 0x55e65a31ab30 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc13797a740 1 -- 172.21.15.82:0/661657847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc128003b70 con 0x55e65a31ab30 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc115ffb640 1 -- 172.21.15.82:0/661657847 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc128039070 con 0x55e65a31ab30 2024-03-27T07:23:01.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc13797a740 10 client.15048 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc13797a740 1 -- 172.21.15.82:0/661657847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e65a0586b0 con 0x55e65a31ab30 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc115ffb640 1 -- 172.21.15.82:0/661657847 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc128003b70 con 0x55e65a31ab30 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc115ffb640 1 -- 172.21.15.82:0/661657847 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc12803f070 con 0x55e65a31ab30 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc13797a740 10 client.15048 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc13797a740 10 client.15048 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc13797a740 20 client.15048 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc13797a740 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e65a32bbb0 0x55e65a32d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc13797a740 4 client.15048 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.656+0000 7fc13797a740 1 -- 172.21.15.82:0/661657847 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e65a287550 con 0x55e65a32bbb0 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.657+0000 7fc12e59c640 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e65a32bbb0 0x55e65a32d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.657+0000 7fc115ffb640 10 client.15048 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.657+0000 7fc12e59c640 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e65a32bbb0 0x55e65a32d020 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=336c75c3dd9e0eb4 server_cookie=95ed9e36eea8463b in_seq=0 out_seq=0 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc115ffb640 1 -- 172.21.15.82:0/661657847 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e65a287550 con 0x55e65a32bbb0 2024-03-27T07:23:01.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc115ffb640 10 client.15048 handle_command_reply: tid=0 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 client.15048 shutdown 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 -- 172.21.15.82:0/661657847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 msgr2=0x55e65a326ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a326ac0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc1280325d0 tx=0x7fc128004450 comp rx=0 tx=0).stop 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 -- 172.21.15.82:0/661657847 shutdown_connections 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e65a32bbb0 0x55e65a32d020 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a326ac0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a31fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc115ffb640 0 client.15048 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 --2- 172.21.15.82:0/661657847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a31f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 -- 172.21.15.82:0/661657847 >> 172.21.15.82:0/661657847 conn(0x55e65a2dcb20 msgr2=0x55e65a30fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 -- 172.21.15.82:0/661657847 shutdown_connections 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 1 -- 172.21.15.82:0/661657847 wait complete. 2024-03-27T07:23:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.658+0000 7fc13797a740 20 client.15048 trim_cache size 0 max 16384 2024-03-27T07:23:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc13797a740 1 Processor -- start 2024-03-27T07:23:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc13797a740 1 -- start start 2024-03-27T07:23:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc13797a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a31d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc13797a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a326a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc13797a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a30b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc13797a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e65a32b360 con 0x55e65a31ab30 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc13797a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e65a32ba30 con 0x55e65a3159c0 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc13797a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e65a32c100 con 0x55e65a314fd0 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc12ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a30b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc12ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a30b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34344/0 (socket says 172.21.15.82:34344) 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc12ed9d640 1 -- 172.21.15.82:0/4101053134 learned_addr learned my addr 172.21.15.82:0/4101053134 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc125d9b640 1 --2- 172.21.15.82:0/4101053134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a326a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc12e59c640 1 --2- 172.21.15.82:0/4101053134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a31d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc12ed9d640 1 -- 172.21.15.82:0/4101053134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 msgr2=0x55e65a31d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/4101053134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a31d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc12ed9d640 1 -- 172.21.15.82:0/4101053134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 msgr2=0x55e65a326a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/4101053134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a326a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc12ed9d640 1 -- 172.21.15.82:0/4101053134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e65a31a160 con 0x55e65a31ab30 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc125d9b640 1 --2- 172.21.15.82:0/4101053134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a326a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/4101053134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a30b6a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc12802c630 tx=0x7fc128005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a3400758f4ab63 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.676+0000 7fc117fff640 1 -- 172.21.15.82:0/4101053134 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128058040 con 0x55e65a31ab30 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc117fff640 1 -- 172.21.15.82:0/4101053134 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1280098a0 con 0x55e65a31ab30 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc117fff640 1 -- 172.21.15.82:0/4101053134 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128050040 con 0x55e65a31ab30 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 -- 172.21.15.82:0/4101053134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 msgr2=0x55e65a30b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 --2- 172.21.15.82:0/4101053134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a30b6a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc12802c630 tx=0x7fc128005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 -- 172.21.15.82:0/4101053134 shutdown_connections 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 --2- 172.21.15.82:0/4101053134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a30b6a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 --2- 172.21.15.82:0/4101053134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a326a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 --2- 172.21.15.82:0/4101053134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a31d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 -- 172.21.15.82:0/4101053134 >> 172.21.15.82:0/4101053134 conn(0x55e65a2dcb20 msgr2=0x55e65a32ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 -- 172.21.15.82:0/4101053134 shutdown_connections 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 -- 172.21.15.82:0/4101053134 wait complete. 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 -- start start 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.677+0000 7fc13797a740 1 Processor -- start 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc13797a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a322430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc13797a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a322970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc13797a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a325990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc13797a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e65a32cea0 con 0x55e65a31ab30 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc13797a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e65a32c7d0 con 0x55e65a3159c0 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc13797a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e65a32d570 con 0x55e65a314fd0 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc13797a740 10 client.0 _ll_register_callbacks cb 0x7fc12804e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc12ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a325990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc12ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a325990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34350/0 (socket says 172.21.15.82:34350) 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc12ed9d640 1 -- 172.21.15.82:0/1262198365 learned_addr learned my addr 172.21.15.82:0/1262198365 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc12e59c640 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a322430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc125d9b640 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a322970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc12ed9d640 1 -- 172.21.15.82:0/1262198365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 msgr2=0x55e65a322430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a322430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc12ed9d640 1 -- 172.21.15.82:0/1262198365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 msgr2=0x55e65a322970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a322970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc12ed9d640 1 -- 172.21.15.82:0/1262198365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e65a325f80 con 0x55e65a31ab30 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc12ed9d640 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a325990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc128005c90 tx=0x7fc128004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e5705570cfec08 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc115ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc115ffb640 1 -- 172.21.15.82:0/1262198365 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12806d060 con 0x55e65a31ab30 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc115ffb640 1 -- 172.21.15.82:0/1262198365 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fc128003b70 con 0x55e65a31ab30 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc13797a740 1 -- 172.21.15.82:0/1262198365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1280098a0 con 0x55e65a31ab30 2024-03-27T07:23:01.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc115ffb640 1 -- 172.21.15.82:0/1262198365 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc128050030 con 0x55e65a31ab30 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc13797a740 10 client.15054 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.678+0000 7fc13797a740 1 -- 172.21.15.82:0/1262198365 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e65a391be0 con 0x55e65a31ab30 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc115ffb640 1 -- 172.21.15.82:0/1262198365 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1280098a0 con 0x55e65a31ab30 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc115ffb640 1 -- 172.21.15.82:0/1262198365 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc12803f040 con 0x55e65a31ab30 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc13797a740 10 client.15054 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc13797a740 10 client.15054 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc13797a740 20 client.15054 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc13797a740 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e65a396380 0x55e65a392e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc13797a740 4 client.15054 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc13797a740 1 -- 172.21.15.82:0/1262198365 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "status"}) -- 0x55e65a2818a0 con 0x55e65a396380 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc12e59c640 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e65a396380 0x55e65a392e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc115ffb640 10 client.15054 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.679+0000 7fc12e59c640 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e65a396380 0x55e65a392e90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2e63ea0e89cf02d server_cookie=a1d9232865c454c4 in_seq=0 out_seq=0 2024-03-27T07:23:01.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc115ffb640 1 -- 172.21.15.82:0/1262198365 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e65a2818a0 con 0x55e65a396380 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc115ffb640 10 client.15054 handle_command_reply: tid=0 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 client.15054 shutdown 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 -- 172.21.15.82:0/1262198365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 msgr2=0x55e65a325990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a325990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc128005c90 tx=0x7fc128004760 comp rx=0 tx=0).stop 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 -- 172.21.15.82:0/1262198365 shutdown_connections 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e65a396380 0x55e65a392e90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e65a31ab30 0x55e65a325990 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e65a3159c0 0x55e65a322970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc115ffb640 0 client.15054 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 --2- 172.21.15.82:0/1262198365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e65a314fd0 0x55e65a322430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 -- 172.21.15.82:0/1262198365 >> 172.21.15.82:0/1262198365 conn(0x55e65a2dcb20 msgr2=0x55e65a30b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 -- 172.21.15.82:0/1262198365 shutdown_connections 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 1 -- 172.21.15.82:0/1262198365 wait complete. 2024-03-27T07:23:01.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc13797a740 20 client.15054 trim_cache size 0 max 16384 2024-03-27T07:23:01.690 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:23:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "604548c2-ec09-11ee-95d0-87774f69a715", 2024-03-27T07:23:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-03-27T07:23:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24470, 2024-03-27T07:23:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-27T07:23:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-27T07:23:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-27T07:23:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 83.094340122999995, 2024-03-27T07:23:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 21, 2024-03-27T07:23:01.690 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2024-03-27T07:23:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2024-03-27T07:23:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 104.520174536 2024-03-27T07:23:01.691 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:23:01.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 -- 172.21.15.82:0/2356588188 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc11c0a3610 msgr2=0x7fc11c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc11c0a3610 0x7fc11c0a5ad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc12804d000 tx=0x7fc128048000 comp rx=0 tx=0).stop 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 -- 172.21.15.82:0/2356588188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc130101c60 msgr2=0x7fc130198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc130101c60 0x7fc130198360 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc11800d950 tx=0x7fc11800de10 comp rx=0 tx=0).stop 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 -- 172.21.15.82:0/2356588188 shutdown_connections 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fc11c0a3610 0x7fc11c0a5ad0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc130101c60 0x7fc130198360 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc130102620 0x7fc13019f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 --2- 172.21.15.82:0/2356588188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc130100a70 0x7fc130197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 -- 172.21.15.82:0/2356588188 >> 172.21.15.82:0/2356588188 conn(0x7fc1300fc000 msgr2=0x7fc13006a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.680+0000 7fc134cb5640 1 -- 172.21.15.82:0/2356588188 shutdown_connections 2024-03-27T07:23:01.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.681+0000 7fc134cb5640 1 -- 172.21.15.82:0/2356588188 wait complete. 2024-03-27T07:23:01.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-03-27T07:23:01.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.793+0000 7f5e47f55640 1 -- 172.21.15.82:0/2808265645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40102610 msgr2=0x7f5e40108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.793+0000 7f5e47f55640 1 --2- 172.21.15.82:0/2808265645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40102610 0x7f5e40108ea0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009ca0 tx=0x7f5e3802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.793+0000 7f5e47f55640 1 -- 172.21.15.82:0/2808265645 shutdown_connections 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.793+0000 7f5e47f55640 1 --2- 172.21.15.82:0/2808265645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40102610 0x7f5e40108ea0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.793+0000 7f5e47f55640 1 --2- 172.21.15.82:0/2808265645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e40101c50 0x7f5e401020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.793+0000 7f5e47f55640 1 --2- 172.21.15.82:0/2808265645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40100a60 0x7f5e40100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.793+0000 7f5e47f55640 1 -- 172.21.15.82:0/2808265645 >> 172.21.15.82:0/2808265645 conn(0x7f5e400fbff0 msgr2=0x7f5e400fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.793+0000 7f5e47f55640 1 -- 172.21.15.82:0/2808265645 shutdown_connections 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.793+0000 7f5e47f55640 1 -- 172.21.15.82:0/2808265645 wait complete. 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e47f55640 1 Processor -- start 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e47f55640 1 -- start start 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e47f55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40100a60 0x7f5e4006ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e47f55640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e40101c50 0x7f5e4019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e47f55640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102610 0x7f5e4019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e47f55640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4010c6c0 con 0x7f5e40100a60 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e47f55640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4010c540 con 0x7f5e40102610 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e47f55640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4010c840 con 0x7f5e40101c50 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e45cf1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40100a60 0x7f5e4006ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e45cf1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40100a60 0x7f5e4006ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34366/0 (socket says 172.21.15.82:34366) 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e45cf1640 1 -- 172.21.15.82:0/355167965 learned_addr learned my addr 172.21.15.82:0/355167965 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e454f0640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e40101c50 0x7f5e4019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e464f2640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102610 0x7f5e4019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e45cf1640 1 -- 172.21.15.82:0/355167965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e40101c50 msgr2=0x7f5e4019cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e40101c50 0x7f5e4019cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e45cf1640 1 -- 172.21.15.82:0/355167965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102610 msgr2=0x7f5e4019f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102610 0x7f5e4019f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e45cf1640 1 -- 172.21.15.82:0/355167965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4019fab0 con 0x7f5e40100a60 2024-03-27T07:23:01.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e464f2640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102610 0x7f5e4019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:23:01.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40100a60 0x7f5e4006ac90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00e9c0 tx=0x7f5e3c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.794+0000 7f5e36ffd640 1 -- 172.21.15.82:0/355167965 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00cd80 con 0x7f5e40100a60 2024-03-27T07:23:01.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.795+0000 7f5e36ffd640 1 -- 172.21.15.82:0/355167965 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e3c0035f0 con 0x7f5e40100a60 2024-03-27T07:23:01.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.795+0000 7f5e47f55640 1 -- 172.21.15.82:0/355167965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4019fd40 con 0x7f5e40100a60 2024-03-27T07:23:01.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.795+0000 7f5e36ffd640 1 -- 172.21.15.82:0/355167965 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c010690 con 0x7f5e40100a60 2024-03-27T07:23:01.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.795+0000 7f5e47f55640 1 -- 172.21.15.82:0/355167965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e401a01d0 con 0x7f5e40100a60 2024-03-27T07:23:01.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e36ffd640 1 -- 172.21.15.82:0/355167965 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f5e3c0037a0 con 0x7f5e40100a60 2024-03-27T07:23:01.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e4ac0e740 1 Processor -- start 2024-03-27T07:23:01.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e4ac0e740 1 -- start start 2024-03-27T07:23:01.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cbfd0 0x55b0d07cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b0d0731010 con 0x55b0d07d1b30 2024-03-27T07:23:01.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b0d06d9770 con 0x55b0d07cbfd0 2024-03-27T07:23:01.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b0d072cfc0 con 0x55b0d07cc9c0 2024-03-27T07:23:01.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e454f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e464f2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cbfd0 0x55b0d07cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e36ffd640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5e2c0a3610 0x7f5e2c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e454f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07d3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34382/0 (socket says 172.21.15.82:34382) 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e454f0640 1 -- 172.21.15.82:0/1158511209 learned_addr learned my addr 172.21.15.82:0/1158511209 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.797+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/1158511209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e464f2640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5e2c0a3610 0x7f5e2c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e454f0640 1 -- 172.21.15.82:0/1158511209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cc9c0 msgr2=0x55b0d07d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e454f0640 1 --2- 172.21.15.82:0/1158511209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e454f0640 1 -- 172.21.15.82:0/1158511209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cbfd0 msgr2=0x55b0d07cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e454f0640 1 --2- 172.21.15.82:0/1158511209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cbfd0 0x55b0d07cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e454f0640 1 -- 172.21.15.82:0/1158511209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0d06f8330 con 0x55b0d07d1b30 2024-03-27T07:23:01.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e464f2640 1 --2- 172.21.15.82:0/1158511209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cbfd0 0x55b0d07cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e36ffd640 1 -- 172.21.15.82:0/355167965 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f5e3c0d0170 con 0x7f5e40100a60 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e454f0640 1 --2- 172.21.15.82:0/1158511209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07d3fc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009c90 tx=0x7f5e30011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e593d27102cdfa server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e464f2640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5e2c0a3610 0x7f5e2c0a5ad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5e38006010 tx=0x7f5e3802c0f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e2bfff640 1 -- 172.21.15.82:0/1158511209 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3001e070 con 0x55b0d07d1b30 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e2bfff640 1 -- 172.21.15.82:0/1158511209 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e30019b10 con 0x55b0d07d1b30 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.798+0000 7f5e2bfff640 1 -- 172.21.15.82:0/1158511209 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000eaf0 con 0x55b0d07d1b30 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/1158511209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 msgr2=0x55b0d07d3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/1158511209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07d3fc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009c90 tx=0x7f5e30011810 comp rx=0 tx=0).stop 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/1158511209 shutdown_connections 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/1158511209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07d3fc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/1158511209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/1158511209 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cbfd0 0x55b0d07cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/1158511209 >> 172.21.15.82:0/1158511209 conn(0x55b0d0793b20 msgr2=0x55b0d07c7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/1158511209 shutdown_connections 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/1158511209 wait complete. 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 -- start start 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.799+0000 7f5e4ac0e740 1 Processor -- start 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07d6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07dda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b0d07d4ae0 con 0x55b0d07d1b30 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b0d06ecb30 con 0x55b0d07cc9c0 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b0d07d4c60 con 0x55b0d07cbfd0 2024-03-27T07:23:01.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e4ac0e740 10 client.0 _ll_register_callbacks cb 0x55b0d07281a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e464f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07dda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e464f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07dda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34384/0 (socket says 172.21.15.82:34384) 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e464f2640 1 -- 172.21.15.82:0/3789294964 learned_addr learned my addr 172.21.15.82:0/3789294964 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e454f0640 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e464f2640 1 -- 172.21.15.82:0/3789294964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 msgr2=0x55b0d07d6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e464f2640 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07d6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e464f2640 1 -- 172.21.15.82:0/3789294964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cc9c0 msgr2=0x55b0d07d69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e464f2640 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e464f2640 1 -- 172.21.15.82:0/3789294964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0d04452d0 con 0x55b0d07d1b30 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e464f2640 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07dda00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009ca0 tx=0x7f5e380095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2104550ac2c599b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e297fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:01.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e297fa640 1 -- 172.21.15.82:0/3789294964 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e38039040 con 0x55b0d07d1b30 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e297fa640 1 -- 172.21.15.82:0/3789294964 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f5e38004040 con 0x55b0d07d1b30 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3789294964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e30019b10 con 0x55b0d07d1b30 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e297fa640 1 -- 172.21.15.82:0/3789294964 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5e38032e40 con 0x55b0d07d1b30 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e4ac0e740 10 client.15066 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.800+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3789294964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b0d050f6b0 con 0x55b0d07d1b30 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e297fa640 1 -- 172.21.15.82:0/3789294964 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e30019b10 con 0x55b0d07d1b30 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e297fa640 1 -- 172.21.15.82:0/3789294964 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5e38059930 con 0x55b0d07d1b30 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e4ac0e740 10 client.15066 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e4ac0e740 10 client.15066 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e4ac0e740 20 client.15066 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b0d07e2ef0 0x55b0d07e4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e4ac0e740 4 client.15066 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3789294964 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0d073e550 con 0x55b0d07e2ef0 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b0d07e2ef0 0x55b0d07e4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e297fa640 10 client.15066 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.801+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b0d07e2ef0 0x55b0d07e4360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6094e1af9a87b68b server_cookie=ac90a92a686463fc in_seq=0 out_seq=0 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.802+0000 7f5e297fa640 1 -- 172.21.15.82:0/3789294964 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b0d073e550 con 0x55b0d07e2ef0 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.802+0000 7f5e297fa640 10 client.15066 handle_command_reply: tid=0 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.802+0000 7f5e4ac0e740 1 client.15066 shutdown 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.802+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3789294964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 msgr2=0x55b0d07dda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.802+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07dda00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009ca0 tx=0x7f5e380095c0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.803+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3789294964 shutdown_connections 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.803+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b0d07e2ef0 0x55b0d07e4360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.803+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07d1b30 0x55b0d07dda00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.803+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.803+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/3789294964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07d6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.803+0000 7f5e297fa640 0 client.15066 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:23:01.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.803+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3789294964 >> 172.21.15.82:0/3789294964 conn(0x55b0d0793b20 msgr2=0x55b0d07c6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.803+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3789294964 shutdown_connections 2024-03-27T07:23:01.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.803+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3789294964 wait complete. 2024-03-27T07:23:01.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.803+0000 7f5e4ac0e740 20 client.15066 trim_cache size 0 max 16384 2024-03-27T07:23:01.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.820+0000 7f5e4ac0e740 1 Processor -- start 2024-03-27T07:23:01.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.820+0000 7f5e4ac0e740 1 -- start start 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.820+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.820+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.820+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07d1b30 0x55b0d07dd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.820+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b0d07e26a0 con 0x55b0d07cc9c0 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.820+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b0d07e2d70 con 0x55b0d07d1b30 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.820+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b0d07e3440 con 0x55b0d07cbfd0 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.820+0000 7f5e454f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e454f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34394/0 (socket says 172.21.15.82:34394) 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e454f0640 1 -- 172.21.15.82:0/3455695498 learned_addr learned my addr 172.21.15.82:0/3455695498 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/3455695498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e464f2640 1 --2- 172.21.15.82:0/3455695498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07d1b30 0x55b0d07dd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e454f0640 1 -- 172.21.15.82:0/3455695498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 msgr2=0x55b0d07cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e454f0640 1 --2- 172.21.15.82:0/3455695498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e454f0640 1 -- 172.21.15.82:0/3455695498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07d1b30 msgr2=0x55b0d07dd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e454f0640 1 --2- 172.21.15.82:0/3455695498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07d1b30 0x55b0d07dd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e454f0640 1 -- 172.21.15.82:0/3455695498 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0d07ccda0 con 0x55b0d07cc9c0 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e454f0640 1 --2- 172.21.15.82:0/3455695498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07ce3a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55b0d07c8890 tx=0x7f5e30009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a37709a52b965a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e2b7fe640 1 -- 172.21.15.82:0/3455695498 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30028070 con 0x55b0d07cc9c0 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e2b7fe640 1 -- 172.21.15.82:0/3455695498 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e3001f040 con 0x55b0d07cc9c0 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.821+0000 7f5e2b7fe640 1 -- 172.21.15.82:0/3455695498 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3001e030 con 0x55b0d07cc9c0 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3455695498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 msgr2=0x55b0d07ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/3455695498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07ce3a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55b0d07c8890 tx=0x7f5e30009fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3455695498 shutdown_connections 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/3455695498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07ce3a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/3455695498 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07d1b30 0x55b0d07dd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/3455695498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3455695498 >> 172.21.15.82:0/3455695498 conn(0x55b0d0793b20 msgr2=0x55b0d07d6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3455695498 shutdown_connections 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/3455695498 wait complete. 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 -- start start 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 Processor -- start 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07d94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07d1b30 0x55b0d07dca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b0d07e41e0 con 0x55b0d07cc9c0 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b0d07e3b10 con 0x55b0d07d1b30 2024-03-27T07:23:01.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b0d07e48b0 con 0x55b0d07cbfd0 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e4ac0e740 10 client.0 _ll_register_callbacks cb 0x7f5e3c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e454f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e454f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34400/0 (socket says 172.21.15.82:34400) 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e454f0640 1 -- 172.21.15.82:0/2314471308 learned_addr learned my addr 172.21.15.82:0/2314471308 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07d94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.822+0000 7f5e464f2640 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07d1b30 0x55b0d07dca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e454f0640 1 -- 172.21.15.82:0/2314471308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 msgr2=0x55b0d07d94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e454f0640 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07d94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e454f0640 1 -- 172.21.15.82:0/2314471308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07d1b30 msgr2=0x55b0d07dca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e454f0640 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07d1b30 0x55b0d07dca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e454f0640 1 -- 172.21.15.82:0/2314471308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0d07dd020 con 0x55b0d07cc9c0 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e454f0640 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d9a10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5e3001c040 tx=0x7f5e30005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf8d300b3e7e741 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e297fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e297fa640 1 -- 172.21.15.82:0/2314471308 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30034070 con 0x55b0d07cc9c0 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e297fa640 1 -- 172.21.15.82:0/2314471308 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f5e300054d0 con 0x55b0d07cc9c0 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/2314471308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e3001f040 con 0x55b0d07cc9c0 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e297fa640 1 -- 172.21.15.82:0/2314471308 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5e3003f050 con 0x55b0d07cc9c0 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e4ac0e740 10 client.15072 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/2314471308 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b0d0848f90 con 0x55b0d07cc9c0 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e297fa640 1 -- 172.21.15.82:0/2314471308 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e3001f040 con 0x55b0d07cc9c0 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e297fa640 1 -- 172.21.15.82:0/2314471308 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5e3002d450 con 0x55b0d07cc9c0 2024-03-27T07:23:01.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e4ac0e740 10 client.15072 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e4ac0e740 10 client.15072 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e4ac0e740 20 client.15072 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b0d084d3d0 0x55b0d084c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e4ac0e740 4 client.15072 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.823+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/2314471308 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "status"}) -- 0x55b0d07388a0 con 0x55b0d084d3d0 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b0d084d3d0 0x55b0d084c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e297fa640 10 client.15072 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e45cf1640 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b0d084d3d0 0x55b0d084c0e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5abdbccdd2776139 server_cookie=9aec45222faf0dee in_seq=0 out_seq=0 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e297fa640 1 -- 172.21.15.82:0/2314471308 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b0d07388a0 con 0x55b0d084d3d0 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e297fa640 10 client.15072 handle_command_reply: tid=0 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 client.15072 shutdown 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/2314471308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 msgr2=0x55b0d07d9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d9a10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5e3001c040 tx=0x7f5e30005b20 comp rx=0 tx=0).stop 2024-03-27T07:23:01.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/2314471308 shutdown_connections 2024-03-27T07:23:01.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b0d084d3d0 0x55b0d084c0e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b0d07cc9c0 0x55b0d07d9a10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e297fa640 0 client.15072 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:23:01.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b0d07d1b30 0x55b0d07dca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 --2- 172.21.15.82:0/2314471308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b0d07cbfd0 0x55b0d07d94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/2314471308 >> 172.21.15.82:0/2314471308 conn(0x55b0d0793b20 msgr2=0x55b0d07d6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/2314471308 shutdown_connections 2024-03-27T07:23:01.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 1 -- 172.21.15.82:0/2314471308 wait complete. 2024-03-27T07:23:01.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.824+0000 7f5e4ac0e740 20 client.15072 trim_cache size 0 max 16384 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "604548c2-ec09-11ee-95d0-87774f69a715", 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24484, 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 84.255558492999995, 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 21, 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2024-03-27T07:23:01.835 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2024-03-27T07:23:01.836 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 101.767236352 2024-03-27T07:23:01.836 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 -- 172.21.15.82:0/355167965 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5e2c0a3610 msgr2=0x7f5e2c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5e2c0a3610 0x7f5e2c0a5ad0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5e38006010 tx=0x7f5e3802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 -- 172.21.15.82:0/355167965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40100a60 msgr2=0x7f5e4006ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40100a60 0x7f5e4006ac90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00e9c0 tx=0x7f5e3c00ee80 comp rx=0 tx=0).stop 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 -- 172.21.15.82:0/355167965 shutdown_connections 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f5e2c0a3610 0x7f5e2c0a5ad0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e40102610 0x7f5e4019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e40101c50 0x7f5e4019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 --2- 172.21.15.82:0/355167965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e40100a60 0x7f5e4006ac90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 -- 172.21.15.82:0/355167965 >> 172.21.15.82:0/355167965 conn(0x7f5e400fbff0 msgr2=0x7f5e40104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 -- 172.21.15.82:0/355167965 shutdown_connections 2024-03-27T07:23:01.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.825+0000 7f5e47f55640 1 -- 172.21.15.82:0/355167965 wait complete. 2024-03-27T07:23:01.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:01 smithi082 ceph-mon[32178]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:23:01.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:01 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1573166391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:01.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:01 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3440204918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:01.838 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:01 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/121808333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:01.839 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-27T07:23:01.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.939+0000 7f32da24d640 1 -- 172.21.15.82:0/4005906283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d41025f0 msgr2=0x7f32d41049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.939+0000 7f32da24d640 1 --2- 172.21.15.82:0/4005906283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d41025f0 0x7f32d41049e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f32c4009860 tx=0x7f32c402bb70 comp rx=0 tx=0).stop 2024-03-27T07:23:01.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.939+0000 7f32da24d640 1 -- 172.21.15.82:0/4005906283 shutdown_connections 2024-03-27T07:23:01.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.939+0000 7f32da24d640 1 --2- 172.21.15.82:0/4005906283 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32d4107850 0x7f32d4109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.939+0000 7f32da24d640 1 --2- 172.21.15.82:0/4005906283 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32d4104f20 0x7f32d4107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.939+0000 7f32da24d640 1 --2- 172.21.15.82:0/4005906283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d41025f0 0x7f32d41049e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.939+0000 7f32da24d640 1 -- 172.21.15.82:0/4005906283 >> 172.21.15.82:0/4005906283 conn(0x7f32d40fc000 msgr2=0x7f32d40fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.939+0000 7f32da24d640 1 -- 172.21.15.82:0/4005906283 shutdown_connections 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.939+0000 7f32da24d640 1 -- 172.21.15.82:0/4005906283 wait complete. 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32da24d640 1 Processor -- start 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32da24d640 1 -- start start 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32da24d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32d41025f0 0x7f32d4197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32da24d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d4104f20 0x7f32d4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32da24d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32d4107850 0x7f32d419f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32da24d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f32d410d7f0 con 0x7f32d41025f0 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32da24d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f32d410d670 con 0x7f32d4107850 2024-03-27T07:23:01.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32da24d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f32d410d970 con 0x7f32d4104f20 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32d37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32d41025f0 0x7f32d4197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32d37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32d41025f0 0x7f32d4197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34418/0 (socket says 172.21.15.82:34418) 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32d37fe640 1 -- 172.21.15.82:0/2862068484 learned_addr learned my addr 172.21.15.82:0/2862068484 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32d2ffd640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d4104f20 0x7f32d4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32d3fff640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32d4107850 0x7f32d419f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32d37fe640 1 -- 172.21.15.82:0/2862068484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d4104f20 msgr2=0x7f32d4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32d37fe640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d4104f20 0x7f32d4198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32d37fe640 1 -- 172.21.15.82:0/2862068484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32d4107850 msgr2=0x7f32d419f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32d37fe640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32d4107850 0x7f32d419f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.940+0000 7f32d37fe640 1 -- 172.21.15.82:0/2862068484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d419fb10 con 0x7f32d41025f0 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.941+0000 7f32d37fe640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32d41025f0 0x7f32d4197ef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005940 tx=0x7f32c4032470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.941+0000 7f32d0ff9640 1 -- 172.21.15.82:0/2862068484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4041020 con 0x7f32d41025f0 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.941+0000 7f32da24d640 1 -- 172.21.15.82:0/2862068484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d419fda0 con 0x7f32d41025f0 2024-03-27T07:23:01.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.941+0000 7f32d0ff9640 1 -- 172.21.15.82:0/2862068484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32c402c9f0 con 0x7f32d41025f0 2024-03-27T07:23:01.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.941+0000 7f32d0ff9640 1 -- 172.21.15.82:0/2862068484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c4039040 con 0x7f32d41025f0 2024-03-27T07:23:01.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.941+0000 7f32da24d640 1 -- 172.21.15.82:0/2862068484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d41a0220 con 0x7f32d41025f0 2024-03-27T07:23:01.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.943+0000 7f32d0ff9640 1 -- 172.21.15.82:0/2862068484 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f32c4044020 con 0x7f32d41025f0 2024-03-27T07:23:01.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.943+0000 7f32dce30740 1 Processor -- start 2024-03-27T07:23:01.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.943+0000 7f32dce30740 1 -- start start 2024-03-27T07:23:01.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.943+0000 7f32dce30740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db51fd0 0x55b80db523f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.943+0000 7f32dce30740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db529c0 0x55b80db574c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.943+0000 7f32dce30740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db57b30 0x55b80db59fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.943+0000 7f32dce30740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b80dab7010 con 0x55b80db51fd0 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.943+0000 7f32dce30740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b80da5f770 con 0x55b80db57b30 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.943+0000 7f32dce30740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b80dab2fc0 con 0x55b80db529c0 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db51fd0 0x55b80db523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d0ff9640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f32bc0a3610 0x7f32bc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db51fd0 0x55b80db523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34426/0 (socket says 172.21.15.82:34426) 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 -- 172.21.15.82:0/1238361273 learned_addr learned my addr 172.21.15.82:0/1238361273 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d2ffd640 1 --2- 172.21.15.82:0/1238361273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db57b30 0x55b80db59fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d37fe640 1 --2- 172.21.15.82:0/1238361273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db529c0 0x55b80db574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f32bc0a3610 0x7f32bc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d0ff9640 1 -- 172.21.15.82:0/2862068484 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f32c40f16f0 con 0x7f32d41025f0 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 -- 172.21.15.82:0/1238361273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db529c0 msgr2=0x55b80db574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 --2- 172.21.15.82:0/1238361273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db529c0 0x55b80db574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 -- 172.21.15.82:0/1238361273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db57b30 msgr2=0x55b80db59fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 --2- 172.21.15.82:0/1238361273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db57b30 0x55b80db59fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 -- 172.21.15.82:0/1238361273 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b80da7e330 con 0x55b80db51fd0 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 --2- 172.21.15.82:0/1238361273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db51fd0 0x55b80db523f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32cc005c40 tx=0x7f32cc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd820f8595a6a40 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32b9ffb640 1 -- 172.21.15.82:0/1238361273 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc020030 con 0x55b80db51fd0 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32d3fff640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f32bc0a3610 0x7f32bc0a5ad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32cc023000 tx=0x7f32cc021000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32b9ffb640 1 -- 172.21.15.82:0/1238361273 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32cc01c8f0 con 0x55b80db51fd0 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.944+0000 7f32b9ffb640 1 -- 172.21.15.82:0/1238361273 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc024620 con 0x55b80db51fd0 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.945+0000 7f32dce30740 1 -- 172.21.15.82:0/1238361273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db51fd0 msgr2=0x55b80db523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.945+0000 7f32dce30740 1 --2- 172.21.15.82:0/1238361273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db51fd0 0x55b80db523f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32cc005c40 tx=0x7f32cc00ee30 comp rx=0 tx=0).stop 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.945+0000 7f32dce30740 1 -- 172.21.15.82:0/1238361273 shutdown_connections 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.945+0000 7f32dce30740 1 --2- 172.21.15.82:0/1238361273 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db57b30 0x55b80db59fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.945+0000 7f32dce30740 1 --2- 172.21.15.82:0/1238361273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db529c0 0x55b80db574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.945+0000 7f32dce30740 1 --2- 172.21.15.82:0/1238361273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db51fd0 0x55b80db523f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.945+0000 7f32dce30740 1 -- 172.21.15.82:0/1238361273 >> 172.21.15.82:0/1238361273 conn(0x55b80db19b20 msgr2=0x55b80db4d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.945+0000 7f32dce30740 1 -- 172.21.15.82:0/1238361273 shutdown_connections 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.945+0000 7f32dce30740 1 -- 172.21.15.82:0/1238361273 wait complete. 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.945+0000 7f32dce30740 1 -- start start 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32dce30740 1 Processor -- start 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32dce30740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 0x55b80db5c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32dce30740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db529c0 0x55b80db5ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32dce30740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db63a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32dce30740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b80db5aae0 con 0x55b80db57b30 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32dce30740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b80da72b30 con 0x55b80db529c0 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32dce30740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b80db5ac60 con 0x55b80db51fd0 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32dce30740 10 client.0 _ll_register_callbacks cb 0x55b80daae1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:01.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db63a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db63a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34442/0 (socket says 172.21.15.82:34442) 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d37fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 0x55b80db5c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d3fff640 1 -- 172.21.15.82:0/360360341 learned_addr learned my addr 172.21.15.82:0/360360341 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d2ffd640 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db529c0 0x55b80db5ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d3fff640 1 -- 172.21.15.82:0/360360341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 msgr2=0x55b80db5c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d3fff640 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 0x55b80db5c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d3fff640 1 -- 172.21.15.82:0/360360341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db529c0 msgr2=0x55b80db5ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d3fff640 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db529c0 0x55b80db5ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d3fff640 1 -- 172.21.15.82:0/360360341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b80d7cb2d0 con 0x55b80db57b30 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d37fe640 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 0x55b80db5c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32d3fff640 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db63a60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00d7b0 tx=0x7f32cc01df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b24f6be631fdb5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32b2ffd640 1 -- 172.21.15.82:0/360360341 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc020070 con 0x55b80db57b30 2024-03-27T07:23:01.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32b2ffd640 1 -- 172.21.15.82:0/360360341 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f32cc01c610 con 0x55b80db57b30 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.946+0000 7f32dce30740 1 -- 172.21.15.82:0/360360341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32cc01c8f0 con 0x55b80db57b30 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32b2ffd640 1 -- 172.21.15.82:0/360360341 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f32cc038070 con 0x55b80db57b30 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32dce30740 10 client.15084 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32dce30740 1 -- 172.21.15.82:0/360360341 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b80d8956b0 con 0x55b80db57b30 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32b2ffd640 1 -- 172.21.15.82:0/360360341 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32cc01c8f0 con 0x55b80db57b30 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32b2ffd640 1 -- 172.21.15.82:0/360360341 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f32cc00b040 con 0x55b80db57b30 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32dce30740 10 client.15084 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32dce30740 10 client.15084 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32dce30740 20 client.15084 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32dce30740 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b80db68e00 0x55b80db6a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32dce30740 4 client.15084 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32dce30740 1 -- 172.21.15.82:0/360360341 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b80dac4550 con 0x55b80db68e00 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.947+0000 7f32d37fe640 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b80db68e00 0x55b80db6a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.948+0000 7f32d37fe640 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b80db68e00 0x55b80db6a270 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e465a61b8965d2dd server_cookie=3c7ba00dbea42f63 in_seq=0 out_seq=0 2024-03-27T07:23:01.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.948+0000 7f32b2ffd640 10 client.15084 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32b2ffd640 1 -- 172.21.15.82:0/360360341 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b80dac4550 con 0x55b80db68e00 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32b2ffd640 10 client.15084 handle_command_reply: tid=0 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 client.15084 shutdown 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 -- 172.21.15.82:0/360360341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 msgr2=0x55b80db63a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db63a60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00d7b0 tx=0x7f32cc01df80 comp rx=0 tx=0).stop 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 -- 172.21.15.82:0/360360341 shutdown_connections 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b80db68e00 0x55b80db6a270 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db63a60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32b2ffd640 0 client.15084 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db529c0 0x55b80db5ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 --2- 172.21.15.82:0/360360341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 0x55b80db5c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 -- 172.21.15.82:0/360360341 >> 172.21.15.82:0/360360341 conn(0x55b80db19b20 msgr2=0x55b80db4cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 -- 172.21.15.82:0/360360341 shutdown_connections 2024-03-27T07:23:01.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 1 -- 172.21.15.82:0/360360341 wait complete. 2024-03-27T07:23:01.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.949+0000 7f32dce30740 20 client.15084 trim_cache size 0 max 16384 2024-03-27T07:23:01.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.966+0000 7f32dce30740 1 Processor -- start 2024-03-27T07:23:01.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32dce30740 1 -- start start 2024-03-27T07:23:01.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32dce30740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 0x55b80db5c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32dce30740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db529c0 0x55b80db5c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32dce30740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db71540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32dce30740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b80db685b0 con 0x55b80db57b30 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32dce30740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b80db68c80 con 0x55b80db529c0 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32dce30740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b80db69350 con 0x55b80db51fd0 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db71540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db71540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34444/0 (socket says 172.21.15.82:34444) 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d3fff640 1 -- 172.21.15.82:0/2745299697 learned_addr learned my addr 172.21.15.82:0/2745299697 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d37fe640 1 --2- 172.21.15.82:0/2745299697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 0x55b80db5c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d2ffd640 1 --2- 172.21.15.82:0/2745299697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db529c0 0x55b80db5c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d3fff640 1 -- 172.21.15.82:0/2745299697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 msgr2=0x55b80db5c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d3fff640 1 --2- 172.21.15.82:0/2745299697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 0x55b80db5c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d3fff640 1 -- 172.21.15.82:0/2745299697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db529c0 msgr2=0x55b80db5c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d3fff640 1 --2- 172.21.15.82:0/2745299697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db529c0 0x55b80db5c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d3fff640 1 -- 172.21.15.82:0/2745299697 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b80db4e690 con 0x55b80db57b30 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32d3fff640 1 --2- 172.21.15.82:0/2745299697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db71540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f32cc024f90 tx=0x7f32cc0246f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b402a9ed667e8d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32b97fa640 1 -- 172.21.15.82:0/2745299697 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc020040 con 0x55b80db57b30 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32b97fa640 1 -- 172.21.15.82:0/2745299697 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32cc009cc0 con 0x55b80db57b30 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.967+0000 7f32b97fa640 1 -- 172.21.15.82:0/2745299697 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32cc02c070 con 0x55b80db57b30 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 -- 172.21.15.82:0/2745299697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 msgr2=0x55b80db71540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 --2- 172.21.15.82:0/2745299697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db71540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f32cc024f90 tx=0x7f32cc0246f0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 -- 172.21.15.82:0/2745299697 shutdown_connections 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 --2- 172.21.15.82:0/2745299697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db57b30 0x55b80db71540 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 --2- 172.21.15.82:0/2745299697 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db529c0 0x55b80db5c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 --2- 172.21.15.82:0/2745299697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db51fd0 0x55b80db5c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 -- 172.21.15.82:0/2745299697 >> 172.21.15.82:0/2745299697 conn(0x55b80db19b20 msgr2=0x55b80db67d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 -- 172.21.15.82:0/2745299697 shutdown_connections 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 -- 172.21.15.82:0/2745299697 wait complete. 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 -- start start 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.968+0000 7f32dce30740 1 Processor -- start 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32dce30740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db51fd0 0x55b80dbccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32dce30740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db529c0 0x55b80dbcf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32dce30740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db57b30 0x55b80dbd1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32dce30740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b80db6a0f0 con 0x55b80db529c0 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32dce30740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b80db69a20 con 0x55b80db51fd0 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32dce30740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b80db6a7c0 con 0x55b80db57b30 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32dce30740 10 client.0 _ll_register_callbacks cb 0x7f32c8009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db529c0 0x55b80dbcf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db529c0 0x55b80dbcf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34446/0 (socket says 172.21.15.82:34446) 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d2ffd640 1 -- 172.21.15.82:0/3258932876 learned_addr learned my addr 172.21.15.82:0/3258932876 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:01.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d37fe640 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db51fd0 0x55b80dbccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d3fff640 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db57b30 0x55b80dbd1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d2ffd640 1 -- 172.21.15.82:0/3258932876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db57b30 msgr2=0x55b80dbd1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d2ffd640 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db57b30 0x55b80dbd1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d2ffd640 1 -- 172.21.15.82:0/3258932876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db51fd0 msgr2=0x55b80dbccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d2ffd640 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db51fd0 0x55b80dbccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d2ffd640 1 -- 172.21.15.82:0/3258932876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b80dbd1e70 con 0x55b80db529c0 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32d2ffd640 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db529c0 0x55b80dbcf0b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32d4199400 tx=0x7f32c8012d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6492d6973642fc0e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32b2ffd640 1 -- 172.21.15.82:0/3258932876 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8004230 con 0x55b80db529c0 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32b2ffd640 1 -- 172.21.15.82:0/3258932876 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f32c80043d0 con 0x55b80db529c0 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32dce30740 1 -- 172.21.15.82:0/3258932876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32cc009cc0 con 0x55b80db529c0 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32b2ffd640 1 -- 172.21.15.82:0/3258932876 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f32c800f870 con 0x55b80db529c0 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32dce30740 10 client.15090 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:01.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32dce30740 1 -- 172.21.15.82:0/3258932876 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55b80dbd3240 con 0x55b80db529c0 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.969+0000 7f32b2ffd640 1 -- 172.21.15.82:0/3258932876 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f32cc009cc0 con 0x55b80db529c0 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32b2ffd640 1 -- 172.21.15.82:0/3258932876 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f32c802a480 con 0x55b80db529c0 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32dce30740 10 client.15090 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32dce30740 10 client.15090 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32dce30740 20 client.15090 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32dce30740 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b80dbd7eb0 0x55b80dbd42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32dce30740 4 client.15090 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32dce30740 1 -- 172.21.15.82:0/3258932876 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "status"}) -- 0x55b80dabe8a0 con 0x55b80dbd7eb0 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32d37fe640 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b80dbd7eb0 0x55b80dbd42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32d37fe640 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b80dbd7eb0 0x55b80dbd42f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a66b76ec98ee1dc2 server_cookie=954a2bab1bcb851b in_seq=0 out_seq=0 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32b2ffd640 10 client.15090 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32b2ffd640 1 -- 172.21.15.82:0/3258932876 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b80dabe8a0 con 0x55b80dbd7eb0 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32b2ffd640 10 client.15090 handle_command_reply: tid=0 2024-03-27T07:23:01.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.970+0000 7f32dce30740 1 client.15090 shutdown 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 1 -- 172.21.15.82:0/3258932876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db529c0 msgr2=0x55b80dbcf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db529c0 0x55b80dbcf0b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f32d4199400 tx=0x7f32c8012d70 comp rx=0 tx=0).stop 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 1 -- 172.21.15.82:0/3258932876 shutdown_connections 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b80dbd7eb0 0x55b80dbd42f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b80db529c0 0x55b80dbcf0b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b80db57b30 0x55b80dbd1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32b2ffd640 0 client.15090 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 1 --2- 172.21.15.82:0/3258932876 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b80db51fd0 0x55b80dbccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 1 -- 172.21.15.82:0/3258932876 >> 172.21.15.82:0/3258932876 conn(0x55b80db19b20 msgr2=0x55b80db5c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 1 -- 172.21.15.82:0/3258932876 shutdown_connections 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 1 -- 172.21.15.82:0/3258932876 wait complete. 2024-03-27T07:23:01.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32dce30740 20 client.15090 trim_cache size 0 max 16384 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "604548c2-ec09-11ee-95d0-87774f69a715", 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24497, 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 86.426528841999996, 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 21, 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 93.349129399999995 2024-03-27T07:23:01.980 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:23:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 -- 172.21.15.82:0/2862068484 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f32bc0a3610 msgr2=0x7f32bc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f32bc0a3610 0x7f32bc0a5ad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f32cc023000 tx=0x7f32cc021000 comp rx=0 tx=0).stop 2024-03-27T07:23:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 -- 172.21.15.82:0/2862068484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32d41025f0 msgr2=0x7f32d4197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:01.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32d41025f0 0x7f32d4197ef0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f32c4005940 tx=0x7f32c4032470 comp rx=0 tx=0).stop 2024-03-27T07:23:01.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 -- 172.21.15.82:0/2862068484 shutdown_connections 2024-03-27T07:23:01.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f32bc0a3610 0x7f32bc0a5ad0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f32d4107850 0x7f32d419f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32d4104f20 0x7f32d4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 --2- 172.21.15.82:0/2862068484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f32d41025f0 0x7f32d4197ef0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:01.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 -- 172.21.15.82:0/2862068484 >> 172.21.15.82:0/2862068484 conn(0x7f32d40fc000 msgr2=0x7f32d4103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 -- 172.21.15.82:0/2862068484 shutdown_connections 2024-03-27T07:23:01.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:01.971+0000 7f32da24d640 1 -- 172.21.15.82:0/2862068484 wait complete. 2024-03-27T07:23:01.984 INFO:tasks.cephadm:Setup complete, yielding 2024-03-27T07:23:01.984 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-27T07:23:01.995 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T07:23:01.995 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- bash -c 'ceph orch status' 2024-03-27T07:23:02.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:01 smithi149 ceph-mon[36065]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:23:02.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:01 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1573166391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:02.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:01 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3440204918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:02.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:01 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/121808333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:02.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:01 smithi153 ceph-mon[36179]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:23:02.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:01 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1573166391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:02.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:01 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3440204918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:02.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:01 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/121808333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:02.234 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:23:03.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:03 smithi082 ceph-mon[32178]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:23:03.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.912+0000 7f1c709fe700 1 -- 172.21.15.82:0/2994945727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c6c103090 msgr2=0x7f1c6c105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:03.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.912+0000 7f1c709fe700 1 --2- 172.21.15.82:0/2994945727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c6c103090 0x7f1c6c105480 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c60009990 tx=0x7f1c60009ca0 comp rx=0 tx=0).stop 2024-03-27T07:23:03.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.912+0000 7f1c709fe700 1 -- 172.21.15.82:0/2994945727 shutdown_connections 2024-03-27T07:23:03.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.912+0000 7f1c709fe700 1 --2- 172.21.15.82:0/2994945727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1082f0 0x7f1c6c10a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:03.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.912+0000 7f1c709fe700 1 --2- 172.21.15.82:0/2994945727 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c6c103090 0x7f1c6c105480 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:03.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.912+0000 7f1c709fe700 1 --2- 172.21.15.82:0/2994945727 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c6c1059c0 0x7f1c6c107db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:03.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.912+0000 7f1c709fe700 1 -- 172.21.15.82:0/2994945727 >> 172.21.15.82:0/2994945727 conn(0x7f1c6c0fca20 msgr2=0x7f1c6c0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:03.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.912+0000 7f1c709fe700 1 -- 172.21.15.82:0/2994945727 shutdown_connections 2024-03-27T07:23:03.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.912+0000 7f1c709fe700 1 -- 172.21.15.82:0/2994945727 wait complete. 2024-03-27T07:23:03.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c709fe700 1 Processor -- start 2024-03-27T07:23:03.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c709fe700 1 -- start start 2024-03-27T07:23:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c709fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1059c0 0x7f1c6c1029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c709fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c6c1082f0 0x7f1c6c101040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c709fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c6c101580 0x7f1c6c101a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c709fe700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c10e210 con 0x7f1c6c1082f0 2024-03-27T07:23:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c709fe700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c10e090 con 0x7f1c6c101580 2024-03-27T07:23:03.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c709fe700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c10e390 con 0x7f1c6c1059c0 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c6a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c6c1082f0 0x7f1c6c101040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c6a59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c6c1082f0 0x7f1c6c101040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34474/0 (socket says 172.21.15.82:34474) 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c6a59c700 1 -- 172.21.15.82:0/3687735744 learned_addr learned my addr 172.21.15.82:0/3687735744 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c6b59e700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c6c101580 0x7f1c6c101a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c6ad9d700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1059c0 0x7f1c6c1029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c6a59c700 1 -- 172.21.15.82:0/3687735744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1059c0 msgr2=0x7f1c6c1029f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c6a59c700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1059c0 0x7f1c6c1029f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c6a59c700 1 -- 172.21.15.82:0/3687735744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c6c101580 msgr2=0x7f1c6c101a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c6a59c700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c6c101580 0x7f1c6c101a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.913+0000 7f1c6a59c700 1 -- 172.21.15.82:0/3687735744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c1a2c50 con 0x7f1c6c1082f0 2024-03-27T07:23:03.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.914+0000 7f1c6a59c700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c6c1082f0 0x7f1c6c101040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00d950 tx=0x7f1c5c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.914+0000 7f1c53fff700 1 -- 172.21.15.82:0/3687735744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c016070 con 0x7f1c6c1082f0 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.914+0000 7f1c53fff700 1 -- 172.21.15.82:0/3687735744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c5c00fd70 con 0x7f1c6c1082f0 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.914+0000 7f1c709fe700 1 -- 172.21.15.82:0/3687735744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6c1a2f40 con 0x7f1c6c1082f0 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.914+0000 7f1c53fff700 1 -- 172.21.15.82:0/3687735744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00e610 con 0x7f1c6c1082f0 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.914+0000 7f1c709fe700 1 -- 172.21.15.82:0/3687735744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6c1a33f0 con 0x7f1c6c1082f0 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.915+0000 7f1c709fe700 1 -- 172.21.15.82:0/3687735744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c6c069300 con 0x7f1c6c1082f0 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.916+0000 7f1c53fff700 1 -- 172.21.15.82:0/3687735744 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f1c5c019070 con 0x7f1c6c1082f0 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.917+0000 7f1c53fff700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1c540a36f0 0x7f1c540a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.917+0000 7f1c6ad9d700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1c540a36f0 0x7f1c540a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.917+0000 7f1c53fff700 1 -- 172.21.15.82:0/3687735744 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f1c5c0cfaa0 con 0x7f1c6c1082f0 2024-03-27T07:23:03.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.917+0000 7f1c6ad9d700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1c540a36f0 0x7f1c540a5bb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1c60003890 tx=0x7f1c60003980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:03.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:03.921+0000 7f1c53fff700 1 -- 172.21.15.82:0/3687735744 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1c5c09c6a0 con 0x7f1c6c1082f0 2024-03-27T07:23:04.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:03 smithi149 ceph-mon[36065]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:23:04.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:03 smithi153 ceph-mon[36179]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:23:04.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.138+0000 7f1c709fe700 1 -- 172.21.15.82:0/3687735744 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f1c6c062a80 con 0x7f1c540a36f0 2024-03-27T07:23:04.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.139+0000 7f1c53fff700 1 -- 172.21.15.82:0/3687735744 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f1c6c062a80 con 0x7f1c540a36f0 2024-03-27T07:23:04.141 INFO:teuthology.orchestra.run.smithi082.stdout:Backend: cephadm 2024-03-27T07:23:04.141 INFO:teuthology.orchestra.run.smithi082.stdout:Available: Yes 2024-03-27T07:23:04.141 INFO:teuthology.orchestra.run.smithi082.stdout:Paused: No 2024-03-27T07:23:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 -- 172.21.15.82:0/3687735744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1c540a36f0 msgr2=0x7f1c540a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1c540a36f0 0x7f1c540a5bb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1c60003890 tx=0x7f1c60003980 comp rx=0 tx=0).stop 2024-03-27T07:23:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 -- 172.21.15.82:0/3687735744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c6c1082f0 msgr2=0x7f1c6c101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c6c1082f0 0x7f1c6c101040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00d950 tx=0x7f1c5c00dc60 comp rx=0 tx=0).stop 2024-03-27T07:23:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 -- 172.21.15.82:0/3687735744 shutdown_connections 2024-03-27T07:23:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1c540a36f0 0x7f1c540a5bb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c6c1059c0 0x7f1c6c1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c6c101580 0x7f1c6c101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 --2- 172.21.15.82:0/3687735744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c6c1082f0 0x7f1c6c101040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:04.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 -- 172.21.15.82:0/3687735744 >> 172.21.15.82:0/3687735744 conn(0x7f1c6c0fca20 msgr2=0x7f1c6c1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:04.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 -- 172.21.15.82:0/3687735744 shutdown_connections 2024-03-27T07:23:04.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:04.141+0000 7f1c709fe700 1 -- 172.21.15.82:0/3687735744 wait complete. 2024-03-27T07:23:04.831 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-27T07:23:05.071 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:23:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:05 smithi082 ceph-mon[32178]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:05.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:05 smithi082 ceph-mon[32178]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:23:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:05 smithi149 ceph-mon[36065]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:06.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:05 smithi149 ceph-mon[36065]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:23:06.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:05 smithi153 ceph-mon[36179]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:06.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:05 smithi153 ceph-mon[36179]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T07:23:06.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.913+0000 7f300921e700 1 -- 172.21.15.82:0/4157397588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3004102770 msgr2=0x7f3004102bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:06.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.913+0000 7f300921e700 1 --2- 172.21.15.82:0/4157397588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3004102770 0x7f3004102bd0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2ff40099c0 tx=0x7f2ff4009cd0 comp rx=0 tx=0).stop 2024-03-27T07:23:06.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.913+0000 7f300921e700 1 -- 172.21.15.82:0/4157397588 shutdown_connections 2024-03-27T07:23:06.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.913+0000 7f300921e700 1 --2- 172.21.15.82:0/4157397588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3004103110 0x7f30041099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:06.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.913+0000 7f300921e700 1 --2- 172.21.15.82:0/4157397588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3004101570 0x7f3004101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:06.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.913+0000 7f300921e700 1 --2- 172.21.15.82:0/4157397588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3004102770 0x7f3004102bd0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:06.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.913+0000 7f300921e700 1 -- 172.21.15.82:0/4157397588 >> 172.21.15.82:0/4157397588 conn(0x7f30040fcb30 msgr2=0x7f30040fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:06.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.913+0000 7f300921e700 1 -- 172.21.15.82:0/4157397588 shutdown_connections 2024-03-27T07:23:06.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.913+0000 7f300921e700 1 -- 172.21.15.82:0/4157397588 wait complete. 2024-03-27T07:23:06.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300921e700 1 Processor -- start 2024-03-27T07:23:06.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300921e700 1 -- start start 2024-03-27T07:23:06.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300921e700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3004101570 0x7f300406b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:06.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300921e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3004102770 0x7f300419d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:06.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300921e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3004103110 0x7f300419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:06.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300921e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f300410d130 con 0x7f3004103110 2024-03-27T07:23:06.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300921e700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f300410cfb0 con 0x7f3004101570 2024-03-27T07:23:06.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300921e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f300410d2b0 con 0x7f3004102770 2024-03-27T07:23:06.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3004102770 0x7f300419d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:06.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f3002d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3004101570 0x7f300406b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:06.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3004102770 0x7f300419d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:52460/0 (socket says 172.21.15.82:52460) 2024-03-27T07:23:06.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f3002d9d700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3004101570 0x7f300406b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:43374/0 (socket says 172.21.15.82:43374) 2024-03-27T07:23:06.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.914+0000 7f300259c700 1 -- 172.21.15.82:0/1898179813 learned_addr learned my addr 172.21.15.82:0/1898179813 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:06.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f300359e700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3004103110 0x7f300419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f300259c700 1 -- 172.21.15.82:0/1898179813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3004101570 msgr2=0x7f300406b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f300259c700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3004101570 0x7f300406b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f300259c700 1 -- 172.21.15.82:0/1898179813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3004103110 msgr2=0x7f300419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f300259c700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3004103110 0x7f300419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f300259c700 1 -- 172.21.15.82:0/1898179813 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30041a04e0 con 0x7f3004102770 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f300259c700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3004102770 0x7f300419d5d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4006010 tx=0x7f2ff40057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f2febfff700 1 -- 172.21.15.82:0/1898179813 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4027070 con 0x7f3004102770 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f300921e700 1 -- 172.21.15.82:0/1898179813 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30041973a0 con 0x7f3004102770 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f2febfff700 1 -- 172.21.15.82:0/1898179813 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ff4004150 con 0x7f3004102770 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f2febfff700 1 -- 172.21.15.82:0/1898179813 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4022dd0 con 0x7f3004102770 2024-03-27T07:23:06.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.915+0000 7f300921e700 1 -- 172.21.15.82:0/1898179813 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3004197880 con 0x7f3004102770 2024-03-27T07:23:06.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.916+0000 7f300921e700 1 -- 172.21.15.82:0/1898179813 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3004069300 con 0x7f3004102770 2024-03-27T07:23:06.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.917+0000 7f2febfff700 1 -- 172.21.15.82:0/1898179813 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f2ff402a070 con 0x7f3004102770 2024-03-27T07:23:06.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.918+0000 7f2febfff700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fec0a36a0 0x7f2fec0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:06.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.918+0000 7f3002d9d700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fec0a36a0 0x7f2fec0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:06.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.918+0000 7f2febfff700 1 -- 172.21.15.82:0/1898179813 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f2ff40d10a0 con 0x7f3004102770 2024-03-27T07:23:06.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.918+0000 7f3002d9d700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fec0a36a0 0x7f2fec0a5b60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30041025d0 tx=0x7f2ff800f7d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:06.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:06.922+0000 7f2febfff700 1 -- 172.21.15.82:0/1898179813 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2ff4013070 con 0x7f3004102770 2024-03-27T07:23:07.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.127+0000 7f300921e700 1 -- 172.21.15.82:0/1898179813 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3004062a80 con 0x7f2fec0a36a0 2024-03-27T07:23:07.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.141+0000 7f2febfff700 1 -- 172.21.15.82:0/1898179813 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f3004062a80 con 0x7f2fec0a36a0 2024-03-27T07:23:07.143 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-27T07:23:07.143 INFO:teuthology.orchestra.run.smithi082.stdout:mds.a smithi082 running (101s) 15s ago 101s 13.9M - 19.0.0-2478-g155268c4 b379bbd8da6b eca28766cd3b 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.b smithi149 running (98s) 32s ago 98s 25.6M - 19.0.0-2478-g155268c4 b379bbd8da6b 13f6608fa5bc 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.c smithi153 running (113s) 32s ago 112s 17.6M - 19.0.0-2478-g155268c4 b379bbd8da6b ad65a8c6f54f 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.d smithi082 running (2m) 15s ago 2m 12.9M - 19.0.0-2478-g155268c4 b379bbd8da6b e702cb3f7c87 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.e smithi149 running (119s) 32s ago 118s 19.1M - 19.0.0-2478-g155268c4 b379bbd8da6b 7a1babf96f3c 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.f smithi153 running (116s) 32s ago 115s 16.0M - 19.0.0-2478-g155268c4 b379bbd8da6b 2767a95d9915 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.g smithi082 running (104s) 15s ago 104s 15.2M - 19.0.0-2478-g155268c4 b379bbd8da6b d9b53df302f3 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.h smithi149 running (110s) 32s ago 109s 17.7M - 19.0.0-2478-g155268c4 b379bbd8da6b ba48746825b2 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.i smithi153 running (107s) 32s ago 107s 17.2M - 19.0.0-2478-g155268c4 b379bbd8da6b 3a4066c405da 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.j smithi082 running (2m) 15s ago 2m 13.9M - 19.0.0-2478-g155268c4 b379bbd8da6b eff950a02649 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.k smithi149 running (2m) 32s ago 2m 13.7M - 19.0.0-2478-g155268c4 b379bbd8da6b 65861988f4cb 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mds.l smithi153 running (2m) 32s ago 2m 15.4M - 19.0.0-2478-g155268c4 b379bbd8da6b a2996c7af0b6 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.x smithi082 *:9283,8765 running (9m) 15s ago 9m 516M - 19.0.0-2478-g155268c4 b379bbd8da6b 80c360a9ab6e 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.y smithi149 *:8443,8765 running (7m) 32s ago 7m 454M - 19.0.0-2478-g155268c4 b379bbd8da6b da6bb59530ec 2024-03-27T07:23:07.144 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.z smithi153 *:8443,8765 running (7m) 32s ago 7m 454M - 19.0.0-2478-g155268c4 b379bbd8da6b 507ac8682273 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:mon.a smithi082 running (9m) 15s ago 9m 51.1M 2048M 19.0.0-2478-g155268c4 b379bbd8da6b 08307e622ef7 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:mon.b smithi149 running (7m) 32s ago 7m 38.3M 2048M 19.0.0-2478-g155268c4 b379bbd8da6b 151efc33b67e 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:mon.c smithi153 running (7m) 32s ago 7m 41.9M 2048M 19.0.0-2478-g155268c4 b379bbd8da6b 67f5b30c380a 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (7m) 15s ago 7m 55.4M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b 308d3b29d7d9 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi149 running (6m) 32s ago 6m 47.5M 1451M 19.0.0-2478-g155268c4 b379bbd8da6b 942294ae74d0 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi153 running (6m) 32s ago 6m 57.6M 4270M 19.0.0-2478-g155268c4 b379bbd8da6b 788f0596478b 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi082 running (5m) 15s ago 5m 43.5M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b df840e210476 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi149 running (5m) 32s ago 5m 42.2M 1451M 19.0.0-2478-g155268c4 b379bbd8da6b a99f2c6025a4 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi153 running (5m) 32s ago 5m 57.4M 4270M 19.0.0-2478-g155268c4 b379bbd8da6b d3e0ef2bd9ce 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 smithi082 running (4m) 15s ago 4m 42.0M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b fb8a5a8857ea 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 smithi149 running (4m) 32s ago 4m 54.3M 1451M 19.0.0-2478-g155268c4 b379bbd8da6b 6404ac22b883 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 smithi153 running (3m) 32s ago 3m 42.7M 4270M 19.0.0-2478-g155268c4 b379bbd8da6b 5491f8f33ed6 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 smithi082 running (3m) 15s ago 3m 51.1M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b 4a298b9718b8 2024-03-27T07:23:07.145 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 smithi149 running (2m) 32s ago 2m 43.3M 1451M 19.0.0-2478-g155268c4 b379bbd8da6b 43b161ae4857 2024-03-27T07:23:07.146 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 smithi153 running (2m) 32s ago 2m 39.9M 4270M 19.0.0-2478-g155268c4 b379bbd8da6b 454fa5461329 2024-03-27T07:23:07.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 -- 172.21.15.82:0/1898179813 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fec0a36a0 msgr2=0x7f2fec0a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:07.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fec0a36a0 0x7f2fec0a5b60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f30041025d0 tx=0x7f2ff800f7d0 comp rx=0 tx=0).stop 2024-03-27T07:23:07.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 -- 172.21.15.82:0/1898179813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3004102770 msgr2=0x7f300419d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:07.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3004102770 0x7f300419d5d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4006010 tx=0x7f2ff40057c0 comp rx=0 tx=0).stop 2024-03-27T07:23:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 -- 172.21.15.82:0/1898179813 shutdown_connections 2024-03-27T07:23:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fec0a36a0 0x7f2fec0a5b60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3004103110 0x7f300419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3004101570 0x7f300406b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 --2- 172.21.15.82:0/1898179813 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3004102770 0x7f300419d5d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 -- 172.21.15.82:0/1898179813 >> 172.21.15.82:0/1898179813 conn(0x7f30040fcb30 msgr2=0x7f3004105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 -- 172.21.15.82:0/1898179813 shutdown_connections 2024-03-27T07:23:07.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:07.143+0000 7f300921e700 1 -- 172.21.15.82:0/1898179813 wait complete. 2024-03-27T07:23:07.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:07 smithi082 ceph-mon[32178]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-03-27T07:23:07.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-27T07:23:08.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:07 smithi149 ceph-mon[36065]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-03-27T07:23:08.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:07 smithi153 ceph-mon[36179]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-03-27T07:23:08.186 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:23:08.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:08 smithi082 ceph-mon[32178]: from='client.24946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:09.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:08 smithi149 ceph-mon[36065]: from='client.24946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:09.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:08 smithi153 ceph-mon[36179]: from='client.24946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:09.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:09 smithi082 ceph-mon[32178]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:23:09.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 -- 172.21.15.82:0/4212831331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b74103870 msgr2=0x7f2b74103cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:09.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 --2- 172.21.15.82:0/4212831331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b74103870 0x7f2b74103cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2b600099c0 tx=0x7f2b60009cd0 comp rx=0 tx=0).stop 2024-03-27T07:23:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 -- 172.21.15.82:0/4212831331 shutdown_connections 2024-03-27T07:23:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 --2- 172.21.15.82:0/4212831331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b74102670 0x7f2b74102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 --2- 172.21.15.82:0/4212831331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b74104210 0x7f2b7410aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 --2- 172.21.15.82:0/4212831331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b74103870 0x7f2b74103cd0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 -- 172.21.15.82:0/4212831331 >> 172.21.15.82:0/4212831331 conn(0x7f2b740fdc50 msgr2=0x7f2b74100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 -- 172.21.15.82:0/4212831331 shutdown_connections 2024-03-27T07:23:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 -- 172.21.15.82:0/4212831331 wait complete. 2024-03-27T07:23:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 Processor -- start 2024-03-27T07:23:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 -- start start 2024-03-27T07:23:09.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b74102670 0x7f2b741988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b74103870 0x7f2b74198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b74104210 0x7f2b7419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7410e260 con 0x7f2b74102670 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.941+0000 7f2b7aedf700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7410e0e0 con 0x7f2b74103870 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b7aedf700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7410e3e0 con 0x7f2b74104210 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b78c7b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b74102670 0x7f2b741988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b78c7b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b74102670 0x7f2b741988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54288/0 (socket says 172.21.15.82:54288) 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b78c7b700 1 -- 172.21.15.82:0/2413557983 learned_addr learned my addr 172.21.15.82:0/2413557983 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b73fff700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b74103870 0x7f2b74198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b7947c700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b74104210 0x7f2b7419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b78c7b700 1 -- 172.21.15.82:0/2413557983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b74104210 msgr2=0x7f2b7419fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:09.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b78c7b700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b74104210 0x7f2b7419fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b78c7b700 1 -- 172.21.15.82:0/2413557983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b74103870 msgr2=0x7f2b74198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b78c7b700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b74103870 0x7f2b74198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b78c7b700 1 -- 172.21.15.82:0/2413557983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b741a0500 con 0x7f2b74102670 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b73fff700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b74103870 0x7f2b74198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b78c7b700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b74102670 0x7f2b741988a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800e980 tx=0x7f2b6800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b71ffb700 1 -- 172.21.15.82:0/2413557983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68004230 con 0x7f2b74102670 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b71ffb700 1 -- 172.21.15.82:0/2413557983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2b680043d0 con 0x7f2b74102670 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b7aedf700 1 -- 172.21.15.82:0/2413557983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b741a07f0 con 0x7f2b74102670 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.942+0000 7f2b71ffb700 1 -- 172.21.15.82:0/2413557983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68003dc0 con 0x7f2b74102670 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.943+0000 7f2b7aedf700 1 -- 172.21.15.82:0/2413557983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b741a0ce0 con 0x7f2b74102670 2024-03-27T07:23:09.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.943+0000 7f2b7aedf700 1 -- 172.21.15.82:0/2413557983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b74069300 con 0x7f2b74102670 2024-03-27T07:23:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.944+0000 7f2b71ffb700 1 -- 172.21.15.82:0/2413557983 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f2b6800c810 con 0x7f2b74102670 2024-03-27T07:23:09.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.945+0000 7f2b71ffb700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b640a36a0 0x7f2b640a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:09.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.945+0000 7f2b73fff700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b640a36a0 0x7f2b640a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:09.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.945+0000 7f2b71ffb700 1 -- 172.21.15.82:0/2413557983 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f2b680cff40 con 0x7f2b74102670 2024-03-27T07:23:09.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.945+0000 7f2b73fff700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b640a36a0 0x7f2b640a5b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b60000c00 tx=0x7f2b60005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:09.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:09.949+0000 7f2b71ffb700 1 -- 172.21.15.82:0/2413557983 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2b6809cb40 con 0x7f2b74102670 2024-03-27T07:23:10.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:09 smithi149 ceph-mon[36065]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:23:10.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:09 smithi153 ceph-mon[36179]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T07:23:10.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.155+0000 7f2b7aedf700 1 -- 172.21.15.82:0/2413557983 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f2b74062a80 con 0x7f2b640a36a0 2024-03-27T07:23:10.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.163+0000 7f2b71ffb700 1 -- 172.21.15.82:0/2413557983 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f2b74062a80 con 0x7f2b640a36a0 2024-03-27T07:23:10.165 INFO:teuthology.orchestra.run.smithi082.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-27T07:23:10.165 INFO:teuthology.orchestra.run.smithi082.stdout:mds.all 12/12 35s ago 2m smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi149=b;smithi149=e;smithi149=h;smithi149=k;smithi153=c;smithi153=f;smithi153=i;smithi153=l;count:12 2024-03-27T07:23:10.165 INFO:teuthology.orchestra.run.smithi082.stdout:mgr 3/3 35s ago 7m smithi082=x;smithi149=y;smithi153=z;count:3 2024-03-27T07:23:10.165 INFO:teuthology.orchestra.run.smithi082.stdout:mon 3/3 35s ago 8m smithi082:172.21.15.82=a;smithi149:172.21.15.149=b;smithi153:172.21.15.153=c;count:3 2024-03-27T07:23:10.165 INFO:teuthology.orchestra.run.smithi082.stdout:osd 12 35s ago - 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 -- 172.21.15.82:0/2413557983 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b640a36a0 msgr2=0x7f2b640a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b640a36a0 0x7f2b640a5b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2b60000c00 tx=0x7f2b60005fb0 comp rx=0 tx=0).stop 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 -- 172.21.15.82:0/2413557983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b74102670 msgr2=0x7f2b741988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b74102670 0x7f2b741988a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800e980 tx=0x7f2b6800ec90 comp rx=0 tx=0).stop 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 -- 172.21.15.82:0/2413557983 shutdown_connections 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2b640a36a0 0x7f2b640a5b60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b74104210 0x7f2b7419fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b74102670 0x7f2b741988a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 --2- 172.21.15.82:0/2413557983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2b74103870 0x7f2b74198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 -- 172.21.15.82:0/2413557983 >> 172.21.15.82:0/2413557983 conn(0x7f2b740fdc50 msgr2=0x7f2b74106bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 -- 172.21.15.82:0/2413557983 shutdown_connections 2024-03-27T07:23:10.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:10.166+0000 7f2b7aedf700 1 -- 172.21.15.82:0/2413557983 wait complete. 2024-03-27T07:23:10.867 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-27T07:23:11.107 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:23:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:11 smithi082 ceph-mon[32178]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:11.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:11 smithi082 ceph-mon[32178]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-27T07:23:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:11 smithi149 ceph-mon[36065]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:12.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:11 smithi149 ceph-mon[36065]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-27T07:23:12.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:11 smithi153 ceph-mon[36179]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:12.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:11 smithi153 ceph-mon[36179]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-27T07:23:12.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.846+0000 7f4702f00700 1 -- 172.21.15.82:0/428260328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc101570 msgr2=0x7f46fc101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:12.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.846+0000 7f4702f00700 1 --2- 172.21.15.82:0/428260328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc101570 0x7f46fc101990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f46f00099c0 tx=0x7f46f0009cd0 comp rx=0 tx=0).stop 2024-03-27T07:23:12.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.846+0000 7f4702f00700 1 -- 172.21.15.82:0/428260328 shutdown_connections 2024-03-27T07:23:12.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.846+0000 7f4702f00700 1 --2- 172.21.15.82:0/428260328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc103110 0x7f46fc1099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:12.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.846+0000 7f4702f00700 1 --2- 172.21.15.82:0/428260328 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc101570 0x7f46fc101990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:12.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.846+0000 7f4702f00700 1 --2- 172.21.15.82:0/428260328 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46fc102770 0x7f46fc102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:12.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.846+0000 7f4702f00700 1 -- 172.21.15.82:0/428260328 >> 172.21.15.82:0/428260328 conn(0x7f46fc0fcb10 msgr2=0x7f46fc0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:12.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.846+0000 7f4702f00700 1 -- 172.21.15.82:0/428260328 shutdown_connections 2024-03-27T07:23:12.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.846+0000 7f4702f00700 1 -- 172.21.15.82:0/428260328 wait complete. 2024-03-27T07:23:12.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.846+0000 7f4702f00700 1 Processor -- start 2024-03-27T07:23:12.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4702f00700 1 -- start start 2024-03-27T07:23:12.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4702f00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc101570 0x7f46fc197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:12.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4702f00700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc102770 0x7f46fc197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:12.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4702f00700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46fc103110 0x7f46fc19ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:12.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4702f00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc10d140 con 0x7f46fc101570 2024-03-27T07:23:12.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4702f00700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc10cfc0 con 0x7f46fc103110 2024-03-27T07:23:12.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4702f00700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f46fc10d2c0 con 0x7f46fc102770 2024-03-27T07:23:12.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4700c9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc101570 0x7f46fc197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:12.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f46fbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc102770 0x7f46fc197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:12.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4700c9c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc101570 0x7f46fc197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54320/0 (socket says 172.21.15.82:54320) 2024-03-27T07:23:12.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4700c9c700 1 -- 172.21.15.82:0/4254916409 learned_addr learned my addr 172.21.15.82:0/4254916409 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:12.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f470149d700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46fc103110 0x7f46fc19ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:12.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f46fbfff700 1 -- 172.21.15.82:0/4254916409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46fc103110 msgr2=0x7f46fc19ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:12.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f46fbfff700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46fc103110 0x7f46fc19ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:12.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f46fbfff700 1 -- 172.21.15.82:0/4254916409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc101570 msgr2=0x7f46fc197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:12.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f46fbfff700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc101570 0x7f46fc197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:12.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f46fbfff700 1 -- 172.21.15.82:0/4254916409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46fc19f4a0 con 0x7f46fc102770 2024-03-27T07:23:12.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f4700c9c700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc101570 0x7f46fc197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:12.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.847+0000 7f46fbfff700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc102770 0x7f46fc197d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f46e800fb90 tx=0x7f46e800fea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:12.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.848+0000 7f46f9ffb700 1 -- 172.21.15.82:0/4254916409 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8009b40 con 0x7f46fc102770 2024-03-27T07:23:12.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.848+0000 7f4702f00700 1 -- 172.21.15.82:0/4254916409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46fc06a350 con 0x7f46fc102770 2024-03-27T07:23:12.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.848+0000 7f46f9ffb700 1 -- 172.21.15.82:0/4254916409 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46e8009ce0 con 0x7f46fc102770 2024-03-27T07:23:12.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.848+0000 7f46f9ffb700 1 -- 172.21.15.82:0/4254916409 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8018690 con 0x7f46fc102770 2024-03-27T07:23:12.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.848+0000 7f4702f00700 1 -- 172.21.15.82:0/4254916409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46fc06a890 con 0x7f46fc102770 2024-03-27T07:23:12.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.849+0000 7f4702f00700 1 -- 172.21.15.82:0/4254916409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46fc069300 con 0x7f46fc102770 2024-03-27T07:23:12.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.850+0000 7f46f9ffb700 1 -- 172.21.15.82:0/4254916409 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f46e80193f0 con 0x7f46fc102770 2024-03-27T07:23:12.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.850+0000 7f46f9ffb700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f46ec0a36a0 0x7f46ec0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:12.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.851+0000 7f4700c9c700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f46ec0a36a0 0x7f46ec0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:12.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.851+0000 7f46f9ffb700 1 -- 172.21.15.82:0/4254916409 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f46e80d15f0 con 0x7f46fc102770 2024-03-27T07:23:12.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.851+0000 7f4700c9c700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f46ec0a36a0 0x7f46ec0a5b60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009750 tx=0x7f46f0003960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:12.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:12.854+0000 7f46f9ffb700 1 -- 172.21.15.82:0/4254916409 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f46e8014070 con 0x7f46fc102770 2024-03-27T07:23:13.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.057+0000 7f4702f00700 1 -- 172.21.15.82:0/4254916409 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f46fc06aaf0 con 0x7f46ec0a36a0 2024-03-27T07:23:13.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.059+0000 7f46f9ffb700 1 -- 172.21.15.82:0/4254916409 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f46fc06aaf0 con 0x7f46ec0a36a0 2024-03-27T07:23:13.061 INFO:teuthology.orchestra.run.smithi082.stdout:HOST ADDR LABELS STATUS 2024-03-27T07:23:13.061 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 172.21.15.82 2024-03-27T07:23:13.061 INFO:teuthology.orchestra.run.smithi082.stdout:smithi149 172.21.15.149 2024-03-27T07:23:13.061 INFO:teuthology.orchestra.run.smithi082.stdout:smithi153 172.21.15.153 2024-03-27T07:23:13.061 INFO:teuthology.orchestra.run.smithi082.stdout:3 hosts in cluster 2024-03-27T07:23:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 -- 172.21.15.82:0/4254916409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f46ec0a36a0 msgr2=0x7f46ec0a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f46ec0a36a0 0x7f46ec0a5b60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009750 tx=0x7f46f0003960 comp rx=0 tx=0).stop 2024-03-27T07:23:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 -- 172.21.15.82:0/4254916409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc102770 msgr2=0x7f46fc197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc102770 0x7f46fc197d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f46e800fb90 tx=0x7f46e800fea0 comp rx=0 tx=0).stop 2024-03-27T07:23:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 -- 172.21.15.82:0/4254916409 shutdown_connections 2024-03-27T07:23:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f46ec0a36a0 0x7f46ec0a5b60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f46fc103110 0x7f46fc19ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46fc101570 0x7f46fc197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 --2- 172.21.15.82:0/4254916409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46fc102770 0x7f46fc197d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:13.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 -- 172.21.15.82:0/4254916409 >> 172.21.15.82:0/4254916409 conn(0x7f46fc0fcb10 msgr2=0x7f46fc105ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:13.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 -- 172.21.15.82:0/4254916409 shutdown_connections 2024-03-27T07:23:13.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:13.061+0000 7f4702f00700 1 -- 172.21.15.82:0/4254916409 wait complete. 2024-03-27T07:23:13.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:13 smithi082 ceph-mon[32178]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-27T07:23:13.751 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-27T07:23:13.989 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:23:14.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:13 smithi149 ceph-mon[36065]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-27T07:23:14.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:13 smithi153 ceph-mon[36179]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-27T07:23:14.832 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:14 smithi082 ceph-mon[32178]: from='client.24958 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:15.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:14 smithi149 ceph-mon[36065]: from='client.24958 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:14 smithi153 ceph-mon[36179]: from='client.24958 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.680+0000 7f8c65208700 1 -- 172.21.15.82:0/1277464378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103140 msgr2=0x7f8c601099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.680+0000 7f8c65208700 1 --2- 172.21.15.82:0/1277464378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103140 0x7f8c601099f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800b0a0 tx=0x7f8c5800b3b0 comp rx=0 tx=0).stop 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.680+0000 7f8c65208700 1 -- 172.21.15.82:0/1277464378 shutdown_connections 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.680+0000 7f8c65208700 1 --2- 172.21.15.82:0/1277464378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103140 0x7f8c601099f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.680+0000 7f8c65208700 1 --2- 172.21.15.82:0/1277464378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c601015a0 0x7f8c601019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.680+0000 7f8c65208700 1 --2- 172.21.15.82:0/1277464378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c601027a0 0x7f8c60102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.680+0000 7f8c65208700 1 -- 172.21.15.82:0/1277464378 >> 172.21.15.82:0/1277464378 conn(0x7f8c600fcb60 msgr2=0x7f8c600fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.680+0000 7f8c65208700 1 -- 172.21.15.82:0/1277464378 shutdown_connections 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.680+0000 7f8c65208700 1 -- 172.21.15.82:0/1277464378 wait complete. 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.681+0000 7f8c65208700 1 Processor -- start 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.681+0000 7f8c65208700 1 -- start start 2024-03-27T07:23:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c65208700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c601015a0 0x7f8c601987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c65208700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c601027a0 0x7f8c60198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c65208700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103140 0x7f8c6019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c65208700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010e2d0 con 0x7f8c60103140 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c65208700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010e150 con 0x7f8c601015a0 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c65208700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6010e450 con 0x7f8c601027a0 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103140 0x7f8c6019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5f59e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103140 0x7f8c6019fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54326/0 (socket says 172.21.15.82:54326) 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5f59e700 1 -- 172.21.15.82:0/636939359 learned_addr learned my addr 172.21.15.82:0/636939359 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5e59c700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c601027a0 0x7f8c60198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5ed9d700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c601015a0 0x7f8c601987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5f59e700 1 -- 172.21.15.82:0/636939359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c601027a0 msgr2=0x7f8c60198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5f59e700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c601027a0 0x7f8c60198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5f59e700 1 -- 172.21.15.82:0/636939359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c601015a0 msgr2=0x7f8c601987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:15.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5f59e700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c601015a0 0x7f8c601987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5f59e700 1 -- 172.21.15.82:0/636939359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c601a0430 con 0x7f8c60103140 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c5f59e700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103140 0x7f8c6019fd90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8c58004d00 tx=0x7f8c58004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c47fff700 1 -- 172.21.15.82:0/636939359 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58021070 con 0x7f8c60103140 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c65208700 1 -- 172.21.15.82:0/636939359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c601a06c0 con 0x7f8c60103140 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c47fff700 1 -- 172.21.15.82:0/636939359 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c58007b80 con 0x7f8c60103140 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c47fff700 1 -- 172.21.15.82:0/636939359 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c580052a0 con 0x7f8c60103140 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.682+0000 7f8c65208700 1 -- 172.21.15.82:0/636939359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c601a0bc0 con 0x7f8c60103140 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.683+0000 7f8c65208700 1 -- 172.21.15.82:0/636939359 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c60069300 con 0x7f8c60103140 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.684+0000 7f8c47fff700 1 -- 172.21.15.82:0/636939359 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f8c58024070 con 0x7f8c60103140 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.685+0000 7f8c47fff700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c480a36a0 0x7f8c480a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.685+0000 7f8c47fff700 1 -- 172.21.15.82:0/636939359 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f8c5800f020 con 0x7f8c60103140 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.685+0000 7f8c5ed9d700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c480a36a0 0x7f8c480a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:15.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.685+0000 7f8c5ed9d700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c480a36a0 0x7f8c480a5b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8c60102600 tx=0x7f8c50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:15.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.689+0000 7f8c47fff700 1 -- 172.21.15.82:0/636939359 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8c5802b020 con 0x7f8c60103140 2024-03-27T07:23:15.803 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:15 smithi082 ceph-mon[32178]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:23:15.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.897+0000 7f8c65208700 1 -- 172.21.15.82:0/636939359 --> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f8c60062a80 con 0x7f8c480a36a0 2024-03-27T07:23:15.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.899+0000 7f8c47fff700 1 -- 172.21.15.82:0/636939359 <== mgr.14152 v2:172.21.15.82:6800/3599330107 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f8c60062a80 con 0x7f8c480a36a0 2024-03-27T07:23:15.901 INFO:teuthology.orchestra.run.smithi082.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-27T07:23:15.901 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-03-27T07:23:15.901 INFO:teuthology.orchestra.run.smithi082.stdout:smithi149 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-03-27T07:23:15.901 INFO:teuthology.orchestra.run.smithi082.stdout:smithi153 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300MV400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.901+0000 7f8c65208700 1 -- 172.21.15.82:0/636939359 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c480a36a0 msgr2=0x7f8c480a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.901+0000 7f8c65208700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c480a36a0 0x7f8c480a5b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8c60102600 tx=0x7f8c50009260 comp rx=0 tx=0).stop 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.901+0000 7f8c65208700 1 -- 172.21.15.82:0/636939359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103140 msgr2=0x7f8c6019fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.901+0000 7f8c65208700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103140 0x7f8c6019fd90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8c58004d00 tx=0x7f8c58004d30 comp rx=0 tx=0).stop 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.901+0000 7f8c65208700 1 -- 172.21.15.82:0/636939359 shutdown_connections 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.901+0000 7f8c65208700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8c480a36a0 0x7f8c480a5b60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.901+0000 7f8c65208700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c60103140 0x7f8c6019fd90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.901+0000 7f8c65208700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8c601015a0 0x7f8c601987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.901+0000 7f8c65208700 1 --2- 172.21.15.82:0/636939359 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8c601027a0 0x7f8c60198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.901+0000 7f8c65208700 1 -- 172.21.15.82:0/636939359 >> 172.21.15.82:0/636939359 conn(0x7f8c600fcb60 msgr2=0x7f8c601059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.902+0000 7f8c65208700 1 -- 172.21.15.82:0/636939359 shutdown_connections 2024-03-27T07:23:15.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:15.902+0000 7f8c65208700 1 -- 172.21.15.82:0/636939359 wait complete. 2024-03-27T07:23:16.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:15 smithi149 ceph-mon[36065]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:23:16.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:15 smithi153 ceph-mon[36179]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:23:16.754 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-27T07:23:16.762 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T07:23:16.763 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-27T07:23:17.004 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:23:17.827 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:17 smithi082 ceph-mon[32178]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:17.827 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:17 smithi082 ceph-mon[32178]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:23:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:17 smithi149 ceph-mon[36065]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:18.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:17 smithi149 ceph-mon[36065]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:23:18.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:17 smithi153 ceph-mon[36179]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:18.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:17 smithi153 ceph-mon[36179]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:23:18.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.684+0000 7f049f62b700 1 -- 172.21.15.82:0/1657623251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498101560 msgr2=0x7f0498101980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:18.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.684+0000 7f049f62b700 1 --2- 172.21.15.82:0/1657623251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498101560 0x7f0498101980 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f04940099c0 tx=0x7f0494009cd0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.684+0000 7f049f62b700 1 -- 172.21.15.82:0/1657623251 shutdown_connections 2024-03-27T07:23:18.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.684+0000 7f049f62b700 1 --2- 172.21.15.82:0/1657623251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0498103100 0x7f04981099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.684+0000 7f049f62b700 1 --2- 172.21.15.82:0/1657623251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498101560 0x7f0498101980 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.684+0000 7f049f62b700 1 --2- 172.21.15.82:0/1657623251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0498102760 0x7f0498102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.684+0000 7f049f62b700 1 -- 172.21.15.82:0/1657623251 >> 172.21.15.82:0/1657623251 conn(0x7f04980fcb00 msgr2=0x7f04980fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:18.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.684+0000 7f049f62b700 1 -- 172.21.15.82:0/1657623251 shutdown_connections 2024-03-27T07:23:18.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.684+0000 7f049f62b700 1 -- 172.21.15.82:0/1657623251 wait complete. 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049f62b700 1 Processor -- start 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049f62b700 1 -- start start 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049f62b700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0498101560 0x7f049806b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049f62b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0498102760 0x7f049819d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049f62b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498103100 0x7f049819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049f62b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f049810d130 con 0x7f0498103100 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049f62b700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f049810cfb0 con 0x7f0498101560 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049f62b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f049810d2b0 con 0x7f0498102760 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049d3c7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0498101560 0x7f049806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049dbc8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498103100 0x7f049819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049d3c7700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0498101560 0x7f049806b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:49516/0 (socket says 172.21.15.82:49516) 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049d3c7700 1 -- 172.21.15.82:0/3387472012 learned_addr learned my addr 172.21.15.82:0/3387472012 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:18.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049cbc6700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0498102760 0x7f049819d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049dbc8700 1 -- 172.21.15.82:0/3387472012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0498102760 msgr2=0x7f049819d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049dbc8700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0498102760 0x7f049819d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049dbc8700 1 -- 172.21.15.82:0/3387472012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0498101560 msgr2=0x7f049806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049dbc8700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0498101560 0x7f049806b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049dbc8700 1 -- 172.21.15.82:0/3387472012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04981a04b0 con 0x7f0498103100 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.685+0000 7f049d3c7700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0498101560 0x7f049806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.686+0000 7f049dbc8700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498103100 0x7f049819fbe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0490007f10 tx=0x7f049000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.686+0000 7f048e7fc700 1 -- 172.21.15.82:0/3387472012 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490004db0 con 0x7f0498103100 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.686+0000 7f049f62b700 1 -- 172.21.15.82:0/3387472012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04981a07a0 con 0x7f0498103100 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.686+0000 7f048e7fc700 1 -- 172.21.15.82:0/3387472012 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0490003a00 con 0x7f0498103100 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.686+0000 7f048e7fc700 1 -- 172.21.15.82:0/3387472012 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490004680 con 0x7f0498103100 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.686+0000 7f049f62b700 1 -- 172.21.15.82:0/3387472012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04981a0c90 con 0x7f0498103100 2024-03-27T07:23:18.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.687+0000 7f049f62b700 1 -- 172.21.15.82:0/3387472012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0498069300 con 0x7f0498103100 2024-03-27T07:23:18.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.688+0000 7f048e7fc700 1 -- 172.21.15.82:0/3387472012 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f049001c020 con 0x7f0498103100 2024-03-27T07:23:18.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.689+0000 7f048e7fc700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f04840a36a0 0x7f04840a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:18.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.689+0000 7f049d3c7700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f04840a36a0 0x7f04840a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:18.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.689+0000 7f048e7fc700 1 -- 172.21.15.82:0/3387472012 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f04900cfe70 con 0x7f0498103100 2024-03-27T07:23:18.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.689+0000 7f049d3c7700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f04840a36a0 0x7f04840a5b60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0494000c00 tx=0x7f0494005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:18.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.692+0000 7f048e7fc700 1 -- 172.21.15.82:0/3387472012 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0490023030 con 0x7f0498103100 2024-03-27T07:23:18.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.936+0000 7f049f62b700 1 -- 172.21.15.82:0/3387472012 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f049802dd30 con 0x7f0498103100 2024-03-27T07:23:18.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.937+0000 7f048e7fc700 1 -- 172.21.15.82:0/3387472012 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3042 (secure 0 0 0) 0x7f0490010070 con 0x7f0498103100 2024-03-27T07:23:18.939 INFO:teuthology.orchestra.run.smithi082.stdout:e21 2024-03-27T07:23:18.939 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-27T07:23:18.939 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-27T07:23:18.939 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-03-27T07:23:18.939 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:18.939 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-03-27T07:23:18.939 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 21 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-03-27T07:21:34.901653+0000 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-03-27T07:21:39.590410+0000 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 300 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-27T07:23:18.940 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 3 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1,2 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=24497,1=24484,2=24470} 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data disabled 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 0 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 24497 members: 24497,24470,24484 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b{0:24497} state up:active seq 3 addr [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c{0:24466} state up:standby-replay seq 1 addr [v2:172.21.15.153:6836/1290254754,v1:172.21.15.153:6837/1290254754] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.941 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.i{1:24484} state up:active seq 6 addr [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.f{1:24460} state up:standby-replay seq 1 addr [v2:172.21.15.153:6834/1080332547,v1:172.21.15.153:6835/1080332547] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.h{2:24470} state up:active seq 7 addr [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.e{2:24446} state up:standby-replay seq 1 addr [v2:172.21.15.149:6834/227197026,v1:172.21.15.149:6835/227197026] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.j{-1:14538} state up:standby seq 1 addr [v2:172.21.15.82:6834/159427358,v1:172.21.15.82:6835/159427358] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d{-1:14556} state up:standby seq 1 addr [v2:172.21.15.82:6836/2302110902,v1:172.21.15.82:6837/2302110902] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.g{-1:14613} state up:standby seq 1 addr [v2:172.21.15.82:6838/908346783,v1:172.21.15.82:6839/908346783] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a{-1:14625} state up:standby seq 1 addr [v2:172.21.15.82:6840/31948189,v1:172.21.15.82:6841/31948189] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.l{-1:24403} state up:standby seq 1 addr [v2:172.21.15.153:6832/193154371,v1:172.21.15.153:6833/193154371] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.942 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.k{-1:24422} state up:standby seq 1 addr [v2:172.21.15.149:6832/51873872,v1:172.21.15.149:6833/51873872] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T07:23:18.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 -- 172.21.15.82:0/3387472012 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f04840a36a0 msgr2=0x7f04840a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:18.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f04840a36a0 0x7f04840a5b60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0494000c00 tx=0x7f0494005fb0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 -- 172.21.15.82:0/3387472012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498103100 msgr2=0x7f049819fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:18.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498103100 0x7f049819fbe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0490007f10 tx=0x7f049000d3b0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 -- 172.21.15.82:0/3387472012 shutdown_connections 2024-03-27T07:23:18.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f04840a36a0 0x7f04840a5b60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0498103100 0x7f049819fbe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0498101560 0x7f049806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 --2- 172.21.15.82:0/3387472012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0498102760 0x7f049819d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 -- 172.21.15.82:0/3387472012 >> 172.21.15.82:0/3387472012 conn(0x7f04980fcb00 msgr2=0x7f0498105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 -- 172.21.15.82:0/3387472012 shutdown_connections 2024-03-27T07:23:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:18.939+0000 7f049f62b700 1 -- 172.21.15.82:0/3387472012 wait complete. 2024-03-27T07:23:18.944 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 21 2024-03-27T07:23:19.740 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- bash -c 'ceph osd dump' 2024-03-27T07:23:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:19 smithi082 ceph-mon[32178]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-03-27T07:23:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:19 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3387472012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-27T07:23:19.980 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:23:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:19 smithi149 ceph-mon[36065]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-03-27T07:23:20.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:19 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3387472012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-27T07:23:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:19 smithi153 ceph-mon[36179]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-03-27T07:23:20.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:19 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3387472012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-27T07:23:21.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.614+0000 7fe436375700 1 -- 172.21.15.82:0/812518883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe430076670 msgr2=0x7fe430074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.614+0000 7fe436375700 1 --2- 172.21.15.82:0/812518883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe430076670 0x7fe430074ad0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe420009990 tx=0x7fe420009ca0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.614+0000 7fe436375700 1 -- 172.21.15.82:0/812518883 shutdown_connections 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.614+0000 7fe436375700 1 --2- 172.21.15.82:0/812518883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe43010ec70 0x7fe430111060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.614+0000 7fe436375700 1 --2- 172.21.15.82:0/812518883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe430076670 0x7fe430074ad0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.614+0000 7fe436375700 1 --2- 172.21.15.82:0/812518883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4300750a0 0x7fe430075520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.614+0000 7fe436375700 1 -- 172.21.15.82:0/812518883 >> 172.21.15.82:0/812518883 conn(0x7fe4300fdc50 msgr2=0x7fe430100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.614+0000 7fe436375700 1 -- 172.21.15.82:0/812518883 shutdown_connections 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.614+0000 7fe436375700 1 -- 172.21.15.82:0/812518883 wait complete. 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe436375700 1 Processor -- start 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe436375700 1 -- start start 2024-03-27T07:23:21.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe436375700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4300750a0 0x7fe43019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe436375700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe430076670 0x7fe43019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe436375700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe43010ec70 0x7fe4301a6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe436375700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe430114850 con 0x7fe43010ec70 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe436375700 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe4301146d0 con 0x7fe430076670 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe436375700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4301149d0 con 0x7fe4300750a0 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe434912700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe43010ec70 0x7fe4301a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe434912700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe43010ec70 0x7fe4301a6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33106/0 (socket says 172.21.15.82:33106) 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe42ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4300750a0 0x7fe43019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe434912700 1 -- 172.21.15.82:0/3485705667 learned_addr learned my addr 172.21.15.82:0/3485705667 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe42f7fe700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe430076670 0x7fe43019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe434912700 1 -- 172.21.15.82:0/3485705667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4300750a0 msgr2=0x7fe43019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:21.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe434912700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4300750a0 0x7fe43019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe434912700 1 -- 172.21.15.82:0/3485705667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe430076670 msgr2=0x7fe43019f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:21.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe434912700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe430076670 0x7fe43019f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.615+0000 7fe434912700 1 -- 172.21.15.82:0/3485705667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4301a6b10 con 0x7fe43010ec70 2024-03-27T07:23:21.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.616+0000 7fe434912700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe43010ec70 0x7fe4301a6470 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe42800ef60 tx=0x7fe42800ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:21.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.616+0000 7fe42d7fa700 1 -- 172.21.15.82:0/3485705667 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4280092e0 con 0x7fe43010ec70 2024-03-27T07:23:21.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.616+0000 7fe42d7fa700 1 -- 172.21.15.82:0/3485705667 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe428004bb0 con 0x7fe43010ec70 2024-03-27T07:23:21.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.616+0000 7fe436375700 1 -- 172.21.15.82:0/3485705667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4301a6da0 con 0x7fe43010ec70 2024-03-27T07:23:21.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.616+0000 7fe42d7fa700 1 -- 172.21.15.82:0/3485705667 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe428004280 con 0x7fe43010ec70 2024-03-27T07:23:21.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.616+0000 7fe436375700 1 -- 172.21.15.82:0/3485705667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4301a7200 con 0x7fe43010ec70 2024-03-27T07:23:21.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.617+0000 7fe436375700 1 -- 172.21.15.82:0/3485705667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe43002dd30 con 0x7fe43010ec70 2024-03-27T07:23:21.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.618+0000 7fe42d7fa700 1 -- 172.21.15.82:0/3485705667 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7fe42801b030 con 0x7fe43010ec70 2024-03-27T07:23:21.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.618+0000 7fe42d7fa700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe4180a36a0 0x7fe4180a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:21.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.618+0000 7fe42ffff700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe4180a36a0 0x7fe4180a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:21.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.619+0000 7fe42d7fa700 1 -- 172.21.15.82:0/3485705667 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fe4280d00d0 con 0x7fe43010ec70 2024-03-27T07:23:21.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.619+0000 7fe42ffff700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe4180a36a0 0x7fe4180a5b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe42000b7b0 tx=0x7fe420005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:21.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.622+0000 7fe42d7fa700 1 -- 172.21.15.82:0/3485705667 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe428022020 con 0x7fe43010ec70 2024-03-27T07:23:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.831+0000 7fe436375700 1 -- 172.21.15.82:0/3485705667 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fe43002df50 con 0x7fe43010ec70 2024-03-27T07:23:21.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.832+0000 7fe42d7fa700 1 -- 172.21.15.82:0/3485705667 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5242 (secure 0 0 0) 0x7fe428010040 con 0x7fe43010ec70 2024-03-27T07:23:21.834 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 88 2024-03-27T07:23:21.834 INFO:teuthology.orchestra.run.smithi082.stdout:fsid 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:23:21.834 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-03-27T07:13:23.455121+0000 2024-03-27T07:23:21.834 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-03-27T07:22:27.661407+0000 2024-03-27T07:23:21.834 INFO:teuthology.orchestra.run.smithi082.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-03-27T07:23:21.834 INFO:teuthology.orchestra.run.smithi082.stdout:crush_version 26 2024-03-27T07:23:21.834 INFO:teuthology.orchestra.run.smithi082.stdout:full_ratio 0.95 2024-03-27T07:23:21.834 INFO:teuthology.orchestra.run.smithi082.stdout:backfillfull_ratio 0.9 2024-03-27T07:23:21.834 INFO:teuthology.orchestra.run.smithi082.stdout:nearfull_ratio 0.85 2024-03-27T07:23:21.834 INFO:teuthology.orchestra.run.smithi082.stdout:require_min_compat_client luminous 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:min_compat_client luminous 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:require_osd_release squid 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:stretch_mode_enabled false 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:max_osd 12 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6802/546346020,v1:172.21.15.82:6803/546346020] [v2:172.21.15.82:6804/546346020,v1:172.21.15.82:6805/546346020] exists,up 3843b5bc-e505-452f-8ce4-f4db52e6c7e8 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6800/828199566,v1:172.21.15.149:6801/828199566] [v2:172.21.15.149:6802/828199566,v1:172.21.15.149:6803/828199566] exists,up 0fb771fe-8d60-4f03-b108-3a94c2e8e6c6 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6800/2925402990,v1:172.21.15.153:6801/2925402990] [v2:172.21.15.153:6802/2925402990,v1:172.21.15.153:6803/2925402990] exists,up 91427a95-87e5-4e0f-b881-9886eea7cd86 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 up in weight 1 up_from 25 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6810/590021111,v1:172.21.15.82:6811/590021111] [v2:172.21.15.82:6812/590021111,v1:172.21.15.82:6813/590021111] exists,up 0fdaf48a-424a-48a1-b666-53dfd853d486 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 up in weight 1 up_from 33 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6808/1568090772,v1:172.21.15.149:6809/1568090772] [v2:172.21.15.149:6810/1568090772,v1:172.21.15.149:6811/1568090772] exists,up ebc9ca5b-bfe9-4124-a145-964d792106b4 2024-03-27T07:23:21.835 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 up in weight 1 up_from 38 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6808/588711733,v1:172.21.15.153:6809/588711733] [v2:172.21.15.153:6810/588711733,v1:172.21.15.153:6811/588711733] exists,up 03acb116-175d-40b6-a569-3ecac8868d99 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 up in weight 1 up_from 46 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6818/2410451909,v1:172.21.15.82:6819/2410451909] [v2:172.21.15.82:6820/2410451909,v1:172.21.15.82:6821/2410451909] exists,up 5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 up in weight 1 up_from 52 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6816/688070751,v1:172.21.15.149:6817/688070751] [v2:172.21.15.149:6818/688070751,v1:172.21.15.149:6819/688070751] exists,up 9a0a4fc5-d9ec-46ff-8052-1cb270698473 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 up in weight 1 up_from 60 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6816/3435360108,v1:172.21.15.153:6817/3435360108] [v2:172.21.15.153:6818/3435360108,v1:172.21.15.153:6819/3435360108] exists,up c1af4d31-3f29-41c3-8d02-605bad1858c6 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 up in weight 1 up_from 68 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6826/1945187916,v1:172.21.15.82:6827/1945187916] [v2:172.21.15.82:6828/1945187916,v1:172.21.15.82:6829/1945187916] exists,up 7905db5d-ad78-473a-b285-f1c4043865cb 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 up in weight 1 up_from 73 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.149:6824/42810131,v1:172.21.15.149:6825/42810131] [v2:172.21.15.149:6826/42810131,v1:172.21.15.149:6827/42810131] exists,up a76fdd45-339b-4cae-a342-d9b1bea0f85f 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.153:6824/4155977568,v1:172.21.15.153:6825/4155977568] [v2:172.21.15.153:6826/4155977568,v1:172.21.15.153:6827/4155977568] exists,up d520186c-b3fd-4979-8b42-634cd9b0c60b 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.6 [8,11] 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.a [2,11] 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.16 [2,4] 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.1f [8,4] 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.e [5,9] 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.34 [4,9] 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.3c [4,9] 2024-03-27T07:23:21.836 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3926741310 expires 2024-03-28T07:14:26.375934+0000 2024-03-27T07:23:21.837 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/3434341690 expires 2024-03-28T07:14:26.375934+0000 2024-03-27T07:23:21.837 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3359247901 expires 2024-03-28T07:13:59.895783+0000 2024-03-27T07:23:21.837 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/832211049 expires 2024-03-28T07:14:26.375934+0000 2024-03-27T07:23:21.837 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1610502221 expires 2024-03-28T07:14:26.375934+0000 2024-03-27T07:23:21.837 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/2722847802 expires 2024-03-28T07:13:59.895783+0000 2024-03-27T07:23:21.837 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/2130588958 expires 2024-03-28T07:13:59.895783+0000 2024-03-27T07:23:21.837 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/1919860944 expires 2024-03-28T07:13:59.895783+0000 2024-03-27T07:23:21.837 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/1919860944 expires 2024-03-28T07:13:59.895783+0000 2024-03-27T07:23:21.837 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/3434341690 expires 2024-03-28T07:14:26.375934+0000 2024-03-27T07:23:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 -- 172.21.15.82:0/3485705667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe4180a36a0 msgr2=0x7fe4180a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe4180a36a0 0x7fe4180a5b60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe42000b7b0 tx=0x7fe420005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 -- 172.21.15.82:0/3485705667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe43010ec70 msgr2=0x7fe4301a6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe43010ec70 0x7fe4301a6470 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe42800ef60 tx=0x7fe42800ef90 comp rx=0 tx=0).stop 2024-03-27T07:23:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 -- 172.21.15.82:0/3485705667 shutdown_connections 2024-03-27T07:23:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe4180a36a0 0x7fe4180a5b60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4300750a0 0x7fe43019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe43010ec70 0x7fe4301a6470 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 --2- 172.21.15.82:0/3485705667 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe430076670 0x7fe43019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 -- 172.21.15.82:0/3485705667 >> 172.21.15.82:0/3485705667 conn(0x7fe4300fdc50 msgr2=0x7fe430102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 -- 172.21.15.82:0/3485705667 shutdown_connections 2024-03-27T07:23:21.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:21.834+0000 7fe436375700 1 -- 172.21.15.82:0/3485705667 wait complete. 2024-03-27T07:23:21.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:21 smithi082 ceph-mon[32178]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:23:22.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:21 smithi149 ceph-mon[36065]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:23:22.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:21 smithi153 ceph-mon[36179]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:23:22.612 INFO:teuthology.run_tasks:Running task fs.ready... 2024-03-27T07:23:22.630 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:23:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.741+0000 7f0bed65c640 1 -- 172.21.15.82:0/1159194079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0be8103740 msgr2=0x7f0be8109fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:22.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.741+0000 7f0bed65c640 1 --2- 172.21.15.82:0/1159194079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0be8103740 0x7f0be8109fd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009ca0 tx=0x7f0be002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.741+0000 7f0bed65c640 1 -- 172.21.15.82:0/1159194079 shutdown_connections 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.741+0000 7f0bed65c640 1 --2- 172.21.15.82:0/1159194079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0be8103740 0x7f0be8109fd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.741+0000 7f0bed65c640 1 --2- 172.21.15.82:0/1159194079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0be8102d80 0x7f0be8103200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.741+0000 7f0bed65c640 1 --2- 172.21.15.82:0/1159194079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be8101b90 0x7f0be8101fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.741+0000 7f0bed65c640 1 -- 172.21.15.82:0/1159194079 >> 172.21.15.82:0/1159194079 conn(0x7f0be80fd100 msgr2=0x7f0be80ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.741+0000 7f0bed65c640 1 -- 172.21.15.82:0/1159194079 shutdown_connections 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.741+0000 7f0bed65c640 1 -- 172.21.15.82:0/1159194079 wait complete. 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0bed65c640 1 Processor -- start 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0bed65c640 1 -- start start 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0bed65c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0be8101b90 0x7f0be819a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0bed65c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0be8102d80 0x7f0be819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0bed65c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be8103740 0x7f0be81a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:22.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0bed65c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0be810d810 con 0x7f0be8102d80 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0bed65c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0be810d690 con 0x7f0be8103740 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0bed65c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0be810d990 con 0x7f0be8101b90 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0be67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0be8102d80 0x7f0be819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0be67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0be8102d80 0x7f0be819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33126/0 (socket says 172.21.15.82:33126) 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0be67fc640 1 -- 172.21.15.82:0/510481045 learned_addr learned my addr 172.21.15.82:0/510481045 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0be6ffd640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0be8101b90 0x7f0be819a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0be67fc640 1 -- 172.21.15.82:0/510481045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0be8101b90 msgr2=0x7f0be819a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0be67fc640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0be8101b90 0x7f0be819a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0be67fc640 1 -- 172.21.15.82:0/510481045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be8103740 msgr2=0x7f0be81a1610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0be67fc640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be8103740 0x7f0be81a1610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0be67fc640 1 -- 172.21.15.82:0/510481045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be81a1c80 con 0x7f0be8102d80 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.742+0000 7f0be67fc640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0be8102d80 0x7f0be819a5a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00e9f0 tx=0x7f0bdc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.743+0000 7f0bcffff640 1 -- 172.21.15.82:0/510481045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc00cd80 con 0x7f0be8102d80 2024-03-27T07:23:22.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.743+0000 7f0bcffff640 1 -- 172.21.15.82:0/510481045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0bdc005500 con 0x7f0be8102d80 2024-03-27T07:23:22.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.743+0000 7f0bed65c640 1 -- 172.21.15.82:0/510481045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be81a1f70 con 0x7f0be8102d80 2024-03-27T07:23:22.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.743+0000 7f0bcffff640 1 -- 172.21.15.82:0/510481045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc010690 con 0x7f0be8102d80 2024-03-27T07:23:22.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.743+0000 7f0bed65c640 1 -- 172.21.15.82:0/510481045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be81a23e0 con 0x7f0be8102d80 2024-03-27T07:23:22.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.744+0000 7f0bed65c640 1 -- 172.21.15.82:0/510481045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be81a26a0 con 0x7f0be8102d80 2024-03-27T07:23:22.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.745+0000 7f0bcffff640 1 -- 172.21.15.82:0/510481045 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f0bdc0046c0 con 0x7f0be8102d80 2024-03-27T07:23:22.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.745+0000 7f0bcffff640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0bd00a3610 0x7f0bd00a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:22.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.745+0000 7f0be6ffd640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0bd00a3610 0x7f0bd00a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:22.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.745+0000 7f0bcffff640 1 -- 172.21.15.82:0/510481045 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f0bdc0d0350 con 0x7f0be8102d80 2024-03-27T07:23:22.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.746+0000 7f0be6ffd640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0bd00a3610 0x7f0bd00a5ad0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0be8102be0 tx=0x7f0bd8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:22.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.749+0000 7f0bcffff640 1 -- 172.21.15.82:0/510481045 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0bdc053cb0 con 0x7f0be8102d80 2024-03-27T07:23:22.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.927+0000 7f0bed65c640 1 -- 172.21.15.82:0/510481045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0be81a2870 con 0x7f0be8102d80 2024-03-27T07:23:22.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.928+0000 7f0bcffff640 1 -- 172.21.15.82:0/510481045 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22502 (secure 0 0 0) 0x7f0bdc09cf50 con 0x7f0be8102d80 2024-03-27T07:23:22.930 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:22.930 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:22:27.661407+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:23:22.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 -- 172.21.15.82:0/510481045 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0bd00a3610 msgr2=0x7f0bd00a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:22.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0bd00a3610 0x7f0bd00a5ad0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0be8102be0 tx=0x7f0bd8005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 -- 172.21.15.82:0/510481045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0be8102d80 msgr2=0x7f0be819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0be8102d80 0x7f0be819a5a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00e9f0 tx=0x7f0bdc00edf0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 -- 172.21.15.82:0/510481045 shutdown_connections 2024-03-27T07:23:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f0bd00a3610 0x7f0bd00a5ad0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0be8102d80 0x7f0be819a5a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0be8103740 0x7f0be81a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 --2- 172.21.15.82:0/510481045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0be8101b90 0x7f0be819a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 -- 172.21.15.82:0/510481045 >> 172.21.15.82:0/510481045 conn(0x7f0be80fd100 msgr2=0x7f0be8073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 -- 172.21.15.82:0/510481045 shutdown_connections 2024-03-27T07:23:22.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:22.930+0000 7f0bed65c640 1 -- 172.21.15.82:0/510481045 wait complete. 2024-03-27T07:23:22.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:22 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3485705667' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-27T07:23:22.944 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T07:21:32.592597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T07:21:33.858606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:23:22.944 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:23:23.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:22 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3485705667' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-27T07:23:23.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:22 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3485705667' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.047+0000 7f8e8592e640 1 -- 172.21.15.82:0/996847514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e80100a60 msgr2=0x7f8e80100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.047+0000 7f8e8592e640 1 --2- 172.21.15.82:0/996847514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e80100a60 0x7f8e80100e80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009900 tx=0x7f8e7002bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.047+0000 7f8e8592e640 1 -- 172.21.15.82:0/996847514 shutdown_connections 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.047+0000 7f8e8592e640 1 --2- 172.21.15.82:0/996847514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e80102610 0x7f8e80108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.047+0000 7f8e8592e640 1 --2- 172.21.15.82:0/996847514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e80101c50 0x7f8e801020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.047+0000 7f8e8592e640 1 --2- 172.21.15.82:0/996847514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e80100a60 0x7f8e80100e80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.047+0000 7f8e8592e640 1 -- 172.21.15.82:0/996847514 >> 172.21.15.82:0/996847514 conn(0x7f8e800fbff0 msgr2=0x7f8e800fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.047+0000 7f8e8592e640 1 -- 172.21.15.82:0/996847514 shutdown_connections 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.047+0000 7f8e8592e640 1 -- 172.21.15.82:0/996847514 wait complete. 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.047+0000 7f8e8592e640 1 Processor -- start 2024-03-27T07:23:23.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e8592e640 1 -- start start 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e8592e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e80100a60 0x7f8e80197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e8592e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e80101c50 0x7f8e801983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e8592e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e80102610 0x7f8e8019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e8592e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8010c6b0 con 0x7f8e80101c50 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e8592e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8010c530 con 0x7f8e80100a60 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e8592e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8010c830 con 0x7f8e80102610 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e80101c50 0x7f8e801983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e80101c50 0x7f8e801983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33144/0 (socket says 172.21.15.82:33144) 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7e7fc640 1 -- 172.21.15.82:0/991398645 learned_addr learned my addr 172.21.15.82:0/991398645 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7effd640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e80100a60 0x7f8e80197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7f7fe640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e80102610 0x7f8e8019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7e7fc640 1 -- 172.21.15.82:0/991398645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e80102610 msgr2=0x7f8e8019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7e7fc640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e80102610 0x7f8e8019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7e7fc640 1 -- 172.21.15.82:0/991398645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e80100a60 msgr2=0x7f8e80197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7e7fc640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e80100a60 0x7f8e80197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7e7fc640 1 -- 172.21.15.82:0/991398645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8019fad0 con 0x7f8e80101c50 2024-03-27T07:23:23.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e7e7fc640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e80101c50 0x7f8e801983f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400e9f0 tx=0x7f8e7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:23.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e8492c640 1 -- 172.21.15.82:0/991398645 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e7400cd80 con 0x7f8e80101c50 2024-03-27T07:23:23.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.048+0000 7f8e8592e640 1 -- 172.21.15.82:0/991398645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8019fdc0 con 0x7f8e80101c50 2024-03-27T07:23:23.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.049+0000 7f8e8492c640 1 -- 172.21.15.82:0/991398645 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e74010910 con 0x7f8e80101c50 2024-03-27T07:23:23.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.049+0000 7f8e8492c640 1 -- 172.21.15.82:0/991398645 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e740188f0 con 0x7f8e80101c50 2024-03-27T07:23:23.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.049+0000 7f8e8592e640 1 -- 172.21.15.82:0/991398645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e801a0290 con 0x7f8e80101c50 2024-03-27T07:23:23.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.049+0000 7f8e8592e640 1 -- 172.21.15.82:0/991398645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e80068d90 con 0x7f8e80101c50 2024-03-27T07:23:23.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.050+0000 7f8e8492c640 1 -- 172.21.15.82:0/991398645 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f8e74010ac0 con 0x7f8e80101c50 2024-03-27T07:23:23.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.051+0000 7f8e8492c640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e680a3610 0x7f8e680a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.051+0000 7f8e7effd640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e680a3610 0x7f8e680a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.051+0000 7f8e8492c640 1 -- 172.21.15.82:0/991398645 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f8e740d00b0 con 0x7f8e80101c50 2024-03-27T07:23:23.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.052+0000 7f8e7effd640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e680a3610 0x7f8e680a5ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8e70000c00 tx=0x7f8e70005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:23.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.056+0000 7f8e8492c640 1 -- 172.21.15.82:0/991398645 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8e7409c660 con 0x7f8e80101c50 2024-03-27T07:23:23.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.231+0000 7f8e8592e640 1 -- 172.21.15.82:0/991398645 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8e801a0c40 con 0x7f8e80101c50 2024-03-27T07:23:23.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.231+0000 7f8e8492c640 1 -- 172.21.15.82:0/991398645 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f8e740a0960 con 0x7f8e80101c50 2024-03-27T07:23:23.234 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:23:23.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.233+0000 7f8e8592e640 1 -- 172.21.15.82:0/991398645 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e680a3610 msgr2=0x7f8e680a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.233+0000 7f8e8592e640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e680a3610 0x7f8e680a5ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8e70000c00 tx=0x7f8e70005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.233+0000 7f8e8592e640 1 -- 172.21.15.82:0/991398645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e80101c50 msgr2=0x7f8e801983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.233+0000 7f8e8592e640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e80101c50 0x7f8e801983f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400e9f0 tx=0x7f8e7400eeb0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.233+0000 7f8e8592e640 1 -- 172.21.15.82:0/991398645 shutdown_connections 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.233+0000 7f8e8592e640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f8e680a3610 0x7f8e680a5ad0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.233+0000 7f8e8592e640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e80101c50 0x7f8e801983f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.233+0000 7f8e8592e640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e80102610 0x7f8e8019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.233+0000 7f8e8592e640 1 --2- 172.21.15.82:0/991398645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e80100a60 0x7f8e80197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.233+0000 7f8e8592e640 1 -- 172.21.15.82:0/991398645 >> 172.21.15.82:0/991398645 conn(0x7f8e800fbff0 msgr2=0x7f8e8006a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.234+0000 7f8e8592e640 1 -- 172.21.15.82:0/991398645 shutdown_connections 2024-03-27T07:23:23.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.234+0000 7f8e8592e640 1 -- 172.21.15.82:0/991398645 wait complete. 2024-03-27T07:23:23.247 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T07:23:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.349+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/3146652526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0100a70 msgr2=0x7fb6c0100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.349+0000 7fb6c6aaf640 1 --2- 172.21.15.82:0/3146652526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0100a70 0x7fb6c0100e90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4009900 tx=0x7fb6b402bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.349+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/3146652526 shutdown_connections 2024-03-27T07:23:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.349+0000 7fb6c6aaf640 1 --2- 172.21.15.82:0/3146652526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6c0102620 0x7fb6c0108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.349+0000 7fb6c6aaf640 1 --2- 172.21.15.82:0/3146652526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c0101c60 0x7fb6c01020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.349+0000 7fb6c6aaf640 1 --2- 172.21.15.82:0/3146652526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0100a70 0x7fb6c0100e90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.349+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/3146652526 >> 172.21.15.82:0/3146652526 conn(0x7fb6c00fc000 msgr2=0x7fb6c00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.349+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/3146652526 shutdown_connections 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.349+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/3146652526 wait complete. 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c6aaf640 1 Processor -- start 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c6aaf640 1 -- start start 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c6aaf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6c0100a70 0x7fb6c006acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c6aaf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c0101c60 0x7fb6c019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c6aaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0102620 0x7fb6c019f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c6aaf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c010c730 con 0x7fb6c0102620 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c6aaf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c010c5b0 con 0x7fb6c0100a70 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c6aaf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c010c8b0 con 0x7fb6c0101c60 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c504c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0102620 0x7fb6c019f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c504c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0102620 0x7fb6c019f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33162/0 (socket says 172.21.15.82:33162) 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c504c640 1 -- 172.21.15.82:0/928543217 learned_addr learned my addr 172.21.15.82:0/928543217 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6c484b640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6c0100a70 0x7fb6c006acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.350+0000 7fb6bffff640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c0101c60 0x7fb6c019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6c504c640 1 -- 172.21.15.82:0/928543217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c0101c60 msgr2=0x7fb6c019cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6c504c640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c0101c60 0x7fb6c019cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6c504c640 1 -- 172.21.15.82:0/928543217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6c0100a70 msgr2=0x7fb6c006acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6c504c640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6c0100a70 0x7fb6c006acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6c504c640 1 -- 172.21.15.82:0/928543217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c019fae0 con 0x7fb6c0102620 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6c504c640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0102620 0x7fb6c019f220 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800eb10 tx=0x7fb6b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6bdffb640 1 -- 172.21.15.82:0/928543217 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8004b20 con 0x7fb6c0102620 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6bdffb640 1 -- 172.21.15.82:0/928543217 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6b8004cc0 con 0x7fb6c0102620 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/928543217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c019fdd0 con 0x7fb6c0102620 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6bdffb640 1 -- 172.21.15.82:0/928543217 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8010760 con 0x7fb6c0102620 2024-03-27T07:23:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.351+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/928543217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c01a02f0 con 0x7fb6c0102620 2024-03-27T07:23:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.352+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/928543217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c0107d90 con 0x7fb6c0102620 2024-03-27T07:23:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.353+0000 7fb6bdffb640 1 -- 172.21.15.82:0/928543217 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7fb6b8005020 con 0x7fb6c0102620 2024-03-27T07:23:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.353+0000 7fb6bdffb640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb6b00a3690 0x7fb6b00a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.353+0000 7fb6c484b640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb6b00a3690 0x7fb6b00a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.353+0000 7fb6bdffb640 1 -- 172.21.15.82:0/928543217 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fb6b80d01e0 con 0x7fb6c0102620 2024-03-27T07:23:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.354+0000 7fb6c484b640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb6b00a3690 0x7fb6b00a5b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb6b402c170 tx=0x7fb6b402df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.358+0000 7fb6bdffb640 1 -- 172.21.15.82:0/928543217 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb6b809cde0 con 0x7fb6c0102620 2024-03-27T07:23:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.534+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/928543217 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb6c0062750 con 0x7fb6c0102620 2024-03-27T07:23:23.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.534+0000 7fb6bdffb640 1 -- 172.21.15.82:0/928543217 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7fb6b80870f0 con 0x7fb6c0102620 2024-03-27T07:23:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-27T07:23:23.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/928543217 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb6b00a3690 msgr2=0x7fb6b00a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb6b00a3690 0x7fb6b00a5b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb6b402c170 tx=0x7fb6b402df90 comp rx=0 tx=0).stop 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/928543217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0102620 msgr2=0x7fb6c019f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0102620 0x7fb6c019f220 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800eb10 tx=0x7fb6b800c2d0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/928543217 shutdown_connections 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fb6b00a3690 0x7fb6b00a5b50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0102620 0x7fb6c019f220 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6c0101c60 0x7fb6c019cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 --2- 172.21.15.82:0/928543217 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb6c0100a70 0x7fb6c006acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/928543217 >> 172.21.15.82:0/928543217 conn(0x7fb6c00fc000 msgr2=0x7fb6c0104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/928543217 shutdown_connections 2024-03-27T07:23:23.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.536+0000 7fb6c6aaf640 1 -- 172.21.15.82:0/928543217 wait complete. 2024-03-27T07:23:23.549 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T07:23:23.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.651+0000 7ff14210d640 1 -- 172.21.15.82:0/138941598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff13c102630 msgr2=0x7ff13c104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.651+0000 7ff14210d640 1 --2- 172.21.15.82:0/138941598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff13c102630 0x7ff13c104a20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009900 tx=0x7ff12c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.651+0000 7ff14210d640 1 -- 172.21.15.82:0/138941598 shutdown_connections 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.651+0000 7ff14210d640 1 --2- 172.21.15.82:0/138941598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff13c107890 0x7ff13c109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.651+0000 7ff14210d640 1 --2- 172.21.15.82:0/138941598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c104f60 0x7ff13c107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.651+0000 7ff14210d640 1 --2- 172.21.15.82:0/138941598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff13c102630 0x7ff13c104a20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.651+0000 7ff14210d640 1 -- 172.21.15.82:0/138941598 >> 172.21.15.82:0/138941598 conn(0x7ff13c0fbfe0 msgr2=0x7ff13c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.651+0000 7ff14210d640 1 -- 172.21.15.82:0/138941598 shutdown_connections 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.651+0000 7ff14210d640 1 -- 172.21.15.82:0/138941598 wait complete. 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff14210d640 1 Processor -- start 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff14210d640 1 -- start start 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff14210d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff13c102630 0x7ff13c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff14210d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c104f60 0x7ff13c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff14210d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff13c107890 0x7ff13c19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff14210d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c10d7f0 con 0x7ff13c107890 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff14210d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c10d670 con 0x7ff13c104f60 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff14210d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff13c10d970 con 0x7ff13c102630 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff13bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff13c107890 0x7ff13c19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff13bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff13c107890 0x7ff13c19f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33182/0 (socket says 172.21.15.82:33182) 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff13bfff640 1 -- 172.21.15.82:0/788189997 learned_addr learned my addr 172.21.15.82:0/788189997 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff13affd640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c104f60 0x7ff13c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.652+0000 7ff13b7fe640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff13c102630 0x7ff13c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff13bfff640 1 -- 172.21.15.82:0/788189997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff13c102630 msgr2=0x7ff13c197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff13bfff640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff13c102630 0x7ff13c197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff13bfff640 1 -- 172.21.15.82:0/788189997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c104f60 msgr2=0x7ff13c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff13bfff640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c104f60 0x7ff13c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff13bfff640 1 -- 172.21.15.82:0/788189997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff13c19fb10 con 0x7ff13c107890 2024-03-27T07:23:23.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff13bfff640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff13c107890 0x7ff13c19f4a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff13400eb10 tx=0x7ff13400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:23.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff138ff9640 1 -- 172.21.15.82:0/788189997 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff134004b20 con 0x7ff13c107890 2024-03-27T07:23:23.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff14210d640 1 -- 172.21.15.82:0/788189997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff13c19fe00 con 0x7ff13c107890 2024-03-27T07:23:23.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff138ff9640 1 -- 172.21.15.82:0/788189997 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff134004cc0 con 0x7ff13c107890 2024-03-27T07:23:23.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff138ff9640 1 -- 172.21.15.82:0/788189997 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff134010760 con 0x7ff13c107890 2024-03-27T07:23:23.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.653+0000 7ff14210d640 1 -- 172.21.15.82:0/788189997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff13c1a0310 con 0x7ff13c107890 2024-03-27T07:23:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.654+0000 7ff14210d640 1 -- 172.21.15.82:0/788189997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13c0fdad0 con 0x7ff13c107890 2024-03-27T07:23:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.655+0000 7ff138ff9640 1 -- 172.21.15.82:0/788189997 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7ff134005020 con 0x7ff13c107890 2024-03-27T07:23:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.656+0000 7ff138ff9640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1240a3610 0x7ff1240a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.656+0000 7ff13b7fe640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1240a3610 0x7ff1240a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.656+0000 7ff138ff9640 1 -- 172.21.15.82:0/788189997 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7ff1340d0390 con 0x7ff13c107890 2024-03-27T07:23:23.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.656+0000 7ff13b7fe640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1240a3610 0x7ff1240a5ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff12c02c7b0 tx=0x7ff12c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:23.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.660+0000 7ff138ff9640 1 -- 172.21.15.82:0/788189997 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ff13409cf90 con 0x7ff13c107890 2024-03-27T07:23:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.839+0000 7ff14210d640 1 -- 172.21.15.82:0/788189997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff13c062750 con 0x7ff13c107890 2024-03-27T07:23:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.840+0000 7ff138ff9640 1 -- 172.21.15.82:0/788189997 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7ff134085e20 con 0x7ff13c107890 2024-03-27T07:23:23.842 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-27T07:23:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 -- 172.21.15.82:0/788189997 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1240a3610 msgr2=0x7ff1240a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1240a3610 0x7ff1240a5ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff12c02c7b0 tx=0x7ff12c005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 -- 172.21.15.82:0/788189997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff13c107890 msgr2=0x7ff13c19f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff13c107890 0x7ff13c19f4a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff13400eb10 tx=0x7ff13400c2d0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 -- 172.21.15.82:0/788189997 shutdown_connections 2024-03-27T07:23:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7ff1240a3610 0x7ff1240a5ad0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff13c107890 0x7ff13c19f4a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff13c104f60 0x7ff13c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 --2- 172.21.15.82:0/788189997 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff13c102630 0x7ff13c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 -- 172.21.15.82:0/788189997 >> 172.21.15.82:0/788189997 conn(0x7ff13c0fbfe0 msgr2=0x7ff13c1030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 -- 172.21.15.82:0/788189997 shutdown_connections 2024-03-27T07:23:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.842+0000 7ff14210d640 1 -- 172.21.15.82:0/788189997 wait complete. 2024-03-27T07:23:23.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:23 smithi082 ceph-mon[32178]: pgmap v346: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T07:23:23.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:23 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/510481045' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:23.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:23 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/991398645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:23.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:23 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/928543217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:23.855 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:23:23.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 -- 172.21.15.82:0/2698862110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd870102670 msgr2=0x7fd870104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 --2- 172.21.15.82:0/2698862110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd870102670 0x7fd870104a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd864009900 tx=0x7fd86402bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 -- 172.21.15.82:0/2698862110 shutdown_connections 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 --2- 172.21.15.82:0/2698862110 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd870104fa0 0x7fd870107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 --2- 172.21.15.82:0/2698862110 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd8701078d0 0x7fd870109d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 --2- 172.21.15.82:0/2698862110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd870102670 0x7fd870104a60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 -- 172.21.15.82:0/2698862110 >> 172.21.15.82:0/2698862110 conn(0x7fd8700fc080 msgr2=0x7fd8700fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 -- 172.21.15.82:0/2698862110 shutdown_connections 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 -- 172.21.15.82:0/2698862110 wait complete. 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 Processor -- start 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 -- start start 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd870102670 0x7fd870197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd870104fa0 0x7fd870198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8701078d0 0x7fd87019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd87010d820 con 0x7fd8701078d0 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd87010d6a0 con 0x7fd870102670 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.955+0000 7fd87664e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd87010d9a0 con 0x7fd870104fa0 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd874beb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8701078d0 0x7fd87019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd86ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd870102670 0x7fd870197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd874beb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8701078d0 0x7fd87019f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33208/0 (socket says 172.21.15.82:33208) 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd874beb640 1 -- 172.21.15.82:0/304243964 learned_addr learned my addr 172.21.15.82:0/304243964 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd86f7fe640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd870104fa0 0x7fd870198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd874beb640 1 -- 172.21.15.82:0/304243964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd870104fa0 msgr2=0x7fd870198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd874beb640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd870104fa0 0x7fd870198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd874beb640 1 -- 172.21.15.82:0/304243964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd870102670 msgr2=0x7fd870197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd874beb640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd870102670 0x7fd870197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:23.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd874beb640 1 -- 172.21.15.82:0/304243964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd87019fae0 con 0x7fd8701078d0 2024-03-27T07:23:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd86ffff640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd870102670 0x7fd870197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd874beb640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8701078d0 0x7fd87019f470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd86800eb10 tx=0x7fd86800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd86d7fa640 1 -- 172.21.15.82:0/304243964 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868004b20 con 0x7fd8701078d0 2024-03-27T07:23:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd87664e640 1 -- 172.21.15.82:0/304243964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd87019fdd0 con 0x7fd8701078d0 2024-03-27T07:23:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd86d7fa640 1 -- 172.21.15.82:0/304243964 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd868004cc0 con 0x7fd8701078d0 2024-03-27T07:23:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd86d7fa640 1 -- 172.21.15.82:0/304243964 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd868010760 con 0x7fd8701078d0 2024-03-27T07:23:23.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.956+0000 7fd87664e640 1 -- 172.21.15.82:0/304243964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8701a0290 con 0x7fd8701078d0 2024-03-27T07:23:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.957+0000 7fd87664e640 1 -- 172.21.15.82:0/304243964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8700fdb70 con 0x7fd8701078d0 2024-03-27T07:23:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.958+0000 7fd86d7fa640 1 -- 172.21.15.82:0/304243964 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7fd868005020 con 0x7fd8701078d0 2024-03-27T07:23:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.959+0000 7fd86d7fa640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd8580a3610 0x7fd8580a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.959+0000 7fd86ffff640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd8580a3610 0x7fd8580a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.959+0000 7fd86d7fa640 1 -- 172.21.15.82:0/304243964 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fd8680d0390 con 0x7fd8701078d0 2024-03-27T07:23:23.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.959+0000 7fd86ffff640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd8580a3610 0x7fd8580a5ad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd86402c7b0 tx=0x7fd864005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:23.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:23.963+0000 7fd86d7fa640 1 -- 172.21.15.82:0/304243964 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd86809cf90 con 0x7fd8701078d0 2024-03-27T07:23:24.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:23 smithi149 ceph-mon[36065]: pgmap v346: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T07:23:24.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:23 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/510481045' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:24.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:23 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/991398645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:24.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:23 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/928543217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:24.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:23 smithi153 ceph-mon[36179]: pgmap v346: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T07:23:24.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:23 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/510481045' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:24.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:23 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/991398645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:24.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:23 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/928543217' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:24.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.178+0000 7fd87664e640 1 -- 172.21.15.82:0/304243964 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd870062750 con 0x7fd8701078d0 2024-03-27T07:23:24.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.179+0000 7fd86d7fa640 1 -- 172.21.15.82:0/304243964 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fd868085e20 con 0x7fd8701078d0 2024-03-27T07:23:24.181 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:24.181 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:21:39.590410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24470,24484]},"id":1}]} 2024-03-27T07:23:24.181 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 21 2024-03-27T07:23:24.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 -- 172.21.15.82:0/304243964 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd8580a3610 msgr2=0x7fd8580a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd8580a3610 0x7fd8580a5ad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd86402c7b0 tx=0x7fd864005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 -- 172.21.15.82:0/304243964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8701078d0 msgr2=0x7fd87019f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8701078d0 0x7fd87019f470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd86800eb10 tx=0x7fd86800c2d0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 -- 172.21.15.82:0/304243964 shutdown_connections 2024-03-27T07:23:24.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd8580a3610 0x7fd8580a5ad0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8701078d0 0x7fd87019f470 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd870104fa0 0x7fd870198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 --2- 172.21.15.82:0/304243964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd870102670 0x7fd870197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 -- 172.21.15.82:0/304243964 >> 172.21.15.82:0/304243964 conn(0x7fd8700fc080 msgr2=0x7fd870102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:24.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 -- 172.21.15.82:0/304243964 shutdown_connections 2024-03-27T07:23:24.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.181+0000 7fd87664e640 1 -- 172.21.15.82:0/304243964 wait complete. 2024-03-27T07:23:24.194 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:23:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.294+0000 7f8121765640 1 -- 172.21.15.82:0/964773617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c100af0 msgr2=0x7f811c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.294+0000 7f8121765640 1 --2- 172.21.15.82:0/964773617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c100af0 0x7f811c100f10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f810c009900 tx=0x7f810c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:24.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.294+0000 7f8121765640 1 -- 172.21.15.82:0/964773617 shutdown_connections 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.294+0000 7f8121765640 1 --2- 172.21.15.82:0/964773617 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811c1026a0 0x7f811c108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.294+0000 7f8121765640 1 --2- 172.21.15.82:0/964773617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c101ce0 0x7f811c102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.294+0000 7f8121765640 1 --2- 172.21.15.82:0/964773617 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c100af0 0x7f811c100f10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.294+0000 7f8121765640 1 -- 172.21.15.82:0/964773617 >> 172.21.15.82:0/964773617 conn(0x7f811c0fc080 msgr2=0x7f811c0fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.294+0000 7f8121765640 1 -- 172.21.15.82:0/964773617 shutdown_connections 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.294+0000 7f8121765640 1 -- 172.21.15.82:0/964773617 wait complete. 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.294+0000 7f8121765640 1 Processor -- start 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8121765640 1 -- start start 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8121765640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811c100af0 0x7f811c197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8121765640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c101ce0 0x7f811c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8121765640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c1026a0 0x7f811c19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8121765640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f811c10c6f0 con 0x7f811c101ce0 2024-03-27T07:23:24.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8121765640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f811c10c570 con 0x7f811c100af0 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8121765640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f811c10c870 con 0x7f811c1026a0 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f81127fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c101ce0 0x7f811c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f81127fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c101ce0 0x7f811c198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33226/0 (socket says 172.21.15.82:33226) 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f81127fc640 1 -- 172.21.15.82:0/2448299037 learned_addr learned my addr 172.21.15.82:0/2448299037 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f811b7fe640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c1026a0 0x7f811c19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f811affd640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811c100af0 0x7f811c197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f81127fc640 1 -- 172.21.15.82:0/2448299037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c1026a0 msgr2=0x7f811c19f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f81127fc640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c1026a0 0x7f811c19f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f81127fc640 1 -- 172.21.15.82:0/2448299037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811c100af0 msgr2=0x7f811c197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f81127fc640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811c100af0 0x7f811c197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f81127fc640 1 -- 172.21.15.82:0/2448299037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f811c19fac0 con 0x7f811c101ce0 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f81127fc640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c101ce0 0x7f811c198430 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f810400e9f0 tx=0x7f810400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8118ff9640 1 -- 172.21.15.82:0/2448299037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810400cd80 con 0x7f811c101ce0 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8118ff9640 1 -- 172.21.15.82:0/2448299037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8104005500 con 0x7f811c101ce0 2024-03-27T07:23:24.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8121765640 1 -- 172.21.15.82:0/2448299037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f811c19fdb0 con 0x7f811c101ce0 2024-03-27T07:23:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.295+0000 7f8118ff9640 1 -- 172.21.15.82:0/2448299037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8104010690 con 0x7f811c101ce0 2024-03-27T07:23:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.296+0000 7f8121765640 1 -- 172.21.15.82:0/2448299037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f811c1a0220 con 0x7f811c101ce0 2024-03-27T07:23:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.297+0000 7f8121765640 1 -- 172.21.15.82:0/2448299037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f811c1a04b0 con 0x7f811c101ce0 2024-03-27T07:23:24.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.298+0000 7f8118ff9640 1 -- 172.21.15.82:0/2448299037 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f81040046c0 con 0x7f811c101ce0 2024-03-27T07:23:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.298+0000 7f8118ff9640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f81080a3610 0x7f81080a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.298+0000 7f811affd640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f81080a3610 0x7f81080a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.298+0000 7f8118ff9640 1 -- 172.21.15.82:0/2448299037 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f81040d0080 con 0x7f811c101ce0 2024-03-27T07:23:24.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.299+0000 7f811affd640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f81080a3610 0x7f81080a5ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f810c000c00 tx=0x7f810c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:24.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.302+0000 7f8118ff9640 1 -- 172.21.15.82:0/2448299037 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f810409cc80 con 0x7f811c101ce0 2024-03-27T07:23:24.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.481+0000 7f8121765640 1 -- 172.21.15.82:0/2448299037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f811c1a0d50 con 0x7f811c101ce0 2024-03-27T07:23:24.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.482+0000 7f8118ff9640 1 -- 172.21.15.82:0/2448299037 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22502 (secure 0 0 0) 0x7f810409c580 con 0x7f811c101ce0 2024-03-27T07:23:24.484 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:24.484 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:22:27.661407+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:23:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 -- 172.21.15.82:0/2448299037 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f81080a3610 msgr2=0x7f81080a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f81080a3610 0x7f81080a5ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f810c000c00 tx=0x7f810c005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 -- 172.21.15.82:0/2448299037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c101ce0 msgr2=0x7f811c198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c101ce0 0x7f811c198430 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f810400e9f0 tx=0x7f810400edf0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 -- 172.21.15.82:0/2448299037 shutdown_connections 2024-03-27T07:23:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f81080a3610 0x7f81080a5ad0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f811c101ce0 0x7f811c198430 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f811c1026a0 0x7f811c19f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 --2- 172.21.15.82:0/2448299037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f811c100af0 0x7f811c197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 -- 172.21.15.82:0/2448299037 >> 172.21.15.82:0/2448299037 conn(0x7f811c0fc080 msgr2=0x7f811c06a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 -- 172.21.15.82:0/2448299037 shutdown_connections 2024-03-27T07:23:24.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.484+0000 7f8121765640 1 -- 172.21.15.82:0/2448299037 wait complete. 2024-03-27T07:23:24.497 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T07:21:32.592597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T07:21:33.858606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:23:24.498 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:23:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 -- 172.21.15.82:0/1746890377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8654101b60 msgr2=0x7f8654101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 --2- 172.21.15.82:0/1746890377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8654101b60 0x7f8654101f80 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f864c009ca0 tx=0x7f864c02c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 -- 172.21.15.82:0/1746890377 shutdown_connections 2024-03-27T07:23:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 --2- 172.21.15.82:0/1746890377 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8654103710 0x7f8654109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 --2- 172.21.15.82:0/1746890377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8654102d50 0x7f86541031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 --2- 172.21.15.82:0/1746890377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8654101b60 0x7f8654101f80 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 -- 172.21.15.82:0/1746890377 >> 172.21.15.82:0/1746890377 conn(0x7f86540fd0f0 msgr2=0x7f86540ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:24.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 -- 172.21.15.82:0/1746890377 shutdown_connections 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 -- 172.21.15.82:0/1746890377 wait complete. 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 Processor -- start 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 -- start start 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8654101b60 0x7f8654075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8654102d50 0x7f8654073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8654103710 0x7f8654074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f865410d7b0 con 0x7f8654102d50 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f865410d630 con 0x7f8654103710 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f865b0af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f865410d930 con 0x7f8654101b60 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f8653fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8654102d50 0x7f8654073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f8653fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8654102d50 0x7f8654073f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33244/0 (socket says 172.21.15.82:33244) 2024-03-27T07:23:24.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f8653fff640 1 -- 172.21.15.82:0/1377132778 learned_addr learned my addr 172.21.15.82:0/1377132778 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.601+0000 7f8658e4b640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8654101b60 0x7f8654075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f865964c640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8654103710 0x7f8654074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f8653fff640 1 -- 172.21.15.82:0/1377132778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8654101b60 msgr2=0x7f8654075900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f8653fff640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8654101b60 0x7f8654075900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f8653fff640 1 -- 172.21.15.82:0/1377132778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8654103710 msgr2=0x7f8654074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f8653fff640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8654103710 0x7f8654074480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f8653fff640 1 -- 172.21.15.82:0/1377132778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8654074d10 con 0x7f8654102d50 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f8653fff640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8654102d50 0x7f8654073f40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f863c00e9f0 tx=0x7f863c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f8651ffb640 1 -- 172.21.15.82:0/1377132778 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c00cd80 con 0x7f8654102d50 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f8651ffb640 1 -- 172.21.15.82:0/1377132778 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f863c010910 con 0x7f8654102d50 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f865b0af640 1 -- 172.21.15.82:0/1377132778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86541a1ff0 con 0x7f8654102d50 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f8651ffb640 1 -- 172.21.15.82:0/1377132778 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f863c018990 con 0x7f8654102d50 2024-03-27T07:23:24.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.602+0000 7f865b0af640 1 -- 172.21.15.82:0/1377132778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86541a2450 con 0x7f8654102d50 2024-03-27T07:23:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.603+0000 7f865b0af640 1 -- 172.21.15.82:0/1377132778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8654108fa0 con 0x7f8654102d50 2024-03-27T07:23:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.604+0000 7f8651ffb640 1 -- 172.21.15.82:0/1377132778 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f863c010ac0 con 0x7f8654102d50 2024-03-27T07:23:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.605+0000 7f8651ffb640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f86400a3610 0x7f86400a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.605+0000 7f8658e4b640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f86400a3610 0x7f86400a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.605+0000 7f8651ffb640 1 -- 172.21.15.82:0/1377132778 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f863c0cff70 con 0x7f8654102d50 2024-03-27T07:23:24.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.606+0000 7f8658e4b640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f86400a3610 0x7f86400a5ad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f864c02c630 tx=0x7f864c009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:24.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.610+0000 7f8651ffb640 1 -- 172.21.15.82:0/1377132778 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f863c09c520 con 0x7f8654102d50 2024-03-27T07:23:24.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.788+0000 7f865b0af640 1 -- 172.21.15.82:0/1377132778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8654062850 con 0x7f8654102d50 2024-03-27T07:23:24.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.789+0000 7f8651ffb640 1 -- 172.21.15.82:0/1377132778 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f863c0a0820 con 0x7f8654102d50 2024-03-27T07:23:24.791 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:23:24.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 -- 172.21.15.82:0/1377132778 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f86400a3610 msgr2=0x7f86400a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f86400a3610 0x7f86400a5ad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f864c02c630 tx=0x7f864c009360 comp rx=0 tx=0).stop 2024-03-27T07:23:24.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 -- 172.21.15.82:0/1377132778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8654102d50 msgr2=0x7f8654073f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8654102d50 0x7f8654073f40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f863c00e9f0 tx=0x7f863c00eeb0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 -- 172.21.15.82:0/1377132778 shutdown_connections 2024-03-27T07:23:24.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f86400a3610 0x7f86400a5ad0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8654102d50 0x7f8654073f40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8654103710 0x7f8654074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 --2- 172.21.15.82:0/1377132778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8654101b60 0x7f8654075900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 -- 172.21.15.82:0/1377132778 >> 172.21.15.82:0/1377132778 conn(0x7f86540fd0f0 msgr2=0x7f8654106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:24.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 -- 172.21.15.82:0/1377132778 shutdown_connections 2024-03-27T07:23:24.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.791+0000 7f865b0af640 1 -- 172.21.15.82:0/1377132778 wait complete. 2024-03-27T07:23:24.804 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:24 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/788189997' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:24.804 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:24 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/304243964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:24.804 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:24 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2448299037' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:24.805 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T07:23:24.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.920+0000 7f29d7be2640 1 -- 172.21.15.82:0/905148977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0104f20 msgr2=0x7f29d0107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.920+0000 7f29d7be2640 1 --2- 172.21.15.82:0/905148977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0104f20 0x7f29d0107310 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009900 tx=0x7f29c002bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:24.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.920+0000 7f29d7be2640 1 -- 172.21.15.82:0/905148977 shutdown_connections 2024-03-27T07:23:24.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.920+0000 7f29d7be2640 1 --2- 172.21.15.82:0/905148977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0104f20 0x7f29d0107310 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.920+0000 7f29d7be2640 1 --2- 172.21.15.82:0/905148977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d0107850 0x7f29d0109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.920+0000 7f29d7be2640 1 --2- 172.21.15.82:0/905148977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29d01025f0 0x7f29d01049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.920+0000 7f29d7be2640 1 -- 172.21.15.82:0/905148977 >> 172.21.15.82:0/905148977 conn(0x7f29d00fc000 msgr2=0x7f29d00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:24.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.920+0000 7f29d7be2640 1 -- 172.21.15.82:0/905148977 shutdown_connections 2024-03-27T07:23:24.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.920+0000 7f29d7be2640 1 -- 172.21.15.82:0/905148977 wait complete. 2024-03-27T07:23:24.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d7be2640 1 Processor -- start 2024-03-27T07:23:24.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d7be2640 1 -- start start 2024-03-27T07:23:24.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d7be2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29d01025f0 0x7f29d019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d7be2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0104f20 0x7f29d019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d7be2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d0107850 0x7f29d01a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d7be2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29d010d800 con 0x7f29d0104f20 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d7be2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f29d010d680 con 0x7f29d0107850 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d7be2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f29d010d980 con 0x7f29d01025f0 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d517d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0104f20 0x7f29d019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d517d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0104f20 0x7f29d019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33262/0 (socket says 172.21.15.82:33262) 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d517d640 1 -- 172.21.15.82:0/4009261321 learned_addr learned my addr 172.21.15.82:0/4009261321 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d597e640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29d01025f0 0x7f29d019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d617f640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d0107850 0x7f29d01a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d517d640 1 -- 172.21.15.82:0/4009261321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29d01025f0 msgr2=0x7f29d019a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d517d640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29d01025f0 0x7f29d019a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d517d640 1 -- 172.21.15.82:0/4009261321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d0107850 msgr2=0x7f29d01a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d517d640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d0107850 0x7f29d01a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d517d640 1 -- 172.21.15.82:0/4009261321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d01a1d20 con 0x7f29d0104f20 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d517d640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0104f20 0x7f29d019a640 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f29c0000c00 tx=0x7f29c002c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29c6ffd640 1 -- 172.21.15.82:0/4009261321 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0041070 con 0x7f29d0104f20 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29c6ffd640 1 -- 172.21.15.82:0/4009261321 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29c0004450 con 0x7f29d0104f20 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29d7be2640 1 -- 172.21.15.82:0/4009261321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d01a1fb0 con 0x7f29d0104f20 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.921+0000 7f29c6ffd640 1 -- 172.21.15.82:0/4009261321 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0034440 con 0x7f29d0104f20 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.922+0000 7f29d7be2640 1 -- 172.21.15.82:0/4009261321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d01a2410 con 0x7f29d0104f20 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.922+0000 7f29d7be2640 1 -- 172.21.15.82:0/4009261321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d01093a0 con 0x7f29d0104f20 2024-03-27T07:23:24.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.923+0000 7f29c6ffd640 1 -- 172.21.15.82:0/4009261321 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f29c0044070 con 0x7f29d0104f20 2024-03-27T07:23:24.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.924+0000 7f29c6ffd640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29bc0a3610 0x7f29bc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.924+0000 7f29d597e640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29bc0a3610 0x7f29bc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.924+0000 7f29c6ffd640 1 -- 172.21.15.82:0/4009261321 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f29c00f17b0 con 0x7f29d0104f20 2024-03-27T07:23:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.924+0000 7f29d597e640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29bc0a3610 0x7f29bc0a5ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009bd0 tx=0x7f29cc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:24.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:24.928+0000 7f29c6ffd640 1 -- 172.21.15.82:0/4009261321 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f29c00bddf0 con 0x7f29d0104f20 2024-03-27T07:23:25.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:24 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/788189997' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:25.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:24 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/304243964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:25.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:24 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2448299037' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:25.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:24 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/788189997' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:25.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:24 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/304243964' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:25.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:24 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2448299037' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:25.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.104+0000 7f29d7be2640 1 -- 172.21.15.82:0/4009261321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f29d002d590 con 0x7f29d0104f20 2024-03-27T07:23:25.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.104+0000 7f29c6ffd640 1 -- 172.21.15.82:0/4009261321 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f29c00c20f0 con 0x7f29d0104f20 2024-03-27T07:23:25.107 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-27T07:23:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.106+0000 7f29d7be2640 1 -- 172.21.15.82:0/4009261321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29bc0a3610 msgr2=0x7f29bc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.106+0000 7f29d7be2640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29bc0a3610 0x7f29bc0a5ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f29cc009bd0 tx=0x7f29cc005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.106+0000 7f29d7be2640 1 -- 172.21.15.82:0/4009261321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0104f20 msgr2=0x7f29d019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.106+0000 7f29d7be2640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0104f20 0x7f29d019a640 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f29c0000c00 tx=0x7f29c002c640 comp rx=0 tx=0).stop 2024-03-27T07:23:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.106+0000 7f29d7be2640 1 -- 172.21.15.82:0/4009261321 shutdown_connections 2024-03-27T07:23:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.106+0000 7f29d7be2640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f29bc0a3610 0x7f29bc0a5ad0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.106+0000 7f29d7be2640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29d0104f20 0x7f29d019a640 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.106+0000 7f29d7be2640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f29d0107850 0x7f29d01a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.106+0000 7f29d7be2640 1 --2- 172.21.15.82:0/4009261321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29d01025f0 0x7f29d019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.106+0000 7f29d7be2640 1 -- 172.21.15.82:0/4009261321 >> 172.21.15.82:0/4009261321 conn(0x7f29d00fc000 msgr2=0x7f29d0101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:25.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.107+0000 7f29d7be2640 1 -- 172.21.15.82:0/4009261321 shutdown_connections 2024-03-27T07:23:25.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.107+0000 7f29d7be2640 1 -- 172.21.15.82:0/4009261321 wait complete. 2024-03-27T07:23:25.120 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T07:23:25.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.224+0000 7f73b159a640 1 -- 172.21.15.82:0/2352898465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ac102650 msgr2=0x7f73ac104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.224+0000 7f73b159a640 1 --2- 172.21.15.82:0/2352898465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ac102650 0x7f73ac104a40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f739c009900 tx=0x7f739c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:25.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.224+0000 7f73b159a640 1 -- 172.21.15.82:0/2352898465 shutdown_connections 2024-03-27T07:23:25.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.224+0000 7f73b159a640 1 --2- 172.21.15.82:0/2352898465 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac1078b0 0x7f73ac109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.224+0000 7f73b159a640 1 --2- 172.21.15.82:0/2352898465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac104f80 0x7f73ac107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.224+0000 7f73b159a640 1 --2- 172.21.15.82:0/2352898465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ac102650 0x7f73ac104a40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.224+0000 7f73b159a640 1 -- 172.21.15.82:0/2352898465 >> 172.21.15.82:0/2352898465 conn(0x7f73ac0fc000 msgr2=0x7f73ac0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.224+0000 7f73b159a640 1 -- 172.21.15.82:0/2352898465 shutdown_connections 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.224+0000 7f73b159a640 1 -- 172.21.15.82:0/2352898465 wait complete. 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.224+0000 7f73b159a640 1 Processor -- start 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73b159a640 1 -- start start 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73b159a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ac102650 0x7f73ac197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73b159a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac104f80 0x7f73ac198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73b159a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac1078b0 0x7f73ac19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73b159a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac10d810 con 0x7f73ac102650 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73b159a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac10d690 con 0x7f73ac1078b0 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73b159a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac10d990 con 0x7f73ac104f80 2024-03-27T07:23:25.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ac102650 0x7f73ac197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ac102650 0x7f73ac197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33278/0 (socket says 172.21.15.82:33278) 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73aaffd640 1 -- 172.21.15.82:0/3589004061 learned_addr learned my addr 172.21.15.82:0/3589004061 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73ab7fe640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac1078b0 0x7f73ac19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73a27fc640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac104f80 0x7f73ac198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73aaffd640 1 -- 172.21.15.82:0/3589004061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac104f80 msgr2=0x7f73ac198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73aaffd640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac104f80 0x7f73ac198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73aaffd640 1 -- 172.21.15.82:0/3589004061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac1078b0 msgr2=0x7f73ac19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73aaffd640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac1078b0 0x7f73ac19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73aaffd640 1 -- 172.21.15.82:0/3589004061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac19fb10 con 0x7f73ac102650 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.225+0000 7f73aaffd640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ac102650 0x7f73ac197f40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f739c009230 tx=0x7f739c02c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.226+0000 7f73a8ff9640 1 -- 172.21.15.82:0/3589004061 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c041070 con 0x7f73ac102650 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.226+0000 7f73a8ff9640 1 -- 172.21.15.82:0/3589004061 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f739c004450 con 0x7f73ac102650 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.226+0000 7f73b159a640 1 -- 172.21.15.82:0/3589004061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac19fda0 con 0x7f73ac102650 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.226+0000 7f73a8ff9640 1 -- 172.21.15.82:0/3589004061 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f739c003e20 con 0x7f73ac102650 2024-03-27T07:23:25.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.226+0000 7f73b159a640 1 -- 172.21.15.82:0/3589004061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac1a01d0 con 0x7f73ac102650 2024-03-27T07:23:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.227+0000 7f73b159a640 1 -- 172.21.15.82:0/3589004061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac0fdaf0 con 0x7f73ac102650 2024-03-27T07:23:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.228+0000 7f73a8ff9640 1 -- 172.21.15.82:0/3589004061 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f739c044070 con 0x7f73ac102650 2024-03-27T07:23:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.228+0000 7f73a8ff9640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f73980a3610 0x7f73980a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.228+0000 7f73a27fc640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f73980a3610 0x7f73980a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.228+0000 7f73a8ff9640 1 -- 172.21.15.82:0/3589004061 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f739c0f1840 con 0x7f73ac102650 2024-03-27T07:23:25.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.229+0000 7f73a27fc640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f73980a3610 0x7f73980a5ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73ac199400 tx=0x7f7394005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:25.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.233+0000 7f73a8ff9640 1 -- 172.21.15.82:0/3589004061 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f739c0bddf0 con 0x7f73ac102650 2024-03-27T07:23:25.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.408+0000 7f73b159a640 1 -- 172.21.15.82:0/3589004061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f73ac062820 con 0x7f73ac102650 2024-03-27T07:23:25.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.408+0000 7f73a8ff9640 1 -- 172.21.15.82:0/3589004061 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f739c0c20f0 con 0x7f73ac102650 2024-03-27T07:23:25.411 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-27T07:23:25.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 -- 172.21.15.82:0/3589004061 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f73980a3610 msgr2=0x7f73980a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f73980a3610 0x7f73980a5ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f73ac199400 tx=0x7f7394005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 -- 172.21.15.82:0/3589004061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ac102650 msgr2=0x7f73ac197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ac102650 0x7f73ac197f40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f739c009230 tx=0x7f739c02c650 comp rx=0 tx=0).stop 2024-03-27T07:23:25.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 -- 172.21.15.82:0/3589004061 shutdown_connections 2024-03-27T07:23:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f73980a3610 0x7f73980a5ad0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f73ac1078b0 0x7f73ac19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73ac104f80 0x7f73ac198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 --2- 172.21.15.82:0/3589004061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f73ac102650 0x7f73ac197f40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 -- 172.21.15.82:0/3589004061 >> 172.21.15.82:0/3589004061 conn(0x7f73ac0fc000 msgr2=0x7f73ac103420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 -- 172.21.15.82:0/3589004061 shutdown_connections 2024-03-27T07:23:25.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.410+0000 7f73b159a640 1 -- 172.21.15.82:0/3589004061 wait complete. 2024-03-27T07:23:25.423 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:23:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.523+0000 7f2feeceb640 1 -- 172.21.15.82:0/3554004506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe8102620 msgr2=0x7f2fe8108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.523+0000 7f2feeceb640 1 --2- 172.21.15.82:0/3554004506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe8102620 0x7f2fe8108eb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009900 tx=0x7f2fd802bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.523+0000 7f2feeceb640 1 -- 172.21.15.82:0/3554004506 shutdown_connections 2024-03-27T07:23:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.523+0000 7f2feeceb640 1 --2- 172.21.15.82:0/3554004506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe8102620 0x7f2fe8108eb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.523+0000 7f2feeceb640 1 --2- 172.21.15.82:0/3554004506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe8101c60 0x7f2fe81020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.523+0000 7f2feeceb640 1 --2- 172.21.15.82:0/3554004506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fe8100a70 0x7f2fe8100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.523+0000 7f2feeceb640 1 -- 172.21.15.82:0/3554004506 >> 172.21.15.82:0/3554004506 conn(0x7f2fe80fbfe0 msgr2=0x7f2fe80fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.523+0000 7f2feeceb640 1 -- 172.21.15.82:0/3554004506 shutdown_connections 2024-03-27T07:23:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.523+0000 7f2feeceb640 1 -- 172.21.15.82:0/3554004506 wait complete. 2024-03-27T07:23:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2feeceb640 1 Processor -- start 2024-03-27T07:23:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2feeceb640 1 -- start start 2024-03-27T07:23:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2feeceb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fe8100a70 0x7f2fe8069840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2feeceb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe8101c60 0x7f2fe819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2feeceb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe8102620 0x7f2fe819f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2feeceb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe810c6f0 con 0x7f2fe8101c60 2024-03-27T07:23:25.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2feeceb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe810c570 con 0x7f2fe8102620 2024-03-27T07:23:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2feeceb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe810c870 con 0x7f2fe8100a70 2024-03-27T07:23:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2fe7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe8101c60 0x7f2fe819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2fe7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe8101c60 0x7f2fe819cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33306/0 (socket says 172.21.15.82:33306) 2024-03-27T07:23:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2fe7fff640 1 -- 172.21.15.82:0/1131877128 learned_addr learned my addr 172.21.15.82:0/1131877128 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2feca87640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fe8100a70 0x7f2fe8069840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2fed288640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe8102620 0x7f2fe819f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2fe7fff640 1 -- 172.21.15.82:0/1131877128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fe8100a70 msgr2=0x7f2fe8069840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2fe7fff640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fe8100a70 0x7f2fe8069840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2fe7fff640 1 -- 172.21.15.82:0/1131877128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe8102620 msgr2=0x7f2fe819f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.524+0000 7f2fe7fff640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe8102620 0x7f2fe819f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.525+0000 7f2fe7fff640 1 -- 172.21.15.82:0/1131877128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe819fa90 con 0x7f2fe8101c60 2024-03-27T07:23:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.525+0000 7f2feca87640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fe8100a70 0x7f2fe8069840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.525+0000 7f2fe7fff640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe8101c60 0x7f2fe819cb90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000e9f0 tx=0x7f2fd000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:25.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.525+0000 7f2fe5ffb640 1 -- 172.21.15.82:0/1131877128 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000cd80 con 0x7f2fe8101c60 2024-03-27T07:23:25.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.525+0000 7f2feeceb640 1 -- 172.21.15.82:0/1131877128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe819fd80 con 0x7f2fe8101c60 2024-03-27T07:23:25.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.525+0000 7f2fe5ffb640 1 -- 172.21.15.82:0/1131877128 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fd0010910 con 0x7f2fe8101c60 2024-03-27T07:23:25.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.525+0000 7f2fe5ffb640 1 -- 172.21.15.82:0/1131877128 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00188f0 con 0x7f2fe8101c60 2024-03-27T07:23:25.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.525+0000 7f2feeceb640 1 -- 172.21.15.82:0/1131877128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe81a0250 con 0x7f2fe8101c60 2024-03-27T07:23:25.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.526+0000 7f2feeceb640 1 -- 172.21.15.82:0/1131877128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe8107d90 con 0x7f2fe8101c60 2024-03-27T07:23:25.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.527+0000 7f2fe5ffb640 1 -- 172.21.15.82:0/1131877128 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f2fd0010ac0 con 0x7f2fe8101c60 2024-03-27T07:23:25.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.528+0000 7f2fe5ffb640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fd40a3610 0x7f2fd40a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.528+0000 7f2feca87640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fd40a3610 0x7f2fd40a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.528+0000 7f2fe5ffb640 1 -- 172.21.15.82:0/1131877128 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f2fd00d00a0 con 0x7f2fe8101c60 2024-03-27T07:23:25.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.528+0000 7f2feca87640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fd40a3610 0x7f2fd40a5ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8101ac0 tx=0x7f2fe0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:25.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.532+0000 7f2fe5ffb640 1 -- 172.21.15.82:0/1131877128 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2fd009c650 con 0x7f2fe8101c60 2024-03-27T07:23:25.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.749+0000 7f2feeceb640 1 -- 172.21.15.82:0/1131877128 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fe802d370 con 0x7f2fe8101c60 2024-03-27T07:23:25.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.749+0000 7f2fe5ffb640 1 -- 172.21.15.82:0/1131877128 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f2fd00a0950 con 0x7f2fe8101c60 2024-03-27T07:23:25.753 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:25.754 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:21:39.590410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24470,24484]},"id":1}]} 2024-03-27T07:23:25.754 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 21 2024-03-27T07:23:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 -- 172.21.15.82:0/1131877128 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fd40a3610 msgr2=0x7f2fd40a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fd40a3610 0x7f2fd40a5ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8101ac0 tx=0x7f2fe0009500 comp rx=0 tx=0).stop 2024-03-27T07:23:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 -- 172.21.15.82:0/1131877128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe8101c60 msgr2=0x7f2fe819cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe8101c60 0x7f2fe819cb90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000e9f0 tx=0x7f2fd000eeb0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 -- 172.21.15.82:0/1131877128 shutdown_connections 2024-03-27T07:23:25.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f2fd40a3610 0x7f2fd40a5ad0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2fe8101c60 0x7f2fe819cb90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2fe8102620 0x7f2fe819f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 --2- 172.21.15.82:0/1131877128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2fe8100a70 0x7f2fe8069840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 -- 172.21.15.82:0/1131877128 >> 172.21.15.82:0/1131877128 conn(0x7f2fe80fbfe0 msgr2=0x7f2fe8104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 -- 172.21.15.82:0/1131877128 shutdown_connections 2024-03-27T07:23:25.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.752+0000 7f2feeceb640 1 -- 172.21.15.82:0/1131877128 wait complete. 2024-03-27T07:23:25.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:23:25.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 -- 172.21.15.82:0/2836108786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf30107850 msgr2=0x7faf30109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 --2- 172.21.15.82:0/2836108786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf30107850 0x7faf30109ca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faf28009ca0 tx=0x7faf2802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 -- 172.21.15.82:0/2836108786 shutdown_connections 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 --2- 172.21.15.82:0/2836108786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf30107850 0x7faf30109ca0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 --2- 172.21.15.82:0/2836108786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf30104f20 0x7faf30107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 --2- 172.21.15.82:0/2836108786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf301025f0 0x7faf301049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 -- 172.21.15.82:0/2836108786 >> 172.21.15.82:0/2836108786 conn(0x7faf300fbfe0 msgr2=0x7faf300fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 -- 172.21.15.82:0/2836108786 shutdown_connections 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 -- 172.21.15.82:0/2836108786 wait complete. 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 Processor -- start 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.867+0000 7faf35ba7640 1 -- start start 2024-03-27T07:23:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf35ba7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf301025f0 0x7faf30197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf35ba7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf30104f20 0x7faf30198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf35ba7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf30107850 0x7faf3019f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf35ba7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf3010d810 con 0x7faf30104f20 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf35ba7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf3010d690 con 0x7faf30107850 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf35ba7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf3010d990 con 0x7faf301025f0 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf26ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf30104f20 0x7faf30198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf26ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf30104f20 0x7faf30198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33328/0 (socket says 172.21.15.82:33328) 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf26ffd640 1 -- 172.21.15.82:0/1008547060 learned_addr learned my addr 172.21.15.82:0/1008547060 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf2f7fe640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf301025f0 0x7faf30197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf2ffff640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf30107850 0x7faf3019f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf26ffd640 1 -- 172.21.15.82:0/1008547060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf301025f0 msgr2=0x7faf30197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf26ffd640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf301025f0 0x7faf30197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf26ffd640 1 -- 172.21.15.82:0/1008547060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf30107850 msgr2=0x7faf3019f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf26ffd640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf30107850 0x7faf3019f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf26ffd640 1 -- 172.21.15.82:0/1008547060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3019fa50 con 0x7faf30104f20 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf26ffd640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf30104f20 0x7faf30198370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faf1800e9f0 tx=0x7faf1800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf2d7fa640 1 -- 172.21.15.82:0/1008547060 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1800ccc0 con 0x7faf30104f20 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf2d7fa640 1 -- 172.21.15.82:0/1008547060 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf18005500 con 0x7faf30104f20 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf35ba7640 1 -- 172.21.15.82:0/1008547060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3019fd40 con 0x7faf30104f20 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf2d7fa640 1 -- 172.21.15.82:0/1008547060 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf18010690 con 0x7faf30104f20 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.868+0000 7faf35ba7640 1 -- 172.21.15.82:0/1008547060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf301a01e0 con 0x7faf30104f20 2024-03-27T07:23:25.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.869+0000 7faf35ba7640 1 -- 172.21.15.82:0/1008547060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf300fdad0 con 0x7faf30104f20 2024-03-27T07:23:25.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.870+0000 7faf2d7fa640 1 -- 172.21.15.82:0/1008547060 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7faf180046c0 con 0x7faf30104f20 2024-03-27T07:23:25.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.871+0000 7faf2d7fa640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7faf1c0a3610 0x7faf1c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:25.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.871+0000 7faf2d7fa640 1 -- 172.21.15.82:0/1008547060 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7faf180d01f0 con 0x7faf30104f20 2024-03-27T07:23:25.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.871+0000 7faf2f7fe640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7faf1c0a3610 0x7faf1c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:25.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.871+0000 7faf2f7fe640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7faf1c0a3610 0x7faf1c0a5ad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faf20009bd0 tx=0x7faf20005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:25.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:25.875+0000 7faf2d7fa640 1 -- 172.21.15.82:0/1008547060 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7faf18053cb0 con 0x7faf30104f20 2024-03-27T07:23:25.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:25 smithi082 ceph-mon[32178]: pgmap v347: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:23:25.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:25 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1377132778' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:25.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:25 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4009261321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:25.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:25 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3589004061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:26.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:25 smithi149 ceph-mon[36065]: pgmap v347: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:23:26.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:25 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1377132778' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:26.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:25 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4009261321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:26.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:25 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3589004061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:26.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:25 smithi153 ceph-mon[36179]: pgmap v347: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T07:23:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:25 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1377132778' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:25 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4009261321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:26.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:25 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3589004061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:26.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.052+0000 7faf35ba7640 1 -- 172.21.15.82:0/1008547060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf3002d5c0 con 0x7faf30104f20 2024-03-27T07:23:26.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.054+0000 7faf2d7fa640 1 -- 172.21.15.82:0/1008547060 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22502 (secure 0 0 0) 0x7faf1809cdf0 con 0x7faf30104f20 2024-03-27T07:23:26.056 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:26.056 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:22:27.661407+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:23:26.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 -- 172.21.15.82:0/1008547060 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7faf1c0a3610 msgr2=0x7faf1c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7faf1c0a3610 0x7faf1c0a5ad0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7faf20009bd0 tx=0x7faf20005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:26.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 -- 172.21.15.82:0/1008547060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf30104f20 msgr2=0x7faf30198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf30104f20 0x7faf30198370 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faf1800e9f0 tx=0x7faf1800eeb0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 -- 172.21.15.82:0/1008547060 shutdown_connections 2024-03-27T07:23:26.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7faf1c0a3610 0x7faf1c0a5ad0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faf30104f20 0x7faf30198370 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faf30107850 0x7faf3019f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 --2- 172.21.15.82:0/1008547060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf301025f0 0x7faf30197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 -- 172.21.15.82:0/1008547060 >> 172.21.15.82:0/1008547060 conn(0x7faf300fbfe0 msgr2=0x7faf30102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 -- 172.21.15.82:0/1008547060 shutdown_connections 2024-03-27T07:23:26.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.056+0000 7faf35ba7640 1 -- 172.21.15.82:0/1008547060 wait complete. 2024-03-27T07:23:26.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-27T07:21:34.901653+0000', 'modified': '2024-03-27T07:21:39.590410+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24497, 'mds_1': 24484, 'mds_2': 24470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24446': {'gid': 24446, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.149:6835/227197026', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6834', 'nonce': 227197026}, {'type': 'v1', 'addr': '172.21.15.149:6835', 'nonce': 227197026}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6835/1080332547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 1080332547}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 1080332547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.153:6837/1290254754', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6836', 'nonce': 1290254754}, {'type': 'v1', 'addr': '172.21.15.153:6837', 'nonce': 1290254754}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'h', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.149:6837/4121570293', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6836', 'nonce': 4121570293}, {'type': 'v1', 'addr': '172.21.15.149:6837', 'nonce': 4121570293}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24484': {'gid': 24484, 'name': 'i', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.153:6839/1505538081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6838', 'nonce': 1505538081}, {'type': 'v1', 'addr': '172.21.15.153:6839', 'nonce': 1505538081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.149:6839/3930771704', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.149:6838', 'nonce': 3930771704}, {'type': 'v1', 'addr': '172.21.15.149:6839', 'nonce': 3930771704}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497, 24470, 24484]} 2024-03-27T07:23:26.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-03-27T07:23:26.070 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-27T07:23:26.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.171+0000 7f422f97a640 1 -- 172.21.15.82:0/914565529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4228102630 msgr2=0x7f4228104a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.171+0000 7f422f97a640 1 --2- 172.21.15.82:0/914565529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4228102630 0x7f4228104a20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4224009900 tx=0x7f422402bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:26.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.171+0000 7f422f97a640 1 -- 172.21.15.82:0/914565529 shutdown_connections 2024-03-27T07:23:26.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.171+0000 7f422f97a640 1 --2- 172.21.15.82:0/914565529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4228107890 0x7f4228109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.171+0000 7f422f97a640 1 --2- 172.21.15.82:0/914565529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4228104f60 0x7f4228107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.171+0000 7f422f97a640 1 --2- 172.21.15.82:0/914565529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4228102630 0x7f4228104a20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.171+0000 7f422f97a640 1 -- 172.21.15.82:0/914565529 >> 172.21.15.82:0/914565529 conn(0x7f42280fbfe0 msgr2=0x7f42280fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.171+0000 7f422f97a640 1 -- 172.21.15.82:0/914565529 shutdown_connections 2024-03-27T07:23:26.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.171+0000 7f422f97a640 1 -- 172.21.15.82:0/914565529 wait complete. 2024-03-27T07:23:26.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422f97a640 1 Processor -- start 2024-03-27T07:23:26.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422f97a640 1 -- start start 2024-03-27T07:23:26.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422f97a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4228102630 0x7f4228197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422f97a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4228104f60 0x7f4228198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422f97a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4228107890 0x7f422819f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422f97a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f422810d7f0 con 0x7f4228104f60 2024-03-27T07:23:26.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422f97a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f422810d670 con 0x7f4228102630 2024-03-27T07:23:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422f97a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f422810d970 con 0x7f4228107890 2024-03-27T07:23:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422cf15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4228104f60 0x7f4228198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422cf15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4228104f60 0x7f4228198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33348/0 (socket says 172.21.15.82:33348) 2024-03-27T07:23:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422cf15640 1 -- 172.21.15.82:0/828170245 learned_addr learned my addr 172.21.15.82:0/828170245 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422d716640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4228102630 0x7f4228197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422df17640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4228107890 0x7f422819f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422cf15640 1 -- 172.21.15.82:0/828170245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4228107890 msgr2=0x7f422819f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422cf15640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4228107890 0x7f422819f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422cf15640 1 -- 172.21.15.82:0/828170245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4228102630 msgr2=0x7f4228197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422cf15640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4228102630 0x7f4228197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422cf15640 1 -- 172.21.15.82:0/828170245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422819fb10 con 0x7f4228104f60 2024-03-27T07:23:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.172+0000 7f422df17640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4228107890 0x7f422819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:23:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.173+0000 7f422cf15640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4228104f60 0x7f4228198430 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f421800e9f0 tx=0x7f421800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.173+0000 7f421e7fc640 1 -- 172.21.15.82:0/828170245 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421800ccc0 con 0x7f4228104f60 2024-03-27T07:23:26.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.173+0000 7f421e7fc640 1 -- 172.21.15.82:0/828170245 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4218005500 con 0x7f4228104f60 2024-03-27T07:23:26.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.173+0000 7f421e7fc640 1 -- 172.21.15.82:0/828170245 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4218010690 con 0x7f4228104f60 2024-03-27T07:23:26.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.173+0000 7f422f97a640 1 -- 172.21.15.82:0/828170245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f422819fe00 con 0x7f4228104f60 2024-03-27T07:23:26.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.173+0000 7f422f97a640 1 -- 172.21.15.82:0/828170245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42281a0270 con 0x7f4228104f60 2024-03-27T07:23:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.175+0000 7f421e7fc640 1 -- 172.21.15.82:0/828170245 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f42180046c0 con 0x7f4228104f60 2024-03-27T07:23:26.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f42321fd740 1 Processor -- start 2024-03-27T07:23:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f42321fd740 1 -- start start 2024-03-27T07:23:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f421e7fc640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f42140a3610 0x7f42140a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f42321fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e1747513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f42321fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e1747564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f42321fd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e174758fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f42321fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e1746b6010 con 0x55e1747519c0 2024-03-27T07:23:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f42321fd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e17465e770 con 0x55e174756b30 2024-03-27T07:23:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f42321fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e1746b1fc0 con 0x55e174750fd0 2024-03-27T07:23:26.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f422cf15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e1747564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f422df17640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f42140a3610 0x7f42140a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f422d716640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e1747513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f422d716640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e1747513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:50580/0 (socket says 172.21.15.82:50580) 2024-03-27T07:23:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f422d716640 1 -- 172.21.15.82:0/1270799622 learned_addr learned my addr 172.21.15.82:0/1270799622 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f421e7fc640 1 -- 172.21.15.82:0/828170245 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f42180d0120 con 0x7f4228104f60 2024-03-27T07:23:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f422df17640 1 --2- 172.21.15.82:0/1270799622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e174758fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.176+0000 7f422d716640 1 -- 172.21.15.82:0/1270799622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 msgr2=0x55e174758fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.177+0000 7f422d716640 1 --2- 172.21.15.82:0/1270799622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e174758fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.177+0000 7f422d716640 1 -- 172.21.15.82:0/1270799622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 msgr2=0x55e1747564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.177+0000 7f422d716640 1 --2- 172.21.15.82:0/1270799622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e1747564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.177+0000 7f422d716640 1 -- 172.21.15.82:0/1270799622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e17467d330 con 0x55e174750fd0 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.177+0000 7f422cf15640 1 --2- 172.21.15.82:0/1270799622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e1747564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.177+0000 7f422df17640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f42140a3610 0x7f42140a5ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4220005fd0 tx=0x7f4220009eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.177+0000 7f422d716640 1 --2- 172.21.15.82:0/1270799622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e1747513f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4224009900 tx=0x7f4224009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a506cd5c2f15481 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.177+0000 7f42137fe640 1 -- 172.21.15.82:0/1270799622 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224005d50 con 0x55e174750fd0 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.177+0000 7f42137fe640 1 -- 172.21.15.82:0/1270799622 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f422402cb80 con 0x55e174750fd0 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.177+0000 7f42137fe640 1 -- 172.21.15.82:0/1270799622 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42240046c0 con 0x55e174750fd0 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 -- 172.21.15.82:0/1270799622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 msgr2=0x55e1747513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 --2- 172.21.15.82:0/1270799622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e1747513f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4224009900 tx=0x7f4224009560 comp rx=0 tx=0).stop 2024-03-27T07:23:26.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 -- 172.21.15.82:0/1270799622 shutdown_connections 2024-03-27T07:23:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 --2- 172.21.15.82:0/1270799622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e1747564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 --2- 172.21.15.82:0/1270799622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e174758fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 --2- 172.21.15.82:0/1270799622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e1747513f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 -- 172.21.15.82:0/1270799622 >> 172.21.15.82:0/1270799622 conn(0x55e174718b20 msgr2=0x55e17474c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 -- 172.21.15.82:0/1270799622 shutdown_connections 2024-03-27T07:23:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 -- 172.21.15.82:0/1270799622 wait complete. 2024-03-27T07:23:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 -- start start 2024-03-27T07:23:26.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.178+0000 7f42321fd740 1 Processor -- start 2024-03-27T07:23:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f42321fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e17475b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f42321fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e17475b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f42321fd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e1747629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f42321fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e174759a80 con 0x55e1747519c0 2024-03-27T07:23:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f42321fd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e174671b30 con 0x55e174756b30 2024-03-27T07:23:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f42321fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e174759c00 con 0x55e174750fd0 2024-03-27T07:23:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f42321fd740 10 client.0 _ll_register_callbacks cb 0x55e1746ad1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422cf15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e17475b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422d716640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e17475b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422cf15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e17475b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33366/0 (socket says 172.21.15.82:33366) 2024-03-27T07:23:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422cf15640 1 -- 172.21.15.82:0/677371729 learned_addr learned my addr 172.21.15.82:0/677371729 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422df17640 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e1747629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422cf15640 1 -- 172.21.15.82:0/677371729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 msgr2=0x55e17475b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422cf15640 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e17475b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422cf15640 1 -- 172.21.15.82:0/677371729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 msgr2=0x55e1747629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422cf15640 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e1747629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422cf15640 1 -- 172.21.15.82:0/677371729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1743ca2d0 con 0x55e1747519c0 2024-03-27T07:23:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f422cf15640 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e17475b9a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f42180cdbf0 tx=0x7f4218007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f012a71170e607f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f4210ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f4210ff9640 1 -- 172.21.15.82:0/677371729 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421809bf20 con 0x55e1747519c0 2024-03-27T07:23:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f4210ff9640 1 -- 172.21.15.82:0/677371729 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f4218066e70 con 0x55e1747519c0 2024-03-27T07:23:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.179+0000 7f42321fd740 1 -- 172.21.15.82:0/677371729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f422402cb80 con 0x55e1747519c0 2024-03-27T07:23:26.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f4210ff9640 1 -- 172.21.15.82:0/677371729 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f42180b2240 con 0x55e1747519c0 2024-03-27T07:23:26.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f42321fd740 10 client.15210 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:26.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f42321fd740 1 -- 172.21.15.82:0/677371729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e1744946b0 con 0x55e1747519c0 2024-03-27T07:23:26.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f4210ff9640 1 -- 172.21.15.82:0/677371729 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f422402cb80 con 0x55e1747519c0 2024-03-27T07:23:26.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f4210ff9640 1 -- 172.21.15.82:0/677371729 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f42180a4da0 con 0x55e1747519c0 2024-03-27T07:23:26.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f42321fd740 10 client.15210 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:26.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f42321fd740 10 client.15210 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-27T07:23:26.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f42321fd740 20 client.15210 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:26.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f42321fd740 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e174767f10 0x55e174769380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f42321fd740 4 client.15210 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:23:26.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f42321fd740 1 -- 172.21.15.82:0/677371729 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1746c3550 con 0x55e174767f10 2024-03-27T07:23:26.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.180+0000 7f422d716640 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e174767f10 0x55e174769380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.181+0000 7f422d716640 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e174767f10 0x55e174769380 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7366939e593285ef server_cookie=336f79aae97c647d in_seq=0 out_seq=0 2024-03-27T07:23:26.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.181+0000 7f4210ff9640 10 client.15210 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:23:26.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f4210ff9640 1 -- 172.21.15.82:0/677371729 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e1746c3550 con 0x55e174767f10 2024-03-27T07:23:26.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f4210ff9640 10 client.15210 handle_command_reply: tid=0 2024-03-27T07:23:26.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 client.15210 shutdown 2024-03-27T07:23:26.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 -- 172.21.15.82:0/677371729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 msgr2=0x55e17475b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e17475b9a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f42180cdbf0 tx=0x7f4218007810 comp rx=0 tx=0).stop 2024-03-27T07:23:26.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 -- 172.21.15.82:0/677371729 shutdown_connections 2024-03-27T07:23:26.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e174767f10 0x55e174769380 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e1747519c0 0x55e17475b9a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e1747629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 --2- 172.21.15.82:0/677371729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e17475b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 -- 172.21.15.82:0/677371729 >> 172.21.15.82:0/677371729 conn(0x55e174718b20 msgr2=0x55e17474bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f4210ff9640 0 client.15210 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:23:26.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 -- 172.21.15.82:0/677371729 shutdown_connections 2024-03-27T07:23:26.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 1 -- 172.21.15.82:0/677371729 wait complete. 2024-03-27T07:23:26.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.182+0000 7f42321fd740 20 client.15210 trim_cache size 0 max 16384 2024-03-27T07:23:26.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f42321fd740 1 Processor -- start 2024-03-27T07:23:26.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f42321fd740 1 -- start start 2024-03-27T07:23:26.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f42321fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e174752ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f42321fd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e1747519c0 0x55e174753400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f42321fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174756b30 0x55e1747629a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f42321fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e1747676c0 con 0x55e174756b30 2024-03-27T07:23:26.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f42321fd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e174767d90 con 0x55e1747519c0 2024-03-27T07:23:26.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f42321fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e174768460 con 0x55e174750fd0 2024-03-27T07:23:26.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422df17640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174756b30 0x55e1747629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422d716640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e174752ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422df17640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174756b30 0x55e1747629a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33368/0 (socket says 172.21.15.82:33368) 2024-03-27T07:23:26.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422df17640 1 -- 172.21.15.82:0/527712493 learned_addr learned my addr 172.21.15.82:0/527712493 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422cf15640 1 --2- 172.21.15.82:0/527712493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e1747519c0 0x55e174753400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422df17640 1 -- 172.21.15.82:0/527712493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 msgr2=0x55e174752ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422df17640 1 --2- 172.21.15.82:0/527712493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e174752ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422df17640 1 -- 172.21.15.82:0/527712493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e1747519c0 msgr2=0x55e174753400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422df17640 1 --2- 172.21.15.82:0/527712493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e1747519c0 0x55e174753400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422df17640 1 -- 172.21.15.82:0/527712493 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e17475a540 con 0x55e174756b30 2024-03-27T07:23:26.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.200+0000 7f422df17640 1 --2- 172.21.15.82:0/527712493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174756b30 0x55e1747629a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4220010fd0 tx=0x7f4220009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccc10adffb02a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f4212ffd640 1 -- 172.21.15.82:0/527712493 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220012510 con 0x55e174756b30 2024-03-27T07:23:26.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f4212ffd640 1 -- 172.21.15.82:0/527712493 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f422002f070 con 0x55e174756b30 2024-03-27T07:23:26.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f4212ffd640 1 -- 172.21.15.82:0/527712493 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422002a660 con 0x55e174756b30 2024-03-27T07:23:26.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f42321fd740 1 -- 172.21.15.82:0/527712493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174756b30 msgr2=0x55e1747629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f42321fd740 1 --2- 172.21.15.82:0/527712493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174756b30 0x55e1747629a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4220010fd0 tx=0x7f4220009500 comp rx=0 tx=0).stop 2024-03-27T07:23:26.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f42321fd740 1 -- 172.21.15.82:0/527712493 shutdown_connections 2024-03-27T07:23:26.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f42321fd740 1 --2- 172.21.15.82:0/527712493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174756b30 0x55e1747629a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f42321fd740 1 --2- 172.21.15.82:0/527712493 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e1747519c0 0x55e174753400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f42321fd740 1 --2- 172.21.15.82:0/527712493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e174750fd0 0x55e174752ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f42321fd740 1 -- 172.21.15.82:0/527712493 >> 172.21.15.82:0/527712493 conn(0x55e174718b20 msgr2=0x55e17474c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f42321fd740 1 -- 172.21.15.82:0/527712493 shutdown_connections 2024-03-27T07:23:26.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f42321fd740 1 -- 172.21.15.82:0/527712493 wait complete. 2024-03-27T07:23:26.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.201+0000 7f42321fd740 1 -- start start 2024-03-27T07:23:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f42321fd740 1 Processor -- start 2024-03-27T07:23:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f42321fd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174750fd0 0x55e17475ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f42321fd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e1747519c0 0x55e17475f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f42321fd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e174761de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f42321fd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e174769200 con 0x55e174750fd0 2024-03-27T07:23:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f42321fd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e174768b30 con 0x55e174756b30 2024-03-27T07:23:26.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f42321fd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e1747698d0 con 0x55e1747519c0 2024-03-27T07:23:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f42321fd740 10 client.0 _ll_register_callbacks cb 0x7f421800e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422d716640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174750fd0 0x55e17475ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422d716640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174750fd0 0x55e17475ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33370/0 (socket says 172.21.15.82:33370) 2024-03-27T07:23:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422d716640 1 -- 172.21.15.82:0/3219424422 learned_addr learned my addr 172.21.15.82:0/3219424422 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422df17640 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e174761de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422cf15640 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e1747519c0 0x55e17475f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422d716640 1 -- 172.21.15.82:0/3219424422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e1747519c0 msgr2=0x55e17475f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422d716640 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e1747519c0 0x55e17475f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422d716640 1 -- 172.21.15.82:0/3219424422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 msgr2=0x55e174761de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422d716640 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e174761de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422d716640 1 -- 172.21.15.82:0/3219424422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e174762420 con 0x55e174750fd0 2024-03-27T07:23:26.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f422d716640 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174750fd0 0x55e17475ebd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4224006010 tx=0x7f422402cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2a5ca98faadd4c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.202+0000 7f4210ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:26.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f4210ff9640 1 -- 172.21.15.82:0/3219424422 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224004450 con 0x55e174750fd0 2024-03-27T07:23:26.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f4210ff9640 1 -- 172.21.15.82:0/3219424422 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f4224005040 con 0x55e174750fd0 2024-03-27T07:23:26.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f42321fd740 1 -- 172.21.15.82:0/3219424422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f422002f070 con 0x55e174750fd0 2024-03-27T07:23:26.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f4210ff9640 1 -- 172.21.15.82:0/3219424422 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4224005260 con 0x55e174750fd0 2024-03-27T07:23:26.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f42321fd740 10 client.15216 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:26.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f42321fd740 1 -- 172.21.15.82:0/3219424422 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55e1747ce390 con 0x55e174750fd0 2024-03-27T07:23:26.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f4210ff9640 1 -- 172.21.15.82:0/3219424422 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f422002f070 con 0x55e174750fd0 2024-03-27T07:23:26.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f4210ff9640 1 -- 172.21.15.82:0/3219424422 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f42240046c0 con 0x55e174750fd0 2024-03-27T07:23:26.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f42321fd740 10 client.15216 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:26.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f42321fd740 10 client.15216 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-27T07:23:26.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f42321fd740 20 client.15216 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:26.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f42321fd740 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e1747d2b50 0x55e1747d1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f42321fd740 4 client.15216 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T07:23:26.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f42321fd740 1 -- 172.21.15.82:0/3219424422 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "status"}) -- 0x55e1746bd8a0 con 0x55e1747d2b50 2024-03-27T07:23:26.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.203+0000 7f422cf15640 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e1747d2b50 0x55e1747d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f4210ff9640 10 client.15216 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:23:26.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f422cf15640 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e1747d2b50 0x55e1747d1860 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bd546301e91173f9 server_cookie=e00f1cdb00262045 in_seq=0 out_seq=0 2024-03-27T07:23:26.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f4210ff9640 1 -- 172.21.15.82:0/3219424422 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e1746bd8a0 con 0x55e1747d2b50 2024-03-27T07:23:26.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f4210ff9640 10 client.15216 handle_command_reply: tid=0 2024-03-27T07:23:26.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 client.15216 shutdown 2024-03-27T07:23:26.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 -- 172.21.15.82:0/3219424422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174750fd0 msgr2=0x55e17475ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174750fd0 0x55e17475ebd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4224006010 tx=0x7f422402cbb0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 -- 172.21.15.82:0/3219424422 shutdown_connections 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e1747d2b50 0x55e1747d1860 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e174756b30 0x55e174761de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e1747519c0 0x55e17475f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 --2- 172.21.15.82:0/3219424422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e174750fd0 0x55e17475ebd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f4210ff9640 0 client.15216 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 -- 172.21.15.82:0/3219424422 >> 172.21.15.82:0/3219424422 conn(0x55e174718b20 msgr2=0x55e17475b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 -- 172.21.15.82:0/3219424422 shutdown_connections 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 1 -- 172.21.15.82:0/3219424422 wait complete. 2024-03-27T07:23:26.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.204+0000 7f42321fd740 20 client.15216 trim_cache size 0 max 16384 2024-03-27T07:23:26.222 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:23:26.222 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "604548c2-ec09-11ee-95d0-87774f69a715", 2024-03-27T07:23:26.222 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-03-27T07:23:26.222 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24470, 2024-03-27T07:23:26.222 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-27T07:23:26.222 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-27T07:23:26.222 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-27T07:23:26.222 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 107.618650415, 2024-03-27T07:23:26.223 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 21, 2024-03-27T07:23:26.223 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2024-03-27T07:23:26.223 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2024-03-27T07:23:26.223 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 129.04448826199999 2024-03-27T07:23:26.223 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:23:26.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 -- 172.21.15.82:0/828170245 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f42140a3610 msgr2=0x7f42140a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f42140a3610 0x7f42140a5ad0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4220005fd0 tx=0x7f4220009eb0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 -- 172.21.15.82:0/828170245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4228104f60 msgr2=0x7f4228198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4228104f60 0x7f4228198430 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f421800e9f0 tx=0x7f421800eeb0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 -- 172.21.15.82:0/828170245 shutdown_connections 2024-03-27T07:23:26.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f42140a3610 0x7f42140a5ad0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4228104f60 0x7f4228198430 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4228107890 0x7f422819f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 --2- 172.21.15.82:0/828170245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4228102630 0x7f4228197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 -- 172.21.15.82:0/828170245 >> 172.21.15.82:0/828170245 conn(0x7f42280fbfe0 msgr2=0x7f42281030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 -- 172.21.15.82:0/828170245 shutdown_connections 2024-03-27T07:23:26.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.205+0000 7f422f97a640 1 -- 172.21.15.82:0/828170245 wait complete. 2024-03-27T07:23:26.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-03-27T07:23:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.327+0000 7f785c4c0640 1 -- 172.21.15.82:0/2328042485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7854103710 msgr2=0x7f7854109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.327+0000 7f785c4c0640 1 --2- 172.21.15.82:0/2328042485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7854103710 0x7f7854109fa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f784c009be0 tx=0x7f784c02bef0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.327+0000 7f785c4c0640 1 -- 172.21.15.82:0/2328042485 shutdown_connections 2024-03-27T07:23:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.327+0000 7f785c4c0640 1 --2- 172.21.15.82:0/2328042485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854102d50 0x7f78541031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.327+0000 7f785c4c0640 1 --2- 172.21.15.82:0/2328042485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7854103710 0x7f7854109fa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.327+0000 7f785c4c0640 1 --2- 172.21.15.82:0/2328042485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7854101b60 0x7f7854101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.327+0000 7f785c4c0640 1 -- 172.21.15.82:0/2328042485 >> 172.21.15.82:0/2328042485 conn(0x7f78540fd0f0 msgr2=0x7f78540ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.327+0000 7f785c4c0640 1 -- 172.21.15.82:0/2328042485 shutdown_connections 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.327+0000 7f785c4c0640 1 -- 172.21.15.82:0/2328042485 wait complete. 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.327+0000 7f785c4c0640 1 Processor -- start 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f785c4c0640 1 -- start start 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f785c4c0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7854101b60 0x7f7854197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f785c4c0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854102d50 0x7f7854198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f785c4c0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7854103710 0x7f785419f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f785c4c0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f785410d7c0 con 0x7f7854102d50 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f785c4c0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f785410d640 con 0x7f7854103710 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f785c4c0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f785410d940 con 0x7f7854101b60 2024-03-27T07:23:26.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f7859a5b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854102d50 0x7f7854198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f7859a5b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854102d50 0x7f7854198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33400/0 (socket says 172.21.15.82:33400) 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f7859a5b640 1 -- 172.21.15.82:0/2112992973 learned_addr learned my addr 172.21.15.82:0/2112992973 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f785a25c640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7854101b60 0x7f7854197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f785aa5d640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7854103710 0x7f785419f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f7859a5b640 1 -- 172.21.15.82:0/2112992973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7854101b60 msgr2=0x7f7854197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f7859a5b640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7854101b60 0x7f7854197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f7859a5b640 1 -- 172.21.15.82:0/2112992973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7854103710 msgr2=0x7f785419f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f7859a5b640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7854103710 0x7f785419f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f7859a5b640 1 -- 172.21.15.82:0/2112992973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785419fa20 con 0x7f7854102d50 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f7859a5b640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854102d50 0x7f7854198340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f785000e9c0 tx=0x7f785000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f784b7fe640 1 -- 172.21.15.82:0/2112992973 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785000ccc0 con 0x7f7854102d50 2024-03-27T07:23:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f784b7fe640 1 -- 172.21.15.82:0/2112992973 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7850005500 con 0x7f7854102d50 2024-03-27T07:23:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f785c4c0640 1 -- 172.21.15.82:0/2112992973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785419fd10 con 0x7f7854102d50 2024-03-27T07:23:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.328+0000 7f784b7fe640 1 -- 172.21.15.82:0/2112992973 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7850010430 con 0x7f7854102d50 2024-03-27T07:23:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.329+0000 7f785c4c0640 1 -- 172.21.15.82:0/2112992973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78541a0200 con 0x7f7854102d50 2024-03-27T07:23:26.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.330+0000 7f784b7fe640 1 -- 172.21.15.82:0/2112992973 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f78500046c0 con 0x7f7854102d50 2024-03-27T07:23:26.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f785f187740 1 Processor -- start 2024-03-27T07:23:26.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f785f187740 1 -- start start 2024-03-27T07:23:26.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f785f187740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e063f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f785f187740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e0b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f785f187740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e0dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f785f187740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555fc9d6b010 con 0x555fc9e0bb30 2024-03-27T07:23:26.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f785f187740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555fc9d13770 con 0x555fc9e069c0 2024-03-27T07:23:26.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f785f187740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555fc9d66fc0 con 0x555fc9e05fd0 2024-03-27T07:23:26.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f784b7fe640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78400a3610 0x7f78400a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f7859a5b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e0dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f7859a5b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e0dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33402/0 (socket says 172.21.15.82:33402) 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.331+0000 7f785a25c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e0b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f7859a5b640 1 -- 172.21.15.82:0/1488841113 learned_addr learned my addr 172.21.15.82:0/1488841113 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f785aa5d640 1 --2- 172.21.15.82:0/1488841113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f785aa5d640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78400a3610 0x7f78400a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f784b7fe640 1 -- 172.21.15.82:0/2112992973 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f78500cffc0 con 0x7f7854102d50 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f785a25c640 1 -- 172.21.15.82:0/1488841113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 msgr2=0x555fc9e063f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f785a25c640 1 --2- 172.21.15.82:0/1488841113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e063f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f785a25c640 1 -- 172.21.15.82:0/1488841113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 msgr2=0x555fc9e0dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f785a25c640 1 --2- 172.21.15.82:0/1488841113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e0dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f785a25c640 1 -- 172.21.15.82:0/1488841113 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fc9d32330 con 0x555fc9e069c0 2024-03-27T07:23:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f7859a5b640 1 --2- 172.21.15.82:0/1488841113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e0dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f785aa5d640 1 --2- 172.21.15.82:0/1488841113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f785aa5d640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78400a3610 0x7f78400a5ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f784c004ab0 tx=0x7f784c004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f785a25c640 1 --2- 172.21.15.82:0/1488841113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e0b4c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7844009bf0 tx=0x7f7844011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed65c9ffb5cf71f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f7848bfe640 1 -- 172.21.15.82:0/1488841113 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844009da0 con 0x555fc9e069c0 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f7848bfe640 1 -- 172.21.15.82:0/1488841113 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7844005020 con 0x555fc9e069c0 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.332+0000 7f7848bfe640 1 -- 172.21.15.82:0/1488841113 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844004b60 con 0x555fc9e069c0 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 -- 172.21.15.82:0/1488841113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 msgr2=0x555fc9e0b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 --2- 172.21.15.82:0/1488841113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e0b4c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7844009bf0 tx=0x7f7844011810 comp rx=0 tx=0).stop 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 -- 172.21.15.82:0/1488841113 shutdown_connections 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 --2- 172.21.15.82:0/1488841113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e0dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 --2- 172.21.15.82:0/1488841113 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e0b4c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 --2- 172.21.15.82:0/1488841113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 -- 172.21.15.82:0/1488841113 >> 172.21.15.82:0/1488841113 conn(0x555fc9dcdb20 msgr2=0x555fc9e01940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 -- 172.21.15.82:0/1488841113 shutdown_connections 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 -- 172.21.15.82:0/1488841113 wait complete. 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 -- start start 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.333+0000 7f785f187740 1 Processor -- start 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785f187740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e104e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785f187740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e10a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785f187740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e17a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785f187740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555fc9e0eae0 con 0x555fc9e0bb30 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785f187740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555fc9d26b30 con 0x555fc9e069c0 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785f187740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555fc9e0ec60 con 0x555fc9e05fd0 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785f187740 10 client.0 _ll_register_callbacks cb 0x555fc9d621a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785aa5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e17a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785aa5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e17a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33408/0 (socket says 172.21.15.82:33408) 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785aa5d640 1 -- 172.21.15.82:0/1702299941 learned_addr learned my addr 172.21.15.82:0/1702299941 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785a25c640 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e104e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f7859a5b640 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e10a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785aa5d640 1 -- 172.21.15.82:0/1702299941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 msgr2=0x555fc9e104e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785aa5d640 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e104e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785aa5d640 1 -- 172.21.15.82:0/1702299941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 msgr2=0x555fc9e10a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785aa5d640 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e10a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785aa5d640 1 -- 172.21.15.82:0/1702299941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fc9a7f2d0 con 0x555fc9e0bb30 2024-03-27T07:23:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785a25c640 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785aa5d640 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e17a60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f784c035000 tx=0x7f784c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5605246180efc8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f783dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f783dffb640 1 -- 172.21.15.82:0/1702299941 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c02ce10 con 0x555fc9e0bb30 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f783dffb640 1 -- 172.21.15.82:0/1702299941 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f784c004040 con 0x555fc9e0bb30 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.334+0000 7f785f187740 1 -- 172.21.15.82:0/1702299941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7844005020 con 0x555fc9e0bb30 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f783dffb640 1 -- 172.21.15.82:0/1702299941 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f784c004240 con 0x555fc9e0bb30 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f785f187740 10 client.15228 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f785f187740 1 -- 172.21.15.82:0/1702299941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555fc9b496b0 con 0x555fc9e0bb30 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f783dffb640 1 -- 172.21.15.82:0/1702299941 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7844005020 con 0x555fc9e0bb30 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f783dffb640 1 -- 172.21.15.82:0/1702299941 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f784c034b00 con 0x555fc9e0bb30 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f785f187740 10 client.15228 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f785f187740 10 client.15228 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f785f187740 20 client.15228 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f785f187740 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555fc9e1d010 0x555fc9e1e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f785f187740 4 client.15228 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:23:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f785f187740 1 -- 172.21.15.82:0/1702299941 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fc9d78550 con 0x555fc9e1d010 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f785a25c640 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555fc9e1d010 0x555fc9e1e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f783dffb640 10 client.15228 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.335+0000 7f785a25c640 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555fc9e1d010 0x555fc9e1e480 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df5bba0900b9d733 server_cookie=b3f5a80cba04008b in_seq=0 out_seq=0 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f783dffb640 1 -- 172.21.15.82:0/1702299941 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x555fc9d78550 con 0x555fc9e1d010 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f783dffb640 10 client.15228 handle_command_reply: tid=0 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 client.15228 shutdown 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 -- 172.21.15.82:0/1702299941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 msgr2=0x555fc9e17a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e17a60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f784c035000 tx=0x7f784c009500 comp rx=0 tx=0).stop 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 -- 172.21.15.82:0/1702299941 shutdown_connections 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555fc9e1d010 0x555fc9e1e480 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e17a60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e10a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f783dffb640 0 client.15228 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:23:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 --2- 172.21.15.82:0/1702299941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e104e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 -- 172.21.15.82:0/1702299941 >> 172.21.15.82:0/1702299941 conn(0x555fc9dcdb20 msgr2=0x555fc9e00b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 -- 172.21.15.82:0/1702299941 shutdown_connections 2024-03-27T07:23:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 1 -- 172.21.15.82:0/1702299941 wait complete. 2024-03-27T07:23:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.336+0000 7f785f187740 20 client.15228 trim_cache size 0 max 16384 2024-03-27T07:23:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.354+0000 7f785f187740 1 Processor -- start 2024-03-27T07:23:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.354+0000 7f785f187740 1 -- start start 2024-03-27T07:23:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.354+0000 7f785f187740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e0f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.354+0000 7f785f187740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e17980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.354+0000 7f785f187740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e25750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.354+0000 7f785f187740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555fc9e1c7c0 con 0x555fc9e0bb30 2024-03-27T07:23:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.354+0000 7f785f187740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555fc9e1ce90 con 0x555fc9e069c0 2024-03-27T07:23:26.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.354+0000 7f785f187740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555fc9e1d560 con 0x555fc9e05fd0 2024-03-27T07:23:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.354+0000 7f785aa5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e25750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785aa5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e25750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33422/0 (socket says 172.21.15.82:33422) 2024-03-27T07:23:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785aa5d640 1 -- 172.21.15.82:0/3894282378 learned_addr learned my addr 172.21.15.82:0/3894282378 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f7859a5b640 1 --2- 172.21.15.82:0/3894282378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e17980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785a25c640 1 --2- 172.21.15.82:0/3894282378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e0f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785aa5d640 1 -- 172.21.15.82:0/3894282378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 msgr2=0x555fc9e0f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785aa5d640 1 --2- 172.21.15.82:0/3894282378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e0f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785aa5d640 1 -- 172.21.15.82:0/3894282378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 msgr2=0x555fc9e17980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785aa5d640 1 --2- 172.21.15.82:0/3894282378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e17980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785aa5d640 1 -- 172.21.15.82:0/3894282378 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fc9e0e380 con 0x555fc9e0bb30 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785aa5d640 1 --2- 172.21.15.82:0/3894282378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e25750 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f784c034e70 tx=0x7f784c0092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8448e3d489a9ec29 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f783ffff640 1 -- 172.21.15.82:0/3894282378 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c043640 con 0x555fc9e0bb30 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f783ffff640 1 -- 172.21.15.82:0/3894282378 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f784c053070 con 0x555fc9e0bb30 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f783ffff640 1 -- 172.21.15.82:0/3894282378 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c034690 con 0x555fc9e0bb30 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785f187740 1 -- 172.21.15.82:0/3894282378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 msgr2=0x555fc9e25750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.355+0000 7f785f187740 1 --2- 172.21.15.82:0/3894282378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e25750 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f784c034e70 tx=0x7f784c0092c0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 -- 172.21.15.82:0/3894282378 shutdown_connections 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 --2- 172.21.15.82:0/3894282378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e0bb30 0x555fc9e25750 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 --2- 172.21.15.82:0/3894282378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e069c0 0x555fc9e17980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 --2- 172.21.15.82:0/3894282378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e05fd0 0x555fc9e0f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 -- 172.21.15.82:0/3894282378 >> 172.21.15.82:0/3894282378 conn(0x555fc9dcdb20 msgr2=0x555fc9e0f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 -- 172.21.15.82:0/3894282378 shutdown_connections 2024-03-27T07:23:26.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 -- 172.21.15.82:0/3894282378 wait complete. 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 -- start start 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 Processor -- start 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e05fd0 0x555fc9e13130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e069c0 0x555fc9e13670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e0bb30 0x555fc9e16640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555fc9e1e300 con 0x555fc9e05fd0 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555fc9e1dc30 con 0x555fc9e0bb30 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555fc9e1e9d0 con 0x555fc9e069c0 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785f187740 10 client.0 _ll_register_callbacks cb 0x7f784c009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785a25c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e05fd0 0x555fc9e13130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785a25c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e05fd0 0x555fc9e13130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33432/0 (socket says 172.21.15.82:33432) 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785a25c640 1 -- 172.21.15.82:0/4085131525 learned_addr learned my addr 172.21.15.82:0/4085131525 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f7859a5b640 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e069c0 0x555fc9e13670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785aa5d640 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e0bb30 0x555fc9e16640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785a25c640 1 -- 172.21.15.82:0/4085131525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e069c0 msgr2=0x555fc9e13670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785a25c640 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e069c0 0x555fc9e13670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785a25c640 1 -- 172.21.15.82:0/4085131525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e0bb30 msgr2=0x555fc9e16640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785a25c640 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e0bb30 0x555fc9e16640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.356+0000 7f785a25c640 1 -- 172.21.15.82:0/4085131525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fc9e16c30 con 0x555fc9e05fd0 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f785a25c640 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e05fd0 0x555fc9e13130 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f78440057c0 tx=0x7f7844005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732e3f44f5c05756 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f783dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f783dffb640 1 -- 172.21.15.82:0/4085131525 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784402f020 con 0x555fc9e05fd0 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f783dffb640 1 -- 172.21.15.82:0/4085131525 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f784402ba30 con 0x555fc9e05fd0 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f785f187740 1 -- 172.21.15.82:0/4085131525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f784c053070 con 0x555fc9e05fd0 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f783dffb640 1 -- 172.21.15.82:0/4085131525 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f784402bc30 con 0x555fc9e05fd0 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f785f187740 10 client.15234 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:26.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f785f187740 1 -- 172.21.15.82:0/4085131525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555fc9e82d80 con 0x555fc9e05fd0 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f783dffb640 1 -- 172.21.15.82:0/4085131525 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f784c053070 con 0x555fc9e05fd0 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f783dffb640 1 -- 172.21.15.82:0/4085131525 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f78440036f0 con 0x555fc9e05fd0 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f785f187740 10 client.15234 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f785f187740 10 client.15234 resolve_mds: resolved name 'i' to daemon mds.i 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f785f187740 20 client.15234 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f785f187740 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555fc9e876c0 0x555fc9e863d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f785f187740 4 client.15234 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.357+0000 7f785f187740 1 -- 172.21.15.82:0/4085131525 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "status"}) -- 0x555fc9d728a0 con 0x555fc9e876c0 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f7859a5b640 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555fc9e876c0 0x555fc9e863d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f7859a5b640 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555fc9e876c0 0x555fc9e863d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=93effec492c09597 server_cookie=d04e6f5c59ab278 in_seq=0 out_seq=0 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f783dffb640 10 client.15234 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f783dffb640 1 -- 172.21.15.82:0/4085131525 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555fc9d728a0 con 0x555fc9e876c0 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f783dffb640 10 client.15234 handle_command_reply: tid=0 2024-03-27T07:23:26.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 client.15234 shutdown 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 -- 172.21.15.82:0/4085131525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e05fd0 msgr2=0x555fc9e13130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e05fd0 0x555fc9e13130 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f78440057c0 tx=0x7f7844005750 comp rx=0 tx=0).stop 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 -- 172.21.15.82:0/4085131525 shutdown_connections 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555fc9e876c0 0x555fc9e863d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555fc9e0bb30 0x555fc9e16640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555fc9e069c0 0x555fc9e13670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 --2- 172.21.15.82:0/4085131525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555fc9e05fd0 0x555fc9e13130 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f783dffb640 0 client.15234 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 -- 172.21.15.82:0/4085131525 >> 172.21.15.82:0/4085131525 conn(0x555fc9dcdb20 msgr2=0x555fc9e0f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 -- 172.21.15.82:0/4085131525 shutdown_connections 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 1 -- 172.21.15.82:0/4085131525 wait complete. 2024-03-27T07:23:26.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.358+0000 7f785f187740 20 client.15234 trim_cache size 0 max 16384 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "604548c2-ec09-11ee-95d0-87774f69a715", 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24484, 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 108.78946591499999, 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 21, 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 126.30114498499999 2024-03-27T07:23:26.372 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:23:26.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 -- 172.21.15.82:0/2112992973 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78400a3610 msgr2=0x7f78400a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78400a3610 0x7f78400a5ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f784c004ab0 tx=0x7f784c004a40 comp rx=0 tx=0).stop 2024-03-27T07:23:26.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 -- 172.21.15.82:0/2112992973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854102d50 msgr2=0x7f7854198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854102d50 0x7f7854198340 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f785000e9c0 tx=0x7f785000ee80 comp rx=0 tx=0).stop 2024-03-27T07:23:26.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 -- 172.21.15.82:0/2112992973 shutdown_connections 2024-03-27T07:23:26.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78400a3610 0x7f78400a5ad0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854102d50 0x7f7854198340 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7854103710 0x7f785419f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 --2- 172.21.15.82:0/2112992973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7854101b60 0x7f7854197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 -- 172.21.15.82:0/2112992973 >> 172.21.15.82:0/2112992973 conn(0x7f78540fd0f0 msgr2=0x7f7854106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 -- 172.21.15.82:0/2112992973 shutdown_connections 2024-03-27T07:23:26.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.359+0000 7f785c4c0640 1 -- 172.21.15.82:0/2112992973 wait complete. 2024-03-27T07:23:26.375 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.478+0000 7f45c9ed4640 1 -- 172.21.15.82:0/541770403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c4102600 msgr2=0x7f45c4108e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.478+0000 7f45c9ed4640 1 --2- 172.21.15.82:0/541770403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c4102600 0x7f45c4108e90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009ca0 tx=0x7f45bc02c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.478+0000 7f45c9ed4640 1 -- 172.21.15.82:0/541770403 shutdown_connections 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.478+0000 7f45c9ed4640 1 --2- 172.21.15.82:0/541770403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c4102600 0x7f45c4108e90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.478+0000 7f45c9ed4640 1 --2- 172.21.15.82:0/541770403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45c4101c40 0x7f45c41020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.478+0000 7f45c9ed4640 1 --2- 172.21.15.82:0/541770403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c4100a50 0x7f45c4100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.478+0000 7f45c9ed4640 1 -- 172.21.15.82:0/541770403 >> 172.21.15.82:0/541770403 conn(0x7f45c40fbfe0 msgr2=0x7f45c40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c9ed4640 1 -- 172.21.15.82:0/541770403 shutdown_connections 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c9ed4640 1 -- 172.21.15.82:0/541770403 wait complete. 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c9ed4640 1 Processor -- start 2024-03-27T07:23:26.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c9ed4640 1 -- start start 2024-03-27T07:23:26.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c9ed4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c4100a50 0x7f45c4069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c9ed4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45c4101c40 0x7f45c419ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c9ed4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c4102600 0x7f45c41a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c9ed4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f45c410c6d0 con 0x7f45c4102600 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c9ed4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f45c410c550 con 0x7f45c4100a50 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c9ed4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45c410c850 con 0x7f45c4101c40 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c4102600 0x7f45c41a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c37fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c4100a50 0x7f45c4069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c4102600 0x7f45c41a14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33440/0 (socket says 172.21.15.82:33440) 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.479+0000 7f45c3fff640 1 -- 172.21.15.82:0/1830629146 learned_addr learned my addr 172.21.15.82:0/1830629146 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45c4101c40 0x7f45c419ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c3fff640 1 -- 172.21.15.82:0/1830629146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45c4101c40 msgr2=0x7f45c419ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c3fff640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45c4101c40 0x7f45c419ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c3fff640 1 -- 172.21.15.82:0/1830629146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c4100a50 msgr2=0x7f45c4069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c3fff640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c4100a50 0x7f45c4069820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c3fff640 1 -- 172.21.15.82:0/1830629146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c41a1cd0 con 0x7f45c4102600 2024-03-27T07:23:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c37fe640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c4100a50 0x7f45c4069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c3fff640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c4102600 0x7f45c41a14e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f45bc02c630 tx=0x7f45bc032ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c0ff9640 1 -- 172.21.15.82:0/1830629146 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc041020 con 0x7f45c4102600 2024-03-27T07:23:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c0ff9640 1 -- 172.21.15.82:0/1830629146 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45bc034cd0 con 0x7f45c4102600 2024-03-27T07:23:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c9ed4640 1 -- 172.21.15.82:0/1830629146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c41a1f00 con 0x7f45c4102600 2024-03-27T07:23:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c0ff9640 1 -- 172.21.15.82:0/1830629146 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45bc039040 con 0x7f45c4102600 2024-03-27T07:23:26.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.480+0000 7f45c9ed4640 1 -- 172.21.15.82:0/1830629146 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c41a23c0 con 0x7f45c4102600 2024-03-27T07:23:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.482+0000 7f45c0ff9640 1 -- 172.21.15.82:0/1830629146 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f45bc044020 con 0x7f45c4102600 2024-03-27T07:23:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.482+0000 7f45ccb96740 1 Processor -- start 2024-03-27T07:23:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.482+0000 7f45ccb96740 1 -- start start 2024-03-27T07:23:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.482+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 0x55f74d6293f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.482+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d62e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d62eb30 0x55f74d630fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45ccb96740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f74d58e010 con 0x55f74d6299c0 2024-03-27T07:23:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45ccb96740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f74d536770 con 0x55f74d628fd0 2024-03-27T07:23:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45ccb96740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f74d589fc0 con 0x55f74d62eb30 2024-03-27T07:23:26.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c0ff9640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f45ac0a3640 0x7f45ac0a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d62e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d62e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33450/0 (socket says 172.21.15.82:33450) 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 0x55f74d6293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c37fe640 1 -- 172.21.15.82:0/1124519919 learned_addr learned my addr 172.21.15.82:0/1124519919 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/1124519919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d62eb30 0x55f74d630fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c3fff640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f45ac0a3640 0x7f45ac0a5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c37fe640 1 -- 172.21.15.82:0/1124519919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d62eb30 msgr2=0x55f74d630fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c37fe640 1 --2- 172.21.15.82:0/1124519919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d62eb30 0x55f74d630fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c37fe640 1 -- 172.21.15.82:0/1124519919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 msgr2=0x55f74d6293f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c37fe640 1 --2- 172.21.15.82:0/1124519919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 0x55f74d6293f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c0ff9640 1 -- 172.21.15.82:0/1830629146 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f45bc0f1ac0 con 0x7f45c4102600 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c37fe640 1 -- 172.21.15.82:0/1124519919 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f74d555330 con 0x55f74d6299c0 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/1124519919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 0x55f74d6293f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:26.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c37fe640 1 --2- 172.21.15.82:0/1124519919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d62e4c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45b80114f0 tx=0x7f45b80119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4617dd2e79160970 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45c3fff640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f45ac0a3640 0x7f45ac0a5b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0ef960 tx=0x7f45bc0dcf90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45a9ffb640 1 -- 172.21.15.82:0/1124519919 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b801e070 con 0x55f74d6299c0 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45a9ffb640 1 -- 172.21.15.82:0/1124519919 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b8011250 con 0x55f74d6299c0 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.483+0000 7f45a9ffb640 1 -- 172.21.15.82:0/1124519919 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b80199b0 con 0x55f74d6299c0 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.484+0000 7f45ccb96740 1 -- 172.21.15.82:0/1124519919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 msgr2=0x55f74d62e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.484+0000 7f45ccb96740 1 --2- 172.21.15.82:0/1124519919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d62e4c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45b80114f0 tx=0x7f45b80119b0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.484+0000 7f45ccb96740 1 -- 172.21.15.82:0/1124519919 shutdown_connections 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.484+0000 7f45ccb96740 1 --2- 172.21.15.82:0/1124519919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d62e4c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.484+0000 7f45ccb96740 1 --2- 172.21.15.82:0/1124519919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d62eb30 0x55f74d630fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.484+0000 7f45ccb96740 1 --2- 172.21.15.82:0/1124519919 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 0x55f74d6293f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.484+0000 7f45ccb96740 1 -- 172.21.15.82:0/1124519919 >> 172.21.15.82:0/1124519919 conn(0x55f74d5f0b20 msgr2=0x55f74d624940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.484+0000 7f45ccb96740 1 -- 172.21.15.82:0/1124519919 shutdown_connections 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.484+0000 7f45ccb96740 1 -- 172.21.15.82:0/1124519919 wait complete. 2024-03-27T07:23:26.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.484+0000 7f45ccb96740 1 -- start start 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45ccb96740 1 Processor -- start 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d628fd0 0x55f74d633540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d633a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 0x55f74d63aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45ccb96740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f74d631ae0 con 0x55f74d6299c0 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45ccb96740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f74d549b30 con 0x55f74d62eb30 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45ccb96740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f74d631c60 con 0x55f74d628fd0 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45ccb96740 10 client.0 _ll_register_callbacks cb 0x55f74d5851a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d633a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d633a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33466/0 (socket says 172.21.15.82:33466) 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c37fe640 1 -- 172.21.15.82:0/4054145226 learned_addr learned my addr 172.21.15.82:0/4054145226 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d628fd0 0x55f74d633540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 0x55f74d63aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c37fe640 1 -- 172.21.15.82:0/4054145226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d628fd0 msgr2=0x55f74d633540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c37fe640 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d628fd0 0x55f74d633540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c37fe640 1 -- 172.21.15.82:0/4054145226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 msgr2=0x55f74d63aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c37fe640 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 0x55f74d63aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c37fe640 1 -- 172.21.15.82:0/4054145226 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f74d2a22d0 con 0x55f74d6299c0 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 0x55f74d63aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45c37fe640 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d633a80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f45b801c040 tx=0x7f45b8019940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217c14322c341219 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45a2ffd640 1 -- 172.21.15.82:0/4054145226 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8027020 con 0x55f74d6299c0 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45a2ffd640 1 -- 172.21.15.82:0/4054145226 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f45b8019d40 con 0x55f74d6299c0 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.485+0000 7f45ccb96740 1 -- 172.21.15.82:0/4054145226 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b8011250 con 0x55f74d6299c0 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45a2ffd640 1 -- 172.21.15.82:0/4054145226 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f45b801e070 con 0x55f74d6299c0 2024-03-27T07:23:26.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45ccb96740 10 client.15246 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45ccb96740 1 -- 172.21.15.82:0/4054145226 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f74d36c6b0 con 0x55f74d6299c0 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45a2ffd640 1 -- 172.21.15.82:0/4054145226 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b8011250 con 0x55f74d6299c0 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45a2ffd640 1 -- 172.21.15.82:0/4054145226 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f45b8004870 con 0x55f74d6299c0 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45ccb96740 10 client.15246 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45ccb96740 10 client.15246 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45ccb96740 20 client.15246 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45ccb96740 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f74d63fcc0 0x55f74d641130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45ccb96740 4 client.15246 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45ccb96740 1 -- 172.21.15.82:0/4054145226 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f74d59b550 con 0x55f74d63fcc0 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.486+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f74d63fcc0 0x55f74d641130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.487+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f74d63fcc0 0x55f74d641130 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44a96c6e8b76eee server_cookie=7bc39f4de112bdbe in_seq=0 out_seq=0 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.487+0000 7f45a2ffd640 10 client.15246 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.487+0000 7f45a2ffd640 1 -- 172.21.15.82:0/4054145226 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f74d59b550 con 0x55f74d63fcc0 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.487+0000 7f45a2ffd640 10 client.15246 handle_command_reply: tid=0 2024-03-27T07:23:26.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 client.15246 shutdown 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 -- 172.21.15.82:0/4054145226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 msgr2=0x55f74d633a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d633a80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f45b801c040 tx=0x7f45b8019940 comp rx=0 tx=0).stop 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 -- 172.21.15.82:0/4054145226 shutdown_connections 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f74d63fcc0 0x55f74d641130 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d6299c0 0x55f74d633a80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 0x55f74d63aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45a2ffd640 0 client.15246 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 --2- 172.21.15.82:0/4054145226 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d628fd0 0x55f74d633540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 -- 172.21.15.82:0/4054145226 >> 172.21.15.82:0/4054145226 conn(0x55f74d5f0b20 msgr2=0x55f74d623b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 -- 172.21.15.82:0/4054145226 shutdown_connections 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 1 -- 172.21.15.82:0/4054145226 wait complete. 2024-03-27T07:23:26.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.488+0000 7f45ccb96740 20 client.15246 trim_cache size 0 max 16384 2024-03-27T07:23:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45ccb96740 1 Processor -- start 2024-03-27T07:23:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45ccb96740 1 -- start start 2024-03-27T07:23:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 0x55f74d627b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 0x55f74d63aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d62eb30 0x55f74d6280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45ccb96740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f74d63f470 con 0x55f74d62eb30 2024-03-27T07:23:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45ccb96740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f74d63fb40 con 0x55f74d628fd0 2024-03-27T07:23:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45ccb96740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f74d640210 con 0x55f74d6299c0 2024-03-27T07:23:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d62eb30 0x55f74d6280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d62eb30 0x55f74d6280c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33472/0 (socket says 172.21.15.82:33472) 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c2ffd640 1 -- 172.21.15.82:0/1347547374 learned_addr learned my addr 172.21.15.82:0/1347547374 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/1347547374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 0x55f74d627b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c37fe640 1 --2- 172.21.15.82:0/1347547374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 0x55f74d63aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c2ffd640 1 -- 172.21.15.82:0/1347547374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 msgr2=0x55f74d63aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/1347547374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 0x55f74d63aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c2ffd640 1 -- 172.21.15.82:0/1347547374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 msgr2=0x55f74d627b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/1347547374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 0x55f74d627b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c2ffd640 1 -- 172.21.15.82:0/1347547374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f74d6346c0 con 0x55f74d62eb30 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c37fe640 1 --2- 172.21.15.82:0/1347547374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 0x55f74d63aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/1347547374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d62eb30 0x55f74d6280c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45b4000c00 tx=0x7f45b4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638efdcc7336b0fb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.506+0000 7f45a97fa640 1 -- 172.21.15.82:0/1347547374 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4011c80 con 0x55f74d62eb30 2024-03-27T07:23:26.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45a97fa640 1 -- 172.21.15.82:0/1347547374 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b4011e20 con 0x55f74d62eb30 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45a97fa640 1 -- 172.21.15.82:0/1347547374 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b400f620 con 0x55f74d62eb30 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45ccb96740 1 -- 172.21.15.82:0/1347547374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d62eb30 msgr2=0x55f74d6280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45ccb96740 1 --2- 172.21.15.82:0/1347547374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d62eb30 0x55f74d6280c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45b4000c00 tx=0x7f45b4005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45ccb96740 1 -- 172.21.15.82:0/1347547374 shutdown_connections 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45ccb96740 1 --2- 172.21.15.82:0/1347547374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d62eb30 0x55f74d6280c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45ccb96740 1 --2- 172.21.15.82:0/1347547374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 0x55f74d63aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45ccb96740 1 --2- 172.21.15.82:0/1347547374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d628fd0 0x55f74d627b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45ccb96740 1 -- 172.21.15.82:0/1347547374 >> 172.21.15.82:0/1347547374 conn(0x55f74d5f0b20 msgr2=0x55f74d63ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45ccb96740 1 -- 172.21.15.82:0/1347547374 shutdown_connections 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45ccb96740 1 -- 172.21.15.82:0/1347547374 wait complete. 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.507+0000 7f45ccb96740 1 -- start start 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45ccb96740 1 Processor -- start 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d628fd0 0x55f74d636890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 0x55f74d636dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45ccb96740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 0x55f74d639df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45ccb96740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f74d640fb0 con 0x55f74d628fd0 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45ccb96740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f74d6408e0 con 0x55f74d62eb30 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45ccb96740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f74d641680 con 0x55f74d6299c0 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45ccb96740 10 client.0 _ll_register_callbacks cb 0x7f45b801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d628fd0 0x55f74d636890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d628fd0 0x55f74d636890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33476/0 (socket says 172.21.15.82:33476) 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c2ffd640 1 -- 172.21.15.82:0/2426015457 learned_addr learned my addr 172.21.15.82:0/2426015457 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 0x55f74d639df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c37fe640 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 0x55f74d636dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c2ffd640 1 -- 172.21.15.82:0/2426015457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 msgr2=0x55f74d636dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 0x55f74d636dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c2ffd640 1 -- 172.21.15.82:0/2426015457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 msgr2=0x55f74d639df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:26.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 0x55f74d639df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c2ffd640 1 -- 172.21.15.82:0/2426015457 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f74d63a3e0 con 0x55f74d628fd0 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45c2ffd640 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d628fd0 0x55f74d636890 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009c30 tx=0x7f45b4012fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c823a6e698b98fe9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.508+0000 7f45a2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45a2ffd640 1 -- 172.21.15.82:0/2426015457 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4000e60 con 0x55f74d628fd0 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45a2ffd640 1 -- 172.21.15.82:0/2426015457 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f45b4011b70 con 0x55f74d628fd0 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45ccb96740 1 -- 172.21.15.82:0/2426015457 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45b4011e20 con 0x55f74d628fd0 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45a2ffd640 1 -- 172.21.15.82:0/2426015457 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f45b4005040 con 0x55f74d628fd0 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45ccb96740 10 client.15252 fetch_fsmap learned FSMap version 21 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45ccb96740 1 -- 172.21.15.82:0/2426015457 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f74d6a6110 con 0x55f74d628fd0 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45a2ffd640 1 -- 172.21.15.82:0/2426015457 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b4011e20 con 0x55f74d628fd0 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45a2ffd640 1 -- 172.21.15.82:0/2426015457 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f45b4020420 con 0x55f74d628fd0 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45ccb96740 10 client.15252 fetch_fsmap finished waiting for FSMap version 21 2024-03-27T07:23:26.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45ccb96740 10 client.15252 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45ccb96740 20 client.15252 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45ccb96740 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f74d6aa8e0 0x55f74d6a73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45ccb96740 4 client.15252 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45ccb96740 1 -- 172.21.15.82:0/2426015457 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "status"}) -- 0x55f74d5958a0 con 0x55f74d6aa8e0 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.509+0000 7f45c37fe640 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f74d6aa8e0 0x55f74d6a73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45a2ffd640 10 client.15252 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45c37fe640 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f74d6aa8e0 0x55f74d6a73f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79b2232155ad5b0 server_cookie=87ebf18386cc717a in_seq=0 out_seq=0 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45a2ffd640 1 -- 172.21.15.82:0/2426015457 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55f74d5958a0 con 0x55f74d6aa8e0 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45a2ffd640 10 client.15252 handle_command_reply: tid=0 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 client.15252 shutdown 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 -- 172.21.15.82:0/2426015457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d628fd0 msgr2=0x55f74d636890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d628fd0 0x55f74d636890 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f45b4009c30 tx=0x7f45b4012fe0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 -- 172.21.15.82:0/2426015457 shutdown_connections 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f74d62eb30 0x55f74d639df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f74d6299c0 0x55f74d636dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f74d6aa8e0 0x55f74d6a73f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 --2- 172.21.15.82:0/2426015457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f74d628fd0 0x55f74d636890 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45a2ffd640 0 client.15252 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 -- 172.21.15.82:0/2426015457 >> 172.21.15.82:0/2426015457 conn(0x55f74d5f0b20 msgr2=0x55f74d627b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 -- 172.21.15.82:0/2426015457 shutdown_connections 2024-03-27T07:23:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 1 -- 172.21.15.82:0/2426015457 wait complete. 2024-03-27T07:23:26.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.510+0000 7f45ccb96740 20 client.15252 trim_cache size 0 max 16384 2024-03-27T07:23:26.520 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:23:26.520 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "604548c2-ec09-11ee-95d0-87774f69a715", 2024-03-27T07:23:26.520 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-03-27T07:23:26.521 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24497, 2024-03-27T07:23:26.521 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-03-27T07:23:26.521 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-03-27T07:23:26.521 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-03-27T07:23:26.521 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 110.965871818, 2024-03-27T07:23:26.521 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 21, 2024-03-27T07:23:26.521 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 88, 2024-03-27T07:23:26.521 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 86, 2024-03-27T07:23:26.521 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 117.888470779 2024-03-27T07:23:26.521 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:23:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 -- 172.21.15.82:0/1830629146 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f45ac0a3640 msgr2=0x7f45ac0a5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f45ac0a3640 0x7f45ac0a5b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f45bc0ef960 tx=0x7f45bc0dcf90 comp rx=0 tx=0).stop 2024-03-27T07:23:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 -- 172.21.15.82:0/1830629146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c4102600 msgr2=0x7f45c41a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c4102600 0x7f45c41a14e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f45bc02c630 tx=0x7f45bc032ea0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 -- 172.21.15.82:0/1830629146 shutdown_connections 2024-03-27T07:23:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f45ac0a3640 0x7f45ac0a5b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45c4102600 0x7f45c41a14e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45c4101c40 0x7f45c419ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 --2- 172.21.15.82:0/1830629146 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f45c4100a50 0x7f45c4069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 -- 172.21.15.82:0/1830629146 >> 172.21.15.82:0/1830629146 conn(0x7f45c40fbfe0 msgr2=0x7f45c4104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 -- 172.21.15.82:0/1830629146 shutdown_connections 2024-03-27T07:23:26.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.511+0000 7f45c9ed4640 1 -- 172.21.15.82:0/1830629146 wait complete. 2024-03-27T07:23:26.524 INFO:teuthology.run_tasks:Running task sequential... 2024-03-27T07:23:26.533 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-03-27T07:23:26.533 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-27T07:23:26.534 INFO:teuthology.task.print:Enabling mgr modules 2024-03-27T07:23:26.534 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-03-27T07:23:26.535 INFO:teuthology.task.exec:Executing custom commands... 2024-03-27T07:23:26.535 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T07:23:26.535 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-03-27T07:23:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.636+0000 7f9bbf59e640 1 -- 172.21.15.82:0/1547063736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc01019d0 msgr2=0x7f9bc0101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.636+0000 7f9bbf59e640 1 --2- 172.21.15.82:0/1547063736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc01019d0 0x7f9bc0101df0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8009900 tx=0x7f9bb802bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.636+0000 7f9bbf59e640 1 -- 172.21.15.82:0/1547063736 shutdown_connections 2024-03-27T07:23:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.636+0000 7f9bbf59e640 1 --2- 172.21.15.82:0/1547063736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc0103580 0x7f9bc0109e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.636+0000 7f9bbf59e640 1 --2- 172.21.15.82:0/1547063736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bc0102bc0 0x7f9bc0103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.636+0000 7f9bbf59e640 1 --2- 172.21.15.82:0/1547063736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc01019d0 0x7f9bc0101df0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.636+0000 7f9bbf59e640 1 -- 172.21.15.82:0/1547063736 >> 172.21.15.82:0/1547063736 conn(0x7f9bc00fcf60 msgr2=0x7f9bc00ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.636+0000 7f9bbf59e640 1 -- 172.21.15.82:0/1547063736 shutdown_connections 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.636+0000 7f9bbf59e640 1 -- 172.21.15.82:0/1547063736 wait complete. 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbf59e640 1 Processor -- start 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbf59e640 1 -- start start 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbf59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bc01019d0 0x7f9bc0075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbf59e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc0102bc0 0x7f9bc0073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbf59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc0103580 0x7f9bc0074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbf59e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc010d640 con 0x7f9bc0103580 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbf59e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc010d4c0 con 0x7f9bc0102bc0 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbf59e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc010d7c0 con 0x7f9bc01019d0 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc0103580 0x7f9bc0074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc0103580 0x7f9bc0074480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33490/0 (socket says 172.21.15.82:33490) 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbed9d640 1 -- 172.21.15.82:0/862423233 learned_addr learned my addr 172.21.15.82:0/862423233 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbdd9b640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc0102bc0 0x7f9bc0073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbe59c640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bc01019d0 0x7f9bc0075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbed9d640 1 -- 172.21.15.82:0/862423233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bc01019d0 msgr2=0x7f9bc0075900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbed9d640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bc01019d0 0x7f9bc0075900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbed9d640 1 -- 172.21.15.82:0/862423233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc0102bc0 msgr2=0x7f9bc0073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbed9d640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc0102bc0 0x7f9bc0073f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbed9d640 1 -- 172.21.15.82:0/862423233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc0074d10 con 0x7f9bc0103580 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbed9d640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc0103580 0x7f9bc0074480 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000e970 tx=0x7f9bb000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9baf7fe640 1 -- 172.21.15.82:0/862423233 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000ccc0 con 0x7f9bc0103580 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9baf7fe640 1 -- 172.21.15.82:0/862423233 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bb000ce60 con 0x7f9bc0103580 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbf59e640 1 -- 172.21.15.82:0/862423233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc01a1e30 con 0x7f9bc0103580 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9baf7fe640 1 -- 172.21.15.82:0/862423233 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0010490 con 0x7f9bc0103580 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.637+0000 7f9bbf59e640 1 -- 172.21.15.82:0/862423233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc01a2240 con 0x7f9bc0103580 2024-03-27T07:23:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.638+0000 7f9bbf59e640 1 -- 172.21.15.82:0/862423233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc0108d70 con 0x7f9bc0103580 2024-03-27T07:23:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.639+0000 7f9baf7fe640 1 -- 172.21.15.82:0/862423233 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 138370+0+0 (secure 0 0 0) 0x7f9bb0005020 con 0x7f9bc0103580 2024-03-27T07:23:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.640+0000 7f9baf7fe640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9ba80a3600 0x7f9ba80a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.640+0000 7f9bbe59c640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9ba80a3600 0x7f9ba80a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.640+0000 7f9baf7fe640 1 -- 172.21.15.82:0/862423233 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f9bb00d0150 con 0x7f9bc0103580 2024-03-27T07:23:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.640+0000 7f9bbe59c640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9ba80a3600 0x7f9ba80a5ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8000c00 tx=0x7f9bb8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.644+0000 7f9baf7fe640 1 -- 172.21.15.82:0/862423233 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9bb009cd50 con 0x7f9bc0103580 2024-03-27T07:23:26.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:26.879+0000 7f9bbf59e640 1 -- 172.21.15.82:0/862423233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f9bc00627f0 con 0x7f9bc0103580 2024-03-27T07:23:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:26 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1131877128' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:26.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:26 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1008547060' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:26 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1131877128' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:27.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:26 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1008547060' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:26 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1131877128' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:27.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:26 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1008547060' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:27.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.688+0000 7f9baf7fe640 1 -- 172.21.15.82:0/862423233 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f9bb009c650 con 0x7f9bc0103580 2024-03-27T07:23:27.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 -- 172.21.15.82:0/862423233 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9ba80a3600 msgr2=0x7f9ba80a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:27.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9ba80a3600 0x7f9ba80a5ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8000c00 tx=0x7f9bb8005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:27.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 -- 172.21.15.82:0/862423233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc0103580 msgr2=0x7f9bc0074480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:27.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc0103580 0x7f9bc0074480 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000e970 tx=0x7f9bb000ed70 comp rx=0 tx=0).stop 2024-03-27T07:23:27.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 -- 172.21.15.82:0/862423233 shutdown_connections 2024-03-27T07:23:27.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f9ba80a3600 0x7f9ba80a5ac0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:27.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9bc0103580 0x7f9bc0074480 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:27.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9bc0102bc0 0x7f9bc0073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:27.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 --2- 172.21.15.82:0/862423233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9bc01019d0 0x7f9bc0075900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:27.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 -- 172.21.15.82:0/862423233 >> 172.21.15.82:0/862423233 conn(0x7f9bc00fcf60 msgr2=0x7f9bc0105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:27.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 -- 172.21.15.82:0/862423233 shutdown_connections 2024-03-27T07:23:27.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.691+0000 7f9bbf59e640 1 -- 172.21.15.82:0/862423233 wait complete. 2024-03-27T07:23:27.711 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-03-27T07:23:27.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.818+0000 7f7836442640 1 -- 172.21.15.82:0/2553576901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7830102d90 msgr2=0x7f7830103210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.818+0000 7f7836442640 1 --2- 172.21.15.82:0/2553576901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7830102d90 0x7f7830103210 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7824009900 tx=0x7f782402bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.818+0000 7f7836442640 1 -- 172.21.15.82:0/2553576901 shutdown_connections 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.818+0000 7f7836442640 1 --2- 172.21.15.82:0/2553576901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7830102d90 0x7f7830103210 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.818+0000 7f7836442640 1 --2- 172.21.15.82:0/2553576901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7830103750 0x7f7830109fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.818+0000 7f7836442640 1 --2- 172.21.15.82:0/2553576901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7830101ba0 0x7f7830101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.818+0000 7f7836442640 1 -- 172.21.15.82:0/2553576901 >> 172.21.15.82:0/2553576901 conn(0x7f78300fd110 msgr2=0x7f78300ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.818+0000 7f7836442640 1 -- 172.21.15.82:0/2553576901 shutdown_connections 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.818+0000 7f7836442640 1 -- 172.21.15.82:0/2553576901 wait complete. 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f7836442640 1 Processor -- start 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f7836442640 1 -- start start 2024-03-27T07:23:27.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f7836442640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7830101ba0 0x7f7830197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f7836442640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7830102d90 0x7f78301982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f7836442640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7830103750 0x7f783019f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f7836442640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f783010d820 con 0x7f7830101ba0 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f7836442640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f783010d6a0 con 0x7f7830103750 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f7836442640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f783010d9a0 con 0x7f7830102d90 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f782ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7830101ba0 0x7f7830197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f782ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7830101ba0 0x7f7830197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41346/0 (socket says 172.21.15.82:41346) 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f782ffff640 1 -- 172.21.15.82:0/3738043643 learned_addr learned my addr 172.21.15.82:0/3738043643 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.819+0000 7f78349df640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7830103750 0x7f783019f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782f7fe640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7830102d90 0x7f78301982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782ffff640 1 -- 172.21.15.82:0/3738043643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7830102d90 msgr2=0x7f78301982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782ffff640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7830102d90 0x7f78301982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782ffff640 1 -- 172.21.15.82:0/3738043643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7830103750 msgr2=0x7f783019f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:27.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782ffff640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7830103750 0x7f783019f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782ffff640 1 -- 172.21.15.82:0/3738043643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783019f9d0 con 0x7f7830101ba0 2024-03-27T07:23:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782f7fe640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7830102d90 0x7f78301982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:23:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782ffff640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7830101ba0 0x7f7830197db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f782000d950 tx=0x7f782000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782d7fa640 1 -- 172.21.15.82:0/3738043643 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820017070 con 0x7f7830101ba0 2024-03-27T07:23:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f7836442640 1 -- 172.21.15.82:0/3738043643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783019fcc0 con 0x7f7830101ba0 2024-03-27T07:23:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782d7fa640 1 -- 172.21.15.82:0/3738043643 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7820009c30 con 0x7f7830101ba0 2024-03-27T07:23:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f782d7fa640 1 -- 172.21.15.82:0/3738043643 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782000f600 con 0x7f7830101ba0 2024-03-27T07:23:27.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.820+0000 7f7836442640 1 -- 172.21.15.82:0/3738043643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78301a0190 con 0x7f7830101ba0 2024-03-27T07:23:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.821+0000 7f7836442640 1 -- 172.21.15.82:0/3738043643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7830108ec0 con 0x7f7830101ba0 2024-03-27T07:23:27.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.822+0000 7f782d7fa640 1 -- 172.21.15.82:0/3738043643 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 138387+0+0 (secure 0 0 0) 0x7f782001a070 con 0x7f7830101ba0 2024-03-27T07:23:27.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.822+0000 7f782d7fa640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78180a3700 0x7f78180a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:27.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.823+0000 7f782f7fe640 1 -- 172.21.15.82:0/3738043643 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78180a3700 msgr2=0x7f78180a5bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3599330107 2024-03-27T07:23:27.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.823+0000 7f782d7fa640 1 -- 172.21.15.82:0/3738043643 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f78200cf7c0 con 0x7f7830101ba0 2024-03-27T07:23:27.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.823+0000 7f782f7fe640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78180a3700 0x7f78180a5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:23:27.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:27.827+0000 7f782d7fa640 1 -- 172.21.15.82:0/3738043643 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7820009de0 con 0x7f7830101ba0 2024-03-27T07:23:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:27 smithi149 ceph-mon[36065]: pgmap v348: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:23:28.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:27 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/862423233' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-27T07:23:28.006 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: ignoring --setuser ceph since I am not root 2024-03-27T07:23:28.006 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: ignoring --setgroup ceph since I am not root 2024-03-27T07:23:28.006 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:27 smithi149 ceph-mgr[37496]: -- 172.21.15.149:0/170671648 <== mon.2 v2:172.21.15.149:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555df77f45a0 con 0x555df77c8c00 2024-03-27T07:23:28.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.006+0000 7f7836442640 1 -- 172.21.15.82:0/3738043643 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f7830062750 con 0x7f7830101ba0 2024-03-27T07:23:28.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.009+0000 7f782d7fa640 1 -- 172.21.15.82:0/3738043643 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) ==== 138+0+0 (secure 0 0 0) 0x7f782009c3c0 con 0x7f7830101ba0 2024-03-27T07:23:28.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 -- 172.21.15.82:0/3738043643 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78180a3700 msgr2=0x7f78180a5bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:23:28.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78180a3700 0x7f78180a5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 -- 172.21.15.82:0/3738043643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7830101ba0 msgr2=0x7f7830197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:28.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7830101ba0 0x7f7830197db0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f782000d950 tx=0x7f782000de10 comp rx=0 tx=0).stop 2024-03-27T07:23:28.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 -- 172.21.15.82:0/3738043643 shutdown_connections 2024-03-27T07:23:28.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f78180a3700 0x7f78180a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7830103750 0x7f783019f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7830102d90 0x7f78301982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 --2- 172.21.15.82:0/3738043643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7830101ba0 0x7f7830197db0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 -- 172.21.15.82:0/3738043643 >> 172.21.15.82:0/3738043643 conn(0x7f78300fd110 msgr2=0x7f7830106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:28.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 -- 172.21.15.82:0/3738043643 shutdown_connections 2024-03-27T07:23:28.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.012+0000 7f7836442640 1 -- 172.21.15.82:0/3738043643 wait complete. 2024-03-27T07:23:28.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:27 smithi082 ceph-mon[32178]: pgmap v348: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:23:28.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:27 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/862423233' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-27T07:23:28.026 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:27 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: ignoring --setuser ceph since I am not root 2024-03-27T07:23:28.026 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:27 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: ignoring --setgroup ceph since I am not root 2024-03-27T07:23:28.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-03-27T07:23:28.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:27 smithi153 ceph-mon[36179]: pgmap v348: 97 pgs: 97 active+clean; 641 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:23:28.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:27 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/862423233' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-03-27T07:23:28.038 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:27 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: ignoring --setuser ceph since I am not root 2024-03-27T07:23:28.038 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:27 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: ignoring --setgroup ceph since I am not root 2024-03-27T07:23:28.038 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:27 smithi153 ceph-mgr[38151]: -- 172.21.15.153:0/3495888528 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56134d7c05a0 con 0x56134d795000 2024-03-27T07:23:28.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.128+0000 7fd8025e2640 1 -- 172.21.15.82:0/3934885918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc101bb0 msgr2=0x7fd7fc101fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:28.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.128+0000 7fd8025e2640 1 --2- 172.21.15.82:0/3934885918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc101bb0 0x7fd7fc101fd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009900 tx=0x7fd7f002bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:28.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.128+0000 7fd8025e2640 1 -- 172.21.15.82:0/3934885918 shutdown_connections 2024-03-27T07:23:28.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.128+0000 7fd8025e2640 1 --2- 172.21.15.82:0/3934885918 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc103760 0x7fd7fc109ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.128+0000 7fd8025e2640 1 --2- 172.21.15.82:0/3934885918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7fc102da0 0x7fd7fc103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.128+0000 7fd8025e2640 1 --2- 172.21.15.82:0/3934885918 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc101bb0 0x7fd7fc101fd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.128+0000 7fd8025e2640 1 -- 172.21.15.82:0/3934885918 >> 172.21.15.82:0/3934885918 conn(0x7fd7fc0fd120 msgr2=0x7fd7fc0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.128+0000 7fd8025e2640 1 -- 172.21.15.82:0/3934885918 shutdown_connections 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.128+0000 7fd8025e2640 1 -- 172.21.15.82:0/3934885918 wait complete. 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd8025e2640 1 Processor -- start 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd8025e2640 1 -- start start 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd8025e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc101bb0 0x7fd7fc197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd8025e2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7fc102da0 0x7fd7fc198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd8025e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc103760 0x7fd7fc19f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd8025e2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc10d800 con 0x7fd7fc103760 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd8025e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc10d680 con 0x7fd7fc101bb0 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd8025e2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd7fc10d980 con 0x7fd7fc102da0 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd7fbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc101bb0 0x7fd7fc197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd7fbfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc101bb0 0x7fd7fc197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:45376/0 (socket says 172.21.15.82:45376) 2024-03-27T07:23:28.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd800b7f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc103760 0x7fd7fc19f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd7fbfff640 1 -- 172.21.15.82:0/3348851619 learned_addr learned my addr 172.21.15.82:0/3348851619 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.129+0000 7fd7fb7fe640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7fc102da0 0x7fd7fc198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd7fbfff640 1 -- 172.21.15.82:0/3348851619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7fc102da0 msgr2=0x7fd7fc198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd7fbfff640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7fc102da0 0x7fd7fc198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd7fbfff640 1 -- 172.21.15.82:0/3348851619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc103760 msgr2=0x7fd7fc19f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd7fbfff640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc103760 0x7fd7fc19f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd7fbfff640 1 -- 172.21.15.82:0/3348851619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7fc19f9e0 con 0x7fd7fc101bb0 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd800b7f640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc103760 0x7fd7fc19f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd7fbfff640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc101bb0 0x7fd7fc197dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0000c00 tx=0x7fd7f0005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd7f97fa640 1 -- 172.21.15.82:0/3348851619 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0041070 con 0x7fd7fc101bb0 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd8025e2640 1 -- 172.21.15.82:0/3348851619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7fc19fc70 con 0x7fd7fc101bb0 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd7f97fa640 1 -- 172.21.15.82:0/3348851619 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7f00044d0 con 0x7fd7fc101bb0 2024-03-27T07:23:28.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd7f97fa640 1 -- 172.21.15.82:0/3348851619 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0034440 con 0x7fd7fc101bb0 2024-03-27T07:23:28.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.130+0000 7fd8025e2640 1 -- 172.21.15.82:0/3348851619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7fc1a01b0 con 0x7fd7fc101bb0 2024-03-27T07:23:28.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.131+0000 7fd8025e2640 1 -- 172.21.15.82:0/3348851619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7fc108e70 con 0x7fd7fc101bb0 2024-03-27T07:23:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.132+0000 7fd7f97fa640 1 -- 172.21.15.82:0/3348851619 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) ==== 138387+0+0 (secure 0 0 0) 0x7fd7f0044070 con 0x7fd7fc101bb0 2024-03-27T07:23:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.133+0000 7fd7f97fa640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd7e40a3700 0x7fd7e40a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.133+0000 7fd7fb7fe640 1 -- 172.21.15.82:0/3348851619 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd7e40a3700 msgr2=0x7fd7e40a5bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3599330107 2024-03-27T07:23:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.133+0000 7fd7f97fa640 1 -- 172.21.15.82:0/3348851619 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fd7f00f1aa0 con 0x7fd7fc101bb0 2024-03-27T07:23:28.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.133+0000 7fd7fb7fe640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd7e40a3700 0x7fd7e40a5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:23:28.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.141+0000 7fd7f97fa640 1 -- 172.21.15.82:0/3348851619 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd7f00bdff0 con 0x7fd7fc101bb0 2024-03-27T07:23:28.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.321+0000 7fd8025e2640 1 -- 172.21.15.82:0/3348851619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fd7fc02d370 con 0x7fd7fc101bb0 2024-03-27T07:23:28.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.328+0000 7fd7f97fa640 1 -- 172.21.15.82:0/3348851619 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) ==== 133+0+0 (secure 0 0 0) 0x7fd7f00c22f0 con 0x7fd7fc101bb0 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.330+0000 7fd8025e2640 1 -- 172.21.15.82:0/3348851619 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd7e40a3700 msgr2=0x7fd7e40a5bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.330+0000 7fd8025e2640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd7e40a3700 0x7fd7e40a5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.330+0000 7fd8025e2640 1 -- 172.21.15.82:0/3348851619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc101bb0 msgr2=0x7fd7fc197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.330+0000 7fd8025e2640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc101bb0 0x7fd7fc197dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0000c00 tx=0x7fd7f0005d50 comp rx=0 tx=0).stop 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.331+0000 7fd8025e2640 1 -- 172.21.15.82:0/3348851619 shutdown_connections 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.331+0000 7fd8025e2640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fd7e40a3700 0x7fd7e40a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.331+0000 7fd8025e2640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7fc103760 0x7fd7fc19f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.331+0000 7fd8025e2640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7fc102da0 0x7fd7fc198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.331+0000 7fd8025e2640 1 --2- 172.21.15.82:0/3348851619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd7fc101bb0 0x7fd7fc197dc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.331+0000 7fd8025e2640 1 -- 172.21.15.82:0/3348851619 >> 172.21.15.82:0/3348851619 conn(0x7fd7fc0fd120 msgr2=0x7fd7fc106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.331+0000 7fd8025e2640 1 -- 172.21.15.82:0/3348851619 shutdown_connections 2024-03-27T07:23:28.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:28.331+0000 7fd8025e2640 1 -- 172.21.15.82:0/3348851619 wait complete. 2024-03-27T07:23:28.344 INFO:teuthology.run_tasks:Running task kclient... 2024-03-27T07:23:28.368 INFO:tasks.kclient:Mounting kernel clients... 2024-03-27T07:23:28.368 INFO:tasks.kclient:config is {'client.0': {}} 2024-03-27T07:23:28.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:23:28.369 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-03-27T07:23:28.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:23:28.384 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-03-27T07:23:28.454 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-03-27T07:23:28.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T07:23:28.456 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-03-27T07:23:28.456 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-27T07:23:28.456 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-27T07:23:28.456 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph fs ls 2024-03-27T07:23:28.538 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:28 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:28.263+0000 7fd66e3b5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T07:23:28.538 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:28 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:28.358+0000 7fd66e3b5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T07:23:28.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:28 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:28.274+0000 7faa3f630200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T07:23:28.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:28 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:28.373+0000 7faa3f630200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T07:23:28.706 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:28.389+0000 7f6833a9b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T07:23:28.706 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:28.483+0000 7f6833a9b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T07:23:28.747 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:23:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:28 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/862423233' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-27T07:23:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:28 smithi149 ceph-mon[36065]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-27T07:23:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:28 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3738043643' entity='client.admin' 2024-03-27T07:23:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:28 smithi149 ceph-mon[36065]: from='client.? ' entity='client.admin' 2024-03-27T07:23:29.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:28 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/862423233' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-27T07:23:29.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:28 smithi082 ceph-mon[32178]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-27T07:23:29.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:28 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3738043643' entity='client.admin' 2024-03-27T07:23:29.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:28 smithi082 ceph-mon[32178]: from='client.? ' entity='client.admin' 2024-03-27T07:23:29.031 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:28 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/862423233' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-03-27T07:23:29.031 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:28 smithi153 ceph-mon[36179]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-03-27T07:23:29.031 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:28 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3738043643' entity='client.admin' 2024-03-27T07:23:29.031 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:28 smithi153 ceph-mon[36179]: from='client.? ' entity='client.admin' 2024-03-27T07:23:29.288 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:29.029+0000 7fd66e3b5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T07:23:29.288 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:29.158+0000 7fd66e3b5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T07:23:29.297 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:29.057+0000 7faa3f630200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T07:23:29.297 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:29.151+0000 7faa3f630200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T07:23:29.297 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:29.295+0000 7faa3f630200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T07:23:29.482 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:29.144+0000 7f6833a9b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T07:23:29.483 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:29.238+0000 7f6833a9b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T07:23:29.483 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:29.384+0000 7f6833a9b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T07:23:29.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:29.390+0000 7faa3f630200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T07:23:29.688 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:29.473+0000 7faa3f630200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T07:23:29.755 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:29.480+0000 7f6833a9b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T07:23:29.755 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:29.565+0000 7f6833a9b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T07:23:29.767 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:29.313+0000 7fd66e3b5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T07:23:29.768 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:29.410+0000 7fd66e3b5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T07:23:29.768 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:29.495+0000 7fd66e3b5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T07:23:29.768 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:29.766+0000 7fd66e3b5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T07:23:30.006 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:29.743+0000 7faa3f630200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T07:23:30.007 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:29.851+0000 7faa3f630200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T07:23:30.007 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:29.939+0000 7faa3f630200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T07:23:30.038 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:29.878+0000 7fd66e3b5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T07:23:30.038 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:29.966+0000 7fd66e3b5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T07:23:30.131 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:29.836+0000 7f6833a9b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T07:23:30.132 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:29.947+0000 7f6833a9b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T07:23:30.132 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:30 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:30.034+0000 7f6833a9b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T07:23:30.132 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:30 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:30.129+0000 7f6833a9b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T07:23:30.327 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:30 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:30.036+0000 7faa3f630200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T07:23:30.327 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:30 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:30.225+0000 7faa3f630200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T07:23:30.505 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:30 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:30.336+0000 7f6833a9b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T07:23:30.538 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:30 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:30.062+0000 7fd66e3b5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T07:23:30.538 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:30 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:30.242+0000 7fd66e3b5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T07:23:30.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.561+0000 7f9511417700 1 -- 172.21.15.82:0/4294655479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c102690 msgr2=0x7f950c102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:30.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.561+0000 7f9511417700 1 --2- 172.21.15.82:0/4294655479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c102690 0x7f950c102b10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f95000099c0 tx=0x7f9500009cd0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.565+0000 7f9511417700 1 -- 172.21.15.82:0/4294655479 shutdown_connections 2024-03-27T07:23:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.565+0000 7f9511417700 1 --2- 172.21.15.82:0/4294655479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950c103050 0x7f950c10f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.565+0000 7f9511417700 1 --2- 172.21.15.82:0/4294655479 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c108670 0x7f950c108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.565+0000 7f9511417700 1 --2- 172.21.15.82:0/4294655479 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c102690 0x7f950c102b10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.565+0000 7f9511417700 1 -- 172.21.15.82:0/4294655479 >> 172.21.15.82:0/4294655479 conn(0x7f950c079770 msgr2=0x7f950c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.565+0000 7f9511417700 1 -- 172.21.15.82:0/4294655479 shutdown_connections 2024-03-27T07:23:30.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.565+0000 7f9511417700 1 -- 172.21.15.82:0/4294655479 wait complete. 2024-03-27T07:23:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.566+0000 7f9511417700 1 Processor -- start 2024-03-27T07:23:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.566+0000 7f9511417700 1 -- start start 2024-03-27T07:23:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.567+0000 7f9511417700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c102690 0x7f950c198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.567+0000 7f9511417700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950c103050 0x7f950c1994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.567+0000 7f9511417700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c108670 0x7f950c19d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:30.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.567+0000 7f9511417700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f950c112a90 con 0x7f950c102690 2024-03-27T07:23:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.567+0000 7f950b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c108670 0x7f950c19d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.567+0000 7f950b7fe700 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c108670 0x7f950c19d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:45408/0 (socket says 172.21.15.82:45408) 2024-03-27T07:23:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.567+0000 7f950a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950c103050 0x7f950c1994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.567+0000 7f950b7fe700 1 -- 172.21.15.82:0/3123505661 learned_addr learned my addr 172.21.15.82:0/3123505661 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.567+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f950c112910 con 0x7f950c108670 2024-03-27T07:23:30.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.567+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f950c112c10 con 0x7f950c103050 2024-03-27T07:23:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.568+0000 7f950b7fe700 1 -- 172.21.15.82:0/3123505661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950c103050 msgr2=0x7f950c1994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.568+0000 7f950b7fe700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950c103050 0x7f950c1994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.568+0000 7f950b7fe700 1 -- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c102690 msgr2=0x7f950c198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.568+0000 7f950b7fe700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c102690 0x7f950c198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.568+0000 7f950b7fe700 1 -- 172.21.15.82:0/3123505661 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950c19df90 con 0x7f950c108670 2024-03-27T07:23:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.568+0000 7f950b7fe700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c108670 0x7f950c19d850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f950400b970 tx=0x7f950400bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.568+0000 7f94f3fff700 1 -- 172.21.15.82:0/3123505661 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950401d070 con 0x7f950c108670 2024-03-27T07:23:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.569+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950c19e280 con 0x7f950c108670 2024-03-27T07:23:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.569+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f950c074870 con 0x7f950c108670 2024-03-27T07:23:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.569+0000 7f94f3fff700 1 -- 172.21.15.82:0/3123505661 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9504010d40 con 0x7f950c108670 2024-03-27T07:23:30.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.569+0000 7f94f3fff700 1 -- 172.21.15.82:0/3123505661 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504007790 con 0x7f950c108670 2024-03-27T07:23:30.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.572+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f950c103d20 con 0x7f950c108670 2024-03-27T07:23:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.573+0000 7f94f3fff700 1 -- 172.21.15.82:0/3123505661 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 19) ==== 138387+0+0 (secure 0 0 0) 0x7f9504020070 con 0x7f950c108670 2024-03-27T07:23:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.574+0000 7f94f3fff700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f40a3840 0x7f94f40a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:30.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.574+0000 7f950affd700 1 -- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f40a3840 msgr2=0x7f94f40a5d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3599330107 2024-03-27T07:23:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.574+0000 7f94f3fff700 1 -- 172.21.15.82:0/3123505661 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f95040d3600 con 0x7f950c108670 2024-03-27T07:23:30.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.574+0000 7f950affd700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f40a3840 0x7f94f40a5d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:23:30.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.585+0000 7f94f3fff700 1 -- 172.21.15.82:0/3123505661 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9504054cb0 con 0x7f950c108670 2024-03-27T07:23:30.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.775+0000 7f950affd700 1 -- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f40a3840 msgr2=0x7f94f40a5d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3599330107 2024-03-27T07:23:30.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.775+0000 7f950affd700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f40a3840 0x7f94f40a5d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T07:23:30.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.865+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f950c069330 con 0x7f950c108670 2024-03-27T07:23:30.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.866+0000 7f94f3fff700 1 -- 172.21.15.82:0/3123505661 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7f950c069330 con 0x7f950c108670 2024-03-27T07:23:30.869 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-27T07:23:30.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f40a3840 msgr2=0x7f94f40a5d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f40a3840 0x7f94f40a5d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c108670 msgr2=0x7f950c19d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c108670 0x7f950c19d850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f950400b970 tx=0x7f950400bc80 comp rx=0 tx=0).stop 2024-03-27T07:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 shutdown_connections 2024-03-27T07:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f94f40a3840 0x7f94f40a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f950c108670 0x7f950c19d850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f950c102690 0x7f950c198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 --2- 172.21.15.82:0/3123505661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f950c103050 0x7f950c1994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:30.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 >> 172.21.15.82:0/3123505661 conn(0x7f950c079770 msgr2=0x7f950c1014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:30.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 shutdown_connections 2024-03-27T07:23:30.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:30.868+0000 7f9511417700 1 -- 172.21.15.82:0/3123505661 wait complete. 2024-03-27T07:23:31.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:30 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3123505661' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-27T07:23:31.228 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:30 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3123505661' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-27T07:23:31.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:30 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3123505661' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-27T07:23:31.538 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:31.225+0000 7fd66e3b5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T07:23:31.538 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:31.356+0000 7fd66e3b5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T07:23:31.674 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:31 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:31.234+0000 7faa3f630200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T07:23:31.675 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:31 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:31.366+0000 7faa3f630200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T07:23:31.708 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-27T07:23:31.708 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-27T07:23:31.709 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-03-27T07:23:31.709 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-27T07:23:31.709 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-27T07:23:31.709 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-27T07:23:31.709 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-27T07:23:31.709 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-27T07:23:31.709 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-27T07:23:31.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:23:31.709 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-03-27T07:23:31.724 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T07:23:31.724 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T07:23:31.724 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-27T07:23:31.725 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 42125sec preferred_lft 42125sec 2024-03-27T07:23:31.726 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-03-27T07:23:31.726 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-03-27T07:23:31.726 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-27T07:23:31.726 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T07:23:31.726 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-27T07:23:31.726 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-03-27T07:23:31.726 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-03-27T07:23:31.727 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-03-27T07:23:31.727 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-27T07:23:31.727 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-27T07:23:31.755 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:31 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:31.491+0000 7f6833a9b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T07:23:31.755 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:31 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:31.647+0000 7f6833a9b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T07:23:31.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T07:23:31.926 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:31 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:31.714+0000 7faa3f630200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T07:23:31.927 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:31 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:31.811+0000 7faa3f630200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T07:23:31.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T07:23:31.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:23:31.947 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-27T07:23:31.976 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-03-27T07:23:31.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:23:31.978 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-03-27T07:23:32.031 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:31.696+0000 7fd66e3b5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T07:23:32.031 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:31.804+0000 7fd66e3b5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T07:23:32.031 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:32.028+0000 7fd66e3b5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:23:32.048 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-03-27T07:23:32.048 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-27T07:23:32.048 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-27T07:23:32.049 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-27T07:23:32.049 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-27T07:23:32.049 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T07:23:32.049 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-27T07:23:32.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-27T07:23:32.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-27T07:23:32.049 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-27T07:23:32.049 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-27T07:23:32.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T07:23:32.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:32.043+0000 7faa3f630200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:23:32.255 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:32.001+0000 7f6833a9b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T07:23:32.255 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:32.091+0000 7f6833a9b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T07:23:32.288 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:32.244+0000 7fd66e3b5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T07:23:32.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T07:23:32.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:23:32.363 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-03-27T07:23:32.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:23:32.379 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-03-27T07:23:32.434 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T07:23:32.434 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-27T07:23:32.434 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T07:23:32.434 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-27T07:23:32.434 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-27T07:23:32.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T07:23:32.533 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:32.254+0000 7faa3f630200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T07:23:32.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T07:23:32.558 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-27T07:23:32.559 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T07:23:32.559 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-27T07:23:32.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-27T07:23:32.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-27T07:23:32.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-27T07:23:32.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-27T07:23:32.559 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-27T07:23:32.559 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-27T07:23:32.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T07:23:32.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T07:23:32.707 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T07:23:32.707 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-03-27T07:23:32.707 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-03-27T07:23:32.707 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-03-27T07:23:32.707 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-03-27T07:23:32.755 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:32.289+0000 7f6833a9b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:23:32.755 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:32.476+0000 7f6833a9b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T07:23:32.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T07:23:32.783 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:32.564+0000 7faa3f630200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:23:32.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T07:23:32.793 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T07:23:32.793 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-27T07:23:32.807 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-27T07:23:32.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T07:23:32.808 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-27T07:23:32.862 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-03-27T07:23:32.862 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-03-27T07:23:32.862 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5 2024-03-27T07:23:32.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:23:32.863 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-03-27T07:23:32.878 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:32.587+0000 7fd66e3b5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:23:32.948 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-03-27T07:23:32.948 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-03-27T07:23:32.948 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-03-27T07:23:33.062 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:32.791+0000 7f6833a9b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T07:23:33.062 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:33 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:33.060+0000 7f6833a9b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T07:23:33.066 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:32.843+0000 7faa3f630200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T07:23:33.074 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-03-27T07:23:33.074 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-03-27T07:23:33.074 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-03-27T07:23:33.074 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:6789,172.21.15.149:6789,172.21.15.153:6789" 2024-03-27T07:23:33.074 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:6789,172.21.15.149:6789,172.21.15.153:6789:/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5 2024-03-27T07:23:33.074 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=604548c2-ec09-11ee-95d0-87774f69a715" will pass to kernel 2024-03-27T07:23:33.076 INFO:teuthology.orchestra.run.smithi082.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-27T07:23:33.076 INFO:teuthology.orchestra.run.smithi082.stdout: You just mounted a file system that supports labels which does not 2024-03-27T07:23:33.076 INFO:teuthology.orchestra.run.smithi082.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-27T07:23:33.076 INFO:teuthology.orchestra.run.smithi082.stdout: applications will generate AVC messages and not be allowed access to 2024-03-27T07:23:33.076 INFO:teuthology.orchestra.run.smithi082.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-27T07:23:33.077 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-27T07:23:33.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:23:33.078 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-27T07:23:33.106 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-27T07:23:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-27T07:23:33.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T07:23:33.204 INFO:teuthology.orchestra.run.smithi082.stdout:client15291 2024-03-27T07:23:33.205 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:23:33.205 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T07:23:33.222 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-27T07:23:33.288 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:32.876+0000 7fd66e3b5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T07:23:33.288 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:33.119+0000 7fd66e3b5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T07:23:33.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-27T07:23:33.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T07:23:33.321 INFO:teuthology.orchestra.run.smithi082.stdout:client15291 2024-03-27T07:23:33.322 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-27T07:23:33.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-27T07:23:33.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T07:23:33.381 INFO:teuthology.orchestra.run.smithi082.stdout:client15291 2024-03-27T07:23:33.382 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/604548c2-ec09-11ee-95d0-87774f69a715.client15291/status') 2024-03-27T07:23:33.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T07:23:33.437 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:33 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:33.098+0000 7faa3f630200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T07:23:33.443 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.15291 (3)192.168.0.1:0/3008524158 2024-03-27T07:23:33.443 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-03-27T07:23:33.444 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-03-27T07:23:33.444 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-03-27T07:23:33.444 INFO:teuthology.orchestra.run.smithi082.stderr:70 bytes copied, 2.0719e-05 s, 3.4 MB/s 2024-03-27T07:23:33.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T07:23:33.451 INFO:teuthology.run_tasks:Running task exec... 2024-03-27T07:23:33.468 INFO:teuthology.task.exec:Executing custom commands... 2024-03-27T07:23:33.469 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T07:23:33.469 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-03-27T07:23:33.505 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:33 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:33.304+0000 7f6833a9b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T07:23:33.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.571+0000 7f5128255640 1 -- 172.21.15.82:0/2378404858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5120100a70 msgr2=0x7f5120100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.571+0000 7f5128255640 1 --2- 172.21.15.82:0/2378404858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5120100a70 0x7f5120100e90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5110009900 tx=0x7f511002bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.572+0000 7f5128255640 1 -- 172.21.15.82:0/2378404858 shutdown_connections 2024-03-27T07:23:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.572+0000 7f5128255640 1 --2- 172.21.15.82:0/2378404858 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5120102620 0x7f5120108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.572+0000 7f5128255640 1 --2- 172.21.15.82:0/2378404858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5120101c60 0x7f51201020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.572+0000 7f5128255640 1 --2- 172.21.15.82:0/2378404858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5120100a70 0x7f5120100e90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.572+0000 7f5128255640 1 -- 172.21.15.82:0/2378404858 >> 172.21.15.82:0/2378404858 conn(0x7f51200fbfe0 msgr2=0x7f51200fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.572+0000 7f5128255640 1 -- 172.21.15.82:0/2378404858 shutdown_connections 2024-03-27T07:23:33.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.572+0000 7f5128255640 1 -- 172.21.15.82:0/2378404858 wait complete. 2024-03-27T07:23:33.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.572+0000 7f5128255640 1 Processor -- start 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.572+0000 7f5128255640 1 -- start start 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5128255640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5120100a70 0x7f5120069d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5128255640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5120101c60 0x7f512019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5128255640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5120102620 0x7f512019f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5128255640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f512010c6e0 con 0x7f5120101c60 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5128255640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f512010c560 con 0x7f5120102620 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5128255640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f512010c860 con 0x7f5120100a70 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f51257f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5120101c60 0x7f512019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f51257f0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5120101c60 0x7f512019cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41412/0 (socket says 172.21.15.82:41412) 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f51257f0640 1 -- 172.21.15.82:0/3710129570 learned_addr learned my addr 172.21.15.82:0/3710129570 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5125ff1640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5120100a70 0x7f5120069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f51267f2640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5120102620 0x7f512019f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:33.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f51257f0640 1 -- 172.21.15.82:0/3710129570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5120100a70 msgr2=0x7f5120069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f51257f0640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5120100a70 0x7f5120069d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f51257f0640 1 -- 172.21.15.82:0/3710129570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5120102620 msgr2=0x7f512019f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f51257f0640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5120102620 0x7f512019f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f51257f0640 1 -- 172.21.15.82:0/3710129570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512019fb00 con 0x7f5120101c60 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f51257f0640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5120101c60 0x7f512019cbd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f511c00e9f0 tx=0x7f511c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5116ffd640 1 -- 172.21.15.82:0/3710129570 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c00cd80 con 0x7f5120101c60 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5128255640 1 -- 172.21.15.82:0/3710129570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512019fd90 con 0x7f5120101c60 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5116ffd640 1 -- 172.21.15.82:0/3710129570 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f511c005500 con 0x7f5120101c60 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5116ffd640 1 -- 172.21.15.82:0/3710129570 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c010690 con 0x7f5120101c60 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.573+0000 7f5128255640 1 -- 172.21.15.82:0/3710129570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51201a0280 con 0x7f5120101c60 2024-03-27T07:23:33.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.574+0000 7f5128255640 1 -- 172.21.15.82:0/3710129570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5120107de0 con 0x7f5120101c60 2024-03-27T07:23:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.575+0000 7f5116ffd640 1 -- 172.21.15.82:0/3710129570 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 138387+0+0 (secure 0 0 0) 0x7f511c0046c0 con 0x7f5120101c60 2024-03-27T07:23:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.576+0000 7f5116ffd640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f510c0a3700 0x7f510c0a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.576+0000 7f5125ff1640 1 -- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f510c0a3700 msgr2=0x7f510c0a5bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3599330107 2024-03-27T07:23:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.576+0000 7f5116ffd640 1 -- 172.21.15.82:0/3710129570 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f511c0d0100 con 0x7f5120101c60 2024-03-27T07:23:33.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.576+0000 7f5125ff1640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f510c0a3700 0x7f510c0a5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:23:33.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.581+0000 7f5116ffd640 1 -- 172.21.15.82:0/3710129570 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f511c09cd00 con 0x7f5120101c60 2024-03-27T07:23:33.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.777+0000 7f5125ff1640 1 -- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f510c0a3700 msgr2=0x7f510c0a5bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3599330107 2024-03-27T07:23:33.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.777+0000 7f5125ff1640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f510c0a3700 0x7f510c0a5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T07:23:33.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.806+0000 7f5128255640 1 -- 172.21.15.82:0/3710129570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f5120062780 con 0x7f5120101c60 2024-03-27T07:23:33.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.858+0000 7f5116ffd640 1 -- 172.21.15.82:0/3710129570 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v22) ==== 117+0+0 (secure 0 0 0) 0x7f511c09c600 con 0x7f5120101c60 2024-03-27T07:23:33.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 -- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f510c0a3700 msgr2=0x7f510c0a5bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:23:33.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f510c0a3700 0x7f510c0a5bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 -- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5120101c60 msgr2=0x7f512019cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5120101c60 0x7f512019cbd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f511c00e9f0 tx=0x7f511c00edf0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 -- 172.21.15.82:0/3710129570 shutdown_connections 2024-03-27T07:23:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f510c0a3700 0x7f510c0a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5120101c60 0x7f512019cbd0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5120102620 0x7f512019f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 --2- 172.21.15.82:0/3710129570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5120100a70 0x7f5120069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 -- 172.21.15.82:0/3710129570 >> 172.21.15.82:0/3710129570 conn(0x7f51200fbfe0 msgr2=0x7f5120104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 -- 172.21.15.82:0/3710129570 shutdown_connections 2024-03-27T07:23:33.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:33.861+0000 7f5128255640 1 -- 172.21.15.82:0/3710129570 wait complete. 2024-03-27T07:23:33.876 INFO:teuthology.run_tasks:Running task check-counter... 2024-03-27T07:23:33.887 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-03-27T07:23:33.898 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:23:34.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.000+0000 7f822cafb640 1 -- 172.21.15.82:0/2953507824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8228102620 msgr2=0x7f8228108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.000+0000 7f822cafb640 1 --2- 172.21.15.82:0/2953507824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8228102620 0x7f8228108eb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8220009ca0 tx=0x7f822002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.001+0000 7f822cafb640 1 -- 172.21.15.82:0/2953507824 shutdown_connections 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.001+0000 7f822cafb640 1 --2- 172.21.15.82:0/2953507824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8228102620 0x7f8228108eb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.001+0000 7f822cafb640 1 --2- 172.21.15.82:0/2953507824 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228101c60 0x7f82281020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.001+0000 7f822cafb640 1 --2- 172.21.15.82:0/2953507824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8228100a70 0x7f8228100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.001+0000 7f822cafb640 1 -- 172.21.15.82:0/2953507824 >> 172.21.15.82:0/2953507824 conn(0x7f82280fbfe0 msgr2=0x7f82280fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.001+0000 7f822cafb640 1 -- 172.21.15.82:0/2953507824 shutdown_connections 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.001+0000 7f822cafb640 1 -- 172.21.15.82:0/2953507824 wait complete. 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.001+0000 7f822cafb640 1 Processor -- start 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.001+0000 7f822cafb640 1 -- start start 2024-03-27T07:23:34.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822cafb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8228100a70 0x7f8228069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822cafb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228101c60 0x7f822819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822cafb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8228102620 0x7f822819f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822cafb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f822810c6d0 con 0x7f8228100a70 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822cafb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f822810c550 con 0x7f8228101c60 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822cafb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f822810c850 con 0x7f8228102620 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8228100a70 0x7f8228069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8228100a70 0x7f8228069820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41428/0 (socket says 172.21.15.82:41428) 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822659c640 1 -- 172.21.15.82:0/3634091067 learned_addr learned my addr 172.21.15.82:0/3634091067 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f8225d9b640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228101c60 0x7f822819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f8226d9d640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8228102620 0x7f822819f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822659c640 1 -- 172.21.15.82:0/3634091067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8228102620 msgr2=0x7f822819f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822659c640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8228102620 0x7f822819f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822659c640 1 -- 172.21.15.82:0/3634091067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228101c60 msgr2=0x7f822819cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822659c640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228101c60 0x7f822819cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822659c640 1 -- 172.21.15.82:0/3634091067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822819fa90 con 0x7f8228100a70 2024-03-27T07:23:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822659c640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8228100a70 0x7f8228069820 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d950 tx=0x7f821c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f82177fe640 1 -- 172.21.15.82:0/3634091067 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c017020 con 0x7f8228100a70 2024-03-27T07:23:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f82177fe640 1 -- 172.21.15.82:0/3634091067 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f821c009c30 con 0x7f8228100a70 2024-03-27T07:23:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822cafb640 1 -- 172.21.15.82:0/3634091067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822819fd20 con 0x7f8228100a70 2024-03-27T07:23:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f82177fe640 1 -- 172.21.15.82:0/3634091067 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c00f740 con 0x7f8228100a70 2024-03-27T07:23:34.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.002+0000 7f822cafb640 1 -- 172.21.15.82:0/3634091067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82281a01c0 con 0x7f8228100a70 2024-03-27T07:23:34.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.004+0000 7f822cafb640 1 -- 172.21.15.82:0/3634091067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8228107d90 con 0x7f8228100a70 2024-03-27T07:23:34.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.005+0000 7f82177fe640 1 -- 172.21.15.82:0/3634091067 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 138387+0+0 (secure 0 0 0) 0x7f821c01a020 con 0x7f8228100a70 2024-03-27T07:23:34.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.005+0000 7f82177fe640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82100a3660 0x7f82100a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.005+0000 7f8225d9b640 1 -- 172.21.15.82:0/3634091067 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82100a3660 msgr2=0x7f82100a5b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3599330107 2024-03-27T07:23:34.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.005+0000 7f82177fe640 1 -- 172.21.15.82:0/3634091067 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f821c0cf6a0 con 0x7f8228100a70 2024-03-27T07:23:34.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.005+0000 7f8225d9b640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82100a3660 0x7f82100a5b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:23:34.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.014+0000 7f82177fe640 1 -- 172.21.15.82:0/3634091067 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f821c021070 con 0x7f8228100a70 2024-03-27T07:23:34.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:33 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3710129570' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-27T07:23:34.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:33 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:33.957+0000 7faa3f630200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T07:23:34.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.200+0000 7f822cafb640 1 -- 172.21.15.82:0/3634091067 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8228062890 con 0x7f8228100a70 2024-03-27T07:23:34.203 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:33 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3710129570' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-27T07:23:34.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.202+0000 7f82177fe640 1 -- 172.21.15.82:0/3634091067 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22502 (secure 0 0 0) 0x7f821c009de0 con 0x7f8228100a70 2024-03-27T07:23:34.205 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:34.205 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":88,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:22:27.661407+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:23:34.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 -- 172.21.15.82:0/3634091067 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82100a3660 msgr2=0x7f82100a5b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:23:34.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82100a3660 0x7f82100a5b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 -- 172.21.15.82:0/3634091067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8228100a70 msgr2=0x7f8228069820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8228100a70 0x7f8228069820 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d950 tx=0x7f821c00de10 comp rx=0 tx=0).stop 2024-03-27T07:23:34.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 -- 172.21.15.82:0/3634091067 shutdown_connections 2024-03-27T07:23:34.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f82100a3660 0x7f82100a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8228102620 0x7f822819f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8228101c60 0x7f822819cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 --2- 172.21.15.82:0/3634091067 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8228100a70 0x7f8228069820 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 -- 172.21.15.82:0/3634091067 >> 172.21.15.82:0/3634091067 conn(0x7f82280fbfe0 msgr2=0x7f8228104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:34.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 -- 172.21.15.82:0/3634091067 shutdown_connections 2024-03-27T07:23:34.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.205+0000 7f822cafb640 1 -- 172.21.15.82:0/3634091067 wait complete. 2024-03-27T07:23:34.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T07:21:32.592597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T07:21:33.858606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:23:34.218 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:23:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:33 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3710129570' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-27T07:23:34.288 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:33.948+0000 7fd66e3b5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T07:23:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.322+0000 7f1fbafc7640 1 -- 172.21.15.82:0/2494519782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb41078f0 msgr2=0x7f1fb4109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.322+0000 7f1fbafc7640 1 --2- 172.21.15.82:0/2494519782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb41078f0 0x7f1fb4109ce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009ca0 tx=0x7f1fac02c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.322+0000 7f1fbafc7640 1 -- 172.21.15.82:0/2494519782 shutdown_connections 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.322+0000 7f1fbafc7640 1 --2- 172.21.15.82:0/2494519782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb41078f0 0x7f1fb4109ce0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.322+0000 7f1fbafc7640 1 --2- 172.21.15.82:0/2494519782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb4104fc0 0x7f1fb41073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.322+0000 7f1fbafc7640 1 --2- 172.21.15.82:0/2494519782 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb4102690 0x7f1fb4104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.322+0000 7f1fbafc7640 1 -- 172.21.15.82:0/2494519782 >> 172.21.15.82:0/2494519782 conn(0x7f1fb40fbfe0 msgr2=0x7f1fb40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.322+0000 7f1fbafc7640 1 -- 172.21.15.82:0/2494519782 shutdown_connections 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.322+0000 7f1fbafc7640 1 -- 172.21.15.82:0/2494519782 wait complete. 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fbafc7640 1 Processor -- start 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fbafc7640 1 -- start start 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fbafc7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb4102690 0x7f1fb4197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fbafc7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb4104fc0 0x7f1fb41983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fbafc7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb41078f0 0x7f1fb419f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fbafc7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb410d800 con 0x7f1fb4102690 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fbafc7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb410d680 con 0x7f1fb4104fc0 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fbafc7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb410d980 con 0x7f1fb41078f0 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fb8d63640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb4102690 0x7f1fb4197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fb8d63640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb4102690 0x7f1fb4197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41444/0 (socket says 172.21.15.82:41444) 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fb8d63640 1 -- 172.21.15.82:0/571046440 learned_addr learned my addr 172.21.15.82:0/571046440 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fb9564640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb41078f0 0x7f1fb419f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.323+0000 7f1fb3fff640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb4104fc0 0x7f1fb41983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fb8d63640 1 -- 172.21.15.82:0/571046440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb41078f0 msgr2=0x7f1fb419f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fb8d63640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb41078f0 0x7f1fb419f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fb8d63640 1 -- 172.21.15.82:0/571046440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb4104fc0 msgr2=0x7f1fb41983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fb8d63640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb4104fc0 0x7f1fb41983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fb8d63640 1 -- 172.21.15.82:0/571046440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb419fac0 con 0x7f1fb4102690 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fb8d63640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb4102690 0x7f1fb4197ea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800d950 tx=0x7f1fa800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fb1ffb640 1 -- 172.21.15.82:0/571046440 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8017030 con 0x7f1fb4102690 2024-03-27T07:23:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fb1ffb640 1 -- 172.21.15.82:0/571046440 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1fa8004020 con 0x7f1fb4102690 2024-03-27T07:23:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fbafc7640 1 -- 172.21.15.82:0/571046440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb419fdb0 con 0x7f1fb4102690 2024-03-27T07:23:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fb1ffb640 1 -- 172.21.15.82:0/571046440 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa80047a0 con 0x7f1fb4102690 2024-03-27T07:23:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.324+0000 7f1fbafc7640 1 -- 172.21.15.82:0/571046440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb41a0220 con 0x7f1fb4102690 2024-03-27T07:23:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.325+0000 7f1fbafc7640 1 -- 172.21.15.82:0/571046440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb40fdad0 con 0x7f1fb4102690 2024-03-27T07:23:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.326+0000 7f1fb1ffb640 1 -- 172.21.15.82:0/571046440 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 138387+0+0 (secure 0 0 0) 0x7f1fa80041d0 con 0x7f1fb4102690 2024-03-27T07:23:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.326+0000 7f1fb1ffb640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1fa40a3660 0x7f1fa40a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.327+0000 7f1fb3fff640 1 -- 172.21.15.82:0/571046440 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1fa40a3660 msgr2=0x7f1fa40a5b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3599330107 2024-03-27T07:23:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.327+0000 7f1fb1ffb640 1 -- 172.21.15.82:0/571046440 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7f1fa80cf700 con 0x7f1fb4102690 2024-03-27T07:23:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.327+0000 7f1fb3fff640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1fa40a3660 0x7f1fa40a5b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:23:34.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.331+0000 7f1fb1ffb640 1 -- 172.21.15.82:0/571046440 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1fa809c300 con 0x7f1fb4102690 2024-03-27T07:23:34.505 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:34 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:34.201+0000 7f6833a9b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T07:23:34.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.514+0000 7f1fbafc7640 1 -- 172.21.15.82:0/571046440 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1fb40627f0 con 0x7f1fb4102690 2024-03-27T07:23:34.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.514+0000 7f1fb1ffb640 1 -- 172.21.15.82:0/571046440 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f1fa809bc00 con 0x7f1fb4102690 2024-03-27T07:23:34.516 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:23:34.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 -- 172.21.15.82:0/571046440 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1fa40a3660 msgr2=0x7f1fa40a5b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:23:34.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1fa40a3660 0x7f1fa40a5b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 -- 172.21.15.82:0/571046440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb4102690 msgr2=0x7f1fb4197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb4102690 0x7f1fb4197ea0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800d950 tx=0x7f1fa800de10 comp rx=0 tx=0).stop 2024-03-27T07:23:34.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 -- 172.21.15.82:0/571046440 shutdown_connections 2024-03-27T07:23:34.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7f1fa40a3660 0x7f1fa40a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fb41078f0 0x7f1fb419f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1fb4104fc0 0x7f1fb41983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 --2- 172.21.15.82:0/571046440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1fb4102690 0x7f1fb4197ea0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 -- 172.21.15.82:0/571046440 >> 172.21.15.82:0/571046440 conn(0x7f1fb40fbfe0 msgr2=0x7f1fb4102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:34.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 -- 172.21.15.82:0/571046440 shutdown_connections 2024-03-27T07:23:34.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.516+0000 7f1fbafc7640 1 -- 172.21.15.82:0/571046440 wait complete. 2024-03-27T07:23:34.529 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T07:23:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.635+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/3422375161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4a0100a50 msgr2=0x7fe4a0100e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.635+0000 7fe4a7ed4640 1 --2- 172.21.15.82:0/3422375161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4a0100a50 0x7fe4a0100e70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009900 tx=0x7fe49c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/3422375161 shutdown_connections 2024-03-27T07:23:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 --2- 172.21.15.82:0/3422375161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a0102600 0x7fe4a0108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 --2- 172.21.15.82:0/3422375161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4a0101c40 0x7fe4a01020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 --2- 172.21.15.82:0/3422375161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4a0100a50 0x7fe4a0100e70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/3422375161 >> 172.21.15.82:0/3422375161 conn(0x7fe4a00fbfe0 msgr2=0x7fe4a00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/3422375161 shutdown_connections 2024-03-27T07:23:34.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/3422375161 wait complete. 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 Processor -- start 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 -- start start 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4a0100a50 0x7fe4a0069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4a0101c40 0x7fe4a019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a0102600 0x7fe4a019f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a010c6a0 con 0x7fe4a0101c40 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a010c520 con 0x7fe4a0102600 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a7ed4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a010c820 con 0x7fe4a0100a50 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a546f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4a0101c40 0x7fe4a019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a546f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4a0101c40 0x7fe4a019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41458/0 (socket says 172.21.15.82:41458) 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.636+0000 7fe4a546f640 1 -- 172.21.15.82:0/4006353834 learned_addr learned my addr 172.21.15.82:0/4006353834 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe4a6471640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a0102600 0x7fe4a019f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe4a5c70640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4a0100a50 0x7fe4a0069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe4a546f640 1 -- 172.21.15.82:0/4006353834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4a0100a50 msgr2=0x7fe4a0069820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe4a546f640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4a0100a50 0x7fe4a0069820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe4a546f640 1 -- 172.21.15.82:0/4006353834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a0102600 msgr2=0x7fe4a019f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe4a546f640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a0102600 0x7fe4a019f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe4a546f640 1 -- 172.21.15.82:0/4006353834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a019fb20 con 0x7fe4a0101c40 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe4a546f640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4a0101c40 0x7fe4a019cbf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe49000d950 tx=0x7fe49000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe496ffd640 1 -- 172.21.15.82:0/4006353834 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490017070 con 0x7fe4a0101c40 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe496ffd640 1 -- 172.21.15.82:0/4006353834 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe490009c30 con 0x7fe4a0101c40 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/4006353834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a019fdb0 con 0x7fe4a0101c40 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe496ffd640 1 -- 172.21.15.82:0/4006353834 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49000f6b0 con 0x7fe4a0101c40 2024-03-27T07:23:34.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.637+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/4006353834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a01a0270 con 0x7fe4a0101c40 2024-03-27T07:23:34.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.638+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/4006353834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a0107e40 con 0x7fe4a0101c40 2024-03-27T07:23:34.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.639+0000 7fe496ffd640 1 -- 172.21.15.82:0/4006353834 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 138387+0+0 (secure 0 0 0) 0x7fe4900109d0 con 0x7fe4a0101c40 2024-03-27T07:23:34.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.640+0000 7fe496ffd640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe48c0a3660 0x7fe48c0a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.640+0000 7fe4a5c70640 1 -- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe48c0a3660 msgr2=0x7fe48c0a5b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3599330107 2024-03-27T07:23:34.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.640+0000 7fe496ffd640 1 -- 172.21.15.82:0/4006353834 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8182+0+0 (secure 0 0 0) 0x7fe4900cf8f0 con 0x7fe4a0101c40 2024-03-27T07:23:34.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.640+0000 7fe4a5c70640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe48c0a3660 0x7fe48c0a5b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T07:23:34.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.645+0000 7fe496ffd640 1 -- 172.21.15.82:0/4006353834 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe490009de0 con 0x7fe4a0101c40 2024-03-27T07:23:34.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.841+0000 7fe4a5c70640 1 -- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe48c0a3660 msgr2=0x7fe48c0a5b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3599330107 2024-03-27T07:23:34.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.841+0000 7fe4a5c70640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe48c0a3660 0x7fe48c0a5b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T07:23:34.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.861+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/4006353834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe4a00627f0 con 0x7fe4a0101c40 2024-03-27T07:23:34.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.861+0000 7fe496ffd640 1 -- 172.21.15.82:0/4006353834 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7fe49009bea0 con 0x7fe4a0101c40 2024-03-27T07:23:34.863 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-27T07:23:34.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe48c0a3660 msgr2=0x7fe48c0a5b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:23:34.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe48c0a3660 0x7fe48c0a5b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4a0101c40 msgr2=0x7fe4a019cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4a0101c40 0x7fe4a019cbf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe49000d950 tx=0x7fe49000de10 comp rx=0 tx=0).stop 2024-03-27T07:23:34.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/4006353834 shutdown_connections 2024-03-27T07:23:34.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:6800/3599330107,v1:172.21.15.82:6801/3599330107] conn(0x7fe48c0a3660 0x7fe48c0a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4a0101c40 0x7fe4a019cbf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4a0102600 0x7fe4a019f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 --2- 172.21.15.82:0/4006353834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4a0100a50 0x7fe4a0069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/4006353834 >> 172.21.15.82:0/4006353834 conn(0x7fe4a00fbfe0 msgr2=0x7fe4a0105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:34.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/4006353834 shutdown_connections 2024-03-27T07:23:34.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.863+0000 7fe4a7ed4640 1 -- 172.21.15.82:0/4006353834 wait complete. 2024-03-27T07:23:34.867 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:34.566+0000 7fd66e3b5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T07:23:34.867 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:34.679+0000 7fd66e3b5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T07:23:34.867 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:34 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:34.559+0000 7faa3f630200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T07:23:34.867 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:34 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:34.685+0000 7faa3f630200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T07:23:34.877 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T07:23:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.989+0000 7f5a2609a640 1 -- 172.21.15.82:0/192873336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a20101c40 msgr2=0x7f5a201020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.989+0000 7f5a2609a640 1 --2- 172.21.15.82:0/192873336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a20101c40 0x7f5a201020c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009900 tx=0x7f5a1402bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:34.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.989+0000 7f5a2609a640 1 -- 172.21.15.82:0/192873336 shutdown_connections 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.989+0000 7f5a2609a640 1 --2- 172.21.15.82:0/192873336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a20101c40 0x7f5a201020c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.989+0000 7f5a2609a640 1 --2- 172.21.15.82:0/192873336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a20102600 0x7f5a20108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.989+0000 7f5a2609a640 1 --2- 172.21.15.82:0/192873336 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a20100a50 0x7f5a20100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.989+0000 7f5a2609a640 1 -- 172.21.15.82:0/192873336 >> 172.21.15.82:0/192873336 conn(0x7f5a200fbfe0 msgr2=0x7f5a200fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.989+0000 7f5a2609a640 1 -- 172.21.15.82:0/192873336 shutdown_connections 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.989+0000 7f5a2609a640 1 -- 172.21.15.82:0/192873336 wait complete. 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.990+0000 7f5a2609a640 1 Processor -- start 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.990+0000 7f5a2609a640 1 -- start start 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.990+0000 7f5a2609a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a20100a50 0x7f5a20196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.990+0000 7f5a2609a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a20101c40 0x7f5a20197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.990+0000 7f5a2609a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a20102600 0x7f5a2019e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.990+0000 7f5a2609a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2010c6b0 con 0x7f5a20102600 2024-03-27T07:23:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.990+0000 7f5a2609a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2010c530 con 0x7f5a20101c40 2024-03-27T07:23:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a2609a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2010c830 con 0x7f5a20100a50 2024-03-27T07:23:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a20102600 0x7f5a2019e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a20100a50 0x7f5a20196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a20102600 0x7f5a2019e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41512/0 (socket says 172.21.15.82:41512) 2024-03-27T07:23:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1ffff640 1 -- 172.21.15.82:0/3607558342 learned_addr learned my addr 172.21.15.82:0/3607558342 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1effd640 1 --2- 172.21.15.82:0/3607558342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a20101c40 0x7f5a20197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1ffff640 1 -- 172.21.15.82:0/3607558342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a20100a50 msgr2=0x7f5a20196dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1ffff640 1 --2- 172.21.15.82:0/3607558342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a20100a50 0x7f5a20196dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1ffff640 1 -- 172.21.15.82:0/3607558342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a20101c40 msgr2=0x7f5a20197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1ffff640 1 --2- 172.21.15.82:0/3607558342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a20101c40 0x7f5a20197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1ffff640 1 -- 172.21.15.82:0/3607558342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2019e9f0 con 0x7f5a20102600 2024-03-27T07:23:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1ffff640 1 --2- 172.21.15.82:0/3607558342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a20102600 0x7f5a2019e380 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009fd0 tx=0x7f5a1800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1cff9640 1 -- 172.21.15.82:0/3607558342 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18017070 con 0x7f5a20102600 2024-03-27T07:23:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1cff9640 1 -- 172.21.15.82:0/3607558342 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a18003e50 con 0x7f5a20102600 2024-03-27T07:23:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a2609a640 1 -- 172.21.15.82:0/3607558342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a20068d10 con 0x7f5a20102600 2024-03-27T07:23:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a1cff9640 1 -- 172.21.15.82:0/3607558342 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a180106c0 con 0x7f5a20102600 2024-03-27T07:23:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.991+0000 7f5a2609a640 1 -- 172.21.15.82:0/3607558342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a200691e0 con 0x7f5a20102600 2024-03-27T07:23:34.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.992+0000 7f5a2609a640 1 -- 172.21.15.82:0/3607558342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a20068940 con 0x7f5a20102600 2024-03-27T07:23:34.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.994+0000 7f5a1cff9640 1 -- 172.21.15.82:0/3607558342 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 138055+0+0 (secure 0 0 0) 0x7f5a18003970 con 0x7f5a20102600 2024-03-27T07:23:34.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.995+0000 7f5a1cff9640 1 -- 172.21.15.82:0/3607558342 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f5a180cf4a0 con 0x7f5a20102600 2024-03-27T07:23:34.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:34.998+0000 7f5a1cff9640 1 -- 172.21.15.82:0/3607558342 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f5a1809bd50 con 0x7f5a20102600 2024-03-27T07:23:35.187 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:34 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:34.928+0000 7faa3f630200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T07:23:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:34 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3710129570' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-27T07:23:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:34 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:23:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:34 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3634091067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:34 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/571046440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:34 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4006353834' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:35.206 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:23:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z[38112]: 2024-03-27T07:23:34.930+0000 7fd66e3b5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T07:23:35.206 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:34 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3710129570' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-27T07:23:35.206 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:34 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:23:35.207 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:34 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3634091067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:35.207 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:34 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/571046440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:35.207 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:34 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4006353834' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:35.218 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:34 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3710129570' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-27T07:23:35.219 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:34 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:23:35.219 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:34 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3634091067' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:35.219 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:34 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/571046440' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:35.219 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:34 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4006353834' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:35.219 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:34 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:34.860+0000 7f6833a9b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T07:23:35.219 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:34 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:34.972+0000 7f6833a9b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T07:23:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.235+0000 7f5a2609a640 1 -- 172.21.15.82:0/3607558342 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5a20107900 con 0x7f5a20102600 2024-03-27T07:23:35.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.236+0000 7f5a1cff9640 1 -- 172.21.15.82:0/3607558342 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f5a180a0050 con 0x7f5a20102600 2024-03-27T07:23:35.238 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-27T07:23:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.238+0000 7f5a2609a640 1 -- 172.21.15.82:0/3607558342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a20102600 msgr2=0x7f5a2019e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.238+0000 7f5a2609a640 1 --2- 172.21.15.82:0/3607558342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a20102600 0x7f5a2019e380 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5a18009fd0 tx=0x7f5a1800b260 comp rx=0 tx=0).stop 2024-03-27T07:23:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.238+0000 7f5a2609a640 1 -- 172.21.15.82:0/3607558342 shutdown_connections 2024-03-27T07:23:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.238+0000 7f5a2609a640 1 --2- 172.21.15.82:0/3607558342 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a20102600 0x7f5a2019e380 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.238+0000 7f5a2609a640 1 --2- 172.21.15.82:0/3607558342 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5a20101c40 0x7f5a20197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.238+0000 7f5a2609a640 1 --2- 172.21.15.82:0/3607558342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a20100a50 0x7f5a20196dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.238+0000 7f5a2609a640 1 -- 172.21.15.82:0/3607558342 >> 172.21.15.82:0/3607558342 conn(0x7f5a200fbfe0 msgr2=0x7f5a20105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.238+0000 7f5a2609a640 1 -- 172.21.15.82:0/3607558342 shutdown_connections 2024-03-27T07:23:35.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.238+0000 7f5a2609a640 1 -- 172.21.15.82:0/3607558342 wait complete. 2024-03-27T07:23:35.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:23:35.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.355+0000 7fe71d1e2640 1 -- 172.21.15.82:0/2545332482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe718100a70 msgr2=0x7fe718100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:35.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.355+0000 7fe71d1e2640 1 --2- 172.21.15.82:0/2545332482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe718100a70 0x7fe718100e90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe708009900 tx=0x7fe70802bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:35.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.355+0000 7fe71d1e2640 1 -- 172.21.15.82:0/2545332482 shutdown_connections 2024-03-27T07:23:35.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.355+0000 7fe71d1e2640 1 --2- 172.21.15.82:0/2545332482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe718102620 0x7fe718108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.355+0000 7fe71d1e2640 1 --2- 172.21.15.82:0/2545332482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe718101c60 0x7fe7181020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.355+0000 7fe71d1e2640 1 --2- 172.21.15.82:0/2545332482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe718100a70 0x7fe718100e90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.355+0000 7fe71d1e2640 1 -- 172.21.15.82:0/2545332482 >> 172.21.15.82:0/2545332482 conn(0x7fe7180fbfe0 msgr2=0x7fe7180fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:35.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.355+0000 7fe71d1e2640 1 -- 172.21.15.82:0/2545332482 shutdown_connections 2024-03-27T07:23:35.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.355+0000 7fe71d1e2640 1 -- 172.21.15.82:0/2545332482 wait complete. 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe71d1e2640 1 Processor -- start 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe71d1e2640 1 -- start start 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe71d1e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe718100a70 0x7fe718069840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe71d1e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe718101c60 0x7fe71819cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe71d1e2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe718102620 0x7fe71819f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe71d1e2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe71810c6c0 con 0x7fe718100a70 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe71d1e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe71810c540 con 0x7fe718101c60 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe71d1e2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe71810c840 con 0x7fe718102620 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe716d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe718100a70 0x7fe718069840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe716d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe718100a70 0x7fe718069840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41644/0 (socket says 172.21.15.82:41644) 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe70ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe718101c60 0x7fe71819cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe716d9d640 1 -- 172.21.15.82:0/1334578799 learned_addr learned my addr 172.21.15.82:0/1334578799 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.356+0000 7fe71759e640 1 --2- 172.21.15.82:0/1334578799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe718102620 0x7fe71819f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe716d9d640 1 -- 172.21.15.82:0/1334578799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe718102620 msgr2=0x7fe71819f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:35.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe716d9d640 1 --2- 172.21.15.82:0/1334578799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe718102620 0x7fe71819f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe716d9d640 1 -- 172.21.15.82:0/1334578799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe718101c60 msgr2=0x7fe71819cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe716d9d640 1 --2- 172.21.15.82:0/1334578799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe718101c60 0x7fe71819cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe716d9d640 1 -- 172.21.15.82:0/1334578799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71819faa0 con 0x7fe718100a70 2024-03-27T07:23:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe716d9d640 1 --2- 172.21.15.82:0/1334578799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe718100a70 0x7fe718069840 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe708000c00 tx=0x7fe70802c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe714d99640 1 -- 172.21.15.82:0/1334578799 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708041070 con 0x7fe718100a70 2024-03-27T07:23:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe71d1e2640 1 -- 172.21.15.82:0/1334578799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71819fd30 con 0x7fe718100a70 2024-03-27T07:23:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe714d99640 1 -- 172.21.15.82:0/1334578799 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe708004450 con 0x7fe718100a70 2024-03-27T07:23:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe714d99640 1 -- 172.21.15.82:0/1334578799 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708034440 con 0x7fe718100a70 2024-03-27T07:23:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.357+0000 7fe71d1e2640 1 -- 172.21.15.82:0/1334578799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe718196970 con 0x7fe718100a70 2024-03-27T07:23:35.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.358+0000 7fe71d1e2640 1 -- 172.21.15.82:0/1334578799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe718107d90 con 0x7fe718100a70 2024-03-27T07:23:35.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.360+0000 7fe714d99640 1 -- 172.21.15.82:0/1334578799 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 138055+0+0 (secure 0 0 0) 0x7fe708044070 con 0x7fe718100a70 2024-03-27T07:23:35.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.361+0000 7fe714d99640 1 -- 172.21.15.82:0/1334578799 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe7080f1320 con 0x7fe718100a70 2024-03-27T07:23:35.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.365+0000 7fe714d99640 1 -- 172.21.15.82:0/1334578799 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe7080bdc60 con 0x7fe718100a70 2024-03-27T07:23:35.505 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y[37492]: 2024-03-27T07:23:35.231+0000 7f6833a9b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T07:23:35.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.559+0000 7fe71d1e2640 1 -- 172.21.15.82:0/1334578799 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe718062780 con 0x7fe718100a70 2024-03-27T07:23:35.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.561+0000 7fe714d99640 1 -- 172.21.15.82:0/1334578799 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22880 (secure 0 0 0) 0x7fe7080c1f60 con 0x7fe718100a70 2024-03-27T07:23:35.563 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:35.564 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:23:34.942015+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1643774131":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3910998089":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6801/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2476913094":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/1969604742":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6800/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:23:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.564+0000 7fe71d1e2640 1 -- 172.21.15.82:0/1334578799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe718100a70 msgr2=0x7fe718069840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.564+0000 7fe71d1e2640 1 --2- 172.21.15.82:0/1334578799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe718100a70 0x7fe718069840 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe708000c00 tx=0x7fe70802c640 comp rx=0 tx=0).stop 2024-03-27T07:23:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.564+0000 7fe71d1e2640 1 -- 172.21.15.82:0/1334578799 shutdown_connections 2024-03-27T07:23:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.564+0000 7fe71d1e2640 1 --2- 172.21.15.82:0/1334578799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe718102620 0x7fe71819f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.564+0000 7fe71d1e2640 1 --2- 172.21.15.82:0/1334578799 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe718101c60 0x7fe71819cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.564+0000 7fe71d1e2640 1 --2- 172.21.15.82:0/1334578799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe718100a70 0x7fe718069840 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.564+0000 7fe71d1e2640 1 -- 172.21.15.82:0/1334578799 >> 172.21.15.82:0/1334578799 conn(0x7fe7180fbfe0 msgr2=0x7fe718104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.564+0000 7fe71d1e2640 1 -- 172.21.15.82:0/1334578799 shutdown_connections 2024-03-27T07:23:35.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.564+0000 7fe71d1e2640 1 -- 172.21.15.82:0/1334578799 wait complete. 2024-03-27T07:23:35.577 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:35.214+0000 7fa99ef7f700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:23:35.577 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:35.214+0000 7fa99ef7f700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:23:35.577 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:35.214+0000 7fa99ef7f700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:23:35.578 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:35.214+0000 7fa99ef7f700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:23:35.578 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:35.214+0000 7fa99ef7f700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:23:35.578 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:35.215+0000 7fa9a1f85700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:23:35.578 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:35.215+0000 7fa9a1f85700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:23:35.578 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:35.215+0000 7fa9a1f85700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:23:35.578 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:35.215+0000 7fa9a1f85700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:23:35.578 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:23:35.215+0000 7fa9a1f85700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:23:35.579 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T07:21:32.592597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T07:21:33.858606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:23:35.580 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:23:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.686+0000 7fac309b6640 1 -- 172.21.15.82:0/3739631431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c100a50 msgr2=0x7fac2c100e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.686+0000 7fac309b6640 1 --2- 172.21.15.82:0/3739631431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c100a50 0x7fac2c100e70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fac20009900 tx=0x7fac2002bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.686+0000 7fac309b6640 1 -- 172.21.15.82:0/3739631431 shutdown_connections 2024-03-27T07:23:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.686+0000 7fac309b6640 1 --2- 172.21.15.82:0/3739631431 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac2c102600 0x7fac2c108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.686+0000 7fac309b6640 1 --2- 172.21.15.82:0/3739631431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac2c101c40 0x7fac2c1020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.686+0000 7fac309b6640 1 --2- 172.21.15.82:0/3739631431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c100a50 0x7fac2c100e70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.686+0000 7fac309b6640 1 -- 172.21.15.82:0/3739631431 >> 172.21.15.82:0/3739631431 conn(0x7fac2c0fbfe0 msgr2=0x7fac2c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.686+0000 7fac309b6640 1 -- 172.21.15.82:0/3739631431 shutdown_connections 2024-03-27T07:23:35.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.686+0000 7fac309b6640 1 -- 172.21.15.82:0/3739631431 wait complete. 2024-03-27T07:23:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac309b6640 1 Processor -- start 2024-03-27T07:23:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac309b6640 1 -- start start 2024-03-27T07:23:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac309b6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac2c100a50 0x7fac2c104b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac309b6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac2c101c40 0x7fac2c1031c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac309b6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c102600 0x7fac2c103700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac309b6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c10c6a0 con 0x7fac2c102600 2024-03-27T07:23:35.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac309b6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c10c520 con 0x7fac2c100a50 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac309b6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c10c820 con 0x7fac2c101c40 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac2ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c102600 0x7fac2c103700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac2ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c102600 0x7fac2c103700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41674/0 (socket says 172.21.15.82:41674) 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac29d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac2c101c40 0x7fac2c1031c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac2ad9d640 1 -- 172.21.15.82:0/3756711931 learned_addr learned my addr 172.21.15.82:0/3756711931 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac2a59c640 1 --2- 172.21.15.82:0/3756711931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac2c100a50 0x7fac2c104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac2ad9d640 1 -- 172.21.15.82:0/3756711931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac2c101c40 msgr2=0x7fac2c1031c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac2ad9d640 1 --2- 172.21.15.82:0/3756711931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac2c101c40 0x7fac2c1031c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac2ad9d640 1 -- 172.21.15.82:0/3756711931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac2c100a50 msgr2=0x7fac2c104b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.687+0000 7fac2ad9d640 1 --2- 172.21.15.82:0/3756711931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac2c100a50 0x7fac2c104b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.688+0000 7fac2ad9d640 1 -- 172.21.15.82:0/3756711931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac2c103f90 con 0x7fac2c102600 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.688+0000 7fac2ad9d640 1 --2- 172.21.15.82:0/3756711931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c102600 0x7fac2c103700 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fac2400eaa0 tx=0x7fac2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:35.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.688+0000 7fac1b7fe640 1 -- 172.21.15.82:0/3756711931 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2400cdb0 con 0x7fac2c102600 2024-03-27T07:23:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.688+0000 7fac309b6640 1 -- 172.21.15.82:0/3756711931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2c1a1fa0 con 0x7fac2c102600 2024-03-27T07:23:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.688+0000 7fac1b7fe640 1 -- 172.21.15.82:0/3756711931 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac24005020 con 0x7fac2c102600 2024-03-27T07:23:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.688+0000 7fac1b7fe640 1 -- 172.21.15.82:0/3756711931 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac240116b0 con 0x7fac2c102600 2024-03-27T07:23:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.688+0000 7fac309b6640 1 -- 172.21.15.82:0/3756711931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2c1a2400 con 0x7fac2c102600 2024-03-27T07:23:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.689+0000 7fac309b6640 1 -- 172.21.15.82:0/3756711931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2c1a2720 con 0x7fac2c102600 2024-03-27T07:23:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.690+0000 7fac1b7fe640 1 -- 172.21.15.82:0/3756711931 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 138055+0+0 (secure 0 0 0) 0x7fac24005560 con 0x7fac2c102600 2024-03-27T07:23:35.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.691+0000 7fac1b7fe640 1 -- 172.21.15.82:0/3756711931 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fac240cf980 con 0x7fac2c102600 2024-03-27T07:23:35.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.699+0000 7fac1b7fe640 1 -- 172.21.15.82:0/3756711931 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fac24016030 con 0x7fac2c102600 2024-03-27T07:23:35.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.889+0000 7fac309b6640 1 -- 172.21.15.82:0/3756711931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fac2c1a2a80 con 0x7fac2c102600 2024-03-27T07:23:35.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.890+0000 7fac1b7fe640 1 -- 172.21.15.82:0/3756711931 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7fac2409c230 con 0x7fac2c102600 2024-03-27T07:23:35.892 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:23:35.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.892+0000 7fac309b6640 1 -- 172.21.15.82:0/3756711931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c102600 msgr2=0x7fac2c103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:35.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.892+0000 7fac309b6640 1 --2- 172.21.15.82:0/3756711931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c102600 0x7fac2c103700 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fac2400eaa0 tx=0x7fac2400ef60 comp rx=0 tx=0).stop 2024-03-27T07:23:35.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.892+0000 7fac309b6640 1 -- 172.21.15.82:0/3756711931 shutdown_connections 2024-03-27T07:23:35.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.892+0000 7fac309b6640 1 --2- 172.21.15.82:0/3756711931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac2c102600 0x7fac2c103700 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.892+0000 7fac309b6640 1 --2- 172.21.15.82:0/3756711931 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac2c101c40 0x7fac2c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.892+0000 7fac309b6640 1 --2- 172.21.15.82:0/3756711931 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac2c100a50 0x7fac2c104b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:35.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.892+0000 7fac309b6640 1 -- 172.21.15.82:0/3756711931 >> 172.21.15.82:0/3756711931 conn(0x7fac2c0fbfe0 msgr2=0x7fac2c068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:35.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.892+0000 7fac309b6640 1 -- 172.21.15.82:0/3756711931 shutdown_connections 2024-03-27T07:23:35.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:35.892+0000 7fac309b6640 1 -- 172.21.15.82:0/3756711931 wait complete. 2024-03-27T07:23:35.906 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T07:23:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.030+0000 7fddd4276640 1 -- 172.21.15.82:0/1250941763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddcc102d50 msgr2=0x7fddcc1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.030+0000 7fddd4276640 1 --2- 172.21.15.82:0/1250941763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddcc102d50 0x7fddcc1031d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009900 tx=0x7fddbc02bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.030+0000 7fddd4276640 1 -- 172.21.15.82:0/1250941763 shutdown_connections 2024-03-27T07:23:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.030+0000 7fddd4276640 1 --2- 172.21.15.82:0/1250941763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddcc102d50 0x7fddcc1031d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.030+0000 7fddd4276640 1 --2- 172.21.15.82:0/1250941763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddcc103710 0x7fddcc109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.030+0000 7fddd4276640 1 --2- 172.21.15.82:0/1250941763 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddcc101b60 0x7fddcc101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.030+0000 7fddd4276640 1 -- 172.21.15.82:0/1250941763 >> 172.21.15.82:0/1250941763 conn(0x7fddcc0fd0b0 msgr2=0x7fddcc0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.030+0000 7fddd4276640 1 -- 172.21.15.82:0/1250941763 shutdown_connections 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.030+0000 7fddd4276640 1 -- 172.21.15.82:0/1250941763 wait complete. 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd4276640 1 Processor -- start 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd4276640 1 -- start start 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd4276640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddcc101b60 0x7fddcc197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd4276640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddcc102d50 0x7fddcc198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd4276640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddcc103710 0x7fddcc19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd4276640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc10d7c0 con 0x7fddcc101b60 2024-03-27T07:23:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd4276640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc10d640 con 0x7fddcc102d50 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd4276640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fddcc10d940 con 0x7fddcc103710 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd2012640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddcc101b60 0x7fddcc197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd2012640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddcc101b60 0x7fddcc197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41702/0 (socket says 172.21.15.82:41702) 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd2012640 1 -- 172.21.15.82:0/789473523 learned_addr learned my addr 172.21.15.82:0/789473523 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd1811640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddcc102d50 0x7fddcc198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.031+0000 7fddd2813640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddcc103710 0x7fddcc19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddd2012640 1 -- 172.21.15.82:0/789473523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddcc103710 msgr2=0x7fddcc19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddd2012640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddcc103710 0x7fddcc19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddd2012640 1 -- 172.21.15.82:0/789473523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddcc102d50 msgr2=0x7fddcc198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddd2012640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddcc102d50 0x7fddcc198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddd2012640 1 -- 172.21.15.82:0/789473523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddcc19fb00 con 0x7fddcc101b60 2024-03-27T07:23:36.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddd2012640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddcc101b60 0x7fddcc197ee0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fddc800e9c0 tx=0x7fddc800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddc37fe640 1 -- 172.21.15.82:0/789473523 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc800ccc0 con 0x7fddcc101b60 2024-03-27T07:23:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddc37fe640 1 -- 172.21.15.82:0/789473523 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fddc80035f0 con 0x7fddcc101b60 2024-03-27T07:23:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddd4276640 1 -- 172.21.15.82:0/789473523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddcc19fdf0 con 0x7fddcc101b60 2024-03-27T07:23:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddc37fe640 1 -- 172.21.15.82:0/789473523 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc800ce60 con 0x7fddcc101b60 2024-03-27T07:23:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.032+0000 7fddd4276640 1 -- 172.21.15.82:0/789473523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddcc1a0250 con 0x7fddcc101b60 2024-03-27T07:23:36.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.033+0000 7fddd4276640 1 -- 172.21.15.82:0/789473523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddcc108fa0 con 0x7fddcc101b60 2024-03-27T07:23:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.034+0000 7fddc37fe640 1 -- 172.21.15.82:0/789473523 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 21) ==== 138182+0+0 (secure 0 0 0) 0x7fddc80037a0 con 0x7fddcc101b60 2024-03-27T07:23:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.035+0000 7fddc37fe640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fddb80a3410 0x7fddb80a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.035+0000 7fddc37fe640 1 -- 172.21.15.82:0/789473523 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fddc80cfdf0 con 0x7fddcc101b60 2024-03-27T07:23:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.035+0000 7fddd1811640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fddb80a3410 0x7fddb80a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.036+0000 7fddd1811640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fddb80a3410 0x7fddb80a58d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddbc02c7b0 tx=0x7fddbc005fd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:36.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.039+0000 7fddc37fe640 1 -- 172.21.15.82:0/789473523 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fddc809cbe0 con 0x7fddcc101b60 2024-03-27T07:23:36.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: Active manager daemon x restarted 2024-03-27T07:23:36.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: Activating manager daemon x 2024-03-27T07:23:36.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-27T07:23:36.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: osdmap e89: 12 total, 12 up, 12 in 2024-03-27T07:23:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:23:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: mgrmap e20: x(active, starting, since 0.0145884s), standbys: z, y 2024-03-27T07:23:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: Standby manager daemon z restarted 2024-03-27T07:23:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: Standby manager daemon z started 2024-03-27T07:23:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-27T07:23:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:23:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:23:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:23:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:23:36.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-27T07:23:36.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-27T07:23:36.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-27T07:23:36.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-27T07:23:36.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-27T07:23:36.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-27T07:23:36.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T07:23:36.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T07:23:36.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:23:36.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:23:36.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:23:36.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:23:36.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:23:36.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:23:36.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:23:36.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:23:36.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:23:36.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-27T07:23:36.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-27T07:23:36.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-27T07:23:36.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: Manager daemon x is now available 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3607558342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: Standby manager daemon y restarted 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: Standby manager daemon y started 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: [27/Mar/2024:07:23:35] ENGINE Bus STARTING 2024-03-27T07:23:36.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1334578799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:36.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: [27/Mar/2024:07:23:35] ENGINE Serving on https://172.21.15.82:7150 2024-03-27T07:23:36.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: [27/Mar/2024:07:23:35] ENGINE Serving on http://172.21.15.82:8765 2024-03-27T07:23:36.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:35 smithi082 ceph-mon[32178]: [27/Mar/2024:07:23:35] ENGINE Bus STARTED 2024-03-27T07:23:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.215+0000 7fddd4276640 1 -- 172.21.15.82:0/789473523 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fddcc062780 con 0x7fddcc101b60 2024-03-27T07:23:36.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.216+0000 7fddc37fe640 1 -- 172.21.15.82:0/789473523 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7fddc809c4e0 con 0x7fddcc101b60 2024-03-27T07:23:36.218 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-27T07:23:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 -- 172.21.15.82:0/789473523 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fddb80a3410 msgr2=0x7fddb80a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fddb80a3410 0x7fddb80a58d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddbc02c7b0 tx=0x7fddbc005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 -- 172.21.15.82:0/789473523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddcc101b60 msgr2=0x7fddcc197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddcc101b60 0x7fddcc197ee0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fddc800e9c0 tx=0x7fddc800edc0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 -- 172.21.15.82:0/789473523 shutdown_connections 2024-03-27T07:23:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fddb80a3410 0x7fddb80a58d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fddcc103710 0x7fddcc19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fddcc102d50 0x7fddcc198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 --2- 172.21.15.82:0/789473523 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fddcc101b60 0x7fddcc197ee0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 -- 172.21.15.82:0/789473523 >> 172.21.15.82:0/789473523 conn(0x7fddcc0fd0b0 msgr2=0x7fddcc106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:36.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 -- 172.21.15.82:0/789473523 shutdown_connections 2024-03-27T07:23:36.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.218+0000 7fddd4276640 1 -- 172.21.15.82:0/789473523 wait complete. 2024-03-27T07:23:36.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: Active manager daemon x restarted 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: Activating manager daemon x 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: osdmap e89: 12 total, 12 up, 12 in 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: mgrmap e20: x(active, starting, since 0.0145884s), standbys: z, y 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: Standby manager daemon z restarted 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: Standby manager daemon z started 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:23:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T07:23:36.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:23:36.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: Manager daemon x is now available 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3607558342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: Standby manager daemon y restarted 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: Standby manager daemon y started 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-27T07:23:36.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:23:36.260 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-27T07:23:36.260 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:23:36.260 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: [27/Mar/2024:07:23:35] ENGINE Bus STARTING 2024-03-27T07:23:36.260 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1334578799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:36.260 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: [27/Mar/2024:07:23:35] ENGINE Serving on https://172.21.15.82:7150 2024-03-27T07:23:36.260 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: [27/Mar/2024:07:23:35] ENGINE Serving on http://172.21.15.82:8765 2024-03-27T07:23:36.260 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:35 smithi149 ceph-mon[36065]: [27/Mar/2024:07:23:35] ENGINE Bus STARTED 2024-03-27T07:23:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: Active manager daemon x restarted 2024-03-27T07:23:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: Activating manager daemon x 2024-03-27T07:23:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-27T07:23:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: osdmap e89: 12 total, 12 up, 12 in 2024-03-27T07:23:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:23:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: mgrmap e20: x(active, starting, since 0.0145884s), standbys: z, y 2024-03-27T07:23:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: Standby manager daemon z restarted 2024-03-27T07:23:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: Standby manager daemon z started 2024-03-27T07:23:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-27T07:23:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.153:0/2946232088' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:23:36.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T07:23:36.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: Manager daemon x is now available 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3607558342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:36.292 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: Standby manager daemon y restarted 2024-03-27T07:23:36.293 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: Standby manager daemon y started 2024-03-27T07:23:36.293 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-27T07:23:36.293 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T07:23:36.293 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-27T07:23:36.293 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='mgr.? 172.21.15.149:0/3814251795' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T07:23:36.293 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: [27/Mar/2024:07:23:35] ENGINE Bus STARTING 2024-03-27T07:23:36.293 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1334578799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:36.293 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: [27/Mar/2024:07:23:35] ENGINE Serving on https://172.21.15.82:7150 2024-03-27T07:23:36.293 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: [27/Mar/2024:07:23:35] ENGINE Serving on http://172.21.15.82:8765 2024-03-27T07:23:36.293 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:35 smithi153 ceph-mon[36179]: [27/Mar/2024:07:23:35] ENGINE Bus STARTED 2024-03-27T07:23:36.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.334+0000 7f9c2875e640 1 -- 172.21.15.82:0/3576650550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c20102e00 msgr2=0x7f9c20103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.334+0000 7f9c2875e640 1 --2- 172.21.15.82:0/3576650550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c20102e00 0x7f9c20103280 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9c10009930 tx=0x7f9c1002bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:36.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.334+0000 7f9c2875e640 1 -- 172.21.15.82:0/3576650550 shutdown_connections 2024-03-27T07:23:36.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.334+0000 7f9c2875e640 1 --2- 172.21.15.82:0/3576650550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c20102e00 0x7f9c20103280 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.334+0000 7f9c2875e640 1 --2- 172.21.15.82:0/3576650550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c201037c0 0x7f9c2010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.334+0000 7f9c2875e640 1 --2- 172.21.15.82:0/3576650550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200ffe30 0x7f9c20100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.334+0000 7f9c2875e640 1 -- 172.21.15.82:0/3576650550 >> 172.21.15.82:0/3576650550 conn(0x7f9c200fb760 msgr2=0x7f9c200fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:36.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.334+0000 7f9c2875e640 1 -- 172.21.15.82:0/3576650550 shutdown_connections 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.334+0000 7f9c2875e640 1 -- 172.21.15.82:0/3576650550 wait complete. 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c2875e640 1 Processor -- start 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c2875e640 1 -- start start 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c2875e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200ffe30 0x7f9c20197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c2875e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c20102e00 0x7f9c20198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c2875e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c201037c0 0x7f9c2019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c2875e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2010d7f0 con 0x7f9c201037c0 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c2875e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2010d670 con 0x7f9c20102e00 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c2875e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2010d970 con 0x7f9c200ffe30 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c26cfb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c201037c0 0x7f9c2019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c264fa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200ffe30 0x7f9c20197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c25cf9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c20102e00 0x7f9c20198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c26cfb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c201037c0 0x7f9c2019f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41718/0 (socket says 172.21.15.82:41718) 2024-03-27T07:23:36.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c264fa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200ffe30 0x7f9c20197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:44016/0 (socket says 172.21.15.82:44016) 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c264fa640 1 -- 172.21.15.82:0/4176805949 learned_addr learned my addr 172.21.15.82:0/4176805949 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c26cfb640 1 -- 172.21.15.82:0/4176805949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200ffe30 msgr2=0x7f9c20197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c26cfb640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200ffe30 0x7f9c20197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c26cfb640 1 -- 172.21.15.82:0/4176805949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c20102e00 msgr2=0x7f9c20198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c26cfb640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c20102e00 0x7f9c20198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c26cfb640 1 -- 172.21.15.82:0/4176805949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2019faf0 con 0x7f9c201037c0 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.335+0000 7f9c264fa640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200ffe30 0x7f9c20197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.336+0000 7f9c26cfb640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c201037c0 0x7f9c2019f480 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800da10 tx=0x7f9c1800ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.336+0000 7f9c177fe640 1 -- 172.21.15.82:0/4176805949 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800bd70 con 0x7f9c201037c0 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.336+0000 7f9c2875e640 1 -- 172.21.15.82:0/4176805949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2019fde0 con 0x7f9c201037c0 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.336+0000 7f9c177fe640 1 -- 172.21.15.82:0/4176805949 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c18003e50 con 0x7f9c201037c0 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.336+0000 7f9c177fe640 1 -- 172.21.15.82:0/4176805949 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c180106a0 con 0x7f9c201037c0 2024-03-27T07:23:36.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.336+0000 7f9c2875e640 1 -- 172.21.15.82:0/4176805949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c201a0250 con 0x7f9c201037c0 2024-03-27T07:23:36.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.337+0000 7f9c2875e640 1 -- 172.21.15.82:0/4176805949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c20108f50 con 0x7f9c201037c0 2024-03-27T07:23:36.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.338+0000 7f9c177fe640 1 -- 172.21.15.82:0/4176805949 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 21) ==== 138182+0+0 (secure 0 0 0) 0x7f9c18004b40 con 0x7f9c201037c0 2024-03-27T07:23:36.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.338+0000 7f9c177fe640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9c0c0a3410 0x7f9c0c0a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.338+0000 7f9c264fa640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9c0c0a3410 0x7f9c0c0a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.338+0000 7f9c177fe640 1 -- 172.21.15.82:0/4176805949 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9c180d00c0 con 0x7f9c201037c0 2024-03-27T07:23:36.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.339+0000 7f9c264fa640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9c0c0a3410 0x7f9c0c0a58d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0104e0 tx=0x7f9c1c00b410 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:36.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.342+0000 7f9c177fe640 1 -- 172.21.15.82:0/4176805949 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9c1809ceb0 con 0x7f9c201037c0 2024-03-27T07:23:36.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.523+0000 7f9c2875e640 1 -- 172.21.15.82:0/4176805949 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9c2002d500 con 0x7f9c201037c0 2024-03-27T07:23:36.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.524+0000 7f9c177fe640 1 -- 172.21.15.82:0/4176805949 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f9c1809c7b0 con 0x7f9c201037c0 2024-03-27T07:23:36.526 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 -- 172.21.15.82:0/4176805949 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9c0c0a3410 msgr2=0x7f9c0c0a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9c0c0a3410 0x7f9c0c0a58d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0104e0 tx=0x7f9c1c00b410 comp rx=0 tx=0).stop 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 -- 172.21.15.82:0/4176805949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c201037c0 msgr2=0x7f9c2019f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c201037c0 0x7f9c2019f480 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800da10 tx=0x7f9c1800ded0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 -- 172.21.15.82:0/4176805949 shutdown_connections 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9c0c0a3410 0x7f9c0c0a58d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9c201037c0 0x7f9c2019f480 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9c20102e00 0x7f9c20198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 --2- 172.21.15.82:0/4176805949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c200ffe30 0x7f9c20197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 -- 172.21.15.82:0/4176805949 >> 172.21.15.82:0/4176805949 conn(0x7f9c200fb760 msgr2=0x7f9c20106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 -- 172.21.15.82:0/4176805949 shutdown_connections 2024-03-27T07:23:36.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.526+0000 7f9c2875e640 1 -- 172.21.15.82:0/4176805949 wait complete. 2024-03-27T07:23:36.539 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-03-27T07:23:36.539 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:23:36.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.642+0000 7fac09b4b640 1 -- 172.21.15.82:0/245682020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04101c60 msgr2=0x7fac041020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 --2- 172.21.15.82:0/245682020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04101c60 0x7fac041020e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fabf8009900 tx=0x7fabf802bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 -- 172.21.15.82:0/245682020 shutdown_connections 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 --2- 172.21.15.82:0/245682020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04101c60 0x7fac041020e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 --2- 172.21.15.82:0/245682020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac04102620 0x7fac04108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 --2- 172.21.15.82:0/245682020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac04100a70 0x7fac04100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 -- 172.21.15.82:0/245682020 >> 172.21.15.82:0/245682020 conn(0x7fac040fbfe0 msgr2=0x7fac040fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 -- 172.21.15.82:0/245682020 shutdown_connections 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 -- 172.21.15.82:0/245682020 wait complete. 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 Processor -- start 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 -- start start 2024-03-27T07:23:36.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.643+0000 7fac09b4b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac04100a70 0x7fac04196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac09b4b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac04101c60 0x7fac041972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac09b4b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04102620 0x7fac0419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac09b4b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fac0410c6f0 con 0x7fac04102620 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac09b4b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fac0410c570 con 0x7fac04100a70 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac09b4b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac0410c870 con 0x7fac04101c60 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04102620 0x7fac0419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac037fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac04100a70 0x7fac04196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04102620 0x7fac0419e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41736/0 (socket says 172.21.15.82:41736) 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac03fff640 1 -- 172.21.15.82:0/646719184 learned_addr learned my addr 172.21.15.82:0/646719184 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac02ffd640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac04101c60 0x7fac041972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac03fff640 1 -- 172.21.15.82:0/646719184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac04101c60 msgr2=0x7fac041972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac03fff640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac04101c60 0x7fac041972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac03fff640 1 -- 172.21.15.82:0/646719184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac04100a70 msgr2=0x7fac04196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac03fff640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac04100a70 0x7fac04196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac03fff640 1 -- 172.21.15.82:0/646719184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac0419e9c0 con 0x7fac04102620 2024-03-27T07:23:36.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac03fff640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04102620 0x7fac0419e320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00eb10 tx=0x7fabfc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:36.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac00ff9640 1 -- 172.21.15.82:0/646719184 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc004b20 con 0x7fac04102620 2024-03-27T07:23:36.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac00ff9640 1 -- 172.21.15.82:0/646719184 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fabfc004cc0 con 0x7fac04102620 2024-03-27T07:23:36.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac09b4b640 1 -- 172.21.15.82:0/646719184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac04068d10 con 0x7fac04102620 2024-03-27T07:23:36.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac00ff9640 1 -- 172.21.15.82:0/646719184 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc010760 con 0x7fac04102620 2024-03-27T07:23:36.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.644+0000 7fac09b4b640 1 -- 172.21.15.82:0/646719184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac04069260 con 0x7fac04102620 2024-03-27T07:23:36.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.645+0000 7fac09b4b640 1 -- 172.21.15.82:0/646719184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac04068940 con 0x7fac04102620 2024-03-27T07:23:36.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.647+0000 7fac00ff9640 1 -- 172.21.15.82:0/646719184 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 21) ==== 138182+0+0 (secure 0 0 0) 0x7fabfc005020 con 0x7fac04102620 2024-03-27T07:23:36.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.647+0000 7fac00ff9640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fabec0a3410 0x7fabec0a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:36.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.647+0000 7fac00ff9640 1 -- 172.21.15.82:0/646719184 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fabfc0d0090 con 0x7fac04102620 2024-03-27T07:23:36.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.647+0000 7fac037fe640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fabec0a3410 0x7fabec0a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:36.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.648+0000 7fac037fe640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fabec0a3410 0x7fabec0a58d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fac04198280 tx=0x7fabf400d620 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:36.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.652+0000 7fac00ff9640 1 -- 172.21.15.82:0/646719184 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fabfc09ce80 con 0x7fac04102620 2024-03-27T07:23:36.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.871+0000 7fac09b4b640 1 -- 172.21.15.82:0/646719184 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac04107800 con 0x7fac04102620 2024-03-27T07:23:36.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.872+0000 7fac00ff9640 1 -- 172.21.15.82:0/646719184 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11860 (secure 0 0 0) 0x7fabfc09c780 con 0x7fac04102620 2024-03-27T07:23:36.874 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:36.874 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:23:33.807990+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:23:36.874 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-03-27T07:23:36.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 -- 172.21.15.82:0/646719184 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fabec0a3410 msgr2=0x7fabec0a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fabec0a3410 0x7fabec0a58d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fac04198280 tx=0x7fabf400d620 comp rx=0 tx=0).stop 2024-03-27T07:23:36.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 -- 172.21.15.82:0/646719184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04102620 msgr2=0x7fac0419e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04102620 0x7fac0419e320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00eb10 tx=0x7fabfc00c2d0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 -- 172.21.15.82:0/646719184 shutdown_connections 2024-03-27T07:23:36.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fabec0a3410 0x7fabec0a58d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fac04102620 0x7fac0419e320 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fac04101c60 0x7fac041972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 --2- 172.21.15.82:0/646719184 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fac04100a70 0x7fac04196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 -- 172.21.15.82:0/646719184 >> 172.21.15.82:0/646719184 conn(0x7fac040fbfe0 msgr2=0x7fac04104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:36.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 -- 172.21.15.82:0/646719184 shutdown_connections 2024-03-27T07:23:36.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.874+0000 7fac09b4b640 1 -- 172.21.15.82:0/646719184 wait complete. 2024-03-27T07:23:36.887 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-03-27T07:23:36.888 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-03-27T07:23:36.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T07:23:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 -- 172.21.15.82:0/3301847326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca8100a70 msgr2=0x7fbca8100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 --2- 172.21.15.82:0/3301847326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca8100a70 0x7fbca8100e90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009900 tx=0x7fbca402bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 -- 172.21.15.82:0/3301847326 shutdown_connections 2024-03-27T07:23:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 --2- 172.21.15.82:0/3301847326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbca8102620 0x7fbca8108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 --2- 172.21.15.82:0/3301847326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca8101c60 0x7fbca81020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 --2- 172.21.15.82:0/3301847326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca8100a70 0x7fbca8100e90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 -- 172.21.15.82:0/3301847326 >> 172.21.15.82:0/3301847326 conn(0x7fbca80fbfe0 msgr2=0x7fbca80fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:36.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 -- 172.21.15.82:0/3301847326 shutdown_connections 2024-03-27T07:23:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 -- 172.21.15.82:0/3301847326 wait complete. 2024-03-27T07:23:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 Processor -- start 2024-03-27T07:23:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 -- start start 2024-03-27T07:23:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.995+0000 7fbcafde2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca8100a70 0x7fbca8197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcafde2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca8101c60 0x7fbca81983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcafde2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbca8102620 0x7fbca819f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcafde2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbca810c6c0 con 0x7fbca8101c60 2024-03-27T07:23:37.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcafde2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbca810c540 con 0x7fbca8102620 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcafde2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbca810c840 con 0x7fbca8100a70 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcad37d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca8101c60 0x7fbca81983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcad37d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca8101c60 0x7fbca81983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41754/0 (socket says 172.21.15.82:41754) 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcad37d640 1 -- 172.21.15.82:0/71242076 learned_addr learned my addr 172.21.15.82:0/71242076 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcadb7e640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca8100a70 0x7fbca8197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcae37f640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbca8102620 0x7fbca819f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcad37d640 1 -- 172.21.15.82:0/71242076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca8100a70 msgr2=0x7fbca8197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcad37d640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca8100a70 0x7fbca8197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcad37d640 1 -- 172.21.15.82:0/71242076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbca8102620 msgr2=0x7fbca819f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcad37d640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbca8102620 0x7fbca819f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcad37d640 1 -- 172.21.15.82:0/71242076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca819fab0 con 0x7fbca8101c60 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcad37d640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca8101c60 0x7fbca81983d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800d950 tx=0x7fbc9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:37.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbc9effd640 1 -- 172.21.15.82:0/71242076 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc98017030 con 0x7fbca8101c60 2024-03-27T07:23:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcafde2640 1 -- 172.21.15.82:0/71242076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca819fda0 con 0x7fbca8101c60 2024-03-27T07:23:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbc9effd640 1 -- 172.21.15.82:0/71242076 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc98004020 con 0x7fbca8101c60 2024-03-27T07:23:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbc9effd640 1 -- 172.21.15.82:0/71242076 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc980047a0 con 0x7fbca8101c60 2024-03-27T07:23:37.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.996+0000 7fbcafde2640 1 -- 172.21.15.82:0/71242076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca81a0270 con 0x7fbca8101c60 2024-03-27T07:23:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.998+0000 7fbcafde2640 1 -- 172.21.15.82:0/71242076 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca81a0530 con 0x7fbca8101c60 2024-03-27T07:23:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.998+0000 7fbc9effd640 1 -- 172.21.15.82:0/71242076 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 21) ==== 138182+0+0 (secure 0 0 0) 0x7fbc980041d0 con 0x7fbca8101c60 2024-03-27T07:23:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.999+0000 7fbc9effd640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc940a3410 0x7fbc940a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.999+0000 7fbc9effd640 1 -- 172.21.15.82:0/71242076 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fbc980cf350 con 0x7fbca8101c60 2024-03-27T07:23:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:36.999+0000 7fbcadb7e640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc940a3410 0x7fbc940a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.000+0000 7fbcadb7e640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc940a3410 0x7fbc940a58d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbca4000c00 tx=0x7fbca4005fd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:37.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.004+0000 7fbc9effd640 1 -- 172.21.15.82:0/71242076 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fbc9809c140 con 0x7fbca8101c60 2024-03-27T07:23:37.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:36 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3756711931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:37.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:36 smithi082 ceph-mon[32178]: mgrmap e21: x(active, since 1.01799s), standbys: y, z 2024-03-27T07:23:37.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:36 smithi082 ceph-mon[32178]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:23:37.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:36 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/789473523' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:37.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:36 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4176805949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:37.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.203+0000 7fbcafde2640 1 -- 172.21.15.82:0/71242076 --> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbca81a0700 con 0x7fbc940a3410 2024-03-27T07:23:37.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.211+0000 7fbc9effd640 1 -- 172.21.15.82:0/71242076 <== mgr.15273 v2:172.21.15.82:6800/573513718 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258022 (secure 0 0 0) 0x7fbca81a0700 con 0x7fbc940a3410 2024-03-27T07:23:37.217 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:37.219 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-27T07:23:37.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 -- 172.21.15.82:0/71242076 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc940a3410 msgr2=0x7fbc940a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc940a3410 0x7fbc940a58d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbca4000c00 tx=0x7fbca4005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 -- 172.21.15.82:0/71242076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca8101c60 msgr2=0x7fbca81983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca8101c60 0x7fbca81983d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800d950 tx=0x7fbc9800de10 comp rx=0 tx=0).stop 2024-03-27T07:23:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 -- 172.21.15.82:0/71242076 shutdown_connections 2024-03-27T07:23:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc940a3410 0x7fbc940a58d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbca8101c60 0x7fbca81983d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbca8102620 0x7fbca819f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 --2- 172.21.15.82:0/71242076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbca8100a70 0x7fbca8197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 -- 172.21.15.82:0/71242076 >> 172.21.15.82:0/71242076 conn(0x7fbca80fbfe0 msgr2=0x7fbca80fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:37.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 -- 172.21.15.82:0/71242076 shutdown_connections 2024-03-27T07:23:37.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.215+0000 7fbcafde2640 1 -- 172.21.15.82:0/71242076 wait complete. 2024-03-27T07:23:37.229 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-03-27T07:23:36.961936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188408,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":964,"num_read_kb":643,"num_write":470,"num_write_kb":4377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181318,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357032,"kb_used_data":12000,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584792,"statfs":{"total":1151940427776,"available":1151574827008,"internally_reserved":0,"allocated":12288000,"data_stored":9201658,"data_compressed":223143,"data_compressed_allocated":294912,"data_compressed_original":3440640,"omap_allocated":19139,"internal_metadata":353154365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.992646"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057054+0000","last_change":"2024-03-27T07:21:35.577169+0000","last_active":"2024-03-27T07:23:35.057054+0000","last_peered":"2024-03-27T07:23:35.057054+0000","last_clean":"2024-03-27T07:23:35.057054+0000","last_became_active":"2024-03-27T07:21:35.576737+0000","last_became_peered":"2024-03-27T07:21:35.576737+0000","last_unstale":"2024-03-27T07:23:35.057054+0000","last_undegraded":"2024-03-27T07:23:35.057054+0000","last_fullsized":"2024-03-27T07:23:35.057054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:58:55.152543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.225176+0000","last_change":"2024-03-27T07:21:35.576197+0000","last_active":"2024-03-27T07:23:35.225176+0000","last_peered":"2024-03-27T07:23:35.225176+0000","last_clean":"2024-03-27T07:23:35.225176+0000","last_became_active":"2024-03-27T07:21:35.575876+0000","last_became_peered":"2024-03-27T07:21:35.575876+0000","last_unstale":"2024-03-27T07:23:35.225176+0000","last_undegraded":"2024-03-27T07:23:35.225176+0000","last_fullsized":"2024-03-27T07:23:35.225176+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:23:12.589029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224758+0000","last_change":"2024-03-27T07:21:35.582045+0000","last_active":"2024-03-27T07:23:35.224758+0000","last_peered":"2024-03-27T07:23:35.224758+0000","last_clean":"2024-03-27T07:23:35.224758+0000","last_became_active":"2024-03-27T07:21:35.581710+0000","last_became_peered":"2024-03-27T07:21:35.581710+0000","last_unstale":"2024-03-27T07:23:35.224758+0000","last_undegraded":"2024-03-27T07:23:35.224758+0000","last_fullsized":"2024-03-27T07:23:35.224758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:47:39.004986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949235+0000","last_change":"2024-03-27T07:22:27.670513+0000","last_active":"2024-03-27T07:23:34.949235+0000","last_peered":"2024-03-27T07:23:34.949235+0000","last_clean":"2024-03-27T07:23:34.949235+0000","last_became_active":"2024-03-27T07:22:27.670263+0000","last_became_peered":"2024-03-27T07:22:27.670263+0000","last_unstale":"2024-03-27T07:23:34.949235+0000","last_undegraded":"2024-03-27T07:23:34.949235+0000","last_fullsized":"2024-03-27T07:23:34.949235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:32:43.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482696+0000","last_change":"2024-03-27T07:21:35.568964+0000","last_active":"2024-03-27T07:23:35.482696+0000","last_peered":"2024-03-27T07:23:35.482696+0000","last_clean":"2024-03-27T07:23:35.482696+0000","last_became_active":"2024-03-27T07:21:35.568607+0000","last_became_peered":"2024-03-27T07:21:35.568607+0000","last_unstale":"2024-03-27T07:23:35.482696+0000","last_undegraded":"2024-03-27T07:23:35.482696+0000","last_fullsized":"2024-03-27T07:23:35.482696+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:26:32.122422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067396+0000","last_change":"2024-03-27T07:21:35.575915+0000","last_active":"2024-03-27T07:23:35.067396+0000","last_peered":"2024-03-27T07:23:35.067396+0000","last_clean":"2024-03-27T07:23:35.067396+0000","last_became_active":"2024-03-27T07:21:35.575604+0000","last_became_peered":"2024-03-27T07:21:35.575604+0000","last_unstale":"2024-03-27T07:23:35.067396+0000","last_undegraded":"2024-03-27T07:23:35.067396+0000","last_fullsized":"2024-03-27T07:23:35.067396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:19:12.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947683+0000","last_change":"2024-03-27T07:21:35.570762+0000","last_active":"2024-03-27T07:23:34.947683+0000","last_peered":"2024-03-27T07:23:34.947683+0000","last_clean":"2024-03-27T07:23:34.947683+0000","last_became_active":"2024-03-27T07:21:35.570380+0000","last_became_peered":"2024-03-27T07:21:35.570380+0000","last_unstale":"2024-03-27T07:23:34.947683+0000","last_undegraded":"2024-03-27T07:23:34.947683+0000","last_fullsized":"2024-03-27T07:23:34.947683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:35:04.463674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057560+0000","last_change":"2024-03-27T07:21:35.573220+0000","last_active":"2024-03-27T07:23:35.057560+0000","last_peered":"2024-03-27T07:23:35.057560+0000","last_clean":"2024-03-27T07:23:35.057560+0000","last_became_active":"2024-03-27T07:21:35.572909+0000","last_became_peered":"2024-03-27T07:21:35.572909+0000","last_unstale":"2024-03-27T07:23:35.057560+0000","last_undegraded":"2024-03-27T07:23:35.057560+0000","last_fullsized":"2024-03-27T07:23:35.057560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:49:51.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.223506+0000","last_change":"2024-03-27T07:21:35.559298+0000","last_active":"2024-03-27T07:23:35.223506+0000","last_peered":"2024-03-27T07:23:35.223506+0000","last_clean":"2024-03-27T07:23:35.223506+0000","last_became_active":"2024-03-27T07:21:35.558968+0000","last_became_peered":"2024-03-27T07:21:35.558968+0000","last_unstale":"2024-03-27T07:23:35.223506+0000","last_undegraded":"2024-03-27T07:23:35.223506+0000","last_fullsized":"2024-03-27T07:23:35.223506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:12:31.027411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067619+0000","last_change":"2024-03-27T07:21:35.577015+0000","last_active":"2024-03-27T07:23:35.067619+0000","last_peered":"2024-03-27T07:23:35.067619+0000","last_clean":"2024-03-27T07:23:35.067619+0000","last_became_active":"2024-03-27T07:21:35.576599+0000","last_became_peered":"2024-03-27T07:21:35.576599+0000","last_unstale":"2024-03-27T07:23:35.067619+0000","last_undegraded":"2024-03-27T07:23:35.067619+0000","last_fullsized":"2024-03-27T07:23:35.067619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:03.138951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948191+0000","last_change":"2024-03-27T07:21:35.576540+0000","last_active":"2024-03-27T07:23:34.948191+0000","last_peered":"2024-03-27T07:23:34.948191+0000","last_clean":"2024-03-27T07:23:34.948191+0000","last_became_active":"2024-03-27T07:21:35.576101+0000","last_became_peered":"2024-03-27T07:21:35.576101+0000","last_unstale":"2024-03-27T07:23:34.948191+0000","last_undegraded":"2024-03-27T07:23:34.948191+0000","last_fullsized":"2024-03-27T07:23:34.948191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:13.654970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949003+0000","last_change":"2024-03-27T07:22:27.669089+0000","last_active":"2024-03-27T07:23:34.949003+0000","last_peered":"2024-03-27T07:23:34.949003+0000","last_clean":"2024-03-27T07:23:34.949003+0000","last_became_active":"2024-03-27T07:22:27.668715+0000","last_became_peered":"2024-03-27T07:22:27.668715+0000","last_unstale":"2024-03-27T07:23:34.949003+0000","last_undegraded":"2024-03-27T07:23:34.949003+0000","last_fullsized":"2024-03-27T07:23:34.949003+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:44:33.732968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222315+0000","last_change":"2024-03-27T07:21:35.559726+0000","last_active":"2024-03-27T07:23:35.222315+0000","last_peered":"2024-03-27T07:23:35.222315+0000","last_clean":"2024-03-27T07:23:35.222315+0000","last_became_active":"2024-03-27T07:21:35.559294+0000","last_became_peered":"2024-03-27T07:21:35.559294+0000","last_unstale":"2024-03-27T07:23:35.222315+0000","last_undegraded":"2024-03-27T07:23:35.222315+0000","last_fullsized":"2024-03-27T07:23:35.222315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:27:00.364447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224071+0000","last_change":"2024-03-27T07:21:35.577959+0000","last_active":"2024-03-27T07:23:35.224071+0000","last_peered":"2024-03-27T07:23:35.224071+0000","last_clean":"2024-03-27T07:23:35.224071+0000","last_became_active":"2024-03-27T07:21:35.577642+0000","last_became_peered":"2024-03-27T07:21:35.577642+0000","last_unstale":"2024-03-27T07:23:35.224071+0000","last_undegraded":"2024-03-27T07:23:35.224071+0000","last_fullsized":"2024-03-27T07:23:35.224071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:07:44.836888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224287+0000","last_change":"2024-03-27T07:21:35.580901+0000","last_active":"2024-03-27T07:23:35.224287+0000","last_peered":"2024-03-27T07:23:35.224287+0000","last_clean":"2024-03-27T07:23:35.224287+0000","last_became_active":"2024-03-27T07:21:35.579456+0000","last_became_peered":"2024-03-27T07:21:35.579456+0000","last_unstale":"2024-03-27T07:23:35.224287+0000","last_undegraded":"2024-03-27T07:23:35.224287+0000","last_fullsized":"2024-03-27T07:23:35.224287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:35:54.722160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221935+0000","last_change":"2024-03-27T07:21:35.574462+0000","last_active":"2024-03-27T07:23:35.221935+0000","last_peered":"2024-03-27T07:23:35.221935+0000","last_clean":"2024-03-27T07:23:35.221935+0000","last_became_active":"2024-03-27T07:21:35.574158+0000","last_became_peered":"2024-03-27T07:21:35.574158+0000","last_unstale":"2024-03-27T07:23:35.221935+0000","last_undegraded":"2024-03-27T07:23:35.221935+0000","last_fullsized":"2024-03-27T07:23:35.221935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:16:18.756955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057213+0000","last_change":"2024-03-27T07:21:35.576808+0000","last_active":"2024-03-27T07:23:35.057213+0000","last_peered":"2024-03-27T07:23:35.057213+0000","last_clean":"2024-03-27T07:23:35.057213+0000","last_became_active":"2024-03-27T07:21:35.574819+0000","last_became_peered":"2024-03-27T07:21:35.574819+0000","last_unstale":"2024-03-27T07:23:35.057213+0000","last_undegraded":"2024-03-27T07:23:35.057213+0000","last_fullsized":"2024-03-27T07:23:35.057213+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:29:06.137201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949053+0000","last_change":"2024-03-27T07:21:35.570650+0000","last_active":"2024-03-27T07:23:34.949053+0000","last_peered":"2024-03-27T07:23:34.949053+0000","last_clean":"2024-03-27T07:23:34.949053+0000","last_became_active":"2024-03-27T07:21:35.569850+0000","last_became_peered":"2024-03-27T07:21:35.569850+0000","last_unstale":"2024-03-27T07:23:34.949053+0000","last_undegraded":"2024-03-27T07:23:34.949053+0000","last_fullsized":"2024-03-27T07:23:34.949053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:22:39.829648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948167+0000","last_change":"2024-03-27T07:21:35.566322+0000","last_active":"2024-03-27T07:23:34.948167+0000","last_peered":"2024-03-27T07:23:34.948167+0000","last_clean":"2024-03-27T07:23:34.948167+0000","last_became_active":"2024-03-27T07:21:35.565947+0000","last_became_peered":"2024-03-27T07:21:35.565947+0000","last_unstale":"2024-03-27T07:23:34.948167+0000","last_undegraded":"2024-03-27T07:23:34.948167+0000","last_fullsized":"2024-03-27T07:23:34.948167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:58:34.151735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949018+0000","last_change":"2024-03-27T07:22:27.702687+0000","last_active":"2024-03-27T07:23:34.949018+0000","last_peered":"2024-03-27T07:23:34.949018+0000","last_clean":"2024-03-27T07:23:34.949018+0000","last_became_active":"2024-03-27T07:22:27.696358+0000","last_became_peered":"2024-03-27T07:22:27.696358+0000","last_unstale":"2024-03-27T07:23:34.949018+0000","last_undegraded":"2024-03-27T07:23:34.949018+0000","last_fullsized":"2024-03-27T07:23:34.949018+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:30:28.499338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058686+0000","last_change":"2024-03-27T07:21:35.576918+0000","last_active":"2024-03-27T07:23:35.058686+0000","last_peered":"2024-03-27T07:23:35.058686+0000","last_clean":"2024-03-27T07:23:35.058686+0000","last_became_active":"2024-03-27T07:21:35.576581+0000","last_became_peered":"2024-03-27T07:21:35.576581+0000","last_unstale":"2024-03-27T07:23:35.058686+0000","last_undegraded":"2024-03-27T07:23:35.058686+0000","last_fullsized":"2024-03-27T07:23:35.058686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:31:54.813459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.059064+0000","last_change":"2024-03-27T07:21:34.560583+0000","last_active":"2024-03-27T07:23:35.059064+0000","last_peered":"2024-03-27T07:23:35.059064+0000","last_clean":"2024-03-27T07:23:35.059064+0000","last_became_active":"2024-03-27T07:21:34.560257+0000","last_became_peered":"2024-03-27T07:21:34.560257+0000","last_unstale":"2024-03-27T07:23:35.059064+0000","last_undegraded":"2024-03-27T07:23:35.059064+0000","last_fullsized":"2024-03-27T07:23:35.059064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:25:27.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224927+0000","last_change":"2024-03-27T07:21:35.573251+0000","last_active":"2024-03-27T07:23:35.224927+0000","last_peered":"2024-03-27T07:23:35.224927+0000","last_clean":"2024-03-27T07:23:35.224927+0000","last_became_active":"2024-03-27T07:21:35.572890+0000","last_became_peered":"2024-03-27T07:21:35.572890+0000","last_unstale":"2024-03-27T07:23:35.224927+0000","last_undegraded":"2024-03-27T07:23:35.224927+0000","last_fullsized":"2024-03-27T07:23:35.224927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:49.317704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483172+0000","last_change":"2024-03-27T07:21:34.567140+0000","last_active":"2024-03-27T07:23:35.483172+0000","last_peered":"2024-03-27T07:23:35.483172+0000","last_clean":"2024-03-27T07:23:35.483172+0000","last_became_active":"2024-03-27T07:21:34.566689+0000","last_became_peered":"2024-03-27T07:21:34.566689+0000","last_unstale":"2024-03-27T07:23:35.483172+0000","last_undegraded":"2024-03-27T07:23:35.483172+0000","last_fullsized":"2024-03-27T07:23:35.483172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:50:54.656277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222293+0000","last_change":"2024-03-27T07:21:35.565259+0000","last_active":"2024-03-27T07:23:35.222293+0000","last_peered":"2024-03-27T07:23:35.222293+0000","last_clean":"2024-03-27T07:23:35.222293+0000","last_became_active":"2024-03-27T07:21:35.564954+0000","last_became_peered":"2024-03-27T07:21:35.564954+0000","last_unstale":"2024-03-27T07:23:35.222293+0000","last_undegraded":"2024-03-27T07:23:35.222293+0000","last_fullsized":"2024-03-27T07:23:35.222293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:02.950515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483014+0000","last_change":"2024-03-27T07:21:34.558887+0000","last_active":"2024-03-27T07:23:35.483014+0000","last_peered":"2024-03-27T07:23:35.483014+0000","last_clean":"2024-03-27T07:23:35.483014+0000","last_became_active":"2024-03-27T07:21:34.556689+0000","last_became_peered":"2024-03-27T07:21:34.556689+0000","last_unstale":"2024-03-27T07:23:35.483014+0000","last_undegraded":"2024-03-27T07:23:35.483014+0000","last_fullsized":"2024-03-27T07:23:35.483014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:37.162440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064533+0000","last_change":"2024-03-27T07:21:35.576346+0000","last_active":"2024-03-27T07:23:35.064533+0000","last_peered":"2024-03-27T07:23:35.064533+0000","last_clean":"2024-03-27T07:23:35.064533+0000","last_became_active":"2024-03-27T07:21:35.572774+0000","last_became_peered":"2024-03-27T07:21:35.572774+0000","last_unstale":"2024-03-27T07:23:35.064533+0000","last_undegraded":"2024-03-27T07:23:35.064533+0000","last_fullsized":"2024-03-27T07:23:35.064533+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:12:44.181603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'9","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.722484+0000","last_change":"2024-03-27T07:21:34.562208+0000","last_active":"2024-03-27T07:23:35.722484+0000","last_peered":"2024-03-27T07:23:35.722484+0000","last_clean":"2024-03-27T07:23:35.722484+0000","last_became_active":"2024-03-27T07:21:34.561829+0000","last_became_peered":"2024-03-27T07:21:34.561829+0000","last_unstale":"2024-03-27T07:23:35.722484+0000","last_undegraded":"2024-03-27T07:23:35.722484+0000","last_fullsized":"2024-03-27T07:23:35.722484+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:01:48.845075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1853,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482808+0000","last_change":"2024-03-27T07:21:35.575384+0000","last_active":"2024-03-27T07:23:35.482808+0000","last_peered":"2024-03-27T07:23:35.482808+0000","last_clean":"2024-03-27T07:23:35.482808+0000","last_became_active":"2024-03-27T07:21:35.574928+0000","last_became_peered":"2024-03-27T07:21:35.574928+0000","last_unstale":"2024-03-27T07:23:35.482808+0000","last_undegraded":"2024-03-27T07:23:35.482808+0000","last_fullsized":"2024-03-27T07:23:35.482808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:34.034114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067396+0000","last_change":"2024-03-27T07:21:34.562791+0000","last_active":"2024-03-27T07:23:35.067396+0000","last_peered":"2024-03-27T07:23:35.067396+0000","last_clean":"2024-03-27T07:23:35.067396+0000","last_became_active":"2024-03-27T07:21:34.562441+0000","last_became_peered":"2024-03-27T07:21:34.562441+0000","last_unstale":"2024-03-27T07:23:35.067396+0000","last_undegraded":"2024-03-27T07:23:35.067396+0000","last_fullsized":"2024-03-27T07:23:35.067396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:44:42.509635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064356+0000","last_change":"2024-03-27T07:21:35.578022+0000","last_active":"2024-03-27T07:23:35.064356+0000","last_peered":"2024-03-27T07:23:35.064356+0000","last_clean":"2024-03-27T07:23:35.064356+0000","last_became_active":"2024-03-27T07:21:35.577665+0000","last_became_peered":"2024-03-27T07:21:35.577665+0000","last_unstale":"2024-03-27T07:23:35.064356+0000","last_undegraded":"2024-03-27T07:23:35.064356+0000","last_fullsized":"2024-03-27T07:23:35.064356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:05:40.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221881+0000","last_change":"2024-03-27T07:21:34.557610+0000","last_active":"2024-03-27T07:23:35.221881+0000","last_peered":"2024-03-27T07:23:35.221881+0000","last_clean":"2024-03-27T07:23:35.221881+0000","last_became_active":"2024-03-27T07:21:34.557295+0000","last_became_peered":"2024-03-27T07:21:34.557295+0000","last_unstale":"2024-03-27T07:23:35.221881+0000","last_undegraded":"2024-03-27T07:23:35.221881+0000","last_fullsized":"2024-03-27T07:23:35.221881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:38:40.291447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057741+0000","last_change":"2024-03-27T07:21:35.568910+0000","last_active":"2024-03-27T07:23:35.057741+0000","last_peered":"2024-03-27T07:23:35.057741+0000","last_clean":"2024-03-27T07:23:35.057741+0000","last_became_active":"2024-03-27T07:21:35.568606+0000","last_became_peered":"2024-03-27T07:21:35.568606+0000","last_unstale":"2024-03-27T07:23:35.057741+0000","last_undegraded":"2024-03-27T07:23:35.057741+0000","last_fullsized":"2024-03-27T07:23:35.057741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:04:54.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064009+0000","last_change":"2024-03-27T07:21:34.563096+0000","last_active":"2024-03-27T07:23:35.064009+0000","last_peered":"2024-03-27T07:23:35.064009+0000","last_clean":"2024-03-27T07:23:35.064009+0000","last_became_active":"2024-03-27T07:21:34.562721+0000","last_became_peered":"2024-03-27T07:21:34.562721+0000","last_unstale":"2024-03-27T07:23:35.064009+0000","last_undegraded":"2024-03-27T07:23:35.064009+0000","last_fullsized":"2024-03-27T07:23:35.064009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:42:43.902139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948802+0000","last_change":"2024-03-27T07:21:35.571386+0000","last_active":"2024-03-27T07:23:34.948802+0000","last_peered":"2024-03-27T07:23:34.948802+0000","last_clean":"2024-03-27T07:23:34.948802+0000","last_became_active":"2024-03-27T07:21:35.571061+0000","last_became_peered":"2024-03-27T07:21:35.571061+0000","last_unstale":"2024-03-27T07:23:34.948802+0000","last_undegraded":"2024-03-27T07:23:34.948802+0000","last_fullsized":"2024-03-27T07:23:34.948802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:15:06.887550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067769+0000","last_change":"2024-03-27T07:21:34.561401+0000","last_active":"2024-03-27T07:23:35.067769+0000","last_peered":"2024-03-27T07:23:35.067769+0000","last_clean":"2024-03-27T07:23:35.067769+0000","last_became_active":"2024-03-27T07:21:34.561071+0000","last_became_peered":"2024-03-27T07:21:34.561071+0000","last_unstale":"2024-03-27T07:23:35.067769+0000","last_undegraded":"2024-03-27T07:23:35.067769+0000","last_fullsized":"2024-03-27T07:23:35.067769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:41.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.223027+0000","last_change":"2024-03-27T07:21:35.561505+0000","last_active":"2024-03-27T07:23:35.223027+0000","last_peered":"2024-03-27T07:23:35.223027+0000","last_clean":"2024-03-27T07:23:35.223027+0000","last_became_active":"2024-03-27T07:21:35.561166+0000","last_became_peered":"2024-03-27T07:21:35.561166+0000","last_unstale":"2024-03-27T07:23:35.223027+0000","last_undegraded":"2024-03-27T07:23:35.223027+0000","last_fullsized":"2024-03-27T07:23:35.223027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:59.179147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948097+0000","last_change":"2024-03-27T07:22:27.704448+0000","last_active":"2024-03-27T07:23:34.948097+0000","last_peered":"2024-03-27T07:23:34.948097+0000","last_clean":"2024-03-27T07:23:34.948097+0000","last_became_active":"2024-03-27T07:22:27.696496+0000","last_became_peered":"2024-03-27T07:22:27.696496+0000","last_unstale":"2024-03-27T07:23:34.948097+0000","last_undegraded":"2024-03-27T07:23:34.948097+0000","last_fullsized":"2024-03-27T07:23:34.948097+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:05.114224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224840+0000","last_change":"2024-03-27T07:21:35.574795+0000","last_active":"2024-03-27T07:23:35.224840+0000","last_peered":"2024-03-27T07:23:35.224840+0000","last_clean":"2024-03-27T07:23:35.224840+0000","last_became_active":"2024-03-27T07:21:35.574534+0000","last_became_peered":"2024-03-27T07:21:35.574534+0000","last_unstale":"2024-03-27T07:23:35.224840+0000","last_undegraded":"2024-03-27T07:23:35.224840+0000","last_fullsized":"2024-03-27T07:23:35.224840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:46:44.777575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064528+0000","last_change":"2024-03-27T07:21:34.555772+0000","last_active":"2024-03-27T07:23:35.064528+0000","last_peered":"2024-03-27T07:23:35.064528+0000","last_clean":"2024-03-27T07:23:35.064528+0000","last_became_active":"2024-03-27T07:21:34.555430+0000","last_became_peered":"2024-03-27T07:21:34.555430+0000","last_unstale":"2024-03-27T07:23:35.064528+0000","last_undegraded":"2024-03-27T07:23:35.064528+0000","last_fullsized":"2024-03-27T07:23:35.064528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:11:48.058887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222480+0000","last_change":"2024-03-27T07:21:35.573184+0000","last_active":"2024-03-27T07:23:35.222480+0000","last_peered":"2024-03-27T07:23:35.222480+0000","last_clean":"2024-03-27T07:23:35.222480+0000","last_became_active":"2024-03-27T07:21:35.572776+0000","last_became_peered":"2024-03-27T07:21:35.572776+0000","last_unstale":"2024-03-27T07:23:35.222480+0000","last_undegraded":"2024-03-27T07:23:35.222480+0000","last_fullsized":"2024-03-27T07:23:35.222480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:03.122229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'36","reported_seq":302,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.722496+0000","last_change":"2024-03-27T07:21:34.563221+0000","last_active":"2024-03-27T07:23:35.722496+0000","last_peered":"2024-03-27T07:23:35.722496+0000","last_clean":"2024-03-27T07:23:35.722496+0000","last_became_active":"2024-03-27T07:21:34.562679+0000","last_became_peered":"2024-03-27T07:21:34.562679+0000","last_unstale":"2024-03-27T07:23:35.722496+0000","last_undegraded":"2024-03-27T07:23:35.722496+0000","last_fullsized":"2024-03-27T07:23:35.722496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:59.795906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67758,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":188,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482984+0000","last_change":"2024-03-27T07:21:35.573408+0000","last_active":"2024-03-27T07:23:35.482984+0000","last_peered":"2024-03-27T07:23:35.482984+0000","last_clean":"2024-03-27T07:23:35.482984+0000","last_became_active":"2024-03-27T07:21:35.572912+0000","last_became_peered":"2024-03-27T07:21:35.572912+0000","last_unstale":"2024-03-27T07:23:35.482984+0000","last_undegraded":"2024-03-27T07:23:35.482984+0000","last_fullsized":"2024-03-27T07:23:35.482984+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:13.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948036+0000","last_change":"2024-03-27T07:21:34.562237+0000","last_active":"2024-03-27T07:23:34.948036+0000","last_peered":"2024-03-27T07:23:34.948036+0000","last_clean":"2024-03-27T07:23:34.948036+0000","last_became_active":"2024-03-27T07:21:34.561895+0000","last_became_peered":"2024-03-27T07:21:34.561895+0000","last_unstale":"2024-03-27T07:23:34.948036+0000","last_undegraded":"2024-03-27T07:23:34.948036+0000","last_fullsized":"2024-03-27T07:23:34.948036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:39:09.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221949+0000","last_change":"2024-03-27T07:21:35.571870+0000","last_active":"2024-03-27T07:23:35.221949+0000","last_peered":"2024-03-27T07:23:35.221949+0000","last_clean":"2024-03-27T07:23:35.221949+0000","last_became_active":"2024-03-27T07:21:35.571272+0000","last_became_peered":"2024-03-27T07:21:35.571272+0000","last_unstale":"2024-03-27T07:23:35.221949+0000","last_undegraded":"2024-03-27T07:23:35.221949+0000","last_fullsized":"2024-03-27T07:23:35.221949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:08:08.374114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064239+0000","last_change":"2024-03-27T07:21:34.563257+0000","last_active":"2024-03-27T07:23:35.064239+0000","last_peered":"2024-03-27T07:23:35.064239+0000","last_clean":"2024-03-27T07:23:35.064239+0000","last_became_active":"2024-03-27T07:21:34.562777+0000","last_became_peered":"2024-03-27T07:21:34.562777+0000","last_unstale":"2024-03-27T07:23:35.064239+0000","last_undegraded":"2024-03-27T07:23:35.064239+0000","last_fullsized":"2024-03-27T07:23:35.064239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:03.873185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947870+0000","last_change":"2024-03-27T07:21:35.568039+0000","last_active":"2024-03-27T07:23:34.947870+0000","last_peered":"2024-03-27T07:23:34.947870+0000","last_clean":"2024-03-27T07:23:34.947870+0000","last_became_active":"2024-03-27T07:21:35.567680+0000","last_became_peered":"2024-03-27T07:21:35.567680+0000","last_unstale":"2024-03-27T07:23:34.947870+0000","last_undegraded":"2024-03-27T07:23:34.947870+0000","last_fullsized":"2024-03-27T07:23:34.947870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:51:31.223267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":145,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.721821+0000","last_change":"2024-03-27T07:21:34.560885+0000","last_active":"2024-03-27T07:23:35.721821+0000","last_peered":"2024-03-27T07:23:35.721821+0000","last_clean":"2024-03-27T07:23:35.721821+0000","last_became_active":"2024-03-27T07:21:34.560431+0000","last_became_peered":"2024-03-27T07:21:34.560431+0000","last_unstale":"2024-03-27T07:23:35.721821+0000","last_undegraded":"2024-03-27T07:23:35.721821+0000","last_fullsized":"2024-03-27T07:23:35.721821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:19:00.526827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947636+0000","last_change":"2024-03-27T07:21:35.569293+0000","last_active":"2024-03-27T07:23:34.947636+0000","last_peered":"2024-03-27T07:23:34.947636+0000","last_clean":"2024-03-27T07:23:34.947636+0000","last_became_active":"2024-03-27T07:21:35.568962+0000","last_became_peered":"2024-03-27T07:21:35.568962+0000","last_unstale":"2024-03-27T07:23:34.947636+0000","last_undegraded":"2024-03-27T07:23:34.947636+0000","last_fullsized":"2024-03-27T07:23:34.947636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:14:09.947298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482624+0000","last_change":"2024-03-27T07:21:34.569232+0000","last_active":"2024-03-27T07:23:35.482624+0000","last_peered":"2024-03-27T07:23:35.482624+0000","last_clean":"2024-03-27T07:23:35.482624+0000","last_became_active":"2024-03-27T07:21:34.568900+0000","last_became_peered":"2024-03-27T07:21:34.568900+0000","last_unstale":"2024-03-27T07:23:35.482624+0000","last_undegraded":"2024-03-27T07:23:35.482624+0000","last_fullsized":"2024-03-27T07:23:35.482624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:27:55.489262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064095+0000","last_change":"2024-03-27T07:21:35.577020+0000","last_active":"2024-03-27T07:23:35.064095+0000","last_peered":"2024-03-27T07:23:35.064095+0000","last_clean":"2024-03-27T07:23:35.064095+0000","last_became_active":"2024-03-27T07:21:35.576696+0000","last_became_peered":"2024-03-27T07:21:35.576696+0000","last_unstale":"2024-03-27T07:23:35.064095+0000","last_undegraded":"2024-03-27T07:23:35.064095+0000","last_fullsized":"2024-03-27T07:23:35.064095+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:37:35.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483182+0000","last_change":"2024-03-27T07:21:34.562496+0000","last_active":"2024-03-27T07:23:35.483182+0000","last_peered":"2024-03-27T07:23:35.483182+0000","last_clean":"2024-03-27T07:23:35.483182+0000","last_became_active":"2024-03-27T07:21:34.562166+0000","last_became_peered":"2024-03-27T07:21:34.562166+0000","last_unstale":"2024-03-27T07:23:35.483182+0000","last_undegraded":"2024-03-27T07:23:35.483182+0000","last_fullsized":"2024-03-27T07:23:35.483182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:38.828496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057091+0000","last_change":"2024-03-27T07:22:27.696771+0000","last_active":"2024-03-27T07:23:35.057091+0000","last_peered":"2024-03-27T07:23:35.057091+0000","last_clean":"2024-03-27T07:23:35.057091+0000","last_became_active":"2024-03-27T07:22:27.696289+0000","last_became_peered":"2024-03-27T07:22:27.696289+0000","last_unstale":"2024-03-27T07:23:35.057091+0000","last_undegraded":"2024-03-27T07:23:35.057091+0000","last_fullsized":"2024-03-27T07:23:35.057091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:46.675105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949141+0000","last_change":"2024-03-27T07:21:34.560289+0000","last_active":"2024-03-27T07:23:34.949141+0000","last_peered":"2024-03-27T07:23:34.949141+0000","last_clean":"2024-03-27T07:23:34.949141+0000","last_became_active":"2024-03-27T07:21:34.559985+0000","last_became_peered":"2024-03-27T07:21:34.559985+0000","last_unstale":"2024-03-27T07:23:34.949141+0000","last_undegraded":"2024-03-27T07:23:34.949141+0000","last_fullsized":"2024-03-27T07:23:34.949141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:45:46.611725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067662+0000","last_change":"2024-03-27T07:21:35.579626+0000","last_active":"2024-03-27T07:23:35.067662+0000","last_peered":"2024-03-27T07:23:35.067662+0000","last_clean":"2024-03-27T07:23:35.067662+0000","last_became_active":"2024-03-27T07:21:35.579173+0000","last_became_peered":"2024-03-27T07:21:35.579173+0000","last_unstale":"2024-03-27T07:23:35.067662+0000","last_undegraded":"2024-03-27T07:23:35.067662+0000","last_fullsized":"2024-03-27T07:23:35.067662+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:56:48.015958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947779+0000","last_change":"2024-03-27T07:21:34.568216+0000","last_active":"2024-03-27T07:23:34.947779+0000","last_peered":"2024-03-27T07:23:34.947779+0000","last_clean":"2024-03-27T07:23:34.947779+0000","last_became_active":"2024-03-27T07:21:34.567468+0000","last_became_peered":"2024-03-27T07:21:34.567468+0000","last_unstale":"2024-03-27T07:23:34.947779+0000","last_undegraded":"2024-03-27T07:23:34.947779+0000","last_fullsized":"2024-03-27T07:23:34.947779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:44:50.359865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067551+0000","last_change":"2024-03-27T07:21:35.574614+0000","last_active":"2024-03-27T07:23:35.067551+0000","last_peered":"2024-03-27T07:23:35.067551+0000","last_clean":"2024-03-27T07:23:35.067551+0000","last_became_active":"2024-03-27T07:21:35.574274+0000","last_became_peered":"2024-03-27T07:21:35.574274+0000","last_unstale":"2024-03-27T07:23:35.067551+0000","last_undegraded":"2024-03-27T07:23:35.067551+0000","last_fullsized":"2024-03-27T07:23:35.067551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:57.744066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064155+0000","last_change":"2024-03-27T07:21:35.573196+0000","last_active":"2024-03-27T07:23:35.064155+0000","last_peered":"2024-03-27T07:23:35.064155+0000","last_clean":"2024-03-27T07:23:35.064155+0000","last_became_active":"2024-03-27T07:21:35.572852+0000","last_became_peered":"2024-03-27T07:21:35.572852+0000","last_unstale":"2024-03-27T07:23:35.064155+0000","last_undegraded":"2024-03-27T07:23:35.064155+0000","last_fullsized":"2024-03-27T07:23:35.064155+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:00.478573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.721385+0000","last_change":"2024-03-27T07:21:34.566380+0000","last_active":"2024-03-27T07:23:35.721385+0000","last_peered":"2024-03-27T07:23:35.721385+0000","last_clean":"2024-03-27T07:23:35.721385+0000","last_became_active":"2024-03-27T07:21:34.566034+0000","last_became_peered":"2024-03-27T07:21:34.566034+0000","last_unstale":"2024-03-27T07:23:35.721385+0000","last_undegraded":"2024-03-27T07:23:35.721385+0000","last_fullsized":"2024-03-27T07:23:35.721385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:06.470957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058293+0000","last_change":"2024-03-27T07:21:35.576149+0000","last_active":"2024-03-27T07:23:35.058293+0000","last_peered":"2024-03-27T07:23:35.058293+0000","last_clean":"2024-03-27T07:23:35.058293+0000","last_became_active":"2024-03-27T07:21:35.573628+0000","last_became_peered":"2024-03-27T07:21:35.573628+0000","last_unstale":"2024-03-27T07:23:35.058293+0000","last_undegraded":"2024-03-27T07:23:35.058293+0000","last_fullsized":"2024-03-27T07:23:35.058293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:37:06.571848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224109+0000","last_change":"2024-03-27T07:21:34.555206+0000","last_active":"2024-03-27T07:23:35.224109+0000","last_peered":"2024-03-27T07:23:35.224109+0000","last_clean":"2024-03-27T07:23:35.224109+0000","last_became_active":"2024-03-27T07:21:34.554789+0000","last_became_peered":"2024-03-27T07:21:34.554789+0000","last_unstale":"2024-03-27T07:23:35.224109+0000","last_undegraded":"2024-03-27T07:23:35.224109+0000","last_fullsized":"2024-03-27T07:23:35.224109+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:24:37.211394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":357,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947736+0000","last_change":"2024-03-27T07:20:20.641816+0000","last_active":"2024-03-27T07:23:34.947736+0000","last_peered":"2024-03-27T07:23:34.947736+0000","last_clean":"2024-03-27T07:23:34.947736+0000","last_became_active":"2024-03-27T07:20:20.641398+0000","last_became_peered":"2024-03-27T07:20:20.641398+0000","last_unstale":"2024-03-27T07:23:34.947736+0000","last_undegraded":"2024-03-27T07:23:34.947736+0000","last_fullsized":"2024-03-27T07:23:34.947736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_clean_scrub_stamp":"2024-03-27T07:16:54.496466+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:52:56.728469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221593+0000","last_change":"2024-03-27T07:21:35.562594+0000","last_active":"2024-03-27T07:23:35.221593+0000","last_peered":"2024-03-27T07:23:35.221593+0000","last_clean":"2024-03-27T07:23:35.221593+0000","last_became_active":"2024-03-27T07:21:35.562287+0000","last_became_peered":"2024-03-27T07:21:35.562287+0000","last_unstale":"2024-03-27T07:23:35.221593+0000","last_undegraded":"2024-03-27T07:23:35.221593+0000","last_fullsized":"2024-03-27T07:23:35.221593+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:38:25.172452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948003+0000","last_change":"2024-03-27T07:21:34.564569+0000","last_active":"2024-03-27T07:23:34.948003+0000","last_peered":"2024-03-27T07:23:34.948003+0000","last_clean":"2024-03-27T07:23:34.948003+0000","last_became_active":"2024-03-27T07:21:34.563830+0000","last_became_peered":"2024-03-27T07:21:34.563830+0000","last_unstale":"2024-03-27T07:23:34.948003+0000","last_undegraded":"2024-03-27T07:23:34.948003+0000","last_fullsized":"2024-03-27T07:23:34.948003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:46:19.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483051+0000","last_change":"2024-03-27T07:21:34.569447+0000","last_active":"2024-03-27T07:23:35.483051+0000","last_peered":"2024-03-27T07:23:35.483051+0000","last_clean":"2024-03-27T07:23:35.483051+0000","last_became_active":"2024-03-27T07:21:34.569096+0000","last_became_peered":"2024-03-27T07:21:34.569096+0000","last_unstale":"2024-03-27T07:23:35.483051+0000","last_undegraded":"2024-03-27T07:23:35.483051+0000","last_fullsized":"2024-03-27T07:23:35.483051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:49:00.695556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222018+0000","last_change":"2024-03-27T07:21:35.558620+0000","last_active":"2024-03-27T07:23:35.222018+0000","last_peered":"2024-03-27T07:23:35.222018+0000","last_clean":"2024-03-27T07:23:35.222018+0000","last_became_active":"2024-03-27T07:21:35.557559+0000","last_became_peered":"2024-03-27T07:21:35.557559+0000","last_unstale":"2024-03-27T07:23:35.222018+0000","last_undegraded":"2024-03-27T07:23:35.222018+0000","last_fullsized":"2024-03-27T07:23:35.222018+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:09:03.236893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'45","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.181910+0000","last_change":"2024-03-27T07:22:27.674005+0000","last_active":"2024-03-27T07:23:35.181910+0000","last_peered":"2024-03-27T07:23:35.181910+0000","last_clean":"2024-03-27T07:23:35.181910+0000","last_became_active":"2024-03-27T07:22:27.670596+0000","last_became_peered":"2024-03-27T07:22:27.670596+0000","last_unstale":"2024-03-27T07:23:35.181910+0000","last_undegraded":"2024-03-27T07:23:35.181910+0000","last_fullsized":"2024-03-27T07:23:35.181910+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:38:43.398885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":80,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058871+0000","last_change":"2024-03-27T07:21:35.573345+0000","last_active":"2024-03-27T07:23:35.058871+0000","last_peered":"2024-03-27T07:23:35.058871+0000","last_clean":"2024-03-27T07:23:35.058871+0000","last_became_active":"2024-03-27T07:21:35.573037+0000","last_became_peered":"2024-03-27T07:21:35.573037+0000","last_unstale":"2024-03-27T07:23:35.058871+0000","last_undegraded":"2024-03-27T07:23:35.058871+0000","last_fullsized":"2024-03-27T07:23:35.058871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:07:49.834272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.223649+0000","last_change":"2024-03-27T07:21:34.558738+0000","last_active":"2024-03-27T07:23:35.223649+0000","last_peered":"2024-03-27T07:23:35.223649+0000","last_clean":"2024-03-27T07:23:35.223649+0000","last_became_active":"2024-03-27T07:21:34.558353+0000","last_became_peered":"2024-03-27T07:21:34.558353+0000","last_unstale":"2024-03-27T07:23:35.223649+0000","last_undegraded":"2024-03-27T07:23:35.223649+0000","last_fullsized":"2024-03-27T07:23:35.223649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:46:07.816121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224640+0000","last_change":"2024-03-27T07:21:35.575747+0000","last_active":"2024-03-27T07:23:35.224640+0000","last_peered":"2024-03-27T07:23:35.224640+0000","last_clean":"2024-03-27T07:23:35.224640+0000","last_became_active":"2024-03-27T07:21:35.575382+0000","last_became_peered":"2024-03-27T07:21:35.575382+0000","last_unstale":"2024-03-27T07:23:35.224640+0000","last_undegraded":"2024-03-27T07:23:35.224640+0000","last_fullsized":"2024-03-27T07:23:35.224640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:10:03.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221937+0000","last_change":"2024-03-27T07:21:34.563713+0000","last_active":"2024-03-27T07:23:35.221937+0000","last_peered":"2024-03-27T07:23:35.221937+0000","last_clean":"2024-03-27T07:23:35.221937+0000","last_became_active":"2024-03-27T07:21:34.563356+0000","last_became_peered":"2024-03-27T07:21:34.563356+0000","last_unstale":"2024-03-27T07:23:35.221937+0000","last_undegraded":"2024-03-27T07:23:35.221937+0000","last_fullsized":"2024-03-27T07:23:35.221937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:48:11.366029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482627+0000","last_change":"2024-03-27T07:21:35.569912+0000","last_active":"2024-03-27T07:23:35.482627+0000","last_peered":"2024-03-27T07:23:35.482627+0000","last_clean":"2024-03-27T07:23:35.482627+0000","last_became_active":"2024-03-27T07:21:35.569546+0000","last_became_peered":"2024-03-27T07:21:35.569546+0000","last_unstale":"2024-03-27T07:23:35.482627+0000","last_undegraded":"2024-03-27T07:23:35.482627+0000","last_fullsized":"2024-03-27T07:23:35.482627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:45:18.146654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057895+0000","last_change":"2024-03-27T07:21:34.557719+0000","last_active":"2024-03-27T07:23:35.057895+0000","last_peered":"2024-03-27T07:23:35.057895+0000","last_clean":"2024-03-27T07:23:35.057895+0000","last_became_active":"2024-03-27T07:21:34.557360+0000","last_became_peered":"2024-03-27T07:21:34.557360+0000","last_unstale":"2024-03-27T07:23:35.057895+0000","last_undegraded":"2024-03-27T07:23:35.057895+0000","last_fullsized":"2024-03-27T07:23:35.057895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:24:47.002674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056806+0000","last_change":"2024-03-27T07:21:35.578259+0000","last_active":"2024-03-27T07:23:35.056806+0000","last_peered":"2024-03-27T07:23:35.056806+0000","last_clean":"2024-03-27T07:23:35.056806+0000","last_became_active":"2024-03-27T07:21:35.574765+0000","last_became_peered":"2024-03-27T07:21:35.574765+0000","last_unstale":"2024-03-27T07:23:35.056806+0000","last_undegraded":"2024-03-27T07:23:35.056806+0000","last_fullsized":"2024-03-27T07:23:35.056806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:34:49.358416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056872+0000","last_change":"2024-03-27T07:22:27.671151+0000","last_active":"2024-03-27T07:23:35.056872+0000","last_peered":"2024-03-27T07:23:35.056872+0000","last_clean":"2024-03-27T07:23:35.056872+0000","last_became_active":"2024-03-27T07:22:27.667575+0000","last_became_peered":"2024-03-27T07:22:27.667575+0000","last_unstale":"2024-03-27T07:23:35.056872+0000","last_undegraded":"2024-03-27T07:23:35.056872+0000","last_fullsized":"2024-03-27T07:23:35.056872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:20:51.954730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058599+0000","last_change":"2024-03-27T07:21:35.577445+0000","last_active":"2024-03-27T07:23:35.058599+0000","last_peered":"2024-03-27T07:23:35.058599+0000","last_clean":"2024-03-27T07:23:35.058599+0000","last_became_active":"2024-03-27T07:21:35.577110+0000","last_became_peered":"2024-03-27T07:21:35.577110+0000","last_unstale":"2024-03-27T07:23:35.058599+0000","last_undegraded":"2024-03-27T07:23:35.058599+0000","last_fullsized":"2024-03-27T07:23:35.058599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:36:45.919519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482738+0000","last_change":"2024-03-27T07:21:34.567744+0000","last_active":"2024-03-27T07:23:35.482738+0000","last_peered":"2024-03-27T07:23:35.482738+0000","last_clean":"2024-03-27T07:23:35.482738+0000","last_became_active":"2024-03-27T07:21:34.567412+0000","last_became_peered":"2024-03-27T07:21:34.567412+0000","last_unstale":"2024-03-27T07:23:35.482738+0000","last_undegraded":"2024-03-27T07:23:35.482738+0000","last_fullsized":"2024-03-27T07:23:35.482738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:37:07.075048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947849+0000","last_change":"2024-03-27T07:21:35.570287+0000","last_active":"2024-03-27T07:23:34.947849+0000","last_peered":"2024-03-27T07:23:34.947849+0000","last_clean":"2024-03-27T07:23:34.947849+0000","last_became_active":"2024-03-27T07:21:35.569194+0000","last_became_peered":"2024-03-27T07:21:35.569194+0000","last_unstale":"2024-03-27T07:23:34.947849+0000","last_undegraded":"2024-03-27T07:23:34.947849+0000","last_fullsized":"2024-03-27T07:23:34.947849+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:01:44.155291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948171+0000","last_change":"2024-03-27T07:21:34.561420+0000","last_active":"2024-03-27T07:23:34.948171+0000","last_peered":"2024-03-27T07:23:34.948171+0000","last_clean":"2024-03-27T07:23:34.948171+0000","last_became_active":"2024-03-27T07:21:34.560923+0000","last_became_peered":"2024-03-27T07:21:34.560923+0000","last_unstale":"2024-03-27T07:23:34.948171+0000","last_undegraded":"2024-03-27T07:23:34.948171+0000","last_fullsized":"2024-03-27T07:23:34.948171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:39:48.256790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948314+0000","last_change":"2024-03-27T07:21:35.571317+0000","last_active":"2024-03-27T07:23:34.948314+0000","last_peered":"2024-03-27T07:23:34.948314+0000","last_clean":"2024-03-27T07:23:34.948314+0000","last_became_active":"2024-03-27T07:21:35.570237+0000","last_became_peered":"2024-03-27T07:21:35.570237+0000","last_unstale":"2024-03-27T07:23:34.948314+0000","last_undegraded":"2024-03-27T07:23:34.948314+0000","last_fullsized":"2024-03-27T07:23:34.948314+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:09:53.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'39","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.175735+0000","last_change":"2024-03-27T07:21:34.553377+0000","last_active":"2024-03-27T07:23:35.175735+0000","last_peered":"2024-03-27T07:23:35.175735+0000","last_clean":"2024-03-27T07:23:35.175735+0000","last_became_active":"2024-03-27T07:21:34.553050+0000","last_became_peered":"2024-03-27T07:21:34.553050+0000","last_unstale":"2024-03-27T07:23:35.175735+0000","last_undegraded":"2024-03-27T07:23:35.175735+0000","last_fullsized":"2024-03-27T07:23:35.175735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:03.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947957+0000","last_change":"2024-03-27T07:21:35.572384+0000","last_active":"2024-03-27T07:23:34.947957+0000","last_peered":"2024-03-27T07:23:34.947957+0000","last_clean":"2024-03-27T07:23:34.947957+0000","last_became_active":"2024-03-27T07:21:35.572071+0000","last_became_peered":"2024-03-27T07:21:35.572071+0000","last_unstale":"2024-03-27T07:23:34.947957+0000","last_undegraded":"2024-03-27T07:23:34.947957+0000","last_fullsized":"2024-03-27T07:23:34.947957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:03:04.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222498+0000","last_change":"2024-03-27T07:21:34.559187+0000","last_active":"2024-03-27T07:23:35.222498+0000","last_peered":"2024-03-27T07:23:35.222498+0000","last_clean":"2024-03-27T07:23:35.222498+0000","last_became_active":"2024-03-27T07:21:34.558675+0000","last_became_peered":"2024-03-27T07:21:34.558675+0000","last_unstale":"2024-03-27T07:23:35.222498+0000","last_undegraded":"2024-03-27T07:23:35.222498+0000","last_fullsized":"2024-03-27T07:23:35.222498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:41.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948473+0000","last_change":"2024-03-27T07:21:35.576440+0000","last_active":"2024-03-27T07:23:34.948473+0000","last_peered":"2024-03-27T07:23:34.948473+0000","last_clean":"2024-03-27T07:23:34.948473+0000","last_became_active":"2024-03-27T07:21:35.576143+0000","last_became_peered":"2024-03-27T07:21:35.576143+0000","last_unstale":"2024-03-27T07:23:34.948473+0000","last_undegraded":"2024-03-27T07:23:34.948473+0000","last_fullsized":"2024-03-27T07:23:34.948473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:31:29.400053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056874+0000","last_change":"2024-03-27T07:21:35.565760+0000","last_active":"2024-03-27T07:23:35.056874+0000","last_peered":"2024-03-27T07:23:35.056874+0000","last_clean":"2024-03-27T07:23:35.056874+0000","last_became_active":"2024-03-27T07:21:35.565351+0000","last_became_peered":"2024-03-27T07:21:35.565351+0000","last_unstale":"2024-03-27T07:23:35.056874+0000","last_undegraded":"2024-03-27T07:23:35.056874+0000","last_fullsized":"2024-03-27T07:23:35.056874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:16.871912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947900+0000","last_change":"2024-03-27T07:21:35.564100+0000","last_active":"2024-03-27T07:23:34.947900+0000","last_peered":"2024-03-27T07:23:34.947900+0000","last_clean":"2024-03-27T07:23:34.947900+0000","last_became_active":"2024-03-27T07:21:35.563748+0000","last_became_peered":"2024-03-27T07:21:35.563748+0000","last_unstale":"2024-03-27T07:23:34.947900+0000","last_undegraded":"2024-03-27T07:23:34.947900+0000","last_fullsized":"2024-03-27T07:23:34.947900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:19:30.742692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947885+0000","last_change":"2024-03-27T07:21:35.575036+0000","last_active":"2024-03-27T07:23:34.947885+0000","last_peered":"2024-03-27T07:23:34.947885+0000","last_clean":"2024-03-27T07:23:34.947885+0000","last_became_active":"2024-03-27T07:21:35.574689+0000","last_became_peered":"2024-03-27T07:21:35.574689+0000","last_unstale":"2024-03-27T07:23:34.947885+0000","last_undegraded":"2024-03-27T07:23:34.947885+0000","last_fullsized":"2024-03-27T07:23:34.947885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:50:40.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224610+0000","last_change":"2024-03-27T07:21:35.577814+0000","last_active":"2024-03-27T07:23:35.224610+0000","last_peered":"2024-03-27T07:23:35.224610+0000","last_clean":"2024-03-27T07:23:35.224610+0000","last_became_active":"2024-03-27T07:21:35.576265+0000","last_became_peered":"2024-03-27T07:21:35.576265+0000","last_unstale":"2024-03-27T07:23:35.224610+0000","last_undegraded":"2024-03-27T07:23:35.224610+0000","last_fullsized":"2024-03-27T07:23:35.224610+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:04.523768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222189+0000","last_change":"2024-03-27T07:21:35.568753+0000","last_active":"2024-03-27T07:23:35.222189+0000","last_peered":"2024-03-27T07:23:35.222189+0000","last_clean":"2024-03-27T07:23:35.222189+0000","last_became_active":"2024-03-27T07:21:35.568441+0000","last_became_peered":"2024-03-27T07:21:35.568441+0000","last_unstale":"2024-03-27T07:23:35.222189+0000","last_undegraded":"2024-03-27T07:23:35.222189+0000","last_fullsized":"2024-03-27T07:23:35.222189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:32:54.294960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057086+0000","last_change":"2024-03-27T07:21:35.573094+0000","last_active":"2024-03-27T07:23:35.057086+0000","last_peered":"2024-03-27T07:23:35.057086+0000","last_clean":"2024-03-27T07:23:35.057086+0000","last_became_active":"2024-03-27T07:21:35.572739+0000","last_became_peered":"2024-03-27T07:21:35.572739+0000","last_unstale":"2024-03-27T07:23:35.057086+0000","last_undegraded":"2024-03-27T07:23:35.057086+0000","last_fullsized":"2024-03-27T07:23:35.057086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:02.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948312+0000","last_change":"2024-03-27T07:21:35.580647+0000","last_active":"2024-03-27T07:23:34.948312+0000","last_peered":"2024-03-27T07:23:34.948312+0000","last_clean":"2024-03-27T07:23:34.948312+0000","last_became_active":"2024-03-27T07:21:35.580230+0000","last_became_peered":"2024-03-27T07:21:35.580230+0000","last_unstale":"2024-03-27T07:23:34.948312+0000","last_undegraded":"2024-03-27T07:23:34.948312+0000","last_fullsized":"2024-03-27T07:23:34.948312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:04:37.573021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057728+0000","last_change":"2024-03-27T07:21:35.568859+0000","last_active":"2024-03-27T07:23:35.057728+0000","last_peered":"2024-03-27T07:23:35.057728+0000","last_clean":"2024-03-27T07:23:35.057728+0000","last_became_active":"2024-03-27T07:21:35.568468+0000","last_became_peered":"2024-03-27T07:21:35.568468+0000","last_unstale":"2024-03-27T07:23:35.057728+0000","last_undegraded":"2024-03-27T07:23:35.057728+0000","last_fullsized":"2024-03-27T07:23:35.057728+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:44:59.875882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064061+0000","last_change":"2024-03-27T07:21:35.568485+0000","last_active":"2024-03-27T07:23:35.064061+0000","last_peered":"2024-03-27T07:23:35.064061+0000","last_clean":"2024-03-27T07:23:35.064061+0000","last_became_active":"2024-03-27T07:21:35.568154+0000","last_became_peered":"2024-03-27T07:21:35.568154+0000","last_unstale":"2024-03-27T07:23:35.064061+0000","last_undegraded":"2024-03-27T07:23:35.064061+0000","last_fullsized":"2024-03-27T07:23:35.064061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:08:29.418189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057815+0000","last_change":"2024-03-27T07:21:35.567369+0000","last_active":"2024-03-27T07:23:35.057815+0000","last_peered":"2024-03-27T07:23:35.057815+0000","last_clean":"2024-03-27T07:23:35.057815+0000","last_became_active":"2024-03-27T07:21:35.564602+0000","last_became_peered":"2024-03-27T07:21:35.564602+0000","last_unstale":"2024-03-27T07:23:35.057815+0000","last_undegraded":"2024-03-27T07:23:35.057815+0000","last_fullsized":"2024-03-27T07:23:35.057815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:23:15.123502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222268+0000","last_change":"2024-03-27T07:21:35.572580+0000","last_active":"2024-03-27T07:23:35.222268+0000","last_peered":"2024-03-27T07:23:35.222268+0000","last_clean":"2024-03-27T07:23:35.222268+0000","last_became_active":"2024-03-27T07:21:35.572245+0000","last_became_peered":"2024-03-27T07:21:35.572245+0000","last_unstale":"2024-03-27T07:23:35.222268+0000","last_undegraded":"2024-03-27T07:23:35.222268+0000","last_fullsized":"2024-03-27T07:23:35.222268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:45:56.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222009+0000","last_change":"2024-03-27T07:21:35.584975+0000","last_active":"2024-03-27T07:23:35.222009+0000","last_peered":"2024-03-27T07:23:35.222009+0000","last_clean":"2024-03-27T07:23:35.222009+0000","last_became_active":"2024-03-27T07:21:35.584579+0000","last_became_peered":"2024-03-27T07:21:35.584579+0000","last_unstale":"2024-03-27T07:23:35.222009+0000","last_undegraded":"2024-03-27T07:23:35.222009+0000","last_fullsized":"2024-03-27T07:23:35.222009+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:22:44.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056880+0000","last_change":"2024-03-27T07:21:35.573496+0000","last_active":"2024-03-27T07:23:35.056880+0000","last_peered":"2024-03-27T07:23:35.056880+0000","last_clean":"2024-03-27T07:23:35.056880+0000","last_became_active":"2024-03-27T07:21:35.572946+0000","last_became_peered":"2024-03-27T07:21:35.572946+0000","last_unstale":"2024-03-27T07:23:35.056880+0000","last_undegraded":"2024-03-27T07:23:35.056880+0000","last_fullsized":"2024-03-27T07:23:35.056880+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:37:50.236828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107082,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597806,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":828,"num_read_kb":524,"num_write":287,"num_write_kb":1437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":582,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1793418,"data_compressed":81513,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351013,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":863566,"data_compressed":22025,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612650,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1142784,"data_stored":1261580,"data_compressed":46598,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776176,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1007616,"data_stored":863802,"data_compressed":22025,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037813,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":469924,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":1062885,"data_compressed":38573,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495678,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":469975,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":537526,"data_compressed":4748,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":991232,"data_stored":471246,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1060864,"data_stored":540107,"data_compressed":4748,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":995102,"data_compressed":28181,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920842,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":471385,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":1194560,"data_compressed":44729,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":67758,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70339,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134307,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":201327,"data_compressed":8025,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T07:23:37.234 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T07:23:37.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:36 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3756711931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:37.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:36 smithi149 ceph-mon[36065]: mgrmap e21: x(active, since 1.01799s), standbys: y, z 2024-03-27T07:23:37.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:36 smithi149 ceph-mon[36065]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:23:37.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:36 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/789473523' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:37.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:36 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4176805949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:37.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:36 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3756711931' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:37.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:36 smithi153 ceph-mon[36179]: mgrmap e21: x(active, since 1.01799s), standbys: y, z 2024-03-27T07:23:37.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:36 smithi153 ceph-mon[36179]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:23:37.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:36 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/789473523' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:37.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:36 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4176805949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:37.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.378+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/2785770169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24100a70 msgr2=0x7f9a24100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.378+0000 7f9a2bd6b640 1 --2- 172.21.15.82:0/2785770169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24100a70 0x7f9a24100e90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009900 tx=0x7f9a1402bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.378+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/2785770169 shutdown_connections 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.378+0000 7f9a2bd6b640 1 --2- 172.21.15.82:0/2785770169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a24102620 0x7f9a24108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.378+0000 7f9a2bd6b640 1 --2- 172.21.15.82:0/2785770169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a24101c60 0x7f9a241020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.378+0000 7f9a2bd6b640 1 --2- 172.21.15.82:0/2785770169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24100a70 0x7f9a24100e90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.378+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/2785770169 >> 172.21.15.82:0/2785770169 conn(0x7f9a240fbfe0 msgr2=0x7f9a240fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/2785770169 shutdown_connections 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/2785770169 wait complete. 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2bd6b640 1 Processor -- start 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2bd6b640 1 -- start start 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2bd6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24100a70 0x7f9a24197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2bd6b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a24101c60 0x7f9a241983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2bd6b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a24102620 0x7f9a2419f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2bd6b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2410c6c0 con 0x7f9a24100a70 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2bd6b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2410c540 con 0x7f9a24102620 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2bd6b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9a2410c840 con 0x7f9a24101c60 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a29b07640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24100a70 0x7f9a24197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a29b07640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24100a70 0x7f9a24197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41792/0 (socket says 172.21.15.82:41792) 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a29b07640 1 -- 172.21.15.82:0/3810661062 learned_addr learned my addr 172.21.15.82:0/3810661062 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.379+0000 7f9a2a308640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a24102620 0x7f9a2419f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a29306640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a24101c60 0x7f9a241983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a29b07640 1 -- 172.21.15.82:0/3810661062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a24101c60 msgr2=0x7f9a241983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a29b07640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a24101c60 0x7f9a241983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a29b07640 1 -- 172.21.15.82:0/3810661062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a24102620 msgr2=0x7f9a2419f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a29b07640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a24102620 0x7f9a2419f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a29b07640 1 -- 172.21.15.82:0/3810661062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2419fa90 con 0x7f9a24100a70 2024-03-27T07:23:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a29b07640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24100a70 0x7f9a24197e70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9a14000c00 tx=0x7f9a14005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a1affd640 1 -- 172.21.15.82:0/3810661062 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14041070 con 0x7f9a24100a70 2024-03-27T07:23:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a1affd640 1 -- 172.21.15.82:0/3810661062 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a140044d0 con 0x7f9a24100a70 2024-03-27T07:23:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a1affd640 1 -- 172.21.15.82:0/3810661062 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a14034440 con 0x7f9a24100a70 2024-03-27T07:23:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/3810661062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a2419fd20 con 0x7f9a24100a70 2024-03-27T07:23:37.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.380+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/3810661062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a241a01c0 con 0x7f9a24100a70 2024-03-27T07:23:37.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.381+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/3810661062 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a241a0390 con 0x7f9a24100a70 2024-03-27T07:23:37.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.382+0000 7f9a1affd640 1 -- 172.21.15.82:0/3810661062 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 21) ==== 138182+0+0 (secure 0 0 0) 0x7f9a14044070 con 0x7f9a24100a70 2024-03-27T07:23:37.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.382+0000 7f9a1affd640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9a100a3410 0x7f9a100a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.383+0000 7f9a29306640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9a100a3410 0x7f9a100a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.383+0000 7f9a1affd640 1 -- 172.21.15.82:0/3810661062 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9a140f14d0 con 0x7f9a24100a70 2024-03-27T07:23:37.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.383+0000 7f9a29306640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9a100a3410 0x7f9a100a58d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a24199380 tx=0x7f9a20005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:37.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.387+0000 7f9a1affd640 1 -- 172.21.15.82:0/3810661062 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9a140bdc70 con 0x7f9a24100a70 2024-03-27T07:23:37.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.570+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/3810661062 --> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a240693c0 con 0x7f9a100a3410 2024-03-27T07:23:37.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.578+0000 7f9a1affd640 1 -- 172.21.15.82:0/3810661062 <== mgr.15273 v2:172.21.15.82:6800/573513718 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258022 (secure 0 0 0) 0x7f9a240693c0 con 0x7f9a100a3410 2024-03-27T07:23:37.582 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:37.583 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-27T07:23:37.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/3810661062 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9a100a3410 msgr2=0x7f9a100a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9a100a3410 0x7f9a100a58d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a24199380 tx=0x7f9a20005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:37.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/3810661062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24100a70 msgr2=0x7f9a24197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24100a70 0x7f9a24197e70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9a14000c00 tx=0x7f9a14005d50 comp rx=0 tx=0).stop 2024-03-27T07:23:37.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/3810661062 shutdown_connections 2024-03-27T07:23:37.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9a100a3410 0x7f9a100a58d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9a24102620 0x7f9a2419f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a24101c60 0x7f9a241983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 --2- 172.21.15.82:0/3810661062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a24100a70 0x7f9a24197e70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/3810661062 >> 172.21.15.82:0/3810661062 conn(0x7f9a240fbfe0 msgr2=0x7f9a24068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:37.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/3810661062 shutdown_connections 2024-03-27T07:23:37.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.581+0000 7f9a2bd6b640 1 -- 172.21.15.82:0/3810661062 wait complete. 2024-03-27T07:23:37.595 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-03-27T07:23:36.961936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188408,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":964,"num_read_kb":643,"num_write":470,"num_write_kb":4377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181318,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357032,"kb_used_data":12000,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584792,"statfs":{"total":1151940427776,"available":1151574827008,"internally_reserved":0,"allocated":12288000,"data_stored":9201658,"data_compressed":223143,"data_compressed_allocated":294912,"data_compressed_original":3440640,"omap_allocated":19139,"internal_metadata":353154365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.992646"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057054+0000","last_change":"2024-03-27T07:21:35.577169+0000","last_active":"2024-03-27T07:23:35.057054+0000","last_peered":"2024-03-27T07:23:35.057054+0000","last_clean":"2024-03-27T07:23:35.057054+0000","last_became_active":"2024-03-27T07:21:35.576737+0000","last_became_peered":"2024-03-27T07:21:35.576737+0000","last_unstale":"2024-03-27T07:23:35.057054+0000","last_undegraded":"2024-03-27T07:23:35.057054+0000","last_fullsized":"2024-03-27T07:23:35.057054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:58:55.152543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.225176+0000","last_change":"2024-03-27T07:21:35.576197+0000","last_active":"2024-03-27T07:23:35.225176+0000","last_peered":"2024-03-27T07:23:35.225176+0000","last_clean":"2024-03-27T07:23:35.225176+0000","last_became_active":"2024-03-27T07:21:35.575876+0000","last_became_peered":"2024-03-27T07:21:35.575876+0000","last_unstale":"2024-03-27T07:23:35.225176+0000","last_undegraded":"2024-03-27T07:23:35.225176+0000","last_fullsized":"2024-03-27T07:23:35.225176+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:23:12.589029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224758+0000","last_change":"2024-03-27T07:21:35.582045+0000","last_active":"2024-03-27T07:23:35.224758+0000","last_peered":"2024-03-27T07:23:35.224758+0000","last_clean":"2024-03-27T07:23:35.224758+0000","last_became_active":"2024-03-27T07:21:35.581710+0000","last_became_peered":"2024-03-27T07:21:35.581710+0000","last_unstale":"2024-03-27T07:23:35.224758+0000","last_undegraded":"2024-03-27T07:23:35.224758+0000","last_fullsized":"2024-03-27T07:23:35.224758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:47:39.004986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949235+0000","last_change":"2024-03-27T07:22:27.670513+0000","last_active":"2024-03-27T07:23:34.949235+0000","last_peered":"2024-03-27T07:23:34.949235+0000","last_clean":"2024-03-27T07:23:34.949235+0000","last_became_active":"2024-03-27T07:22:27.670263+0000","last_became_peered":"2024-03-27T07:22:27.670263+0000","last_unstale":"2024-03-27T07:23:34.949235+0000","last_undegraded":"2024-03-27T07:23:34.949235+0000","last_fullsized":"2024-03-27T07:23:34.949235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:32:43.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482696+0000","last_change":"2024-03-27T07:21:35.568964+0000","last_active":"2024-03-27T07:23:35.482696+0000","last_peered":"2024-03-27T07:23:35.482696+0000","last_clean":"2024-03-27T07:23:35.482696+0000","last_became_active":"2024-03-27T07:21:35.568607+0000","last_became_peered":"2024-03-27T07:21:35.568607+0000","last_unstale":"2024-03-27T07:23:35.482696+0000","last_undegraded":"2024-03-27T07:23:35.482696+0000","last_fullsized":"2024-03-27T07:23:35.482696+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:26:32.122422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067396+0000","last_change":"2024-03-27T07:21:35.575915+0000","last_active":"2024-03-27T07:23:35.067396+0000","last_peered":"2024-03-27T07:23:35.067396+0000","last_clean":"2024-03-27T07:23:35.067396+0000","last_became_active":"2024-03-27T07:21:35.575604+0000","last_became_peered":"2024-03-27T07:21:35.575604+0000","last_unstale":"2024-03-27T07:23:35.067396+0000","last_undegraded":"2024-03-27T07:23:35.067396+0000","last_fullsized":"2024-03-27T07:23:35.067396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:19:12.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947683+0000","last_change":"2024-03-27T07:21:35.570762+0000","last_active":"2024-03-27T07:23:34.947683+0000","last_peered":"2024-03-27T07:23:34.947683+0000","last_clean":"2024-03-27T07:23:34.947683+0000","last_became_active":"2024-03-27T07:21:35.570380+0000","last_became_peered":"2024-03-27T07:21:35.570380+0000","last_unstale":"2024-03-27T07:23:34.947683+0000","last_undegraded":"2024-03-27T07:23:34.947683+0000","last_fullsized":"2024-03-27T07:23:34.947683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:35:04.463674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057560+0000","last_change":"2024-03-27T07:21:35.573220+0000","last_active":"2024-03-27T07:23:35.057560+0000","last_peered":"2024-03-27T07:23:35.057560+0000","last_clean":"2024-03-27T07:23:35.057560+0000","last_became_active":"2024-03-27T07:21:35.572909+0000","last_became_peered":"2024-03-27T07:21:35.572909+0000","last_unstale":"2024-03-27T07:23:35.057560+0000","last_undegraded":"2024-03-27T07:23:35.057560+0000","last_fullsized":"2024-03-27T07:23:35.057560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:49:51.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.223506+0000","last_change":"2024-03-27T07:21:35.559298+0000","last_active":"2024-03-27T07:23:35.223506+0000","last_peered":"2024-03-27T07:23:35.223506+0000","last_clean":"2024-03-27T07:23:35.223506+0000","last_became_active":"2024-03-27T07:21:35.558968+0000","last_became_peered":"2024-03-27T07:21:35.558968+0000","last_unstale":"2024-03-27T07:23:35.223506+0000","last_undegraded":"2024-03-27T07:23:35.223506+0000","last_fullsized":"2024-03-27T07:23:35.223506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:12:31.027411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067619+0000","last_change":"2024-03-27T07:21:35.577015+0000","last_active":"2024-03-27T07:23:35.067619+0000","last_peered":"2024-03-27T07:23:35.067619+0000","last_clean":"2024-03-27T07:23:35.067619+0000","last_became_active":"2024-03-27T07:21:35.576599+0000","last_became_peered":"2024-03-27T07:21:35.576599+0000","last_unstale":"2024-03-27T07:23:35.067619+0000","last_undegraded":"2024-03-27T07:23:35.067619+0000","last_fullsized":"2024-03-27T07:23:35.067619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:03.138951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948191+0000","last_change":"2024-03-27T07:21:35.576540+0000","last_active":"2024-03-27T07:23:34.948191+0000","last_peered":"2024-03-27T07:23:34.948191+0000","last_clean":"2024-03-27T07:23:34.948191+0000","last_became_active":"2024-03-27T07:21:35.576101+0000","last_became_peered":"2024-03-27T07:21:35.576101+0000","last_unstale":"2024-03-27T07:23:34.948191+0000","last_undegraded":"2024-03-27T07:23:34.948191+0000","last_fullsized":"2024-03-27T07:23:34.948191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:13.654970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949003+0000","last_change":"2024-03-27T07:22:27.669089+0000","last_active":"2024-03-27T07:23:34.949003+0000","last_peered":"2024-03-27T07:23:34.949003+0000","last_clean":"2024-03-27T07:23:34.949003+0000","last_became_active":"2024-03-27T07:22:27.668715+0000","last_became_peered":"2024-03-27T07:22:27.668715+0000","last_unstale":"2024-03-27T07:23:34.949003+0000","last_undegraded":"2024-03-27T07:23:34.949003+0000","last_fullsized":"2024-03-27T07:23:34.949003+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:44:33.732968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222315+0000","last_change":"2024-03-27T07:21:35.559726+0000","last_active":"2024-03-27T07:23:35.222315+0000","last_peered":"2024-03-27T07:23:35.222315+0000","last_clean":"2024-03-27T07:23:35.222315+0000","last_became_active":"2024-03-27T07:21:35.559294+0000","last_became_peered":"2024-03-27T07:21:35.559294+0000","last_unstale":"2024-03-27T07:23:35.222315+0000","last_undegraded":"2024-03-27T07:23:35.222315+0000","last_fullsized":"2024-03-27T07:23:35.222315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:27:00.364447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224071+0000","last_change":"2024-03-27T07:21:35.577959+0000","last_active":"2024-03-27T07:23:35.224071+0000","last_peered":"2024-03-27T07:23:35.224071+0000","last_clean":"2024-03-27T07:23:35.224071+0000","last_became_active":"2024-03-27T07:21:35.577642+0000","last_became_peered":"2024-03-27T07:21:35.577642+0000","last_unstale":"2024-03-27T07:23:35.224071+0000","last_undegraded":"2024-03-27T07:23:35.224071+0000","last_fullsized":"2024-03-27T07:23:35.224071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:07:44.836888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224287+0000","last_change":"2024-03-27T07:21:35.580901+0000","last_active":"2024-03-27T07:23:35.224287+0000","last_peered":"2024-03-27T07:23:35.224287+0000","last_clean":"2024-03-27T07:23:35.224287+0000","last_became_active":"2024-03-27T07:21:35.579456+0000","last_became_peered":"2024-03-27T07:21:35.579456+0000","last_unstale":"2024-03-27T07:23:35.224287+0000","last_undegraded":"2024-03-27T07:23:35.224287+0000","last_fullsized":"2024-03-27T07:23:35.224287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:35:54.722160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221935+0000","last_change":"2024-03-27T07:21:35.574462+0000","last_active":"2024-03-27T07:23:35.221935+0000","last_peered":"2024-03-27T07:23:35.221935+0000","last_clean":"2024-03-27T07:23:35.221935+0000","last_became_active":"2024-03-27T07:21:35.574158+0000","last_became_peered":"2024-03-27T07:21:35.574158+0000","last_unstale":"2024-03-27T07:23:35.221935+0000","last_undegraded":"2024-03-27T07:23:35.221935+0000","last_fullsized":"2024-03-27T07:23:35.221935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:16:18.756955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057213+0000","last_change":"2024-03-27T07:21:35.576808+0000","last_active":"2024-03-27T07:23:35.057213+0000","last_peered":"2024-03-27T07:23:35.057213+0000","last_clean":"2024-03-27T07:23:35.057213+0000","last_became_active":"2024-03-27T07:21:35.574819+0000","last_became_peered":"2024-03-27T07:21:35.574819+0000","last_unstale":"2024-03-27T07:23:35.057213+0000","last_undegraded":"2024-03-27T07:23:35.057213+0000","last_fullsized":"2024-03-27T07:23:35.057213+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:29:06.137201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949053+0000","last_change":"2024-03-27T07:21:35.570650+0000","last_active":"2024-03-27T07:23:34.949053+0000","last_peered":"2024-03-27T07:23:34.949053+0000","last_clean":"2024-03-27T07:23:34.949053+0000","last_became_active":"2024-03-27T07:21:35.569850+0000","last_became_peered":"2024-03-27T07:21:35.569850+0000","last_unstale":"2024-03-27T07:23:34.949053+0000","last_undegraded":"2024-03-27T07:23:34.949053+0000","last_fullsized":"2024-03-27T07:23:34.949053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:22:39.829648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948167+0000","last_change":"2024-03-27T07:21:35.566322+0000","last_active":"2024-03-27T07:23:34.948167+0000","last_peered":"2024-03-27T07:23:34.948167+0000","last_clean":"2024-03-27T07:23:34.948167+0000","last_became_active":"2024-03-27T07:21:35.565947+0000","last_became_peered":"2024-03-27T07:21:35.565947+0000","last_unstale":"2024-03-27T07:23:34.948167+0000","last_undegraded":"2024-03-27T07:23:34.948167+0000","last_fullsized":"2024-03-27T07:23:34.948167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:58:34.151735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949018+0000","last_change":"2024-03-27T07:22:27.702687+0000","last_active":"2024-03-27T07:23:34.949018+0000","last_peered":"2024-03-27T07:23:34.949018+0000","last_clean":"2024-03-27T07:23:34.949018+0000","last_became_active":"2024-03-27T07:22:27.696358+0000","last_became_peered":"2024-03-27T07:22:27.696358+0000","last_unstale":"2024-03-27T07:23:34.949018+0000","last_undegraded":"2024-03-27T07:23:34.949018+0000","last_fullsized":"2024-03-27T07:23:34.949018+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:30:28.499338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058686+0000","last_change":"2024-03-27T07:21:35.576918+0000","last_active":"2024-03-27T07:23:35.058686+0000","last_peered":"2024-03-27T07:23:35.058686+0000","last_clean":"2024-03-27T07:23:35.058686+0000","last_became_active":"2024-03-27T07:21:35.576581+0000","last_became_peered":"2024-03-27T07:21:35.576581+0000","last_unstale":"2024-03-27T07:23:35.058686+0000","last_undegraded":"2024-03-27T07:23:35.058686+0000","last_fullsized":"2024-03-27T07:23:35.058686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:31:54.813459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.059064+0000","last_change":"2024-03-27T07:21:34.560583+0000","last_active":"2024-03-27T07:23:35.059064+0000","last_peered":"2024-03-27T07:23:35.059064+0000","last_clean":"2024-03-27T07:23:35.059064+0000","last_became_active":"2024-03-27T07:21:34.560257+0000","last_became_peered":"2024-03-27T07:21:34.560257+0000","last_unstale":"2024-03-27T07:23:35.059064+0000","last_undegraded":"2024-03-27T07:23:35.059064+0000","last_fullsized":"2024-03-27T07:23:35.059064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:25:27.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224927+0000","last_change":"2024-03-27T07:21:35.573251+0000","last_active":"2024-03-27T07:23:35.224927+0000","last_peered":"2024-03-27T07:23:35.224927+0000","last_clean":"2024-03-27T07:23:35.224927+0000","last_became_active":"2024-03-27T07:21:35.572890+0000","last_became_peered":"2024-03-27T07:21:35.572890+0000","last_unstale":"2024-03-27T07:23:35.224927+0000","last_undegraded":"2024-03-27T07:23:35.224927+0000","last_fullsized":"2024-03-27T07:23:35.224927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:49.317704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483172+0000","last_change":"2024-03-27T07:21:34.567140+0000","last_active":"2024-03-27T07:23:35.483172+0000","last_peered":"2024-03-27T07:23:35.483172+0000","last_clean":"2024-03-27T07:23:35.483172+0000","last_became_active":"2024-03-27T07:21:34.566689+0000","last_became_peered":"2024-03-27T07:21:34.566689+0000","last_unstale":"2024-03-27T07:23:35.483172+0000","last_undegraded":"2024-03-27T07:23:35.483172+0000","last_fullsized":"2024-03-27T07:23:35.483172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:50:54.656277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222293+0000","last_change":"2024-03-27T07:21:35.565259+0000","last_active":"2024-03-27T07:23:35.222293+0000","last_peered":"2024-03-27T07:23:35.222293+0000","last_clean":"2024-03-27T07:23:35.222293+0000","last_became_active":"2024-03-27T07:21:35.564954+0000","last_became_peered":"2024-03-27T07:21:35.564954+0000","last_unstale":"2024-03-27T07:23:35.222293+0000","last_undegraded":"2024-03-27T07:23:35.222293+0000","last_fullsized":"2024-03-27T07:23:35.222293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:02.950515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483014+0000","last_change":"2024-03-27T07:21:34.558887+0000","last_active":"2024-03-27T07:23:35.483014+0000","last_peered":"2024-03-27T07:23:35.483014+0000","last_clean":"2024-03-27T07:23:35.483014+0000","last_became_active":"2024-03-27T07:21:34.556689+0000","last_became_peered":"2024-03-27T07:21:34.556689+0000","last_unstale":"2024-03-27T07:23:35.483014+0000","last_undegraded":"2024-03-27T07:23:35.483014+0000","last_fullsized":"2024-03-27T07:23:35.483014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:37.162440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064533+0000","last_change":"2024-03-27T07:21:35.576346+0000","last_active":"2024-03-27T07:23:35.064533+0000","last_peered":"2024-03-27T07:23:35.064533+0000","last_clean":"2024-03-27T07:23:35.064533+0000","last_became_active":"2024-03-27T07:21:35.572774+0000","last_became_peered":"2024-03-27T07:21:35.572774+0000","last_unstale":"2024-03-27T07:23:35.064533+0000","last_undegraded":"2024-03-27T07:23:35.064533+0000","last_fullsized":"2024-03-27T07:23:35.064533+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:12:44.181603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'9","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.722484+0000","last_change":"2024-03-27T07:21:34.562208+0000","last_active":"2024-03-27T07:23:35.722484+0000","last_peered":"2024-03-27T07:23:35.722484+0000","last_clean":"2024-03-27T07:23:35.722484+0000","last_became_active":"2024-03-27T07:21:34.561829+0000","last_became_peered":"2024-03-27T07:21:34.561829+0000","last_unstale":"2024-03-27T07:23:35.722484+0000","last_undegraded":"2024-03-27T07:23:35.722484+0000","last_fullsized":"2024-03-27T07:23:35.722484+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:01:48.845075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1853,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482808+0000","last_change":"2024-03-27T07:21:35.575384+0000","last_active":"2024-03-27T07:23:35.482808+0000","last_peered":"2024-03-27T07:23:35.482808+0000","last_clean":"2024-03-27T07:23:35.482808+0000","last_became_active":"2024-03-27T07:21:35.574928+0000","last_became_peered":"2024-03-27T07:21:35.574928+0000","last_unstale":"2024-03-27T07:23:35.482808+0000","last_undegraded":"2024-03-27T07:23:35.482808+0000","last_fullsized":"2024-03-27T07:23:35.482808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:34.034114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067396+0000","last_change":"2024-03-27T07:21:34.562791+0000","last_active":"2024-03-27T07:23:35.067396+0000","last_peered":"2024-03-27T07:23:35.067396+0000","last_clean":"2024-03-27T07:23:35.067396+0000","last_became_active":"2024-03-27T07:21:34.562441+0000","last_became_peered":"2024-03-27T07:21:34.562441+0000","last_unstale":"2024-03-27T07:23:35.067396+0000","last_undegraded":"2024-03-27T07:23:35.067396+0000","last_fullsized":"2024-03-27T07:23:35.067396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:44:42.509635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064356+0000","last_change":"2024-03-27T07:21:35.578022+0000","last_active":"2024-03-27T07:23:35.064356+0000","last_peered":"2024-03-27T07:23:35.064356+0000","last_clean":"2024-03-27T07:23:35.064356+0000","last_became_active":"2024-03-27T07:21:35.577665+0000","last_became_peered":"2024-03-27T07:21:35.577665+0000","last_unstale":"2024-03-27T07:23:35.064356+0000","last_undegraded":"2024-03-27T07:23:35.064356+0000","last_fullsized":"2024-03-27T07:23:35.064356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:05:40.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221881+0000","last_change":"2024-03-27T07:21:34.557610+0000","last_active":"2024-03-27T07:23:35.221881+0000","last_peered":"2024-03-27T07:23:35.221881+0000","last_clean":"2024-03-27T07:23:35.221881+0000","last_became_active":"2024-03-27T07:21:34.557295+0000","last_became_peered":"2024-03-27T07:21:34.557295+0000","last_unstale":"2024-03-27T07:23:35.221881+0000","last_undegraded":"2024-03-27T07:23:35.221881+0000","last_fullsized":"2024-03-27T07:23:35.221881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:38:40.291447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057741+0000","last_change":"2024-03-27T07:21:35.568910+0000","last_active":"2024-03-27T07:23:35.057741+0000","last_peered":"2024-03-27T07:23:35.057741+0000","last_clean":"2024-03-27T07:23:35.057741+0000","last_became_active":"2024-03-27T07:21:35.568606+0000","last_became_peered":"2024-03-27T07:21:35.568606+0000","last_unstale":"2024-03-27T07:23:35.057741+0000","last_undegraded":"2024-03-27T07:23:35.057741+0000","last_fullsized":"2024-03-27T07:23:35.057741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:04:54.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064009+0000","last_change":"2024-03-27T07:21:34.563096+0000","last_active":"2024-03-27T07:23:35.064009+0000","last_peered":"2024-03-27T07:23:35.064009+0000","last_clean":"2024-03-27T07:23:35.064009+0000","last_became_active":"2024-03-27T07:21:34.562721+0000","last_became_peered":"2024-03-27T07:21:34.562721+0000","last_unstale":"2024-03-27T07:23:35.064009+0000","last_undegraded":"2024-03-27T07:23:35.064009+0000","last_fullsized":"2024-03-27T07:23:35.064009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:42:43.902139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948802+0000","last_change":"2024-03-27T07:21:35.571386+0000","last_active":"2024-03-27T07:23:34.948802+0000","last_peered":"2024-03-27T07:23:34.948802+0000","last_clean":"2024-03-27T07:23:34.948802+0000","last_became_active":"2024-03-27T07:21:35.571061+0000","last_became_peered":"2024-03-27T07:21:35.571061+0000","last_unstale":"2024-03-27T07:23:34.948802+0000","last_undegraded":"2024-03-27T07:23:34.948802+0000","last_fullsized":"2024-03-27T07:23:34.948802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:15:06.887550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067769+0000","last_change":"2024-03-27T07:21:34.561401+0000","last_active":"2024-03-27T07:23:35.067769+0000","last_peered":"2024-03-27T07:23:35.067769+0000","last_clean":"2024-03-27T07:23:35.067769+0000","last_became_active":"2024-03-27T07:21:34.561071+0000","last_became_peered":"2024-03-27T07:21:34.561071+0000","last_unstale":"2024-03-27T07:23:35.067769+0000","last_undegraded":"2024-03-27T07:23:35.067769+0000","last_fullsized":"2024-03-27T07:23:35.067769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:41.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.223027+0000","last_change":"2024-03-27T07:21:35.561505+0000","last_active":"2024-03-27T07:23:35.223027+0000","last_peered":"2024-03-27T07:23:35.223027+0000","last_clean":"2024-03-27T07:23:35.223027+0000","last_became_active":"2024-03-27T07:21:35.561166+0000","last_became_peered":"2024-03-27T07:21:35.561166+0000","last_unstale":"2024-03-27T07:23:35.223027+0000","last_undegraded":"2024-03-27T07:23:35.223027+0000","last_fullsized":"2024-03-27T07:23:35.223027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:59.179147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948097+0000","last_change":"2024-03-27T07:22:27.704448+0000","last_active":"2024-03-27T07:23:34.948097+0000","last_peered":"2024-03-27T07:23:34.948097+0000","last_clean":"2024-03-27T07:23:34.948097+0000","last_became_active":"2024-03-27T07:22:27.696496+0000","last_became_peered":"2024-03-27T07:22:27.696496+0000","last_unstale":"2024-03-27T07:23:34.948097+0000","last_undegraded":"2024-03-27T07:23:34.948097+0000","last_fullsized":"2024-03-27T07:23:34.948097+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:05.114224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224840+0000","last_change":"2024-03-27T07:21:35.574795+0000","last_active":"2024-03-27T07:23:35.224840+0000","last_peered":"2024-03-27T07:23:35.224840+0000","last_clean":"2024-03-27T07:23:35.224840+0000","last_became_active":"2024-03-27T07:21:35.574534+0000","last_became_peered":"2024-03-27T07:21:35.574534+0000","last_unstale":"2024-03-27T07:23:35.224840+0000","last_undegraded":"2024-03-27T07:23:35.224840+0000","last_fullsized":"2024-03-27T07:23:35.224840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:46:44.777575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064528+0000","last_change":"2024-03-27T07:21:34.555772+0000","last_active":"2024-03-27T07:23:35.064528+0000","last_peered":"2024-03-27T07:23:35.064528+0000","last_clean":"2024-03-27T07:23:35.064528+0000","last_became_active":"2024-03-27T07:21:34.555430+0000","last_became_peered":"2024-03-27T07:21:34.555430+0000","last_unstale":"2024-03-27T07:23:35.064528+0000","last_undegraded":"2024-03-27T07:23:35.064528+0000","last_fullsized":"2024-03-27T07:23:35.064528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:11:48.058887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222480+0000","last_change":"2024-03-27T07:21:35.573184+0000","last_active":"2024-03-27T07:23:35.222480+0000","last_peered":"2024-03-27T07:23:35.222480+0000","last_clean":"2024-03-27T07:23:35.222480+0000","last_became_active":"2024-03-27T07:21:35.572776+0000","last_became_peered":"2024-03-27T07:21:35.572776+0000","last_unstale":"2024-03-27T07:23:35.222480+0000","last_undegraded":"2024-03-27T07:23:35.222480+0000","last_fullsized":"2024-03-27T07:23:35.222480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:03.122229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'36","reported_seq":302,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.722496+0000","last_change":"2024-03-27T07:21:34.563221+0000","last_active":"2024-03-27T07:23:35.722496+0000","last_peered":"2024-03-27T07:23:35.722496+0000","last_clean":"2024-03-27T07:23:35.722496+0000","last_became_active":"2024-03-27T07:21:34.562679+0000","last_became_peered":"2024-03-27T07:21:34.562679+0000","last_unstale":"2024-03-27T07:23:35.722496+0000","last_undegraded":"2024-03-27T07:23:35.722496+0000","last_fullsized":"2024-03-27T07:23:35.722496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:59.795906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67758,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":188,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482984+0000","last_change":"2024-03-27T07:21:35.573408+0000","last_active":"2024-03-27T07:23:35.482984+0000","last_peered":"2024-03-27T07:23:35.482984+0000","last_clean":"2024-03-27T07:23:35.482984+0000","last_became_active":"2024-03-27T07:21:35.572912+0000","last_became_peered":"2024-03-27T07:21:35.572912+0000","last_unstale":"2024-03-27T07:23:35.482984+0000","last_undegraded":"2024-03-27T07:23:35.482984+0000","last_fullsized":"2024-03-27T07:23:35.482984+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:13.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948036+0000","last_change":"2024-03-27T07:21:34.562237+0000","last_active":"2024-03-27T07:23:34.948036+0000","last_peered":"2024-03-27T07:23:34.948036+0000","last_clean":"2024-03-27T07:23:34.948036+0000","last_became_active":"2024-03-27T07:21:34.561895+0000","last_became_peered":"2024-03-27T07:21:34.561895+0000","last_unstale":"2024-03-27T07:23:34.948036+0000","last_undegraded":"2024-03-27T07:23:34.948036+0000","last_fullsized":"2024-03-27T07:23:34.948036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:39:09.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221949+0000","last_change":"2024-03-27T07:21:35.571870+0000","last_active":"2024-03-27T07:23:35.221949+0000","last_peered":"2024-03-27T07:23:35.221949+0000","last_clean":"2024-03-27T07:23:35.221949+0000","last_became_active":"2024-03-27T07:21:35.571272+0000","last_became_peered":"2024-03-27T07:21:35.571272+0000","last_unstale":"2024-03-27T07:23:35.221949+0000","last_undegraded":"2024-03-27T07:23:35.221949+0000","last_fullsized":"2024-03-27T07:23:35.221949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:08:08.374114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064239+0000","last_change":"2024-03-27T07:21:34.563257+0000","last_active":"2024-03-27T07:23:35.064239+0000","last_peered":"2024-03-27T07:23:35.064239+0000","last_clean":"2024-03-27T07:23:35.064239+0000","last_became_active":"2024-03-27T07:21:34.562777+0000","last_became_peered":"2024-03-27T07:21:34.562777+0000","last_unstale":"2024-03-27T07:23:35.064239+0000","last_undegraded":"2024-03-27T07:23:35.064239+0000","last_fullsized":"2024-03-27T07:23:35.064239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:03.873185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947870+0000","last_change":"2024-03-27T07:21:35.568039+0000","last_active":"2024-03-27T07:23:34.947870+0000","last_peered":"2024-03-27T07:23:34.947870+0000","last_clean":"2024-03-27T07:23:34.947870+0000","last_became_active":"2024-03-27T07:21:35.567680+0000","last_became_peered":"2024-03-27T07:21:35.567680+0000","last_unstale":"2024-03-27T07:23:34.947870+0000","last_undegraded":"2024-03-27T07:23:34.947870+0000","last_fullsized":"2024-03-27T07:23:34.947870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:51:31.223267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":145,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.721821+0000","last_change":"2024-03-27T07:21:34.560885+0000","last_active":"2024-03-27T07:23:35.721821+0000","last_peered":"2024-03-27T07:23:35.721821+0000","last_clean":"2024-03-27T07:23:35.721821+0000","last_became_active":"2024-03-27T07:21:34.560431+0000","last_became_peered":"2024-03-27T07:21:34.560431+0000","last_unstale":"2024-03-27T07:23:35.721821+0000","last_undegraded":"2024-03-27T07:23:35.721821+0000","last_fullsized":"2024-03-27T07:23:35.721821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:19:00.526827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947636+0000","last_change":"2024-03-27T07:21:35.569293+0000","last_active":"2024-03-27T07:23:34.947636+0000","last_peered":"2024-03-27T07:23:34.947636+0000","last_clean":"2024-03-27T07:23:34.947636+0000","last_became_active":"2024-03-27T07:21:35.568962+0000","last_became_peered":"2024-03-27T07:21:35.568962+0000","last_unstale":"2024-03-27T07:23:34.947636+0000","last_undegraded":"2024-03-27T07:23:34.947636+0000","last_fullsized":"2024-03-27T07:23:34.947636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:14:09.947298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482624+0000","last_change":"2024-03-27T07:21:34.569232+0000","last_active":"2024-03-27T07:23:35.482624+0000","last_peered":"2024-03-27T07:23:35.482624+0000","last_clean":"2024-03-27T07:23:35.482624+0000","last_became_active":"2024-03-27T07:21:34.568900+0000","last_became_peered":"2024-03-27T07:21:34.568900+0000","last_unstale":"2024-03-27T07:23:35.482624+0000","last_undegraded":"2024-03-27T07:23:35.482624+0000","last_fullsized":"2024-03-27T07:23:35.482624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:27:55.489262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064095+0000","last_change":"2024-03-27T07:21:35.577020+0000","last_active":"2024-03-27T07:23:35.064095+0000","last_peered":"2024-03-27T07:23:35.064095+0000","last_clean":"2024-03-27T07:23:35.064095+0000","last_became_active":"2024-03-27T07:21:35.576696+0000","last_became_peered":"2024-03-27T07:21:35.576696+0000","last_unstale":"2024-03-27T07:23:35.064095+0000","last_undegraded":"2024-03-27T07:23:35.064095+0000","last_fullsized":"2024-03-27T07:23:35.064095+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:37:35.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483182+0000","last_change":"2024-03-27T07:21:34.562496+0000","last_active":"2024-03-27T07:23:35.483182+0000","last_peered":"2024-03-27T07:23:35.483182+0000","last_clean":"2024-03-27T07:23:35.483182+0000","last_became_active":"2024-03-27T07:21:34.562166+0000","last_became_peered":"2024-03-27T07:21:34.562166+0000","last_unstale":"2024-03-27T07:23:35.483182+0000","last_undegraded":"2024-03-27T07:23:35.483182+0000","last_fullsized":"2024-03-27T07:23:35.483182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:38.828496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057091+0000","last_change":"2024-03-27T07:22:27.696771+0000","last_active":"2024-03-27T07:23:35.057091+0000","last_peered":"2024-03-27T07:23:35.057091+0000","last_clean":"2024-03-27T07:23:35.057091+0000","last_became_active":"2024-03-27T07:22:27.696289+0000","last_became_peered":"2024-03-27T07:22:27.696289+0000","last_unstale":"2024-03-27T07:23:35.057091+0000","last_undegraded":"2024-03-27T07:23:35.057091+0000","last_fullsized":"2024-03-27T07:23:35.057091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:46.675105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949141+0000","last_change":"2024-03-27T07:21:34.560289+0000","last_active":"2024-03-27T07:23:34.949141+0000","last_peered":"2024-03-27T07:23:34.949141+0000","last_clean":"2024-03-27T07:23:34.949141+0000","last_became_active":"2024-03-27T07:21:34.559985+0000","last_became_peered":"2024-03-27T07:21:34.559985+0000","last_unstale":"2024-03-27T07:23:34.949141+0000","last_undegraded":"2024-03-27T07:23:34.949141+0000","last_fullsized":"2024-03-27T07:23:34.949141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:45:46.611725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067662+0000","last_change":"2024-03-27T07:21:35.579626+0000","last_active":"2024-03-27T07:23:35.067662+0000","last_peered":"2024-03-27T07:23:35.067662+0000","last_clean":"2024-03-27T07:23:35.067662+0000","last_became_active":"2024-03-27T07:21:35.579173+0000","last_became_peered":"2024-03-27T07:21:35.579173+0000","last_unstale":"2024-03-27T07:23:35.067662+0000","last_undegraded":"2024-03-27T07:23:35.067662+0000","last_fullsized":"2024-03-27T07:23:35.067662+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:56:48.015958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947779+0000","last_change":"2024-03-27T07:21:34.568216+0000","last_active":"2024-03-27T07:23:34.947779+0000","last_peered":"2024-03-27T07:23:34.947779+0000","last_clean":"2024-03-27T07:23:34.947779+0000","last_became_active":"2024-03-27T07:21:34.567468+0000","last_became_peered":"2024-03-27T07:21:34.567468+0000","last_unstale":"2024-03-27T07:23:34.947779+0000","last_undegraded":"2024-03-27T07:23:34.947779+0000","last_fullsized":"2024-03-27T07:23:34.947779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:44:50.359865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067551+0000","last_change":"2024-03-27T07:21:35.574614+0000","last_active":"2024-03-27T07:23:35.067551+0000","last_peered":"2024-03-27T07:23:35.067551+0000","last_clean":"2024-03-27T07:23:35.067551+0000","last_became_active":"2024-03-27T07:21:35.574274+0000","last_became_peered":"2024-03-27T07:21:35.574274+0000","last_unstale":"2024-03-27T07:23:35.067551+0000","last_undegraded":"2024-03-27T07:23:35.067551+0000","last_fullsized":"2024-03-27T07:23:35.067551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:57.744066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064155+0000","last_change":"2024-03-27T07:21:35.573196+0000","last_active":"2024-03-27T07:23:35.064155+0000","last_peered":"2024-03-27T07:23:35.064155+0000","last_clean":"2024-03-27T07:23:35.064155+0000","last_became_active":"2024-03-27T07:21:35.572852+0000","last_became_peered":"2024-03-27T07:21:35.572852+0000","last_unstale":"2024-03-27T07:23:35.064155+0000","last_undegraded":"2024-03-27T07:23:35.064155+0000","last_fullsized":"2024-03-27T07:23:35.064155+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:00.478573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.721385+0000","last_change":"2024-03-27T07:21:34.566380+0000","last_active":"2024-03-27T07:23:35.721385+0000","last_peered":"2024-03-27T07:23:35.721385+0000","last_clean":"2024-03-27T07:23:35.721385+0000","last_became_active":"2024-03-27T07:21:34.566034+0000","last_became_peered":"2024-03-27T07:21:34.566034+0000","last_unstale":"2024-03-27T07:23:35.721385+0000","last_undegraded":"2024-03-27T07:23:35.721385+0000","last_fullsized":"2024-03-27T07:23:35.721385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:06.470957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058293+0000","last_change":"2024-03-27T07:21:35.576149+0000","last_active":"2024-03-27T07:23:35.058293+0000","last_peered":"2024-03-27T07:23:35.058293+0000","last_clean":"2024-03-27T07:23:35.058293+0000","last_became_active":"2024-03-27T07:21:35.573628+0000","last_became_peered":"2024-03-27T07:21:35.573628+0000","last_unstale":"2024-03-27T07:23:35.058293+0000","last_undegraded":"2024-03-27T07:23:35.058293+0000","last_fullsized":"2024-03-27T07:23:35.058293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:37:06.571848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224109+0000","last_change":"2024-03-27T07:21:34.555206+0000","last_active":"2024-03-27T07:23:35.224109+0000","last_peered":"2024-03-27T07:23:35.224109+0000","last_clean":"2024-03-27T07:23:35.224109+0000","last_became_active":"2024-03-27T07:21:34.554789+0000","last_became_peered":"2024-03-27T07:21:34.554789+0000","last_unstale":"2024-03-27T07:23:35.224109+0000","last_undegraded":"2024-03-27T07:23:35.224109+0000","last_fullsized":"2024-03-27T07:23:35.224109+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:24:37.211394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":357,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947736+0000","last_change":"2024-03-27T07:20:20.641816+0000","last_active":"2024-03-27T07:23:34.947736+0000","last_peered":"2024-03-27T07:23:34.947736+0000","last_clean":"2024-03-27T07:23:34.947736+0000","last_became_active":"2024-03-27T07:20:20.641398+0000","last_became_peered":"2024-03-27T07:20:20.641398+0000","last_unstale":"2024-03-27T07:23:34.947736+0000","last_undegraded":"2024-03-27T07:23:34.947736+0000","last_fullsized":"2024-03-27T07:23:34.947736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_clean_scrub_stamp":"2024-03-27T07:16:54.496466+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:52:56.728469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221593+0000","last_change":"2024-03-27T07:21:35.562594+0000","last_active":"2024-03-27T07:23:35.221593+0000","last_peered":"2024-03-27T07:23:35.221593+0000","last_clean":"2024-03-27T07:23:35.221593+0000","last_became_active":"2024-03-27T07:21:35.562287+0000","last_became_peered":"2024-03-27T07:21:35.562287+0000","last_unstale":"2024-03-27T07:23:35.221593+0000","last_undegraded":"2024-03-27T07:23:35.221593+0000","last_fullsized":"2024-03-27T07:23:35.221593+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:38:25.172452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948003+0000","last_change":"2024-03-27T07:21:34.564569+0000","last_active":"2024-03-27T07:23:34.948003+0000","last_peered":"2024-03-27T07:23:34.948003+0000","last_clean":"2024-03-27T07:23:34.948003+0000","last_became_active":"2024-03-27T07:21:34.563830+0000","last_became_peered":"2024-03-27T07:21:34.563830+0000","last_unstale":"2024-03-27T07:23:34.948003+0000","last_undegraded":"2024-03-27T07:23:34.948003+0000","last_fullsized":"2024-03-27T07:23:34.948003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:46:19.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483051+0000","last_change":"2024-03-27T07:21:34.569447+0000","last_active":"2024-03-27T07:23:35.483051+0000","last_peered":"2024-03-27T07:23:35.483051+0000","last_clean":"2024-03-27T07:23:35.483051+0000","last_became_active":"2024-03-27T07:21:34.569096+0000","last_became_peered":"2024-03-27T07:21:34.569096+0000","last_unstale":"2024-03-27T07:23:35.483051+0000","last_undegraded":"2024-03-27T07:23:35.483051+0000","last_fullsized":"2024-03-27T07:23:35.483051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:49:00.695556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222018+0000","last_change":"2024-03-27T07:21:35.558620+0000","last_active":"2024-03-27T07:23:35.222018+0000","last_peered":"2024-03-27T07:23:35.222018+0000","last_clean":"2024-03-27T07:23:35.222018+0000","last_became_active":"2024-03-27T07:21:35.557559+0000","last_became_peered":"2024-03-27T07:21:35.557559+0000","last_unstale":"2024-03-27T07:23:35.222018+0000","last_undegraded":"2024-03-27T07:23:35.222018+0000","last_fullsized":"2024-03-27T07:23:35.222018+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:09:03.236893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'45","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.181910+0000","last_change":"2024-03-27T07:22:27.674005+0000","last_active":"2024-03-27T07:23:35.181910+0000","last_peered":"2024-03-27T07:23:35.181910+0000","last_clean":"2024-03-27T07:23:35.181910+0000","last_became_active":"2024-03-27T07:22:27.670596+0000","last_became_peered":"2024-03-27T07:22:27.670596+0000","last_unstale":"2024-03-27T07:23:35.181910+0000","last_undegraded":"2024-03-27T07:23:35.181910+0000","last_fullsized":"2024-03-27T07:23:35.181910+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:38:43.398885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":80,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058871+0000","last_change":"2024-03-27T07:21:35.573345+0000","last_active":"2024-03-27T07:23:35.058871+0000","last_peered":"2024-03-27T07:23:35.058871+0000","last_clean":"2024-03-27T07:23:35.058871+0000","last_became_active":"2024-03-27T07:21:35.573037+0000","last_became_peered":"2024-03-27T07:21:35.573037+0000","last_unstale":"2024-03-27T07:23:35.058871+0000","last_undegraded":"2024-03-27T07:23:35.058871+0000","last_fullsized":"2024-03-27T07:23:35.058871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:07:49.834272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.223649+0000","last_change":"2024-03-27T07:21:34.558738+0000","last_active":"2024-03-27T07:23:35.223649+0000","last_peered":"2024-03-27T07:23:35.223649+0000","last_clean":"2024-03-27T07:23:35.223649+0000","last_became_active":"2024-03-27T07:21:34.558353+0000","last_became_peered":"2024-03-27T07:21:34.558353+0000","last_unstale":"2024-03-27T07:23:35.223649+0000","last_undegraded":"2024-03-27T07:23:35.223649+0000","last_fullsized":"2024-03-27T07:23:35.223649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:46:07.816121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224640+0000","last_change":"2024-03-27T07:21:35.575747+0000","last_active":"2024-03-27T07:23:35.224640+0000","last_peered":"2024-03-27T07:23:35.224640+0000","last_clean":"2024-03-27T07:23:35.224640+0000","last_became_active":"2024-03-27T07:21:35.575382+0000","last_became_peered":"2024-03-27T07:21:35.575382+0000","last_unstale":"2024-03-27T07:23:35.224640+0000","last_undegraded":"2024-03-27T07:23:35.224640+0000","last_fullsized":"2024-03-27T07:23:35.224640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:10:03.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221937+0000","last_change":"2024-03-27T07:21:34.563713+0000","last_active":"2024-03-27T07:23:35.221937+0000","last_peered":"2024-03-27T07:23:35.221937+0000","last_clean":"2024-03-27T07:23:35.221937+0000","last_became_active":"2024-03-27T07:21:34.563356+0000","last_became_peered":"2024-03-27T07:21:34.563356+0000","last_unstale":"2024-03-27T07:23:35.221937+0000","last_undegraded":"2024-03-27T07:23:35.221937+0000","last_fullsized":"2024-03-27T07:23:35.221937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:48:11.366029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482627+0000","last_change":"2024-03-27T07:21:35.569912+0000","last_active":"2024-03-27T07:23:35.482627+0000","last_peered":"2024-03-27T07:23:35.482627+0000","last_clean":"2024-03-27T07:23:35.482627+0000","last_became_active":"2024-03-27T07:21:35.569546+0000","last_became_peered":"2024-03-27T07:21:35.569546+0000","last_unstale":"2024-03-27T07:23:35.482627+0000","last_undegraded":"2024-03-27T07:23:35.482627+0000","last_fullsized":"2024-03-27T07:23:35.482627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:45:18.146654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057895+0000","last_change":"2024-03-27T07:21:34.557719+0000","last_active":"2024-03-27T07:23:35.057895+0000","last_peered":"2024-03-27T07:23:35.057895+0000","last_clean":"2024-03-27T07:23:35.057895+0000","last_became_active":"2024-03-27T07:21:34.557360+0000","last_became_peered":"2024-03-27T07:21:34.557360+0000","last_unstale":"2024-03-27T07:23:35.057895+0000","last_undegraded":"2024-03-27T07:23:35.057895+0000","last_fullsized":"2024-03-27T07:23:35.057895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:24:47.002674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056806+0000","last_change":"2024-03-27T07:21:35.578259+0000","last_active":"2024-03-27T07:23:35.056806+0000","last_peered":"2024-03-27T07:23:35.056806+0000","last_clean":"2024-03-27T07:23:35.056806+0000","last_became_active":"2024-03-27T07:21:35.574765+0000","last_became_peered":"2024-03-27T07:21:35.574765+0000","last_unstale":"2024-03-27T07:23:35.056806+0000","last_undegraded":"2024-03-27T07:23:35.056806+0000","last_fullsized":"2024-03-27T07:23:35.056806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:34:49.358416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056872+0000","last_change":"2024-03-27T07:22:27.671151+0000","last_active":"2024-03-27T07:23:35.056872+0000","last_peered":"2024-03-27T07:23:35.056872+0000","last_clean":"2024-03-27T07:23:35.056872+0000","last_became_active":"2024-03-27T07:22:27.667575+0000","last_became_peered":"2024-03-27T07:22:27.667575+0000","last_unstale":"2024-03-27T07:23:35.056872+0000","last_undegraded":"2024-03-27T07:23:35.056872+0000","last_fullsized":"2024-03-27T07:23:35.056872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:20:51.954730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058599+0000","last_change":"2024-03-27T07:21:35.577445+0000","last_active":"2024-03-27T07:23:35.058599+0000","last_peered":"2024-03-27T07:23:35.058599+0000","last_clean":"2024-03-27T07:23:35.058599+0000","last_became_active":"2024-03-27T07:21:35.577110+0000","last_became_peered":"2024-03-27T07:21:35.577110+0000","last_unstale":"2024-03-27T07:23:35.058599+0000","last_undegraded":"2024-03-27T07:23:35.058599+0000","last_fullsized":"2024-03-27T07:23:35.058599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:36:45.919519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482738+0000","last_change":"2024-03-27T07:21:34.567744+0000","last_active":"2024-03-27T07:23:35.482738+0000","last_peered":"2024-03-27T07:23:35.482738+0000","last_clean":"2024-03-27T07:23:35.482738+0000","last_became_active":"2024-03-27T07:21:34.567412+0000","last_became_peered":"2024-03-27T07:21:34.567412+0000","last_unstale":"2024-03-27T07:23:35.482738+0000","last_undegraded":"2024-03-27T07:23:35.482738+0000","last_fullsized":"2024-03-27T07:23:35.482738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:37:07.075048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947849+0000","last_change":"2024-03-27T07:21:35.570287+0000","last_active":"2024-03-27T07:23:34.947849+0000","last_peered":"2024-03-27T07:23:34.947849+0000","last_clean":"2024-03-27T07:23:34.947849+0000","last_became_active":"2024-03-27T07:21:35.569194+0000","last_became_peered":"2024-03-27T07:21:35.569194+0000","last_unstale":"2024-03-27T07:23:34.947849+0000","last_undegraded":"2024-03-27T07:23:34.947849+0000","last_fullsized":"2024-03-27T07:23:34.947849+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:01:44.155291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948171+0000","last_change":"2024-03-27T07:21:34.561420+0000","last_active":"2024-03-27T07:23:34.948171+0000","last_peered":"2024-03-27T07:23:34.948171+0000","last_clean":"2024-03-27T07:23:34.948171+0000","last_became_active":"2024-03-27T07:21:34.560923+0000","last_became_peered":"2024-03-27T07:21:34.560923+0000","last_unstale":"2024-03-27T07:23:34.948171+0000","last_undegraded":"2024-03-27T07:23:34.948171+0000","last_fullsized":"2024-03-27T07:23:34.948171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:39:48.256790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948314+0000","last_change":"2024-03-27T07:21:35.571317+0000","last_active":"2024-03-27T07:23:34.948314+0000","last_peered":"2024-03-27T07:23:34.948314+0000","last_clean":"2024-03-27T07:23:34.948314+0000","last_became_active":"2024-03-27T07:21:35.570237+0000","last_became_peered":"2024-03-27T07:21:35.570237+0000","last_unstale":"2024-03-27T07:23:34.948314+0000","last_undegraded":"2024-03-27T07:23:34.948314+0000","last_fullsized":"2024-03-27T07:23:34.948314+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:09:53.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'39","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.175735+0000","last_change":"2024-03-27T07:21:34.553377+0000","last_active":"2024-03-27T07:23:35.175735+0000","last_peered":"2024-03-27T07:23:35.175735+0000","last_clean":"2024-03-27T07:23:35.175735+0000","last_became_active":"2024-03-27T07:21:34.553050+0000","last_became_peered":"2024-03-27T07:21:34.553050+0000","last_unstale":"2024-03-27T07:23:35.175735+0000","last_undegraded":"2024-03-27T07:23:35.175735+0000","last_fullsized":"2024-03-27T07:23:35.175735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:03.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947957+0000","last_change":"2024-03-27T07:21:35.572384+0000","last_active":"2024-03-27T07:23:34.947957+0000","last_peered":"2024-03-27T07:23:34.947957+0000","last_clean":"2024-03-27T07:23:34.947957+0000","last_became_active":"2024-03-27T07:21:35.572071+0000","last_became_peered":"2024-03-27T07:21:35.572071+0000","last_unstale":"2024-03-27T07:23:34.947957+0000","last_undegraded":"2024-03-27T07:23:34.947957+0000","last_fullsized":"2024-03-27T07:23:34.947957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:03:04.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222498+0000","last_change":"2024-03-27T07:21:34.559187+0000","last_active":"2024-03-27T07:23:35.222498+0000","last_peered":"2024-03-27T07:23:35.222498+0000","last_clean":"2024-03-27T07:23:35.222498+0000","last_became_active":"2024-03-27T07:21:34.558675+0000","last_became_peered":"2024-03-27T07:21:34.558675+0000","last_unstale":"2024-03-27T07:23:35.222498+0000","last_undegraded":"2024-03-27T07:23:35.222498+0000","last_fullsized":"2024-03-27T07:23:35.222498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:41.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948473+0000","last_change":"2024-03-27T07:21:35.576440+0000","last_active":"2024-03-27T07:23:34.948473+0000","last_peered":"2024-03-27T07:23:34.948473+0000","last_clean":"2024-03-27T07:23:34.948473+0000","last_became_active":"2024-03-27T07:21:35.576143+0000","last_became_peered":"2024-03-27T07:21:35.576143+0000","last_unstale":"2024-03-27T07:23:34.948473+0000","last_undegraded":"2024-03-27T07:23:34.948473+0000","last_fullsized":"2024-03-27T07:23:34.948473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:31:29.400053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056874+0000","last_change":"2024-03-27T07:21:35.565760+0000","last_active":"2024-03-27T07:23:35.056874+0000","last_peered":"2024-03-27T07:23:35.056874+0000","last_clean":"2024-03-27T07:23:35.056874+0000","last_became_active":"2024-03-27T07:21:35.565351+0000","last_became_peered":"2024-03-27T07:21:35.565351+0000","last_unstale":"2024-03-27T07:23:35.056874+0000","last_undegraded":"2024-03-27T07:23:35.056874+0000","last_fullsized":"2024-03-27T07:23:35.056874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:16.871912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947900+0000","last_change":"2024-03-27T07:21:35.564100+0000","last_active":"2024-03-27T07:23:34.947900+0000","last_peered":"2024-03-27T07:23:34.947900+0000","last_clean":"2024-03-27T07:23:34.947900+0000","last_became_active":"2024-03-27T07:21:35.563748+0000","last_became_peered":"2024-03-27T07:21:35.563748+0000","last_unstale":"2024-03-27T07:23:34.947900+0000","last_undegraded":"2024-03-27T07:23:34.947900+0000","last_fullsized":"2024-03-27T07:23:34.947900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:19:30.742692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947885+0000","last_change":"2024-03-27T07:21:35.575036+0000","last_active":"2024-03-27T07:23:34.947885+0000","last_peered":"2024-03-27T07:23:34.947885+0000","last_clean":"2024-03-27T07:23:34.947885+0000","last_became_active":"2024-03-27T07:21:35.574689+0000","last_became_peered":"2024-03-27T07:21:35.574689+0000","last_unstale":"2024-03-27T07:23:34.947885+0000","last_undegraded":"2024-03-27T07:23:34.947885+0000","last_fullsized":"2024-03-27T07:23:34.947885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:50:40.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224610+0000","last_change":"2024-03-27T07:21:35.577814+0000","last_active":"2024-03-27T07:23:35.224610+0000","last_peered":"2024-03-27T07:23:35.224610+0000","last_clean":"2024-03-27T07:23:35.224610+0000","last_became_active":"2024-03-27T07:21:35.576265+0000","last_became_peered":"2024-03-27T07:21:35.576265+0000","last_unstale":"2024-03-27T07:23:35.224610+0000","last_undegraded":"2024-03-27T07:23:35.224610+0000","last_fullsized":"2024-03-27T07:23:35.224610+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:04.523768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222189+0000","last_change":"2024-03-27T07:21:35.568753+0000","last_active":"2024-03-27T07:23:35.222189+0000","last_peered":"2024-03-27T07:23:35.222189+0000","last_clean":"2024-03-27T07:23:35.222189+0000","last_became_active":"2024-03-27T07:21:35.568441+0000","last_became_peered":"2024-03-27T07:21:35.568441+0000","last_unstale":"2024-03-27T07:23:35.222189+0000","last_undegraded":"2024-03-27T07:23:35.222189+0000","last_fullsized":"2024-03-27T07:23:35.222189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:32:54.294960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057086+0000","last_change":"2024-03-27T07:21:35.573094+0000","last_active":"2024-03-27T07:23:35.057086+0000","last_peered":"2024-03-27T07:23:35.057086+0000","last_clean":"2024-03-27T07:23:35.057086+0000","last_became_active":"2024-03-27T07:21:35.572739+0000","last_became_peered":"2024-03-27T07:21:35.572739+0000","last_unstale":"2024-03-27T07:23:35.057086+0000","last_undegraded":"2024-03-27T07:23:35.057086+0000","last_fullsized":"2024-03-27T07:23:35.057086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:02.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948312+0000","last_change":"2024-03-27T07:21:35.580647+0000","last_active":"2024-03-27T07:23:34.948312+0000","last_peered":"2024-03-27T07:23:34.948312+0000","last_clean":"2024-03-27T07:23:34.948312+0000","last_became_active":"2024-03-27T07:21:35.580230+0000","last_became_peered":"2024-03-27T07:21:35.580230+0000","last_unstale":"2024-03-27T07:23:34.948312+0000","last_undegraded":"2024-03-27T07:23:34.948312+0000","last_fullsized":"2024-03-27T07:23:34.948312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:04:37.573021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057728+0000","last_change":"2024-03-27T07:21:35.568859+0000","last_active":"2024-03-27T07:23:35.057728+0000","last_peered":"2024-03-27T07:23:35.057728+0000","last_clean":"2024-03-27T07:23:35.057728+0000","last_became_active":"2024-03-27T07:21:35.568468+0000","last_became_peered":"2024-03-27T07:21:35.568468+0000","last_unstale":"2024-03-27T07:23:35.057728+0000","last_undegraded":"2024-03-27T07:23:35.057728+0000","last_fullsized":"2024-03-27T07:23:35.057728+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:44:59.875882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064061+0000","last_change":"2024-03-27T07:21:35.568485+0000","last_active":"2024-03-27T07:23:35.064061+0000","last_peered":"2024-03-27T07:23:35.064061+0000","last_clean":"2024-03-27T07:23:35.064061+0000","last_became_active":"2024-03-27T07:21:35.568154+0000","last_became_peered":"2024-03-27T07:21:35.568154+0000","last_unstale":"2024-03-27T07:23:35.064061+0000","last_undegraded":"2024-03-27T07:23:35.064061+0000","last_fullsized":"2024-03-27T07:23:35.064061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:08:29.418189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057815+0000","last_change":"2024-03-27T07:21:35.567369+0000","last_active":"2024-03-27T07:23:35.057815+0000","last_peered":"2024-03-27T07:23:35.057815+0000","last_clean":"2024-03-27T07:23:35.057815+0000","last_became_active":"2024-03-27T07:21:35.564602+0000","last_became_peered":"2024-03-27T07:21:35.564602+0000","last_unstale":"2024-03-27T07:23:35.057815+0000","last_undegraded":"2024-03-27T07:23:35.057815+0000","last_fullsized":"2024-03-27T07:23:35.057815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:23:15.123502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222268+0000","last_change":"2024-03-27T07:21:35.572580+0000","last_active":"2024-03-27T07:23:35.222268+0000","last_peered":"2024-03-27T07:23:35.222268+0000","last_clean":"2024-03-27T07:23:35.222268+0000","last_became_active":"2024-03-27T07:21:35.572245+0000","last_became_peered":"2024-03-27T07:21:35.572245+0000","last_unstale":"2024-03-27T07:23:35.222268+0000","last_undegraded":"2024-03-27T07:23:35.222268+0000","last_fullsized":"2024-03-27T07:23:35.222268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:45:56.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222009+0000","last_change":"2024-03-27T07:21:35.584975+0000","last_active":"2024-03-27T07:23:35.222009+0000","last_peered":"2024-03-27T07:23:35.222009+0000","last_clean":"2024-03-27T07:23:35.222009+0000","last_became_active":"2024-03-27T07:21:35.584579+0000","last_became_peered":"2024-03-27T07:21:35.584579+0000","last_unstale":"2024-03-27T07:23:35.222009+0000","last_undegraded":"2024-03-27T07:23:35.222009+0000","last_fullsized":"2024-03-27T07:23:35.222009+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:22:44.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056880+0000","last_change":"2024-03-27T07:21:35.573496+0000","last_active":"2024-03-27T07:23:35.056880+0000","last_peered":"2024-03-27T07:23:35.056880+0000","last_clean":"2024-03-27T07:23:35.056880+0000","last_became_active":"2024-03-27T07:21:35.572946+0000","last_became_peered":"2024-03-27T07:21:35.572946+0000","last_unstale":"2024-03-27T07:23:35.056880+0000","last_undegraded":"2024-03-27T07:23:35.056880+0000","last_fullsized":"2024-03-27T07:23:35.056880+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:37:50.236828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107082,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597806,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":828,"num_read_kb":524,"num_write":287,"num_write_kb":1437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":582,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1793418,"data_compressed":81513,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351013,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":863566,"data_compressed":22025,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612650,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1142784,"data_stored":1261580,"data_compressed":46598,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776176,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1007616,"data_stored":863802,"data_compressed":22025,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037813,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":469924,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":1062885,"data_compressed":38573,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495678,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":469975,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":537526,"data_compressed":4748,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":991232,"data_stored":471246,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1060864,"data_stored":540107,"data_compressed":4748,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":995102,"data_compressed":28181,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920842,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":471385,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":1194560,"data_compressed":44729,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":67758,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70339,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134307,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":201327,"data_compressed":8025,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T07:23:37.598 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-03-27T07:23:37.599 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T07:23:37.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.737+0000 7fba6ce39640 1 -- 172.21.15.82:0/3619590158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba68100a70 msgr2=0x7fba68100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.737+0000 7fba6ce39640 1 --2- 172.21.15.82:0/3619590158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba68100a70 0x7fba68100e90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba58009900 tx=0x7fba5802bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:37.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.737+0000 7fba6ce39640 1 -- 172.21.15.82:0/3619590158 shutdown_connections 2024-03-27T07:23:37.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.737+0000 7fba6ce39640 1 --2- 172.21.15.82:0/3619590158 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba68102620 0x7fba68108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.737+0000 7fba6ce39640 1 --2- 172.21.15.82:0/3619590158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba68101c60 0x7fba681020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.737+0000 7fba6ce39640 1 --2- 172.21.15.82:0/3619590158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba68100a70 0x7fba68100e90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.737+0000 7fba6ce39640 1 -- 172.21.15.82:0/3619590158 >> 172.21.15.82:0/3619590158 conn(0x7fba680fbfe0 msgr2=0x7fba680fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:37.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.737+0000 7fba6ce39640 1 -- 172.21.15.82:0/3619590158 shutdown_connections 2024-03-27T07:23:37.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.737+0000 7fba6ce39640 1 -- 172.21.15.82:0/3619590158 wait complete. 2024-03-27T07:23:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6ce39640 1 Processor -- start 2024-03-27T07:23:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6ce39640 1 -- start start 2024-03-27T07:23:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6ce39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba68100a70 0x7fba68104a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6ce39640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba68101c60 0x7fba68103040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6ce39640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba68102620 0x7fba68103580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6ce39640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba6810c730 con 0x7fba68100a70 2024-03-27T07:23:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6ce39640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fba6810c5b0 con 0x7fba68101c60 2024-03-27T07:23:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6ce39640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fba6810c8b0 con 0x7fba68102620 2024-03-27T07:23:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba68100a70 0x7fba68104a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba68100a70 0x7fba68104a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49154/0 (socket says 172.21.15.82:49154) 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6659c640 1 -- 172.21.15.82:0/1956074461 learned_addr learned my addr 172.21.15.82:0/1956074461 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba65d9b640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba68101c60 0x7fba68103040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba66d9d640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba68102620 0x7fba68103580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6659c640 1 -- 172.21.15.82:0/1956074461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba68102620 msgr2=0x7fba68103580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6659c640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba68102620 0x7fba68103580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6659c640 1 -- 172.21.15.82:0/1956074461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba68101c60 msgr2=0x7fba68103040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6659c640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba68101c60 0x7fba68103040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6659c640 1 -- 172.21.15.82:0/1956074461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba68103e10 con 0x7fba68100a70 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba6659c640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba68100a70 0x7fba68104a00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fba58000c00 tx=0x7fba5802c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.738+0000 7fba577fe640 1 -- 172.21.15.82:0/1956074461 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58043020 con 0x7fba68100a70 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.739+0000 7fba577fe640 1 -- 172.21.15.82:0/1956074461 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba580054e0 con 0x7fba68100a70 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.739+0000 7fba6ce39640 1 -- 172.21.15.82:0/1956074461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba681a1fc0 con 0x7fba68100a70 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.739+0000 7fba577fe640 1 -- 172.21.15.82:0/1956074461 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58003ce0 con 0x7fba68100a70 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.739+0000 7fba6ce39640 1 -- 172.21.15.82:0/1956074461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba681a2420 con 0x7fba68100a70 2024-03-27T07:23:37.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.740+0000 7fba6ce39640 1 -- 172.21.15.82:0/1956074461 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba681a25f0 con 0x7fba68100a70 2024-03-27T07:23:37.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.741+0000 7fba577fe640 1 -- 172.21.15.82:0/1956074461 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 21) ==== 138182+0+0 (secure 0 0 0) 0x7fba58046020 con 0x7fba68100a70 2024-03-27T07:23:37.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.742+0000 7fba577fe640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fba500a3410 0x7fba500a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:37.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.742+0000 7fba577fe640 1 -- 172.21.15.82:0/1956074461 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fba580f1ac0 con 0x7fba68100a70 2024-03-27T07:23:37.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.742+0000 7fba65d9b640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fba500a3410 0x7fba500a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:37.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.742+0000 7fba65d9b640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fba500a3410 0x7fba500a58d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fba68104770 tx=0x7fba5c005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:37.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.747+0000 7fba577fe640 1 -- 172.21.15.82:0/1956074461 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fba5804d020 con 0x7fba68100a70 2024-03-27T07:23:37.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.936+0000 7fba6ce39640 1 -- 172.21.15.82:0/1956074461 --> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba680fe1b0 con 0x7fba500a3410 2024-03-27T07:23:37.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.943+0000 7fba577fe640 1 -- 172.21.15.82:0/1956074461 <== mgr.15273 v2:172.21.15.82:6800/573513718 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258022 (secure 0 0 0) 0x7fba680fe1b0 con 0x7fba500a3410 2024-03-27T07:23:37.948 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:37.949 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-03-27T07:23:37.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.946+0000 7fba6ce39640 1 -- 172.21.15.82:0/1956074461 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fba500a3410 msgr2=0x7fba500a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.946+0000 7fba6ce39640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fba500a3410 0x7fba500a58d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fba68104770 tx=0x7fba5c005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:37.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.946+0000 7fba6ce39640 1 -- 172.21.15.82:0/1956074461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba68100a70 msgr2=0x7fba68104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:37.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.946+0000 7fba6ce39640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba68100a70 0x7fba68104a00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fba58000c00 tx=0x7fba5802c6c0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.946+0000 7fba6ce39640 1 -- 172.21.15.82:0/1956074461 shutdown_connections 2024-03-27T07:23:37.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.946+0000 7fba6ce39640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fba500a3410 0x7fba500a58d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.946+0000 7fba6ce39640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba68102620 0x7fba68103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.946+0000 7fba6ce39640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba68101c60 0x7fba68103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.946+0000 7fba6ce39640 1 --2- 172.21.15.82:0/1956074461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba68100a70 0x7fba68104a00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:37.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.946+0000 7fba6ce39640 1 -- 172.21.15.82:0/1956074461 >> 172.21.15.82:0/1956074461 conn(0x7fba680fbfe0 msgr2=0x7fba680fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:37.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.947+0000 7fba6ce39640 1 -- 172.21.15.82:0/1956074461 shutdown_connections 2024-03-27T07:23:37.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:37.947+0000 7fba6ce39640 1 -- 172.21.15.82:0/1956074461 wait complete. 2024-03-27T07:23:37.963 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-03-27T07:23:36.961936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188408,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":964,"num_read_kb":643,"num_write":470,"num_write_kb":4377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":1181318,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":865,"ondisk_log_size":865,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357032,"kb_used_data":12000,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584792,"statfs":{"total":1151940427776,"available":1151574827008,"internally_reserved":0,"allocated":12288000,"data_stored":9201658,"data_compressed":223143,"data_compressed_allocated":294912,"data_compressed_original":3440640,"omap_allocated":19139,"internal_metadata":353154365},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.992646"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057054+0000","last_change":"2024-03-27T07:21:35.577169+0000","last_active":"2024-03-27T07:23:35.057054+0000","last_peered":"2024-03-27T07:23:35.057054+0000","last_clean":"2024-03-27T07:23:35.057054+0000","last_became_active":"2024-03-27T07:21:35.576737+0000","last_became_peered":"2024-03-27T07:21:35.576737+0000","last_unstale":"2024-03-27T07:23:35.057054+0000","last_undegraded":"2024-03-27T07:23:35.057054+0000","last_fullsized":"2024-03-27T07:23:35.057054+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:58:55.152543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.225176+0000","last_change":"2024-03-27T07:21:35.576197+0000","last_active":"2024-03-27T07:23:35.225176+0000","last_peered":"2024-03-27T07:23:35.225176+0000","last_clean":"2024-03-27T07:23:35.225176+0000","last_became_active":"2024-03-27T07:21:35.575876+0000","last_became_peered":"2024-03-27T07:21:35.575876+0000","last_unstale":"2024-03-27T07:23:35.225176+0000","last_undegraded":"2024-03-27T07:23:35.225176+0000","last_fullsized":"2024-03-27T07:23:35.225176+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:23:12.589029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224758+0000","last_change":"2024-03-27T07:21:35.582045+0000","last_active":"2024-03-27T07:23:35.224758+0000","last_peered":"2024-03-27T07:23:35.224758+0000","last_clean":"2024-03-27T07:23:35.224758+0000","last_became_active":"2024-03-27T07:21:35.581710+0000","last_became_peered":"2024-03-27T07:21:35.581710+0000","last_unstale":"2024-03-27T07:23:35.224758+0000","last_undegraded":"2024-03-27T07:23:35.224758+0000","last_fullsized":"2024-03-27T07:23:35.224758+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:47:39.004986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949235+0000","last_change":"2024-03-27T07:22:27.670513+0000","last_active":"2024-03-27T07:23:34.949235+0000","last_peered":"2024-03-27T07:23:34.949235+0000","last_clean":"2024-03-27T07:23:34.949235+0000","last_became_active":"2024-03-27T07:22:27.670263+0000","last_became_peered":"2024-03-27T07:22:27.670263+0000","last_unstale":"2024-03-27T07:23:34.949235+0000","last_undegraded":"2024-03-27T07:23:34.949235+0000","last_fullsized":"2024-03-27T07:23:34.949235+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:32:43.906648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482696+0000","last_change":"2024-03-27T07:21:35.568964+0000","last_active":"2024-03-27T07:23:35.482696+0000","last_peered":"2024-03-27T07:23:35.482696+0000","last_clean":"2024-03-27T07:23:35.482696+0000","last_became_active":"2024-03-27T07:21:35.568607+0000","last_became_peered":"2024-03-27T07:21:35.568607+0000","last_unstale":"2024-03-27T07:23:35.482696+0000","last_undegraded":"2024-03-27T07:23:35.482696+0000","last_fullsized":"2024-03-27T07:23:35.482696+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:26:32.122422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067396+0000","last_change":"2024-03-27T07:21:35.575915+0000","last_active":"2024-03-27T07:23:35.067396+0000","last_peered":"2024-03-27T07:23:35.067396+0000","last_clean":"2024-03-27T07:23:35.067396+0000","last_became_active":"2024-03-27T07:21:35.575604+0000","last_became_peered":"2024-03-27T07:21:35.575604+0000","last_unstale":"2024-03-27T07:23:35.067396+0000","last_undegraded":"2024-03-27T07:23:35.067396+0000","last_fullsized":"2024-03-27T07:23:35.067396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:19:12.698525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947683+0000","last_change":"2024-03-27T07:21:35.570762+0000","last_active":"2024-03-27T07:23:34.947683+0000","last_peered":"2024-03-27T07:23:34.947683+0000","last_clean":"2024-03-27T07:23:34.947683+0000","last_became_active":"2024-03-27T07:21:35.570380+0000","last_became_peered":"2024-03-27T07:21:35.570380+0000","last_unstale":"2024-03-27T07:23:34.947683+0000","last_undegraded":"2024-03-27T07:23:34.947683+0000","last_fullsized":"2024-03-27T07:23:34.947683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:35:04.463674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057560+0000","last_change":"2024-03-27T07:21:35.573220+0000","last_active":"2024-03-27T07:23:35.057560+0000","last_peered":"2024-03-27T07:23:35.057560+0000","last_clean":"2024-03-27T07:23:35.057560+0000","last_became_active":"2024-03-27T07:21:35.572909+0000","last_became_peered":"2024-03-27T07:21:35.572909+0000","last_unstale":"2024-03-27T07:23:35.057560+0000","last_undegraded":"2024-03-27T07:23:35.057560+0000","last_fullsized":"2024-03-27T07:23:35.057560+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:49:51.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.223506+0000","last_change":"2024-03-27T07:21:35.559298+0000","last_active":"2024-03-27T07:23:35.223506+0000","last_peered":"2024-03-27T07:23:35.223506+0000","last_clean":"2024-03-27T07:23:35.223506+0000","last_became_active":"2024-03-27T07:21:35.558968+0000","last_became_peered":"2024-03-27T07:21:35.558968+0000","last_unstale":"2024-03-27T07:23:35.223506+0000","last_undegraded":"2024-03-27T07:23:35.223506+0000","last_fullsized":"2024-03-27T07:23:35.223506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:12:31.027411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067619+0000","last_change":"2024-03-27T07:21:35.577015+0000","last_active":"2024-03-27T07:23:35.067619+0000","last_peered":"2024-03-27T07:23:35.067619+0000","last_clean":"2024-03-27T07:23:35.067619+0000","last_became_active":"2024-03-27T07:21:35.576599+0000","last_became_peered":"2024-03-27T07:21:35.576599+0000","last_unstale":"2024-03-27T07:23:35.067619+0000","last_undegraded":"2024-03-27T07:23:35.067619+0000","last_fullsized":"2024-03-27T07:23:35.067619+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:03.138951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948191+0000","last_change":"2024-03-27T07:21:35.576540+0000","last_active":"2024-03-27T07:23:34.948191+0000","last_peered":"2024-03-27T07:23:34.948191+0000","last_clean":"2024-03-27T07:23:34.948191+0000","last_became_active":"2024-03-27T07:21:35.576101+0000","last_became_peered":"2024-03-27T07:21:35.576101+0000","last_unstale":"2024-03-27T07:23:34.948191+0000","last_undegraded":"2024-03-27T07:23:34.948191+0000","last_fullsized":"2024-03-27T07:23:34.948191+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:13.654970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949003+0000","last_change":"2024-03-27T07:22:27.669089+0000","last_active":"2024-03-27T07:23:34.949003+0000","last_peered":"2024-03-27T07:23:34.949003+0000","last_clean":"2024-03-27T07:23:34.949003+0000","last_became_active":"2024-03-27T07:22:27.668715+0000","last_became_peered":"2024-03-27T07:22:27.668715+0000","last_unstale":"2024-03-27T07:23:34.949003+0000","last_undegraded":"2024-03-27T07:23:34.949003+0000","last_fullsized":"2024-03-27T07:23:34.949003+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:44:33.732968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222315+0000","last_change":"2024-03-27T07:21:35.559726+0000","last_active":"2024-03-27T07:23:35.222315+0000","last_peered":"2024-03-27T07:23:35.222315+0000","last_clean":"2024-03-27T07:23:35.222315+0000","last_became_active":"2024-03-27T07:21:35.559294+0000","last_became_peered":"2024-03-27T07:21:35.559294+0000","last_unstale":"2024-03-27T07:23:35.222315+0000","last_undegraded":"2024-03-27T07:23:35.222315+0000","last_fullsized":"2024-03-27T07:23:35.222315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:27:00.364447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224071+0000","last_change":"2024-03-27T07:21:35.577959+0000","last_active":"2024-03-27T07:23:35.224071+0000","last_peered":"2024-03-27T07:23:35.224071+0000","last_clean":"2024-03-27T07:23:35.224071+0000","last_became_active":"2024-03-27T07:21:35.577642+0000","last_became_peered":"2024-03-27T07:21:35.577642+0000","last_unstale":"2024-03-27T07:23:35.224071+0000","last_undegraded":"2024-03-27T07:23:35.224071+0000","last_fullsized":"2024-03-27T07:23:35.224071+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:07:44.836888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224287+0000","last_change":"2024-03-27T07:21:35.580901+0000","last_active":"2024-03-27T07:23:35.224287+0000","last_peered":"2024-03-27T07:23:35.224287+0000","last_clean":"2024-03-27T07:23:35.224287+0000","last_became_active":"2024-03-27T07:21:35.579456+0000","last_became_peered":"2024-03-27T07:21:35.579456+0000","last_unstale":"2024-03-27T07:23:35.224287+0000","last_undegraded":"2024-03-27T07:23:35.224287+0000","last_fullsized":"2024-03-27T07:23:35.224287+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:35:54.722160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221935+0000","last_change":"2024-03-27T07:21:35.574462+0000","last_active":"2024-03-27T07:23:35.221935+0000","last_peered":"2024-03-27T07:23:35.221935+0000","last_clean":"2024-03-27T07:23:35.221935+0000","last_became_active":"2024-03-27T07:21:35.574158+0000","last_became_peered":"2024-03-27T07:21:35.574158+0000","last_unstale":"2024-03-27T07:23:35.221935+0000","last_undegraded":"2024-03-27T07:23:35.221935+0000","last_fullsized":"2024-03-27T07:23:35.221935+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:16:18.756955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057213+0000","last_change":"2024-03-27T07:21:35.576808+0000","last_active":"2024-03-27T07:23:35.057213+0000","last_peered":"2024-03-27T07:23:35.057213+0000","last_clean":"2024-03-27T07:23:35.057213+0000","last_became_active":"2024-03-27T07:21:35.574819+0000","last_became_peered":"2024-03-27T07:21:35.574819+0000","last_unstale":"2024-03-27T07:23:35.057213+0000","last_undegraded":"2024-03-27T07:23:35.057213+0000","last_fullsized":"2024-03-27T07:23:35.057213+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:29:06.137201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949053+0000","last_change":"2024-03-27T07:21:35.570650+0000","last_active":"2024-03-27T07:23:34.949053+0000","last_peered":"2024-03-27T07:23:34.949053+0000","last_clean":"2024-03-27T07:23:34.949053+0000","last_became_active":"2024-03-27T07:21:35.569850+0000","last_became_peered":"2024-03-27T07:21:35.569850+0000","last_unstale":"2024-03-27T07:23:34.949053+0000","last_undegraded":"2024-03-27T07:23:34.949053+0000","last_fullsized":"2024-03-27T07:23:34.949053+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:22:39.829648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948167+0000","last_change":"2024-03-27T07:21:35.566322+0000","last_active":"2024-03-27T07:23:34.948167+0000","last_peered":"2024-03-27T07:23:34.948167+0000","last_clean":"2024-03-27T07:23:34.948167+0000","last_became_active":"2024-03-27T07:21:35.565947+0000","last_became_peered":"2024-03-27T07:21:35.565947+0000","last_unstale":"2024-03-27T07:23:34.948167+0000","last_undegraded":"2024-03-27T07:23:34.948167+0000","last_fullsized":"2024-03-27T07:23:34.948167+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:58:34.151735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'9","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949018+0000","last_change":"2024-03-27T07:22:27.702687+0000","last_active":"2024-03-27T07:23:34.949018+0000","last_peered":"2024-03-27T07:23:34.949018+0000","last_clean":"2024-03-27T07:23:34.949018+0000","last_became_active":"2024-03-27T07:22:27.696358+0000","last_became_peered":"2024-03-27T07:22:27.696358+0000","last_unstale":"2024-03-27T07:23:34.949018+0000","last_undegraded":"2024-03-27T07:23:34.949018+0000","last_fullsized":"2024-03-27T07:23:34.949018+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:30:28.499338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,4],"acting":[9,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058686+0000","last_change":"2024-03-27T07:21:35.576918+0000","last_active":"2024-03-27T07:23:35.058686+0000","last_peered":"2024-03-27T07:23:35.058686+0000","last_clean":"2024-03-27T07:23:35.058686+0000","last_became_active":"2024-03-27T07:21:35.576581+0000","last_became_peered":"2024-03-27T07:21:35.576581+0000","last_unstale":"2024-03-27T07:23:35.058686+0000","last_undegraded":"2024-03-27T07:23:35.058686+0000","last_fullsized":"2024-03-27T07:23:35.058686+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:31:54.813459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.059064+0000","last_change":"2024-03-27T07:21:34.560583+0000","last_active":"2024-03-27T07:23:35.059064+0000","last_peered":"2024-03-27T07:23:35.059064+0000","last_clean":"2024-03-27T07:23:35.059064+0000","last_became_active":"2024-03-27T07:21:34.560257+0000","last_became_peered":"2024-03-27T07:21:34.560257+0000","last_unstale":"2024-03-27T07:23:35.059064+0000","last_undegraded":"2024-03-27T07:23:35.059064+0000","last_fullsized":"2024-03-27T07:23:35.059064+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:25:27.328498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224927+0000","last_change":"2024-03-27T07:21:35.573251+0000","last_active":"2024-03-27T07:23:35.224927+0000","last_peered":"2024-03-27T07:23:35.224927+0000","last_clean":"2024-03-27T07:23:35.224927+0000","last_became_active":"2024-03-27T07:21:35.572890+0000","last_became_peered":"2024-03-27T07:21:35.572890+0000","last_unstale":"2024-03-27T07:23:35.224927+0000","last_undegraded":"2024-03-27T07:23:35.224927+0000","last_fullsized":"2024-03-27T07:23:35.224927+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:49.317704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"86'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483172+0000","last_change":"2024-03-27T07:21:34.567140+0000","last_active":"2024-03-27T07:23:35.483172+0000","last_peered":"2024-03-27T07:23:35.483172+0000","last_clean":"2024-03-27T07:23:35.483172+0000","last_became_active":"2024-03-27T07:21:34.566689+0000","last_became_peered":"2024-03-27T07:21:34.566689+0000","last_unstale":"2024-03-27T07:23:35.483172+0000","last_undegraded":"2024-03-27T07:23:35.483172+0000","last_fullsized":"2024-03-27T07:23:35.483172+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:50:54.656277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222293+0000","last_change":"2024-03-27T07:21:35.565259+0000","last_active":"2024-03-27T07:23:35.222293+0000","last_peered":"2024-03-27T07:23:35.222293+0000","last_clean":"2024-03-27T07:23:35.222293+0000","last_became_active":"2024-03-27T07:21:35.564954+0000","last_became_peered":"2024-03-27T07:21:35.564954+0000","last_unstale":"2024-03-27T07:23:35.222293+0000","last_undegraded":"2024-03-27T07:23:35.222293+0000","last_fullsized":"2024-03-27T07:23:35.222293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:02.950515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483014+0000","last_change":"2024-03-27T07:21:34.558887+0000","last_active":"2024-03-27T07:23:35.483014+0000","last_peered":"2024-03-27T07:23:35.483014+0000","last_clean":"2024-03-27T07:23:35.483014+0000","last_became_active":"2024-03-27T07:21:34.556689+0000","last_became_peered":"2024-03-27T07:21:34.556689+0000","last_unstale":"2024-03-27T07:23:35.483014+0000","last_undegraded":"2024-03-27T07:23:35.483014+0000","last_fullsized":"2024-03-27T07:23:35.483014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:37.162440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064533+0000","last_change":"2024-03-27T07:21:35.576346+0000","last_active":"2024-03-27T07:23:35.064533+0000","last_peered":"2024-03-27T07:23:35.064533+0000","last_clean":"2024-03-27T07:23:35.064533+0000","last_became_active":"2024-03-27T07:21:35.572774+0000","last_became_peered":"2024-03-27T07:21:35.572774+0000","last_unstale":"2024-03-27T07:23:35.064533+0000","last_undegraded":"2024-03-27T07:23:35.064533+0000","last_fullsized":"2024-03-27T07:23:35.064533+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:12:44.181603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"89'9","reported_seq":153,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.722484+0000","last_change":"2024-03-27T07:21:34.562208+0000","last_active":"2024-03-27T07:23:35.722484+0000","last_peered":"2024-03-27T07:23:35.722484+0000","last_clean":"2024-03-27T07:23:35.722484+0000","last_became_active":"2024-03-27T07:21:34.561829+0000","last_became_peered":"2024-03-27T07:21:34.561829+0000","last_unstale":"2024-03-27T07:23:35.722484+0000","last_undegraded":"2024-03-27T07:23:35.722484+0000","last_fullsized":"2024-03-27T07:23:35.722484+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:01:48.845075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1853,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":6,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482808+0000","last_change":"2024-03-27T07:21:35.575384+0000","last_active":"2024-03-27T07:23:35.482808+0000","last_peered":"2024-03-27T07:23:35.482808+0000","last_clean":"2024-03-27T07:23:35.482808+0000","last_became_active":"2024-03-27T07:21:35.574928+0000","last_became_peered":"2024-03-27T07:21:35.574928+0000","last_unstale":"2024-03-27T07:23:35.482808+0000","last_undegraded":"2024-03-27T07:23:35.482808+0000","last_fullsized":"2024-03-27T07:23:35.482808+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:34.034114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067396+0000","last_change":"2024-03-27T07:21:34.562791+0000","last_active":"2024-03-27T07:23:35.067396+0000","last_peered":"2024-03-27T07:23:35.067396+0000","last_clean":"2024-03-27T07:23:35.067396+0000","last_became_active":"2024-03-27T07:21:34.562441+0000","last_became_peered":"2024-03-27T07:21:34.562441+0000","last_unstale":"2024-03-27T07:23:35.067396+0000","last_undegraded":"2024-03-27T07:23:35.067396+0000","last_fullsized":"2024-03-27T07:23:35.067396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:44:42.509635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064356+0000","last_change":"2024-03-27T07:21:35.578022+0000","last_active":"2024-03-27T07:23:35.064356+0000","last_peered":"2024-03-27T07:23:35.064356+0000","last_clean":"2024-03-27T07:23:35.064356+0000","last_became_active":"2024-03-27T07:21:35.577665+0000","last_became_peered":"2024-03-27T07:21:35.577665+0000","last_unstale":"2024-03-27T07:23:35.064356+0000","last_undegraded":"2024-03-27T07:23:35.064356+0000","last_fullsized":"2024-03-27T07:23:35.064356+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:05:40.301149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"86'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221881+0000","last_change":"2024-03-27T07:21:34.557610+0000","last_active":"2024-03-27T07:23:35.221881+0000","last_peered":"2024-03-27T07:23:35.221881+0000","last_clean":"2024-03-27T07:23:35.221881+0000","last_became_active":"2024-03-27T07:21:34.557295+0000","last_became_peered":"2024-03-27T07:21:34.557295+0000","last_unstale":"2024-03-27T07:23:35.221881+0000","last_undegraded":"2024-03-27T07:23:35.221881+0000","last_fullsized":"2024-03-27T07:23:35.221881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:38:40.291447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057741+0000","last_change":"2024-03-27T07:21:35.568910+0000","last_active":"2024-03-27T07:23:35.057741+0000","last_peered":"2024-03-27T07:23:35.057741+0000","last_clean":"2024-03-27T07:23:35.057741+0000","last_became_active":"2024-03-27T07:21:35.568606+0000","last_became_peered":"2024-03-27T07:21:35.568606+0000","last_unstale":"2024-03-27T07:23:35.057741+0000","last_undegraded":"2024-03-27T07:23:35.057741+0000","last_fullsized":"2024-03-27T07:23:35.057741+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:04:54.792142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064009+0000","last_change":"2024-03-27T07:21:34.563096+0000","last_active":"2024-03-27T07:23:35.064009+0000","last_peered":"2024-03-27T07:23:35.064009+0000","last_clean":"2024-03-27T07:23:35.064009+0000","last_became_active":"2024-03-27T07:21:34.562721+0000","last_became_peered":"2024-03-27T07:21:34.562721+0000","last_unstale":"2024-03-27T07:23:35.064009+0000","last_undegraded":"2024-03-27T07:23:35.064009+0000","last_fullsized":"2024-03-27T07:23:35.064009+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:42:43.902139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948802+0000","last_change":"2024-03-27T07:21:35.571386+0000","last_active":"2024-03-27T07:23:34.948802+0000","last_peered":"2024-03-27T07:23:34.948802+0000","last_clean":"2024-03-27T07:23:34.948802+0000","last_became_active":"2024-03-27T07:21:35.571061+0000","last_became_peered":"2024-03-27T07:21:35.571061+0000","last_unstale":"2024-03-27T07:23:34.948802+0000","last_undegraded":"2024-03-27T07:23:34.948802+0000","last_fullsized":"2024-03-27T07:23:34.948802+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:15:06.887550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":143,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067769+0000","last_change":"2024-03-27T07:21:34.561401+0000","last_active":"2024-03-27T07:23:35.067769+0000","last_peered":"2024-03-27T07:23:35.067769+0000","last_clean":"2024-03-27T07:23:35.067769+0000","last_became_active":"2024-03-27T07:21:34.561071+0000","last_became_peered":"2024-03-27T07:21:34.561071+0000","last_unstale":"2024-03-27T07:23:35.067769+0000","last_undegraded":"2024-03-27T07:23:35.067769+0000","last_fullsized":"2024-03-27T07:23:35.067769+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:41.610926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.223027+0000","last_change":"2024-03-27T07:21:35.561505+0000","last_active":"2024-03-27T07:23:35.223027+0000","last_peered":"2024-03-27T07:23:35.223027+0000","last_clean":"2024-03-27T07:23:35.223027+0000","last_became_active":"2024-03-27T07:21:35.561166+0000","last_became_peered":"2024-03-27T07:21:35.561166+0000","last_unstale":"2024-03-27T07:23:35.223027+0000","last_undegraded":"2024-03-27T07:23:35.223027+0000","last_fullsized":"2024-03-27T07:23:35.223027+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:49:59.179147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'2","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948097+0000","last_change":"2024-03-27T07:22:27.704448+0000","last_active":"2024-03-27T07:23:34.948097+0000","last_peered":"2024-03-27T07:23:34.948097+0000","last_clean":"2024-03-27T07:23:34.948097+0000","last_became_active":"2024-03-27T07:22:27.696496+0000","last_became_peered":"2024-03-27T07:22:27.696496+0000","last_unstale":"2024-03-27T07:23:34.948097+0000","last_undegraded":"2024-03-27T07:23:34.948097+0000","last_fullsized":"2024-03-27T07:23:34.948097+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:05.114224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224840+0000","last_change":"2024-03-27T07:21:35.574795+0000","last_active":"2024-03-27T07:23:35.224840+0000","last_peered":"2024-03-27T07:23:35.224840+0000","last_clean":"2024-03-27T07:23:35.224840+0000","last_became_active":"2024-03-27T07:21:35.574534+0000","last_became_peered":"2024-03-27T07:21:35.574534+0000","last_unstale":"2024-03-27T07:23:35.224840+0000","last_undegraded":"2024-03-27T07:23:35.224840+0000","last_fullsized":"2024-03-27T07:23:35.224840+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:46:44.777575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064528+0000","last_change":"2024-03-27T07:21:34.555772+0000","last_active":"2024-03-27T07:23:35.064528+0000","last_peered":"2024-03-27T07:23:35.064528+0000","last_clean":"2024-03-27T07:23:35.064528+0000","last_became_active":"2024-03-27T07:21:34.555430+0000","last_became_peered":"2024-03-27T07:21:34.555430+0000","last_unstale":"2024-03-27T07:23:35.064528+0000","last_undegraded":"2024-03-27T07:23:35.064528+0000","last_fullsized":"2024-03-27T07:23:35.064528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:11:48.058887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222480+0000","last_change":"2024-03-27T07:21:35.573184+0000","last_active":"2024-03-27T07:23:35.222480+0000","last_peered":"2024-03-27T07:23:35.222480+0000","last_clean":"2024-03-27T07:23:35.222480+0000","last_became_active":"2024-03-27T07:21:35.572776+0000","last_became_peered":"2024-03-27T07:21:35.572776+0000","last_unstale":"2024-03-27T07:23:35.222480+0000","last_undegraded":"2024-03-27T07:23:35.222480+0000","last_fullsized":"2024-03-27T07:23:35.222480+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:03.122229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"89'36","reported_seq":302,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.722496+0000","last_change":"2024-03-27T07:21:34.563221+0000","last_active":"2024-03-27T07:23:35.722496+0000","last_peered":"2024-03-27T07:23:35.722496+0000","last_clean":"2024-03-27T07:23:35.722496+0000","last_became_active":"2024-03-27T07:21:34.562679+0000","last_became_peered":"2024-03-27T07:21:34.562679+0000","last_unstale":"2024-03-27T07:23:35.722496+0000","last_undegraded":"2024-03-27T07:23:35.722496+0000","last_fullsized":"2024-03-27T07:23:35.722496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:59.795906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67758,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":245,"num_read_kb":188,"num_write":37,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482984+0000","last_change":"2024-03-27T07:21:35.573408+0000","last_active":"2024-03-27T07:23:35.482984+0000","last_peered":"2024-03-27T07:23:35.482984+0000","last_clean":"2024-03-27T07:23:35.482984+0000","last_became_active":"2024-03-27T07:21:35.572912+0000","last_became_peered":"2024-03-27T07:21:35.572912+0000","last_unstale":"2024-03-27T07:23:35.482984+0000","last_undegraded":"2024-03-27T07:23:35.482984+0000","last_fullsized":"2024-03-27T07:23:35.482984+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:13.219709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'6","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948036+0000","last_change":"2024-03-27T07:21:34.562237+0000","last_active":"2024-03-27T07:23:34.948036+0000","last_peered":"2024-03-27T07:23:34.948036+0000","last_clean":"2024-03-27T07:23:34.948036+0000","last_became_active":"2024-03-27T07:21:34.561895+0000","last_became_peered":"2024-03-27T07:21:34.561895+0000","last_unstale":"2024-03-27T07:23:34.948036+0000","last_undegraded":"2024-03-27T07:23:34.948036+0000","last_fullsized":"2024-03-27T07:23:34.948036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:39:09.220247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221949+0000","last_change":"2024-03-27T07:21:35.571870+0000","last_active":"2024-03-27T07:23:35.221949+0000","last_peered":"2024-03-27T07:23:35.221949+0000","last_clean":"2024-03-27T07:23:35.221949+0000","last_became_active":"2024-03-27T07:21:35.571272+0000","last_became_peered":"2024-03-27T07:21:35.571272+0000","last_unstale":"2024-03-27T07:23:35.221949+0000","last_undegraded":"2024-03-27T07:23:35.221949+0000","last_fullsized":"2024-03-27T07:23:35.221949+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:08:08.374114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064239+0000","last_change":"2024-03-27T07:21:34.563257+0000","last_active":"2024-03-27T07:23:35.064239+0000","last_peered":"2024-03-27T07:23:35.064239+0000","last_clean":"2024-03-27T07:23:35.064239+0000","last_became_active":"2024-03-27T07:21:34.562777+0000","last_became_peered":"2024-03-27T07:21:34.562777+0000","last_unstale":"2024-03-27T07:23:35.064239+0000","last_undegraded":"2024-03-27T07:23:35.064239+0000","last_fullsized":"2024-03-27T07:23:35.064239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:03.873185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947870+0000","last_change":"2024-03-27T07:21:35.568039+0000","last_active":"2024-03-27T07:23:34.947870+0000","last_peered":"2024-03-27T07:23:34.947870+0000","last_clean":"2024-03-27T07:23:34.947870+0000","last_became_active":"2024-03-27T07:21:35.567680+0000","last_became_peered":"2024-03-27T07:21:35.567680+0000","last_unstale":"2024-03-27T07:23:34.947870+0000","last_undegraded":"2024-03-27T07:23:34.947870+0000","last_fullsized":"2024-03-27T07:23:34.947870+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:51:31.223267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'4","reported_seq":145,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.721821+0000","last_change":"2024-03-27T07:21:34.560885+0000","last_active":"2024-03-27T07:23:35.721821+0000","last_peered":"2024-03-27T07:23:35.721821+0000","last_clean":"2024-03-27T07:23:35.721821+0000","last_became_active":"2024-03-27T07:21:34.560431+0000","last_became_peered":"2024-03-27T07:21:34.560431+0000","last_unstale":"2024-03-27T07:23:35.721821+0000","last_undegraded":"2024-03-27T07:23:35.721821+0000","last_fullsized":"2024-03-27T07:23:35.721821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:19:00.526827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947636+0000","last_change":"2024-03-27T07:21:35.569293+0000","last_active":"2024-03-27T07:23:34.947636+0000","last_peered":"2024-03-27T07:23:34.947636+0000","last_clean":"2024-03-27T07:23:34.947636+0000","last_became_active":"2024-03-27T07:21:35.568962+0000","last_became_peered":"2024-03-27T07:21:35.568962+0000","last_unstale":"2024-03-27T07:23:34.947636+0000","last_undegraded":"2024-03-27T07:23:34.947636+0000","last_fullsized":"2024-03-27T07:23:34.947636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:14:09.947298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'15","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482624+0000","last_change":"2024-03-27T07:21:34.569232+0000","last_active":"2024-03-27T07:23:35.482624+0000","last_peered":"2024-03-27T07:23:35.482624+0000","last_clean":"2024-03-27T07:23:35.482624+0000","last_became_active":"2024-03-27T07:21:34.568900+0000","last_became_peered":"2024-03-27T07:21:34.568900+0000","last_unstale":"2024-03-27T07:23:35.482624+0000","last_undegraded":"2024-03-27T07:23:35.482624+0000","last_fullsized":"2024-03-27T07:23:35.482624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:27:55.489262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064095+0000","last_change":"2024-03-27T07:21:35.577020+0000","last_active":"2024-03-27T07:23:35.064095+0000","last_peered":"2024-03-27T07:23:35.064095+0000","last_clean":"2024-03-27T07:23:35.064095+0000","last_became_active":"2024-03-27T07:21:35.576696+0000","last_became_peered":"2024-03-27T07:21:35.576696+0000","last_unstale":"2024-03-27T07:23:35.064095+0000","last_undegraded":"2024-03-27T07:23:35.064095+0000","last_fullsized":"2024-03-27T07:23:35.064095+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:37:35.037889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483182+0000","last_change":"2024-03-27T07:21:34.562496+0000","last_active":"2024-03-27T07:23:35.483182+0000","last_peered":"2024-03-27T07:23:35.483182+0000","last_clean":"2024-03-27T07:23:35.483182+0000","last_became_active":"2024-03-27T07:21:34.562166+0000","last_became_peered":"2024-03-27T07:21:34.562166+0000","last_unstale":"2024-03-27T07:23:35.483182+0000","last_undegraded":"2024-03-27T07:23:35.483182+0000","last_fullsized":"2024-03-27T07:23:35.483182+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:38.828496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057091+0000","last_change":"2024-03-27T07:22:27.696771+0000","last_active":"2024-03-27T07:23:35.057091+0000","last_peered":"2024-03-27T07:23:35.057091+0000","last_clean":"2024-03-27T07:23:35.057091+0000","last_became_active":"2024-03-27T07:22:27.696289+0000","last_became_peered":"2024-03-27T07:22:27.696289+0000","last_unstale":"2024-03-27T07:23:35.057091+0000","last_undegraded":"2024-03-27T07:23:35.057091+0000","last_fullsized":"2024-03-27T07:23:35.057091+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:46.675105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.949141+0000","last_change":"2024-03-27T07:21:34.560289+0000","last_active":"2024-03-27T07:23:34.949141+0000","last_peered":"2024-03-27T07:23:34.949141+0000","last_clean":"2024-03-27T07:23:34.949141+0000","last_became_active":"2024-03-27T07:21:34.559985+0000","last_became_peered":"2024-03-27T07:21:34.559985+0000","last_unstale":"2024-03-27T07:23:34.949141+0000","last_undegraded":"2024-03-27T07:23:34.949141+0000","last_fullsized":"2024-03-27T07:23:34.949141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:45:46.611725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067662+0000","last_change":"2024-03-27T07:21:35.579626+0000","last_active":"2024-03-27T07:23:35.067662+0000","last_peered":"2024-03-27T07:23:35.067662+0000","last_clean":"2024-03-27T07:23:35.067662+0000","last_became_active":"2024-03-27T07:21:35.579173+0000","last_became_peered":"2024-03-27T07:21:35.579173+0000","last_unstale":"2024-03-27T07:23:35.067662+0000","last_undegraded":"2024-03-27T07:23:35.067662+0000","last_fullsized":"2024-03-27T07:23:35.067662+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:56:48.015958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947779+0000","last_change":"2024-03-27T07:21:34.568216+0000","last_active":"2024-03-27T07:23:34.947779+0000","last_peered":"2024-03-27T07:23:34.947779+0000","last_clean":"2024-03-27T07:23:34.947779+0000","last_became_active":"2024-03-27T07:21:34.567468+0000","last_became_peered":"2024-03-27T07:21:34.567468+0000","last_unstale":"2024-03-27T07:23:34.947779+0000","last_undegraded":"2024-03-27T07:23:34.947779+0000","last_fullsized":"2024-03-27T07:23:34.947779+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:44:50.359865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.067551+0000","last_change":"2024-03-27T07:21:35.574614+0000","last_active":"2024-03-27T07:23:35.067551+0000","last_peered":"2024-03-27T07:23:35.067551+0000","last_clean":"2024-03-27T07:23:35.067551+0000","last_became_active":"2024-03-27T07:21:35.574274+0000","last_became_peered":"2024-03-27T07:21:35.574274+0000","last_unstale":"2024-03-27T07:23:35.067551+0000","last_undegraded":"2024-03-27T07:23:35.067551+0000","last_fullsized":"2024-03-27T07:23:35.067551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:54:57.744066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064155+0000","last_change":"2024-03-27T07:21:35.573196+0000","last_active":"2024-03-27T07:23:35.064155+0000","last_peered":"2024-03-27T07:23:35.064155+0000","last_clean":"2024-03-27T07:23:35.064155+0000","last_became_active":"2024-03-27T07:21:35.572852+0000","last_became_peered":"2024-03-27T07:21:35.572852+0000","last_unstale":"2024-03-27T07:23:35.064155+0000","last_undegraded":"2024-03-27T07:23:35.064155+0000","last_fullsized":"2024-03-27T07:23:35.064155+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:00.478573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":144,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.721385+0000","last_change":"2024-03-27T07:21:34.566380+0000","last_active":"2024-03-27T07:23:35.721385+0000","last_peered":"2024-03-27T07:23:35.721385+0000","last_clean":"2024-03-27T07:23:35.721385+0000","last_became_active":"2024-03-27T07:21:34.566034+0000","last_became_peered":"2024-03-27T07:21:34.566034+0000","last_unstale":"2024-03-27T07:23:35.721385+0000","last_undegraded":"2024-03-27T07:23:35.721385+0000","last_fullsized":"2024-03-27T07:23:35.721385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:52:06.470957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058293+0000","last_change":"2024-03-27T07:21:35.576149+0000","last_active":"2024-03-27T07:23:35.058293+0000","last_peered":"2024-03-27T07:23:35.058293+0000","last_clean":"2024-03-27T07:23:35.058293+0000","last_became_active":"2024-03-27T07:21:35.573628+0000","last_became_peered":"2024-03-27T07:21:35.573628+0000","last_unstale":"2024-03-27T07:23:35.058293+0000","last_undegraded":"2024-03-27T07:23:35.058293+0000","last_fullsized":"2024-03-27T07:23:35.058293+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:37:06.571848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"86'3","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224109+0000","last_change":"2024-03-27T07:21:34.555206+0000","last_active":"2024-03-27T07:23:35.224109+0000","last_peered":"2024-03-27T07:23:35.224109+0000","last_clean":"2024-03-27T07:23:35.224109+0000","last_became_active":"2024-03-27T07:21:34.554789+0000","last_became_peered":"2024-03-27T07:21:34.554789+0000","last_unstale":"2024-03-27T07:23:35.224109+0000","last_undegraded":"2024-03-27T07:23:35.224109+0000","last_fullsized":"2024-03-27T07:23:35.224109+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:24:37.211394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'137","reported_seq":357,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947736+0000","last_change":"2024-03-27T07:20:20.641816+0000","last_active":"2024-03-27T07:23:34.947736+0000","last_peered":"2024-03-27T07:23:34.947736+0000","last_clean":"2024-03-27T07:23:34.947736+0000","last_became_active":"2024-03-27T07:20:20.641398+0000","last_became_peered":"2024-03-27T07:20:20.641398+0000","last_unstale":"2024-03-27T07:23:34.947736+0000","last_undegraded":"2024-03-27T07:23:34.947736+0000","last_fullsized":"2024-03-27T07:23:34.947736+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:16:54.496466+0000","last_clean_scrub_stamp":"2024-03-27T07:16:54.496466+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:52:56.728469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221593+0000","last_change":"2024-03-27T07:21:35.562594+0000","last_active":"2024-03-27T07:23:35.221593+0000","last_peered":"2024-03-27T07:23:35.221593+0000","last_clean":"2024-03-27T07:23:35.221593+0000","last_became_active":"2024-03-27T07:21:35.562287+0000","last_became_peered":"2024-03-27T07:21:35.562287+0000","last_unstale":"2024-03-27T07:23:35.221593+0000","last_undegraded":"2024-03-27T07:23:35.221593+0000","last_fullsized":"2024-03-27T07:23:35.221593+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:38:25.172452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"86'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948003+0000","last_change":"2024-03-27T07:21:34.564569+0000","last_active":"2024-03-27T07:23:34.948003+0000","last_peered":"2024-03-27T07:23:34.948003+0000","last_clean":"2024-03-27T07:23:34.948003+0000","last_became_active":"2024-03-27T07:21:34.563830+0000","last_became_peered":"2024-03-27T07:21:34.563830+0000","last_unstale":"2024-03-27T07:23:34.948003+0000","last_undegraded":"2024-03-27T07:23:34.948003+0000","last_fullsized":"2024-03-27T07:23:34.948003+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:46:19.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"86'1","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.483051+0000","last_change":"2024-03-27T07:21:34.569447+0000","last_active":"2024-03-27T07:23:35.483051+0000","last_peered":"2024-03-27T07:23:35.483051+0000","last_clean":"2024-03-27T07:23:35.483051+0000","last_became_active":"2024-03-27T07:21:34.569096+0000","last_became_peered":"2024-03-27T07:21:34.569096+0000","last_unstale":"2024-03-27T07:23:35.483051+0000","last_undegraded":"2024-03-27T07:23:35.483051+0000","last_fullsized":"2024-03-27T07:23:35.483051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:49:00.695556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222018+0000","last_change":"2024-03-27T07:21:35.558620+0000","last_active":"2024-03-27T07:23:35.222018+0000","last_peered":"2024-03-27T07:23:35.222018+0000","last_clean":"2024-03-27T07:23:35.222018+0000","last_became_active":"2024-03-27T07:21:35.557559+0000","last_became_peered":"2024-03-27T07:21:35.557559+0000","last_unstale":"2024-03-27T07:23:35.222018+0000","last_undegraded":"2024-03-27T07:23:35.222018+0000","last_fullsized":"2024-03-27T07:23:35.222018+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:09:03.236893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"89'45","reported_seq":101,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.181910+0000","last_change":"2024-03-27T07:22:27.674005+0000","last_active":"2024-03-27T07:23:35.181910+0000","last_peered":"2024-03-27T07:23:35.181910+0000","last_clean":"2024-03-27T07:23:35.181910+0000","last_became_active":"2024-03-27T07:22:27.670596+0000","last_became_peered":"2024-03-27T07:22:27.670596+0000","last_unstale":"2024-03-27T07:23:35.181910+0000","last_undegraded":"2024-03-27T07:23:35.181910+0000","last_fullsized":"2024-03-27T07:23:35.181910+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:38:43.398885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":80,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058871+0000","last_change":"2024-03-27T07:21:35.573345+0000","last_active":"2024-03-27T07:23:35.058871+0000","last_peered":"2024-03-27T07:23:35.058871+0000","last_clean":"2024-03-27T07:23:35.058871+0000","last_became_active":"2024-03-27T07:21:35.573037+0000","last_became_peered":"2024-03-27T07:21:35.573037+0000","last_unstale":"2024-03-27T07:23:35.058871+0000","last_undegraded":"2024-03-27T07:23:35.058871+0000","last_fullsized":"2024-03-27T07:23:35.058871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:07:49.834272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'4","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.223649+0000","last_change":"2024-03-27T07:21:34.558738+0000","last_active":"2024-03-27T07:23:35.223649+0000","last_peered":"2024-03-27T07:23:35.223649+0000","last_clean":"2024-03-27T07:23:35.223649+0000","last_became_active":"2024-03-27T07:21:34.558353+0000","last_became_peered":"2024-03-27T07:21:34.558353+0000","last_unstale":"2024-03-27T07:23:35.223649+0000","last_undegraded":"2024-03-27T07:23:35.223649+0000","last_fullsized":"2024-03-27T07:23:35.223649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T07:46:07.816121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224640+0000","last_change":"2024-03-27T07:21:35.575747+0000","last_active":"2024-03-27T07:23:35.224640+0000","last_peered":"2024-03-27T07:23:35.224640+0000","last_clean":"2024-03-27T07:23:35.224640+0000","last_became_active":"2024-03-27T07:21:35.575382+0000","last_became_peered":"2024-03-27T07:21:35.575382+0000","last_unstale":"2024-03-27T07:23:35.224640+0000","last_undegraded":"2024-03-27T07:23:35.224640+0000","last_fullsized":"2024-03-27T07:23:35.224640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:10:03.118133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.221937+0000","last_change":"2024-03-27T07:21:34.563713+0000","last_active":"2024-03-27T07:23:35.221937+0000","last_peered":"2024-03-27T07:23:35.221937+0000","last_clean":"2024-03-27T07:23:35.221937+0000","last_became_active":"2024-03-27T07:21:34.563356+0000","last_became_peered":"2024-03-27T07:21:34.563356+0000","last_unstale":"2024-03-27T07:23:35.221937+0000","last_undegraded":"2024-03-27T07:23:35.221937+0000","last_fullsized":"2024-03-27T07:23:35.221937+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:48:11.366029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482627+0000","last_change":"2024-03-27T07:21:35.569912+0000","last_active":"2024-03-27T07:23:35.482627+0000","last_peered":"2024-03-27T07:23:35.482627+0000","last_clean":"2024-03-27T07:23:35.482627+0000","last_became_active":"2024-03-27T07:21:35.569546+0000","last_became_peered":"2024-03-27T07:21:35.569546+0000","last_unstale":"2024-03-27T07:23:35.482627+0000","last_undegraded":"2024-03-27T07:23:35.482627+0000","last_fullsized":"2024-03-27T07:23:35.482627+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:45:18.146654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'3","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057895+0000","last_change":"2024-03-27T07:21:34.557719+0000","last_active":"2024-03-27T07:23:35.057895+0000","last_peered":"2024-03-27T07:23:35.057895+0000","last_clean":"2024-03-27T07:23:35.057895+0000","last_became_active":"2024-03-27T07:21:34.557360+0000","last_became_peered":"2024-03-27T07:21:34.557360+0000","last_unstale":"2024-03-27T07:23:35.057895+0000","last_undegraded":"2024-03-27T07:23:35.057895+0000","last_fullsized":"2024-03-27T07:23:35.057895+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:24:47.002674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056806+0000","last_change":"2024-03-27T07:21:35.578259+0000","last_active":"2024-03-27T07:23:35.056806+0000","last_peered":"2024-03-27T07:23:35.056806+0000","last_clean":"2024-03-27T07:23:35.056806+0000","last_became_active":"2024-03-27T07:21:35.574765+0000","last_became_peered":"2024-03-27T07:21:35.574765+0000","last_unstale":"2024-03-27T07:23:35.056806+0000","last_undegraded":"2024-03-27T07:23:35.056806+0000","last_fullsized":"2024-03-27T07:23:35.056806+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:34:49.358416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'1","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056872+0000","last_change":"2024-03-27T07:22:27.671151+0000","last_active":"2024-03-27T07:23:35.056872+0000","last_peered":"2024-03-27T07:23:35.056872+0000","last_clean":"2024-03-27T07:23:35.056872+0000","last_became_active":"2024-03-27T07:22:27.667575+0000","last_became_peered":"2024-03-27T07:22:27.667575+0000","last_unstale":"2024-03-27T07:23:35.056872+0000","last_undegraded":"2024-03-27T07:23:35.056872+0000","last_fullsized":"2024-03-27T07:23:35.056872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:20:51.954730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.058599+0000","last_change":"2024-03-27T07:21:35.577445+0000","last_active":"2024-03-27T07:23:35.058599+0000","last_peered":"2024-03-27T07:23:35.058599+0000","last_clean":"2024-03-27T07:23:35.058599+0000","last_became_active":"2024-03-27T07:21:35.577110+0000","last_became_peered":"2024-03-27T07:21:35.577110+0000","last_unstale":"2024-03-27T07:23:35.058599+0000","last_undegraded":"2024-03-27T07:23:35.058599+0000","last_fullsized":"2024-03-27T07:23:35.058599+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:36:45.919519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.482738+0000","last_change":"2024-03-27T07:21:34.567744+0000","last_active":"2024-03-27T07:23:35.482738+0000","last_peered":"2024-03-27T07:23:35.482738+0000","last_clean":"2024-03-27T07:23:35.482738+0000","last_became_active":"2024-03-27T07:21:34.567412+0000","last_became_peered":"2024-03-27T07:21:34.567412+0000","last_unstale":"2024-03-27T07:23:35.482738+0000","last_undegraded":"2024-03-27T07:23:35.482738+0000","last_fullsized":"2024-03-27T07:23:35.482738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:37:07.075048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947849+0000","last_change":"2024-03-27T07:21:35.570287+0000","last_active":"2024-03-27T07:23:34.947849+0000","last_peered":"2024-03-27T07:23:34.947849+0000","last_clean":"2024-03-27T07:23:34.947849+0000","last_became_active":"2024-03-27T07:21:35.569194+0000","last_became_peered":"2024-03-27T07:21:35.569194+0000","last_unstale":"2024-03-27T07:23:34.947849+0000","last_undegraded":"2024-03-27T07:23:34.947849+0000","last_fullsized":"2024-03-27T07:23:34.947849+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:01:44.155291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'3","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948171+0000","last_change":"2024-03-27T07:21:34.561420+0000","last_active":"2024-03-27T07:23:34.948171+0000","last_peered":"2024-03-27T07:23:34.948171+0000","last_clean":"2024-03-27T07:23:34.948171+0000","last_became_active":"2024-03-27T07:21:34.560923+0000","last_became_peered":"2024-03-27T07:21:34.560923+0000","last_unstale":"2024-03-27T07:23:34.948171+0000","last_undegraded":"2024-03-27T07:23:34.948171+0000","last_fullsized":"2024-03-27T07:23:34.948171+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:39:48.256790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948314+0000","last_change":"2024-03-27T07:21:35.571317+0000","last_active":"2024-03-27T07:23:34.948314+0000","last_peered":"2024-03-27T07:23:34.948314+0000","last_clean":"2024-03-27T07:23:34.948314+0000","last_became_active":"2024-03-27T07:21:35.570237+0000","last_became_peered":"2024-03-27T07:21:35.570237+0000","last_unstale":"2024-03-27T07:23:34.948314+0000","last_undegraded":"2024-03-27T07:23:34.948314+0000","last_fullsized":"2024-03-27T07:23:34.948314+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:09:53.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"89'39","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.175735+0000","last_change":"2024-03-27T07:21:34.553377+0000","last_active":"2024-03-27T07:23:35.175735+0000","last_peered":"2024-03-27T07:23:35.175735+0000","last_clean":"2024-03-27T07:23:35.175735+0000","last_became_active":"2024-03-27T07:21:34.553050+0000","last_became_peered":"2024-03-27T07:21:34.553050+0000","last_unstale":"2024-03-27T07:23:35.175735+0000","last_undegraded":"2024-03-27T07:23:35.175735+0000","last_fullsized":"2024-03-27T07:23:35.175735+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:28:03.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947957+0000","last_change":"2024-03-27T07:21:35.572384+0000","last_active":"2024-03-27T07:23:34.947957+0000","last_peered":"2024-03-27T07:23:34.947957+0000","last_clean":"2024-03-27T07:23:34.947957+0000","last_became_active":"2024-03-27T07:21:35.572071+0000","last_became_peered":"2024-03-27T07:21:35.572071+0000","last_unstale":"2024-03-27T07:23:34.947957+0000","last_undegraded":"2024-03-27T07:23:34.947957+0000","last_fullsized":"2024-03-27T07:23:34.947957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:03:04.117499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'2","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222498+0000","last_change":"2024-03-27T07:21:34.559187+0000","last_active":"2024-03-27T07:23:35.222498+0000","last_peered":"2024-03-27T07:23:35.222498+0000","last_clean":"2024-03-27T07:23:35.222498+0000","last_became_active":"2024-03-27T07:21:34.558675+0000","last_became_peered":"2024-03-27T07:21:34.558675+0000","last_unstale":"2024-03-27T07:23:35.222498+0000","last_undegraded":"2024-03-27T07:23:35.222498+0000","last_fullsized":"2024-03-27T07:23:35.222498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:33.527979+0000","last_clean_scrub_stamp":"2024-03-27T07:21:33.527979+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:41.376218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948473+0000","last_change":"2024-03-27T07:21:35.576440+0000","last_active":"2024-03-27T07:23:34.948473+0000","last_peered":"2024-03-27T07:23:34.948473+0000","last_clean":"2024-03-27T07:23:34.948473+0000","last_became_active":"2024-03-27T07:21:35.576143+0000","last_became_peered":"2024-03-27T07:21:35.576143+0000","last_unstale":"2024-03-27T07:23:34.948473+0000","last_undegraded":"2024-03-27T07:23:34.948473+0000","last_fullsized":"2024-03-27T07:23:34.948473+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:31:29.400053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056874+0000","last_change":"2024-03-27T07:21:35.565760+0000","last_active":"2024-03-27T07:23:35.056874+0000","last_peered":"2024-03-27T07:23:35.056874+0000","last_clean":"2024-03-27T07:23:35.056874+0000","last_became_active":"2024-03-27T07:21:35.565351+0000","last_became_peered":"2024-03-27T07:21:35.565351+0000","last_unstale":"2024-03-27T07:23:35.056874+0000","last_undegraded":"2024-03-27T07:23:35.056874+0000","last_fullsized":"2024-03-27T07:23:35.056874+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:16.871912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947900+0000","last_change":"2024-03-27T07:21:35.564100+0000","last_active":"2024-03-27T07:23:34.947900+0000","last_peered":"2024-03-27T07:23:34.947900+0000","last_clean":"2024-03-27T07:23:34.947900+0000","last_became_active":"2024-03-27T07:21:35.563748+0000","last_became_peered":"2024-03-27T07:21:35.563748+0000","last_unstale":"2024-03-27T07:23:34.947900+0000","last_undegraded":"2024-03-27T07:23:34.947900+0000","last_fullsized":"2024-03-27T07:23:34.947900+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:19:30.742692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.947885+0000","last_change":"2024-03-27T07:21:35.575036+0000","last_active":"2024-03-27T07:23:34.947885+0000","last_peered":"2024-03-27T07:23:34.947885+0000","last_clean":"2024-03-27T07:23:34.947885+0000","last_became_active":"2024-03-27T07:21:35.574689+0000","last_became_peered":"2024-03-27T07:21:35.574689+0000","last_unstale":"2024-03-27T07:23:34.947885+0000","last_undegraded":"2024-03-27T07:23:34.947885+0000","last_fullsized":"2024-03-27T07:23:34.947885+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:50:40.212930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.224610+0000","last_change":"2024-03-27T07:21:35.577814+0000","last_active":"2024-03-27T07:23:35.224610+0000","last_peered":"2024-03-27T07:23:35.224610+0000","last_clean":"2024-03-27T07:23:35.224610+0000","last_became_active":"2024-03-27T07:21:35.576265+0000","last_became_peered":"2024-03-27T07:21:35.576265+0000","last_unstale":"2024-03-27T07:23:35.224610+0000","last_undegraded":"2024-03-27T07:23:35.224610+0000","last_fullsized":"2024-03-27T07:23:35.224610+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:04.523768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222189+0000","last_change":"2024-03-27T07:21:35.568753+0000","last_active":"2024-03-27T07:23:35.222189+0000","last_peered":"2024-03-27T07:23:35.222189+0000","last_clean":"2024-03-27T07:23:35.222189+0000","last_became_active":"2024-03-27T07:21:35.568441+0000","last_became_peered":"2024-03-27T07:21:35.568441+0000","last_unstale":"2024-03-27T07:23:35.222189+0000","last_undegraded":"2024-03-27T07:23:35.222189+0000","last_fullsized":"2024-03-27T07:23:35.222189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:32:54.294960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057086+0000","last_change":"2024-03-27T07:21:35.573094+0000","last_active":"2024-03-27T07:23:35.057086+0000","last_peered":"2024-03-27T07:23:35.057086+0000","last_clean":"2024-03-27T07:23:35.057086+0000","last_became_active":"2024-03-27T07:21:35.572739+0000","last_became_peered":"2024-03-27T07:21:35.572739+0000","last_unstale":"2024-03-27T07:23:35.057086+0000","last_undegraded":"2024-03-27T07:23:35.057086+0000","last_fullsized":"2024-03-27T07:23:35.057086+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:02.566817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:34.948312+0000","last_change":"2024-03-27T07:21:35.580647+0000","last_active":"2024-03-27T07:23:34.948312+0000","last_peered":"2024-03-27T07:23:34.948312+0000","last_clean":"2024-03-27T07:23:34.948312+0000","last_became_active":"2024-03-27T07:21:35.580230+0000","last_became_peered":"2024-03-27T07:21:35.580230+0000","last_unstale":"2024-03-27T07:23:34.948312+0000","last_undegraded":"2024-03-27T07:23:34.948312+0000","last_fullsized":"2024-03-27T07:23:34.948312+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:04:37.573021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057728+0000","last_change":"2024-03-27T07:21:35.568859+0000","last_active":"2024-03-27T07:23:35.057728+0000","last_peered":"2024-03-27T07:23:35.057728+0000","last_clean":"2024-03-27T07:23:35.057728+0000","last_became_active":"2024-03-27T07:21:35.568468+0000","last_became_peered":"2024-03-27T07:21:35.568468+0000","last_unstale":"2024-03-27T07:23:35.057728+0000","last_undegraded":"2024-03-27T07:23:35.057728+0000","last_fullsized":"2024-03-27T07:23:35.057728+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:44:59.875882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.064061+0000","last_change":"2024-03-27T07:21:35.568485+0000","last_active":"2024-03-27T07:23:35.064061+0000","last_peered":"2024-03-27T07:23:35.064061+0000","last_clean":"2024-03-27T07:23:35.064061+0000","last_became_active":"2024-03-27T07:21:35.568154+0000","last_became_peered":"2024-03-27T07:21:35.568154+0000","last_unstale":"2024-03-27T07:23:35.064061+0000","last_undegraded":"2024-03-27T07:23:35.064061+0000","last_fullsized":"2024-03-27T07:23:35.064061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:08:29.418189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.057815+0000","last_change":"2024-03-27T07:21:35.567369+0000","last_active":"2024-03-27T07:23:35.057815+0000","last_peered":"2024-03-27T07:23:35.057815+0000","last_clean":"2024-03-27T07:23:35.057815+0000","last_became_active":"2024-03-27T07:21:35.564602+0000","last_became_peered":"2024-03-27T07:21:35.564602+0000","last_unstale":"2024-03-27T07:23:35.057815+0000","last_undegraded":"2024-03-27T07:23:35.057815+0000","last_fullsized":"2024-03-27T07:23:35.057815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:23:15.123502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222268+0000","last_change":"2024-03-27T07:21:35.572580+0000","last_active":"2024-03-27T07:23:35.222268+0000","last_peered":"2024-03-27T07:23:35.222268+0000","last_clean":"2024-03-27T07:23:35.222268+0000","last_became_active":"2024-03-27T07:21:35.572245+0000","last_became_peered":"2024-03-27T07:21:35.572245+0000","last_unstale":"2024-03-27T07:23:35.222268+0000","last_undegraded":"2024-03-27T07:23:35.222268+0000","last_fullsized":"2024-03-27T07:23:35.222268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:45:56.575359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.222009+0000","last_change":"2024-03-27T07:21:35.584975+0000","last_active":"2024-03-27T07:23:35.222009+0000","last_peered":"2024-03-27T07:23:35.222009+0000","last_clean":"2024-03-27T07:23:35.222009+0000","last_became_active":"2024-03-27T07:21:35.584579+0000","last_became_peered":"2024-03-27T07:21:35.584579+0000","last_unstale":"2024-03-27T07:23:35.222009+0000","last_undegraded":"2024-03-27T07:23:35.222009+0000","last_fullsized":"2024-03-27T07:23:35.222009+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:22:44.457579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-03-27T07:23:35.056880+0000","last_change":"2024-03-27T07:21:35.573496+0000","last_active":"2024-03-27T07:23:35.056880+0000","last_peered":"2024-03-27T07:23:35.056880+0000","last_clean":"2024-03-27T07:23:35.056880+0000","last_became_active":"2024-03-27T07:21:35.572946+0000","last_became_peered":"2024-03-27T07:21:35.572946+0000","last_unstale":"2024-03-27T07:23:35.056880+0000","last_undegraded":"2024-03-27T07:23:35.056880+0000","last_fullsized":"2024-03-27T07:23:35.056880+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T07:21:34.536282+0000","last_clean_scrub_stamp":"2024-03-27T07:21:34.536282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:37:50.236828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":107082,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597806,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":828,"num_read_kb":524,"num_write":287,"num_write_kb":1437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":582,"num_keys_recovered":7,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":1793418,"data_compressed":81513,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":226,"ondisk_log_size":226,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351013,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":991232,"data_stored":863566,"data_compressed":22025,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":73,"seq":313532612650,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1142784,"data_stored":1261580,"data_compressed":46598,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":68,"seq":292057776176,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1007616,"data_stored":863802,"data_compressed":22025,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":60,"seq":257698037813,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":469924,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":52,"seq":223338299450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":1062885,"data_compressed":38573,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":46,"seq":197568495678,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":469975,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":537526,"data_compressed":4748,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":991232,"data_stored":471246,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1060864,"data_stored":540107,"data_compressed":4748,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":995102,"data_compressed":28181,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920842,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":471385,"data_compressed":2879,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757316,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1064960,"data_stored":1194560,"data_compressed":44729,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35694,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":67758,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":70339,"data_compressed":1869,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":134307,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":201327,"data_compressed":8025,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":393798,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T07:23:37.967 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:23:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.107+0000 7f3b7cfac640 1 -- 172.21.15.82:0/2488744099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78100a70 msgr2=0x7f3b78100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.107+0000 7f3b7cfac640 1 --2- 172.21.15.82:0/2488744099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78100a70 0x7f3b78100e90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009ca0 tx=0x7f3b7002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.107+0000 7f3b7cfac640 1 -- 172.21.15.82:0/2488744099 shutdown_connections 2024-03-27T07:23:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.107+0000 7f3b7cfac640 1 --2- 172.21.15.82:0/2488744099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b78102620 0x7f3b78108eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.107+0000 7f3b7cfac640 1 --2- 172.21.15.82:0/2488744099 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b78101c60 0x7f3b781020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.107+0000 7f3b7cfac640 1 --2- 172.21.15.82:0/2488744099 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78100a70 0x7f3b78100e90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.107+0000 7f3b7cfac640 1 -- 172.21.15.82:0/2488744099 >> 172.21.15.82:0/2488744099 conn(0x7f3b780fbfe0 msgr2=0x7f3b780fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.107+0000 7f3b7cfac640 1 -- 172.21.15.82:0/2488744099 shutdown_connections 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.107+0000 7f3b7cfac640 1 -- 172.21.15.82:0/2488744099 wait complete. 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b7cfac640 1 Processor -- start 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b7cfac640 1 -- start start 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b7cfac640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b78100a70 0x7f3b78104ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b7cfac640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b78101c60 0x7f3b78103110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b7cfac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78102620 0x7f3b78103650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b7cfac640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7810c6f0 con 0x7f3b78102620 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b7cfac640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7810c570 con 0x7f3b78100a70 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b7cfac640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7810c870 con 0x7f3b78101c60 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b76d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78102620 0x7f3b78103650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b76d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78102620 0x7f3b78103650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49184/0 (socket says 172.21.15.82:49184) 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b7659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b78100a70 0x7f3b78104ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b76d9d640 1 -- 172.21.15.82:0/1980829907 learned_addr learned my addr 172.21.15.82:0/1980829907 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b75d9b640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b78101c60 0x7f3b78103110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b76d9d640 1 -- 172.21.15.82:0/1980829907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b78101c60 msgr2=0x7f3b78103110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b76d9d640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b78101c60 0x7f3b78103110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b76d9d640 1 -- 172.21.15.82:0/1980829907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b78100a70 msgr2=0x7f3b78104ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b76d9d640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b78100a70 0x7f3b78104ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b76d9d640 1 -- 172.21.15.82:0/1980829907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b78103ee0 con 0x7f3b78102620 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.108+0000 7f3b75d9b640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b78101c60 0x7f3b78103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.109+0000 7f3b7659c640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b78100a70 0x7f3b78104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.109+0000 7f3b76d9d640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78102620 0x7f3b78103650 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800e970 tx=0x7f3b6800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.109+0000 7f3b677fe640 1 -- 172.21.15.82:0/1980829907 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6800ccc0 con 0x7f3b78102620 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.109+0000 7f3b677fe640 1 -- 172.21.15.82:0/1980829907 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b6800ce60 con 0x7f3b78102620 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.109+0000 7f3b7cfac640 1 -- 172.21.15.82:0/1980829907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b781a1fb0 con 0x7f3b78102620 2024-03-27T07:23:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.109+0000 7f3b677fe640 1 -- 172.21.15.82:0/1980829907 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68010450 con 0x7f3b78102620 2024-03-27T07:23:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.109+0000 7f3b7cfac640 1 -- 172.21.15.82:0/1980829907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b781a2410 con 0x7f3b78102620 2024-03-27T07:23:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.110+0000 7f3b7cfac640 1 -- 172.21.15.82:0/1980829907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b781a2730 con 0x7f3b78102620 2024-03-27T07:23:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.111+0000 7f3b677fe640 1 -- 172.21.15.82:0/1980829907 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) ==== 138490+0+0 (secure 0 0 0) 0x7f3b68005020 con 0x7f3b78102620 2024-03-27T07:23:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.111+0000 7f3b677fe640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3b600a3780 0x7f3b600a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.112+0000 7f3b7659c640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3b600a3780 0x7f3b600a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.112+0000 7f3b677fe640 1 -- 172.21.15.82:0/1980829907 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f3b680d04c0 con 0x7f3b78102620 2024-03-27T07:23:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.112+0000 7f3b7659c640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3b600a3780 0x7f3b600a5c40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b7002c700 tx=0x7f3b70032590 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.116+0000 7f3b677fe640 1 -- 172.21.15.82:0/1980829907 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f3b6809cda0 con 0x7f3b78102620 2024-03-27T07:23:38.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:37 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/646719184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:38.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:37 smithi082 ceph-mon[32178]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:23:38.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:37 smithi082 ceph-mon[32178]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:23:38.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:37 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:37 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:37 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:37 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:37 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:37 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:37 smithi082 ceph-mon[32178]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:23:38.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:37 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/646719184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:38.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:37 smithi149 ceph-mon[36065]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:23:38.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:37 smithi149 ceph-mon[36065]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:23:38.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:37 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:37 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:37 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:37 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:37 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:37 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:37 smithi149 ceph-mon[36065]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:23:38.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:37 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/646719184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:38.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:37 smithi153 ceph-mon[36179]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:23:38.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:37 smithi153 ceph-mon[36179]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:23:38.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:37 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:37 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:37 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:37 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:37 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:37 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:38.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:37 smithi153 ceph-mon[36179]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:23:38.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.302+0000 7f3b7cfac640 1 -- 172.21.15.82:0/1980829907 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b781a2a90 con 0x7f3b78102620 2024-03-27T07:23:38.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.304+0000 7f3b677fe640 1 -- 172.21.15.82:0/1980829907 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22880 (secure 0 0 0) 0x7f3b6809c6a0 con 0x7f3b78102620 2024-03-27T07:23:38.306 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:38.306 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:23:34.942015+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1643774131":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3910998089":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6801/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2476913094":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/1969604742":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6800/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:23:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 -- 172.21.15.82:0/1980829907 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3b600a3780 msgr2=0x7f3b600a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3b600a3780 0x7f3b600a5c40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b7002c700 tx=0x7f3b70032590 comp rx=0 tx=0).stop 2024-03-27T07:23:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 -- 172.21.15.82:0/1980829907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78102620 msgr2=0x7f3b78103650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78102620 0x7f3b78103650 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800e970 tx=0x7f3b6800ed70 comp rx=0 tx=0).stop 2024-03-27T07:23:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 -- 172.21.15.82:0/1980829907 shutdown_connections 2024-03-27T07:23:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3b600a3780 0x7f3b600a5c40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78102620 0x7f3b78103650 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b78101c60 0x7f3b78103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 --2- 172.21.15.82:0/1980829907 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3b78100a70 0x7f3b78104ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 -- 172.21.15.82:0/1980829907 >> 172.21.15.82:0/1980829907 conn(0x7f3b780fbfe0 msgr2=0x7f3b78068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 -- 172.21.15.82:0/1980829907 shutdown_connections 2024-03-27T07:23:38.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.306+0000 7f3b7cfac640 1 -- 172.21.15.82:0/1980829907 wait complete. 2024-03-27T07:23:38.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T07:21:32.592597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T07:21:33.858606+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:23:38.320 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:23:38.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/992153103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4cc104f00 msgr2=0x7ff4cc1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 --2- 172.21.15.82:0/992153103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4cc104f00 0x7ff4cc1072f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009900 tx=0x7ff4c002bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/992153103 shutdown_connections 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 --2- 172.21.15.82:0/992153103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4cc104f00 0x7ff4cc1072f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 --2- 172.21.15.82:0/992153103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4cc107830 0x7ff4cc109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 --2- 172.21.15.82:0/992153103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4cc1025d0 0x7ff4cc1049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/992153103 >> 172.21.15.82:0/992153103 conn(0x7ff4cc0fbfe0 msgr2=0x7ff4cc0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/992153103 shutdown_connections 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/992153103 wait complete. 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 Processor -- start 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.427+0000 7ff4d0f3a640 1 -- start start 2024-03-27T07:23:38.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4d0f3a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4cc1025d0 0x7ff4cc101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4d0f3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4cc104f00 0x7ff4cc100580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4d0f3a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4cc107830 0x7ff4cc100ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4d0f3a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc10d820 con 0x7ff4cc1025d0 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4d0f3a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc10d6a0 con 0x7ff4cc107830 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4d0f3a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff4cc10d9a0 con 0x7ff4cc104f00 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4ca59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4cc1025d0 0x7ff4cc101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4ca59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4cc1025d0 0x7ff4cc101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49202/0 (socket says 172.21.15.82:49202) 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4ca59c640 1 -- 172.21.15.82:0/1128470575 learned_addr learned my addr 172.21.15.82:0/1128470575 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4c9d9b640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4cc104f00 0x7ff4cc100580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4cad9d640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4cc107830 0x7ff4cc100ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4ca59c640 1 -- 172.21.15.82:0/1128470575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4cc104f00 msgr2=0x7ff4cc100580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4ca59c640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4cc104f00 0x7ff4cc100580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4ca59c640 1 -- 172.21.15.82:0/1128470575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4cc107830 msgr2=0x7ff4cc100ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4ca59c640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4cc107830 0x7ff4cc100ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4ca59c640 1 -- 172.21.15.82:0/1128470575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4cc101350 con 0x7ff4cc1025d0 2024-03-27T07:23:38.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4ca59c640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4cc1025d0 0x7ff4cc101f40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00e9f0 tx=0x7ff4bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:38.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4bb7fe640 1 -- 172.21.15.82:0/1128470575 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00cd80 con 0x7ff4cc1025d0 2024-03-27T07:23:38.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/1128470575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4cc1a1fe0 con 0x7ff4cc1025d0 2024-03-27T07:23:38.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4bb7fe640 1 -- 172.21.15.82:0/1128470575 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff4bc010910 con 0x7ff4cc1025d0 2024-03-27T07:23:38.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4bb7fe640 1 -- 172.21.15.82:0/1128470575 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc018950 con 0x7ff4cc1025d0 2024-03-27T07:23:38.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.428+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/1128470575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4cc1a23f0 con 0x7ff4cc1025d0 2024-03-27T07:23:38.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.429+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/1128470575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4cc0fdad0 con 0x7ff4cc1025d0 2024-03-27T07:23:38.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.431+0000 7ff4bb7fe640 1 -- 172.21.15.82:0/1128470575 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) ==== 138490+0+0 (secure 0 0 0) 0x7ff4bc010ac0 con 0x7ff4cc1025d0 2024-03-27T07:23:38.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.431+0000 7ff4bb7fe640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff4b40a3780 0x7ff4b40a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.432+0000 7ff4c9d9b640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff4b40a3780 0x7ff4b40a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.432+0000 7ff4bb7fe640 1 -- 172.21.15.82:0/1128470575 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7ff4bc0d07a0 con 0x7ff4cc1025d0 2024-03-27T07:23:38.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.432+0000 7ff4c9d9b640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff4b40a3780 0x7ff4b40a5c40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff4c002c170 tx=0x7ff4c002df90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:38.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.435+0000 7ff4bb7fe640 1 -- 172.21.15.82:0/1128470575 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ff4bc09ca30 con 0x7ff4cc1025d0 2024-03-27T07:23:38.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.631+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/1128470575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff4cc02d5e0 con 0x7ff4cc1025d0 2024-03-27T07:23:38.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.632+0000 7ff4bb7fe640 1 -- 172.21.15.82:0/1128470575 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7ff4bc0a0d30 con 0x7ff4cc1025d0 2024-03-27T07:23:38.634 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:23:38.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/1128470575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff4b40a3780 msgr2=0x7ff4b40a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff4b40a3780 0x7ff4b40a5c40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff4c002c170 tx=0x7ff4c002df90 comp rx=0 tx=0).stop 2024-03-27T07:23:38.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/1128470575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4cc1025d0 msgr2=0x7ff4cc101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4cc1025d0 0x7ff4cc101f40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc00e9f0 tx=0x7ff4bc00eeb0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/1128470575 shutdown_connections 2024-03-27T07:23:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff4b40a3780 0x7ff4b40a5c40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff4cc107830 0x7ff4cc100ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4cc104f00 0x7ff4cc100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 --2- 172.21.15.82:0/1128470575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff4cc1025d0 0x7ff4cc101f40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/1128470575 >> 172.21.15.82:0/1128470575 conn(0x7ff4cc0fbfe0 msgr2=0x7ff4cc102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/1128470575 shutdown_connections 2024-03-27T07:23:38.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.634+0000 7ff4d0f3a640 1 -- 172.21.15.82:0/1128470575 wait complete. 2024-03-27T07:23:38.648 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T07:23:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.755+0000 7fa20aceb640 1 -- 172.21.15.82:0/2915534964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204100a60 msgr2=0x7fa204100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.755+0000 7fa20aceb640 1 --2- 172.21.15.82:0/2915534964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204100a60 0x7fa204100e80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009900 tx=0x7fa1f802bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.755+0000 7fa20aceb640 1 -- 172.21.15.82:0/2915534964 shutdown_connections 2024-03-27T07:23:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.755+0000 7fa20aceb640 1 --2- 172.21.15.82:0/2915534964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa204102610 0x7fa204108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.755+0000 7fa20aceb640 1 --2- 172.21.15.82:0/2915534964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa204101c50 0x7fa2041020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.755+0000 7fa20aceb640 1 --2- 172.21.15.82:0/2915534964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204100a60 0x7fa204100e80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.755+0000 7fa20aceb640 1 -- 172.21.15.82:0/2915534964 >> 172.21.15.82:0/2915534964 conn(0x7fa2040fbff0 msgr2=0x7fa2040fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.755+0000 7fa20aceb640 1 -- 172.21.15.82:0/2915534964 shutdown_connections 2024-03-27T07:23:38.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.755+0000 7fa20aceb640 1 -- 172.21.15.82:0/2915534964 wait complete. 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa20aceb640 1 Processor -- start 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa20aceb640 1 -- start start 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa20aceb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa204100a60 0x7fa204197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa20aceb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204101c50 0x7fa2041983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa20aceb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa204102610 0x7fa20419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa20aceb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa20410c6e0 con 0x7fa204101c50 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa20aceb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa20410c560 con 0x7fa204100a60 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa20aceb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa20410c860 con 0x7fa204102610 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa203fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204101c50 0x7fa2041983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa203fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204101c50 0x7fa2041983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49218/0 (socket says 172.21.15.82:49218) 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa203fff640 1 -- 172.21.15.82:0/570436290 learned_addr learned my addr 172.21.15.82:0/570436290 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa209288640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa204102610 0x7fa20419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa208a87640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa204100a60 0x7fa204197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa203fff640 1 -- 172.21.15.82:0/570436290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa204102610 msgr2=0x7fa20419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa203fff640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa204102610 0x7fa20419f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa203fff640 1 -- 172.21.15.82:0/570436290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa204100a60 msgr2=0x7fa204197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa203fff640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa204100a60 0x7fa204197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa203fff640 1 -- 172.21.15.82:0/570436290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20419fad0 con 0x7fa204101c50 2024-03-27T07:23:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa203fff640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204101c50 0x7fa2041983f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000e9f0 tx=0x7fa1f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa201ffb640 1 -- 172.21.15.82:0/570436290 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f000cd80 con 0x7fa204101c50 2024-03-27T07:23:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa201ffb640 1 -- 172.21.15.82:0/570436290 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa1f0010910 con 0x7fa204101c50 2024-03-27T07:23:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.756+0000 7fa20aceb640 1 -- 172.21.15.82:0/570436290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20419fdc0 con 0x7fa204101c50 2024-03-27T07:23:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.757+0000 7fa201ffb640 1 -- 172.21.15.82:0/570436290 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0018990 con 0x7fa204101c50 2024-03-27T07:23:38.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.757+0000 7fa20aceb640 1 -- 172.21.15.82:0/570436290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2041a0280 con 0x7fa204101c50 2024-03-27T07:23:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.758+0000 7fa20aceb640 1 -- 172.21.15.82:0/570436290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2041a04b0 con 0x7fa204101c50 2024-03-27T07:23:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.759+0000 7fa201ffb640 1 -- 172.21.15.82:0/570436290 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) ==== 138490+0+0 (secure 0 0 0) 0x7fa1f0010ac0 con 0x7fa204101c50 2024-03-27T07:23:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.759+0000 7fa201ffb640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa1f40a3780 0x7fa1f40a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.760+0000 7fa201ffb640 1 -- 172.21.15.82:0/570436290 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa1f00d03f0 con 0x7fa204101c50 2024-03-27T07:23:38.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.760+0000 7fa208a87640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa1f40a3780 0x7fa1f40a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:38.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.760+0000 7fa208a87640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa1f40a3780 0x7fa1f40a5c40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8000c00 tx=0x7fa1f8005fd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:38.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.764+0000 7fa201ffb640 1 -- 172.21.15.82:0/570436290 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa1f009c680 con 0x7fa204101c50 2024-03-27T07:23:38.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.956+0000 7fa20aceb640 1 -- 172.21.15.82:0/570436290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa2041a0680 con 0x7fa204101c50 2024-03-27T07:23:38.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.957+0000 7fa201ffb640 1 -- 172.21.15.82:0/570436290 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7fa1f00a0980 con 0x7fa204101c50 2024-03-27T07:23:38.958 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-27T07:23:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 -- 172.21.15.82:0/570436290 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa1f40a3780 msgr2=0x7fa1f40a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa1f40a3780 0x7fa1f40a5c40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8000c00 tx=0x7fa1f8005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 -- 172.21.15.82:0/570436290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204101c50 msgr2=0x7fa2041983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204101c50 0x7fa2041983f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000e9f0 tx=0x7fa1f000eeb0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 -- 172.21.15.82:0/570436290 shutdown_connections 2024-03-27T07:23:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa1f40a3780 0x7fa1f40a5c40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa204101c50 0x7fa2041983f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa204102610 0x7fa20419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 --2- 172.21.15.82:0/570436290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa204100a60 0x7fa204197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 -- 172.21.15.82:0/570436290 >> 172.21.15.82:0/570436290 conn(0x7fa2040fbff0 msgr2=0x7fa2040fdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.960+0000 7fa20aceb640 1 -- 172.21.15.82:0/570436290 shutdown_connections 2024-03-27T07:23:38.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:38.961+0000 7fa20aceb640 1 -- 172.21.15.82:0/570436290 wait complete. 2024-03-27T07:23:38.978 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T07:23:39.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 -- 172.21.15.82:0/3183286221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62d0104f80 msgr2=0x7f62d0107370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 --2- 172.21.15.82:0/3183286221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62d0104f80 0x7f62d0107370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009900 tx=0x7f62bc02bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 -- 172.21.15.82:0/3183286221 shutdown_connections 2024-03-27T07:23:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 --2- 172.21.15.82:0/3183286221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d01078b0 0x7f62d0109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 --2- 172.21.15.82:0/3183286221 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62d0104f80 0x7f62d0107370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 --2- 172.21.15.82:0/3183286221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d0102650 0x7f62d0104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 -- 172.21.15.82:0/3183286221 >> 172.21.15.82:0/3183286221 conn(0x7f62d00fbfe0 msgr2=0x7f62d00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 -- 172.21.15.82:0/3183286221 shutdown_connections 2024-03-27T07:23:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 -- 172.21.15.82:0/3183286221 wait complete. 2024-03-27T07:23:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 Processor -- start 2024-03-27T07:23:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.090+0000 7f62d6ec2640 1 -- start start 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62d6ec2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62d0102650 0x7f62d0197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62d6ec2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d0104f80 0x7f62d01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62d6ec2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d01078b0 0x7f62d019f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62d6ec2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f62d010d7a0 con 0x7f62d0104f80 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62d6ec2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f62d010d620 con 0x7f62d0102650 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62d6ec2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f62d010d920 con 0x7f62d01078b0 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d0104f80 0x7f62d01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62d4c5e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62d0102650 0x7f62d0197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d0104f80 0x7f62d01983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49240/0 (socket says 172.21.15.82:49240) 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cffff640 1 -- 172.21.15.82:0/170167124 learned_addr learned my addr 172.21.15.82:0/170167124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62d545f640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d01078b0 0x7f62d019f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cffff640 1 -- 172.21.15.82:0/170167124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d01078b0 msgr2=0x7f62d019f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cffff640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d01078b0 0x7f62d019f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cffff640 1 -- 172.21.15.82:0/170167124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62d0102650 msgr2=0x7f62d0197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cffff640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62d0102650 0x7f62d0197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cffff640 1 -- 172.21.15.82:0/170167124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d019fad0 con 0x7f62d0104f80 2024-03-27T07:23:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62d4c5e640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62d0102650 0x7f62d0197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cffff640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d0104f80 0x7f62d01983f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f62bc000c00 tx=0x7f62bc02c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cdffb640 1 -- 172.21.15.82:0/170167124 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc041070 con 0x7f62d0104f80 2024-03-27T07:23:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cdffb640 1 -- 172.21.15.82:0/170167124 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62bc004450 con 0x7f62d0104f80 2024-03-27T07:23:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62cdffb640 1 -- 172.21.15.82:0/170167124 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62bc003df0 con 0x7f62d0104f80 2024-03-27T07:23:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.091+0000 7f62d6ec2640 1 -- 172.21.15.82:0/170167124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d019fd60 con 0x7f62d0104f80 2024-03-27T07:23:39.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.092+0000 7f62d6ec2640 1 -- 172.21.15.82:0/170167124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d01a01f0 con 0x7f62d0104f80 2024-03-27T07:23:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.093+0000 7f62d6ec2640 1 -- 172.21.15.82:0/170167124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d00fdad0 con 0x7f62d0104f80 2024-03-27T07:23:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.094+0000 7f62cdffb640 1 -- 172.21.15.82:0/170167124 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) ==== 138490+0+0 (secure 0 0 0) 0x7f62bc044070 con 0x7f62d0104f80 2024-03-27T07:23:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.094+0000 7f62cdffb640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f62c00a3780 0x7f62c00a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.095+0000 7f62d4c5e640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f62c00a3780 0x7f62c00a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.095+0000 7f62cdffb640 1 -- 172.21.15.82:0/170167124 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f62bc0f1c90 con 0x7f62d0104f80 2024-03-27T07:23:39.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.095+0000 7f62d4c5e640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f62c00a3780 0x7f62c00a5c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009fc0 tx=0x7f62c4005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:39.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.098+0000 7f62cdffb640 1 -- 172.21.15.82:0/170167124 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f62bc0be6b0 con 0x7f62d0104f80 2024-03-27T07:23:39.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:23:39.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: mgrmap e22: x(active, since 3s), standbys: y, z 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1980829907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi153 to 174.1M 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: Unable to set osd_memory_target on smithi153 to 182635622: error parsing value: Value '182635622' is below minimum 939524096 2024-03-27T07:23:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-27T07:23:39.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: Unable to set osd_memory_target on smithi082 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-03-27T07:23:39.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:23:39.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:23:39.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-27T07:23:39.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: Updating smithi149:/etc/ceph/ceph.conf 2024-03-27T07:23:39.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: Updating smithi153:/etc/ceph/ceph.conf 2024-03-27T07:23:39.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:38 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1128470575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:39.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: mgrmap e22: x(active, since 3s), standbys: y, z 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1980829907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi153 to 174.1M 2024-03-27T07:23:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: Unable to set osd_memory_target on smithi153 to 182635622: error parsing value: Value '182635622' is below minimum 939524096 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-27T07:23:39.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: Unable to set osd_memory_target on smithi082 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-03-27T07:23:39.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:23:39.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:23:39.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-27T07:23:39.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: Updating smithi149:/etc/ceph/ceph.conf 2024-03-27T07:23:39.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: Updating smithi153:/etc/ceph/ceph.conf 2024-03-27T07:23:39.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:38 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1128470575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:39.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.323+0000 7f62d6ec2640 1 -- 172.21.15.82:0/170167124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f62d002d500 con 0x7f62d0104f80 2024-03-27T07:23:39.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.323+0000 7f62cdffb640 1 -- 172.21.15.82:0/170167124 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f62bc0bdfb0 con 0x7f62d0104f80 2024-03-27T07:23:39.326 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-27T07:23:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 -- 172.21.15.82:0/170167124 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f62c00a3780 msgr2=0x7f62c00a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f62c00a3780 0x7f62c00a5c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009fc0 tx=0x7f62c4005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 -- 172.21.15.82:0/170167124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d0104f80 msgr2=0x7f62d01983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d0104f80 0x7f62d01983f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f62bc000c00 tx=0x7f62bc02c640 comp rx=0 tx=0).stop 2024-03-27T07:23:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 -- 172.21.15.82:0/170167124 shutdown_connections 2024-03-27T07:23:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f62c00a3780 0x7f62c00a5c40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62d0104f80 0x7f62d01983f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f62d01078b0 0x7f62d019f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 --2- 172.21.15.82:0/170167124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f62d0102650 0x7f62d0197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 -- 172.21.15.82:0/170167124 >> 172.21.15.82:0/170167124 conn(0x7f62d00fbfe0 msgr2=0x7f62d0103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 -- 172.21.15.82:0/170167124 shutdown_connections 2024-03-27T07:23:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.326+0000 7f62d6ec2640 1 -- 172.21.15.82:0/170167124 wait complete. 2024-03-27T07:23:39.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T07:23:39.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: mgrmap e22: x(active, since 3s), standbys: y, z 2024-03-27T07:23:39.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1980829907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:39.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.339 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi153 to 174.1M 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: Unable to set osd_memory_target on smithi153 to 182635622: error parsing value: Value '182635622' is below minimum 939524096 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]': finished 2024-03-27T07:23:39.340 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.341 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:39.341 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.341 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.341 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.341 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.341 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.342 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:23:39.342 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.342 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.342 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:23:39.343 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-27T07:23:39.343 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: Unable to set osd_memory_target on smithi082 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-03-27T07:23:39.343 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:23:39.343 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:23:39.343 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: Updating smithi082:/etc/ceph/ceph.conf 2024-03-27T07:23:39.343 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: Updating smithi149:/etc/ceph/ceph.conf 2024-03-27T07:23:39.343 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: Updating smithi153:/etc/ceph/ceph.conf 2024-03-27T07:23:39.343 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:38 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1128470575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:23:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 -- 172.21.15.82:0/1651731993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d881024a0 msgr2=0x7f7d8810e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 --2- 172.21.15.82:0/1651731993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d881024a0 0x7f7d8810e9b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009cd0 tx=0x7f7d8002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 -- 172.21.15.82:0/1651731993 shutdown_connections 2024-03-27T07:23:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 --2- 172.21.15.82:0/1651731993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d881024a0 0x7f7d8810e9b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 --2- 172.21.15.82:0/1651731993 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d88101ae0 0x7f7d88101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 --2- 172.21.15.82:0/1651731993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88107b80 0x7f7d88107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 -- 172.21.15.82:0/1651731993 >> 172.21.15.82:0/1651731993 conn(0x7f7d880fd5f0 msgr2=0x7f7d880ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 -- 172.21.15.82:0/1651731993 shutdown_connections 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 -- 172.21.15.82:0/1651731993 wait complete. 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 Processor -- start 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.444+0000 7f7d900d4640 1 -- start start 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d900d4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88101ae0 0x7f7d881983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d900d4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d881024a0 0x7f7d88198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d900d4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d88107b80 0x7f7d8819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d900d4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88111f00 con 0x7f7d881024a0 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d900d4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88111d80 con 0x7f7d88107b80 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d900d4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7d88112080 con 0x7f7d88101ae0 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8d66f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d881024a0 0x7f7d88198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8d66f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d881024a0 0x7f7d88198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49258/0 (socket says 172.21.15.82:49258) 2024-03-27T07:23:39.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8d66f640 1 -- 172.21.15.82:0/2613439141 learned_addr learned my addr 172.21.15.82:0/2613439141 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8de70640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88101ae0 0x7f7d881983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8e671640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d88107b80 0x7f7d8819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8d66f640 1 -- 172.21.15.82:0/2613439141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88101ae0 msgr2=0x7f7d881983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8d66f640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88101ae0 0x7f7d881983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8d66f640 1 -- 172.21.15.82:0/2613439141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d88107b80 msgr2=0x7f7d8819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8d66f640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d88107b80 0x7f7d8819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8d66f640 1 -- 172.21.15.82:0/2613439141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d8819d3d0 con 0x7f7d881024a0 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d8d66f640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d881024a0 0x7f7d88198920 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800e9f0 tx=0x7f7d7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d7effd640 1 -- 172.21.15.82:0/2613439141 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7800cd80 con 0x7f7d881024a0 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d7effd640 1 -- 172.21.15.82:0/2613439141 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7d78010910 con 0x7f7d881024a0 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d900d4640 1 -- 172.21.15.82:0/2613439141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d8819d6c0 con 0x7f7d881024a0 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.445+0000 7f7d7effd640 1 -- 172.21.15.82:0/2613439141 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d78018990 con 0x7f7d881024a0 2024-03-27T07:23:39.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.446+0000 7f7d900d4640 1 -- 172.21.15.82:0/2613439141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d881a4f50 con 0x7f7d881024a0 2024-03-27T07:23:39.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.446+0000 7f7d900d4640 1 -- 172.21.15.82:0/2613439141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d88068d90 con 0x7f7d881024a0 2024-03-27T07:23:39.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.448+0000 7f7d7effd640 1 -- 172.21.15.82:0/2613439141 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) ==== 138490+0+0 (secure 0 0 0) 0x7f7d78010ac0 con 0x7f7d881024a0 2024-03-27T07:23:39.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.448+0000 7f7d7effd640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7d740a3780 0x7f7d740a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.449+0000 7f7d7effd640 1 -- 172.21.15.82:0/2613439141 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f7d780d07a0 con 0x7f7d881024a0 2024-03-27T07:23:39.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.449+0000 7f7d8de70640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7d740a3780 0x7f7d740a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.449+0000 7f7d8de70640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7d740a3780 0x7f7d740a5c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009b50 tx=0x7f7d84005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:39.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.454+0000 7f7d7effd640 1 -- 172.21.15.82:0/2613439141 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7d7809ca30 con 0x7f7d881024a0 2024-03-27T07:23:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.711+0000 7f7d900d4640 1 -- 172.21.15.82:0/2613439141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d88199730 con 0x7f7d881024a0 2024-03-27T07:23:39.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.712+0000 7f7d7effd640 1 -- 172.21.15.82:0/2613439141 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11860 (secure 0 0 0) 0x7f7d88199730 con 0x7f7d881024a0 2024-03-27T07:23:39.714 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:39.714 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:23:33.807990+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:23:39.714 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-03-27T07:23:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 -- 172.21.15.82:0/2613439141 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7d740a3780 msgr2=0x7f7d740a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7d740a3780 0x7f7d740a5c40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009b50 tx=0x7f7d84005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:39.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 -- 172.21.15.82:0/2613439141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d881024a0 msgr2=0x7f7d88198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d881024a0 0x7f7d88198920 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7d7800e9f0 tx=0x7f7d7800eeb0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 -- 172.21.15.82:0/2613439141 shutdown_connections 2024-03-27T07:23:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7d740a3780 0x7f7d740a5c40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d881024a0 0x7f7d88198920 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7d88107b80 0x7f7d8819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 --2- 172.21.15.82:0/2613439141 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7d88101ae0 0x7f7d881983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 -- 172.21.15.82:0/2613439141 >> 172.21.15.82:0/2613439141 conn(0x7f7d880fd5f0 msgr2=0x7f7d880fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 -- 172.21.15.82:0/2613439141 shutdown_connections 2024-03-27T07:23:39.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.714+0000 7f7d900d4640 1 -- 172.21.15.82:0/2613439141 wait complete. 2024-03-27T07:23:39.728 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:23:39.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.827+0000 7f289625c640 1 -- 172.21.15.82:0/3615474145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2890107b80 msgr2=0x7f2890107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.827+0000 7f289625c640 1 --2- 172.21.15.82:0/3615474145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2890107b80 0x7f2890107f60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2880009930 tx=0x7f288002bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.827+0000 7f289625c640 1 -- 172.21.15.82:0/3615474145 shutdown_connections 2024-03-27T07:23:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.827+0000 7f289625c640 1 --2- 172.21.15.82:0/3615474145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f28901024a0 0x7f289010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.827+0000 7f289625c640 1 --2- 172.21.15.82:0/3615474145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2890101ae0 0x7f2890101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.827+0000 7f289625c640 1 --2- 172.21.15.82:0/3615474145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2890107b80 0x7f2890107f60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.827+0000 7f289625c640 1 -- 172.21.15.82:0/3615474145 >> 172.21.15.82:0/3615474145 conn(0x7f28900fd5f0 msgr2=0x7f28900ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.827+0000 7f289625c640 1 -- 172.21.15.82:0/3615474145 shutdown_connections 2024-03-27T07:23:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.827+0000 7f289625c640 1 -- 172.21.15.82:0/3615474145 wait complete. 2024-03-27T07:23:39.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.827+0000 7f289625c640 1 Processor -- start 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f289625c640 1 -- start start 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f289625c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2890101ae0 0x7f2890198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f289625c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28901024a0 0x7f2890198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f289625c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2890107b80 0x7f289019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f289625c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2890111f00 con 0x7f2890101ae0 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f289625c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2890111d80 con 0x7f2890107b80 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f289625c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2890112080 con 0x7f28901024a0 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2890101ae0 0x7f2890198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2890101ae0 0x7f2890198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49272/0 (socket says 172.21.15.82:49272) 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288f7fe640 1 -- 172.21.15.82:0/1520489736 learned_addr learned my addr 172.21.15.82:0/1520489736 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288effd640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28901024a0 0x7f2890198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288ffff640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2890107b80 0x7f289019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288f7fe640 1 -- 172.21.15.82:0/1520489736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28901024a0 msgr2=0x7f2890198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288f7fe640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28901024a0 0x7f2890198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288f7fe640 1 -- 172.21.15.82:0/1520489736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2890107b80 msgr2=0x7f289019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288f7fe640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2890107b80 0x7f289019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288f7fe640 1 -- 172.21.15.82:0/1520489736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289019d430 con 0x7f2890101ae0 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288effd640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28901024a0 0x7f2890198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.828+0000 7f288f7fe640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2890101ae0 0x7f2890198440 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2880009230 tx=0x7f288002cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.829+0000 7f288cff9640 1 -- 172.21.15.82:0/1520489736 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880041070 con 0x7f2890101ae0 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.829+0000 7f289625c640 1 -- 172.21.15.82:0/1520489736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289019d6c0 con 0x7f2890101ae0 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.829+0000 7f288cff9640 1 -- 172.21.15.82:0/1520489736 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2880004450 con 0x7f2890101ae0 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.829+0000 7f288cff9640 1 -- 172.21.15.82:0/1520489736 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880003e50 con 0x7f2890101ae0 2024-03-27T07:23:39.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.829+0000 7f289625c640 1 -- 172.21.15.82:0/1520489736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28901a4fb0 con 0x7f2890101ae0 2024-03-27T07:23:39.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.830+0000 7f289625c640 1 -- 172.21.15.82:0/1520489736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28901031e0 con 0x7f2890101ae0 2024-03-27T07:23:39.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.831+0000 7f288cff9640 1 -- 172.21.15.82:0/1520489736 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 22) ==== 138490+0+0 (secure 0 0 0) 0x7f2880044070 con 0x7f2890101ae0 2024-03-27T07:23:39.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.831+0000 7f288cff9640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f287c0a3920 0x7f287c0a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:39.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.831+0000 7f288effd640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f287c0a3920 0x7f287c0a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:39.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.831+0000 7f288cff9640 1 -- 172.21.15.82:0/1520489736 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f28800f1890 con 0x7f2890101ae0 2024-03-27T07:23:39.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.832+0000 7f288effd640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f287c0a3920 0x7f287c0a5de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f28900ffcb0 tx=0x7f2878005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:39.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.836+0000 7f288cff9640 1 -- 172.21.15.82:0/1520489736 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f28800bdc30 con 0x7f2890101ae0 2024-03-27T07:23:39.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:39.976+0000 7f288cff9640 1 -- 172.21.15.82:0/1520489736 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 23) ==== 138546+0+0 (secure 0 0 0) 0x7f28800035f0 con 0x7f2890101ae0 2024-03-27T07:23:40.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.033+0000 7f289625c640 1 -- 172.21.15.82:0/1520489736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f289010a050 con 0x7f2890101ae0 2024-03-27T07:23:40.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.034+0000 7f288cff9640 1 -- 172.21.15.82:0/1520489736 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+22880 (secure 0 0 0) 0x7f28800aea60 con 0x7f2890101ae0 2024-03-27T07:23:40.037 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:23:40.037 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":89,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:23:34.942015+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1643774131":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3910998089":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6801/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2476913094":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/1969604742":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6800/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:23:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.036+0000 7f289625c640 1 -- 172.21.15.82:0/1520489736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f287c0a3920 msgr2=0x7f287c0a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.036+0000 7f289625c640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f287c0a3920 0x7f287c0a5de0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f28900ffcb0 tx=0x7f2878005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.036+0000 7f289625c640 1 -- 172.21.15.82:0/1520489736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2890101ae0 msgr2=0x7f2890198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.036+0000 7f289625c640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2890101ae0 0x7f2890198440 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2880009230 tx=0x7f288002cb30 comp rx=0 tx=0).stop 2024-03-27T07:23:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.036+0000 7f289625c640 1 -- 172.21.15.82:0/1520489736 shutdown_connections 2024-03-27T07:23:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.036+0000 7f289625c640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f287c0a3920 0x7f287c0a5de0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.036+0000 7f289625c640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2890107b80 0x7f289019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.036+0000 7f289625c640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28901024a0 0x7f2890198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.036+0000 7f289625c640 1 --2- 172.21.15.82:0/1520489736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2890101ae0 0x7f2890198440 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.036+0000 7f289625c640 1 -- 172.21.15.82:0/1520489736 >> 172.21.15.82:0/1520489736 conn(0x7f28900fd5f0 msgr2=0x7f28900fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.037+0000 7f289625c640 1 -- 172.21.15.82:0/1520489736 shutdown_connections 2024-03-27T07:23:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.037+0000 7f289625c640 1 -- 172.21.15.82:0/1520489736 wait complete. 2024-03-27T07:23:40.050 DEBUG:tasks.fwd_scrub:Yielding 2024-03-27T07:23:40.050 INFO:teuthology.run_tasks:Running task exec... 2024-03-27T07:23:40.060 INFO:teuthology.task.exec:Executing custom commands... 2024-03-27T07:23:40.061 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T07:23:40.061 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-03-27T07:23:40.061 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: Updating smithi149:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:23:40.062 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: Updating smithi082:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:23:40.062 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: Updating smithi153:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:23:40.062 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/570436290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:40.062 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:23:40.062 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:23:40.062 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:23:40.062 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:23:40.062 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: Updating smithi149:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:23:40.062 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/170167124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:40.062 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: Updating smithi082:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: Updating smithi153:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2613439141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:23:40.063 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:23:40.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:23:40.064 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:39 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.064 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-03-27T07:23:40.064 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T07:23:40.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:23:40.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T07:23:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.168+0000 7f76ce015640 1 -- 172.21.15.82:0/550219228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c8100a10 msgr2=0x7f76c8100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.168+0000 7f76ce015640 1 --2- 172.21.15.82:0/550219228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c8100a10 0x7f76c8100e90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009930 tx=0x7f76b002bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.168+0000 7f76ce015640 1 -- 172.21.15.82:0/550219228 shutdown_connections 2024-03-27T07:23:40.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.168+0000 7f76ce015640 1 --2- 172.21.15.82:0/550219228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c8100a10 0x7f76c8100e90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.168+0000 7f76ce015640 1 --2- 172.21.15.82:0/550219228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c81013d0 0x7f76c810d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.168+0000 7f76ce015640 1 --2- 172.21.15.82:0/550219228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c8106a20 0x7f76c8106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.168+0000 7f76ce015640 1 -- 172.21.15.82:0/550219228 >> 172.21.15.82:0/550219228 conn(0x7f76c8077b70 msgr2=0x7f76c8077f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.168+0000 7f76ce015640 1 -- 172.21.15.82:0/550219228 shutdown_connections 2024-03-27T07:23:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.168+0000 7f76ce015640 1 -- 172.21.15.82:0/550219228 wait complete. 2024-03-27T07:23:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76ce015640 1 Processor -- start 2024-03-27T07:23:40.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76ce015640 1 -- start start 2024-03-27T07:23:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76ce015640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c8100a10 0x7f76c81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76ce015640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c81013d0 0x7f76c81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76ce015640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c8106a20 0x7f76c819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76ce015640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f76c8111f30 con 0x7f76c8100a10 2024-03-27T07:23:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76ce015640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f76c8111db0 con 0x7f76c8106a20 2024-03-27T07:23:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76ce015640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f76c81120b0 con 0x7f76c81013d0 2024-03-27T07:23:40.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76c77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c8100a10 0x7f76c81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f7c853d6640 1 -- 172.21.15.82:0/1588627772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c800696f0 msgr2=0x7f7c8010e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f7c853d6640 1 --2- 172.21.15.82:0/1588627772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c800696f0 0x7f7c8010e990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009cd0 tx=0x7f7c7802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76c77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c8100a10 0x7f76c81983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49306/0 (socket says 172.21.15.82:49306) 2024-03-27T07:23:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76c77fe640 1 -- 172.21.15.82:0/1539236004 learned_addr learned my addr 172.21.15.82:0/1539236004 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76c7fff640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c8106a20 0x7f76c819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f7c853d6640 1 -- 172.21.15.82:0/1588627772 shutdown_connections 2024-03-27T07:23:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f7c853d6640 1 --2- 172.21.15.82:0/1588627772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c800696f0 0x7f7c8010e990 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f7c853d6640 1 --2- 172.21.15.82:0/1588627772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c80068d30 0x7f7c800691b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f7c853d6640 1 --2- 172.21.15.82:0/1588627772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c80107ad0 0x7f7c80107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f7c853d6640 1 -- 172.21.15.82:0/1588627772 >> 172.21.15.82:0/1588627772 conn(0x7f7c80077b50 msgr2=0x7f7c80077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.169+0000 7f76c6ffd640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c81013d0 0x7f76c81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f7c853d6640 1 -- 172.21.15.82:0/1588627772 shutdown_connections 2024-03-27T07:23:40.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f7c853d6640 1 -- 172.21.15.82:0/1588627772 wait complete. 2024-03-27T07:23:40.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76c77fe640 1 -- 172.21.15.82:0/1539236004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c81013d0 msgr2=0x7f76c81988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76c77fe640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c81013d0 0x7f76c81988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76c77fe640 1 -- 172.21.15.82:0/1539236004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c8106a20 msgr2=0x7f76c819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76c77fe640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c8106a20 0x7f76c819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76c77fe640 1 -- 172.21.15.82:0/1539236004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c819d3a0 con 0x7f76c8100a10 2024-03-27T07:23:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76c7fff640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c8106a20 0x7f76c819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76c77fe640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c8100a10 0x7f76c81983b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f76c000eb90 tx=0x7f76c000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76c4ff9640 1 -- 172.21.15.82:0/1539236004 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0004d20 con 0x7f76c8100a10 2024-03-27T07:23:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76c4ff9640 1 -- 172.21.15.82:0/1539236004 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f76c000ee90 con 0x7f76c8100a10 2024-03-27T07:23:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76ce015640 1 -- 172.21.15.82:0/1539236004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c819d690 con 0x7f76c8100a10 2024-03-27T07:23:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76c4ff9640 1 -- 172.21.15.82:0/1539236004 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c0010830 con 0x7f76c8100a10 2024-03-27T07:23:40.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f76ce015640 1 -- 172.21.15.82:0/1539236004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c81a4f20 con 0x7f76c8100a10 2024-03-27T07:23:40.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f7c853d6640 1 Processor -- start 2024-03-27T07:23:40.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f7c853d6640 1 -- start start 2024-03-27T07:23:40.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f7c853d6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c80068d30 0x7f7c80100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f7c853d6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c800696f0 0x7f7c80100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f7c853d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c80107ad0 0x7f7c80101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f7c853d6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80111eb0 con 0x7f7c80068d30 2024-03-27T07:23:40.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f7c853d6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80111d30 con 0x7f7c80107ad0 2024-03-27T07:23:40.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.170+0000 7f7c853d6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c80112030 con 0x7f7c800696f0 2024-03-27T07:23:40.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c80068d30 0x7f7c80100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c80068d30 0x7f7c80100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49310/0 (socket says 172.21.15.82:49310) 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7effd640 1 -- 172.21.15.82:0/522314884 learned_addr learned my addr 172.21.15.82:0/522314884 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c77fff640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c800696f0 0x7f7c80100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7f7fe640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c80107ad0 0x7f7c80101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7effd640 1 -- 172.21.15.82:0/522314884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c800696f0 msgr2=0x7f7c80100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7effd640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c800696f0 0x7f7c80100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7effd640 1 -- 172.21.15.82:0/522314884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c80107ad0 msgr2=0x7f7c80101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7effd640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c80107ad0 0x7f7c80101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7effd640 1 -- 172.21.15.82:0/522314884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c801a6890 con 0x7f7c80068d30 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7effd640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c80068d30 0x7f7c80100a10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000e9f0 tx=0x7f7c7000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7cff9640 1 -- 172.21.15.82:0/522314884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000cd80 con 0x7f7c80068d30 2024-03-27T07:23:40.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7cff9640 1 -- 172.21.15.82:0/522314884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c70010910 con 0x7f7c80068d30 2024-03-27T07:23:40.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c7cff9640 1 -- 172.21.15.82:0/522314884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70018990 con 0x7f7c80068d30 2024-03-27T07:23:40.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c853d6640 1 -- 172.21.15.82:0/522314884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c801a6b80 con 0x7f7c80068d30 2024-03-27T07:23:40.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f7c853d6640 1 -- 172.21.15.82:0/522314884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c801a7080 con 0x7f7c80068d30 2024-03-27T07:23:40.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.171+0000 7f76ce015640 1 -- 172.21.15.82:0/1539236004 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c804f8b0 con 0x7f76c8100a10 2024-03-27T07:23:40.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.173+0000 7f76c4ff9640 1 -- 172.21.15.82:0/1539236004 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 23) ==== 138546+0+0 (secure 0 0 0) 0x7f76c0005020 con 0x7f76c8100a10 2024-03-27T07:23:40.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.173+0000 7f76c4ff9640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f76b40a38c0 0x7f76b40a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.173+0000 7f76c6ffd640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f76b40a38c0 0x7f76b40a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.173+0000 7f76c4ff9640 1 -- 172.21.15.82:0/1539236004 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f76c00d07f0 con 0x7f76c8100a10 2024-03-27T07:23:40.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.173+0000 7f7c7cff9640 1 -- 172.21.15.82:0/522314884 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 23) ==== 138546+0+0 (secure 0 0 0) 0x7f7c70010ac0 con 0x7f7c80068d30 2024-03-27T07:23:40.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.174+0000 7f76c6ffd640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f76b40a38c0 0x7f76b40a5d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f76b0005ab0 tx=0x7f76b0005fd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.174+0000 7f7c87fb7740 1 Processor -- start 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.174+0000 7f7c87fb7740 1 -- start start 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.174+0000 7f7c7cff9640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7c6c0a3910 0x7f7c6c0a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.174+0000 7f7c7f7fe640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7c6c0a3910 0x7f7c6c0a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.174+0000 7f7c7cff9640 1 -- 172.21.15.82:0/522314884 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f7c700d04e0 con 0x7f7c80068d30 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.174+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.174+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e42a770 0x56232e432e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.174+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e433350 0x56232e435740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56232e334c20 con 0x56232e433350 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56232e38d430 con 0x56232e429e50 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56232e335900 con 0x56232e42a770 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:57784/0 (socket says 172.21.15.82:57784) 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7effd640 1 -- 172.21.15.82:0/1234391850 learned_addr learned my addr 172.21.15.82:0/1234391850 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c77fff640 1 --2- 172.21.15.82:0/1234391850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e42a770 0x56232e432e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7f7fe640 1 --2- 172.21.15.82:0/1234391850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e433350 0x56232e435740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7f7fe640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7c6c0a3910 0x7f7c6c0a5dd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c78005cc0 tx=0x7f7c78032340 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7effd640 1 -- 172.21.15.82:0/1234391850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e42a770 msgr2=0x56232e432e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7effd640 1 --2- 172.21.15.82:0/1234391850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e42a770 0x56232e432e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7effd640 1 -- 172.21.15.82:0/1234391850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e433350 msgr2=0x56232e435740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7effd640 1 --2- 172.21.15.82:0/1234391850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e433350 0x56232e435740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7effd640 1 -- 172.21.15.82:0/1234391850 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56232e388180 con 0x56232e429e50 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c7effd640 1 --2- 172.21.15.82:0/1234391850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42a230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000c6a0 tx=0x7f7c7009c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f12c75db7732d1c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c757fa640 1 -- 172.21.15.82:0/1234391850 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70098c10 con 0x56232e429e50 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c757fa640 1 -- 172.21.15.82:0/1234391850 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c700cde10 con 0x56232e429e50 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.175+0000 7f7c757fa640 1 -- 172.21.15.82:0/1234391850 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70018d90 con 0x56232e429e50 2024-03-27T07:23:40.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.176+0000 7f7c87fb7740 1 -- 172.21.15.82:0/1234391850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 msgr2=0x56232e42a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.176+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/1234391850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42a230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000c6a0 tx=0x7f7c7009c5a0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.176+0000 7f7c87fb7740 1 -- 172.21.15.82:0/1234391850 shutdown_connections 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.176+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/1234391850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e433350 0x56232e435740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.176+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/1234391850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e42a770 0x56232e432e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.176+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/1234391850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42a230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.176+0000 7f7c87fb7740 1 -- 172.21.15.82:0/1234391850 >> 172.21.15.82:0/1234391850 conn(0x56232e424580 msgr2=0x56232e424960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.176+0000 7f7c87fb7740 1 -- 172.21.15.82:0/1234391850 shutdown_connections 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.176+0000 7f7c87fb7740 1 -- 172.21.15.82:0/1234391850 wait complete. 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.176+0000 7f7c87fb7740 1 -- start start 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c87fb7740 1 Processor -- start 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e429e50 0x56232e432ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e42a770 0x56232e430070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e433350 0x56232e4305f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56232e348cc0 con 0x56232e429e50 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56232e3893e0 con 0x56232e42a770 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56232e4360e0 con 0x56232e433350 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c87fb7740 10 client.0 _ll_register_callbacks cb 0x56232e383f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c7effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e429e50 0x56232e432ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c7effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e429e50 0x56232e432ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49332/0 (socket says 172.21.15.82:49332) 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c7effd640 1 -- 172.21.15.82:0/2100496514 learned_addr learned my addr 172.21.15.82:0/2100496514 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c7f7fe640 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e433350 0x56232e4305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c77fff640 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e42a770 0x56232e430070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c7effd640 1 -- 172.21.15.82:0/2100496514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e433350 msgr2=0x56232e4305f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c7effd640 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e433350 0x56232e4305f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c7effd640 1 -- 172.21.15.82:0/2100496514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e42a770 msgr2=0x56232e430070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c7effd640 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e42a770 0x56232e430070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c7effd640 1 -- 172.21.15.82:0/2100496514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56232e34fef0 con 0x56232e429e50 2024-03-27T07:23:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c7effd640 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e429e50 0x56232e432ce0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7c70098f70 tx=0x7f7c700d0380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f7dbc0bd1cafa1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.177+0000 7f7c667fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.178+0000 7f7c667fc640 1 -- 172.21.15.82:0/2100496514 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70018d40 con 0x56232e429e50 2024-03-27T07:23:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.178+0000 7f7c667fc640 1 -- 172.21.15.82:0/2100496514 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f7c7009b9f0 con 0x56232e429e50 2024-03-27T07:23:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.178+0000 7f7c87fb7740 1 -- 172.21.15.82:0/2100496514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c700cde10 con 0x56232e429e50 2024-03-27T07:23:40.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.178+0000 7f76c4ff9640 1 -- 172.21.15.82:0/1539236004 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f76c009cf60 con 0x7f76c8100a10 2024-03-27T07:23:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c667fc640 1 -- 172.21.15.82:0/2100496514 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7c7009bbf0 con 0x56232e429e50 2024-03-27T07:23:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c87fb7740 10 client.15465 fetch_fsmap learned FSMap version 22 2024-03-27T07:23:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c87fb7740 1 -- 172.21.15.82:0/2100496514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56232e1697e0 con 0x56232e429e50 2024-03-27T07:23:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c667fc640 1 -- 172.21.15.82:0/2100496514 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c700cde10 con 0x56232e429e50 2024-03-27T07:23:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c667fc640 1 -- 172.21.15.82:0/2100496514 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f7c70098410 con 0x56232e429e50 2024-03-27T07:23:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c87fb7740 10 client.15465 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:23:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c87fb7740 10 client.15465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:23:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c87fb7740 20 client.15465 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56232e4430a0 0x56232e445490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c87fb7740 4 client.15465 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c87fb7740 1 -- 172.21.15.82:0/2100496514 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56232e39a970 con 0x56232e4430a0 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.179+0000 7f7c77fff640 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56232e4430a0 0x56232e445490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c77fff640 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56232e4430a0 0x56232e445490 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcfb2476a4454508 server_cookie=6b7b6f70bbb67e83 in_seq=0 out_seq=0 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c667fc640 10 client.15465 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c667fc640 1 -- 172.21.15.82:0/2100496514 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56232e39a970 con 0x56232e4430a0 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c667fc640 10 client.15465 handle_command_reply: tid=0 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c87fb7740 1 client.15465 shutdown 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c87fb7740 1 -- 172.21.15.82:0/2100496514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e429e50 msgr2=0x56232e432ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e429e50 0x56232e432ce0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7c70098f70 tx=0x7f7c700d0380 comp rx=0 tx=0).stop 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c87fb7740 1 -- 172.21.15.82:0/2100496514 shutdown_connections 2024-03-27T07:23:40.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e433350 0x56232e4305f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e42a770 0x56232e430070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56232e4430a0 0x56232e445490 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/2100496514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e429e50 0x56232e432ce0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c87fb7740 1 -- 172.21.15.82:0/2100496514 >> 172.21.15.82:0/2100496514 conn(0x56232e424580 msgr2=0x56232e4262d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.180+0000 7f7c667fc640 0 client.15465 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.181+0000 7f7c87fb7740 1 -- 172.21.15.82:0/2100496514 shutdown_connections 2024-03-27T07:23:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.181+0000 7f7c87fb7740 1 -- 172.21.15.82:0/2100496514 wait complete. 2024-03-27T07:23:40.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.181+0000 7f7c87fb7740 20 client.15465 trim_cache size 0 max 16384 2024-03-27T07:23:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c87fb7740 1 Processor -- start 2024-03-27T07:23:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c87fb7740 1 -- start start 2024-03-27T07:23:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e4480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e433350 0x56232e4327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c801b2280 con 0x56232e42a770 2024-03-27T07:23:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c801afb50 con 0x56232e429e50 2024-03-27T07:23:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c801ad9a0 con 0x56232e433350 2024-03-27T07:23:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c77fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e4480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c7effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c77fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e4480d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49340/0 (socket says 172.21.15.82:49340) 2024-03-27T07:23:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c77fff640 1 -- 172.21.15.82:0/4072561634 learned_addr learned my addr 172.21.15.82:0/4072561634 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.198+0000 7f7c7f7fe640 1 --2- 172.21.15.82:0/4072561634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e433350 0x56232e4327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.199+0000 7f7c7effd640 1 -- 172.21.15.82:0/4072561634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e433350 msgr2=0x56232e4327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.199+0000 7f7c7effd640 1 --2- 172.21.15.82:0/4072561634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e433350 0x56232e4327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.199+0000 7f7c7effd640 1 -- 172.21.15.82:0/4072561634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 msgr2=0x56232e4480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.199+0000 7f7c7effd640 1 --2- 172.21.15.82:0/4072561634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e4480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.199+0000 7f7c7effd640 1 -- 172.21.15.82:0/4072561634 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56232e1c9f70 con 0x56232e429e50 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.199+0000 7f7c77fff640 1 --2- 172.21.15.82:0/4072561634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e4480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.199+0000 7f7c7effd640 1 --2- 172.21.15.82:0/4072561634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42ff70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000c880 tx=0x7f7c70098970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f2fb789ceb90a4f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.199+0000 7f7c74ff9640 1 -- 172.21.15.82:0/4072561634 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c700cde10 con 0x56232e429e50 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.199+0000 7f7c74ff9640 1 -- 172.21.15.82:0/4072561634 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c7009b6d0 con 0x56232e429e50 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.199+0000 7f7c74ff9640 1 -- 172.21.15.82:0/4072561634 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c70085ae0 con 0x56232e429e50 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 -- 172.21.15.82:0/4072561634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 msgr2=0x56232e42ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/4072561634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42ff70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000c880 tx=0x7f7c70098970 comp rx=0 tx=0).stop 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 -- 172.21.15.82:0/4072561634 shutdown_connections 2024-03-27T07:23:40.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/4072561634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e4480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/4072561634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e433350 0x56232e4327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/4072561634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e429e50 0x56232e42ff70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 -- 172.21.15.82:0/4072561634 >> 172.21.15.82:0/4072561634 conn(0x56232e424580 msgr2=0x56232e423590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 -- 172.21.15.82:0/4072561634 shutdown_connections 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 -- 172.21.15.82:0/4072561634 wait complete. 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 -- start start 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 Processor -- start 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e429e50 0x56232e445990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.200+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e445ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c87fb7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e433350 0x56232e446410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c801ae010 con 0x56232e42a770 2024-03-27T07:23:40.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7c801af480 con 0x56232e433350 2024-03-27T07:23:40.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c87fb7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7c801ae6e0 con 0x56232e429e50 2024-03-27T07:23:40.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c87fb7740 10 client.0 _ll_register_callbacks cb 0x7f7c700a0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:40.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c77fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e445ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c7f7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e433350 0x56232e446410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c77fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e445ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49348/0 (socket says 172.21.15.82:49348) 2024-03-27T07:23:40.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c77fff640 1 -- 172.21.15.82:0/270526705 learned_addr learned my addr 172.21.15.82:0/270526705 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c7effd640 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e429e50 0x56232e445990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c77fff640 1 -- 172.21.15.82:0/270526705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e429e50 msgr2=0x56232e445990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c77fff640 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e429e50 0x56232e445990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c77fff640 1 -- 172.21.15.82:0/270526705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e433350 msgr2=0x56232e446410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c77fff640 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e433350 0x56232e446410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c77fff640 1 -- 172.21.15.82:0/270526705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56232e061170 con 0x56232e42a770 2024-03-27T07:23:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c7f7fe640 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e433350 0x56232e446410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c7effd640 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e429e50 0x56232e445990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c77fff640 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e445ed0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7c68004700 tx=0x7f7c6801f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25b226a10f6e45e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c667fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c667fc640 1 -- 172.21.15.82:0/270526705 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68004250 con 0x56232e42a770 2024-03-27T07:23:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c667fc640 1 -- 172.21.15.82:0/270526705 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f7c680043f0 con 0x56232e42a770 2024-03-27T07:23:40.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.201+0000 7f7c87fb7740 1 -- 172.21.15.82:0/270526705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c7009b6d0 con 0x56232e42a770 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c667fc640 1 -- 172.21.15.82:0/270526705 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7c6802f050 con 0x56232e42a770 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c87fb7740 10 client.15471 fetch_fsmap learned FSMap version 22 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c87fb7740 1 -- 172.21.15.82:0/270526705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56232e3584e0 con 0x56232e42a770 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c667fc640 1 -- 172.21.15.82:0/270526705 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c7009b6d0 con 0x56232e42a770 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c667fc640 1 -- 172.21.15.82:0/270526705 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f7c68027680 con 0x56232e42a770 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c87fb7740 10 client.15471 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c87fb7740 10 client.15471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c87fb7740 20 client.15471 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56232e4a97a0 0x56232e4abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c87fb7740 4 client.15471 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T07:23:40.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c87fb7740 1 -- 172.21.15.82:0/270526705 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56232e394cc0 con 0x56232e4a97a0 2024-03-27T07:23:40.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.202+0000 7f7c7effd640 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56232e4a97a0 0x56232e4abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.203+0000 7f7c667fc640 10 client.15471 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:40.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.203+0000 7f7c7effd640 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56232e4a97a0 0x56232e4abbc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b33442238af60dc5 server_cookie=66ee8bac526f158b in_seq=0 out_seq=0 2024-03-27T07:23:40.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c667fc640 1 -- 172.21.15.82:0/270526705 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56232e394cc0 con 0x56232e4a97a0 2024-03-27T07:23:40.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c667fc640 10 client.15471 handle_command_reply: tid=0 2024-03-27T07:23:40.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 client.15471 shutdown 2024-03-27T07:23:40.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 -- 172.21.15.82:0/270526705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 msgr2=0x56232e445ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e445ed0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7c68004700 tx=0x7f7c6801f830 comp rx=0 tx=0).stop 2024-03-27T07:23:40.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 -- 172.21.15.82:0/270526705 shutdown_connections 2024-03-27T07:23:40.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56232e4a97a0 0x56232e4abbc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c667fc640 0 client.15471 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:40.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56232e42a770 0x56232e445ed0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56232e433350 0x56232e446410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 --2- 172.21.15.82:0/270526705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56232e429e50 0x56232e445990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 -- 172.21.15.82:0/270526705 >> 172.21.15.82:0/270526705 conn(0x56232e424580 msgr2=0x56232e43e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 -- 172.21.15.82:0/270526705 shutdown_connections 2024-03-27T07:23:40.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 1 -- 172.21.15.82:0/270526705 wait complete. 2024-03-27T07:23:40.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.204+0000 7f7c87fb7740 20 client.15471 trim_cache size 0 max 16384 2024-03-27T07:23:40.218 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:23:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-03-27T07:23:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "a84e26ac-f73a-4ece-bfd3-0d0a44bec885", 2024-03-27T07:23:40.218 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-03-27T07:23:40.218 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:23:40.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 -- 172.21.15.82:0/522314884 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7c6c0a3910 msgr2=0x7f7c6c0a5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7c6c0a3910 0x7f7c6c0a5dd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c78005cc0 tx=0x7f7c78032340 comp rx=0 tx=0).stop 2024-03-27T07:23:40.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 -- 172.21.15.82:0/522314884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c80068d30 msgr2=0x7f7c80100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c80068d30 0x7f7c80100a10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000e9f0 tx=0x7f7c7000eeb0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 -- 172.21.15.82:0/522314884 shutdown_connections 2024-03-27T07:23:40.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7c6c0a3910 0x7f7c6c0a5dd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7c80107ad0 0x7f7c80101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c800696f0 0x7f7c80100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 --2- 172.21.15.82:0/522314884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c80068d30 0x7f7c80100a10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 -- 172.21.15.82:0/522314884 >> 172.21.15.82:0/522314884 conn(0x7f7c80077b50 msgr2=0x7f7c800fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 -- 172.21.15.82:0/522314884 shutdown_connections 2024-03-27T07:23:40.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.205+0000 7f7c853d6640 1 -- 172.21.15.82:0/522314884 wait complete. 2024-03-27T07:23:40.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:23:40.221 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:23:40.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: Updating smithi149:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:23:40.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: Updating smithi082:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: Updating smithi153:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/570436290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: Updating smithi149:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/170167124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: Updating smithi082:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: Updating smithi153:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2613439141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:40.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:23:40.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:23:40.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:23:40.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:39 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: Updating smithi149:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:23:40.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: Updating smithi082:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:23:40.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: Updating smithi153:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/570436290' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: Updating smithi149:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: Updating smithi149:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/170167124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: Updating smithi082:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: Updating smithi153:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2613439141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:23:40.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:23:40.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:23:40.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:23:40.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:39 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:23:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.325+0000 7fa4b178a640 1 -- 172.21.15.82:0/1107096608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac101070 msgr2=0x7fa4ac1067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.325+0000 7fa4b178a640 1 --2- 172.21.15.82:0/1107096608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac101070 0x7fa4ac1067a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa494009860 tx=0x7fa49402bb70 comp rx=0 tx=0).stop 2024-03-27T07:23:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.325+0000 7fa4b178a640 1 -- 172.21.15.82:0/1107096608 shutdown_connections 2024-03-27T07:23:40.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.325+0000 7fa4b178a640 1 --2- 172.21.15.82:0/1107096608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4ac106e80 0x7fa4ac10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.325+0000 7fa4b178a640 1 --2- 172.21.15.82:0/1107096608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac101070 0x7fa4ac1067a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.325+0000 7fa4b178a640 1 --2- 172.21.15.82:0/1107096608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ac1006c0 0x7fa4ac100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.325+0000 7fa4b178a640 1 -- 172.21.15.82:0/1107096608 >> 172.21.15.82:0/1107096608 conn(0x7fa4ac075cb0 msgr2=0x7fa4ac0760c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.325+0000 7fa4b178a640 1 -- 172.21.15.82:0/1107096608 shutdown_connections 2024-03-27T07:23:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.325+0000 7fa4b178a640 1 -- 172.21.15.82:0/1107096608 wait complete. 2024-03-27T07:23:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4b178a640 1 Processor -- start 2024-03-27T07:23:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4b178a640 1 -- start start 2024-03-27T07:23:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4b178a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ac1006c0 0x7fa4ac101630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4b178a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4ac106e80 0x7fa4ac101b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4b178a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac1020b0 0x7fa4ac1a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4b178a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac111f70 con 0x7fa4ac106e80 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4b178a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac111df0 con 0x7fa4ac1020b0 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4b178a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac1120f0 con 0x7fa4ac1006c0 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4a3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4ac106e80 0x7fa4ac101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4a3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4ac106e80 0x7fa4ac101b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49362/0 (socket says 172.21.15.82:49362) 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4a3fff640 1 -- 172.21.15.82:0/1310810903 learned_addr learned my addr 172.21.15.82:0/1310810903 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4ab7fe640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac1020b0 0x7fa4ac1a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ac1006c0 0x7fa4ac101630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4a3fff640 1 -- 172.21.15.82:0/1310810903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ac1006c0 msgr2=0x7fa4ac101630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ac1006c0 0x7fa4ac101630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4a3fff640 1 -- 172.21.15.82:0/1310810903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac1020b0 msgr2=0x7fa4ac1a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac1020b0 0x7fa4ac1a66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.326+0000 7fa4a3fff640 1 -- 172.21.15.82:0/1310810903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ac1a6da0 con 0x7fa4ac106e80 2024-03-27T07:23:40.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.327+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4ac106e80 0x7fa4ac101b70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa494037040 tx=0x7fa494004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.327+0000 7fa4a8ff9640 1 -- 172.21.15.82:0/1310810903 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494041020 con 0x7fa4ac106e80 2024-03-27T07:23:40.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.327+0000 7fa4b178a640 1 -- 172.21.15.82:0/1310810903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4ac1a7030 con 0x7fa4ac106e80 2024-03-27T07:23:40.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.327+0000 7fa4a8ff9640 1 -- 172.21.15.82:0/1310810903 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa49402c9f0 con 0x7fa4ac106e80 2024-03-27T07:23:40.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.327+0000 7fa4a8ff9640 1 -- 172.21.15.82:0/1310810903 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa494039040 con 0x7fa4ac106e80 2024-03-27T07:23:40.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.327+0000 7fa4b178a640 1 -- 172.21.15.82:0/1310810903 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4ac1a7520 con 0x7fa4ac106e80 2024-03-27T07:23:40.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.329+0000 7fa4b4371740 1 Processor -- start 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.329+0000 7fa4b4371740 1 -- start start 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.329+0000 7fa4a8ff9640 1 -- 172.21.15.82:0/1310810903 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 23) ==== 138546+0+0 (secure 0 0 0) 0x7fa494044020 con 0x7fa4ac106e80 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d21377630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21380210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d21382b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4b4371740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556d212db860 con 0x556d21377b70 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4b4371740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556d212838d0 con 0x556d21380750 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4b4371740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556d212d7810 con 0x556d21377250 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21380210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21380210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49372/0 (socket says 172.21.15.82:49372) 2024-03-27T07:23:40.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4aaffd640 1 -- 172.21.15.82:0/601957300 learned_addr learned my addr 172.21.15.82:0/601957300 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4ab7fe640 1 --2- 172.21.15.82:0/601957300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d21377630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/601957300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d21382b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4a8ff9640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa4980a3840 0x7fa4980a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4aaffd640 1 -- 172.21.15.82:0/601957300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 msgr2=0x556d21377630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/601957300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d21377630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4aaffd640 1 -- 172.21.15.82:0/601957300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 msgr2=0x556d21382b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/601957300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d21382b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4aaffd640 1 -- 172.21.15.82:0/601957300 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d2128e120 con 0x556d21377b70 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/601957300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d21382b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4ab7fe640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa4980a3840 0x7fa4980a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4a8ff9640 1 -- 172.21.15.82:0/1310810903 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa4940f1940 con 0x7fa4ac106e80 2024-03-27T07:23:40.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/601957300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21380210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009d20 tx=0x7fa49c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e086fae8f96d3926 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.330+0000 7fa4a17fa640 1 -- 172.21.15.82:0/601957300 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c01e070 con 0x556d21377b70 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4a17fa640 1 -- 172.21.15.82:0/601957300 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa49c019b10 con 0x556d21377b70 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4a17fa640 1 -- 172.21.15.82:0/601957300 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c00eb60 con 0x556d21377b70 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4b4371740 1 -- 172.21.15.82:0/601957300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 msgr2=0x556d21380210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4b4371740 1 --2- 172.21.15.82:0/601957300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21380210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009d20 tx=0x7fa49c011810 comp rx=0 tx=0).stop 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4ab7fe640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa4980a3840 0x7fa4980a5d00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4005c40 tx=0x7fa4a4004a40 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4b4371740 1 -- 172.21.15.82:0/601957300 shutdown_connections 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4b4371740 1 --2- 172.21.15.82:0/601957300 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21380210 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4b4371740 1 --2- 172.21.15.82:0/601957300 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d21382b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4b4371740 1 --2- 172.21.15.82:0/601957300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d21377630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4b4371740 1 -- 172.21.15.82:0/601957300 >> 172.21.15.82:0/601957300 conn(0x556d21371980 msgr2=0x556d21371d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4b4371740 1 -- 172.21.15.82:0/601957300 shutdown_connections 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.331+0000 7fa4b4371740 1 -- 172.21.15.82:0/601957300 wait complete. 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4b4371740 1 -- start start 2024-03-27T07:23:40.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4b4371740 1 Processor -- start 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d2137d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d2137dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d2137e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4b4371740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556d21383540 con 0x556d21377b70 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4b4371740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556d21296cd0 con 0x556d21380750 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4b4371740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556d213836c0 con 0x556d21377250 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4b4371740 10 client.0 _ll_register_callbacks cb 0x556d21288ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4a3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d2137dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4aaffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d2137d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4a3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d2137dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49376/0 (socket says 172.21.15.82:49376) 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4aaffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d2137d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:49876/0 (socket says 172.21.15.82:49876) 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4a3fff640 1 -- 172.21.15.82:0/4124854836 learned_addr learned my addr 172.21.15.82:0/4124854836 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4ab7fe640 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d2137e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4a3fff640 1 -- 172.21.15.82:0/4124854836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 msgr2=0x556d2137d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d2137d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4a3fff640 1 -- 172.21.15.82:0/4124854836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 msgr2=0x556d2137e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d2137e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4a3fff640 1 -- 172.21.15.82:0/4124854836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d210b97d0 con 0x556d21377b70 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.332+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d2137d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d2137dd00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa4940ef1c0 tx=0x7fa49402bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c650951e8fddf4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4927fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4927fc640 1 -- 172.21.15.82:0/4124854836 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940bd890 con 0x556d21377b70 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4927fc640 1 -- 172.21.15.82:0/4124854836 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa4940ba130 con 0x556d21377b70 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4b4371740 1 -- 172.21.15.82:0/4124854836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa49c019b10 con 0x556d21377b70 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4927fc640 1 -- 172.21.15.82:0/4124854836 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa494032ce0 con 0x556d21377b70 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4b4371740 10 client.15483 fetch_fsmap learned FSMap version 22 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4b4371740 1 -- 172.21.15.82:0/4124854836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x556d20fef3f0 con 0x556d21377b70 2024-03-27T07:23:40.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4927fc640 1 -- 172.21.15.82:0/4124854836 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa49c019b10 con 0x556d21377b70 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4927fc640 1 -- 172.21.15.82:0/4124854836 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa49403c030 con 0x556d21377b70 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4b4371740 10 client.15483 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4b4371740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4b4371740 20 client.15483 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556d21390aa0 0x556d21392f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4b4371740 4 client.15483 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4b4371740 1 -- 172.21.15.82:0/4124854836 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d212e8da0 con 0x556d21390aa0 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.333+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556d21390aa0 0x556d21392f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.334+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556d21390aa0 0x556d21392f40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4811c9be6f621d17 server_cookie=dd91c1b1a2438738 in_seq=0 out_seq=0 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.334+0000 7fa4927fc640 10 client.15483 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.334+0000 7fa4927fc640 1 -- 172.21.15.82:0/4124854836 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556d212e8da0 con 0x556d21390aa0 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.334+0000 7fa4927fc640 10 client.15483 handle_command_reply: tid=0 2024-03-27T07:23:40.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.334+0000 7fa4b4371740 1 client.15483 shutdown 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 1 -- 172.21.15.82:0/4124854836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 msgr2=0x556d2137dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d2137dd00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa4940ef1c0 tx=0x7fa49402bb70 comp rx=0 tx=0).stop 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 1 -- 172.21.15.82:0/4124854836 shutdown_connections 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556d21390aa0 0x556d21392f40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d2137dd00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4927fc640 0 client.15483 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d2137e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4124854836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d2137d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 1 -- 172.21.15.82:0/4124854836 >> 172.21.15.82:0/4124854836 conn(0x556d21371980 msgr2=0x556d213736d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 1 -- 172.21.15.82:0/4124854836 shutdown_connections 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 1 -- 172.21.15.82:0/4124854836 wait complete. 2024-03-27T07:23:40.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.335+0000 7fa4b4371740 20 client.15483 trim_cache size 0 max 16384 2024-03-27T07:23:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4b4371740 1 Processor -- start 2024-03-27T07:23:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4b4371740 1 -- start start 2024-03-27T07:23:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377250 0x556d2137fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21377b70 0x556d2138c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21380750 0x556d21398850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4b4371740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac1b2210 con 0x556d21377250 2024-03-27T07:23:40.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4b4371740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac1afae0 con 0x556d21377b70 2024-03-27T07:23:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4b4371740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac1ad950 con 0x556d21380750 2024-03-27T07:23:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377250 0x556d2137fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4aaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377250 0x556d2137fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49392/0 (socket says 172.21.15.82:49392) 2024-03-27T07:23:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4aaffd640 1 -- 172.21.15.82:0/2810496654 learned_addr learned my addr 172.21.15.82:0/2810496654 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/2810496654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21377b70 0x556d2138c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.352+0000 7fa4ab7fe640 1 --2- 172.21.15.82:0/2810496654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21380750 0x556d21398850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.353+0000 7fa4aaffd640 1 -- 172.21.15.82:0/2810496654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21380750 msgr2=0x556d21398850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.353+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/2810496654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21380750 0x556d21398850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.353+0000 7fa4aaffd640 1 -- 172.21.15.82:0/2810496654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21377b70 msgr2=0x556d2138c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.353+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/2810496654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21377b70 0x556d2138c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.353+0000 7fa4aaffd640 1 -- 172.21.15.82:0/2810496654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d20faf0f0 con 0x556d21377250 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.353+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/2810496654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21377b70 0x556d2138c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.353+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/2810496654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377250 0x556d2137fef0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009d20 tx=0x7fa49c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6dd5a7aa14b9fac server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.353+0000 7fa4a0ff9640 1 -- 172.21.15.82:0/2810496654 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c01e040 con 0x556d21377250 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.353+0000 7fa4a0ff9640 1 -- 172.21.15.82:0/2810496654 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa49c01f040 con 0x556d21377250 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.353+0000 7fa4a0ff9640 1 -- 172.21.15.82:0/2810496654 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49c00ed60 con 0x556d21377250 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 -- 172.21.15.82:0/2810496654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377250 msgr2=0x556d2137fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 --2- 172.21.15.82:0/2810496654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377250 0x556d2137fef0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009d20 tx=0x7fa49c005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 -- 172.21.15.82:0/2810496654 shutdown_connections 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 --2- 172.21.15.82:0/2810496654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21380750 0x556d21398850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 --2- 172.21.15.82:0/2810496654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21377b70 0x556d2138c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 --2- 172.21.15.82:0/2810496654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377250 0x556d2137fef0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 -- 172.21.15.82:0/2810496654 >> 172.21.15.82:0/2810496654 conn(0x556d21371980 msgr2=0x556d2137c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 -- 172.21.15.82:0/2810496654 shutdown_connections 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 -- 172.21.15.82:0/2810496654 wait complete. 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 -- start start 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 Processor -- start 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d21383ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21384000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d213eee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac1adfa0 con 0x556d21377b70 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac1af410 con 0x556d21380750 2024-03-27T07:23:40.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.354+0000 7fa4b4371740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa4ac1ae670 con 0x556d21377250 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4b4371740 10 client.0 _ll_register_callbacks cb 0x7fa494032640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4a3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21384000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4a3fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21384000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49394/0 (socket says 172.21.15.82:49394) 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4a3fff640 1 -- 172.21.15.82:0/4271519446 learned_addr learned my addr 172.21.15.82:0/4271519446 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d21383ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4ab7fe640 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d213eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4a3fff640 1 -- 172.21.15.82:0/4271519446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 msgr2=0x556d21383ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d21383ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4a3fff640 1 -- 172.21.15.82:0/4271519446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 msgr2=0x556d213eee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d213eee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4a3fff640 1 -- 172.21.15.82:0/4271519446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d213ef480 con 0x556d21377b70 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4ab7fe640 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d213eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4a3fff640 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21384000 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa4940b9f20 tx=0x7fa494005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec2aadf01b7efda server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4927fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4927fc640 1 -- 172.21.15.82:0/4271519446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4940bd420 con 0x556d21377b70 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4927fc640 1 -- 172.21.15.82:0/4271519446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa4940c62a0 con 0x556d21377b70 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4b4371740 1 -- 172.21.15.82:0/4271519446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa49c01f040 con 0x556d21377b70 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4927fc640 1 -- 172.21.15.82:0/4271519446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa4940bd600 con 0x556d21377b70 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4b4371740 10 client.15489 fetch_fsmap learned FSMap version 22 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4b4371740 1 -- 172.21.15.82:0/4271519446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x556d213ef480 con 0x556d21377b70 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.355+0000 7fa4927fc640 1 -- 172.21.15.82:0/4271519446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa49c01f040 con 0x556d21377b70 2024-03-27T07:23:40.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4927fc640 1 -- 172.21.15.82:0/4271519446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa4940bcf10 con 0x556d21377b70 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4b4371740 10 client.15489 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4b4371740 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4b4371740 20 client.15489 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556d213f6c20 0x556d213f9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4b4371740 4 client.15489 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4b4371740 1 -- 172.21.15.82:0/4271519446 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556d212e30f0 con 0x556d213f6c20 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556d213f6c20 0x556d213f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4927fc640 10 client.15489 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4aaffd640 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556d213f6c20 0x556d213f9040 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8ffa2894a142333 server_cookie=7ff06afc023fedf8 in_seq=0 out_seq=0 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4927fc640 1 -- 172.21.15.82:0/4271519446 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556d212e30f0 con 0x556d213f6c20 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4927fc640 10 client.15489 handle_command_reply: tid=0 2024-03-27T07:23:40.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.356+0000 7fa4b4371740 1 client.15489 shutdown 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 1 -- 172.21.15.82:0/4271519446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 msgr2=0x556d21384000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21384000 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa4940b9f20 tx=0x7fa494005ab0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 1 -- 172.21.15.82:0/4271519446 shutdown_connections 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556d213f6c20 0x556d213f9040 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556d21377b70 0x556d21384000 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556d21380750 0x556d213eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4927fc640 0 client.15489 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 1 --2- 172.21.15.82:0/4271519446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d21377250 0x556d21383ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 1 -- 172.21.15.82:0/4271519446 >> 172.21.15.82:0/4271519446 conn(0x556d21371980 msgr2=0x556d2137c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 1 -- 172.21.15.82:0/4271519446 shutdown_connections 2024-03-27T07:23:40.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 1 -- 172.21.15.82:0/4271519446 wait complete. 2024-03-27T07:23:40.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b4371740 20 client.15489 trim_cache size 0 max 16384 2024-03-27T07:23:40.369 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:23:40.369 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-27T07:23:40.369 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-03-27T07:23:40.369 INFO:teuthology.orchestra.run.smithi082.stdout: "a84e26ac-f73a-4ece-bfd3-0d0a44bec885": { 2024-03-27T07:23:40.369 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-03-27T07:23:40.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "a84e26ac-f73a-4ece-bfd3-0d0a44bec885", 2024-03-27T07:23:40.370 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-03-27T07:23:40.370 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:23:40.370 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:23:40.370 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:23:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 -- 172.21.15.82:0/1310810903 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa4980a3840 msgr2=0x7fa4980a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa4980a3840 0x7fa4980a5d00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4005c40 tx=0x7fa4a4004a40 comp rx=0 tx=0).stop 2024-03-27T07:23:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 -- 172.21.15.82:0/1310810903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4ac106e80 msgr2=0x7fa4ac101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4ac106e80 0x7fa4ac101b70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa494037040 tx=0x7fa494004550 comp rx=0 tx=0).stop 2024-03-27T07:23:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 -- 172.21.15.82:0/1310810903 shutdown_connections 2024-03-27T07:23:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa4980a3840 0x7fa4980a5d00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa4ac106e80 0x7fa4ac101b70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa4ac1020b0 0x7fa4ac1a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 --2- 172.21.15.82:0/1310810903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4ac1006c0 0x7fa4ac101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 -- 172.21.15.82:0/1310810903 >> 172.21.15.82:0/1310810903 conn(0x7fa4ac075cb0 msgr2=0x7fa4ac0fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 -- 172.21.15.82:0/1310810903 shutdown_connections 2024-03-27T07:23:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.357+0000 7fa4b178a640 1 -- 172.21.15.82:0/1310810903 wait complete. 2024-03-27T07:23:40.373 INFO:tasks.cephfs.filesystem:scrub status for tag:a84e26ac-f73a-4ece-bfd3-0d0a44bec885 - {'path': '/', 'tag': 'a84e26ac-f73a-4ece-bfd3-0d0a44bec885', 'options': 'recursive,force'} 2024-03-27T07:23:40.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.391+0000 7f76ce015640 1 -- 172.21.15.82:0/1539236004 --> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f76c8061f90 con 0x7f76b40a38c0 2024-03-27T07:23:40.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.452+0000 7f76c4ff9640 1 -- 172.21.15.82:0/1539236004 <== mgr.15273 v2:172.21.15.82:6800/573513718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f76c8061f90 con 0x7f76b40a38c0 2024-03-27T07:23:40.454 INFO:teuthology.orchestra.run.smithi082.stdout:Schedule set for path / 2024-03-27T07:23:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 -- 172.21.15.82:0/1539236004 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f76b40a38c0 msgr2=0x7f76b40a5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f76b40a38c0 0x7f76b40a5d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f76b0005ab0 tx=0x7f76b0005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 -- 172.21.15.82:0/1539236004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c8100a10 msgr2=0x7f76c81983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c8100a10 0x7f76c81983b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f76c000eb90 tx=0x7f76c000c6a0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 -- 172.21.15.82:0/1539236004 shutdown_connections 2024-03-27T07:23:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f76b40a38c0 0x7f76b40a5d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f76c8106a20 0x7f76c819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c81013d0 0x7f76c81988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 --2- 172.21.15.82:0/1539236004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76c8100a10 0x7f76c81983b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 -- 172.21.15.82:0/1539236004 >> 172.21.15.82:0/1539236004 conn(0x7f76c8077b70 msgr2=0x7f76c81035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 -- 172.21.15.82:0/1539236004 shutdown_connections 2024-03-27T07:23:40.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.454+0000 7f76ce015640 1 -- 172.21.15.82:0/1539236004 wait complete. 2024-03-27T07:23:40.467 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-03-27T07:23:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.610+0000 7f2592377640 1 -- 172.21.15.82:0/830613613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258c100d30 msgr2=0x7f258c101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.610+0000 7f2592377640 1 --2- 172.21.15.82:0/830613613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258c100d30 0x7f258c101190 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2580009900 tx=0x7f258002bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.610+0000 7f2592377640 1 -- 172.21.15.82:0/830613613 shutdown_connections 2024-03-27T07:23:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.610+0000 7f2592377640 1 --2- 172.21.15.82:0/830613613 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258c100d30 0x7f258c101190 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.610+0000 7f2592377640 1 --2- 172.21.15.82:0/830613613 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f258c1016d0 0x7f258c10d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.610+0000 7f2592377640 1 --2- 172.21.15.82:0/830613613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f258c106a90 0x7f258c106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.610+0000 7f2592377640 1 -- 172.21.15.82:0/830613613 >> 172.21.15.82:0/830613613 conn(0x7f258c077770 msgr2=0x7f258c077b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.610+0000 7f2592377640 1 -- 172.21.15.82:0/830613613 shutdown_connections 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.610+0000 7f2592377640 1 -- 172.21.15.82:0/830613613 wait complete. 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f2592377640 1 Processor -- start 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f2592377640 1 -- start start 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f2592377640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f258c100d30 0x7f258c199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f2592377640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258c1016d0 0x7f258c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f2592377640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f258c106a90 0x7f258c1a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f2592377640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f258c110e00 con 0x7f258c1016d0 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f2592377640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f258c110c80 con 0x7f258c106a90 2024-03-27T07:23:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f2592377640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f258c110f80 con 0x7f258c100d30 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f258b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258c1016d0 0x7f258c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f258b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258c1016d0 0x7f258c199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49406/0 (socket says 172.21.15.82:49406) 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f258b7fe640 1 -- 172.21.15.82:0/1916455281 learned_addr learned my addr 172.21.15.82:0/1916455281 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f258bfff640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f258c100d30 0x7f258c199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.611+0000 7f2590914640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f258c106a90 0x7f258c1a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f258b7fe640 1 -- 172.21.15.82:0/1916455281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f258c100d30 msgr2=0x7f258c199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f258b7fe640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f258c100d30 0x7f258c199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f258b7fe640 1 -- 172.21.15.82:0/1916455281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f258c106a90 msgr2=0x7f258c1a41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f258b7fe640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f258c106a90 0x7f258c1a41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f258b7fe640 1 -- 172.21.15.82:0/1916455281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c1a46e0 con 0x7f258c1016d0 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f258b7fe640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258c1016d0 0x7f258c199660 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2580006010 tx=0x7f258002cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f25897fa640 1 -- 172.21.15.82:0/1916455281 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580041070 con 0x7f258c1016d0 2024-03-27T07:23:40.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f25897fa640 1 -- 172.21.15.82:0/1916455281 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2580004450 con 0x7f258c1016d0 2024-03-27T07:23:40.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f2592377640 1 -- 172.21.15.82:0/1916455281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c1a48b0 con 0x7f258c1016d0 2024-03-27T07:23:40.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f25897fa640 1 -- 172.21.15.82:0/1916455281 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580003e00 con 0x7f258c1016d0 2024-03-27T07:23:40.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.612+0000 7f2592377640 1 -- 172.21.15.82:0/1916455281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c1a4d70 con 0x7f258c1016d0 2024-03-27T07:23:40.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.613+0000 7f2592377640 1 -- 172.21.15.82:0/1916455281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c102130 con 0x7f258c1016d0 2024-03-27T07:23:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.614+0000 7f25897fa640 1 -- 172.21.15.82:0/1916455281 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 23) ==== 138546+0+0 (secure 0 0 0) 0x7f2580044070 con 0x7f258c1016d0 2024-03-27T07:23:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.614+0000 7f25897fa640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f25740a3940 0x7f25740a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.614+0000 7f258bfff640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f25740a3940 0x7f25740a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.615+0000 7f25897fa640 1 -- 172.21.15.82:0/1916455281 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f25800f1b60 con 0x7f258c1016d0 2024-03-27T07:23:40.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.615+0000 7f258bfff640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f25740a3940 0x7f25740a5e00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f257c009b50 tx=0x7f257c005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.619+0000 7f25897fa640 1 -- 172.21.15.82:0/1916455281 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f25800bdd90 con 0x7f258c1016d0 2024-03-27T07:23:40.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.821+0000 7f2592377640 1 -- 172.21.15.82:0/1916455281 --> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f258c061f90 con 0x7f25740a3940 2024-03-27T07:23:40.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.875+0000 7f25897fa640 1 -- 172.21.15.82:0/1916455281 <== mgr.15273 v2:172.21.15.82:6800/573513718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f258c061f90 con 0x7f25740a3940 2024-03-27T07:23:40.877 INFO:teuthology.orchestra.run.smithi082.stdout:Retention added to path / 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.877+0000 7f2592377640 1 -- 172.21.15.82:0/1916455281 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f25740a3940 msgr2=0x7f25740a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.877+0000 7f2592377640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f25740a3940 0x7f25740a5e00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f257c009b50 tx=0x7f257c005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.877+0000 7f2592377640 1 -- 172.21.15.82:0/1916455281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258c1016d0 msgr2=0x7f258c199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.877+0000 7f2592377640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258c1016d0 0x7f258c199660 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2580006010 tx=0x7f258002cb30 comp rx=0 tx=0).stop 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.878+0000 7f2592377640 1 -- 172.21.15.82:0/1916455281 shutdown_connections 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.878+0000 7f2592377640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f25740a3940 0x7f25740a5e00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.878+0000 7f2592377640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258c1016d0 0x7f258c199660 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.878+0000 7f2592377640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f258c106a90 0x7f258c1a41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.878+0000 7f2592377640 1 --2- 172.21.15.82:0/1916455281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f258c100d30 0x7f258c199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.878+0000 7f2592377640 1 -- 172.21.15.82:0/1916455281 >> 172.21.15.82:0/1916455281 conn(0x7f258c077770 msgr2=0x7f258c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.878+0000 7f2592377640 1 -- 172.21.15.82:0/1916455281 shutdown_connections 2024-03-27T07:23:40.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.878+0000 7f2592377640 1 -- 172.21.15.82:0/1916455281 wait complete. 2024-03-27T07:23:40.890 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 -- 172.21.15.82:0/1686999044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc5c1024c0 msgr2=0x7efc5c10e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 --2- 172.21.15.82:0/1686999044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc5c1024c0 0x7efc5c10e9d0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7efc54009cd0 tx=0x7efc5402c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 -- 172.21.15.82:0/1686999044 shutdown_connections 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 --2- 172.21.15.82:0/1686999044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc5c1024c0 0x7efc5c10e9d0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 --2- 172.21.15.82:0/1686999044 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c101b00 0x7efc5c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 --2- 172.21.15.82:0/1686999044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc5c107ba0 0x7efc5c107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 -- 172.21.15.82:0/1686999044 >> 172.21.15.82:0/1686999044 conn(0x7efc5c0fd610 msgr2=0x7efc5c0ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 -- 172.21.15.82:0/1686999044 shutdown_connections 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 -- 172.21.15.82:0/1686999044 wait complete. 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 Processor -- start 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.997+0000 7efc63e55640 1 -- start start 2024-03-27T07:23:41.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc63e55640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc5c101b00 0x7efc5c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc63e55640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c1024c0 0x7efc5c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc63e55640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc5c107ba0 0x7efc5c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc63e55640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c111f20 con 0x7efc5c107ba0 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc63e55640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c111da0 con 0x7efc5c1024c0 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc63e55640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c1120a0 con 0x7efc5c101b00 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc623f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc5c107ba0 0x7efc5c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc623f2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc5c107ba0 0x7efc5c19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49428/0 (socket says 172.21.15.82:49428) 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc623f2640 1 -- 172.21.15.82:0/3544853626 learned_addr learned my addr 172.21.15.82:0/3544853626 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc61bf1640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc5c101b00 0x7efc5c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc613f0640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c1024c0 0x7efc5c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc623f2640 1 -- 172.21.15.82:0/3544853626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc5c101b00 msgr2=0x7efc5c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc623f2640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc5c101b00 0x7efc5c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc623f2640 1 -- 172.21.15.82:0/3544853626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c1024c0 msgr2=0x7efc5c198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:41.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc623f2640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c1024c0 0x7efc5c198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc623f2640 1 -- 172.21.15.82:0/3544853626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5c19d330 con 0x7efc5c107ba0 2024-03-27T07:23:41.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc623f2640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc5c107ba0 0x7efc5c19cc00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efc540348f0 tx=0x7efc54032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:41.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc52ffd640 1 -- 172.21.15.82:0/3544853626 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54041020 con 0x7efc5c107ba0 2024-03-27T07:23:41.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc52ffd640 1 -- 172.21.15.82:0/3544853626 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efc54032e80 con 0x7efc5c107ba0 2024-03-27T07:23:41.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc63e55640 1 -- 172.21.15.82:0/3544853626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5c19d5c0 con 0x7efc5c107ba0 2024-03-27T07:23:41.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc52ffd640 1 -- 172.21.15.82:0/3544853626 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54039040 con 0x7efc5c107ba0 2024-03-27T07:23:41.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.998+0000 7efc63e55640 1 -- 172.21.15.82:0/3544853626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5c1a4eb0 con 0x7efc5c107ba0 2024-03-27T07:23:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:40.999+0000 7efc63e55640 1 -- 172.21.15.82:0/3544853626 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5c04f8b0 con 0x7efc5c107ba0 2024-03-27T07:23:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.001+0000 7efc52ffd640 1 -- 172.21.15.82:0/3544853626 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 23) ==== 138546+0+0 (secure 0 0 0) 0x7efc54044020 con 0x7efc5c107ba0 2024-03-27T07:23:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.001+0000 7efc52ffd640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efc480a38c0 0x7efc480a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.001+0000 7efc52ffd640 1 -- 172.21.15.82:0/3544853626 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7efc540f2230 con 0x7efc5c107ba0 2024-03-27T07:23:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.001+0000 7efc61bf1640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efc480a38c0 0x7efc480a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:41.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.001+0000 7efc61bf1640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efc480a38c0 0x7efc480a5d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009b50 tx=0x7efc4c005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:41.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.005+0000 7efc52ffd640 1 -- 172.21.15.82:0/3544853626 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7efc5404b020 con 0x7efc5c107ba0 2024-03-27T07:23:41.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:40 smithi082 ceph-mon[32178]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-03-27T07:23:41.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:40 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1520489736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:41.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:40 smithi082 ceph-mon[32178]: scrub queued for path: / 2024-03-27T07:23:41.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:23:41.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:23:41.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:23:41.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:40 smithi082 ceph-mon[32178]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:41.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.204+0000 7efc63e55640 1 -- 172.21.15.82:0/3544853626 --> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7efc5c0fe240 con 0x7efc480a38c0 2024-03-27T07:23:41.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.211+0000 7efc52ffd640 1 -- 172.21.15.82:0/3544853626 <== mgr.15273 v2:172.21.15.82:6800/573513718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7efc5c0fe240 con 0x7efc480a38c0 2024-03-27T07:23:41.213 INFO:teuthology.orchestra.run.smithi082.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-03-27T00:00:00", "created": "2024-03-27T07:23:40", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-03-27T07:23:41.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 -- 172.21.15.82:0/3544853626 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efc480a38c0 msgr2=0x7efc480a5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:41.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efc480a38c0 0x7efc480a5d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009b50 tx=0x7efc4c005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:41.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 -- 172.21.15.82:0/3544853626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc5c107ba0 msgr2=0x7efc5c19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:41.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc5c107ba0 0x7efc5c19cc00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efc540348f0 tx=0x7efc54032c90 comp rx=0 tx=0).stop 2024-03-27T07:23:41.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 -- 172.21.15.82:0/3544853626 shutdown_connections 2024-03-27T07:23:41.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efc480a38c0 0x7efc480a5d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc5c107ba0 0x7efc5c19cc00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efc5c1024c0 0x7efc5c198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 --2- 172.21.15.82:0/3544853626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc5c101b00 0x7efc5c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 -- 172.21.15.82:0/3544853626 >> 172.21.15.82:0/3544853626 conn(0x7efc5c0fd610 msgr2=0x7efc5c0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:41.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 -- 172.21.15.82:0/3544853626 shutdown_connections 2024-03-27T07:23:41.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.213+0000 7efc63e55640 1 -- 172.21.15.82:0/3544853626 wait complete. 2024-03-27T07:23:41.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-03-27T07:23:41.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:40 smithi149 ceph-mon[36065]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-03-27T07:23:41.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:40 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1520489736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:41.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:40 smithi149 ceph-mon[36065]: scrub queued for path: / 2024-03-27T07:23:41.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:23:41.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:23:41.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:23:41.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:40 smithi149 ceph-mon[36065]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:41.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:40 smithi153 ceph-mon[36179]: mgrmap e23: x(active, since 5s), standbys: y, z 2024-03-27T07:23:41.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:40 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1520489736' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:23:41.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:40 smithi153 ceph-mon[36179]: scrub queued for path: / 2024-03-27T07:23:41.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:23:41.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:23:41.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:23:41.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:40 smithi153 ceph-mon[36179]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:41.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.327+0000 7f1476fa1640 1 -- 172.21.15.82:0/3479891350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14700691d0 msgr2=0x7f1470069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.327+0000 7f1476fa1640 1 --2- 172.21.15.82:0/3479891350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14700691d0 0x7f1470069650 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1464009930 tx=0x7f146402bc30 comp rx=0 tx=0).stop 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 -- 172.21.15.82:0/3479891350 shutdown_connections 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 --2- 172.21.15.82:0/3479891350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14700691d0 0x7f1470069650 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 --2- 172.21.15.82:0/3479891350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1470069b90 0x7f147010e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 --2- 172.21.15.82:0/3479891350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1470107c40 0x7f1470108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 -- 172.21.15.82:0/3479891350 >> 172.21.15.82:0/3479891350 conn(0x7f14700778a0 msgr2=0x7f1470077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 -- 172.21.15.82:0/3479891350 shutdown_connections 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 -- 172.21.15.82:0/3479891350 wait complete. 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 Processor -- start 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 -- start start 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14700691d0 0x7f14701983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1470069b90 0x7f1470198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:41.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1470107c40 0x7f147019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1470111ec0 con 0x7f14700691d0 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1470111d40 con 0x7f1470069b90 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1476fa1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1470112040 con 0x7f1470107c40 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1474d3d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14700691d0 0x7f14701983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1474d3d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14700691d0 0x7f14701983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49440/0 (socket says 172.21.15.82:49440) 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f1474d3d640 1 -- 172.21.15.82:0/654195245 learned_addr learned my addr 172.21.15.82:0/654195245 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f146ffff640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1470069b90 0x7f1470198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.328+0000 7f147553e640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1470107c40 0x7f147019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f1474d3d640 1 -- 172.21.15.82:0/654195245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1470107c40 msgr2=0x7f147019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f1474d3d640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1470107c40 0x7f147019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f1474d3d640 1 -- 172.21.15.82:0/654195245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1470069b90 msgr2=0x7f1470198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f1474d3d640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1470069b90 0x7f1470198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f1474d3d640 1 -- 172.21.15.82:0/654195245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147019d3b0 con 0x7f14700691d0 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f1474d3d640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14700691d0 0x7f14701983c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f146000d950 tx=0x7f146000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:41.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f146dffb640 1 -- 172.21.15.82:0/654195245 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460017030 con 0x7f14700691d0 2024-03-27T07:23:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f1476fa1640 1 -- 172.21.15.82:0/654195245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147019d6a0 con 0x7f14700691d0 2024-03-27T07:23:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f146dffb640 1 -- 172.21.15.82:0/654195245 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1460004020 con 0x7f14700691d0 2024-03-27T07:23:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f146dffb640 1 -- 172.21.15.82:0/654195245 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14600047a0 con 0x7f14700691d0 2024-03-27T07:23:41.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.329+0000 7f1476fa1640 1 -- 172.21.15.82:0/654195245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14701a4f30 con 0x7f14700691d0 2024-03-27T07:23:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.330+0000 7f1476fa1640 1 -- 172.21.15.82:0/654195245 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147004f8b0 con 0x7f14700691d0 2024-03-27T07:23:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.331+0000 7f146dffb640 1 -- 172.21.15.82:0/654195245 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 23) ==== 138546+0+0 (secure 0 0 0) 0x7f14600041d0 con 0x7f14700691d0 2024-03-27T07:23:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.331+0000 7f146dffb640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f14580a38c0 0x7f14580a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.332+0000 7f146ffff640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f14580a38c0 0x7f14580a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.332+0000 7f146dffb640 1 -- 172.21.15.82:0/654195245 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f14600cfb10 con 0x7f14700691d0 2024-03-27T07:23:41.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.332+0000 7f146ffff640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f14580a38c0 0x7f14580a5d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1464005ab0 tx=0x7f1464005fd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:41.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.336+0000 7f146dffb640 1 -- 172.21.15.82:0/654195245 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f146009c280 con 0x7f14700691d0 2024-03-27T07:23:41.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.534+0000 7f1476fa1640 1 -- 172.21.15.82:0/654195245 --> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f1470061f90 con 0x7f14580a38c0 2024-03-27T07:23:41.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.540+0000 7f146dffb640 1 -- 172.21.15.82:0/654195245 <== mgr.15273 v2:172.21.15.82:6800/573513718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f1470061f90 con 0x7f14580a38c0 2024-03-27T07:23:41.542 INFO:teuthology.orchestra.run.smithi082.stdout:/ 1m 6m3h 2024-03-27T07:23:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.542+0000 7f1476fa1640 1 -- 172.21.15.82:0/654195245 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f14580a38c0 msgr2=0x7f14580a5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.542+0000 7f1476fa1640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f14580a38c0 0x7f14580a5d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1464005ab0 tx=0x7f1464005fd0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.542+0000 7f1476fa1640 1 -- 172.21.15.82:0/654195245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14700691d0 msgr2=0x7f14701983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.542+0000 7f1476fa1640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14700691d0 0x7f14701983c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f146000d950 tx=0x7f146000de10 comp rx=0 tx=0).stop 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.542+0000 7f1476fa1640 1 -- 172.21.15.82:0/654195245 shutdown_connections 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.542+0000 7f1476fa1640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f14580a38c0 0x7f14580a5d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.542+0000 7f1476fa1640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1470107c40 0x7f147019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.542+0000 7f1476fa1640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1470069b90 0x7f1470198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.542+0000 7f1476fa1640 1 --2- 172.21.15.82:0/654195245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f14700691d0 0x7f14701983c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.542+0000 7f1476fa1640 1 -- 172.21.15.82:0/654195245 >> 172.21.15.82:0/654195245 conn(0x7f14700778a0 msgr2=0x7f14700ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.543+0000 7f1476fa1640 1 -- 172.21.15.82:0/654195245 shutdown_connections 2024-03-27T07:23:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:23:41.543+0000 7f1476fa1640 1 -- 172.21.15.82:0/654195245 wait complete. 2024-03-27T07:23:41.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-03-27T07:23:41.583 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-03-27T07:23:41.594 INFO:teuthology.run_tasks:Running task background_exec... 2024-03-27T07:23:41.613 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T07:23:41.613 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-03-27T07:23:41.626 INFO:teuthology.run_tasks:Running task workunit... 2024-03-27T07:23:41.639 INFO:tasks.workunit:Pulling workunits from ref 155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:23:41.639 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-27T07:23:41.639 INFO:tasks.workunit:timeout=3h 2024-03-27T07:23:41.639 INFO:tasks.workunit:cleanup=True 2024-03-27T07:23:41.639 DEBUG:teuthology.orchestra.run.smithi082:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-27T07:23:41.654 INFO:teuthology.orchestra.run.smithi082.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-27T07:23:41.654 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-27T07:23:41.655 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-03-27T07:23:41.655 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T07:23:41.655 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-27T07:23:41.655 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-03-27 07:21:40.986553701 +0000 2024-03-27T07:23:41.655 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-03-27 07:21:40.986553701 +0000 2024-03-27T07:23:41.655 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-03-27 07:23:33.101260850 +0000 2024-03-27T07:23:41.655 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-03-27 07:21:40.986553701 +0000 2024-03-27T07:23:41.655 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-27T07:23:41.655 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-27T07:23:41.728 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T07:23:41.783 INFO:tasks.workunit.client.0.smithi082.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-27T07:23:42.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:41 smithi149 ceph-mon[36065]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:42.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:41 smithi149 ceph-mon[36065]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 90 KiB/s wr, 60 op/s 2024-03-27T07:23:42.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:41 smithi149 ceph-mon[36065]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:42.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:41 smithi149 ceph-mon[36065]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:42.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:41 smithi153 ceph-mon[36179]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:42.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:41 smithi153 ceph-mon[36179]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 90 KiB/s wr, 60 op/s 2024-03-27T07:23:42.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:41 smithi153 ceph-mon[36179]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:42.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:41 smithi153 ceph-mon[36179]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:42.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:41 smithi082 ceph-mon[32178]: from='client.15495 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:42.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:41 smithi082 ceph-mon[32178]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 90 KiB/s wr, 60 op/s 2024-03-27T07:23:42.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:41 smithi082 ceph-mon[32178]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:42.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:41 smithi082 ceph-mon[32178]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:23:44.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:43 smithi149 ceph-mon[36065]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 131 KiB/s wr, 71 op/s 2024-03-27T07:23:44.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:43 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:23:44.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:43 smithi153 ceph-mon[36179]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 131 KiB/s wr, 71 op/s 2024-03-27T07:23:44.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:43 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:23:44.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:43 smithi082 ceph-mon[32178]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 131 KiB/s wr, 71 op/s 2024-03-27T07:23:44.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:43 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:23:46.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:45 smithi149 ceph-mon[36065]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 102 KiB/s wr, 55 op/s 2024-03-27T07:23:46.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:45 smithi153 ceph-mon[36179]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 102 KiB/s wr, 55 op/s 2024-03-27T07:23:46.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:45 smithi082 ceph-mon[32178]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 102 KiB/s wr, 55 op/s 2024-03-27T07:23:48.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:47 smithi149 ceph-mon[36065]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-03-27T07:23:48.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:47 smithi153 ceph-mon[36179]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-03-27T07:23:48.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:47 smithi082 ceph-mon[32178]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 84 KiB/s wr, 51 op/s 2024-03-27T07:23:50.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:49 smithi149 ceph-mon[36065]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-03-27T07:23:50.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:49 smithi153 ceph-mon[36179]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-03-27T07:23:50.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:49 smithi082 ceph-mon[32178]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-03-27T07:23:52.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:51 smithi149 ceph-mon[36065]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-03-27T07:23:52.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:51 smithi153 ceph-mon[36179]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-03-27T07:23:52.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:51 smithi082 ceph-mon[32178]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 47 op/s 2024-03-27T07:23:54.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:53 smithi149 ceph-mon[36065]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 39 KiB/s wr, 24 op/s 2024-03-27T07:23:54.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:53 smithi153 ceph-mon[36179]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 39 KiB/s wr, 24 op/s 2024-03-27T07:23:54.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:53 smithi082 ceph-mon[32178]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 39 KiB/s wr, 24 op/s 2024-03-27T07:23:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.764+0000 7f9cec684640 1 -- 172.21.15.82:0/2750020851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce4101760 msgr2=0x7f9ce410d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.764+0000 7f9cec684640 1 --2- 172.21.15.82:0/2750020851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce4101760 0x7f9ce410d830 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009cd0 tx=0x7f9cdc02c0f0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.764+0000 7f9cec684640 1 -- 172.21.15.82:0/2750020851 shutdown_connections 2024-03-27T07:23:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.764+0000 7f9cec684640 1 --2- 172.21.15.82:0/2750020851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce4101760 0x7f9ce410d830 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.764+0000 7f9cec684640 1 --2- 172.21.15.82:0/2750020851 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce4100da0 0x7f9ce4101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.764+0000 7f9cec684640 1 --2- 172.21.15.82:0/2750020851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce4105a30 0x7f9ce4105e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.764+0000 7f9cec684640 1 -- 172.21.15.82:0/2750020851 >> 172.21.15.82:0/2750020851 conn(0x7f9ce4076850 msgr2=0x7f9ce4076c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.764+0000 7f9cec684640 1 -- 172.21.15.82:0/2750020851 shutdown_connections 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.764+0000 7f9cec684640 1 -- 172.21.15.82:0/2750020851 wait complete. 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9cec684640 1 Processor -- start 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9cec684640 1 -- start start 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9cec684640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce4100da0 0x7f9ce41982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9cec684640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce4101760 0x7f9ce4198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9cec684640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce4105a30 0x7f9ce419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9cec684640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce4110e60 con 0x7f9ce4105a30 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9cec684640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce4110ce0 con 0x7f9ce4100da0 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9cec684640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce4110fe0 con 0x7f9ce4101760 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9ceac21640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce4105a30 0x7f9ce419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9ceac21640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce4105a30 0x7f9ce419cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52170/0 (socket says 172.21.15.82:52170) 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9ceac21640 1 -- 172.21.15.82:0/3498857598 learned_addr learned my addr 172.21.15.82:0/3498857598 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9cea420640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce4100da0 0x7f9ce41982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.765+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce4101760 0x7f9ce4198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9ceac21640 1 -- 172.21.15.82:0/3498857598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce4101760 msgr2=0x7f9ce4198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9ceac21640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce4101760 0x7f9ce4198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9ceac21640 1 -- 172.21.15.82:0/3498857598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce4100da0 msgr2=0x7f9ce41982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9ceac21640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce4100da0 0x7f9ce41982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9ceac21640 1 -- 172.21.15.82:0/3498857598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce419d2e0 con 0x7f9ce4105a30 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9ceac21640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce4105a30 0x7f9ce419cbb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc004af0 tx=0x7f9cdc032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9cdb7fe640 1 -- 172.21.15.82:0/3498857598 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc042020 con 0x7f9ce4105a30 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9cec684640 1 -- 172.21.15.82:0/3498857598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce419d570 con 0x7f9ce4105a30 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9cdb7fe640 1 -- 172.21.15.82:0/3498857598 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cdc032e80 con 0x7f9ce4105a30 2024-03-27T07:23:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9cdb7fe640 1 -- 172.21.15.82:0/3498857598 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc039040 con 0x7f9ce4105a30 2024-03-27T07:23:54.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.766+0000 7f9cec684640 1 -- 172.21.15.82:0/3498857598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce41a4e60 con 0x7f9ce4105a30 2024-03-27T07:23:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.769+0000 7f9cdb7fe640 1 -- 172.21.15.82:0/3498857598 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 23) ==== 138546+0+0 (secure 0 0 0) 0x7f9cdc045020 con 0x7f9ce4105a30 2024-03-27T07:23:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.769+0000 7f9cef26c740 1 Processor -- start 2024-03-27T07:23:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.769+0000 7f9cef26c740 1 -- start start 2024-03-27T07:23:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.769+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.769+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 0x5649fa7b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.769+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.769+0000 7f9cef26c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5649fa76ecd0 con 0x5649fa7a80f0 2024-03-27T07:23:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.769+0000 7f9cef26c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5649fa6b3950 con 0x5649fa7b17e0 2024-03-27T07:23:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.769+0000 7f9cef26c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5649fa70be50 con 0x5649fa7a8a10 2024-03-27T07:23:54.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ce9c1f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ce9c1f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52184/0 (socket says 172.21.15.82:52184) 2024-03-27T07:23:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/2345052262 learned_addr learned my addr 172.21.15.82:0/2345052262 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9cea420640 1 --2- 172.21.15.82:0/2345052262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 0x5649fa7b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/2345052262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9cdb7fe640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9cd00a38c0 0x7f9cd00a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/2345052262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 msgr2=0x5649fa7b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/2345052262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 0x5649fa7b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/2345052262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 msgr2=0x5649fa7b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/2345052262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/2345052262 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649fa420210 con 0x5649fa7a80f0 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9cea420640 1 --2- 172.21.15.82:0/2345052262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 0x5649fa7b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ceac21640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9cd00a38c0 0x7f9cd00a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9cdb7fe640 1 -- 172.21.15.82:0/3498857598 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9cdc0f2040 con 0x7f9ce4105a30 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/2345052262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7a84d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4005bc0 tx=0x7f9cd4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb76157a9d22f409 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9cd8ff9640 1 -- 172.21.15.82:0/2345052262 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd400f480 con 0x5649fa7a80f0 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9cd8ff9640 1 -- 172.21.15.82:0/2345052262 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cd400fb00 con 0x5649fa7a80f0 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.770+0000 7f9cd8ff9640 1 -- 172.21.15.82:0/2345052262 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4010a40 con 0x5649fa7a80f0 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.771+0000 7f9cef26c740 1 -- 172.21.15.82:0/2345052262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 msgr2=0x5649fa7a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.771+0000 7f9ceac21640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9cd00a38c0 0x7f9cd00a5d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0ef890 tx=0x7f9cdc08fdf0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.771+0000 7f9cef26c740 1 --2- 172.21.15.82:0/2345052262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7a84d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4005bc0 tx=0x7f9cd4005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.771+0000 7f9cef26c740 1 -- 172.21.15.82:0/2345052262 shutdown_connections 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.771+0000 7f9cef26c740 1 --2- 172.21.15.82:0/2345052262 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.771+0000 7f9cef26c740 1 --2- 172.21.15.82:0/2345052262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 0x5649fa7b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.771+0000 7f9cef26c740 1 --2- 172.21.15.82:0/2345052262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7a84d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.771+0000 7f9cef26c740 1 -- 172.21.15.82:0/2345052262 >> 172.21.15.82:0/2345052262 conn(0x5649fa7a2a10 msgr2=0x5649fa7a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.771+0000 7f9cef26c740 1 -- 172.21.15.82:0/2345052262 shutdown_connections 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.771+0000 7f9cef26c740 1 -- 172.21.15.82:0/2345052262 wait complete. 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cef26c740 1 -- start start 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cef26c740 1 Processor -- start 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a80f0 0x5649fa7ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a8a10 0x5649fa7aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cef26c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5649fa707e00 con 0x5649fa7a8a10 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cef26c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5649fa6b4520 con 0x5649fa7b17e0 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cef26c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5649fa6c78e0 con 0x5649fa7a80f0 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cef26c740 10 client.0 _ll_register_callbacks cb 0x5649fa702a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cea420640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a8a10 0x5649fa7aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9ce9c1f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a80f0 0x5649fa7ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cea420640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a8a10 0x5649fa7aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52196/0 (socket says 172.21.15.82:52196) 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cea420640 1 -- 172.21.15.82:0/1414379207 learned_addr learned my addr 172.21.15.82:0/1414379207 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cea420640 1 -- 172.21.15.82:0/1414379207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a80f0 msgr2=0x5649fa7ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cea420640 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a80f0 0x5649fa7ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cea420640 1 -- 172.21.15.82:0/1414379207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 msgr2=0x5649fa7af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cea420640 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cea420640 1 -- 172.21.15.82:0/1414379207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649fa4ec620 con 0x5649fa7a8a10 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9cea420640 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a8a10 0x5649fa7aece0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0012770 tx=0x7f9ce0012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a5961487aba15f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.772+0000 7f9ccdffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1414379207 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0004030 con 0x5649fa7a8a10 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1414379207 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9ce00041d0 con 0x5649fa7a8a10 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9cef26c740 1 -- 172.21.15.82:0/1414379207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cd400fb00 con 0x5649fa7a8a10 2024-03-27T07:23:54.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1414379207 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9ce00043d0 con 0x5649fa7a8a10 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9cef26c740 10 client.15519 fetch_fsmap learned FSMap version 22 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9cef26c740 1 -- 172.21.15.82:0/1414379207 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5649fa7c03b0 con 0x5649fa7a8a10 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1414379207 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cd400fb00 con 0x5649fa7a8a10 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1414379207 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f9ce0003b70 con 0x5649fa7a8a10 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9cef26c740 10 client.15519 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9cef26c740 10 client.15519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9cef26c740 20 client.15519 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649fa7c1910 0x5649fa7c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9cef26c740 4 client.15519 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9cef26c740 1 -- 172.21.15.82:0/1414379207 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649fa719390 con 0x5649fa7c1910 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.773+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649fa7c1910 0x5649fa7c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.774+0000 7f9ccdffb640 10 client.15519 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.774+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649fa7c1910 0x5649fa7c3d20 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f0cd4a5aa87e27e server_cookie=b7a2ecde74511d5f in_seq=0 out_seq=0 2024-03-27T07:23:54.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.774+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1414379207 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5649fa719390 con 0x5649fa7c1910 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.774+0000 7f9ccdffb640 10 client.15519 handle_command_reply: tid=0 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 client.15519 shutdown 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 -- 172.21.15.82:0/1414379207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a8a10 msgr2=0x5649fa7aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a8a10 0x5649fa7aece0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0012770 tx=0x7f9ce0012c30 comp rx=0 tx=0).stop 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 -- 172.21.15.82:0/1414379207 shutdown_connections 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649fa7c1910 0x5649fa7c3d20 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a8a10 0x5649fa7aece0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9ccdffb640 0 client.15519 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1414379207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a80f0 0x5649fa7ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 -- 172.21.15.82:0/1414379207 >> 172.21.15.82:0/1414379207 conn(0x5649fa7a2a10 msgr2=0x5649fa7a4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 -- 172.21.15.82:0/1414379207 shutdown_connections 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 1 -- 172.21.15.82:0/1414379207 wait complete. 2024-03-27T07:23:54.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.775+0000 7f9cef26c740 20 client.15519 trim_cache size 0 max 16384 2024-03-27T07:23:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.789+0000 7f9cef26c740 1 Processor -- start 2024-03-27T07:23:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.789+0000 7f9cef26c740 1 -- start start 2024-03-27T07:23:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a80f0 0x5649fa7bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7a8a10 0x5649fa7af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7b17e0 0x5649fa7c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9cef26c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41aff40 con 0x5649fa7b17e0 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9cef26c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41ad810 con 0x5649fa7a8a10 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9cef26c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41ab660 con 0x5649fa7a80f0 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ce9c1f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7b17e0 0x5649fa7c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ce9c1f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7b17e0 0x5649fa7c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52198/0 (socket says 172.21.15.82:52198) 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/1932692237 learned_addr learned my addr 172.21.15.82:0/1932692237 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1932692237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a80f0 0x5649fa7bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9cea420640 1 --2- 172.21.15.82:0/1932692237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7a8a10 0x5649fa7af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/1932692237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a80f0 msgr2=0x5649fa7bceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1932692237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a80f0 0x5649fa7bceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/1932692237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7a8a10 msgr2=0x5649fa7af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1932692237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7a8a10 0x5649fa7af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/1932692237 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649fa7c43a0 con 0x5649fa7b17e0 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1932692237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7b17e0 0x5649fa7c9630 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4013230 tx=0x7f9cd4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424e1a33a1fd37ff server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ccffff640 1 -- 172.21.15.82:0/1932692237 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4031580 con 0x5649fa7b17e0 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ccffff640 1 -- 172.21.15.82:0/1932692237 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cd40055b0 con 0x5649fa7b17e0 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.790+0000 7f9ccffff640 1 -- 172.21.15.82:0/1932692237 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4010d50 con 0x5649fa7b17e0 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 -- 172.21.15.82:0/1932692237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7b17e0 msgr2=0x5649fa7c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1932692237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7b17e0 0x5649fa7c9630 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4013230 tx=0x7f9cd4005f90 comp rx=0 tx=0).stop 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 -- 172.21.15.82:0/1932692237 shutdown_connections 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1932692237 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7b17e0 0x5649fa7c9630 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1932692237 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7a8a10 0x5649fa7af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1932692237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a80f0 0x5649fa7bceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 -- 172.21.15.82:0/1932692237 >> 172.21.15.82:0/1932692237 conn(0x5649fa7a2a10 msgr2=0x5649fa7a11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 -- 172.21.15.82:0/1932692237 shutdown_connections 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 -- 172.21.15.82:0/1932692237 wait complete. 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 -- start start 2024-03-27T07:23:54.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.791+0000 7f9cef26c740 1 Processor -- start 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7abf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 0x5649fa7ac480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9cef26c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7aac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9cef26c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41abcd0 con 0x5649fa7a80f0 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9cef26c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41ad140 con 0x5649fa7b17e0 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9cef26c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce41ac3a0 con 0x5649fa7a8a10 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9cef26c740 10 client.0 _ll_register_callbacks cb 0x7f9ce0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ce9c1f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ce9c1f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7abf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52202/0 (socket says 172.21.15.82:52202) 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/1903038373 learned_addr learned my addr 172.21.15.82:0/1903038373 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9cea420640 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 0x5649fa7ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/1903038373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 msgr2=0x5649fa7ac480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:54.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 0x5649fa7ac480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/1903038373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 msgr2=0x5649fa7aac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7aac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ce9c1f640 1 -- 172.21.15.82:0/1903038373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649fa7a7a60 con 0x5649fa7a80f0 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9cea420640 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 0x5649fa7ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ce9c1f640 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7abf40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4001eb0 tx=0x7f9cd40132c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951bab80c2c4fac8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ccdffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1903038373 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4010720 con 0x5649fa7a80f0 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1903038373 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9cd4031580 con 0x5649fa7a80f0 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9cef26c740 1 -- 172.21.15.82:0/1903038373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cd40055b0 con 0x5649fa7a80f0 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.792+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1903038373 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9cd4046050 con 0x5649fa7a80f0 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9cef26c740 10 client.15525 fetch_fsmap learned FSMap version 22 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9cef26c740 1 -- 172.21.15.82:0/1903038373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5649fa82c600 con 0x5649fa7a80f0 2024-03-27T07:23:54.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1903038373 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cd40055b0 con 0x5649fa7a80f0 2024-03-27T07:23:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1903038373 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f9cd40035f0 con 0x5649fa7a80f0 2024-03-27T07:23:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9cef26c740 10 client.15525 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:23:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9cef26c740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:23:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9cef26c740 20 client.15525 populate_metadata read hostname 'smithi082' 2024-03-27T07:23:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649fa82cad0 0x5649fa82eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:23:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9cef26c740 4 client.15525 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:23:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9cef26c740 1 -- 172.21.15.82:0/1903038373 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5649fa7136e0 con 0x5649fa82cad0 2024-03-27T07:23:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9cea420640 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649fa82cad0 0x5649fa82eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:23:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9cea420640 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649fa82cad0 0x5649fa82eec0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3de91b02ae351aac server_cookie=70ee2e8f06ae5e6b in_seq=0 out_seq=0 2024-03-27T07:23:54.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.793+0000 7f9ccdffb640 10 client.15525 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9ccdffb640 1 -- 172.21.15.82:0/1903038373 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5649fa7136e0 con 0x5649fa82cad0 2024-03-27T07:23:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9ccdffb640 10 client.15525 handle_command_reply: tid=0 2024-03-27T07:23:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9cef26c740 1 client.15525 shutdown 2024-03-27T07:23:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9cef26c740 1 -- 172.21.15.82:0/1903038373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 msgr2=0x5649fa7abf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7abf40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4001eb0 tx=0x7f9cd40132c0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9cef26c740 1 -- 172.21.15.82:0/1903038373 shutdown_connections 2024-03-27T07:23:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5649fa7b17e0 0x5649fa7aac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5649fa7a8a10 0x5649fa7ac480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649fa82cad0 0x5649fa82eec0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9cef26c740 1 --2- 172.21.15.82:0/1903038373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fa7a80f0 0x5649fa7abf40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9ccdffb640 0 client.15525 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:23:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9cef26c740 1 -- 172.21.15.82:0/1903038373 >> 172.21.15.82:0/1903038373 conn(0x5649fa7a2a10 msgr2=0x5649fa7a4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.804+0000 7f9cef26c740 1 -- 172.21.15.82:0/1903038373 shutdown_connections 2024-03-27T07:23:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cef26c740 1 -- 172.21.15.82:0/1903038373 wait complete. 2024-03-27T07:23:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cef26c740 20 client.15525 trim_cache size 0 max 16384 2024-03-27T07:23:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:23:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:23:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:23:54.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:23:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 -- 172.21.15.82:0/3498857598 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9cd00a38c0 msgr2=0x7f9cd00a5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9cd00a38c0 0x7f9cd00a5d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc0ef890 tx=0x7f9cdc08fdf0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 -- 172.21.15.82:0/3498857598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce4105a30 msgr2=0x7f9ce419cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:23:54.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce4105a30 0x7f9ce419cbb0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc004af0 tx=0x7f9cdc032c90 comp rx=0 tx=0).stop 2024-03-27T07:23:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 -- 172.21.15.82:0/3498857598 shutdown_connections 2024-03-27T07:23:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9cd00a38c0 0x7f9cd00a5d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9ce4105a30 0x7f9ce419cbb0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ce4101760 0x7f9ce4198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 --2- 172.21.15.82:0/3498857598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9ce4100da0 0x7f9ce41982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:23:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 -- 172.21.15.82:0/3498857598 >> 172.21.15.82:0/3498857598 conn(0x7f9ce4076850 msgr2=0x7f9ce406a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:23:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 -- 172.21.15.82:0/3498857598 shutdown_connections 2024-03-27T07:23:54.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:23:54.805+0000 7f9cec684640 1 -- 172.21.15.82:0/3498857598 wait complete. 2024-03-27T07:23:56.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:55 smithi149 ceph-mon[36065]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-03-27T07:23:56.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:55 smithi153 ceph-mon[36179]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-03-27T07:23:56.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:55 smithi082 ceph-mon[32178]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-03-27T07:23:58.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:57 smithi149 ceph-mon[36065]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-03-27T07:23:58.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:57 smithi153 ceph-mon[36179]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-03-27T07:23:58.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:57 smithi082 ceph-mon[32178]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-03-27T07:24:00.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:23:59 smithi149 ceph-mon[36065]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-03-27T07:24:00.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:23:59 smithi153 ceph-mon[36179]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-03-27T07:24:00.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:23:59 smithi082 ceph-mon[32178]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-03-27T07:24:01.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:24:00 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:24:00.885+0000 7fa97bab9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:24:01.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:24:00 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:24:00.885+0000 7fa97bab9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:24:01.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:24:00 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:24:00.885+0000 7fa97bab9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:24:01.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:24:00 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:24:00.885+0000 7fa97bab9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:24:01.188 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:24:00 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:24:00.885+0000 7fa97bab9700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T07:24:02.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:02 smithi153 ceph-mon[36179]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-03-27T07:24:02.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:02 smithi082 ceph-mon[32178]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-03-27T07:24:02.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:02 smithi149 ceph-mon[36065]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 27 op/s 2024-03-27T07:24:03.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:03 smithi153 ceph-mon[36179]: mgrmap e24: x(active, since 27s), standbys: y, z 2024-03-27T07:24:03.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:03 smithi082 ceph-mon[32178]: mgrmap e24: x(active, since 27s), standbys: y, z 2024-03-27T07:24:03.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:03 smithi149 ceph-mon[36065]: mgrmap e24: x(active, since 27s), standbys: y, z 2024-03-27T07:24:04.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:04 smithi153 ceph-mon[36179]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-03-27T07:24:04.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:04 smithi082 ceph-mon[32178]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-03-27T07:24:04.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:04 smithi149 ceph-mon[36065]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 26 op/s 2024-03-27T07:24:06.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:06 smithi153 ceph-mon[36179]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-03-27T07:24:06.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:06 smithi082 ceph-mon[32178]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-03-27T07:24:06.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:06 smithi149 ceph-mon[36065]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-03-27T07:24:07.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.893+0000 7fbc7382a640 1 -- 172.21.15.82:0/3768252639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc6c105ac0 msgr2=0x7fbc6c105ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.893+0000 7fbc7382a640 1 --2- 172.21.15.82:0/3768252639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc6c105ac0 0x7fbc6c105ea0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009900 tx=0x7fbc5c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.893+0000 7fbc7382a640 1 -- 172.21.15.82:0/3768252639 shutdown_connections 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.893+0000 7fbc7382a640 1 --2- 172.21.15.82:0/3768252639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc6c1016f0 0x7fbc6c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.893+0000 7fbc7382a640 1 --2- 172.21.15.82:0/3768252639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c100d30 0x7fbc6c1011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.893+0000 7fbc7382a640 1 --2- 172.21.15.82:0/3768252639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc6c105ac0 0x7fbc6c105ea0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.893+0000 7fbc7382a640 1 -- 172.21.15.82:0/3768252639 >> 172.21.15.82:0/3768252639 conn(0x7fbc6c077830 msgr2=0x7fbc6c077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.893+0000 7fbc7382a640 1 -- 172.21.15.82:0/3768252639 shutdown_connections 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.893+0000 7fbc7382a640 1 -- 172.21.15.82:0/3768252639 wait complete. 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc7382a640 1 Processor -- start 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc7382a640 1 -- start start 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc7382a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c100d30 0x7fbc6c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc7382a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc6c1016f0 0x7fbc6c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc7382a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc6c105ac0 0x7fbc6c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc7382a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c111fa0 con 0x7fbc6c1016f0 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc7382a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c111e20 con 0x7fbc6c100d30 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc7382a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c112120 con 0x7fbc6c105ac0 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc70dc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc6c1016f0 0x7fbc6c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc70dc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc6c1016f0 0x7fbc6c1988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55060/0 (socket says 172.21.15.82:55060) 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc70dc5640 1 -- 172.21.15.82:0/2620095943 learned_addr learned my addr 172.21.15.82:0/2620095943 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc715c6640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c100d30 0x7fbc6c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc71dc7640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc6c105ac0 0x7fbc6c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc70dc5640 1 -- 172.21.15.82:0/2620095943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc6c105ac0 msgr2=0x7fbc6c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc6c105ac0 0x7fbc6c19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc70dc5640 1 -- 172.21.15.82:0/2620095943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c100d30 msgr2=0x7fbc6c198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c100d30 0x7fbc6c198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.894+0000 7fbc70dc5640 1 -- 172.21.15.82:0/2620095943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc6c19d350 con 0x7fbc6c1016f0 2024-03-27T07:24:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.895+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc6c1016f0 0x7fbc6c1988a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800e9f0 tx=0x7fbc6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.895+0000 7fbc627fc640 1 -- 172.21.15.82:0/2620095943 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6800cd80 con 0x7fbc6c1016f0 2024-03-27T07:24:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.895+0000 7fbc627fc640 1 -- 172.21.15.82:0/2620095943 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc68010910 con 0x7fbc6c1016f0 2024-03-27T07:24:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.895+0000 7fbc7382a640 1 -- 172.21.15.82:0/2620095943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc6c19d640 con 0x7fbc6c1016f0 2024-03-27T07:24:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.895+0000 7fbc627fc640 1 -- 172.21.15.82:0/2620095943 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc68018990 con 0x7fbc6c1016f0 2024-03-27T07:24:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.895+0000 7fbc7382a640 1 -- 172.21.15.82:0/2620095943 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc6c1a4ed0 con 0x7fbc6c1016f0 2024-03-27T07:24:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.897+0000 7fbc627fc640 1 -- 172.21.15.82:0/2620095943 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7fbc68010ac0 con 0x7fbc6c1016f0 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.897+0000 7fbc76412740 1 Processor -- start 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.897+0000 7fbc76412740 1 -- start start 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc76412740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf5697b0f0 0x55bf5697b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc76412740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf569842a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc76412740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf569847e0 0x55bf56986bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc76412740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bf56941cd0 con 0x55bf569847e0 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc76412740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55bf56886950 con 0x55bf5697b0f0 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc76412740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bf568dee50 con 0x55bf5697ba10 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc627fc640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc580a3940 0x7fbc580a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc70dc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf569847e0 0x55bf56986bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc70dc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf569847e0 0x55bf56986bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55064/0 (socket says 172.21.15.82:55064) 2024-03-27T07:24:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc70dc5640 1 -- 172.21.15.82:0/2749969929 learned_addr learned my addr 172.21.15.82:0/2749969929 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc715c6640 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf569842a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc71dc7640 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf5697b0f0 0x55bf5697b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc71dc7640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc580a3940 0x7fbc580a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc627fc640 1 -- 172.21.15.82:0/2620095943 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fbc680d0710 con 0x7fbc6c1016f0 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc70dc5640 1 -- 172.21.15.82:0/2749969929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 msgr2=0x55bf569842a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf569842a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc70dc5640 1 -- 172.21.15.82:0/2749969929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf5697b0f0 msgr2=0x55bf5697b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf5697b0f0 0x55bf5697b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc70dc5640 1 -- 172.21.15.82:0/2749969929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf565f3210 con 0x55bf569847e0 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc715c6640 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf569842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc71dc7640 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf5697b0f0 0x55bf5697b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf569847e0 0x55bf56986bd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbc68098b50 tx=0x7fbc68018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0be0578d3be490e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc71dc7640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc580a3940 0x7fbc580a5e00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbc64005c40 tx=0x7fbc64009500 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.898+0000 7fbc577fe640 1 -- 172.21.15.82:0/2749969929 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc680870c0 con 0x55bf569847e0 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc577fe640 1 -- 172.21.15.82:0/2749969929 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc680a09f0 con 0x55bf569847e0 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc577fe640 1 -- 172.21.15.82:0/2749969929 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6809bb40 con 0x55bf569847e0 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc76412740 1 -- 172.21.15.82:0/2749969929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf569847e0 msgr2=0x55bf56986bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc76412740 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf569847e0 0x55bf56986bd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbc68098b50 tx=0x7fbc68018420 comp rx=0 tx=0).stop 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc76412740 1 -- 172.21.15.82:0/2749969929 shutdown_connections 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc76412740 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf569847e0 0x55bf56986bd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc76412740 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf569842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc76412740 1 --2- 172.21.15.82:0/2749969929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf5697b0f0 0x55bf5697b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc76412740 1 -- 172.21.15.82:0/2749969929 >> 172.21.15.82:0/2749969929 conn(0x55bf56975a10 msgr2=0x55bf56975df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc76412740 1 -- 172.21.15.82:0/2749969929 shutdown_connections 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.899+0000 7fbc76412740 1 -- 172.21.15.82:0/2749969929 wait complete. 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc76412740 1 -- start start 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc76412740 1 Processor -- start 2024-03-27T07:24:07.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc76412740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697b0f0 0x55bf56981830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc76412740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697ba10 0x55bf56981d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc76412740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf569822b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc76412740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bf568dae00 con 0x55bf5697ba10 2024-03-27T07:24:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc76412740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55bf56887520 con 0x55bf569847e0 2024-03-27T07:24:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc76412740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bf5689a8e0 con 0x55bf5697b0f0 2024-03-27T07:24:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc76412740 10 client.0 _ll_register_callbacks cb 0x55bf568d5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc70dc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697ba10 0x55bf56981d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc70dc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697ba10 0x55bf56981d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55072/0 (socket says 172.21.15.82:55072) 2024-03-27T07:24:07.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc70dc5640 1 -- 172.21.15.82:0/4116810130 learned_addr learned my addr 172.21.15.82:0/4116810130 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc715c6640 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697b0f0 0x55bf56981830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc71dc7640 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf569822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc70dc5640 1 -- 172.21.15.82:0/4116810130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697b0f0 msgr2=0x55bf56981830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697b0f0 0x55bf56981830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc70dc5640 1 -- 172.21.15.82:0/4116810130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 msgr2=0x55bf569822b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf569822b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.900+0000 7fbc70dc5640 1 -- 172.21.15.82:0/4116810130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf566bf620 con 0x55bf5697ba10 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697ba10 0x55bf56981d70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbc680a4d80 tx=0x7fbc68005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9751d8719f6d0c11 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc54ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc54ff9640 1 -- 172.21.15.82:0/4116810130 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc680ce2b0 con 0x55bf5697ba10 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc54ff9640 1 -- 172.21.15.82:0/4116810130 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fbc680b5bd0 con 0x55bf5697ba10 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc76412740 1 -- 172.21.15.82:0/4116810130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc680a09f0 con 0x55bf5697ba10 2024-03-27T07:24:07.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc54ff9640 1 -- 172.21.15.82:0/4116810130 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fbc680b9020 con 0x55bf5697ba10 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc76412740 10 client.15543 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc76412740 1 -- 172.21.15.82:0/4116810130 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55bf56993390 con 0x55bf5697ba10 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc54ff9640 1 -- 172.21.15.82:0/4116810130 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc680a09f0 con 0x55bf5697ba10 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc54ff9640 1 -- 172.21.15.82:0/4116810130 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fbc68018c50 con 0x55bf5697ba10 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc76412740 10 client.15543 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc76412740 10 client.15543 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc76412740 20 client.15543 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc76412740 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55bf569946e0 0x55bf56996ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc76412740 4 client.15543 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc76412740 1 -- 172.21.15.82:0/4116810130 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf568ec390 con 0x55bf569946e0 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.901+0000 7fbc715c6640 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55bf569946e0 0x55bf56996ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.902+0000 7fbc54ff9640 10 client.15543 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.902+0000 7fbc715c6640 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55bf569946e0 0x55bf56996ad0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3262b65493d6a8e8 server_cookie=a34dc0937e07d9d6 in_seq=0 out_seq=0 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc54ff9640 1 -- 172.21.15.82:0/4116810130 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55bf568ec390 con 0x55bf569946e0 2024-03-27T07:24:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc54ff9640 10 client.15543 handle_command_reply: tid=0 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 client.15543 shutdown 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 -- 172.21.15.82:0/4116810130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697ba10 msgr2=0x55bf56981d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697ba10 0x55bf56981d70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbc680a4d80 tx=0x7fbc68005760 comp rx=0 tx=0).stop 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 -- 172.21.15.82:0/4116810130 shutdown_connections 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55bf569946e0 0x55bf56996ad0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697ba10 0x55bf56981d70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf569822b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc54ff9640 0 client.15543 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 --2- 172.21.15.82:0/4116810130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697b0f0 0x55bf56981830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 -- 172.21.15.82:0/4116810130 >> 172.21.15.82:0/4116810130 conn(0x55bf56975a10 msgr2=0x55bf56977760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 -- 172.21.15.82:0/4116810130 shutdown_connections 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 1 -- 172.21.15.82:0/4116810130 wait complete. 2024-03-27T07:24:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.903+0000 7fbc76412740 20 client.15543 trim_cache size 0 max 16384 2024-03-27T07:24:07.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.917+0000 7fbc76412740 1 Processor -- start 2024-03-27T07:24:07.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc76412740 1 -- start start 2024-03-27T07:24:07.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc76412740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf56983f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc76412740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf5698c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc76412740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf5698feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc76412740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1aff70 con 0x55bf5697b0f0 2024-03-27T07:24:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc76412740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1ad840 con 0x55bf569847e0 2024-03-27T07:24:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc76412740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1ab690 con 0x55bf5697ba10 2024-03-27T07:24:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc715c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf56983f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc715c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf56983f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55082/0 (socket says 172.21.15.82:55082) 2024-03-27T07:24:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc715c6640 1 -- 172.21.15.82:0/3821370451 learned_addr learned my addr 172.21.15.82:0/3821370451 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf5698c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc71dc7640 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf5698feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc715c6640 1 -- 172.21.15.82:0/3821370451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 msgr2=0x55bf5698c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc715c6640 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf5698c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc715c6640 1 -- 172.21.15.82:0/3821370451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 msgr2=0x55bf5698feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc715c6640 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf5698feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc715c6640 1 -- 172.21.15.82:0/3821370451 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf56980820 con 0x55bf5697b0f0 2024-03-27T07:24:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf5698c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc71dc7640 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf5698feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:07.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc715c6640 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf56983f60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009900 tx=0x7fbc5c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976c8c69513cf9dd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc56ffd640 1 -- 172.21.15.82:0/3821370451 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c004300 con 0x55bf5697b0f0 2024-03-27T07:24:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc56ffd640 1 -- 172.21.15.82:0/3821370451 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc5c0044a0 con 0x55bf5697b0f0 2024-03-27T07:24:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.918+0000 7fbc56ffd640 1 -- 172.21.15.82:0/3821370451 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c005120 con 0x55bf5697b0f0 2024-03-27T07:24:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 -- 172.21.15.82:0/3821370451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 msgr2=0x55bf56983f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf56983f60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c009900 tx=0x7fbc5c005fd0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 -- 172.21.15.82:0/3821370451 shutdown_connections 2024-03-27T07:24:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf5698feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf5698c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 --2- 172.21.15.82:0/3821370451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf56983f60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 -- 172.21.15.82:0/3821370451 >> 172.21.15.82:0/3821370451 conn(0x55bf56975a10 msgr2=0x55bf56977680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 -- 172.21.15.82:0/3821370451 shutdown_connections 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 -- 172.21.15.82:0/3821370451 wait complete. 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 -- start start 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.919+0000 7fbc76412740 1 Processor -- start 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc76412740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf5697f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc76412740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf5697dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc76412740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf5697e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc76412740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1abd00 con 0x55bf5697b0f0 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc76412740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1ad170 con 0x55bf569847e0 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc76412740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6c1ac3d0 con 0x55bf5697ba10 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc76412740 10 client.0 _ll_register_callbacks cb 0x7fbc64009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:07.928 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc715c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf5697f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc715c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf5697f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55094/0 (socket says 172.21.15.82:55094) 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc715c6640 1 -- 172.21.15.82:0/1261901063 learned_addr learned my addr 172.21.15.82:0/1261901063 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf5697dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc71dc7640 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf5697e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc715c6640 1 -- 172.21.15.82:0/1261901063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 msgr2=0x55bf5697dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc715c6640 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf5697dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc715c6640 1 -- 172.21.15.82:0/1261901063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 msgr2=0x55bf5697e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc715c6640 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf5697e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc715c6640 1 -- 172.21.15.82:0/1261901063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf5697e820 con 0x55bf5697b0f0 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc715c6640 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf5697f4f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c02e010 tx=0x7fbc5c0042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941861c34915b077 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc54ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc54ff9640 1 -- 172.21.15.82:0/1261901063 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c058070 con 0x55bf5697b0f0 2024-03-27T07:24:07.929 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc54ff9640 1 -- 172.21.15.82:0/1261901063 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fbc5c0046c0 con 0x55bf5697b0f0 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.920+0000 7fbc76412740 1 -- 172.21.15.82:0/1261901063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc5c0044a0 con 0x55bf5697b0f0 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc54ff9640 1 -- 172.21.15.82:0/1261901063 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fbc5c0048c0 con 0x55bf5697b0f0 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc76412740 10 client.15549 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc76412740 1 -- 172.21.15.82:0/1261901063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55bf569ff750 con 0x55bf5697b0f0 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc54ff9640 1 -- 172.21.15.82:0/1261901063 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc5c0044a0 con 0x55bf5697b0f0 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc54ff9640 1 -- 172.21.15.82:0/1261901063 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fbc5c04b050 con 0x55bf5697b0f0 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc76412740 10 client.15549 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc76412740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc76412740 20 client.15549 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc76412740 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55bf569ffe40 0x55bf56a02260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc76412740 4 client.15549 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc76412740 1 -- 172.21.15.82:0/1261901063 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bf568e66e0 con 0x55bf569ffe40 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55bf569ffe40 0x55bf56a02260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:07.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc54ff9640 10 client.15549 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:07.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.921+0000 7fbc70dc5640 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55bf569ffe40 0x55bf56a02260 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea24bf347c7ae4fc server_cookie=a1ff3087e99c1106 in_seq=0 out_seq=0 2024-03-27T07:24:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc54ff9640 1 -- 172.21.15.82:0/1261901063 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bf568e66e0 con 0x55bf569ffe40 2024-03-27T07:24:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc54ff9640 10 client.15549 handle_command_reply: tid=0 2024-03-27T07:24:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 client.15549 shutdown 2024-03-27T07:24:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 -- 172.21.15.82:0/1261901063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 msgr2=0x55bf5697f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf5697f4f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c02e010 tx=0x7fbc5c0042e0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 -- 172.21.15.82:0/1261901063 shutdown_connections 2024-03-27T07:24:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bf569847e0 0x55bf5697e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bf5697ba10 0x55bf5697dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55bf569ffe40 0x55bf56a02260 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 --2- 172.21.15.82:0/1261901063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bf5697b0f0 0x55bf5697f4f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc54ff9640 0 client.15549 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 -- 172.21.15.82:0/1261901063 >> 172.21.15.82:0/1261901063 conn(0x55bf56975a10 msgr2=0x55bf569741e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 -- 172.21.15.82:0/1261901063 shutdown_connections 2024-03-27T07:24:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 1 -- 172.21.15.82:0/1261901063 wait complete. 2024-03-27T07:24:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.928+0000 7fbc76412740 20 client.15549 trim_cache size 0 max 16384 2024-03-27T07:24:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:24:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:24:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:24:07.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:24:07.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 -- 172.21.15.82:0/2620095943 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc580a3940 msgr2=0x7fbc580a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:07.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc580a3940 0x7fbc580a5e00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbc64005c40 tx=0x7fbc64009500 comp rx=0 tx=0).stop 2024-03-27T07:24:07.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 -- 172.21.15.82:0/2620095943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc6c1016f0 msgr2=0x7fbc6c1988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:07.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc6c1016f0 0x7fbc6c1988a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800e9f0 tx=0x7fbc6800eeb0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 -- 172.21.15.82:0/2620095943 shutdown_connections 2024-03-27T07:24:07.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbc580a3940 0x7fbc580a5e00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbc6c1016f0 0x7fbc6c1988a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc6c105ac0 0x7fbc6c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 --2- 172.21.15.82:0/2620095943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbc6c100d30 0x7fbc6c198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:07.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 -- 172.21.15.82:0/2620095943 >> 172.21.15.82:0/2620095943 conn(0x7fbc6c077830 msgr2=0x7fbc6c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:07.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 -- 172.21.15.82:0/2620095943 shutdown_connections 2024-03-27T07:24:07.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:07.929+0000 7fbc7382a640 1 -- 172.21.15.82:0/2620095943 wait complete. 2024-03-27T07:24:08.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:08 smithi153 ceph-mon[36179]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-03-27T07:24:08.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:08 smithi082 ceph-mon[32178]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-03-27T07:24:08.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:08 smithi149 ceph-mon[36065]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-03-27T07:24:10.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:24:10.374 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:24:10.404 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:10 smithi082 ceph-mon[32178]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-03-27T07:24:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.489+0000 7fa970bf7640 1 -- 172.21.15.82:0/1448021470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96c1036b0 msgr2=0x7fa96c10bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.489+0000 7fa970bf7640 1 --2- 172.21.15.82:0/1448021470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96c1036b0 0x7fa96c10bb90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa960009900 tx=0x7fa96002bcd0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.489+0000 7fa970bf7640 1 -- 172.21.15.82:0/1448021470 shutdown_connections 2024-03-27T07:24:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.489+0000 7fa970bf7640 1 --2- 172.21.15.82:0/1448021470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96c1036b0 0x7fa96c10bb90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.489+0000 7fa970bf7640 1 --2- 172.21.15.82:0/1448021470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa96c10c160 0x7fa96c10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.489+0000 7fa970bf7640 1 --2- 172.21.15.82:0/1448021470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa96c102d90 0x7fa96c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.489+0000 7fa970bf7640 1 -- 172.21.15.82:0/1448021470 >> 172.21.15.82:0/1448021470 conn(0x7fa96c076dd0 msgr2=0x7fa96c0771e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.490+0000 7fa970bf7640 1 -- 172.21.15.82:0/1448021470 shutdown_connections 2024-03-27T07:24:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.490+0000 7fa970bf7640 1 -- 172.21.15.82:0/1448021470 wait complete. 2024-03-27T07:24:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.490+0000 7fa970bf7640 1 Processor -- start 2024-03-27T07:24:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.490+0000 7fa970bf7640 1 -- start start 2024-03-27T07:24:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.490+0000 7fa970bf7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa96c102d90 0x7fa96c19a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.490+0000 7fa970bf7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa96c1036b0 0x7fa96c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.490+0000 7fa970bf7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96c10c160 0x7fa96c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa970bf7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c111ef0 con 0x7fa96c10c160 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa970bf7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c111d70 con 0x7fa96c1036b0 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa970bf7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c112070 con 0x7fa96c102d90 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96c10c160 0x7fa96c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa96c102d90 0x7fa96c19a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96c10c160 0x7fa96c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55110/0 (socket says 172.21.15.82:55110) 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa969d9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa96c1036b0 0x7fa96c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96ad9d640 1 -- 172.21.15.82:0/108653671 learned_addr learned my addr 172.21.15.82:0/108653671 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96ad9d640 1 -- 172.21.15.82:0/108653671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa96c102d90 msgr2=0x7fa96c19a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96ad9d640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa96c102d90 0x7fa96c19a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96ad9d640 1 -- 172.21.15.82:0/108653671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa96c1036b0 msgr2=0x7fa96c19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96ad9d640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa96c1036b0 0x7fa96c19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96ad9d640 1 -- 172.21.15.82:0/108653671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa96c19f640 con 0x7fa96c10c160 2024-03-27T07:24:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96a59c640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa96c102d90 0x7fa96c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa969d9b640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa96c1036b0 0x7fa96c19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa96ad9d640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96c10c160 0x7fa96c19ef10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa96400eb40 tx=0x7fa96400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa95b7fe640 1 -- 172.21.15.82:0/108653671 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964004b20 con 0x7fa96c10c160 2024-03-27T07:24:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa970bf7640 1 -- 172.21.15.82:0/108653671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa96c19f930 con 0x7fa96c10c160 2024-03-27T07:24:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa95b7fe640 1 -- 172.21.15.82:0/108653671 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa964004cc0 con 0x7fa96c10c160 2024-03-27T07:24:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa95b7fe640 1 -- 172.21.15.82:0/108653671 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa964010850 con 0x7fa96c10c160 2024-03-27T07:24:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.491+0000 7fa970bf7640 1 -- 172.21.15.82:0/108653671 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa96c1a71c0 con 0x7fa96c10c160 2024-03-27T07:24:10.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.494+0000 7fa95b7fe640 1 -- 172.21.15.82:0/108653671 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7fa964005020 con 0x7fa96c10c160 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.494+0000 7fa9737e4740 1 Processor -- start 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa9737e4740 1 -- start start 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91aa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91b3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa9737e4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563dd910e860 con 0x563dd91aa250 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa9737e4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563dd90b68d0 con 0x563dd91aab70 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa9737e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563dd910a810 con 0x563dd91b3750 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa969d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa969d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91aa630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55124/0 (socket says 172.21.15.82:55124) 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa969d9b640 1 -- 172.21.15.82:0/345931718 learned_addr learned my addr 172.21.15.82:0/345931718 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa95b7fe640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9540a38a0 0x7fa9540a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa96a59c640 1 --2- 172.21.15.82:0/345931718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa969d9b640 1 --2- 172.21.15.82:0/345931718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa96ad9d640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9540a38a0 0x7fa9540a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa96a59c640 1 -- 172.21.15.82:0/345931718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 msgr2=0x563dd91b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa96a59c640 1 --2- 172.21.15.82:0/345931718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa96a59c640 1 -- 172.21.15.82:0/345931718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 msgr2=0x563dd91aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa96a59c640 1 --2- 172.21.15.82:0/345931718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa96a59c640 1 -- 172.21.15.82:0/345931718 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd90c1120 con 0x563dd91aab70 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa969d9b640 1 --2- 172.21.15.82:0/345931718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.495+0000 7fa95b7fe640 1 -- 172.21.15.82:0/108653671 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa9640d0a70 con 0x7fa96c10c160 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.496+0000 7fa96a59c640 1 --2- 172.21.15.82:0/345931718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91b3210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009fd0 tx=0x7fa95c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e7c6b947b057df1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.496+0000 7fa96ad9d640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9540a38a0 0x7fa9540a5d60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9640ce0f0 tx=0x7fa964005620 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.496+0000 7fa958ff9640 1 -- 172.21.15.82:0/345931718 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c004030 con 0x563dd91aab70 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.496+0000 7fa958ff9640 1 -- 172.21.15.82:0/345931718 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95c005500 con 0x563dd91aab70 2024-03-27T07:24:10.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.496+0000 7fa958ff9640 1 -- 172.21.15.82:0/345931718 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95c004cc0 con 0x563dd91aab70 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.496+0000 7fa9737e4740 1 -- 172.21.15.82:0/345931718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 msgr2=0x563dd91b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.496+0000 7fa9737e4740 1 --2- 172.21.15.82:0/345931718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91b3210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009fd0 tx=0x7fa95c0118d0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 -- 172.21.15.82:0/345931718 shutdown_connections 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 --2- 172.21.15.82:0/345931718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 --2- 172.21.15.82:0/345931718 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91b3210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 --2- 172.21.15.82:0/345931718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 -- 172.21.15.82:0/345931718 >> 172.21.15.82:0/345931718 conn(0x563dd91a4980 msgr2=0x563dd91a4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 -- 172.21.15.82:0/345931718 shutdown_connections 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 -- 172.21.15.82:0/345931718 wait complete. 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 -- start start 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 Processor -- start 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563dd91b6540 con 0x563dd91aa250 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563dd90c9cd0 con 0x563dd91aab70 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563dd91b66c0 con 0x563dd91b3750 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa9737e4740 10 client.0 _ll_register_callbacks cb 0x563dd90bbee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa969d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa969d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55128/0 (socket says 172.21.15.82:55128) 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.497+0000 7fa969d9b640 1 -- 172.21.15.82:0/3657678864 learned_addr learned my addr 172.21.15.82:0/3657678864 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa96a59c640 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa969d9b640 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa969d9b640 1 -- 172.21.15.82:0/3657678864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 msgr2=0x563dd91b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa969d9b640 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa969d9b640 1 -- 172.21.15.82:0/3657678864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 msgr2=0x563dd91b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa969d9b640 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa969d9b640 1 -- 172.21.15.82:0/3657678864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd8eec7d0 con 0x563dd91aa250 2024-03-27T07:24:10.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa96a59c640 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa969d9b640 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b06e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa96002c210 tx=0x7fa960005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4961f18754e937e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa951ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa951ffb640 1 -- 172.21.15.82:0/3657678864 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960004f30 con 0x563dd91aa250 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa951ffb640 1 -- 172.21.15.82:0/3657678864 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa9600050d0 con 0x563dd91aa250 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa9737e4740 1 -- 172.21.15.82:0/3657678864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa95c005500 con 0x563dd91aa250 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa951ffb640 1 -- 172.21.15.82:0/3657678864 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa960055050 con 0x563dd91aa250 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa9737e4740 10 client.15561 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa9737e4740 1 -- 172.21.15.82:0/3657678864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563dd8e223f0 con 0x563dd91aa250 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.498+0000 7fa951ffb640 1 -- 172.21.15.82:0/3657678864 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa95c005500 con 0x563dd91aa250 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.499+0000 7fa951ffb640 1 -- 172.21.15.82:0/3657678864 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa96004e060 con 0x563dd91aa250 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.499+0000 7fa9737e4740 10 client.15561 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.499+0000 7fa9737e4740 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.499+0000 7fa9737e4740 20 client.15561 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.499+0000 7fa9737e4740 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563dd91c3a60 0x563dd91c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.499+0000 7fa9737e4740 4 client.15561 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.499+0000 7fa9737e4740 1 -- 172.21.15.82:0/3657678864 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dd911bda0 con 0x563dd91c3a60 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.499+0000 7fa96a59c640 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563dd91c3a60 0x563dd91c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.499+0000 7fa951ffb640 10 client.15561 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.499+0000 7fa96a59c640 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563dd91c3a60 0x563dd91c5e70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5097d6aefef6cf1 server_cookie=1e4c5d10d5b2faa5 in_seq=0 out_seq=0 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa951ffb640 1 -- 172.21.15.82:0/3657678864 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x563dd911bda0 con 0x563dd91c3a60 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa951ffb640 10 client.15561 handle_command_reply: tid=0 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa9737e4740 1 client.15561 shutdown 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa9737e4740 1 -- 172.21.15.82:0/3657678864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 msgr2=0x563dd91b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa9737e4740 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b06e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa96002c210 tx=0x7fa960005b70 comp rx=0 tx=0).stop 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa9737e4740 1 -- 172.21.15.82:0/3657678864 shutdown_connections 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa9737e4740 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa9737e4740 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa9737e4740 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563dd91c3a60 0x563dd91c5e70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa9737e4740 1 --2- 172.21.15.82:0/3657678864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b06e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa951ffb640 0 client.15561 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.500+0000 7fa9737e4740 1 -- 172.21.15.82:0/3657678864 >> 172.21.15.82:0/3657678864 conn(0x563dd91a4980 msgr2=0x563dd91a66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.501+0000 7fa9737e4740 1 -- 172.21.15.82:0/3657678864 shutdown_connections 2024-03-27T07:24:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.501+0000 7fa9737e4740 1 -- 172.21.15.82:0/3657678864 wait complete. 2024-03-27T07:24:10.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.501+0000 7fa9737e4740 20 client.15561 trim_cache size 0 max 16384 2024-03-27T07:24:10.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:10 smithi149 ceph-mon[36065]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-03-27T07:24:10.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa9737e4740 1 Processor -- start 2024-03-27T07:24:10.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa9737e4740 1 -- start start 2024-03-27T07:24:10.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91aab70 0x563dd91af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91b3750 0x563dd91bf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa9737e4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1b2210 con 0x563dd91aa250 2024-03-27T07:24:10.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa9737e4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1afae0 con 0x563dd91b3750 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa9737e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1ad930 con 0x563dd91aab70 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa969d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa969d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55134/0 (socket says 172.21.15.82:55134) 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa969d9b640 1 -- 172.21.15.82:0/2543916203 learned_addr learned my addr 172.21.15.82:0/2543916203 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa96a59c640 1 --2- 172.21.15.82:0/2543916203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91aab70 0x563dd91af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa969d9b640 1 --2- 172.21.15.82:0/2543916203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91b3750 0x563dd91bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa969d9b640 1 -- 172.21.15.82:0/2543916203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91aab70 msgr2=0x563dd91af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa969d9b640 1 --2- 172.21.15.82:0/2543916203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91aab70 0x563dd91af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa969d9b640 1 -- 172.21.15.82:0/2543916203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91b3750 msgr2=0x563dd91bf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa969d9b640 1 --2- 172.21.15.82:0/2543916203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91b3750 0x563dd91bf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa969d9b640 1 -- 172.21.15.82:0/2543916203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd8de20f0 con 0x563dd91aa250 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa96a59c640 1 --2- 172.21.15.82:0/2543916203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91aab70 0x563dd91af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:10.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa969d9b640 1 --2- 172.21.15.82:0/2543916203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b2e10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa960001eb0 tx=0x7fa96002bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717ab7df999241c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.518+0000 7fa953fff640 1 -- 172.21.15.82:0/2543916203 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960000e60 con 0x563dd91aa250 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa953fff640 1 -- 172.21.15.82:0/2543916203 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa960003ad0 con 0x563dd91aa250 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa953fff640 1 -- 172.21.15.82:0/2543916203 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960045040 con 0x563dd91aa250 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 -- 172.21.15.82:0/2543916203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 msgr2=0x563dd91b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 --2- 172.21.15.82:0/2543916203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b2e10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fa960001eb0 tx=0x7fa96002bcd0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 -- 172.21.15.82:0/2543916203 shutdown_connections 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 --2- 172.21.15.82:0/2543916203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91b3750 0x563dd91bf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 --2- 172.21.15.82:0/2543916203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91aab70 0x563dd91af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 --2- 172.21.15.82:0/2543916203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91b2e10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 -- 172.21.15.82:0/2543916203 >> 172.21.15.82:0/2543916203 conn(0x563dd91a4980 msgr2=0x563dd91b06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 -- 172.21.15.82:0/2543916203 shutdown_connections 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 -- 172.21.15.82:0/2543916203 wait complete. 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 -- start start 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.519+0000 7fa9737e4740 1 Processor -- start 2024-03-27T07:24:10.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91ac970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa9737e4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa9737e4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1adfa0 con 0x563dd91aa250 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa9737e4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1af410 con 0x563dd91aab70 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa9737e4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa96c1ae670 con 0x563dd91b3750 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa9737e4740 10 client.0 _ll_register_callbacks cb 0x7fa96002cd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa969d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa969d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55140/0 (socket says 172.21.15.82:55140) 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa969d9b640 1 -- 172.21.15.82:0/1345411483 learned_addr learned my addr 172.21.15.82:0/1345411483 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa96a59c640 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa969d9b640 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa969d9b640 1 -- 172.21.15.82:0/1345411483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 msgr2=0x563dd91aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa969d9b640 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa969d9b640 1 -- 172.21.15.82:0/1345411483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 msgr2=0x563dd91ac970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa969d9b640 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91ac970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa969d9b640 1 -- 172.21.15.82:0/1345411483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd91ae450 con 0x563dd91aa250 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa96a59c640 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91ac970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa969d9b640 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91adf10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa9600045c0 tx=0x7fa960009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489b087e522a3f7e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa951ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa951ffb640 1 -- 172.21.15.82:0/1345411483 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960003800 con 0x563dd91aa250 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa951ffb640 1 -- 172.21.15.82:0/1345411483 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa960034790 con 0x563dd91aa250 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.520+0000 7fa9737e4740 1 -- 172.21.15.82:0/1345411483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa960003ad0 con 0x563dd91aa250 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa951ffb640 1 -- 172.21.15.82:0/1345411483 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa960034990 con 0x563dd91aa250 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa9737e4740 10 client.15567 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa9737e4740 1 -- 172.21.15.82:0/1345411483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563dd9229560 con 0x563dd91aa250 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa951ffb640 1 -- 172.21.15.82:0/1345411483 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa960003ad0 con 0x563dd91aa250 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa951ffb640 1 -- 172.21.15.82:0/1345411483 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa96004e040 con 0x563dd91aa250 2024-03-27T07:24:10.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa9737e4740 10 client.15567 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa9737e4740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa9737e4740 20 client.15567 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa9737e4740 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563dd9229b10 0x563dd922bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa9737e4740 4 client.15567 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:24:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa9737e4740 1 -- 172.21.15.82:0/1345411483 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563dd91160f0 con 0x563dd9229b10 2024-03-27T07:24:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa96a59c640 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563dd9229b10 0x563dd922bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa96a59c640 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563dd9229b10 0x563dd922bf30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e380db7cb393e2fc server_cookie=bfcc9b7a24b772d7 in_seq=0 out_seq=0 2024-03-27T07:24:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.521+0000 7fa951ffb640 10 client.15567 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:10.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa951ffb640 1 -- 172.21.15.82:0/1345411483 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563dd91160f0 con 0x563dd9229b10 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa951ffb640 10 client.15567 handle_command_reply: tid=0 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 client.15567 shutdown 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 -- 172.21.15.82:0/1345411483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 msgr2=0x563dd91adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91adf10 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa9600045c0 tx=0x7fa960009830 comp rx=0 tx=0).stop 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 -- 172.21.15.82:0/1345411483 shutdown_connections 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563dd91b3750 0x563dd91aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563dd91aab70 0x563dd91ac970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563dd9229b10 0x563dd922bf30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 --2- 172.21.15.82:0/1345411483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563dd91aa250 0x563dd91adf10 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 -- 172.21.15.82:0/1345411483 >> 172.21.15.82:0/1345411483 conn(0x563dd91a4980 msgr2=0x563dd91b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa951ffb640 0 client.15567 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 -- 172.21.15.82:0/1345411483 shutdown_connections 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 1 -- 172.21.15.82:0/1345411483 wait complete. 2024-03-27T07:24:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa9737e4740 20 client.15567 trim_cache size 0 max 16384 2024-03-27T07:24:10.532 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:24:10.532 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-03-27T07:24:10.532 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-03-27T07:24:10.532 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 -- 172.21.15.82:0/108653671 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9540a38a0 msgr2=0x7fa9540a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9540a38a0 0x7fa9540a5d60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9640ce0f0 tx=0x7fa964005620 comp rx=0 tx=0).stop 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 -- 172.21.15.82:0/108653671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96c10c160 msgr2=0x7fa96c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96c10c160 0x7fa96c19ef10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa96400eb40 tx=0x7fa96400c2d0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 -- 172.21.15.82:0/108653671 shutdown_connections 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9540a38a0 0x7fa9540a5d60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa96c10c160 0x7fa96c19ef10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa96c1036b0 0x7fa96c19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 --2- 172.21.15.82:0/108653671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa96c102d90 0x7fa96c19a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 -- 172.21.15.82:0/108653671 >> 172.21.15.82:0/108653671 conn(0x7fa96c076dd0 msgr2=0x7fa96c0ff720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:10.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.522+0000 7fa970bf7640 1 -- 172.21.15.82:0/108653671 shutdown_connections 2024-03-27T07:24:10.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.523+0000 7fa970bf7640 1 -- 172.21.15.82:0/108653671 wait complete. 2024-03-27T07:24:10.535 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T07:24:10.535 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:24:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:10 smithi153 ceph-mon[36179]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-03-27T07:24:10.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.674+0000 7f1357de2640 1 -- 172.21.15.82:0/880202850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13501024a0 msgr2=0x7f135010e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.674+0000 7f1357de2640 1 --2- 172.21.15.82:0/880202850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13501024a0 0x7f135010e9b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f134c009cd0 tx=0x7f134c02c0f0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.674+0000 7f1357de2640 1 -- 172.21.15.82:0/880202850 shutdown_connections 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.674+0000 7f1357de2640 1 --2- 172.21.15.82:0/880202850 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13501024a0 0x7f135010e9b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.674+0000 7f1357de2640 1 --2- 172.21.15.82:0/880202850 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1350101ae0 0x7f1350101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.674+0000 7f1357de2640 1 --2- 172.21.15.82:0/880202850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1350107b80 0x7f1350107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.674+0000 7f1357de2640 1 -- 172.21.15.82:0/880202850 >> 172.21.15.82:0/880202850 conn(0x7f13500fd5f0 msgr2=0x7f13500ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.674+0000 7f1357de2640 1 -- 172.21.15.82:0/880202850 shutdown_connections 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.674+0000 7f1357de2640 1 -- 172.21.15.82:0/880202850 wait complete. 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1357de2640 1 Processor -- start 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1357de2640 1 -- start start 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1357de2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1350101ae0 0x7f13501983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1357de2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13501024a0 0x7f13501988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1357de2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1350107b80 0x7f135019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1357de2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1350111f00 con 0x7f1350101ae0 2024-03-27T07:24:10.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1357de2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1350111d80 con 0x7f1350107b80 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1357de2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1350112080 con 0x7f13501024a0 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1355b7e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1350101ae0 0x7f13501983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1355b7e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1350101ae0 0x7f13501983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55152/0 (socket says 172.21.15.82:55152) 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1355b7e640 1 -- 172.21.15.82:0/1058198321 learned_addr learned my addr 172.21.15.82:0/1058198321 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f135537d640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13501024a0 0x7f13501988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f135637f640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1350107b80 0x7f135019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1355b7e640 1 -- 172.21.15.82:0/1058198321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13501024a0 msgr2=0x7f13501988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1355b7e640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13501024a0 0x7f13501988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1355b7e640 1 -- 172.21.15.82:0/1058198321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1350107b80 msgr2=0x7f135019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1355b7e640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1350107b80 0x7f135019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1355b7e640 1 -- 172.21.15.82:0/1058198321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135019d390 con 0x7f1350101ae0 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1355b7e640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1350101ae0 0x7f13501983a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f134800e9f0 tx=0x7f134800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1346ffd640 1 -- 172.21.15.82:0/1058198321 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134800cd80 con 0x7f1350101ae0 2024-03-27T07:24:10.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.675+0000 7f1346ffd640 1 -- 172.21.15.82:0/1058198321 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1348005500 con 0x7f1350101ae0 2024-03-27T07:24:10.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.676+0000 7f1346ffd640 1 -- 172.21.15.82:0/1058198321 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1348010690 con 0x7f1350101ae0 2024-03-27T07:24:10.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.676+0000 7f1357de2640 1 -- 172.21.15.82:0/1058198321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135019d680 con 0x7f1350101ae0 2024-03-27T07:24:10.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.676+0000 7f1357de2640 1 -- 172.21.15.82:0/1058198321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13501a4f10 con 0x7f1350101ae0 2024-03-27T07:24:10.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.676+0000 7f1357de2640 1 -- 172.21.15.82:0/1058198321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1350068d90 con 0x7f1350101ae0 2024-03-27T07:24:10.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.677+0000 7f1346ffd640 1 -- 172.21.15.82:0/1058198321 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7f13480046c0 con 0x7f1350101ae0 2024-03-27T07:24:10.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.678+0000 7f1346ffd640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f133c0a38a0 0x7f133c0a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:10.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.678+0000 7f135537d640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f133c0a38a0 0x7f133c0a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:10.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.678+0000 7f1346ffd640 1 -- 172.21.15.82:0/1058198321 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f13480d0720 con 0x7f1350101ae0 2024-03-27T07:24:10.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.679+0000 7f135537d640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f133c0a38a0 0x7f133c0a5d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13500ffc10 tx=0x7f1340005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:10.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.683+0000 7f1346ffd640 1 -- 172.21.15.82:0/1058198321 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f134809cdb0 con 0x7f1350101ae0 2024-03-27T07:24:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.894+0000 7f1357de2640 1 -- 172.21.15.82:0/1058198321 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13501996f0 con 0x7f1350101ae0 2024-03-27T07:24:10.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.895+0000 7f1346ffd640 1 -- 172.21.15.82:0/1058198321 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11860 (secure 0 0 0) 0x7f134809c6b0 con 0x7f1350101ae0 2024-03-27T07:24:10.897 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:24:10.898 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:23:33.807990+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:24:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-03-27T07:24:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 -- 172.21.15.82:0/1058198321 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f133c0a38a0 msgr2=0x7f133c0a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f133c0a38a0 0x7f133c0a5d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13500ffc10 tx=0x7f1340005f90 comp rx=0 tx=0).stop 2024-03-27T07:24:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 -- 172.21.15.82:0/1058198321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1350101ae0 msgr2=0x7f13501983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1350101ae0 0x7f13501983a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f134800e9f0 tx=0x7f134800edf0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 -- 172.21.15.82:0/1058198321 shutdown_connections 2024-03-27T07:24:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f133c0a38a0 0x7f133c0a5d60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1350107b80 0x7f135019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13501024a0 0x7f13501988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 --2- 172.21.15.82:0/1058198321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1350101ae0 0x7f13501983a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 -- 172.21.15.82:0/1058198321 >> 172.21.15.82:0/1058198321 conn(0x7f13500fd5f0 msgr2=0x7f13500fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 -- 172.21.15.82:0/1058198321 shutdown_connections 2024-03-27T07:24:10.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:10.897+0000 7f1357de2640 1 -- 172.21.15.82:0/1058198321 wait complete. 2024-03-27T07:24:10.910 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T07:24:11.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.014+0000 7f8f32135640 1 -- 172.21.15.82:0/954386076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f2c100a70 msgr2=0x7f8f2c100ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.014+0000 7f8f32135640 1 --2- 172.21.15.82:0/954386076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f2c100a70 0x7f8f2c100ef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8f20009890 tx=0x7f8f2002bb70 comp rx=0 tx=0).stop 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.014+0000 7f8f32135640 1 -- 172.21.15.82:0/954386076 shutdown_connections 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.014+0000 7f8f32135640 1 --2- 172.21.15.82:0/954386076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c101430 0x7f8f2c10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.014+0000 7f8f32135640 1 --2- 172.21.15.82:0/954386076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f2c100a70 0x7f8f2c100ef0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.014+0000 7f8f32135640 1 --2- 172.21.15.82:0/954386076 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f2c106a80 0x7f8f2c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.014+0000 7f8f32135640 1 -- 172.21.15.82:0/954386076 >> 172.21.15.82:0/954386076 conn(0x7f8f2c077bb0 msgr2=0x7f8f2c077fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.014+0000 7f8f32135640 1 -- 172.21.15.82:0/954386076 shutdown_connections 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.014+0000 7f8f32135640 1 -- 172.21.15.82:0/954386076 wait complete. 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f32135640 1 Processor -- start 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f32135640 1 -- start start 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f32135640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f2c100a70 0x7f8f2c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f32135640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f2c101430 0x7f8f2c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f32135640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c106a80 0x7f8f2c19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f32135640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c110e90 con 0x7f8f2c106a80 2024-03-27T07:24:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f32135640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c110d10 con 0x7f8f2c100a70 2024-03-27T07:24:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f32135640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c111010 con 0x7f8f2c101430 2024-03-27T07:24:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c106a80 0x7f8f2c19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c106a80 0x7f8f2c19cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55176/0 (socket says 172.21.15.82:55176) 2024-03-27T07:24:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f2bfff640 1 -- 172.21.15.82:0/1152895635 learned_addr learned my addr 172.21.15.82:0/1152895635 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f2affd640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f2c101430 0x7f8f2c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f2c100a70 0x7f8f2c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f2bfff640 1 -- 172.21.15.82:0/1152895635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f2c101430 msgr2=0x7f8f2c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f2bfff640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f2c101430 0x7f8f2c1989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f2bfff640 1 -- 172.21.15.82:0/1152895635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f2c100a70 msgr2=0x7f8f2c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f2bfff640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f2c100a70 0x7f8f2c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.015+0000 7f8f2bfff640 1 -- 172.21.15.82:0/1152895635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2c19d4a0 con 0x7f8f2c106a80 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.016+0000 7f8f2bfff640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c106a80 0x7f8f2c19cd70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400efc0 tx=0x7f8f2400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.016+0000 7f8f28ff9640 1 -- 172.21.15.82:0/1152895635 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24003970 con 0x7f8f2c106a80 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.016+0000 7f8f32135640 1 -- 172.21.15.82:0/1152895635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2c19d790 con 0x7f8f2c106a80 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.016+0000 7f8f28ff9640 1 -- 172.21.15.82:0/1152895635 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f24004020 con 0x7f8f2c106a80 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.016+0000 7f8f28ff9640 1 -- 172.21.15.82:0/1152895635 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400b9d0 con 0x7f8f2c106a80 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.016+0000 7f8f32135640 1 -- 172.21.15.82:0/1152895635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2c1a5020 con 0x7f8f2c106a80 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.018+0000 7f8f28ff9640 1 -- 172.21.15.82:0/1152895635 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7f8f2401d020 con 0x7f8f2c106a80 2024-03-27T07:24:11.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.018+0000 7f8f34df5740 1 Processor -- start 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.018+0000 7f8f34df5740 1 -- start start 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f28ff9640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8f140a38a0 0x7f8f140a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db3db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db46770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db490a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f34df5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56380daa1710 con 0x56380db3e0d0 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f34df5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56380da49af0 con 0x56380db46cb0 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f34df5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56380da9d6c0 con 0x56380db3d7b0 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2affd640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8f140a38a0 0x7f8f140a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db3db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db3db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:51762/0 (socket says 172.21.15.82:51762) 2024-03-27T07:24:11.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2b7fe640 1 -- 172.21.15.82:0/689412195 learned_addr learned my addr 172.21.15.82:0/689412195 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2affd640 1 --2- 172.21.15.82:0/689412195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db46770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f28ff9640 1 -- 172.21.15.82:0/1152895635 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f8f240d01e0 con 0x7f8f2c106a80 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2b7fe640 1 -- 172.21.15.82:0/689412195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 msgr2=0x56380db490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/689412195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2b7fe640 1 -- 172.21.15.82:0/689412195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 msgr2=0x56380db46770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/689412195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db46770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2b7fe640 1 -- 172.21.15.82:0/689412195 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56380d7b53f0 con 0x56380db3d7b0 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2bfff640 1 --2- 172.21.15.82:0/689412195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2affd640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8f140a38a0 0x7f8f140a5d60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f200097b0 tx=0x7f8f200323c0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/689412195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db3db90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009c70 tx=0x7f8f1c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c48a01636ebe3cc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.019+0000 7f8f11ffb640 1 -- 172.21.15.82:0/689412195 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c004230 con 0x56380db3d7b0 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f11ffb640 1 -- 172.21.15.82:0/689412195 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f1c0043d0 con 0x56380db3d7b0 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f11ffb640 1 -- 172.21.15.82:0/689412195 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c019760 con 0x56380db3d7b0 2024-03-27T07:24:11.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f34df5740 1 -- 172.21.15.82:0/689412195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 msgr2=0x56380db3db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f34df5740 1 --2- 172.21.15.82:0/689412195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db3db90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c009c70 tx=0x7f8f1c011810 comp rx=0 tx=0).stop 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f34df5740 1 -- 172.21.15.82:0/689412195 shutdown_connections 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f34df5740 1 --2- 172.21.15.82:0/689412195 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db46770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f34df5740 1 --2- 172.21.15.82:0/689412195 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f34df5740 1 --2- 172.21.15.82:0/689412195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db3db90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f34df5740 1 -- 172.21.15.82:0/689412195 >> 172.21.15.82:0/689412195 conn(0x56380db37ee0 msgr2=0x56380db382c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f34df5740 1 -- 172.21.15.82:0/689412195 shutdown_connections 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.020+0000 7f8f34df5740 1 -- 172.21.15.82:0/689412195 wait complete. 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f34df5740 1 -- start start 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f34df5740 1 Processor -- start 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db43c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f34df5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56380db49aa0 con 0x56380db3e0d0 2024-03-27T07:24:11.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f34df5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56380da5ceb0 con 0x56380db46cb0 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f34df5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56380db49c20 con 0x56380db3d7b0 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f34df5740 10 client.0 _ll_register_callbacks cb 0x56380da996a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db43c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db441a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55196/0 (socket says 172.21.15.82:55196) 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2affd640 1 -- 172.21.15.82:0/2319962786 learned_addr learned my addr 172.21.15.82:0/2319962786 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2bfff640 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2affd640 1 -- 172.21.15.82:0/2319962786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 msgr2=0x56380db43c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2affd640 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db43c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2affd640 1 -- 172.21.15.82:0/2319962786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 msgr2=0x56380db446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2affd640 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db446e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2affd640 1 -- 172.21.15.82:0/2319962786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56380d87f7d0 con 0x56380db3e0d0 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.021+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db43c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f2affd640 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db441a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8f20005e00 tx=0x7f8f200058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddfb3eadbbe12e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f0affd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f0affd640 1 -- 172.21.15.82:0/2319962786 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20053060 con 0x56380db3e0d0 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f0affd640 1 -- 172.21.15.82:0/2319962786 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f8f2002c510 con 0x56380db3e0d0 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f34df5740 1 -- 172.21.15.82:0/2319962786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f1c0043d0 con 0x56380db3e0d0 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f0affd640 1 -- 172.21.15.82:0/2319962786 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8f20039040 con 0x56380db3e0d0 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f34df5740 10 client.15585 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f34df5740 1 -- 172.21.15.82:0/2319962786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56380db55cc0 con 0x56380db3e0d0 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f0affd640 1 -- 172.21.15.82:0/2319962786 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f1c0043d0 con 0x56380db3e0d0 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f0affd640 1 -- 172.21.15.82:0/2319962786 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f8f2003f040 con 0x56380db3e0d0 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f34df5740 10 client.15585 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f34df5740 10 client.15585 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:24:11.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f34df5740 20 client.15585 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f34df5740 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56380db57180 0x56380db595b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f34df5740 4 client.15585 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.022+0000 7f8f34df5740 1 -- 172.21.15.82:0/2319962786 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56380daaec50 con 0x56380db57180 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.023+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56380db57180 0x56380db595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.023+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56380db57180 0x56380db595b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a63311b62cfae5b server_cookie=91feaa1d04ac64ae in_seq=0 out_seq=0 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.023+0000 7f8f0affd640 10 client.15585 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f0affd640 1 -- 172.21.15.82:0/2319962786 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56380daaec50 con 0x56380db57180 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f0affd640 10 client.15585 handle_command_reply: tid=0 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 client.15585 shutdown 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 -- 172.21.15.82:0/2319962786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 msgr2=0x56380db441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db441a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8f20005e00 tx=0x7f8f200058d0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 -- 172.21.15.82:0/2319962786 shutdown_connections 2024-03-27T07:24:11.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56380db57180 0x56380db595b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db441a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f0affd640 0 client.15585 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:24:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 --2- 172.21.15.82:0/2319962786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db43c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 -- 172.21.15.82:0/2319962786 >> 172.21.15.82:0/2319962786 conn(0x56380db37ee0 msgr2=0x56380db39c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 -- 172.21.15.82:0/2319962786 shutdown_connections 2024-03-27T07:24:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 1 -- 172.21.15.82:0/2319962786 wait complete. 2024-03-27T07:24:11.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.024+0000 7f8f34df5740 20 client.15585 trim_cache size 0 max 16384 2024-03-27T07:24:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f34df5740 1 Processor -- start 2024-03-27T07:24:11.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f34df5740 1 -- start start 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db46390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db52840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db36e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f34df5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1b0040 con 0x56380db3e0d0 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f34df5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1ad910 con 0x56380db46cb0 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f34df5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1ab780 con 0x56380db3d7b0 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f2affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db52840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f2affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db52840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55212/0 (socket says 172.21.15.82:55212) 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f2affd640 1 -- 172.21.15.82:0/2376791243 learned_addr learned my addr 172.21.15.82:0/2376791243 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/2376791243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db46390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f2bfff640 1 --2- 172.21.15.82:0/2376791243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db36e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f2affd640 1 -- 172.21.15.82:0/2376791243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 msgr2=0x56380db46390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f2affd640 1 --2- 172.21.15.82:0/2376791243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db46390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f2affd640 1 -- 172.21.15.82:0/2376791243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 msgr2=0x56380db36e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.037+0000 7f8f2affd640 1 --2- 172.21.15.82:0/2376791243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db36e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f2affd640 1 -- 172.21.15.82:0/2376791243 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56380db37d10 con 0x56380db3e0d0 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f2affd640 1 --2- 172.21.15.82:0/2376791243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db52840 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8f200057c0 tx=0x7f8f20005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2b3313f5a37115 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f117fa640 1 -- 172.21.15.82:0/2376791243 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20053050 con 0x56380db3e0d0 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f117fa640 1 -- 172.21.15.82:0/2376791243 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f20032640 con 0x56380db3e0d0 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f117fa640 1 -- 172.21.15.82:0/2376791243 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20032b20 con 0x56380db3e0d0 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f34df5740 1 -- 172.21.15.82:0/2376791243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 msgr2=0x56380db52840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f34df5740 1 --2- 172.21.15.82:0/2376791243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db52840 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8f200057c0 tx=0x7f8f20005940 comp rx=0 tx=0).stop 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f34df5740 1 -- 172.21.15.82:0/2376791243 shutdown_connections 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f34df5740 1 --2- 172.21.15.82:0/2376791243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3e0d0 0x56380db52840 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f34df5740 1 --2- 172.21.15.82:0/2376791243 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380db36e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f34df5740 1 --2- 172.21.15.82:0/2376791243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3d7b0 0x56380db46390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f34df5740 1 -- 172.21.15.82:0/2376791243 >> 172.21.15.82:0/2376791243 conn(0x56380db37ee0 msgr2=0x56380db36770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f34df5740 1 -- 172.21.15.82:0/2376791243 shutdown_connections 2024-03-27T07:24:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.038+0000 7f8f34df5740 1 -- 172.21.15.82:0/2376791243 wait complete. 2024-03-27T07:24:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f34df5740 1 -- start start 2024-03-27T07:24:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f34df5740 1 Processor -- start 2024-03-27T07:24:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3d7b0 0x56380db40ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3e0d0 0x56380db41410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f34df5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380dbbc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f34df5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1abdd0 con 0x56380db3d7b0 2024-03-27T07:24:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f34df5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1ad240 con 0x56380db46cb0 2024-03-27T07:24:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f34df5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2c1ac4a0 con 0x56380db3e0d0 2024-03-27T07:24:11.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f34df5740 10 client.0 _ll_register_callbacks cb 0x7f8f1c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3d7b0 0x56380db40ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f2b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3d7b0 0x56380db40ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55214/0 (socket says 172.21.15.82:55214) 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f2b7fe640 1 -- 172.21.15.82:0/3009258732 learned_addr learned my addr 172.21.15.82:0/3009258732 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f2affd640 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3e0d0 0x56380db41410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.039+0000 7f8f2bfff640 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380dbbc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f2b7fe640 1 -- 172.21.15.82:0/3009258732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3e0d0 msgr2=0x56380db41410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3e0d0 0x56380db41410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f2b7fe640 1 -- 172.21.15.82:0/3009258732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 msgr2=0x56380dbbc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380dbbc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f2b7fe640 1 -- 172.21.15.82:0/3009258732 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56380db490a0 con 0x56380db3d7b0 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f2b7fe640 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3d7b0 0x56380db40ed0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c003ef0 tx=0x7f8f1c0193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1478268966a92dd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f0affd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:11.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f0affd640 1 -- 172.21.15.82:0/3009258732 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c034060 con 0x56380db3d7b0 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f0affd640 1 -- 172.21.15.82:0/3009258732 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f8f1c005380 con 0x56380db3d7b0 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f34df5740 1 -- 172.21.15.82:0/3009258732 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f20032640 con 0x56380db3d7b0 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f0affd640 1 -- 172.21.15.82:0/3009258732 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f8f1c005610 con 0x56380db3d7b0 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f34df5740 10 client.15591 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f34df5740 1 -- 172.21.15.82:0/3009258732 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56380dbbda90 con 0x56380db3d7b0 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.040+0000 7f8f0affd640 1 -- 172.21.15.82:0/3009258732 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f20032640 con 0x56380db3d7b0 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f0affd640 1 -- 172.21.15.82:0/3009258732 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f8f1c018070 con 0x56380db3d7b0 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f34df5740 10 client.15591 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f34df5740 10 client.15591 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f34df5740 20 client.15591 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f34df5740 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56380dbbe020 0x56380dbc0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f34df5740 4 client.15591 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f34df5740 1 -- 172.21.15.82:0/3009258732 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56380daa8fa0 con 0x56380dbbe020 2024-03-27T07:24:11.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f2affd640 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56380dbbe020 0x56380dbc0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f2affd640 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56380dbbe020 0x56380dbc0410 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=61d66554fdd5762c server_cookie=2ef01f2cf15dbd74 in_seq=0 out_seq=0 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f0affd640 10 client.15591 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f0affd640 1 -- 172.21.15.82:0/3009258732 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56380daa8fa0 con 0x56380dbbe020 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f0affd640 10 client.15591 handle_command_reply: tid=0 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.041+0000 7f8f34df5740 1 client.15591 shutdown 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 1 -- 172.21.15.82:0/3009258732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3d7b0 msgr2=0x56380db40ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3d7b0 0x56380db40ed0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c003ef0 tx=0x7f8f1c0193e0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 1 -- 172.21.15.82:0/3009258732 shutdown_connections 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56380dbbe020 0x56380dbc0410 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56380db46cb0 0x56380dbbc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56380db3e0d0 0x56380db41410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f0affd640 0 client.15591 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 1 --2- 172.21.15.82:0/3009258732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56380db3d7b0 0x56380db40ed0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 1 -- 172.21.15.82:0/3009258732 >> 172.21.15.82:0/3009258732 conn(0x56380db37ee0 msgr2=0x56380db37000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 1 -- 172.21.15.82:0/3009258732 shutdown_connections 2024-03-27T07:24:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 1 -- 172.21.15.82:0/3009258732 wait complete. 2024-03-27T07:24:11.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f34df5740 20 client.15591 trim_cache size 0 max 16384 2024-03-27T07:24:11.054 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 -- 172.21.15.82:0/1152895635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8f140a38a0 msgr2=0x7f8f140a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8f140a38a0 0x7f8f140a5d60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8f200097b0 tx=0x7f8f200323c0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 -- 172.21.15.82:0/1152895635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c106a80 msgr2=0x7f8f2c19cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c106a80 0x7f8f2c19cd70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400efc0 tx=0x7f8f2400c800 comp rx=0 tx=0).stop 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 -- 172.21.15.82:0/1152895635 shutdown_connections 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8f140a38a0 0x7f8f140a5d60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f2c106a80 0x7f8f2c19cd70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f2c101430 0x7f8f2c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 --2- 172.21.15.82:0/1152895635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8f2c100a70 0x7f8f2c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 -- 172.21.15.82:0/1152895635 >> 172.21.15.82:0/1152895635 conn(0x7f8f2c077bb0 msgr2=0x7f8f2c06a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 -- 172.21.15.82:0/1152895635 shutdown_connections 2024-03-27T07:24:11.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.042+0000 7f8f32135640 1 -- 172.21.15.82:0/1152895635 wait complete. 2024-03-27T07:24:11.057 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T07:24:11.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 -- 172.21.15.82:0/1491078656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b0101380 msgr2=0x7f40b010d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 --2- 172.21.15.82:0/1491078656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b0101380 0x7f40b010d890 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009cd0 tx=0x7f40a802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 -- 172.21.15.82:0/1491078656 shutdown_connections 2024-03-27T07:24:11.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 --2- 172.21.15.82:0/1491078656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b0101380 0x7f40b010d890 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 --2- 172.21.15.82:0/1491078656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b01009c0 0x7f40b0100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 --2- 172.21.15.82:0/1491078656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40b01069d0 0x7f40b0106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 -- 172.21.15.82:0/1491078656 >> 172.21.15.82:0/1491078656 conn(0x7f40b0077b50 msgr2=0x7f40b0077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 -- 172.21.15.82:0/1491078656 shutdown_connections 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 -- 172.21.15.82:0/1491078656 wait complete. 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 Processor -- start 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.159+0000 7f40b8640640 1 -- start start 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b8640640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b01009c0 0x7f40b01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b8640640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40b0101380 0x7f40b0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b8640640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b01069d0 0x7f40b019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b8640640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f40b0110de0 con 0x7f40b01009c0 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b8640640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f40b0110c60 con 0x7f40b01069d0 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b8640640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40b0110f60 con 0x7f40b0101380 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b63dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b01009c0 0x7f40b01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b63dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b01009c0 0x7f40b01983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55236/0 (socket says 172.21.15.82:55236) 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b63dc640 1 -- 172.21.15.82:0/3809220395 learned_addr learned my addr 172.21.15.82:0/3809220395 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b01069d0 0x7f40b019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40b0101380 0x7f40b0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b63dc640 1 -- 172.21.15.82:0/3809220395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40b0101380 msgr2=0x7f40b0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b63dc640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40b0101380 0x7f40b0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b63dc640 1 -- 172.21.15.82:0/3809220395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b01069d0 msgr2=0x7f40b019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b63dc640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b01069d0 0x7f40b019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b63dc640 1 -- 172.21.15.82:0/3809220395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b019d3c0 con 0x7f40b01009c0 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b63dc640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b01009c0 0x7f40b01983d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00e9f0 tx=0x7f40ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40a77fe640 1 -- 172.21.15.82:0/3809220395 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00cd80 con 0x7f40b01009c0 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40a77fe640 1 -- 172.21.15.82:0/3809220395 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40ac005500 con 0x7f40b01009c0 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b8640640 1 -- 172.21.15.82:0/3809220395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b019d6b0 con 0x7f40b01009c0 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40a77fe640 1 -- 172.21.15.82:0/3809220395 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac010690 con 0x7f40b01009c0 2024-03-27T07:24:11.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.160+0000 7f40b8640640 1 -- 172.21.15.82:0/3809220395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b01a4f40 con 0x7f40b01009c0 2024-03-27T07:24:11.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.162+0000 7f40a77fe640 1 -- 172.21.15.82:0/3809220395 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7f40ac0046c0 con 0x7f40b01009c0 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.163+0000 7f40bb22c740 1 Processor -- start 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.163+0000 7f40bb22c740 1 -- start start 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.163+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a834487b0 0x561a83448b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40a77fe640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f409c0a38a0 0x7f409c0a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 0x561a83451770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a834540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40bb22c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561a833ac710 con 0x561a83451cb0 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40bb22c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561a83354af0 con 0x561a834490d0 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40bb22c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a833a86c0 con 0x561a834487b0 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b6bdd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a834540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b63dc640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f409c0a38a0 0x7f409c0a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b5bdb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 0x561a83451770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b6bdd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a834540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55248/0 (socket says 172.21.15.82:55248) 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b5bdb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 0x561a83451770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:48106/0 (socket says 172.21.15.82:48106) 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b6bdd640 1 -- 172.21.15.82:0/3387693833 learned_addr learned my addr 172.21.15.82:0/3387693833 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/3387693833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a834487b0 0x561a83448b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40a77fe640 1 -- 172.21.15.82:0/3809220395 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f40ac0d0780 con 0x7f40b01009c0 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b5bdb640 1 -- 172.21.15.82:0/3387693833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a834487b0 msgr2=0x561a83448b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/3387693833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a834487b0 0x561a83448b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b5bdb640 1 -- 172.21.15.82:0/3387693833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 msgr2=0x561a834540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/3387693833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a834540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b5bdb640 1 -- 172.21.15.82:0/3387693833 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a830c03f0 con 0x561a834490d0 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/3387693833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a834540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b63dc640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f409c0a38a0 0x7f409c0a5d60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0cdda0 tx=0x7f40ac091b40 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/3387693833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 0x561a83451770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009bf0 tx=0x7f40a0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=607c31fdf17cd6fd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40a4bfe640 1 -- 172.21.15.82:0/3387693833 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0009da0 con 0x561a834490d0 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.164+0000 7f40a4bfe640 1 -- 172.21.15.82:0/3387693833 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40a0005020 con 0x561a834490d0 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.165+0000 7f40a4bfe640 1 -- 172.21.15.82:0/3387693833 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0004b20 con 0x561a834490d0 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.165+0000 7f40bb22c740 1 -- 172.21.15.82:0/3387693833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 msgr2=0x561a83451770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.165+0000 7f40bb22c740 1 --2- 172.21.15.82:0/3387693833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 0x561a83451770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009bf0 tx=0x7f40a0011810 comp rx=0 tx=0).stop 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.165+0000 7f40bb22c740 1 -- 172.21.15.82:0/3387693833 shutdown_connections 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.165+0000 7f40bb22c740 1 --2- 172.21.15.82:0/3387693833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a834540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.165+0000 7f40bb22c740 1 --2- 172.21.15.82:0/3387693833 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 0x561a83451770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.165+0000 7f40bb22c740 1 --2- 172.21.15.82:0/3387693833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a834487b0 0x561a83448b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.165+0000 7f40bb22c740 1 -- 172.21.15.82:0/3387693833 >> 172.21.15.82:0/3387693833 conn(0x561a83442ee0 msgr2=0x561a834432c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.165+0000 7f40bb22c740 1 -- 172.21.15.82:0/3387693833 shutdown_connections 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.165+0000 7f40bb22c740 1 -- 172.21.15.82:0/3387693833 wait complete. 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40bb22c740 1 -- start start 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40bb22c740 1 Processor -- start 2024-03-27T07:24:11.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834487b0 0x561a8344ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a834490d0 0x561a8344f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a8344f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40bb22c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561a83454aa0 con 0x561a83451cb0 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40bb22c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561a83367eb0 con 0x561a834487b0 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40bb22c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561a83454c20 con 0x561a834490d0 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40bb22c740 10 client.0 _ll_register_callbacks cb 0x561a833a46a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40b6bdd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a8344f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40b6bdd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a8344f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55256/0 (socket says 172.21.15.82:55256) 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40b6bdd640 1 -- 172.21.15.82:0/294741090 learned_addr learned my addr 172.21.15.82:0/294741090 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834487b0 0x561a8344ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a834490d0 0x561a8344f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40b6bdd640 1 -- 172.21.15.82:0/294741090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a834490d0 msgr2=0x561a8344f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a834490d0 0x561a8344f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40b6bdd640 1 -- 172.21.15.82:0/294741090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834487b0 msgr2=0x561a8344ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834487b0 0x561a8344ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.166+0000 7f40b6bdd640 1 -- 172.21.15.82:0/294741090 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a8318a7d0 con 0x561a83451cb0 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a8344f7f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f40a8005cc0 tx=0x7f40a802c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89eb3bbc3d92d15b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f4099ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f4099ffb640 1 -- 172.21.15.82:0/294741090 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a8039040 con 0x561a83451cb0 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f4099ffb640 1 -- 172.21.15.82:0/294741090 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f40a8034500 con 0x561a83451cb0 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40bb22c740 1 -- 172.21.15.82:0/294741090 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a0005020 con 0x561a83451cb0 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f4099ffb640 1 -- 172.21.15.82:0/294741090 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f40a8034700 con 0x561a83451cb0 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40bb22c740 10 client.15603 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40bb22c740 1 -- 172.21.15.82:0/294741090 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x561a83460db0 con 0x561a83451cb0 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f4099ffb640 1 -- 172.21.15.82:0/294741090 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40a0005020 con 0x561a83451cb0 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f4099ffb640 1 -- 172.21.15.82:0/294741090 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f40a803f070 con 0x561a83451cb0 2024-03-27T07:24:11.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40bb22c740 10 client.15603 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40bb22c740 10 client.15603 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40bb22c740 20 client.15603 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40bb22c740 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561a834621c0 0x561a834645f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40bb22c740 4 client.15603 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40bb22c740 1 -- 172.21.15.82:0/294741090 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a833b9c50 con 0x561a834621c0 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.167+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561a834621c0 0x561a834645f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.168+0000 7f4099ffb640 10 client.15603 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.168+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561a834621c0 0x561a834645f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24bb65ab8332cf0d server_cookie=8a3f5135dcde74f6 in_seq=0 out_seq=0 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.168+0000 7f4099ffb640 1 -- 172.21.15.82:0/294741090 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561a833b9c50 con 0x561a834621c0 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.168+0000 7f4099ffb640 10 client.15603 handle_command_reply: tid=0 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.168+0000 7f40bb22c740 1 client.15603 shutdown 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 1 -- 172.21.15.82:0/294741090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 msgr2=0x561a8344f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a8344f7f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f40a8005cc0 tx=0x7f40a802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 1 -- 172.21.15.82:0/294741090 shutdown_connections 2024-03-27T07:24:11.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561a834621c0 0x561a834645f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a83451cb0 0x561a8344f7f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a834490d0 0x561a8344f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f4099ffb640 0 client.15603 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:24:11.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 1 --2- 172.21.15.82:0/294741090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834487b0 0x561a8344ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 1 -- 172.21.15.82:0/294741090 >> 172.21.15.82:0/294741090 conn(0x561a83442ee0 msgr2=0x561a83444c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 1 -- 172.21.15.82:0/294741090 shutdown_connections 2024-03-27T07:24:11.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 1 -- 172.21.15.82:0/294741090 wait complete. 2024-03-27T07:24:11.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.169+0000 7f40bb22c740 20 client.15603 trim_cache size 0 max 16384 2024-03-27T07:24:11.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40bb22c740 1 Processor -- start 2024-03-27T07:24:11.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40bb22c740 1 -- start start 2024-03-27T07:24:11.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834487b0 0x561a834514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834490d0 0x561a8345d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a83451cb0 0x561a83469ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40bb22c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01b0080 con 0x561a834490d0 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40bb22c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01ad950 con 0x561a834487b0 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40bb22c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01ab7a0 con 0x561a83451cb0 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b5bdb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834490d0 0x561a8345d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b5bdb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834490d0 0x561a8345d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55264/0 (socket says 172.21.15.82:55264) 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b5bdb640 1 -- 172.21.15.82:0/3115346161 learned_addr learned my addr 172.21.15.82:0/3115346161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/3115346161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834487b0 0x561a834514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/3115346161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a83451cb0 0x561a83469ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b5bdb640 1 -- 172.21.15.82:0/3115346161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a83451cb0 msgr2=0x561a83469ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/3115346161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a83451cb0 0x561a83469ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b5bdb640 1 -- 172.21.15.82:0/3115346161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834487b0 msgr2=0x561a834514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/3115346161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834487b0 0x561a834514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b5bdb640 1 -- 172.21.15.82:0/3115346161 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a83448f00 con 0x561a834490d0 2024-03-27T07:24:11.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.182+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/3115346161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834490d0 0x561a8345d840 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f40a0011d10 tx=0x7f40a00096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4b90bc0ce9c3b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f409bfff640 1 -- 172.21.15.82:0/3115346161 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a002ba30 con 0x561a834490d0 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f409bfff640 1 -- 172.21.15.82:0/3115346161 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40a002b390 con 0x561a834490d0 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f409bfff640 1 -- 172.21.15.82:0/3115346161 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a0005500 con 0x561a834490d0 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 -- 172.21.15.82:0/3115346161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834490d0 msgr2=0x561a8345d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 --2- 172.21.15.82:0/3115346161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834490d0 0x561a8345d840 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f40a0011d10 tx=0x7f40a00096a0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 -- 172.21.15.82:0/3115346161 shutdown_connections 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 --2- 172.21.15.82:0/3115346161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834490d0 0x561a8345d840 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 --2- 172.21.15.82:0/3115346161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a83451cb0 0x561a83469ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 --2- 172.21.15.82:0/3115346161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834487b0 0x561a834514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 -- 172.21.15.82:0/3115346161 >> 172.21.15.82:0/3115346161 conn(0x561a83442ee0 msgr2=0x561a83442000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 -- 172.21.15.82:0/3115346161 shutdown_connections 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 -- 172.21.15.82:0/3115346161 wait complete. 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 -- start start 2024-03-27T07:24:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.183+0000 7f40bb22c740 1 Processor -- start 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834487b0 0x561a83455700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 0x561a83455c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40bb22c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a83451cb0 0x561a83456180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40bb22c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01abe10 con 0x561a834487b0 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40bb22c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01ad280 con 0x561a834490d0 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40bb22c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01ac4e0 con 0x561a83451cb0 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40bb22c740 10 client.0 _ll_register_callbacks cb 0x7f40a8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b6bdd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834487b0 0x561a83455700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b6bdd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834487b0 0x561a83455700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55276/0 (socket says 172.21.15.82:55276) 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b6bdd640 1 -- 172.21.15.82:0/853377856 learned_addr learned my addr 172.21.15.82:0/853377856 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 0x561a83455c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a83451cb0 0x561a83456180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b6bdd640 1 -- 172.21.15.82:0/853377856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a83451cb0 msgr2=0x561a83456180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a83451cb0 0x561a83456180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b6bdd640 1 -- 172.21.15.82:0/853377856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 msgr2=0x561a83455c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 0x561a83455c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b6bdd640 1 -- 172.21.15.82:0/853377856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a834c74f0 con 0x561a834487b0 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40b6bdd640 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834487b0 0x561a83455700 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f40a8004af0 tx=0x7f40a8046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ff5f42a191474e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f4099ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f4099ffb640 1 -- 172.21.15.82:0/853377856 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40a805e060 con 0x561a834487b0 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f4099ffb640 1 -- 172.21.15.82:0/853377856 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f40a8034500 con 0x561a834487b0 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.184+0000 7f40bb22c740 1 -- 172.21.15.82:0/853377856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40a002b390 con 0x561a834487b0 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f4099ffb640 1 -- 172.21.15.82:0/853377856 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f40a8039040 con 0x561a834487b0 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f40bb22c740 10 client.15609 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f40bb22c740 1 -- 172.21.15.82:0/853377856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x561a834c8770 con 0x561a834487b0 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f4099ffb640 1 -- 172.21.15.82:0/853377856 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40a002b390 con 0x561a834487b0 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f4099ffb640 1 -- 172.21.15.82:0/853377856 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f40a803f040 con 0x561a834487b0 2024-03-27T07:24:11.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f40bb22c740 10 client.15609 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f40bb22c740 10 client.15609 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f40bb22c740 20 client.15609 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f40bb22c740 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561a834c8dd0 0x561a834cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f40bb22c740 4 client.15609 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f40bb22c740 1 -- 172.21.15.82:0/853377856 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a833b3fa0 con 0x561a834c8dd0 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561a834c8dd0 0x561a834cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f4099ffb640 10 client.15609 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.185+0000 7f40b5bdb640 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561a834c8dd0 0x561a834cb1c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56e8bd8ab8464aed server_cookie=42ced9dca9481a5d in_seq=0 out_seq=0 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f4099ffb640 1 -- 172.21.15.82:0/853377856 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a833b3fa0 con 0x561a834c8dd0 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f4099ffb640 10 client.15609 handle_command_reply: tid=0 2024-03-27T07:24:11.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 client.15609 shutdown 2024-03-27T07:24:11.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:11 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1058198321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:24:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 -- 172.21.15.82:0/853377856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834487b0 msgr2=0x561a83455700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834487b0 0x561a83455700 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f40a8004af0 tx=0x7f40a8046040 comp rx=0 tx=0).stop 2024-03-27T07:24:11.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 -- 172.21.15.82:0/853377856 shutdown_connections 2024-03-27T07:24:11.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561a834c8dd0 0x561a834cb1c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561a83451cb0 0x561a83456180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561a834490d0 0x561a83455c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 --2- 172.21.15.82:0/853377856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a834487b0 0x561a83455700 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 -- 172.21.15.82:0/853377856 >> 172.21.15.82:0/853377856 conn(0x561a83442ee0 msgr2=0x561a8344ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f4099ffb640 0 client.15609 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:24:11.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 -- 172.21.15.82:0/853377856 shutdown_connections 2024-03-27T07:24:11.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 1 -- 172.21.15.82:0/853377856 wait complete. 2024-03-27T07:24:11.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40bb22c740 20 client.15609 trim_cache size 0 max 16384 2024-03-27T07:24:11.195 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:24:11.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 -- 172.21.15.82:0/3809220395 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f409c0a38a0 msgr2=0x7f409c0a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f409c0a38a0 0x7f409c0a5d60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0cdda0 tx=0x7f40ac091b40 comp rx=0 tx=0).stop 2024-03-27T07:24:11.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 -- 172.21.15.82:0/3809220395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b01009c0 msgr2=0x7f40b01983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b01009c0 0x7f40b01983d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00e9f0 tx=0x7f40ac00edf0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 -- 172.21.15.82:0/3809220395 shutdown_connections 2024-03-27T07:24:11.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f409c0a38a0 0x7f409c0a5d60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f40b01069d0 0x7f40b019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40b0101380 0x7f40b0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 --2- 172.21.15.82:0/3809220395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f40b01009c0 0x7f40b01983d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 -- 172.21.15.82:0/3809220395 >> 172.21.15.82:0/3809220395 conn(0x7f40b0077b50 msgr2=0x7f40b0068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.186+0000 7f40b8640640 1 -- 172.21.15.82:0/3809220395 shutdown_connections 2024-03-27T07:24:11.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.187+0000 7f40b8640640 1 -- 172.21.15.82:0/3809220395 wait complete. 2024-03-27T07:24:11.199 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T07:24:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 -- 172.21.15.82:0/3710055885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70a8101380 msgr2=0x7f70a810d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 --2- 172.21.15.82:0/3710055885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70a8101380 0x7f70a810d890 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7098009860 tx=0x7f709802bb90 comp rx=0 tx=0).stop 2024-03-27T07:24:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 -- 172.21.15.82:0/3710055885 shutdown_connections 2024-03-27T07:24:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 --2- 172.21.15.82:0/3710055885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a81009c0 0x7f70a8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 --2- 172.21.15.82:0/3710055885 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70a8101380 0x7f70a810d890 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 --2- 172.21.15.82:0/3710055885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a81069d0 0x7f70a8106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 -- 172.21.15.82:0/3710055885 >> 172.21.15.82:0/3710055885 conn(0x7f70a8077b50 msgr2=0x7f70a8077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 -- 172.21.15.82:0/3710055885 shutdown_connections 2024-03-27T07:24:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 -- 172.21.15.82:0/3710055885 wait complete. 2024-03-27T07:24:11.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 Processor -- start 2024-03-27T07:24:11.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 -- start start 2024-03-27T07:24:11.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a81009c0 0x7f70a8197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a8101380 0x7f70a81977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.301+0000 7f70ae1e4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70a81069d0 0x7f70a819bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70ae1e4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8110de0 con 0x7f70a81009c0 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70ae1e4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8110c60 con 0x7f70a81069d0 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70ae1e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70a8110f60 con 0x7f70a8101380 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a81009c0 0x7f70a8197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a81009c0 0x7f70a8197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55288/0 (socket says 172.21.15.82:55288) 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a77fe640 1 -- 172.21.15.82:0/2931619346 learned_addr learned my addr 172.21.15.82:0/2931619346 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a6ffd640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a8101380 0x7f70a81977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a7fff640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70a81069d0 0x7f70a819bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a77fe640 1 -- 172.21.15.82:0/2931619346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a8101380 msgr2=0x7f70a81977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a77fe640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a8101380 0x7f70a81977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a77fe640 1 -- 172.21.15.82:0/2931619346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70a81069d0 msgr2=0x7f70a819bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a77fe640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70a81069d0 0x7f70a819bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a77fe640 1 -- 172.21.15.82:0/2931619346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a819c270 con 0x7f70a81009c0 2024-03-27T07:24:11.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a77fe640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a81009c0 0x7f70a8197280 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f70a000eca0 tx=0x7f70a000b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a4ff9640 1 -- 172.21.15.82:0/2931619346 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0004b20 con 0x7f70a81009c0 2024-03-27T07:24:11.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70ae1e4640 1 -- 172.21.15.82:0/2931619346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a819c560 con 0x7f70a81009c0 2024-03-27T07:24:11.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a4ff9640 1 -- 172.21.15.82:0/2931619346 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a0004cc0 con 0x7f70a81009c0 2024-03-27T07:24:11.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70a4ff9640 1 -- 172.21.15.82:0/2931619346 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0017670 con 0x7f70a81009c0 2024-03-27T07:24:11.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.302+0000 7f70ae1e4640 1 -- 172.21.15.82:0/2931619346 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a8068cb0 con 0x7f70a81009c0 2024-03-27T07:24:11.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.305+0000 7f70a4ff9640 1 -- 172.21.15.82:0/2931619346 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7f70a0005020 con 0x7f70a81009c0 2024-03-27T07:24:11.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.305+0000 7f70b0dc5740 1 Processor -- start 2024-03-27T07:24:11.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.305+0000 7f70b0dc5740 1 -- start start 2024-03-27T07:24:11.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.305+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c516a7b0 0x55c1c516ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.305+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5173770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.305+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c5173cb0 0x55c1c51760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.305+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c1c50ce710 con 0x55c1c516b0d0 2024-03-27T07:24:11.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.305+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55c1c5076af0 con 0x55c1c516a7b0 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.305+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c1c50ca6c0 con 0x55c1c5173cb0 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.305+0000 7f70a77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5173770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a7fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c516a7b0 0x55c1c516ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5173770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55294/0 (socket says 172.21.15.82:55294) 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a77fe640 1 -- 172.21.15.82:0/2379759740 learned_addr learned my addr 172.21.15.82:0/2379759740 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a6ffd640 1 --2- 172.21.15.82:0/2379759740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c5173cb0 0x55c1c51760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a4ff9640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f70940a38a0 0x7f70940a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a7fff640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f70940a38a0 0x7f70940a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a77fe640 1 -- 172.21.15.82:0/2379759740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c5173cb0 msgr2=0x55c1c51760a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a77fe640 1 --2- 172.21.15.82:0/2379759740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c5173cb0 0x55c1c51760a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a77fe640 1 -- 172.21.15.82:0/2379759740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c516a7b0 msgr2=0x55c1c516ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a77fe640 1 --2- 172.21.15.82:0/2379759740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c516a7b0 0x55c1c516ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a4ff9640 1 -- 172.21.15.82:0/2931619346 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f70a00d1ee0 con 0x7f70a81009c0 2024-03-27T07:24:11.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a77fe640 1 -- 172.21.15.82:0/2379759740 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1c4de23f0 con 0x55c1c516b0d0 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a77fe640 1 --2- 172.21.15.82:0/2379759740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5173770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f70a00cfc80 tx=0x7f70a0053250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa8355519ed4f10 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f70a7fff640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f70940a38a0 0x7f70940a5d60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7098009830 tx=0x7f709802bb90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f709dffb640 1 -- 172.21.15.82:0/2379759740 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a009d7d0 con 0x55c1c516b0d0 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f709dffb640 1 -- 172.21.15.82:0/2379759740 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a009e570 con 0x55c1c516b0d0 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.306+0000 7f709dffb640 1 -- 172.21.15.82:0/2379759740 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a009a4e0 con 0x55c1c516b0d0 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2379759740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 msgr2=0x55c1c5173770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2379759740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5173770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f70a00cfc80 tx=0x7f70a0053250 comp rx=0 tx=0).stop 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2379759740 shutdown_connections 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2379759740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5173770 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2379759740 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c5173cb0 0x55c1c51760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2379759740 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c516a7b0 0x55c1c516ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2379759740 >> 172.21.15.82:0/2379759740 conn(0x55c1c5164ee0 msgr2=0x55c1c51652c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2379759740 shutdown_connections 2024-03-27T07:24:11.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2379759740 wait complete. 2024-03-27T07:24:11.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 -- start start 2024-03-27T07:24:11.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.307+0000 7f70b0dc5740 1 Processor -- start 2024-03-27T07:24:11.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c516a7b0 0x55c1c5170d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5171260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 0x55c1c51717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c1c51769e0 con 0x55c1c516b0d0 2024-03-27T07:24:11.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55c1c5089eb0 con 0x55c1c5173cb0 2024-03-27T07:24:11.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c1c5176b60 con 0x55c1c516a7b0 2024-03-27T07:24:11.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70b0dc5740 10 client.0 _ll_register_callbacks cb 0x55c1c50c66a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:11.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5171260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c516a7b0 0x55c1c5170d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5171260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55302/0 (socket says 172.21.15.82:55302) 2024-03-27T07:24:11.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a6ffd640 1 -- 172.21.15.82:0/2147018390 learned_addr learned my addr 172.21.15.82:0/2147018390 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a7fff640 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 0x55c1c51717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a6ffd640 1 -- 172.21.15.82:0/2147018390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c516a7b0 msgr2=0x55c1c5170d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a6ffd640 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c516a7b0 0x55c1c5170d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a6ffd640 1 -- 172.21.15.82:0/2147018390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 msgr2=0x55c1c51717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a6ffd640 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 0x55c1c51717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a6ffd640 1 -- 172.21.15.82:0/2147018390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1c4eac7d0 con 0x55c1c516b0d0 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70a6ffd640 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5171260 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f70900116f0 tx=0x7f7090011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8be51e72af0a2a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f7086ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f7086ffd640 1 -- 172.21.15.82:0/2147018390 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709000fb70 con 0x55c1c516b0d0 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f7086ffd640 1 -- 172.21.15.82:0/2147018390 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f7090017050 con 0x55c1c516b0d0 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.308+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2147018390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a009e570 con 0x55c1c516b0d0 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f7086ffd640 1 -- 172.21.15.82:0/2147018390 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f709000fd10 con 0x55c1c516b0d0 2024-03-27T07:24:11.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f70b0dc5740 10 client.15621 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2147018390 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55c1c5182d30 con 0x55c1c516b0d0 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f7086ffd640 1 -- 172.21.15.82:0/2147018390 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a009e570 con 0x55c1c516b0d0 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f7086ffd640 1 -- 172.21.15.82:0/2147018390 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f7090022030 con 0x55c1c516b0d0 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f70b0dc5740 10 client.15621 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f70b0dc5740 10 client.15621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f70b0dc5740 20 client.15621 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c1c51841f0 0x55c1c5186660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f70b0dc5740 4 client.15621 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2147018390 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1c50dbc50 con 0x55c1c51841f0 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f70a77fe640 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c1c51841f0 0x55c1c5186660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f7086ffd640 10 client.15621 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.309+0000 7f70a77fe640 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c1c51841f0 0x55c1c5186660 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc2dec24a520a409 server_cookie=f542fa592b7bf816 in_seq=0 out_seq=0 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f7086ffd640 1 -- 172.21.15.82:0/2147018390 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c1c50dbc50 con 0x55c1c51841f0 2024-03-27T07:24:11.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f7086ffd640 10 client.15621 handle_command_reply: tid=0 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 client.15621 shutdown 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2147018390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 msgr2=0x55c1c5171260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5171260 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f70900116f0 tx=0x7f7090011bb0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2147018390 shutdown_connections 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c1c51841f0 0x55c1c5186660 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5171260 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 0x55c1c51717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f7086ffd640 0 client.15621 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2147018390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c516a7b0 0x55c1c5170d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2147018390 >> 172.21.15.82:0/2147018390 conn(0x55c1c5164ee0 msgr2=0x55c1c5166c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2147018390 shutdown_connections 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.310+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2147018390 wait complete. 2024-03-27T07:24:11.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.311+0000 7f70b0dc5740 20 client.15621 trim_cache size 0 max 16384 2024-03-27T07:24:11.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.323+0000 7f70b0dc5740 1 Processor -- start 2024-03-27T07:24:11.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.323+0000 7f70b0dc5740 1 -- start start 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516a7b0 0x55c1c5173450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c516b0d0 0x55c1c517f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 0x55c1c518bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81ade10 con 0x55c1c516a7b0 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81ab6e0 con 0x55c1c5173cb0 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81a9530 con 0x55c1c516b0d0 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516a7b0 0x55c1c5173450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516a7b0 0x55c1c5173450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55312/0 (socket says 172.21.15.82:55312) 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a77fe640 1 -- 172.21.15.82:0/1768239886 learned_addr learned my addr 172.21.15.82:0/1768239886 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a7fff640 1 --2- 172.21.15.82:0/1768239886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 0x55c1c518bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a6ffd640 1 --2- 172.21.15.82:0/1768239886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c516b0d0 0x55c1c517f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a77fe640 1 -- 172.21.15.82:0/1768239886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c516b0d0 msgr2=0x55c1c517f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a77fe640 1 --2- 172.21.15.82:0/1768239886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c516b0d0 0x55c1c517f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a77fe640 1 -- 172.21.15.82:0/1768239886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 msgr2=0x55c1c518bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a77fe640 1 --2- 172.21.15.82:0/1768239886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 0x55c1c518bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a77fe640 1 -- 172.21.15.82:0/1768239886 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1c5164a10 con 0x55c1c516a7b0 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a7fff640 1 --2- 172.21.15.82:0/1768239886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 0x55c1c518bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f70a77fe640 1 --2- 172.21.15.82:0/1768239886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516a7b0 0x55c1c5173450 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f70a00cf610 tx=0x7f70a0022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e8a1adbffcd98d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f709d7fa640 1 -- 172.21.15.82:0/1768239886 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a00bc070 con 0x55c1c516a7b0 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f709d7fa640 1 -- 172.21.15.82:0/1768239886 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a00b6070 con 0x55c1c516a7b0 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.324+0000 7f709d7fa640 1 -- 172.21.15.82:0/1768239886 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a009a4e0 con 0x55c1c516a7b0 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 -- 172.21.15.82:0/1768239886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516a7b0 msgr2=0x55c1c5173450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/1768239886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516a7b0 0x55c1c5173450 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f70a00cf610 tx=0x7f70a0022040 comp rx=0 tx=0).stop 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 -- 172.21.15.82:0/1768239886 shutdown_connections 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/1768239886 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c5173cb0 0x55c1c518bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/1768239886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c516b0d0 0x55c1c517f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/1768239886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516a7b0 0x55c1c5173450 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 -- 172.21.15.82:0/1768239886 >> 172.21.15.82:0/1768239886 conn(0x55c1c5164ee0 msgr2=0x55c1c5170ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 -- 172.21.15.82:0/1768239886 shutdown_connections 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 -- 172.21.15.82:0/1768239886 wait complete. 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 -- start start 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 Processor -- start 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c516a7b0 0x55c1c5177a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.325+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5177fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70b0dc5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c5173cb0 0x55c1c51e95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81a9ba0 con 0x55c1c516b0d0 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81ab010 con 0x55c1c516a7b0 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70b0dc5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f70a81aa270 con 0x55c1c5173cb0 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70b0dc5740 10 client.0 _ll_register_callbacks cb 0x7f7090009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5177fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5177fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55322/0 (socket says 172.21.15.82:55322) 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a6ffd640 1 -- 172.21.15.82:0/2722855037 learned_addr learned my addr 172.21.15.82:0/2722855037 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a77fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c516a7b0 0x55c1c5177a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a7fff640 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c5173cb0 0x55c1c51e95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a6ffd640 1 -- 172.21.15.82:0/2722855037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c5173cb0 msgr2=0x55c1c51e95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a6ffd640 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c5173cb0 0x55c1c51e95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a6ffd640 1 -- 172.21.15.82:0/2722855037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c516a7b0 msgr2=0x55c1c5177a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a6ffd640 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c516a7b0 0x55c1c5177a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a6ffd640 1 -- 172.21.15.82:0/2722855037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1c51e9ae0 con 0x55c1c516b0d0 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70a6ffd640 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5177fd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55c1c51722f0 tx=0x7f709001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7456ed781cd19f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f7086ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f7086ffd640 1 -- 172.21.15.82:0/2722855037 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090031020 con 0x55c1c516b0d0 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2722855037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a00b6070 con 0x55c1c516b0d0 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f7086ffd640 1 -- 172.21.15.82:0/2722855037 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f7090011e00 con 0x55c1c516b0d0 2024-03-27T07:24:11.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f7086ffd640 1 -- 172.21.15.82:0/2722855037 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f709003c050 con 0x55c1c516b0d0 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70b0dc5740 10 client.15627 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.326+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2722855037 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55c1c51eac80 con 0x55c1c516b0d0 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f7086ffd640 1 -- 172.21.15.82:0/2722855037 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70a00b6070 con 0x55c1c516b0d0 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f7086ffd640 1 -- 172.21.15.82:0/2722855037 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f7090022040 con 0x55c1c516b0d0 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f70b0dc5740 10 client.15627 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f70b0dc5740 10 client.15627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f70b0dc5740 20 client.15627 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c1c51eb420 0x55c1c51ed840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f70b0dc5740 4 client.15627 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2722855037 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1c50d5fa0 con 0x55c1c51eb420 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f70a77fe640 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c1c51eb420 0x55c1c51ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f7086ffd640 10 client.15627 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f70a77fe640 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c1c51eb420 0x55c1c51ed840 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ae71b6e49d83929 server_cookie=f9393b3bd3dea51f in_seq=0 out_seq=0 2024-03-27T07:24:11.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f7086ffd640 1 -- 172.21.15.82:0/2722855037 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1c50d5fa0 con 0x55c1c51eb420 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f7086ffd640 10 client.15627 handle_command_reply: tid=0 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.327+0000 7f70b0dc5740 1 client.15627 shutdown 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2722855037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 msgr2=0x55c1c5177fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5177fd0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x55c1c51722f0 tx=0x7f709001bf60 comp rx=0 tx=0).stop 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2722855037 shutdown_connections 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c1c51eb420 0x55c1c51ed840 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1c516b0d0 0x55c1c5177fd0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c1c5173cb0 0x55c1c51e95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f7086ffd640 0 client.15627 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 1 --2- 172.21.15.82:0/2722855037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c1c516a7b0 0x55c1c5177a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2722855037 >> 172.21.15.82:0/2722855037 conn(0x55c1c5164ee0 msgr2=0x55c1c5164000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2722855037 shutdown_connections 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 1 -- 172.21.15.82:0/2722855037 wait complete. 2024-03-27T07:24:11.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70b0dc5740 20 client.15627 trim_cache size 0 max 16384 2024-03-27T07:24:11.337 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 -- 172.21.15.82:0/2931619346 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f70940a38a0 msgr2=0x7f70940a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f70940a38a0 0x7f70940a5d60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7098009830 tx=0x7f709802bb90 comp rx=0 tx=0).stop 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 -- 172.21.15.82:0/2931619346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a81009c0 msgr2=0x7f70a8197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a81009c0 0x7f70a8197280 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f70a000eca0 tx=0x7f70a000b690 comp rx=0 tx=0).stop 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 -- 172.21.15.82:0/2931619346 shutdown_connections 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f70940a38a0 0x7f70940a5d60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f70a81069d0 0x7f70a819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70a8101380 0x7f70a81977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 --2- 172.21.15.82:0/2931619346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70a81009c0 0x7f70a8197280 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 -- 172.21.15.82:0/2931619346 >> 172.21.15.82:0/2931619346 conn(0x7f70a8077b50 msgr2=0x7f70a8103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:11.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 -- 172.21.15.82:0/2931619346 shutdown_connections 2024-03-27T07:24:11.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:11.328+0000 7f70ae1e4640 1 -- 172.21.15.82:0/2931619346 wait complete. 2024-03-27T07:24:11.406 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:11 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1058198321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:24:11.439 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:11 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1058198321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:24:12.342 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T07:24:12.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:24:12.342 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T07:24:12.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:12 smithi082 ceph-mon[32178]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-03-27T07:24:12.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.461+0000 7efee34a4640 1 -- 172.21.15.82:0/1840146958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efedc101ae0 msgr2=0x7efedc101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.461+0000 7efee34a4640 1 --2- 172.21.15.82:0/1840146958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efedc101ae0 0x7efedc101f60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efecc009930 tx=0x7efecc02bc30 comp rx=0 tx=0).stop 2024-03-27T07:24:12.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.461+0000 7efee34a4640 1 -- 172.21.15.82:0/1840146958 shutdown_connections 2024-03-27T07:24:12.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.461+0000 7efee34a4640 1 --2- 172.21.15.82:0/1840146958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efedc101ae0 0x7efedc101f60 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.461+0000 7efee34a4640 1 --2- 172.21.15.82:0/1840146958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efedc1024a0 0x7efedc10e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.461+0000 7efee34a4640 1 --2- 172.21.15.82:0/1840146958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efedc107b80 0x7efedc107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.461+0000 7efee34a4640 1 -- 172.21.15.82:0/1840146958 >> 172.21.15.82:0/1840146958 conn(0x7efedc078f50 msgr2=0x7efedc079360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.461+0000 7efee34a4640 1 -- 172.21.15.82:0/1840146958 shutdown_connections 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.461+0000 7efee34a4640 1 -- 172.21.15.82:0/1840146958 wait complete. 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee34a4640 1 Processor -- start 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee34a4640 1 -- start start 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee34a4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efedc101ae0 0x7efedc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee34a4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efedc1024a0 0x7efedc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee34a4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efedc107b80 0x7efedc19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee34a4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efedc111f00 con 0x7efedc107b80 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee34a4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efedc111d80 con 0x7efedc101ae0 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee34a4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efedc112080 con 0x7efedc1024a0 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee1a41640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efedc107b80 0x7efedc19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee1a41640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efedc107b80 0x7efedc19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55346/0 (socket says 172.21.15.82:55346) 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee1a41640 1 -- 172.21.15.82:0/1089473798 learned_addr learned my addr 172.21.15.82:0/1089473798 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:12.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee1240640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efedc101ae0 0x7efedc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee0a3f640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efedc1024a0 0x7efedc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee1a41640 1 -- 172.21.15.82:0/1089473798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efedc1024a0 msgr2=0x7efedc198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee1a41640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efedc1024a0 0x7efedc198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee1a41640 1 -- 172.21.15.82:0/1089473798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efedc101ae0 msgr2=0x7efedc198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee1a41640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efedc101ae0 0x7efedc198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.462+0000 7efee1a41640 1 -- 172.21.15.82:0/1089473798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc19d3f0 con 0x7efedc107b80 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.463+0000 7efee1a41640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efedc107b80 0x7efedc19ccc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efed400eb10 tx=0x7efed400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.463+0000 7efed27fc640 1 -- 172.21.15.82:0/1089473798 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4004b20 con 0x7efedc107b80 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.463+0000 7efed27fc640 1 -- 172.21.15.82:0/1089473798 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efed4004cc0 con 0x7efedc107b80 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.463+0000 7efee34a4640 1 -- 172.21.15.82:0/1089473798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc19d6e0 con 0x7efedc107b80 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.463+0000 7efed27fc640 1 -- 172.21.15.82:0/1089473798 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4010760 con 0x7efedc107b80 2024-03-27T07:24:12.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.463+0000 7efee34a4640 1 -- 172.21.15.82:0/1089473798 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc1a4f70 con 0x7efedc107b80 2024-03-27T07:24:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.465+0000 7efed27fc640 1 -- 172.21.15.82:0/1089473798 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7efed4005020 con 0x7efedc107b80 2024-03-27T07:24:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee6169740 1 Processor -- start 2024-03-27T07:24:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee6169740 1 -- start start 2024-03-27T07:24:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efed27fc640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efec80a38a0 0x7efec80a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee6169740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926525e50 0x564926526230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee6169740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926526770 0x56492652ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee6169740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56492652f350 0x564926531740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee6169740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564926430c20 con 0x564926526770 2024-03-27T07:24:12.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee6169740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x564926489430 con 0x56492652f350 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee6169740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564926431900 con 0x564926525e50 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efed27fc640 1 -- 172.21.15.82:0/1089473798 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7efed40d08f0 con 0x7efedc107b80 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee0a3f640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efec80a38a0 0x7efec80a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee1240640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926525e50 0x564926526230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee0a3f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926526770 0x56492652ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee1240640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926525e50 0x564926526230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:51936/0 (socket says 172.21.15.82:51936) 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee1a41640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56492652f350 0x564926531740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee1240640 1 -- 172.21.15.82:0/1617054812 learned_addr learned my addr 172.21.15.82:0/1617054812 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee1240640 1 -- 172.21.15.82:0/1617054812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56492652f350 msgr2=0x564926531740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee1240640 1 --2- 172.21.15.82:0/1617054812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56492652f350 0x564926531740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee1240640 1 -- 172.21.15.82:0/1617054812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926526770 msgr2=0x56492652ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee1240640 1 --2- 172.21.15.82:0/1617054812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926526770 0x56492652ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.466+0000 7efee1240640 1 -- 172.21.15.82:0/1617054812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564926484180 con 0x564926525e50 2024-03-27T07:24:12.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efee0a3f640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efec80a38a0 0x7efec80a5d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efecc005ab0 tx=0x7efecc005e20 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efee1240640 1 --2- 172.21.15.82:0/1617054812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926525e50 0x564926526230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efed8009ca0 tx=0x7efed8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=842c436e5b4f1aea server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efec77fe640 1 -- 172.21.15.82:0/1617054812 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed801e070 con 0x564926525e50 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efec77fe640 1 -- 172.21.15.82:0/1617054812 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efed8009e50 con 0x564926525e50 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efec77fe640 1 -- 172.21.15.82:0/1617054812 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed800e920 con 0x564926525e50 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efee6169740 1 -- 172.21.15.82:0/1617054812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926525e50 msgr2=0x564926526230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efee6169740 1 --2- 172.21.15.82:0/1617054812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926525e50 0x564926526230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efed8009ca0 tx=0x7efed8011810 comp rx=0 tx=0).stop 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efee6169740 1 -- 172.21.15.82:0/1617054812 shutdown_connections 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efee6169740 1 --2- 172.21.15.82:0/1617054812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926526770 0x56492652ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efee6169740 1 --2- 172.21.15.82:0/1617054812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56492652f350 0x564926531740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efee6169740 1 --2- 172.21.15.82:0/1617054812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926525e50 0x564926526230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.467+0000 7efee6169740 1 -- 172.21.15.82:0/1617054812 >> 172.21.15.82:0/1617054812 conn(0x564926520580 msgr2=0x564926520960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 1 -- 172.21.15.82:0/1617054812 shutdown_connections 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 1 -- 172.21.15.82:0/1617054812 wait complete. 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 1 -- start start 2024-03-27T07:24:12.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 1 Processor -- start 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492652ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926526770 0x56492652c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 0x56492652c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564926444cc0 con 0x564926525e50 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5649264853e0 con 0x564926526770 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564926532140 con 0x56492652f350 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee6169740 10 client.0 _ll_register_callbacks cb 0x56492647ff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee1240640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492652ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee1240640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492652ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55360/0 (socket says 172.21.15.82:55360) 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.468+0000 7efee1240640 1 -- 172.21.15.82:0/1015080225 learned_addr learned my addr 172.21.15.82:0/1015080225 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee1a41640 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 0x56492652c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee0a3f640 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926526770 0x56492652c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee1240640 1 -- 172.21.15.82:0/1015080225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 msgr2=0x56492652c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee1240640 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 0x56492652c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee1240640 1 -- 172.21.15.82:0/1015080225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926526770 msgr2=0x56492652c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee1240640 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926526770 0x56492652c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee1240640 1 -- 172.21.15.82:0/1015080225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56492644bef0 con 0x564926525e50 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee1240640 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492652ece0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efed8009870 tx=0x7efed8005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418ba6ede8cb12fb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efec4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efec4ff9640 1 -- 172.21.15.82:0/1015080225 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8027070 con 0x564926525e50 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efec4ff9640 1 -- 172.21.15.82:0/1015080225 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7efed8004220 con 0x564926525e50 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee6169740 1 -- 172.21.15.82:0/1015080225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efed8009e50 con 0x564926525e50 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efec4ff9640 1 -- 172.21.15.82:0/1015080225 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7efed8032050 con 0x564926525e50 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee6169740 10 client.15639 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efee6169740 1 -- 172.21.15.82:0/1015080225 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5649262657e0 con 0x564926525e50 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.469+0000 7efec4ff9640 1 -- 172.21.15.82:0/1015080225 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efed8009e50 con 0x564926525e50 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.470+0000 7efec4ff9640 1 -- 172.21.15.82:0/1015080225 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7efed800e780 con 0x564926525e50 2024-03-27T07:24:12.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.470+0000 7efee6169740 10 client.15639 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.470+0000 7efee6169740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.470+0000 7efee6169740 20 client.15639 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.470+0000 7efee6169740 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56492653f160 0x564926541550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.470+0000 7efee6169740 4 client.15639 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.470+0000 7efee6169740 1 -- 172.21.15.82:0/1015080225 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564926496970 con 0x56492653f160 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.470+0000 7efee0a3f640 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56492653f160 0x564926541550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.470+0000 7efec4ff9640 10 client.15639 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.470+0000 7efee0a3f640 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56492653f160 0x564926541550 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b399a84f8b8e1ae5 server_cookie=5d7649530bb8531b in_seq=0 out_seq=0 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efec4ff9640 1 -- 172.21.15.82:0/1015080225 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x564926496970 con 0x56492653f160 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efec4ff9640 10 client.15639 handle_command_reply: tid=0 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 client.15639 shutdown 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 -- 172.21.15.82:0/1015080225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 msgr2=0x56492652ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492652ece0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efed8009870 tx=0x7efed8005520 comp rx=0 tx=0).stop 2024-03-27T07:24:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 -- 172.21.15.82:0/1015080225 shutdown_connections 2024-03-27T07:24:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 0x56492652c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926526770 0x56492652c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56492653f160 0x564926541550 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 --2- 172.21.15.82:0/1015080225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492652ece0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efec4ff9640 0 client.15639 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 -- 172.21.15.82:0/1015080225 >> 172.21.15.82:0/1015080225 conn(0x564926520580 msgr2=0x5649265222d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 -- 172.21.15.82:0/1015080225 shutdown_connections 2024-03-27T07:24:12.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 1 -- 172.21.15.82:0/1015080225 wait complete. 2024-03-27T07:24:12.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.471+0000 7efee6169740 20 client.15639 trim_cache size 0 max 16384 2024-03-27T07:24:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee6169740 1 Processor -- start 2024-03-27T07:24:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee6169740 1 -- start start 2024-03-27T07:24:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee6169740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492653ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee6169740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926526770 0x564926546d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee6169740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 0x56492652e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee6169740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efedc1afee0 con 0x564926525e50 2024-03-27T07:24:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee6169740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efedc1ad7b0 con 0x564926526770 2024-03-27T07:24:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee6169740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efedc1ab600 con 0x56492652f350 2024-03-27T07:24:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee1240640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492653ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee1240640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492653ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55372/0 (socket says 172.21.15.82:55372) 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee1240640 1 -- 172.21.15.82:0/1426968372 learned_addr learned my addr 172.21.15.82:0/1426968372 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee0a3f640 1 --2- 172.21.15.82:0/1426968372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926526770 0x564926546d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee1a41640 1 --2- 172.21.15.82:0/1426968372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 0x56492652e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee1240640 1 -- 172.21.15.82:0/1426968372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 msgr2=0x56492652e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee1240640 1 --2- 172.21.15.82:0/1426968372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 0x56492652e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee1240640 1 -- 172.21.15.82:0/1426968372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926526770 msgr2=0x564926546d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee1240640 1 --2- 172.21.15.82:0/1426968372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926526770 0x564926546d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee1240640 1 -- 172.21.15.82:0/1426968372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56492652c960 con 0x564926525e50 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.489+0000 7efee1a41640 1 --2- 172.21.15.82:0/1426968372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 0x56492652e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efee1240640 1 --2- 172.21.15.82:0/1426968372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492653ad90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efed800eb20 tx=0x7efed80053c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b396d32217b7a36 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efec6ffd640 1 -- 172.21.15.82:0/1426968372 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed802f020 con 0x564926525e50 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efec6ffd640 1 -- 172.21.15.82:0/1426968372 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efed8009af0 con 0x564926525e50 2024-03-27T07:24:12.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efec6ffd640 1 -- 172.21.15.82:0/1426968372 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8027040 con 0x564926525e50 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efee6169740 1 -- 172.21.15.82:0/1426968372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 msgr2=0x56492653ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efee6169740 1 --2- 172.21.15.82:0/1426968372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492653ad90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efed800eb20 tx=0x7efed80053c0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efee6169740 1 -- 172.21.15.82:0/1426968372 shutdown_connections 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efee6169740 1 --2- 172.21.15.82:0/1426968372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56492652f350 0x56492652e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efee6169740 1 --2- 172.21.15.82:0/1426968372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926526770 0x564926546d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efee6169740 1 --2- 172.21.15.82:0/1426968372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564926525e50 0x56492653ad90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efee6169740 1 -- 172.21.15.82:0/1426968372 >> 172.21.15.82:0/1426968372 conn(0x564926520580 msgr2=0x56492651f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efee6169740 1 -- 172.21.15.82:0/1426968372 shutdown_connections 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.490+0000 7efee6169740 1 -- 172.21.15.82:0/1426968372 wait complete. 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee6169740 1 -- start start 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee6169740 1 Processor -- start 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee6169740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926525e50 0x5649265335a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee6169740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926526770 0x564926533ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee6169740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56492652f350 0x56492659e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee6169740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efedc1abc70 con 0x56492652f350 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee6169740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efedc1ad0e0 con 0x564926525e50 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee6169740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efedc1ac340 con 0x564926526770 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee6169740 10 client.0 _ll_register_callbacks cb 0x7efed801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee1a41640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56492652f350 0x56492659e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee1a41640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56492652f350 0x56492659e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55380/0 (socket says 172.21.15.82:55380) 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee1a41640 1 -- 172.21.15.82:0/328784468 learned_addr learned my addr 172.21.15.82:0/328784468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee1240640 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926525e50 0x5649265335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.491+0000 7efee0a3f640 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926526770 0x564926533ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee1a41640 1 -- 172.21.15.82:0/328784468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926526770 msgr2=0x564926533ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee1a41640 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926526770 0x564926533ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee1a41640 1 -- 172.21.15.82:0/328784468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926525e50 msgr2=0x5649265335a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee1a41640 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926525e50 0x5649265335a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee1a41640 1 -- 172.21.15.82:0/328784468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649262c5f70 con 0x56492652f350 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee1240640 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926525e50 0x5649265335a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee1a41640 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56492652f350 0x56492659e3d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7efed40049d0 tx=0x7efed409c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1600145de6725564 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efec4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efec4ff9640 1 -- 172.21.15.82:0/328784468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed409c880 con 0x56492652f350 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efec4ff9640 1 -- 172.21.15.82:0/328784468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7efed4060e30 con 0x56492652f350 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee6169740 1 -- 172.21.15.82:0/328784468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efed8009af0 con 0x56492652f350 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efec4ff9640 1 -- 172.21.15.82:0/328784468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7efed40a0c30 con 0x56492652f350 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee6169740 10 client.15645 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee6169740 1 -- 172.21.15.82:0/328784468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x56492615d170 con 0x56492652f350 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efec4ff9640 1 -- 172.21.15.82:0/328784468 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efed8009af0 con 0x56492652f350 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efec4ff9640 1 -- 172.21.15.82:0/328784468 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7efed40a50f0 con 0x56492652f350 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee6169740 10 client.15645 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee6169740 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee6169740 20 client.15645 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee6169740 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649265a61c0 0x5649265a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee6169740 4 client.15645 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.492+0000 7efee6169740 1 -- 172.21.15.82:0/328784468 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564926490cc0 con 0x5649265a61c0 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.493+0000 7efee1240640 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649265a61c0 0x5649265a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.493+0000 7efec4ff9640 10 client.15645 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.493+0000 7efee1240640 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649265a61c0 0x5649265a85e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e20f84a3495f7a22 server_cookie=35a60025740ff5ab in_seq=0 out_seq=0 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efec4ff9640 1 -- 172.21.15.82:0/328784468 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564926490cc0 con 0x5649265a61c0 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efec4ff9640 10 client.15645 handle_command_reply: tid=0 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 client.15645 shutdown 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 -- 172.21.15.82:0/328784468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56492652f350 msgr2=0x56492659e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56492652f350 0x56492659e3d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7efed40049d0 tx=0x7efed409c2a0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 -- 172.21.15.82:0/328784468 shutdown_connections 2024-03-27T07:24:12.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5649265a61c0 0x5649265a85e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56492652f350 0x56492659e3d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564926526770 0x564926533ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 --2- 172.21.15.82:0/328784468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564926525e50 0x5649265335a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 -- 172.21.15.82:0/328784468 >> 172.21.15.82:0/328784468 conn(0x564926520580 msgr2=0x564926526b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efec4ff9640 0 client.15645 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 -- 172.21.15.82:0/328784468 shutdown_connections 2024-03-27T07:24:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 1 -- 172.21.15.82:0/328784468 wait complete. 2024-03-27T07:24:12.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.494+0000 7efee6169740 20 client.15645 trim_cache size 0 max 16384 2024-03-27T07:24:12.503 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:24:12.503 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-03-27T07:24:12.504 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "5d880230-f55f-4528-90fa-b7b3e7b34514", 2024-03-27T07:24:12.504 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-03-27T07:24:12.504 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:24:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 -- 172.21.15.82:0/1089473798 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efec80a38a0 msgr2=0x7efec80a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efec80a38a0 0x7efec80a5d60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efecc005ab0 tx=0x7efecc005e20 comp rx=0 tx=0).stop 2024-03-27T07:24:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 -- 172.21.15.82:0/1089473798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efedc107b80 msgr2=0x7efedc19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efedc107b80 0x7efedc19ccc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efed400eb10 tx=0x7efed400c2d0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 -- 172.21.15.82:0/1089473798 shutdown_connections 2024-03-27T07:24:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efec80a38a0 0x7efec80a5d60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efedc107b80 0x7efedc19ccc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efedc1024a0 0x7efedc198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 --2- 172.21.15.82:0/1089473798 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efedc101ae0 0x7efedc198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 -- 172.21.15.82:0/1089473798 >> 172.21.15.82:0/1089473798 conn(0x7efedc078f50 msgr2=0x7efedc104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 -- 172.21.15.82:0/1089473798 shutdown_connections 2024-03-27T07:24:12.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.495+0000 7efee34a4640 1 -- 172.21.15.82:0/1089473798 wait complete. 2024-03-27T07:24:12.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:12 smithi149 ceph-mon[36065]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-03-27T07:24:12.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:24:12.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:24:12.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:12 smithi153 ceph-mon[36179]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-03-27T07:24:12.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.654+0000 7fa403847640 1 -- 172.21.15.82:0/132692573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3fc1069d0 msgr2=0x7fa3fc106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.654+0000 7fa403847640 1 --2- 172.21.15.82:0/132692573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3fc1069d0 0x7fa3fc106db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4009ca0 tx=0x7fa3f402c100 comp rx=0 tx=0).stop 2024-03-27T07:24:12.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.654+0000 7fa403847640 1 -- 172.21.15.82:0/132692573 shutdown_connections 2024-03-27T07:24:12.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.654+0000 7fa403847640 1 --2- 172.21.15.82:0/132692573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3fc101380 0x7fa3fc10d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.654+0000 7fa403847640 1 --2- 172.21.15.82:0/132692573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3fc1009c0 0x7fa3fc100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.654+0000 7fa403847640 1 --2- 172.21.15.82:0/132692573 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3fc1069d0 0x7fa3fc106db0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.654+0000 7fa403847640 1 -- 172.21.15.82:0/132692573 >> 172.21.15.82:0/132692573 conn(0x7fa3fc077b50 msgr2=0x7fa3fc077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.654+0000 7fa403847640 1 -- 172.21.15.82:0/132692573 shutdown_connections 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.654+0000 7fa403847640 1 -- 172.21.15.82:0/132692573 wait complete. 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa403847640 1 Processor -- start 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa403847640 1 -- start start 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa403847640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3fc1009c0 0x7fa3fc1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa403847640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3fc101380 0x7fa3fc197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa403847640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3fc1069d0 0x7fa3fc19bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa403847640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc110de0 con 0x7fa3fc101380 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa403847640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc110c60 con 0x7fa3fc1069d0 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa403847640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc110f60 con 0x7fa3fc1009c0 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa400de2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3fc101380 0x7fa3fc197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa4015e3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3fc1009c0 0x7fa3fc1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa400de2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3fc101380 0x7fa3fc197800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55396/0 (socket says 172.21.15.82:55396) 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa400de2640 1 -- 172.21.15.82:0/1757714831 learned_addr learned my addr 172.21.15.82:0/1757714831 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:12.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa401de4640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3fc1069d0 0x7fa3fc19bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa4015e3640 1 -- 172.21.15.82:0/1757714831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3fc1069d0 msgr2=0x7fa3fc19bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa4015e3640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3fc1069d0 0x7fa3fc19bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa4015e3640 1 -- 172.21.15.82:0/1757714831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3fc101380 msgr2=0x7fa3fc197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa4015e3640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3fc101380 0x7fa3fc197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa4015e3640 1 -- 172.21.15.82:0/1757714831 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3fc19c2b0 con 0x7fa3fc1009c0 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa400de2640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3fc101380 0x7fa3fc197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.655+0000 7fa4015e3640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3fc1009c0 0x7fa3fc1972c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4005cc0 tx=0x7fa3f402ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.656+0000 7fa3f27fc640 1 -- 172.21.15.82:0/1757714831 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4042020 con 0x7fa3fc1009c0 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.656+0000 7fa403847640 1 -- 172.21.15.82:0/1757714831 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3fc19c540 con 0x7fa3fc1009c0 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.656+0000 7fa3f27fc640 1 -- 172.21.15.82:0/1757714831 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f4034640 con 0x7fa3fc1009c0 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.656+0000 7fa3f27fc640 1 -- 172.21.15.82:0/1757714831 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f4039040 con 0x7fa3fc1009c0 2024-03-27T07:24:12.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.656+0000 7fa403847640 1 -- 172.21.15.82:0/1757714831 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3fc1a3e30 con 0x7fa3fc1009c0 2024-03-27T07:24:12.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.658+0000 7fa3f27fc640 1 -- 172.21.15.82:0/1757714831 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7fa3f4045020 con 0x7fa3fc1009c0 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.658+0000 7fa406432740 1 Processor -- start 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.658+0000 7fa406432740 1 -- start start 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.658+0000 7fa3f27fc640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa3e80a38a0 0x7fa3e80a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.658+0000 7fa406432740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6af630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.658+0000 7fa406432740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 0x564dfb6b8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.658+0000 7fa406432740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6b8750 0x564dfb6bab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.658+0000 7fa406432740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564dfb613860 con 0x564dfb6af250 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.658+0000 7fa406432740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x564dfb5bb8d0 con 0x564dfb6afb70 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.658+0000 7fa406432740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564dfb60f810 con 0x564dfb6b8750 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa401de4640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa3e80a38a0 0x7fa3e80a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa4015e3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa400de2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 0x564dfb6b8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa4015e3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55408/0 (socket says 172.21.15.82:55408) 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa4015e3640 1 -- 172.21.15.82:0/2257387859 learned_addr learned my addr 172.21.15.82:0/2257387859 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa401de4640 1 --2- 172.21.15.82:0/2257387859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6b8750 0x564dfb6bab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa3f27fc640 1 -- 172.21.15.82:0/1757714831 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa3f40f2000 con 0x7fa3fc1009c0 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa4015e3640 1 -- 172.21.15.82:0/2257387859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6b8750 msgr2=0x564dfb6bab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa4015e3640 1 --2- 172.21.15.82:0/2257387859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6b8750 0x564dfb6bab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa4015e3640 1 -- 172.21.15.82:0/2257387859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 msgr2=0x564dfb6b8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa4015e3640 1 --2- 172.21.15.82:0/2257387859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 0x564dfb6b8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa4015e3640 1 -- 172.21.15.82:0/2257387859 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dfb5c6120 con 0x564dfb6af250 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa400de2640 1 --2- 172.21.15.82:0/2257387859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 0x564dfb6b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa401de4640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa3e80a38a0 0x7fa3e80a5d60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8013840 tx=0x7fa3f80099d0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa4015e3640 1 --2- 172.21.15.82:0/2257387859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6af630 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40efda0 tx=0x7fa3f400b290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c747a0b041f1dfc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa3e77fe640 1 -- 172.21.15.82:0/2257387859 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40bdad0 con 0x564dfb6af250 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa3e77fe640 1 -- 172.21.15.82:0/2257387859 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f4034920 con 0x564dfb6af250 2024-03-27T07:24:12.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.659+0000 7fa3e77fe640 1 -- 172.21.15.82:0/2257387859 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40d7700 con 0x564dfb6af250 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 -- 172.21.15.82:0/2257387859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 msgr2=0x564dfb6af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 --2- 172.21.15.82:0/2257387859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6af630 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40efda0 tx=0x7fa3f400b290 comp rx=0 tx=0).stop 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 -- 172.21.15.82:0/2257387859 shutdown_connections 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 --2- 172.21.15.82:0/2257387859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6b8750 0x564dfb6bab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 --2- 172.21.15.82:0/2257387859 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 0x564dfb6b8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 --2- 172.21.15.82:0/2257387859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6af630 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 -- 172.21.15.82:0/2257387859 >> 172.21.15.82:0/2257387859 conn(0x564dfb6a9980 msgr2=0x564dfb6a9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 -- 172.21.15.82:0/2257387859 shutdown_connections 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 -- 172.21.15.82:0/2257387859 wait complete. 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 -- start start 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.660+0000 7fa406432740 1 Processor -- start 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa406432740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa406432740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6afb70 0x564dfb6b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa406432740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6b8750 0x564dfb6b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa406432740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564dfb6bb300 con 0x564dfb6af250 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa406432740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x564dfb5cecd0 con 0x564dfb6b8750 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa406432740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564dfb6bb480 con 0x564dfb6afb70 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa406432740 10 client.0 _ll_register_callbacks cb 0x564dfb5c0ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa4015e3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa4015e3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55418/0 (socket says 172.21.15.82:55418) 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa4015e3640 1 -- 172.21.15.82:0/2036802466 learned_addr learned my addr 172.21.15.82:0/2036802466 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa400de2640 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6afb70 0x564dfb6b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa401de4640 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6b8750 0x564dfb6b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa4015e3640 1 -- 172.21.15.82:0/2036802466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6afb70 msgr2=0x564dfb6b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa4015e3640 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6afb70 0x564dfb6b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa4015e3640 1 -- 172.21.15.82:0/2036802466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6b8750 msgr2=0x564dfb6b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa4015e3640 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6b8750 0x564dfb6b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa4015e3640 1 -- 172.21.15.82:0/2036802466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dfb3f17d0 con 0x564dfb6af250 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa4015e3640 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b5730 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40be100 tx=0x7fa3f4032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab006816a39e8cd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa3e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/2036802466 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40d78e0 con 0x564dfb6af250 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/2036802466 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa3f40c2110 con 0x564dfb6af250 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.661+0000 7fa406432740 1 -- 172.21.15.82:0/2036802466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f4034920 con 0x564dfb6af250 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/2036802466 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa3f40bdad0 con 0x564dfb6af250 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa406432740 10 client.15657 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa406432740 1 -- 172.21.15.82:0/2036802466 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564dfb3273f0 con 0x564dfb6af250 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/2036802466 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3f4034920 con 0x564dfb6af250 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/2036802466 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa3f40b8ce0 con 0x564dfb6af250 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa406432740 10 client.15657 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa406432740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa406432740 20 client.15657 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa406432740 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x564dfb6ca850 0x564dfb6ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa406432740 4 client.15657 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa406432740 1 -- 172.21.15.82:0/2036802466 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dfb620da0 con 0x564dfb6ca850 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.662+0000 7fa400de2640 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x564dfb6ca850 0x564dfb6ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa400de2640 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x564dfb6ca850 0x564dfb6ccc40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9aba01fde906b13 server_cookie=f5defa7e2ca6f268 in_seq=0 out_seq=0 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa3e4ff9640 10 client.15657 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/2036802466 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x564dfb620da0 con 0x564dfb6ca850 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa3e4ff9640 10 client.15657 handle_command_reply: tid=0 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 client.15657 shutdown 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 -- 172.21.15.82:0/2036802466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 msgr2=0x564dfb6b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b5730 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40be100 tx=0x7fa3f4032fc0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 -- 172.21.15.82:0/2036802466 shutdown_connections 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6b8750 0x564dfb6b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6afb70 0x564dfb6b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x564dfb6ca850 0x564dfb6ccc40 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 --2- 172.21.15.82:0/2036802466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b5730 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa3e4ff9640 0 client.15657 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:12.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 -- 172.21.15.82:0/2036802466 >> 172.21.15.82:0/2036802466 conn(0x564dfb6a9980 msgr2=0x564dfb6ab6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 -- 172.21.15.82:0/2036802466 shutdown_connections 2024-03-27T07:24:12.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.663+0000 7fa406432740 1 -- 172.21.15.82:0/2036802466 wait complete. 2024-03-27T07:24:12.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.664+0000 7fa406432740 20 client.15657 trim_cache size 0 max 16384 2024-03-27T07:24:12.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa406432740 1 Processor -- start 2024-03-27T07:24:12.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa406432740 1 -- start start 2024-03-27T07:24:12.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa406432740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6af250 0x564dfb6b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa406432740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6afb70 0x564dfb6c0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa406432740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6b8750 0x564dfb6c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa406432740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc1addf0 con 0x564dfb6afb70 2024-03-27T07:24:12.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa406432740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc1ab6c0 con 0x564dfb6b8750 2024-03-27T07:24:12.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa406432740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc1a9530 con 0x564dfb6af250 2024-03-27T07:24:12.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa400de2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6afb70 0x564dfb6c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa400de2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6afb70 0x564dfb6c0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55434/0 (socket says 172.21.15.82:55434) 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa400de2640 1 -- 172.21.15.82:0/2701340448 learned_addr learned my addr 172.21.15.82:0/2701340448 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa401de4640 1 --2- 172.21.15.82:0/2701340448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6b8750 0x564dfb6c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa4015e3640 1 --2- 172.21.15.82:0/2701340448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6af250 0x564dfb6b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa400de2640 1 -- 172.21.15.82:0/2701340448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6af250 msgr2=0x564dfb6b7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa400de2640 1 --2- 172.21.15.82:0/2701340448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6af250 0x564dfb6b7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa400de2640 1 -- 172.21.15.82:0/2701340448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6b8750 msgr2=0x564dfb6c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa400de2640 1 --2- 172.21.15.82:0/2701340448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6b8750 0x564dfb6c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa400de2640 1 -- 172.21.15.82:0/2701340448 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dfb6af9a0 con 0x564dfb6afb70 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.681+0000 7fa4015e3640 1 --2- 172.21.15.82:0/2701340448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6af250 0x564dfb6b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa400de2640 1 --2- 172.21.15.82:0/2701340448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6afb70 0x564dfb6c0950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec012740 tx=0x7fa3ec005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2801abf46bad035 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa3e6ffd640 1 -- 172.21.15.82:0/2701340448 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec005020 con 0x564dfb6afb70 2024-03-27T07:24:12.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa3e6ffd640 1 -- 172.21.15.82:0/2701340448 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3ec00f850 con 0x564dfb6afb70 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa3e6ffd640 1 -- 172.21.15.82:0/2701340448 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec0223d0 con 0x564dfb6afb70 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa406432740 1 -- 172.21.15.82:0/2701340448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6afb70 msgr2=0x564dfb6c0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa406432740 1 --2- 172.21.15.82:0/2701340448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6afb70 0x564dfb6c0950 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec012740 tx=0x7fa3ec005f90 comp rx=0 tx=0).stop 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa406432740 1 -- 172.21.15.82:0/2701340448 shutdown_connections 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa406432740 1 --2- 172.21.15.82:0/2701340448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6afb70 0x564dfb6c0950 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa406432740 1 --2- 172.21.15.82:0/2701340448 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6b8750 0x564dfb6c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa406432740 1 --2- 172.21.15.82:0/2701340448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6af250 0x564dfb6b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa406432740 1 -- 172.21.15.82:0/2701340448 >> 172.21.15.82:0/2701340448 conn(0x564dfb6a9980 msgr2=0x564dfb6a8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa406432740 1 -- 172.21.15.82:0/2701340448 shutdown_connections 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.682+0000 7fa406432740 1 -- 172.21.15.82:0/2701340448 wait complete. 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa406432740 1 -- start start 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa406432740 1 Processor -- start 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa406432740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa406432740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 0x564dfb6d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa406432740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6b8750 0x564dfb6d2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa406432740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc1a9b80 con 0x564dfb6af250 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa406432740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc1aaff0 con 0x564dfb6afb70 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa406432740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa3fc1aa250 con 0x564dfb6b8750 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa406432740 10 client.0 _ll_register_callbacks cb 0x7fa3f4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa4015e3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa4015e3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55446/0 (socket says 172.21.15.82:55446) 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa4015e3640 1 -- 172.21.15.82:0/1997743809 learned_addr learned my addr 172.21.15.82:0/1997743809 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa400de2640 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 0x564dfb6d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.683+0000 7fa401de4640 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6b8750 0x564dfb6d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa4015e3640 1 -- 172.21.15.82:0/1997743809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6b8750 msgr2=0x564dfb6d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa4015e3640 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6b8750 0x564dfb6d2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa4015e3640 1 -- 172.21.15.82:0/1997743809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 msgr2=0x564dfb6d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:12.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa4015e3640 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 0x564dfb6d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa4015e3640 1 -- 172.21.15.82:0/1997743809 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dfb2e70f0 con 0x564dfb6af250 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa4015e3640 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b3360 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40bde70 tx=0x7fa3f400b290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da12244051f20e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa3e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/1997743809 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f40bdf40 con 0x564dfb6af250 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/1997743809 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa3f40c6b50 con 0x564dfb6af250 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa406432740 1 -- 172.21.15.82:0/1997743809 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3ec00f850 con 0x564dfb6af250 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/1997743809 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa3f4034920 con 0x564dfb6af250 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa406432740 10 client.15663 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.684+0000 7fa406432740 1 -- 172.21.15.82:0/1997743809 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x564dfb2e70f0 con 0x564dfb6af250 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.685+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/1997743809 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3ec00f850 con 0x564dfb6af250 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.685+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/1997743809 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fa3f40b8ce0 con 0x564dfb6af250 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.685+0000 7fa406432740 10 client.15663 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.685+0000 7fa406432740 10 client.15663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:12.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.685+0000 7fa406432740 20 client.15663 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.685+0000 7fa406432740 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x564dfb732cf0 0x564dfb735110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.685+0000 7fa406432740 4 client.15663 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.685+0000 7fa406432740 1 -- 172.21.15.82:0/1997743809 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564dfb61b0f0 con 0x564dfb732cf0 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.685+0000 7fa400de2640 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x564dfb732cf0 0x564dfb735110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa3e4ff9640 10 client.15663 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa400de2640 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x564dfb732cf0 0x564dfb735110 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c60e41680b9a7bb5 server_cookie=877169662fbd557 in_seq=0 out_seq=0 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa3e4ff9640 1 -- 172.21.15.82:0/1997743809 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564dfb61b0f0 con 0x564dfb732cf0 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa3e4ff9640 10 client.15663 handle_command_reply: tid=0 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 client.15663 shutdown 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 -- 172.21.15.82:0/1997743809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 msgr2=0x564dfb6b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b3360 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40bde70 tx=0x7fa3f400b290 comp rx=0 tx=0).stop 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 -- 172.21.15.82:0/1997743809 shutdown_connections 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564dfb6b8750 0x564dfb6d2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564dfb6afb70 0x564dfb6d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x564dfb732cf0 0x564dfb735110 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 --2- 172.21.15.82:0/1997743809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564dfb6af250 0x564dfb6b3360 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 -- 172.21.15.82:0/1997743809 >> 172.21.15.82:0/1997743809 conn(0x564dfb6a9980 msgr2=0x564dfb6a8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa3e4ff9640 0 client.15663 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:12.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 -- 172.21.15.82:0/1997743809 shutdown_connections 2024-03-27T07:24:12.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 1 -- 172.21.15.82:0/1997743809 wait complete. 2024-03-27T07:24:12.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.686+0000 7fa406432740 20 client.15663 trim_cache size 0 max 16384 2024-03-27T07:24:12.695 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:24:12.695 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-27T07:24:12.695 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-03-27T07:24:12.696 INFO:teuthology.orchestra.run.smithi082.stdout: "5d880230-f55f-4528-90fa-b7b3e7b34514": { 2024-03-27T07:24:12.696 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-03-27T07:24:12.696 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "5d880230-f55f-4528-90fa-b7b3e7b34514", 2024-03-27T07:24:12.696 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-03-27T07:24:12.696 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:24:12.696 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:24:12.696 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 -- 172.21.15.82:0/1757714831 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa3e80a38a0 msgr2=0x7fa3e80a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa3e80a38a0 0x7fa3e80a5d60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8013840 tx=0x7fa3f80099d0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 -- 172.21.15.82:0/1757714831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3fc1009c0 msgr2=0x7fa3fc1972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3fc1009c0 0x7fa3fc1972c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4005cc0 tx=0x7fa3f402ef90 comp rx=0 tx=0).stop 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 -- 172.21.15.82:0/1757714831 shutdown_connections 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa3e80a38a0 0x7fa3e80a5d60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa3fc101380 0x7fa3fc197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa3fc1069d0 0x7fa3fc19bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 --2- 172.21.15.82:0/1757714831 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa3fc1009c0 0x7fa3fc1972c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 -- 172.21.15.82:0/1757714831 >> 172.21.15.82:0/1757714831 conn(0x7fa3fc077b50 msgr2=0x7fa3fc103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:12.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 -- 172.21.15.82:0/1757714831 shutdown_connections 2024-03-27T07:24:12.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:12.687+0000 7fa403847640 1 -- 172.21.15.82:0/1757714831 wait complete. 2024-03-27T07:24:12.699 INFO:tasks.cephfs.filesystem:scrub status for tag:5d880230-f55f-4528-90fa-b7b3e7b34514 - {'path': '/', 'tag': '5d880230-f55f-4528-90fa-b7b3e7b34514', 'options': 'recursive,force'} 2024-03-27T07:24:13.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:13 smithi082 ceph-mon[32178]: scrub queued for path: / 2024-03-27T07:24:13.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:13 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:13.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:13 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:24:13.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:13 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:13.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:13 smithi149 ceph-mon[36065]: scrub queued for path: / 2024-03-27T07:24:13.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:13 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:13.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:13 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:24:13.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:13 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:13.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:13 smithi153 ceph-mon[36179]: scrub queued for path: / 2024-03-27T07:24:13.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:13 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:13.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:13 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:24:13.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:13 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:14.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:14 smithi082 ceph-mon[32178]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-27T07:24:14.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:14 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:24:14.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:14 smithi149 ceph-mon[36065]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-27T07:24:14.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:14 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:24:14.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:14 smithi153 ceph-mon[36179]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-27T07:24:14.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:14 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:24:16.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:16 smithi082 ceph-mon[32178]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-27T07:24:16.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:16 smithi149 ceph-mon[36065]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-27T07:24:16.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:16 smithi153 ceph-mon[36179]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-03-27T07:24:18.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:18 smithi082 ceph-mon[32178]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-03-27T07:24:18.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:18 smithi149 ceph-mon[36065]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-03-27T07:24:18.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:18 smithi153 ceph-mon[36179]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-03-27T07:24:20.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:20 smithi082 ceph-mon[32178]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-27T07:24:20.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:20 smithi149 ceph-mon[36065]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-27T07:24:20.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:20 smithi153 ceph-mon[36179]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-27T07:24:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.026+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1194272440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c107b40 msgr2=0x7fe89c107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.026+0000 7fe8a0fe2640 1 --2- 172.21.15.82:0/1194272440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c107b40 0x7fe89c107f20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe890009ca0 tx=0x7fe89002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.026+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1194272440 shutdown_connections 2024-03-27T07:24:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.026+0000 7fe8a0fe2640 1 --2- 172.21.15.82:0/1194272440 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89c06ad70 0x7fe89c10e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.026+0000 7fe8a0fe2640 1 --2- 172.21.15.82:0/1194272440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe89c06a3d0 0x7fe89c06a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.026+0000 7fe8a0fe2640 1 --2- 172.21.15.82:0/1194272440 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c107b40 0x7fe89c107f20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.026+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1194272440 >> 172.21.15.82:0/1194272440 conn(0x7fe89c0778a0 msgr2=0x7fe89c077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.026+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1194272440 shutdown_connections 2024-03-27T07:24:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.026+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1194272440 wait complete. 2024-03-27T07:24:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe8a0fe2640 1 Processor -- start 2024-03-27T07:24:21.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe8a0fe2640 1 -- start start 2024-03-27T07:24:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe8a0fe2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89c06a3d0 0x7fe89c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe8a0fe2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe89c06ad70 0x7fe89c1988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe8a0fe2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c107b40 0x7fe89c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe8a0fe2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c111f20 con 0x7fe89c107b40 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe8a0fe2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c111da0 con 0x7fe89c06a3d0 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe8a0fe2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1120a0 con 0x7fe89c06ad70 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c107b40 0x7fe89c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89c06a3d0 0x7fe89c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe899d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe89c06ad70 0x7fe89c1988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89c06a3d0 0x7fe89c198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:60066/0 (socket says 172.21.15.82:60066) 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c107b40 0x7fe89c19cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32896/0 (socket says 172.21.15.82:32896) 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe899d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe89c06ad70 0x7fe89c1988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:49998/0 (socket says 172.21.15.82:49998) 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89a59c640 1 -- 172.21.15.82:0/1096840485 learned_addr learned my addr 172.21.15.82:0/1096840485 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89a59c640 1 -- 172.21.15.82:0/1096840485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe89c06ad70 msgr2=0x7fe89c1988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89a59c640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe89c06ad70 0x7fe89c1988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89a59c640 1 -- 172.21.15.82:0/1096840485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c107b40 msgr2=0x7fe89c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89a59c640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c107b40 0x7fe89c19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89a59c640 1 -- 172.21.15.82:0/1096840485 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89c19d350 con 0x7fe89c06a3d0 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe899d9b640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe89c06ad70 0x7fe89c1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.027+0000 7fe89ad9d640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c107b40 0x7fe89c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.028+0000 7fe89a59c640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89c06a3d0 0x7fe89c198360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe890005e30 tx=0x7fe890032f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.028+0000 7fe88b7fe640 1 -- 172.21.15.82:0/1096840485 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890042020 con 0x7fe89c06a3d0 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.028+0000 7fe88b7fe640 1 -- 172.21.15.82:0/1096840485 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe890034640 con 0x7fe89c06a3d0 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.028+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1096840485 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89c19d5e0 con 0x7fe89c06a3d0 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.028+0000 7fe88b7fe640 1 -- 172.21.15.82:0/1096840485 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe890039040 con 0x7fe89c06a3d0 2024-03-27T07:24:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.028+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1096840485 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe89c1a4ed0 con 0x7fe89c06a3d0 2024-03-27T07:24:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.030+0000 7fe88b7fe640 1 -- 172.21.15.82:0/1096840485 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7fe890045020 con 0x7fe89c06a3d0 2024-03-27T07:24:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.030+0000 7fe8a3bd1740 1 Processor -- start 2024-03-27T07:24:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe8a3bd1740 1 -- start start 2024-03-27T07:24:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe88b7fe640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe8840a3940 0x7fe8840a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68c0f0 0x55e00a68c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 0x55e00a6952a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a6957e0 0x55e00a697bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e00a652cd0 con 0x55e00a6957e0 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e00a597950 con 0x55e00a68c0f0 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e00a5efe50 con 0x55e00a68ca10 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe89ad9d640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe8840a3940 0x7fe8840a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe89a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68c0f0 0x55e00a68c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe89ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a6957e0 0x55e00a697bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe89a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68c0f0 0x55e00a68c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:60068/0 (socket says 172.21.15.82:60068) 2024-03-27T07:24:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe899d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 0x55e00a6952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe89a59c640 1 -- 172.21.15.82:0/3971807881 learned_addr learned my addr 172.21.15.82:0/3971807881 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.031+0000 7fe88b7fe640 1 -- 172.21.15.82:0/1096840485 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe8900f2240 con 0x7fe89c06a3d0 2024-03-27T07:24:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe89a59c640 1 -- 172.21.15.82:0/3971807881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 msgr2=0x55e00a6952a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe89a59c640 1 --2- 172.21.15.82:0/3971807881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 0x55e00a6952a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe89a59c640 1 -- 172.21.15.82:0/3971807881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a6957e0 msgr2=0x55e00a697bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe89a59c640 1 --2- 172.21.15.82:0/3971807881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a6957e0 0x55e00a697bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe89a59c640 1 -- 172.21.15.82:0/3971807881 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00a304210 con 0x55e00a68c0f0 2024-03-27T07:24:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe899d9b640 1 --2- 172.21.15.82:0/3971807881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 0x55e00a6952a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe89ad9d640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe8840a3940 0x7fe8840a5e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8940095f0 tx=0x7fe894009ed0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe89a59c640 1 --2- 172.21.15.82:0/3971807881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68c0f0 0x55e00a68c4d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe8900ba6e0 tx=0x7fe890032b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe608ade6efbd6e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe888ff9640 1 -- 172.21.15.82:0/3971807881 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900c3dc0 con 0x55e00a68c0f0 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe888ff9640 1 -- 172.21.15.82:0/3971807881 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8900be980 con 0x55e00a68c0f0 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.032+0000 7fe888ff9640 1 -- 172.21.15.82:0/3971807881 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900c37c0 con 0x55e00a68c0f0 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3971807881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68c0f0 msgr2=0x55e00a68c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/3971807881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68c0f0 0x55e00a68c4d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe8900ba6e0 tx=0x7fe890032b00 comp rx=0 tx=0).stop 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3971807881 shutdown_connections 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/3971807881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a6957e0 0x55e00a697bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/3971807881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 0x55e00a6952a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/3971807881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68c0f0 0x55e00a68c4d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3971807881 >> 172.21.15.82:0/3971807881 conn(0x55e00a686a10 msgr2=0x55e00a686df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3971807881 shutdown_connections 2024-03-27T07:24:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3971807881 wait complete. 2024-03-27T07:24:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 -- start start 2024-03-27T07:24:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.033+0000 7fe8a3bd1740 1 Processor -- start 2024-03-27T07:24:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68c0f0 0x55e00a6927a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68ca10 0x55e00a692ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 0x55e00a693220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e00a5ebe00 con 0x55e00a68ca10 2024-03-27T07:24:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e00a598520 con 0x55e00a6957e0 2024-03-27T07:24:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e00a5ab8e0 con 0x55e00a68c0f0 2024-03-27T07:24:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe899d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68ca10 0x55e00a692ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe8a3bd1740 10 client.0 _ll_register_callbacks cb 0x55e00a5e6a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe899d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68ca10 0x55e00a692ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32922/0 (socket says 172.21.15.82:32922) 2024-03-27T07:24:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe899d9b640 1 -- 172.21.15.82:0/3382146333 learned_addr learned my addr 172.21.15.82:0/3382146333 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe89ad9d640 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 0x55e00a693220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe89a59c640 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68c0f0 0x55e00a6927a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe899d9b640 1 -- 172.21.15.82:0/3382146333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68c0f0 msgr2=0x55e00a6927a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe899d9b640 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68c0f0 0x55e00a6927a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe899d9b640 1 -- 172.21.15.82:0/3382146333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 msgr2=0x55e00a693220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe899d9b640 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 0x55e00a693220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe899d9b640 1 -- 172.21.15.82:0/3382146333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e00a3d0620 con 0x55e00a68ca10 2024-03-27T07:24:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe899d9b640 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68ca10 0x55e00a692ce0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe88c012b40 tx=0x7fe88c012f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc6e514aeb909c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe881ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe881ffb640 1 -- 172.21.15.82:0/3382146333 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00faa0 con 0x55e00a68ca10 2024-03-27T07:24:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe881ffb640 1 -- 172.21.15.82:0/3382146333 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe88c00fc40 con 0x55e00a68ca10 2024-03-27T07:24:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3382146333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8900be980 con 0x55e00a68ca10 2024-03-27T07:24:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe881ffb640 1 -- 172.21.15.82:0/3382146333 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe88c00fe40 con 0x55e00a68ca10 2024-03-27T07:24:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe8a3bd1740 10 client.15675 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.034+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3382146333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55e00a6a4060 con 0x55e00a68ca10 2024-03-27T07:24:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe881ffb640 1 -- 172.21.15.82:0/3382146333 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8900be980 con 0x55e00a68ca10 2024-03-27T07:24:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe881ffb640 1 -- 172.21.15.82:0/3382146333 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fe88c01c5b0 con 0x55e00a68ca10 2024-03-27T07:24:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe8a3bd1740 10 client.15675 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe8a3bd1740 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe8a3bd1740 20 client.15675 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e00a6a5610 0x55e00a6a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe8a3bd1740 4 client.15675 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3382146333 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e00a5fd390 con 0x55e00a6a5610 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe89a59c640 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e00a6a5610 0x55e00a6a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe89a59c640 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e00a6a5610 0x55e00a6a7a60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9abd67cda6e0d5d1 server_cookie=3c76109f64a32dec in_seq=0 out_seq=0 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.035+0000 7fe881ffb640 10 client.15675 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe881ffb640 1 -- 172.21.15.82:0/3382146333 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e00a5fd390 con 0x55e00a6a5610 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe881ffb640 10 client.15675 handle_command_reply: tid=0 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 client.15675 shutdown 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3382146333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68ca10 msgr2=0x55e00a692ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68ca10 0x55e00a692ce0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe88c012b40 tx=0x7fe88c012f40 comp rx=0 tx=0).stop 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3382146333 shutdown_connections 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e00a6a5610 0x55e00a6a7a60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68ca10 0x55e00a692ce0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 0x55e00a693220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/3382146333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68c0f0 0x55e00a6927a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3382146333 >> 172.21.15.82:0/3382146333 conn(0x55e00a686a10 msgr2=0x55e00a688760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe881ffb640 0 client.15675 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3382146333 shutdown_connections 2024-03-27T07:24:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/3382146333 wait complete. 2024-03-27T07:24:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.036+0000 7fe8a3bd1740 20 client.15675 trim_cache size 0 max 16384 2024-03-27T07:24:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe8a3bd1740 1 Processor -- start 2024-03-27T07:24:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe8a3bd1740 1 -- start start 2024-03-27T07:24:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a694ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 0x55e00a6a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 0x55e00a688570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1aff50 con 0x55e00a68c0f0 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1ad820 con 0x55e00a6957e0 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1ab670 con 0x55e00a68ca10 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe89a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a694ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe89a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a694ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32928/0 (socket says 172.21.15.82:32928) 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe89a59c640 1 -- 172.21.15.82:0/265392929 learned_addr learned my addr 172.21.15.82:0/265392929 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe899d9b640 1 --2- 172.21.15.82:0/265392929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 0x55e00a6a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe89ad9d640 1 --2- 172.21.15.82:0/265392929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 0x55e00a688570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe89a59c640 1 -- 172.21.15.82:0/265392929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 msgr2=0x55e00a6a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe89a59c640 1 --2- 172.21.15.82:0/265392929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 0x55e00a6a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe89a59c640 1 -- 172.21.15.82:0/265392929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 msgr2=0x55e00a688570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe89a59c640 1 --2- 172.21.15.82:0/265392929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 0x55e00a688570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe89a59c640 1 -- 172.21.15.82:0/265392929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00a687390 con 0x55e00a68c0f0 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.051+0000 7fe89ad9d640 1 --2- 172.21.15.82:0/265392929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 0x55e00a688570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe89a59c640 1 --2- 172.21.15.82:0/265392929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a694ed0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe8900be210 tx=0x7fe890005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692c3abc08d8e278 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe883fff640 1 -- 172.21.15.82:0/265392929 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900be980 con 0x55e00a68c0f0 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe883fff640 1 -- 172.21.15.82:0/265392929 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8900c6ef0 con 0x55e00a68c0f0 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe883fff640 1 -- 172.21.15.82:0/265392929 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900bc580 con 0x55e00a68c0f0 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/265392929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 msgr2=0x55e00a694ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/265392929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a694ed0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe8900be210 tx=0x7fe890005f80 comp rx=0 tx=0).stop 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/265392929 shutdown_connections 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/265392929 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a6957e0 0x55e00a688570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/265392929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a68ca10 0x55e00a6a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/265392929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a694ed0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/265392929 >> 172.21.15.82:0/265392929 conn(0x55e00a686a10 msgr2=0x55e00a687e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/265392929 shutdown_connections 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.052+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/265392929 wait complete. 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe8a3bd1740 1 -- start start 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe8a3bd1740 1 Processor -- start 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a69d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68ca10 0x55e00a698730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe8a3bd1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a6957e0 0x55e00a698c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1abce0 con 0x55e00a68c0f0 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1ad150 con 0x55e00a68ca10 2024-03-27T07:24:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe8a3bd1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe89c1ac3b0 con 0x55e00a6957e0 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe8a3bd1740 10 client.0 _ll_register_callbacks cb 0x7fe88c009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe89a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a69d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe89a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a69d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32938/0 (socket says 172.21.15.82:32938) 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe89a59c640 1 -- 172.21.15.82:0/1473345333 learned_addr learned my addr 172.21.15.82:0/1473345333 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe899d9b640 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68ca10 0x55e00a698730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe89ad9d640 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a6957e0 0x55e00a698c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe89a59c640 1 -- 172.21.15.82:0/1473345333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a6957e0 msgr2=0x55e00a698c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe89a59c640 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a6957e0 0x55e00a698c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe89a59c640 1 -- 172.21.15.82:0/1473345333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68ca10 msgr2=0x55e00a698730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe89a59c640 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68ca10 0x55e00a698730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe89a59c640 1 -- 172.21.15.82:0/1473345333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e00a6992e0 con 0x55e00a68c0f0 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.053+0000 7fe899d9b640 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68ca10 0x55e00a698730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe89a59c640 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a69d2a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe890009430 tx=0x7fe8900095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62126c8146db0d21 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe881ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe881ffb640 1 -- 172.21.15.82:0/1473345333 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8900bddc0 con 0x55e00a68c0f0 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe881ffb640 1 -- 172.21.15.82:0/1473345333 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe8900c3dc0 con 0x55e00a68c0f0 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/1473345333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8900c6ef0 con 0x55e00a68c0f0 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe881ffb640 1 -- 172.21.15.82:0/1473345333 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe8900c2630 con 0x55e00a68c0f0 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe8a3bd1740 10 client.15681 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/1473345333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55e00a70fc50 con 0x55e00a68c0f0 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe881ffb640 1 -- 172.21.15.82:0/1473345333 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8900c6ef0 con 0x55e00a68c0f0 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe881ffb640 1 -- 172.21.15.82:0/1473345333 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fe8900ba8f0 con 0x55e00a68c0f0 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe8a3bd1740 10 client.15681 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:21.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe8a3bd1740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe8a3bd1740 20 client.15681 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e00a70ff90 0x55e00a712380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe8a3bd1740 4 client.15681 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:24:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/1473345333 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e00a6a7df0 con 0x55e00a70ff90 2024-03-27T07:24:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.054+0000 7fe899d9b640 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e00a70ff90 0x55e00a712380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.055+0000 7fe881ffb640 10 client.15681 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:21.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.055+0000 7fe899d9b640 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e00a70ff90 0x55e00a712380 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b796b3832f6ef805 server_cookie=93aabcf18e0c9552 in_seq=0 out_seq=0 2024-03-27T07:24:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.060+0000 7fe881ffb640 1 -- 172.21.15.82:0/1473345333 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e00a6a7df0 con 0x55e00a70ff90 2024-03-27T07:24:21.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.060+0000 7fe881ffb640 10 client.15681 handle_command_reply: tid=0 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 client.15681 shutdown 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/1473345333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 msgr2=0x55e00a69d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a69d2a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe890009430 tx=0x7fe8900095e0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/1473345333 shutdown_connections 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e00a6957e0 0x55e00a698c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e00a68ca10 0x55e00a698730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e00a70ff90 0x55e00a712380 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 --2- 172.21.15.82:0/1473345333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e00a68c0f0 0x55e00a69d2a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe881ffb640 0 client.15681 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/1473345333 >> 172.21.15.82:0/1473345333 conn(0x55e00a686a10 msgr2=0x55e00a692fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:21.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/1473345333 shutdown_connections 2024-03-27T07:24:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 1 -- 172.21.15.82:0/1473345333 wait complete. 2024-03-27T07:24:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a3bd1740 20 client.15681 trim_cache size 0 max 16384 2024-03-27T07:24:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:24:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:24:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:24:21.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:24:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1096840485 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe8840a3940 msgr2=0x7fe8840a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a0fe2640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe8840a3940 0x7fe8840a5e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe8940095f0 tx=0x7fe894009ed0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1096840485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89c06a3d0 msgr2=0x7fe89c198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:21.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a0fe2640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89c06a3d0 0x7fe89c198360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe890005e30 tx=0x7fe890032f20 comp rx=0 tx=0).stop 2024-03-27T07:24:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1096840485 shutdown_connections 2024-03-27T07:24:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a0fe2640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe8840a3940 0x7fe8840a5e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a0fe2640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe89c107b40 0x7fe89c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a0fe2640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe89c06ad70 0x7fe89c1988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a0fe2640 1 --2- 172.21.15.82:0/1096840485 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe89c06a3d0 0x7fe89c198360 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.061+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1096840485 >> 172.21.15.82:0/1096840485 conn(0x7fe89c0778a0 msgr2=0x7fe89c0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.062+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1096840485 shutdown_connections 2024-03-27T07:24:21.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:21.062+0000 7fe8a0fe2640 1 -- 172.21.15.82:0/1096840485 wait complete. 2024-03-27T07:24:22.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:22 smithi082 ceph-mon[32178]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-03-27T07:24:22.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:22 smithi149 ceph-mon[36065]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-03-27T07:24:22.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:22 smithi153 ceph-mon[36179]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-03-27T07:24:24.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:24 smithi082 ceph-mon[32178]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-27T07:24:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:24 smithi149 ceph-mon[36065]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-27T07:24:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:24 smithi153 ceph-mon[36179]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-27T07:24:26.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:26 smithi082 ceph-mon[32178]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-27T07:24:26.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:26 smithi149 ceph-mon[36065]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-27T07:24:26.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:26 smithi153 ceph-mon[36179]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-03-27T07:24:28.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:28 smithi082 ceph-mon[32178]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-03-27T07:24:28.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:28 smithi149 ceph-mon[36065]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-03-27T07:24:28.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:28 smithi153 ceph-mon[36179]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-03-27T07:24:30.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:30 smithi082 ceph-mon[32178]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-03-27T07:24:30.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:30 smithi149 ceph-mon[36065]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-03-27T07:24:30.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:30 smithi153 ceph-mon[36179]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.5 KiB/s wr, 7 op/s 2024-03-27T07:24:32.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:32 smithi082 ceph-mon[32178]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-03-27T07:24:32.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:32 smithi149 ceph-mon[36065]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-03-27T07:24:32.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:32 smithi153 ceph-mon[36179]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.5 KiB/s wr, 9 op/s 2024-03-27T07:24:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.151+0000 7f2482a4e640 1 -- 172.21.15.82:0/4220127987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247c101660 msgr2=0x7f247c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.151+0000 7f2482a4e640 1 --2- 172.21.15.82:0/4220127987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247c101660 0x7f247c10d880 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2474009ca0 tx=0x7f247402c0f0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.151+0000 7f2482a4e640 1 -- 172.21.15.82:0/4220127987 shutdown_connections 2024-03-27T07:24:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.151+0000 7f2482a4e640 1 --2- 172.21.15.82:0/4220127987 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247c101660 0x7f247c10d880 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.151+0000 7f2482a4e640 1 --2- 172.21.15.82:0/4220127987 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f247c100ca0 0x7f247c101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.151+0000 7f2482a4e640 1 --2- 172.21.15.82:0/4220127987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f247c1059f0 0x7f247c105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.151+0000 7f2482a4e640 1 -- 172.21.15.82:0/4220127987 >> 172.21.15.82:0/4220127987 conn(0x7f247c0778a0 msgr2=0x7f247c077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.151+0000 7f2482a4e640 1 -- 172.21.15.82:0/4220127987 shutdown_connections 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.151+0000 7f2482a4e640 1 -- 172.21.15.82:0/4220127987 wait complete. 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.152+0000 7f2482a4e640 1 Processor -- start 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.152+0000 7f2482a4e640 1 -- start start 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.152+0000 7f2482a4e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f247c100ca0 0x7f247c1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.152+0000 7f2482a4e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247c101660 0x7f247c197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.152+0000 7f2482a4e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f247c1059f0 0x7f247c19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.152+0000 7f2482a4e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f247c110f10 con 0x7f247c101660 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.152+0000 7f2482a4e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f247c110d90 con 0x7f247c100ca0 2024-03-27T07:24:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.152+0000 7f2482a4e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f247c111090 con 0x7f247c1059f0 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.152+0000 7f247b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247c101660 0x7f247c197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f247bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f247c100ca0 0x7f247c1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f247b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247c101660 0x7f247c197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52842/0 (socket says 172.21.15.82:52842) 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f247b7fe640 1 -- 172.21.15.82:0/2264727738 learned_addr learned my addr 172.21.15.82:0/2264727738 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f2480feb640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f247c1059f0 0x7f247c19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f247b7fe640 1 -- 172.21.15.82:0/2264727738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f247c1059f0 msgr2=0x7f247c19bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f247b7fe640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f247c1059f0 0x7f247c19bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f247b7fe640 1 -- 172.21.15.82:0/2264727738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f247c100ca0 msgr2=0x7f247c1972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f247b7fe640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f247c100ca0 0x7f247c1972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f247b7fe640 1 -- 172.21.15.82:0/2264727738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c19c2e0 con 0x7f247c101660 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f247bfff640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f247c100ca0 0x7f247c1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:34.177 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f247b7fe640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247c101660 0x7f247c197830 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f247000e9f0 tx=0x7f247000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f24797fa640 1 -- 172.21.15.82:0/2264727738 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f247000cd80 con 0x7f247c101660 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f24797fa640 1 -- 172.21.15.82:0/2264727738 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2470010910 con 0x7f247c101660 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f2482a4e640 1 -- 172.21.15.82:0/2264727738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247c19c5d0 con 0x7f247c101660 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f24797fa640 1 -- 172.21.15.82:0/2264727738 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2470018990 con 0x7f247c101660 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.153+0000 7f2482a4e640 1 -- 172.21.15.82:0/2264727738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247c0691d0 con 0x7f247c101660 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f24797fa640 1 -- 172.21.15.82:0/2264727738 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7f2470010ac0 con 0x7f247c101660 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f248563c740 1 Processor -- start 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f248563c740 1 -- start start 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f248563c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 0x563a7d6634d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f248563c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d6706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f248563c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d670bf0 0x563a7d672fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f248563c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563a7d629cd0 con 0x563a7d663a10 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f248563c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563a7d56e950 con 0x563a7d670bf0 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f248563c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563a7d5c6e50 con 0x563a7d6630f0 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f247bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d6706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f247b7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d670bf0 0x563a7d672fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f247bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d6706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52852/0 (socket says 172.21.15.82:52852) 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f247bfff640 1 -- 172.21.15.82:0/449961996 learned_addr learned my addr 172.21.15.82:0/449961996 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f2480feb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 0x563a7d6634d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f24797fa640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f24640a3940 0x7f24640a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f2480feb640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f24640a3940 0x7f24640a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f247bfff640 1 -- 172.21.15.82:0/449961996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 msgr2=0x563a7d6634d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f247bfff640 1 --2- 172.21.15.82:0/449961996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 0x563a7d6634d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.156+0000 7f247bfff640 1 -- 172.21.15.82:0/449961996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d670bf0 msgr2=0x563a7d672fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.157+0000 7f247bfff640 1 --2- 172.21.15.82:0/449961996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d670bf0 0x563a7d672fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.157+0000 7f247bfff640 1 -- 172.21.15.82:0/449961996 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a7d2db210 con 0x563a7d663a10 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.157+0000 7f24797fa640 1 -- 172.21.15.82:0/2264727738 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f24700d06c0 con 0x7f247c101660 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.157+0000 7f247b7fe640 1 --2- 172.21.15.82:0/449961996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d670bf0 0x563a7d672fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.157+0000 7f2480feb640 1 --2- 172.21.15.82:0/449961996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 0x563a7d6634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.157+0000 7f247bfff640 1 --2- 172.21.15.82:0/449961996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d6706b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f246c00e350 tx=0x7f246c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8604b03326cd27 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.157+0000 7f2480feb640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f24640a3940 0x7f24640a5e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2474004af0 tx=0x7f247402c0f0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.157+0000 7f24627fc640 1 -- 172.21.15.82:0/449961996 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c01b070 con 0x563a7d663a10 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.157+0000 7f24627fc640 1 -- 172.21.15.82:0/449961996 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f246c004220 con 0x563a7d663a10 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.157+0000 7f24627fc640 1 -- 172.21.15.82:0/449961996 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c0177e0 con 0x563a7d663a10 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.158+0000 7f248563c740 1 -- 172.21.15.82:0/449961996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 msgr2=0x563a7d6706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.158+0000 7f248563c740 1 --2- 172.21.15.82:0/449961996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d6706b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f246c00e350 tx=0x7f246c005f90 comp rx=0 tx=0).stop 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.158+0000 7f248563c740 1 -- 172.21.15.82:0/449961996 shutdown_connections 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.158+0000 7f248563c740 1 --2- 172.21.15.82:0/449961996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d6706b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.158+0000 7f248563c740 1 --2- 172.21.15.82:0/449961996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d670bf0 0x563a7d672fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.158+0000 7f248563c740 1 --2- 172.21.15.82:0/449961996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 0x563a7d6634d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.158+0000 7f248563c740 1 -- 172.21.15.82:0/449961996 >> 172.21.15.82:0/449961996 conn(0x563a7d65da10 msgr2=0x563a7d65ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.158+0000 7f248563c740 1 -- 172.21.15.82:0/449961996 shutdown_connections 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.158+0000 7f248563c740 1 -- 172.21.15.82:0/449961996 wait complete. 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.158+0000 7f248563c740 1 -- start start 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f248563c740 1 Processor -- start 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f248563c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 0x563a7d66dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f248563c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d663a10 0x563a7d66e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f248563c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d66e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f248563c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563a7d5c2e00 con 0x563a7d670bf0 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f248563c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563a7d56f520 con 0x563a7d663a10 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f248563c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563a7d5828e0 con 0x563a7d6630f0 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f248563c740 10 client.0 _ll_register_callbacks cb 0x563a7d5bda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:34.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f2480feb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d66e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f2480feb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d66e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52858/0 (socket says 172.21.15.82:52858) 2024-03-27T07:24:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f2480feb640 1 -- 172.21.15.82:0/301143917 learned_addr learned my addr 172.21.15.82:0/301143917 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f247bfff640 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 0x563a7d66dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f247b7fe640 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d663a10 0x563a7d66e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f2480feb640 1 -- 172.21.15.82:0/301143917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 msgr2=0x563a7d66dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f2480feb640 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 0x563a7d66dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f2480feb640 1 -- 172.21.15.82:0/301143917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d663a10 msgr2=0x563a7d66e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f2480feb640 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d663a10 0x563a7d66e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.159+0000 7f2480feb640 1 -- 172.21.15.82:0/301143917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a7d3a7620 con 0x563a7d670bf0 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f2480feb640 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d66e680 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2474009ca0 tx=0x7f24740095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61602388d7facb15 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f245b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f245b7fe640 1 -- 172.21.15.82:0/301143917 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474039040 con 0x563a7d670bf0 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f245b7fe640 1 -- 172.21.15.82:0/301143917 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f2474004450 con 0x563a7d670bf0 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f248563c740 1 -- 172.21.15.82:0/301143917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f246c004220 con 0x563a7d670bf0 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f245b7fe640 1 -- 172.21.15.82:0/301143917 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f247405a050 con 0x563a7d670bf0 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f248563c740 10 client.15693 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f248563c740 1 -- 172.21.15.82:0/301143917 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563a7d67f7b0 con 0x563a7d670bf0 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f245b7fe640 1 -- 172.21.15.82:0/301143917 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f246c004220 con 0x563a7d670bf0 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f245b7fe640 1 -- 172.21.15.82:0/301143917 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f247403f070 con 0x563a7d670bf0 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f248563c740 10 client.15693 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:34.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f248563c740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f248563c740 20 client.15693 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f248563c740 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563a7d680ce0 0x563a7d6830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f248563c740 4 client.15693 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f248563c740 1 -- 172.21.15.82:0/301143917 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a7d5d4390 con 0x563a7d680ce0 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.160+0000 7f247bfff640 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563a7d680ce0 0x563a7d6830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.161+0000 7f245b7fe640 10 client.15693 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.161+0000 7f247bfff640 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563a7d680ce0 0x563a7d6830f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dbc144816c0bfad server_cookie=565bae71e0c82f6 in_seq=0 out_seq=0 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f245b7fe640 1 -- 172.21.15.82:0/301143917 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x563a7d5d4390 con 0x563a7d680ce0 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f245b7fe640 10 client.15693 handle_command_reply: tid=0 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 client.15693 shutdown 2024-03-27T07:24:34.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 -- 172.21.15.82:0/301143917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 msgr2=0x563a7d66e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d66e680 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2474009ca0 tx=0x7f24740095c0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 -- 172.21.15.82:0/301143917 shutdown_connections 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563a7d680ce0 0x563a7d6830f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d66e680 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d663a10 0x563a7d66e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f245b7fe640 0 client.15693 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 --2- 172.21.15.82:0/301143917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d6630f0 0x563a7d66dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 -- 172.21.15.82:0/301143917 >> 172.21.15.82:0/301143917 conn(0x563a7d65da10 msgr2=0x563a7d65f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 -- 172.21.15.82:0/301143917 shutdown_connections 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 1 -- 172.21.15.82:0/301143917 wait complete. 2024-03-27T07:24:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.162+0000 7f248563c740 20 client.15693 trim_cache size 0 max 16384 2024-03-27T07:24:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f248563c740 1 Processor -- start 2024-03-27T07:24:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f248563c740 1 -- start start 2024-03-27T07:24:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f248563c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 0x563a7d670330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f248563c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d663a10 0x563a7d67c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f248563c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d688a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f248563c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f247c1add60 con 0x563a7d670bf0 2024-03-27T07:24:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f248563c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f247c1ab630 con 0x563a7d6630f0 2024-03-27T07:24:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f248563c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f247c1a9480 con 0x563a7d663a10 2024-03-27T07:24:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f2480feb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d688a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f2480feb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d688a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52872/0 (socket says 172.21.15.82:52872) 2024-03-27T07:24:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f247b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d663a10 0x563a7d67c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f2480feb640 1 -- 172.21.15.82:0/3599728111 learned_addr learned my addr 172.21.15.82:0/3599728111 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f247bfff640 1 --2- 172.21.15.82:0/3599728111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 0x563a7d670330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f2480feb640 1 -- 172.21.15.82:0/3599728111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d663a10 msgr2=0x563a7d67c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f2480feb640 1 --2- 172.21.15.82:0/3599728111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d663a10 0x563a7d67c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f2480feb640 1 -- 172.21.15.82:0/3599728111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 msgr2=0x563a7d670330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.177+0000 7f2480feb640 1 --2- 172.21.15.82:0/3599728111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 0x563a7d670330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.178+0000 7f2480feb640 1 -- 172.21.15.82:0/3599728111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a7d67c800 con 0x563a7d670bf0 2024-03-27T07:24:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.178+0000 7f247bfff640 1 --2- 172.21.15.82:0/3599728111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 0x563a7d670330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.178+0000 7f247b7fe640 1 --2- 172.21.15.82:0/3599728111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d663a10 0x563a7d67c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.178+0000 7f2480feb640 1 --2- 172.21.15.82:0/3599728111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d688a50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f247402c790 tx=0x7f24740099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff4614baa702187 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.178+0000 7f2461ffb640 1 -- 172.21.15.82:0/3599728111 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474062070 con 0x563a7d670bf0 2024-03-27T07:24:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.178+0000 7f2461ffb640 1 -- 172.21.15.82:0/3599728111 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2474047050 con 0x563a7d670bf0 2024-03-27T07:24:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.178+0000 7f2461ffb640 1 -- 172.21.15.82:0/3599728111 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24740346a0 con 0x563a7d670bf0 2024-03-27T07:24:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 -- 172.21.15.82:0/3599728111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 msgr2=0x563a7d688a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 --2- 172.21.15.82:0/3599728111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d688a50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f247402c790 tx=0x7f24740099a0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 -- 172.21.15.82:0/3599728111 shutdown_connections 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 --2- 172.21.15.82:0/3599728111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d670bf0 0x563a7d688a50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 --2- 172.21.15.82:0/3599728111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d663a10 0x563a7d67c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 --2- 172.21.15.82:0/3599728111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 0x563a7d670330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 -- 172.21.15.82:0/3599728111 >> 172.21.15.82:0/3599728111 conn(0x563a7d65da10 msgr2=0x563a7d6585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 -- 172.21.15.82:0/3599728111 shutdown_connections 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 -- 172.21.15.82:0/3599728111 wait complete. 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 -- start start 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.179+0000 7f248563c740 1 Processor -- start 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f248563c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 0x563a7d66aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.200 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f248563c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d66aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f248563c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d670bf0 0x563a7d66b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f248563c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f247c1a9af0 con 0x563a7d663a10 2024-03-27T07:24:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f248563c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f247c1aaf60 con 0x563a7d6630f0 2024-03-27T07:24:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f248563c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f247c1aa1c0 con 0x563a7d670bf0 2024-03-27T07:24:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f248563c740 10 client.0 _ll_register_callbacks cb 0x7f2470005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f247b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d66aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f247b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d66aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52884/0 (socket says 172.21.15.82:52884) 2024-03-27T07:24:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f247b7fe640 1 -- 172.21.15.82:0/3897714588 learned_addr learned my addr 172.21.15.82:0/3897714588 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f247bfff640 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 0x563a7d66aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.201 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f2480feb640 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d670bf0 0x563a7d66b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f247b7fe640 1 -- 172.21.15.82:0/3897714588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d670bf0 msgr2=0x563a7d66b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f247b7fe640 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d670bf0 0x563a7d66b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f247b7fe640 1 -- 172.21.15.82:0/3897714588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 msgr2=0x563a7d66aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f247b7fe640 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 0x563a7d66aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f247b7fe640 1 -- 172.21.15.82:0/3897714588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a7d6e6320 con 0x563a7d663a10 2024-03-27T07:24:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f247b7fe640 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d66aff0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f247000c6a0 tx=0x7f247009c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8269ad44463832f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f245b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f245b7fe640 1 -- 172.21.15.82:0/3897714588 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24700d0b70 con 0x563a7d663a10 2024-03-27T07:24:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f245b7fe640 1 -- 172.21.15.82:0/3897714588 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f24700d0d10 con 0x563a7d663a10 2024-03-27T07:24:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f248563c740 1 -- 172.21.15.82:0/3897714588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2474047050 con 0x563a7d663a10 2024-03-27T07:24:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f245b7fe640 1 -- 172.21.15.82:0/3897714588 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f24700b5be0 con 0x563a7d663a10 2024-03-27T07:24:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f248563c740 10 client.15699 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.180+0000 7f248563c740 1 -- 172.21.15.82:0/3897714588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x563a7d6e7610 con 0x563a7d663a10 2024-03-27T07:24:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f245b7fe640 1 -- 172.21.15.82:0/3897714588 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2474047050 con 0x563a7d663a10 2024-03-27T07:24:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f245b7fe640 1 -- 172.21.15.82:0/3897714588 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f247009bbe0 con 0x563a7d663a10 2024-03-27T07:24:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f248563c740 10 client.15699 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f248563c740 10 client.15699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f248563c740 20 client.15699 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f248563c740 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563a7d6e7d10 0x563a7d6ea130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f248563c740 4 client.15699 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:24:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f248563c740 1 -- 172.21.15.82:0/3897714588 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a7d5ce6e0 con 0x563a7d6e7d10 2024-03-27T07:24:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f247bfff640 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563a7d6e7d10 0x563a7d6ea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f245b7fe640 10 client.15699 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.181+0000 7f247bfff640 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563a7d6e7d10 0x563a7d6ea130 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a8d53bdbeb52e48 server_cookie=5c5f832113b77189 in_seq=0 out_seq=0 2024-03-27T07:24:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.184+0000 7f245b7fe640 1 -- 172.21.15.82:0/3897714588 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a7d5ce6e0 con 0x563a7d6e7d10 2024-03-27T07:24:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.184+0000 7f245b7fe640 10 client.15699 handle_command_reply: tid=0 2024-03-27T07:24:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.184+0000 7f248563c740 1 client.15699 shutdown 2024-03-27T07:24:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 1 -- 172.21.15.82:0/3897714588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 msgr2=0x563a7d66aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d66aff0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f247000c6a0 tx=0x7f247009c880 comp rx=0 tx=0).stop 2024-03-27T07:24:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 1 -- 172.21.15.82:0/3897714588 shutdown_connections 2024-03-27T07:24:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563a7d6e7d10 0x563a7d6ea130 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a7d663a10 0x563a7d66aff0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563a7d670bf0 0x563a7d66b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 1 --2- 172.21.15.82:0/3897714588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563a7d6630f0 0x563a7d66aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f245b7fe640 0 client.15699 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 1 -- 172.21.15.82:0/3897714588 >> 172.21.15.82:0/3897714588 conn(0x563a7d65da10 msgr2=0x563a7d65edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 1 -- 172.21.15.82:0/3897714588 shutdown_connections 2024-03-27T07:24:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 1 -- 172.21.15.82:0/3897714588 wait complete. 2024-03-27T07:24:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f248563c740 20 client.15699 trim_cache size 0 max 16384 2024-03-27T07:24:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:24:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:24:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:24:34.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:24:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f2482a4e640 1 -- 172.21.15.82:0/2264727738 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f24640a3940 msgr2=0x7f24640a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f2482a4e640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f24640a3940 0x7f24640a5e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2474004af0 tx=0x7f247402c0f0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f2482a4e640 1 -- 172.21.15.82:0/2264727738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247c101660 msgr2=0x7f247c197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:34.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f2482a4e640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247c101660 0x7f247c197830 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f247000e9f0 tx=0x7f247000eeb0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f2482a4e640 1 -- 172.21.15.82:0/2264727738 shutdown_connections 2024-03-27T07:24:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f2482a4e640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f24640a3940 0x7f24640a5e00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f2482a4e640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f247c101660 0x7f247c197830 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f2482a4e640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f247c1059f0 0x7f247c19bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f2482a4e640 1 --2- 172.21.15.82:0/2264727738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f247c100ca0 0x7f247c1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.185+0000 7f2482a4e640 1 -- 172.21.15.82:0/2264727738 >> 172.21.15.82:0/2264727738 conn(0x7f247c0778a0 msgr2=0x7f247c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:34.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.186+0000 7f2482a4e640 1 -- 172.21.15.82:0/2264727738 shutdown_connections 2024-03-27T07:24:34.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:34.186+0000 7f2482a4e640 1 -- 172.21.15.82:0/2264727738 wait complete. 2024-03-27T07:24:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:34 smithi082 ceph-mon[32178]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T07:24:34.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:34 smithi149 ceph-mon[36065]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T07:24:34.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:34 smithi153 ceph-mon[36179]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T07:24:36.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:36 smithi082 ceph-mon[32178]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T07:24:36.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:36 smithi149 ceph-mon[36065]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T07:24:36.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:36 smithi153 ceph-mon[36179]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T07:24:38.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:38 smithi082 ceph-mon[32178]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-03-27T07:24:38.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:38 smithi149 ceph-mon[36065]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-03-27T07:24:38.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:38 smithi153 ceph-mon[36179]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-03-27T07:24:40.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:40 smithi082 ceph-mon[32178]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:24:40.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:40 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:24:40.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:40 smithi149 ceph-mon[36065]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:24:40.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:40 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:24:40.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:40 smithi153 ceph-mon[36179]: pgmap v35: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:24:40.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:40 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:24:42.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:41 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:24:42.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:41 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:24:42.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:41 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:24:42.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:41 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:24:42.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:41 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:24:42.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:41 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:24:42.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:41 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:24:42.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:41 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:24:42.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:41 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:24:42.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:41 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:24:42.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:41 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:24:42.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:41 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:24:42.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:41 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:24:42.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:41 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:24:42.258 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:41 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:24:42.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:24:42.700 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:24:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.805+0000 7efd1a4df640 1 -- 172.21.15.82:0/2614311797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd14101380 msgr2=0x7efd1410d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.805+0000 7efd1a4df640 1 --2- 172.21.15.82:0/2614311797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd14101380 0x7efd1410d890 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009cd0 tx=0x7efd0c02c0f0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.805+0000 7efd1a4df640 1 -- 172.21.15.82:0/2614311797 shutdown_connections 2024-03-27T07:24:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.805+0000 7efd1a4df640 1 --2- 172.21.15.82:0/2614311797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd14101380 0x7efd1410d890 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.805+0000 7efd1a4df640 1 --2- 172.21.15.82:0/2614311797 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd141009c0 0x7efd14100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.805+0000 7efd1a4df640 1 --2- 172.21.15.82:0/2614311797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd141069d0 0x7efd14106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.806+0000 7efd1a4df640 1 -- 172.21.15.82:0/2614311797 >> 172.21.15.82:0/2614311797 conn(0x7efd14077b50 msgr2=0x7efd14077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.806+0000 7efd1a4df640 1 -- 172.21.15.82:0/2614311797 shutdown_connections 2024-03-27T07:24:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.806+0000 7efd1a4df640 1 -- 172.21.15.82:0/2614311797 wait complete. 2024-03-27T07:24:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.806+0000 7efd1a4df640 1 Processor -- start 2024-03-27T07:24:42.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.806+0000 7efd1a4df640 1 -- start start 2024-03-27T07:24:42.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd1a4df640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd141009c0 0x7efd141983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd1a4df640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd14101380 0x7efd14198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd1a4df640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd141069d0 0x7efd1419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd1a4df640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd14110de0 con 0x7efd14101380 2024-03-27T07:24:42.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd1a4df640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd14110c60 con 0x7efd141069d0 2024-03-27T07:24:42.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd1a4df640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd14110f60 con 0x7efd141009c0 2024-03-27T07:24:42.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd137fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd14101380 0x7efd14198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd137fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd14101380 0x7efd14198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42324/0 (socket says 172.21.15.82:42324) 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd137fe640 1 -- 172.21.15.82:0/861622085 learned_addr learned my addr 172.21.15.82:0/861622085 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd18a7c640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd141069d0 0x7efd1419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd13fff640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd141009c0 0x7efd141983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd137fe640 1 -- 172.21.15.82:0/861622085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd141009c0 msgr2=0x7efd141983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd137fe640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd141009c0 0x7efd141983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd137fe640 1 -- 172.21.15.82:0/861622085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd141069d0 msgr2=0x7efd1419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd137fe640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd141069d0 0x7efd1419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd137fe640 1 -- 172.21.15.82:0/861622085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1419d3b0 con 0x7efd14101380 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd18a7c640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd141069d0 0x7efd1419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd13fff640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd141009c0 0x7efd141983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.807+0000 7efd137fe640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd14101380 0x7efd14198900 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7efd0800ea60 tx=0x7efd0800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.808+0000 7efd117fa640 1 -- 172.21.15.82:0/861622085 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0800cde0 con 0x7efd14101380 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.808+0000 7efd117fa640 1 -- 172.21.15.82:0/861622085 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd080035f0 con 0x7efd14101380 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.808+0000 7efd117fa640 1 -- 172.21.15.82:0/861622085 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08010670 con 0x7efd14101380 2024-03-27T07:24:42.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.808+0000 7efd1a4df640 1 -- 172.21.15.82:0/861622085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd1419d6a0 con 0x7efd14101380 2024-03-27T07:24:42.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.808+0000 7efd1a4df640 1 -- 172.21.15.82:0/861622085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd14102eb0 con 0x7efd14101380 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd117fa640 1 -- 172.21.15.82:0/861622085 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7efd080037a0 con 0x7efd14101380 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd1d1a3740 1 Processor -- start 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd1d1a3740 1 -- start start 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be702fa630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be702fab70 0x55be70303210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be70303750 0x55be70305b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd1d1a3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55be7025e860 con 0x55be702fa250 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd1d1a3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55be702068d0 con 0x55be70303750 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd1d1a3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55be7025a810 con 0x55be702fab70 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd137fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be70303750 0x55be70305b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd18a7c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be702fa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd137fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be70303750 0x55be70305b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35654/0 (socket says 172.21.15.82:35654) 2024-03-27T07:24:42.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.812+0000 7efd137fe640 1 -- 172.21.15.82:0/481646122 learned_addr learned my addr 172.21.15.82:0/481646122 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:42.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.813+0000 7efd117fa640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efcfc0a3920 0x7efcfc0a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.813+0000 7efd13fff640 1 --2- 172.21.15.82:0/481646122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be702fab70 0x55be70303210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.813+0000 7efd18a7c640 1 -- 172.21.15.82:0/481646122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be702fab70 msgr2=0x55be70303210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:42.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.813+0000 7efd18a7c640 1 --2- 172.21.15.82:0/481646122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be702fab70 0x55be70303210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.813+0000 7efd18a7c640 1 -- 172.21.15.82:0/481646122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be70303750 msgr2=0x55be70305b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:42.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.813+0000 7efd117fa640 1 -- 172.21.15.82:0/861622085 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7efd080d0760 con 0x7efd14101380 2024-03-27T07:24:42.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.813+0000 7efd18a7c640 1 --2- 172.21.15.82:0/481646122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be70303750 0x55be70305b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.813+0000 7efd18a7c640 1 -- 172.21.15.82:0/481646122 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be70211120 con 0x55be702fa250 2024-03-27T07:24:42.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.813+0000 7efd18a7c640 1 --2- 172.21.15.82:0/481646122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be702fa630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efd0c02c630 tx=0x7efd0c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28a7c7139b975c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:42.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.813+0000 7efd18a7c640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efcfc0a3920 0x7efcfc0a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.814+0000 7efcfa7fc640 1 -- 172.21.15.82:0/481646122 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c043070 con 0x55be702fa250 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.814+0000 7efcfa7fc640 1 -- 172.21.15.82:0/481646122 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd0c032c90 con 0x55be702fa250 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.814+0000 7efcfa7fc640 1 -- 172.21.15.82:0/481646122 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c039040 con 0x55be702fa250 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd1d1a3740 1 -- 172.21.15.82:0/481646122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 msgr2=0x55be702fa630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd18a7c640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efcfc0a3920 0x7efcfc0a5de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009bf0 tx=0x7efd0c003f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/481646122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be702fa630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efd0c02c630 tx=0x7efd0c009900 comp rx=0 tx=0).stop 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd1d1a3740 1 -- 172.21.15.82:0/481646122 shutdown_connections 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/481646122 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be70303750 0x55be70305b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/481646122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be702fab70 0x55be70303210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/481646122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be702fa630 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd1d1a3740 1 -- 172.21.15.82:0/481646122 >> 172.21.15.82:0/481646122 conn(0x55be702f4980 msgr2=0x55be702f4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd1d1a3740 1 -- 172.21.15.82:0/481646122 shutdown_connections 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd1d1a3740 1 -- 172.21.15.82:0/481646122 wait complete. 2024-03-27T07:24:42.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.815+0000 7efd1d1a3740 1 -- start start 2024-03-27T07:24:42.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd1d1a3740 1 Processor -- start 2024-03-27T07:24:42.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be70300750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fab70 0x55be70300c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 0x55be703011d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd13fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be70300750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd13fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be70300750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42338/0 (socket says 172.21.15.82:42338) 2024-03-27T07:24:42.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd13fff640 1 -- 172.21.15.82:0/2952637750 learned_addr learned my addr 172.21.15.82:0/2952637750 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:42.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55be703064e0 con 0x55be702fa250 2024-03-27T07:24:42.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd137fe640 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fab70 0x55be70300c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55be70219cd0 con 0x55be702fab70 2024-03-27T07:24:42.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55be70306660 con 0x55be70303750 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd18a7c640 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 0x55be703011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd1d1a3740 10 client.0 _ll_register_callbacks cb 0x55be7020bee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd13fff640 1 -- 172.21.15.82:0/2952637750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 msgr2=0x55be703011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd13fff640 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 0x55be703011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd13fff640 1 -- 172.21.15.82:0/2952637750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fab70 msgr2=0x55be70300c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd13fff640 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fab70 0x55be70300c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd13fff640 1 -- 172.21.15.82:0/2952637750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be7003c7d0 con 0x55be702fa250 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.816+0000 7efd18a7c640 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 0x55be703011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.817+0000 7efd137fe640 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fab70 0x55be70300c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.817+0000 7efd13fff640 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be70300750 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efd04013710 tx=0x7efd04013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7810787c226c4ce4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.817+0000 7efcf37fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.817+0000 7efcf37fe640 1 -- 172.21.15.82:0/2952637750 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd04011dd0 con 0x55be702fa250 2024-03-27T07:24:42.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.817+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd0c032c90 con 0x55be702fa250 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.817+0000 7efcf37fe640 1 -- 172.21.15.82:0/2952637750 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7efd04004020 con 0x55be702fa250 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.817+0000 7efcf37fe640 1 -- 172.21.15.82:0/2952637750 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7efd04004220 con 0x55be702fa250 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.817+0000 7efd1d1a3740 10 client.15711 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.817+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55be6ff723f0 con 0x55be702fa250 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.817+0000 7efcf37fe640 1 -- 172.21.15.82:0/2952637750 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd0c032c90 con 0x55be702fa250 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.818+0000 7efcf37fe640 1 -- 172.21.15.82:0/2952637750 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7efd0401a070 con 0x55be702fa250 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.818+0000 7efd1d1a3740 10 client.15711 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.818+0000 7efd1d1a3740 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.818+0000 7efd1d1a3740 20 client.15711 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.818+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55be7031c6c0 0x55be7031eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.818+0000 7efd1d1a3740 4 client.15711 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.818+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be7026bda0 con 0x55be7031c6c0 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.819+0000 7efd137fe640 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55be7031c6c0 0x55be7031eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.819+0000 7efd137fe640 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55be7031c6c0 0x55be7031eb30 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac84f293e69298ef server_cookie=6841172d71aeaed6 in_seq=0 out_seq=0 2024-03-27T07:24:42.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.819+0000 7efcf37fe640 10 client.15711 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efcf37fe640 1 -- 172.21.15.82:0/2952637750 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55be7026bda0 con 0x55be7031c6c0 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efcf37fe640 10 client.15711 handle_command_reply: tid=0 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 client.15711 shutdown 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 msgr2=0x55be70300750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be70300750 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efd04013710 tx=0x7efd04013bd0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 shutdown_connections 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 0x55be703011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fab70 0x55be70300c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55be7031c6c0 0x55be7031eb30 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/2952637750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fa250 0x55be70300750 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 >> 172.21.15.82:0/2952637750 conn(0x55be702f4980 msgr2=0x55be702f66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:42.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efcf37fe640 0 client.15711 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:42.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 shutdown_connections 2024-03-27T07:24:42.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.820+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2952637750 wait complete. 2024-03-27T07:24:42.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.821+0000 7efd1d1a3740 20 client.15711 trim_cache size 0 max 16384 2024-03-27T07:24:42.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.854+0000 7efd1d1a3740 1 Processor -- start 2024-03-27T07:24:42.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.854+0000 7efd1d1a3740 1 -- start start 2024-03-27T07:24:42.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be70302e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be702fab70 0x55be70317b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be70303750 0x55be70324440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd1d1a3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd141add20 con 0x55be70303750 2024-03-27T07:24:42.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd1d1a3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd141ab5f0 con 0x55be702fa250 2024-03-27T07:24:42.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd1d1a3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd141a94f0 con 0x55be702fab70 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd13fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be70302e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd13fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be70302e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35672/0 (socket says 172.21.15.82:35672) 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd18a7c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be70303750 0x55be70324440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd13fff640 1 -- 172.21.15.82:0/2415340825 learned_addr learned my addr 172.21.15.82:0/2415340825 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd137fe640 1 --2- 172.21.15.82:0/2415340825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be702fab70 0x55be70317b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd13fff640 1 -- 172.21.15.82:0/2415340825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be702fab70 msgr2=0x55be70317b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd13fff640 1 --2- 172.21.15.82:0/2415340825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be702fab70 0x55be70317b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd13fff640 1 -- 172.21.15.82:0/2415340825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be70303750 msgr2=0x55be70324440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd13fff640 1 --2- 172.21.15.82:0/2415340825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be70303750 0x55be70324440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd13fff640 1 -- 172.21.15.82:0/2415340825 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be6ff320f0 con 0x55be702fa250 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.855+0000 7efd18a7c640 1 --2- 172.21.15.82:0/2415340825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be70303750 0x55be70324440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.856+0000 7efd13fff640 1 --2- 172.21.15.82:0/2415340825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be70302e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd0401b800 tx=0x7efd0401b3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39b0eccd36525a61 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:42.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.856+0000 7efcf9ffb640 1 -- 172.21.15.82:0/2415340825 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd04028030 con 0x55be702fa250 2024-03-27T07:24:42.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.856+0000 7efcf9ffb640 1 -- 172.21.15.82:0/2415340825 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd040054f0 con 0x55be702fa250 2024-03-27T07:24:42.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.856+0000 7efcf9ffb640 1 -- 172.21.15.82:0/2415340825 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd04024b70 con 0x55be702fa250 2024-03-27T07:24:42.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2415340825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 msgr2=0x55be70302e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/2415340825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be70302e80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd0401b800 tx=0x7efd0401b3f0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2415340825 shutdown_connections 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/2415340825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be70303750 0x55be70324440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/2415340825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be702fab70 0x55be70317b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/2415340825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be70302e80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2415340825 >> 172.21.15.82:0/2415340825 conn(0x55be702f4980 msgr2=0x55be702ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2415340825 shutdown_connections 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 -- 172.21.15.82:0/2415340825 wait complete. 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 -- start start 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.857+0000 7efd1d1a3740 1 Processor -- start 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be7030f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fab70 0x55be7030f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd1d1a3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 0x55be7030fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd1d1a3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd141a9ab0 con 0x55be702fab70 2024-03-27T07:24:42.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd13fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be7030f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd13fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be7030f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35688/0 (socket says 172.21.15.82:35688) 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd13fff640 1 -- 172.21.15.82:0/3041711509 learned_addr learned my addr 172.21.15.82:0/3041711509 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd137fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fab70 0x55be7030f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd1d1a3740 1 -- 172.21.15.82:0/3041711509 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd141aaf20 con 0x55be702fa250 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd18a7c640 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 0x55be7030fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd1d1a3740 1 -- 172.21.15.82:0/3041711509 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd141aa180 con 0x55be70303750 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.858+0000 7efd1d1a3740 10 client.0 _ll_register_callbacks cb 0x7efd04009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efd13fff640 1 -- 172.21.15.82:0/3041711509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 msgr2=0x55be7030fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efd13fff640 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 0x55be7030fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efd13fff640 1 -- 172.21.15.82:0/3041711509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fab70 msgr2=0x55be7030f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efd13fff640 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fab70 0x55be7030f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efd13fff640 1 -- 172.21.15.82:0/3041711509 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be70380a60 con 0x55be702fa250 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efd1d1a3740 1 -- 172.21.15.82:0/3041711509 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd040054f0 con 0x55be702fa250 2024-03-27T07:24:42.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efd137fe640 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fab70 0x55be7030f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efd13fff640 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be7030f100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd04009c90 tx=0x7efd040056a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b59a504675cb729 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efcf37fe640 10 client.25547 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:24:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efcf37fe640 1 -- 172.21.15.82:0/3041711509 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd04028040 con 0x55be702fa250 2024-03-27T07:24:42.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efcf37fe640 1 -- 172.21.15.82:0/3041711509 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7efd04024840 con 0x55be702fa250 2024-03-27T07:24:42.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efcf37fe640 1 -- 172.21.15.82:0/3041711509 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7efd04024a80 con 0x55be702fa250 2024-03-27T07:24:42.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efd1d1a3740 10 client.25547 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:42.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.859+0000 7efd1d1a3740 1 -- 172.21.15.82:0/3041711509 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55be70381b30 con 0x55be702fa250 2024-03-27T07:24:42.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efcf37fe640 1 -- 172.21.15.82:0/3041711509 <== mon.2 v2:172.21.15.149:3300/0 4 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7efd0401a040 con 0x55be702fa250 2024-03-27T07:24:42.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efd1d1a3740 10 client.25547 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efd1d1a3740 10 client.25547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efd1d1a3740 20 client.25547 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55be70382040 0x55be70384430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efd1d1a3740 4 client.25547 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efd1d1a3740 1 -- 172.21.15.82:0/3041711509 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55be702660f0 con 0x55be70382040 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efd137fe640 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55be70382040 0x55be70384430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efcf37fe640 10 client.25547 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efd137fe640 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55be70382040 0x55be70384430 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ace7cd9e9960f5a server_cookie=7cd752e845acb902 in_seq=0 out_seq=0 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.860+0000 7efcf37fe640 1 -- 172.21.15.82:0/3041711509 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55be702660f0 con 0x55be70382040 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efcf37fe640 10 client.25547 handle_command_reply: tid=0 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 client.25547 shutdown 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 -- 172.21.15.82:0/3041711509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 msgr2=0x55be7030f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be7030f100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efd04009c90 tx=0x7efd040056a0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 -- 172.21.15.82:0/3041711509 shutdown_connections 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55be70382040 0x55be70384430 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55be702fab70 0x55be7030f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55be70303750 0x55be7030fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 --2- 172.21.15.82:0/3041711509 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55be702fa250 0x55be7030f100 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efcf37fe640 0 client.25547 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 -- 172.21.15.82:0/3041711509 >> 172.21.15.82:0/3041711509 conn(0x55be702f4980 msgr2=0x55be702ff4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 -- 172.21.15.82:0/3041711509 shutdown_connections 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 1 -- 172.21.15.82:0/3041711509 wait complete. 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.861+0000 7efd1d1a3740 20 client.25547 trim_cache size 0 max 16384 2024-03-27T07:24:42.871 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:24:42.872 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-03-27T07:24:42.872 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-03-27T07:24:42.872 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 -- 172.21.15.82:0/861622085 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efcfc0a3920 msgr2=0x7efcfc0a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efcfc0a3920 0x7efcfc0a5de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009bf0 tx=0x7efd0c003f90 comp rx=0 tx=0).stop 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 -- 172.21.15.82:0/861622085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd14101380 msgr2=0x7efd14198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd14101380 0x7efd14198900 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7efd0800ea60 tx=0x7efd0800ef20 comp rx=0 tx=0).stop 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 -- 172.21.15.82:0/861622085 shutdown_connections 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efcfc0a3920 0x7efcfc0a5de0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd14101380 0x7efd14198900 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd141069d0 0x7efd1419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 --2- 172.21.15.82:0/861622085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd141009c0 0x7efd141983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 -- 172.21.15.82:0/861622085 >> 172.21.15.82:0/861622085 conn(0x7efd14077b50 msgr2=0x7efd14068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 -- 172.21.15.82:0/861622085 shutdown_connections 2024-03-27T07:24:42.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.862+0000 7efd1a4df640 1 -- 172.21.15.82:0/861622085 wait complete. 2024-03-27T07:24:42.878 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T07:24:42.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:24:42.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.980+0000 7f4e322f4640 1 -- 172.21.15.82:0/1999996500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e2c106a60 msgr2=0x7f4e2c106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.980+0000 7f4e322f4640 1 --2- 172.21.15.82:0/1999996500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e2c106a60 0x7f4e2c106e40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009930 tx=0x7f4e1c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:24:42.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.980+0000 7f4e322f4640 1 -- 172.21.15.82:0/1999996500 shutdown_connections 2024-03-27T07:24:42.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.980+0000 7f4e322f4640 1 --2- 172.21.15.82:0/1999996500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e2c100a50 0x7f4e2c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.980+0000 7f4e322f4640 1 --2- 172.21.15.82:0/1999996500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e2c101410 0x7f4e2c10d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.980+0000 7f4e322f4640 1 --2- 172.21.15.82:0/1999996500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e2c106a60 0x7f4e2c106e40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.980+0000 7f4e322f4640 1 -- 172.21.15.82:0/1999996500 >> 172.21.15.82:0/1999996500 conn(0x7f4e2c077b50 msgr2=0x7f4e2c077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:42.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.980+0000 7f4e322f4640 1 -- 172.21.15.82:0/1999996500 shutdown_connections 2024-03-27T07:24:42.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.980+0000 7f4e322f4640 1 -- 172.21.15.82:0/1999996500 wait complete. 2024-03-27T07:24:42.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.981+0000 7f4e322f4640 1 Processor -- start 2024-03-27T07:24:42.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.981+0000 7f4e322f4640 1 -- start start 2024-03-27T07:24:42.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.981+0000 7f4e322f4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e2c100a50 0x7f4e2c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.981+0000 7f4e322f4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e2c101410 0x7f4e2c1997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.981+0000 7f4e322f4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e2c106a60 0x7f4e2c1a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.981+0000 7f4e322f4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c110e90 con 0x7f4e2c101410 2024-03-27T07:24:42.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.981+0000 7f4e322f4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c110d10 con 0x7f4e2c100a50 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.981+0000 7f4e322f4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2c111010 con 0x7f4e2c106a60 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e2bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e2c100a50 0x7f4e2c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e2bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e2c100a50 0x7f4e2c199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35714/0 (socket says 172.21.15.82:35714) 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e2bfff640 1 -- 172.21.15.82:0/2561871244 learned_addr learned my addr 172.21.15.82:0/2561871244 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e30891640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e2c106a60 0x7f4e2c1a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e2b7fe640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e2c101410 0x7f4e2c1997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e2bfff640 1 -- 172.21.15.82:0/2561871244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e2c106a60 msgr2=0x7f4e2c1a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e2bfff640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e2c106a60 0x7f4e2c1a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e2bfff640 1 -- 172.21.15.82:0/2561871244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e2c101410 msgr2=0x7f4e2c1997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e2bfff640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e2c101410 0x7f4e2c1997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e2bfff640 1 -- 172.21.15.82:0/2561871244 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2c1a4830 con 0x7f4e2c100a50 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e2bfff640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e2c100a50 0x7f4e2c199270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009900 tx=0x7f4e1c004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:42.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e297fa640 1 -- 172.21.15.82:0/2561871244 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c043020 con 0x7f4e2c100a50 2024-03-27T07:24:42.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e297fa640 1 -- 172.21.15.82:0/2561871244 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e1c0054e0 con 0x7f4e2c100a50 2024-03-27T07:24:42.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e322f4640 1 -- 172.21.15.82:0/2561871244 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2c1a4a00 con 0x7f4e2c100a50 2024-03-27T07:24:42.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.982+0000 7f4e297fa640 1 -- 172.21.15.82:0/2561871244 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c003bb0 con 0x7f4e2c100a50 2024-03-27T07:24:42.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.983+0000 7f4e322f4640 1 -- 172.21.15.82:0/2561871244 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2c1a4ec0 con 0x7f4e2c100a50 2024-03-27T07:24:42.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.984+0000 7f4e322f4640 1 -- 172.21.15.82:0/2561871244 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2c068940 con 0x7f4e2c100a50 2024-03-27T07:24:42.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.985+0000 7f4e297fa640 1 -- 172.21.15.82:0/2561871244 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7f4e1c046020 con 0x7f4e2c100a50 2024-03-27T07:24:42.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.986+0000 7f4e297fa640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4e140a3920 0x7f4e140a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:42.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.986+0000 7f4e297fa640 1 -- 172.21.15.82:0/2561871244 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f4e1c0f21f0 con 0x7f4e2c100a50 2024-03-27T07:24:42.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.986+0000 7f4e2b7fe640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4e140a3920 0x7f4e140a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:42.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.986+0000 7f4e2b7fe640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4e140a3920 0x7f4e140a5de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c069800 tx=0x7f4e20005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:42.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:42.991+0000 7f4e297fa640 1 -- 172.21.15.82:0/2561871244 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4e1c04d020 con 0x7f4e2c100a50 2024-03-27T07:24:43.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:42 smithi153 ceph-mon[36179]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T07:24:43.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:42 smithi082 ceph-mon[32178]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T07:24:43.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.215+0000 7f4e322f4640 1 -- 172.21.15.82:0/2561871244 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e2c108fc0 con 0x7f4e2c100a50 2024-03-27T07:24:43.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.215+0000 7f4e297fa640 1 -- 172.21.15.82:0/2561871244 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11860 (secure 0 0 0) 0x7f4e1c0be990 con 0x7f4e2c100a50 2024-03-27T07:24:43.218 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:24:43.218 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:23:33.807990+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:24:43.218 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-03-27T07:24:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 -- 172.21.15.82:0/2561871244 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4e140a3920 msgr2=0x7f4e140a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4e140a3920 0x7f4e140a5de0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c069800 tx=0x7f4e20005f90 comp rx=0 tx=0).stop 2024-03-27T07:24:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 -- 172.21.15.82:0/2561871244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e2c100a50 msgr2=0x7f4e2c199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e2c100a50 0x7f4e2c199270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009900 tx=0x7f4e1c004360 comp rx=0 tx=0).stop 2024-03-27T07:24:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 -- 172.21.15.82:0/2561871244 shutdown_connections 2024-03-27T07:24:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4e140a3920 0x7f4e140a5de0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e2c101410 0x7f4e2c1997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e2c106a60 0x7f4e2c1a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 --2- 172.21.15.82:0/2561871244 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4e2c100a50 0x7f4e2c199270 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 -- 172.21.15.82:0/2561871244 >> 172.21.15.82:0/2561871244 conn(0x7f4e2c077b50 msgr2=0x7f4e2c103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 -- 172.21.15.82:0/2561871244 shutdown_connections 2024-03-27T07:24:43.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.218+0000 7f4e322f4640 1 -- 172.21.15.82:0/2561871244 wait complete. 2024-03-27T07:24:43.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T07:24:43.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:42 smithi149 ceph-mon[36065]: pgmap v36: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T07:24:43.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.334+0000 7faee0f35640 1 -- 172.21.15.82:0/4140461603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc1066d0 msgr2=0x7faedc106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.334+0000 7faee0f35640 1 --2- 172.21.15.82:0/4140461603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc1066d0 0x7faedc106b50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7faed0009900 tx=0x7faed002bc30 comp rx=0 tx=0).stop 2024-03-27T07:24:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.334+0000 7faee0f35640 1 -- 172.21.15.82:0/4140461603 shutdown_connections 2024-03-27T07:24:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.334+0000 7faee0f35640 1 --2- 172.21.15.82:0/4140461603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc1066d0 0x7faedc106b50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.334+0000 7faee0f35640 1 --2- 172.21.15.82:0/4140461603 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc107090 0x7faedc10e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.334+0000 7faee0f35640 1 --2- 172.21.15.82:0/4140461603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faedc069130 0x7faedc069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.334+0000 7faee0f35640 1 -- 172.21.15.82:0/4140461603 >> 172.21.15.82:0/4140461603 conn(0x7faedc077b50 msgr2=0x7faedc077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.334+0000 7faee0f35640 1 -- 172.21.15.82:0/4140461603 shutdown_connections 2024-03-27T07:24:43.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.334+0000 7faee0f35640 1 -- 172.21.15.82:0/4140461603 wait complete. 2024-03-27T07:24:43.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faee0f35640 1 Processor -- start 2024-03-27T07:24:43.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faee0f35640 1 -- start start 2024-03-27T07:24:43.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faee0f35640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faedc069130 0x7faedc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faee0f35640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc1066d0 0x7faedc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faee0f35640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc107090 0x7faedc19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faee0f35640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faedc111f20 con 0x7faedc1066d0 2024-03-27T07:24:43.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faee0f35640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faedc111da0 con 0x7faedc107090 2024-03-27T07:24:43.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faee0f35640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faedc1120a0 con 0x7faedc069130 2024-03-27T07:24:43.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faed9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc1066d0 0x7faedc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faed9d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc1066d0 0x7faedc198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42388/0 (socket says 172.21.15.82:42388) 2024-03-27T07:24:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faed9d9b640 1 -- 172.21.15.82:0/3181053796 learned_addr learned my addr 172.21.15.82:0/3181053796 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faedad9d640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc107090 0x7faedc19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.335+0000 7faeda59c640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faedc069130 0x7faedc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faed9d9b640 1 -- 172.21.15.82:0/3181053796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faedc069130 msgr2=0x7faedc1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faed9d9b640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faedc069130 0x7faedc1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faed9d9b640 1 -- 172.21.15.82:0/3181053796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc107090 msgr2=0x7faedc19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faed9d9b640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc107090 0x7faedc19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faed9d9b640 1 -- 172.21.15.82:0/3181053796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faedc19d3b0 con 0x7faedc1066d0 2024-03-27T07:24:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faedad9d640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc107090 0x7faedc19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faed9d9b640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc1066d0 0x7faedc198900 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faed002c240 tx=0x7faed00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faecb7fe640 1 -- 172.21.15.82:0/3181053796 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0043020 con 0x7faedc1066d0 2024-03-27T07:24:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faee0f35640 1 -- 172.21.15.82:0/3181053796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faedc19d640 con 0x7faedc1066d0 2024-03-27T07:24:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faee0f35640 1 -- 172.21.15.82:0/3181053796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faedc1a4f30 con 0x7faedc1066d0 2024-03-27T07:24:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faecb7fe640 1 -- 172.21.15.82:0/3181053796 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed00054e0 con 0x7faedc1066d0 2024-03-27T07:24:43.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.336+0000 7faecb7fe640 1 -- 172.21.15.82:0/3181053796 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0003af0 con 0x7faedc1066d0 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.338+0000 7faee3bf3740 1 Processor -- start 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faee3bf3740 1 -- start start 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abf4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abf50d0 0x55ef2abfd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac000a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faee3bf3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ef2ab58710 con 0x55ef2abf50d0 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faee3bf3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ef2ab00af0 con 0x55ef2abfdcb0 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faee3bf3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ef2ab546c0 con 0x55ef2abf47b0 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faedad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abf4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faeda59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abf50d0 0x55ef2abfd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faedad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abf4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47024/0 (socket says 172.21.15.82:47024) 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faedad9d640 1 -- 172.21.15.82:0/2674385070 learned_addr learned my addr 172.21.15.82:0/2674385070 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faedad9d640 1 -- 172.21.15.82:0/2674385070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abfdcb0 msgr2=0x55ef2ac000a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faedad9d640 1 --2- 172.21.15.82:0/2674385070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac000a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faedad9d640 1 -- 172.21.15.82:0/2674385070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abf50d0 msgr2=0x55ef2abfd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faedad9d640 1 --2- 172.21.15.82:0/2674385070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abf50d0 0x55ef2abfd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.339+0000 7faedad9d640 1 -- 172.21.15.82:0/2674385070 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2a86c3f0 con 0x55ef2abf47b0 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.340+0000 7faedad9d640 1 --2- 172.21.15.82:0/2674385070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abf4b90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faed4011790 tx=0x7faed4011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a975c3113eded0ed server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.340+0000 7faec8ff9640 1 -- 172.21.15.82:0/2674385070 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4003c30 con 0x55ef2abf47b0 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.340+0000 7faec8ff9640 1 -- 172.21.15.82:0/2674385070 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed400fe80 con 0x55ef2abf47b0 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.340+0000 7faec8ff9640 1 -- 172.21.15.82:0/2674385070 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40193e0 con 0x55ef2abf47b0 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.340+0000 7faecb7fe640 1 -- 172.21.15.82:0/3181053796 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7faed0046020 con 0x7faedc1066d0 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 -- 172.21.15.82:0/2674385070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 msgr2=0x55ef2abf4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 --2- 172.21.15.82:0/2674385070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abf4b90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faed4011790 tx=0x7faed4011c50 comp rx=0 tx=0).stop 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 -- 172.21.15.82:0/2674385070 shutdown_connections 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 --2- 172.21.15.82:0/2674385070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abf50d0 0x55ef2abfd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 --2- 172.21.15.82:0/2674385070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 --2- 172.21.15.82:0/2674385070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abf4b90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 -- 172.21.15.82:0/2674385070 >> 172.21.15.82:0/2674385070 conn(0x55ef2abeeee0 msgr2=0x55ef2abef2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faecb7fe640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faec40a3920 0x7faec40a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 -- 172.21.15.82:0/2674385070 shutdown_connections 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faeda59c640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faec40a3920 0x7faec40a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faecb7fe640 1 -- 172.21.15.82:0/3181053796 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7faed00f1b50 con 0x7faedc1066d0 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 -- 172.21.15.82:0/2674385070 wait complete. 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 -- start start 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faeda59c640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faec40a3920 0x7faec40a5de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55ef2abf4280 tx=0x7faecc00b390 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.341+0000 7faee3bf3740 1 Processor -- start 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abfad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf50d0 0x55ef2abfb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2abfb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faee3bf3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ef2ac00aa0 con 0x55ef2abfdcb0 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faee3bf3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ef2ab13eb0 con 0x55ef2abf50d0 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faee3bf3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ef2ac00c20 con 0x55ef2abf47b0 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faeda59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abfad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faeda59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abfad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47040/0 (socket says 172.21.15.82:47040) 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faeda59c640 1 -- 172.21.15.82:0/2103945249 learned_addr learned my addr 172.21.15.82:0/2103945249 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faed9d9b640 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf50d0 0x55ef2abfb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faee3bf3740 10 client.0 _ll_register_callbacks cb 0x55ef2ab506a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faedad9d640 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2abfb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faeda59c640 1 -- 172.21.15.82:0/2103945249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf50d0 msgr2=0x55ef2abfb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faeda59c640 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf50d0 0x55ef2abfb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faeda59c640 1 -- 172.21.15.82:0/2103945249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 msgr2=0x55ef2abfb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faeda59c640 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2abfb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faeda59c640 1 -- 172.21.15.82:0/2103945249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2a9367d0 con 0x55ef2abf47b0 2024-03-27T07:24:43.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faeda59c640 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abfad20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faecc003e50 tx=0x7faecc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8af5f17e05ada281 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.342+0000 7faec1ffb640 1 -- 172.21.15.82:0/2103945249 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc01d680 con 0x55ef2abf47b0 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faee3bf3740 1 -- 172.21.15.82:0/2103945249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ef2ab65c50 con 0x55ef2abf47b0 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faec1ffb640 1 -- 172.21.15.82:0/2103945249 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7faecc01d820 con 0x55ef2abf47b0 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faec1ffb640 1 -- 172.21.15.82:0/2103945249 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7faecc01da20 con 0x55ef2abf47b0 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faee3bf3740 10 client.25570 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faee3bf3740 1 -- 172.21.15.82:0/2103945249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ef2ac15650 con 0x55ef2abf47b0 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faec1ffb640 1 -- 172.21.15.82:0/2103945249 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ef2ab65c50 con 0x55ef2abf47b0 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faec1ffb640 1 -- 172.21.15.82:0/2103945249 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7faecc026020 con 0x55ef2abf47b0 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faee3bf3740 10 client.25570 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faee3bf3740 10 client.25570 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faee3bf3740 20 client.25570 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faee3bf3740 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55ef2ac16a60 0x55ef2ac18ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faee3bf3740 4 client.25570 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:43.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faee3bf3740 1 -- 172.21.15.82:0/2103945249 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef2ab5ffa0 con 0x55ef2ac16a60 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.343+0000 7faed9d9b640 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55ef2ac16a60 0x55ef2ac18ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faec1ffb640 10 client.25570 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faed9d9b640 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55ef2ac16a60 0x55ef2ac18ea0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b0d9db2b9a235fab server_cookie=4bd6c80cd475cf26 in_seq=0 out_seq=0 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faec1ffb640 1 -- 172.21.15.82:0/2103945249 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ef2ab5ffa0 con 0x55ef2ac16a60 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faec1ffb640 10 client.25570 handle_command_reply: tid=0 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faee3bf3740 1 client.25570 shutdown 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faee3bf3740 1 -- 172.21.15.82:0/2103945249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 msgr2=0x55ef2abfad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faee3bf3740 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abfad20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faecc003e50 tx=0x7faecc0046c0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faee3bf3740 1 -- 172.21.15.82:0/2103945249 shutdown_connections 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faee3bf3740 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55ef2ac16a60 0x55ef2ac18ea0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faee3bf3740 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2abfb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faee3bf3740 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf50d0 0x55ef2abfb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faee3bf3740 1 --2- 172.21.15.82:0/2103945249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf47b0 0x55ef2abfad20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faee3bf3740 1 -- 172.21.15.82:0/2103945249 >> 172.21.15.82:0/2103945249 conn(0x55ef2abeeee0 msgr2=0x55ef2abf0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.344+0000 7faec1ffb640 0 client.25570 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:24:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.345+0000 7faee3bf3740 1 -- 172.21.15.82:0/2103945249 shutdown_connections 2024-03-27T07:24:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.345+0000 7faee3bf3740 1 -- 172.21.15.82:0/2103945249 wait complete. 2024-03-27T07:24:43.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.345+0000 7faee3bf3740 20 client.25570 trim_cache size 0 max 16384 2024-03-27T07:24:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faee3bf3740 1 Processor -- start 2024-03-27T07:24:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faee3bf3740 1 -- start start 2024-03-27T07:24:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2abfd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 0x55ef2abf9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac12130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faee3bf3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faebc010f10 con 0x55ef2abfdcb0 2024-03-27T07:24:43.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faee3bf3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faebc00e7e0 con 0x55ef2abf47b0 2024-03-27T07:24:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faee3bf3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faebc00c630 con 0x55ef2abf50d0 2024-03-27T07:24:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faedad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac12130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faeda59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2abfd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faeda59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2abfd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35756/0 (socket says 172.21.15.82:35756) 2024-03-27T07:24:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faeda59c640 1 -- 172.21.15.82:0/3043573981 learned_addr learned my addr 172.21.15.82:0/3043573981 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faed9d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 0x55ef2abf9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faeda59c640 1 -- 172.21.15.82:0/3043573981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 msgr2=0x55ef2abf9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faeda59c640 1 --2- 172.21.15.82:0/3043573981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 0x55ef2abf9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faeda59c640 1 -- 172.21.15.82:0/3043573981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 msgr2=0x55ef2ac12130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faeda59c640 1 --2- 172.21.15.82:0/3043573981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac12130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.359+0000 7faeda59c640 1 -- 172.21.15.82:0/3043573981 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef2abf4f00 con 0x55ef2abf47b0 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.360+0000 7faeda59c640 1 --2- 172.21.15.82:0/3043573981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2abfd450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faecc003fc0 tx=0x7faecc003ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3143320aa0088c5d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.360+0000 7faec3fff640 1 -- 172.21.15.82:0/3043573981 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc00be80 con 0x55ef2abf47b0 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.360+0000 7faec3fff640 1 -- 172.21.15.82:0/3043573981 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faecc0057f0 con 0x55ef2abf47b0 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.360+0000 7faec3fff640 1 -- 172.21.15.82:0/3043573981 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faecc005030 con 0x55ef2abf47b0 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 -- 172.21.15.82:0/3043573981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 msgr2=0x55ef2abfd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 --2- 172.21.15.82:0/3043573981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2abfd450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faecc003fc0 tx=0x7faecc003ff0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 -- 172.21.15.82:0/3043573981 shutdown_connections 2024-03-27T07:24:43.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 --2- 172.21.15.82:0/3043573981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac12130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 --2- 172.21.15.82:0/3043573981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 0x55ef2abf9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 --2- 172.21.15.82:0/3043573981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2abfd450 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 -- 172.21.15.82:0/3043573981 >> 172.21.15.82:0/3043573981 conn(0x55ef2abeeee0 msgr2=0x55ef2abf0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 -- 172.21.15.82:0/3043573981 shutdown_connections 2024-03-27T07:24:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 -- 172.21.15.82:0/3043573981 wait complete. 2024-03-27T07:24:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 -- start start 2024-03-27T07:24:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 Processor -- start 2024-03-27T07:24:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2ac09950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 0x55ef2ac09e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.361+0000 7faee3bf3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac74d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faee3bf3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faebc00cca0 con 0x55ef2abfdcb0 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faee3bf3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faebc00e110 con 0x55ef2abf47b0 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faee3bf3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faebc00d370 con 0x55ef2abf50d0 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faee3bf3740 10 client.0 _ll_register_callbacks cb 0x7faecc004200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faedad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac74d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faeda59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2ac09950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faed9d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 0x55ef2ac09e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faeda59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2ac09950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35770/0 (socket says 172.21.15.82:35770) 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faed9d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 0x55ef2ac09e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47070/0 (socket says 172.21.15.82:47070) 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faeda59c640 1 -- 172.21.15.82:0/1107035662 learned_addr learned my addr 172.21.15.82:0/1107035662 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faed9d9b640 1 -- 172.21.15.82:0/1107035662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 msgr2=0x55ef2ac09950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faed9d9b640 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2ac09950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faed9d9b640 1 -- 172.21.15.82:0/1107035662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 msgr2=0x55ef2ac74d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faed9d9b640 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac74d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faed9d9b640 1 -- 172.21.15.82:0/1107035662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef2ac753d0 con 0x55ef2abf50d0 2024-03-27T07:24:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faedad9d640 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac74d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faeda59c640 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2ac09950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faed9d9b640 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 0x55ef2ac09e90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faed00ef220 tx=0x7faed0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66c3b664dae9d834 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faec1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:24:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faec1ffb640 1 -- 172.21.15.82:0/1107035662 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0004c80 con 0x55ef2abf50d0 2024-03-27T07:24:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faec1ffb640 1 -- 172.21.15.82:0/1107035662 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7faed0003c90 con 0x55ef2abf50d0 2024-03-27T07:24:43.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.362+0000 7faee3bf3740 1 -- 172.21.15.82:0/1107035662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faecc0057f0 con 0x55ef2abf50d0 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faec1ffb640 1 -- 172.21.15.82:0/1107035662 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7faed0005690 con 0x55ef2abf50d0 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faee3bf3740 10 client.25576 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faee3bf3740 1 -- 172.21.15.82:0/1107035662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55ef2ac7c7d0 con 0x55ef2abf50d0 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faec1ffb640 1 -- 172.21.15.82:0/1107035662 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faed00be290 con 0x55ef2abf50d0 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faec1ffb640 1 -- 172.21.15.82:0/1107035662 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7faed002cb20 con 0x55ef2abf50d0 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faee3bf3740 10 client.25576 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faee3bf3740 10 client.25576 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faee3bf3740 20 client.25576 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faee3bf3740 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55ef2ac7cf50 0x55ef2ac7f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faee3bf3740 4 client.25576 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faee3bf3740 1 -- 172.21.15.82:0/1107035662 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7faecc0057f0 con 0x55ef2ac7cf50 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faeda59c640 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55ef2ac7cf50 0x55ef2ac7f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.363+0000 7faec1ffb640 10 client.25576 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:24:43.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faeda59c640 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55ef2ac7cf50 0x55ef2ac7f370 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e2b3a46f751e02e server_cookie=3380923cadfff31d in_seq=0 out_seq=0 2024-03-27T07:24:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faec1ffb640 1 -- 172.21.15.82:0/1107035662 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7faecc0057f0 con 0x55ef2ac7cf50 2024-03-27T07:24:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faec1ffb640 10 client.25576 handle_command_reply: tid=0 2024-03-27T07:24:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 client.25576 shutdown 2024-03-27T07:24:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 -- 172.21.15.82:0/1107035662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 msgr2=0x55ef2ac09e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 0x55ef2ac09e90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7faed00ef220 tx=0x7faed0009260 comp rx=0 tx=0).stop 2024-03-27T07:24:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 -- 172.21.15.82:0/1107035662 shutdown_connections 2024-03-27T07:24:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55ef2ac7cf50 0x55ef2ac7f370 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef2abfdcb0 0x55ef2ac74d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faec1ffb640 0 client.25576 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:24:43.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ef2abf50d0 0x55ef2ac09e90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 --2- 172.21.15.82:0/1107035662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ef2abf47b0 0x55ef2ac09950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 -- 172.21.15.82:0/1107035662 >> 172.21.15.82:0/1107035662 conn(0x55ef2abeeee0 msgr2=0x55ef2abf0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 -- 172.21.15.82:0/1107035662 shutdown_connections 2024-03-27T07:24:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 1 -- 172.21.15.82:0/1107035662 wait complete. 2024-03-27T07:24:43.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.364+0000 7faee3bf3740 20 client.25576 trim_cache size 0 max 16384 2024-03-27T07:24:43.374 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:24:43.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 -- 172.21.15.82:0/3181053796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faec40a3920 msgr2=0x7faec40a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faec40a3920 0x7faec40a5de0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x55ef2abf4280 tx=0x7faecc00b390 comp rx=0 tx=0).stop 2024-03-27T07:24:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 -- 172.21.15.82:0/3181053796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc1066d0 msgr2=0x7faedc198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc1066d0 0x7faedc198900 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7faed002c240 tx=0x7faed00042f0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 -- 172.21.15.82:0/3181053796 shutdown_connections 2024-03-27T07:24:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faec40a3920 0x7faec40a5de0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faedc1066d0 0x7faedc198900 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7faedc107090 0x7faedc19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 --2- 172.21.15.82:0/3181053796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faedc069130 0x7faedc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 -- 172.21.15.82:0/3181053796 >> 172.21.15.82:0/3181053796 conn(0x7faedc077b50 msgr2=0x7faedc0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 -- 172.21.15.82:0/3181053796 shutdown_connections 2024-03-27T07:24:43.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.365+0000 7faee0f35640 1 -- 172.21.15.82:0/3181053796 wait complete. 2024-03-27T07:24:43.382 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T07:24:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.488+0000 7f1a329e2640 1 -- 172.21.15.82:0/4287162855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c1066d0 msgr2=0x7f1a2c106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.488+0000 7f1a329e2640 1 --2- 172.21.15.82:0/4287162855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c1066d0 0x7f1a2c106b50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009860 tx=0x7f1a2002bb70 comp rx=0 tx=0).stop 2024-03-27T07:24:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.488+0000 7f1a329e2640 1 -- 172.21.15.82:0/4287162855 shutdown_connections 2024-03-27T07:24:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.488+0000 7f1a329e2640 1 --2- 172.21.15.82:0/4287162855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a2c107090 0x7f1a2c10e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.488+0000 7f1a329e2640 1 --2- 172.21.15.82:0/4287162855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c1066d0 0x7f1a2c106b50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.488+0000 7f1a329e2640 1 --2- 172.21.15.82:0/4287162855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c069130 0x7f1a2c069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.488+0000 7f1a329e2640 1 -- 172.21.15.82:0/4287162855 >> 172.21.15.82:0/4287162855 conn(0x7f1a2c077b50 msgr2=0x7f1a2c077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.488+0000 7f1a329e2640 1 -- 172.21.15.82:0/4287162855 shutdown_connections 2024-03-27T07:24:43.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.488+0000 7f1a329e2640 1 -- 172.21.15.82:0/4287162855 wait complete. 2024-03-27T07:24:43.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.488+0000 7f1a329e2640 1 Processor -- start 2024-03-27T07:24:43.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a329e2640 1 -- start start 2024-03-27T07:24:43.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a329e2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c069130 0x7f1a2c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a329e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c1066d0 0x7f1a2c198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a329e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a2c107090 0x7f1a2c19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a329e2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c111e90 con 0x7f1a2c1066d0 2024-03-27T07:24:43.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a329e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c111d10 con 0x7f1a2c107090 2024-03-27T07:24:43.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a329e2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c112010 con 0x7f1a2c069130 2024-03-27T07:24:43.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a2b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c1066d0 0x7f1a2c198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a2bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c069130 0x7f1a2c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a2bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c069130 0x7f1a2c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47084/0 (socket says 172.21.15.82:47084) 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a2bfff640 1 -- 172.21.15.82:0/4286627546 learned_addr learned my addr 172.21.15.82:0/4286627546 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a30f7f640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a2c107090 0x7f1a2c19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a2bfff640 1 -- 172.21.15.82:0/4286627546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a2c107090 msgr2=0x7f1a2c19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a2c107090 0x7f1a2c19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a2bfff640 1 -- 172.21.15.82:0/4286627546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c1066d0 msgr2=0x7f1a2c198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c1066d0 0x7f1a2c198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.489+0000 7f1a2bfff640 1 -- 172.21.15.82:0/4286627546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c19d3e0 con 0x7f1a2c069130 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.490+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c069130 0x7f1a2c1983f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00e9c0 tx=0x7f1a1c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.490+0000 7f1a297fa640 1 -- 172.21.15.82:0/4286627546 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c00ccc0 con 0x7f1a2c069130 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.490+0000 7f1a297fa640 1 -- 172.21.15.82:0/4286627546 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a1c005500 con 0x7f1a2c069130 2024-03-27T07:24:43.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.490+0000 7f1a297fa640 1 -- 172.21.15.82:0/4286627546 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c010430 con 0x7f1a2c069130 2024-03-27T07:24:43.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.490+0000 7f1a329e2640 1 -- 172.21.15.82:0/4286627546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c19d6d0 con 0x7f1a2c069130 2024-03-27T07:24:43.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.490+0000 7f1a329e2640 1 -- 172.21.15.82:0/4286627546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2c1a4f60 con 0x7f1a2c069130 2024-03-27T07:24:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.492+0000 7f1a355d5740 1 Processor -- start 2024-03-27T07:24:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.492+0000 7f1a355d5740 1 -- start start 2024-03-27T07:24:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d33e50 0x55f072d34230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d34800 0x55f072d20990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d20fb0 0x55f072d21410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a355d5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f072c8a710 con 0x55f072d33e50 2024-03-27T07:24:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a355d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f072c32af0 con 0x55f072d34800 2024-03-27T07:24:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a355d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f072c866c0 con 0x55f072d20fb0 2024-03-27T07:24:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a30f7f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d33e50 0x55f072d34230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a30f7f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d33e50 0x55f072d34230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42438/0 (socket says 172.21.15.82:42438) 2024-03-27T07:24:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a30f7f640 1 -- 172.21.15.82:0/221442161 learned_addr learned my addr 172.21.15.82:0/221442161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/221442161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d20fb0 0x55f072d21410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/221442161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d34800 msgr2=0x55f072d20990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:24:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/221442161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d34800 0x55f072d20990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/221442161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d33e50 msgr2=0x55f072d34230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/221442161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d33e50 0x55f072d34230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/221442161 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f07299e3f0 con 0x55f072d20fb0 2024-03-27T07:24:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a30f7f640 1 --2- 172.21.15.82:0/221442161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d33e50 0x55f072d34230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.493+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/221442161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d20fb0 0x55f072d21410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a20037040 tx=0x7f1a20009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d0bd11b316c465e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.494+0000 7f1a297fa640 1 -- 172.21.15.82:0/4286627546 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7f1a1c0046c0 con 0x7f1a2c069130 2024-03-27T07:24:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.494+0000 7f1a127fc640 1 -- 172.21.15.82:0/221442161 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20043020 con 0x55f072d20fb0 2024-03-27T07:24:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.494+0000 7f1a127fc640 1 -- 172.21.15.82:0/221442161 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a20034cb0 con 0x55f072d20fb0 2024-03-27T07:24:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.494+0000 7f1a127fc640 1 -- 172.21.15.82:0/221442161 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20039040 con 0x55f072d20fb0 2024-03-27T07:24:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.494+0000 7f1a297fa640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1a140a38a0 0x7f1a140a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a355d5740 1 -- 172.21.15.82:0/221442161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d20fb0 msgr2=0x55f072d21410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a355d5740 1 --2- 172.21.15.82:0/221442161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d20fb0 0x55f072d21410 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a20037040 tx=0x7f1a20009510 comp rx=0 tx=0).stop 2024-03-27T07:24:43.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a297fa640 1 -- 172.21.15.82:0/4286627546 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f1a1c0d0640 con 0x7f1a2c069130 2024-03-27T07:24:43.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a30f7f640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1a140a38a0 0x7f1a140a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a355d5740 1 -- 172.21.15.82:0/221442161 shutdown_connections 2024-03-27T07:24:43.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a355d5740 1 --2- 172.21.15.82:0/221442161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d20fb0 0x55f072d21410 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a355d5740 1 --2- 172.21.15.82:0/221442161 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d34800 0x55f072d20990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a355d5740 1 --2- 172.21.15.82:0/221442161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d33e50 0x55f072d34230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a355d5740 1 -- 172.21.15.82:0/221442161 >> 172.21.15.82:0/221442161 conn(0x55f072d23450 msgr2=0x55f072d23830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a355d5740 1 -- 172.21.15.82:0/221442161 shutdown_connections 2024-03-27T07:24:43.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a355d5740 1 -- 172.21.15.82:0/221442161 wait complete. 2024-03-27T07:24:43.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a30f7f640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1a140a38a0 0x7f1a140a5d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009d60 tx=0x7f1a24009500 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.495+0000 7f1a355d5740 1 -- start start 2024-03-27T07:24:43.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.496+0000 7f1a355d5740 1 Processor -- start 2024-03-27T07:24:43.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.496+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d20fb0 0x55f072d37df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.496+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d33e50 0x55f072d38330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.496+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d34800 0x55f072d38870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.496+0000 7f1a2bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d20fb0 0x55f072d37df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.496+0000 7f1a2bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d20fb0 0x55f072d37df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42448/0 (socket says 172.21.15.82:42448) 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.496+0000 7f1a2bfff640 1 -- 172.21.15.82:0/1357086865 learned_addr learned my addr 172.21.15.82:0/1357086865 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.496+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d33e50 0x55f072d38330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.496+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f072d3b230 con 0x55f072d20fb0 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f072c45eb0 con 0x55f072d33e50 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a30f7f640 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d34800 0x55f072d38870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f072d3b3b0 con 0x55f072d34800 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a355d5740 10 client.0 _ll_register_callbacks cb 0x55f072c826a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a2bfff640 1 -- 172.21.15.82:0/1357086865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d34800 msgr2=0x55f072d38870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d34800 0x55f072d38870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a2bfff640 1 -- 172.21.15.82:0/1357086865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d33e50 msgr2=0x55f072d38330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d33e50 0x55f072d38330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a2bfff640 1 -- 172.21.15.82:0/1357086865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f072a687d0 con 0x55f072d20fb0 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d33e50 0x55f072d38330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d20fb0 0x55f072d37df0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c000c00 tx=0x7f1a1c09c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7af8d912e4b245 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a20034cb0 con 0x55f072d20fb0 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.497+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1357086865 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0b4020 con 0x55f072d20fb0 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1357086865 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f1a1c0cdf40 con 0x55f072d20fb0 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1357086865 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1a1c09c5d0 con 0x55f072d20fb0 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a355d5740 10 client.15753 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=22}) -- 0x55f072d47420 con 0x55f072d20fb0 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1357086865 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f1a1c0bb170 con 0x55f072d20fb0 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a355d5740 10 client.15753 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a355d5740 10 client.15753 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a355d5740 20 client.15753 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55f072d48c80 0x55f072d4b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a355d5740 4 client.15753 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f072c97c50 con 0x55f072d48c80 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.498+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55f072d48c80 0x55f072d4b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.499+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55f072d48c80 0x55f072d4b140 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3567de0d96def4f server_cookie=7c40acf10333185c in_seq=0 out_seq=0 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.499+0000 7f1a0b7fe640 10 client.15753 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1357086865 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f072c97c50 con 0x55f072d48c80 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a0b7fe640 10 client.15753 handle_command_reply: tid=0 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 client.15753 shutdown 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d20fb0 msgr2=0x55f072d37df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d20fb0 0x55f072d37df0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c000c00 tx=0x7f1a1c09c200 comp rx=0 tx=0).stop 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 shutdown_connections 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55f072d48c80 0x55f072d4b140 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d34800 0x55f072d38870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d33e50 0x55f072d38330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1357086865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d20fb0 0x55f072d37df0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 >> 172.21.15.82:0/1357086865 conn(0x55f072d23450 msgr2=0x55f072d22bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a0b7fe640 0 client.15753 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:24:43.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 shutdown_connections 2024-03-27T07:24:43.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 1 -- 172.21.15.82:0/1357086865 wait complete. 2024-03-27T07:24:43.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.500+0000 7f1a355d5740 20 client.15753 trim_cache size 0 max 16384 2024-03-27T07:24:43.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.513+0000 7f1a355d5740 1 Processor -- start 2024-03-27T07:24:43.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a355d5740 1 -- start start 2024-03-27T07:24:43.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 0x55f072d44010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d366e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d36c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a355d5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1add30 con 0x55f072d34800 2024-03-27T07:24:43.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a355d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1ab600 con 0x55f072d20fb0 2024-03-27T07:24:43.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a355d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1a9450 con 0x55f072d33e50 2024-03-27T07:24:43.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a2b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a30f7f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d36c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a2b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d366e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47110/0 (socket says 172.21.15.82:47110) 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a30f7f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d36c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42460/0 (socket says 172.21.15.82:42460) 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/2784208364 learned_addr learned my addr 172.21.15.82:0/2784208364 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/2784208364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 0x55f072d44010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/2784208364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 msgr2=0x55f072d44010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/2784208364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 0x55f072d44010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/2784208364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 msgr2=0x55f072d36c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/2784208364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d36c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/2784208364 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f072d3b3a0 con 0x55f072d33e50 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.514+0000 7f1a30f7f640 1 --2- 172.21.15.82:0/2784208364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d36c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.515+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/2784208364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d366e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009780 tx=0x7f1a200056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c727481aab4405a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.515+0000 7f1a11ffb640 1 -- 172.21.15.82:0/2784208364 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20043040 con 0x55f072d33e50 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.515+0000 7f1a11ffb640 1 -- 172.21.15.82:0/2784208364 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a2004c070 con 0x55f072d33e50 2024-03-27T07:24:43.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.515+0000 7f1a11ffb640 1 -- 172.21.15.82:0/2784208364 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20034e60 con 0x55f072d33e50 2024-03-27T07:24:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 -- 172.21.15.82:0/2784208364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 msgr2=0x55f072d366e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 --2- 172.21.15.82:0/2784208364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d366e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009780 tx=0x7f1a200056d0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 -- 172.21.15.82:0/2784208364 shutdown_connections 2024-03-27T07:24:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 --2- 172.21.15.82:0/2784208364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d36c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 --2- 172.21.15.82:0/2784208364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d366e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 --2- 172.21.15.82:0/2784208364 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 0x55f072d44010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 -- 172.21.15.82:0/2784208364 >> 172.21.15.82:0/2784208364 conn(0x55f072d23450 msgr2=0x55f072d32010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 -- 172.21.15.82:0/2784208364 shutdown_connections 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 -- 172.21.15.82:0/2784208364 wait complete. 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 -- start start 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 Processor -- start 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 0x55f072d40640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.516+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d30880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a355d5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d30dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a355d5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1a9ac0 con 0x55f072d34800 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a355d5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1aaf30 con 0x55f072d20fb0 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a355d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c1aa190 con 0x55f072d33e50 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a355d5740 10 client.0 _ll_register_callbacks cb 0x7f1a1c00ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d30880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a30f7f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d30dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d30880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47120/0 (socket says 172.21.15.82:47120) 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/1442057583 learned_addr learned my addr 172.21.15.82:0/1442057583 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 0x55f072d40640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/1442057583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 msgr2=0x55f072d40640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 0x55f072d40640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/1442057583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 msgr2=0x55f072d30dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d30dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2b7fe640 1 -- 172.21.15.82:0/1442057583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f072d50f30 con 0x55f072d33e50 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a30f7f640 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d30dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 0x55f072d40640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a2b7fe640 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d30880 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a20005e00 tx=0x7f1a20009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c6556fdf0d07462 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1442057583 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20034e60 con 0x55f072d33e50 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a355d5740 1 -- 172.21.15.82:0/1442057583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a2004c070 con 0x55f072d33e50 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.517+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1442057583 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f1a2002c620 con 0x55f072d33e50 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1442057583 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f1a20039040 con 0x55f072d33e50 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a355d5740 10 client.25594 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a355d5740 1 -- 172.21.15.82:0/1442057583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55f072d50690 con 0x55f072d33e50 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1442057583 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a2004c070 con 0x55f072d33e50 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1442057583 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f1a20032640 con 0x55f072d33e50 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a355d5740 10 client.25594 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a355d5740 10 client.25594 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a355d5740 20 client.25594 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55f072daf080 0x55f072db1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a355d5740 4 client.25594 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:24:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a355d5740 1 -- 172.21.15.82:0/1442057583 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f072c91fa0 con 0x55f072daf080 2024-03-27T07:24:43.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.518+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55f072daf080 0x55f072db1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a0b7fe640 10 client.25594 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:24:43.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a2bfff640 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55f072daf080 0x55f072db1470 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=aaaea22f337baada server_cookie=5f4802eae4508143 in_seq=0 out_seq=0 2024-03-27T07:24:43.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a0b7fe640 1 -- 172.21.15.82:0/1442057583 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f072c91fa0 con 0x55f072daf080 2024-03-27T07:24:43.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a0b7fe640 10 client.25594 handle_command_reply: tid=0 2024-03-27T07:24:43.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 client.25594 shutdown 2024-03-27T07:24:43.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 -- 172.21.15.82:0/1442057583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 msgr2=0x55f072d30880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d30880 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a20005e00 tx=0x7f1a20009510 comp rx=0 tx=0).stop 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 -- 172.21.15.82:0/1442057583 shutdown_connections 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55f072daf080 0x55f072db1470 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f072d34800 0x55f072d30dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f072d33e50 0x55f072d30880 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a0b7fe640 0 client.25594 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 --2- 172.21.15.82:0/1442057583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f072d20fb0 0x55f072d40640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 -- 172.21.15.82:0/1442057583 >> 172.21.15.82:0/1442057583 conn(0x55f072d23450 msgr2=0x55f072d32e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 -- 172.21.15.82:0/1442057583 shutdown_connections 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 1 -- 172.21.15.82:0/1442057583 wait complete. 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.519+0000 7f1a355d5740 20 client.25594 trim_cache size 0 max 16384 2024-03-27T07:24:43.528 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:24:43.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 -- 172.21.15.82:0/4286627546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1a140a38a0 msgr2=0x7f1a140a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1a140a38a0 0x7f1a140a5d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009d60 tx=0x7f1a24009500 comp rx=0 tx=0).stop 2024-03-27T07:24:43.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 -- 172.21.15.82:0/4286627546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c069130 msgr2=0x7f1a2c1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c069130 0x7f1a2c1983f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00e9c0 tx=0x7f1a1c00ee80 comp rx=0 tx=0).stop 2024-03-27T07:24:43.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 -- 172.21.15.82:0/4286627546 shutdown_connections 2024-03-27T07:24:43.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1a140a38a0 0x7f1a140a5d60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a2c1066d0 0x7f1a2c198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1a2c107090 0x7f1a2c19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 --2- 172.21.15.82:0/4286627546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a2c069130 0x7f1a2c1983f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 -- 172.21.15.82:0/4286627546 >> 172.21.15.82:0/4286627546 conn(0x7f1a2c077b50 msgr2=0x7f1a2c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 -- 172.21.15.82:0/4286627546 shutdown_connections 2024-03-27T07:24:43.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.520+0000 7f1a329e2640 1 -- 172.21.15.82:0/4286627546 wait complete. 2024-03-27T07:24:43.536 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T07:24:43.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.641+0000 7f83333c9640 1 -- 172.21.15.82:0/460544072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f832c1009c0 msgr2=0x7f832c100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.641+0000 7f83333c9640 1 --2- 172.21.15.82:0/460544072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f832c1009c0 0x7f832c100e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f831c009930 tx=0x7f831c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:24:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.641+0000 7f83333c9640 1 -- 172.21.15.82:0/460544072 shutdown_connections 2024-03-27T07:24:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.641+0000 7f83333c9640 1 --2- 172.21.15.82:0/460544072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c101380 0x7f832c10d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.641+0000 7f83333c9640 1 --2- 172.21.15.82:0/460544072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f832c1009c0 0x7f832c100e40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.641+0000 7f83333c9640 1 --2- 172.21.15.82:0/460544072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f832c1069d0 0x7f832c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.641+0000 7f83333c9640 1 -- 172.21.15.82:0/460544072 >> 172.21.15.82:0/460544072 conn(0x7f832c077b50 msgr2=0x7f832c077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.641+0000 7f83333c9640 1 -- 172.21.15.82:0/460544072 shutdown_connections 2024-03-27T07:24:43.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.641+0000 7f83333c9640 1 -- 172.21.15.82:0/460544072 wait complete. 2024-03-27T07:24:43.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f83333c9640 1 Processor -- start 2024-03-27T07:24:43.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f83333c9640 1 -- start start 2024-03-27T07:24:43.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f83333c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c1009c0 0x7f832c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f83333c9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f832c101380 0x7f832c1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f83333c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f832c1069d0 0x7f832c1a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f83333c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f832c110de0 con 0x7f832c1009c0 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f83333c9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f832c110c60 con 0x7f832c101380 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f83333c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f832c110f60 con 0x7f832c1069d0 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f8330964640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f832c101380 0x7f832c1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f8330964640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f832c101380 0x7f832c1997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35854/0 (socket says 172.21.15.82:35854) 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f8330964640 1 -- 172.21.15.82:0/2904513215 learned_addr learned my addr 172.21.15.82:0/2904513215 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.642+0000 7f8331966640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f832c1069d0 0x7f832c1a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f8331165640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c1009c0 0x7f832c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f8330964640 1 -- 172.21.15.82:0/2904513215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f832c1069d0 msgr2=0x7f832c1a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f8330964640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f832c1069d0 0x7f832c1a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f8330964640 1 -- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c1009c0 msgr2=0x7f832c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f8330964640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c1009c0 0x7f832c199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f8330964640 1 -- 172.21.15.82:0/2904513215 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832c1a4840 con 0x7f832c101380 2024-03-27T07:24:43.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f8331165640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c1009c0 0x7f832c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:24:43.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f8330964640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f832c101380 0x7f832c1997c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f831c009230 tx=0x7f831c02cba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f83227fc640 1 -- 172.21.15.82:0/2904513215 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c041070 con 0x7f832c101380 2024-03-27T07:24:43.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f83333c9640 1 -- 172.21.15.82:0/2904513215 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832c1a4a10 con 0x7f832c101380 2024-03-27T07:24:43.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f83227fc640 1 -- 172.21.15.82:0/2904513215 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f831c004450 con 0x7f832c101380 2024-03-27T07:24:43.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f83227fc640 1 -- 172.21.15.82:0/2904513215 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c034440 con 0x7f832c101380 2024-03-27T07:24:43.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.643+0000 7f83333c9640 1 -- 172.21.15.82:0/2904513215 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f832c1a4e80 con 0x7f832c101380 2024-03-27T07:24:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8335fb4740 1 Processor -- start 2024-03-27T07:24:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8335fb4740 1 -- start start 2024-03-27T07:24:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510ef7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 0x565510ee3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ee3fb0 0x565510ee4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8335fb4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565510e4d710 con 0x565510ef6e50 2024-03-27T07:24:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8335fb4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x565510df5af0 con 0x565510ef7800 2024-03-27T07:24:43.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8335fb4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565510e496c0 con 0x565510ee3fb0 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8331966640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510ef7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8331966640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510ef7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42516/0 (socket says 172.21.15.82:42516) 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8331966640 1 -- 172.21.15.82:0/579681588 learned_addr learned my addr 172.21.15.82:0/579681588 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f8331165640 1 --2- 172.21.15.82:0/579681588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 0x565510ee3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.646+0000 7f83227fc640 1 -- 172.21.15.82:0/2904513215 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7f831c044070 con 0x7f832c101380 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f8330964640 1 --2- 172.21.15.82:0/579681588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ee3fb0 0x565510ee4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f8331966640 1 -- 172.21.15.82:0/579681588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ee3fb0 msgr2=0x565510ee4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f8331966640 1 --2- 172.21.15.82:0/579681588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ee3fb0 0x565510ee4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f8331966640 1 -- 172.21.15.82:0/579681588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 msgr2=0x565510ee3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f8331966640 1 --2- 172.21.15.82:0/579681588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 0x565510ee3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f8331966640 1 -- 172.21.15.82:0/579681588 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565510b613f0 con 0x565510ef6e50 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f8330964640 1 --2- 172.21.15.82:0/579681588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ee3fb0 0x565510ee4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f8331966640 1 --2- 172.21.15.82:0/579681588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510ef7230 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8324009fd0 tx=0x7f83240118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a232f956fb8129 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f83227fc640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83180a38a0 0x7f83180a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f83177fe640 1 -- 172.21.15.82:0/579681588 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324004d20 con 0x565510ef6e50 2024-03-27T07:24:43.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f83177fe640 1 -- 172.21.15.82:0/579681588 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8324004050 con 0x565510ef6e50 2024-03-27T07:24:43.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f83177fe640 1 -- 172.21.15.82:0/579681588 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324005260 con 0x565510ef6e50 2024-03-27T07:24:43.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.647+0000 7f83227fc640 1 -- 172.21.15.82:0/2904513215 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f831c0f1c80 con 0x7f832c101380 2024-03-27T07:24:43.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.648+0000 7f8331165640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83180a38a0 0x7f83180a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.648+0000 7f8335fb4740 1 -- 172.21.15.82:0/579681588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 msgr2=0x565510ef7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.648+0000 7f8331165640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83180a38a0 0x7f83180a5d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x565510ee4ad0 tx=0x7f8328009450 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.648+0000 7f8335fb4740 1 --2- 172.21.15.82:0/579681588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510ef7230 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8324009fd0 tx=0x7f83240118d0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.648+0000 7f8335fb4740 1 -- 172.21.15.82:0/579681588 shutdown_connections 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.648+0000 7f8335fb4740 1 --2- 172.21.15.82:0/579681588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ee3fb0 0x565510ee4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.648+0000 7f8335fb4740 1 --2- 172.21.15.82:0/579681588 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 0x565510ee3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.648+0000 7f8335fb4740 1 --2- 172.21.15.82:0/579681588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510ef7230 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.648+0000 7f8335fb4740 1 -- 172.21.15.82:0/579681588 >> 172.21.15.82:0/579681588 conn(0x565510ee6450 msgr2=0x565510ee6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.649+0000 7f8335fb4740 1 -- 172.21.15.82:0/579681588 shutdown_connections 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.649+0000 7f8335fb4740 1 -- 172.21.15.82:0/579681588 wait complete. 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.649+0000 7f8335fb4740 1 -- start start 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.649+0000 7f8335fb4740 1 Processor -- start 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.649+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.649+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510efb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef7800 0x565510efb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8335fb4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565510efe290 con 0x565510ef7800 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8335fb4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x565510e08eb0 con 0x565510ee3fb0 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8335fb4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565510efe410 con 0x565510ef6e50 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8335fb4740 10 client.0 _ll_register_callbacks cb 0x565510e456a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8331165640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8330964640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510efb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8331165640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35878/0 (socket says 172.21.15.82:35878) 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8330964640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510efb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47172/0 (socket says 172.21.15.82:47172) 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8331165640 1 -- 172.21.15.82:0/1202715111 learned_addr learned my addr 172.21.15.82:0/1202715111 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8331966640 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef7800 0x565510efb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8330964640 1 -- 172.21.15.82:0/1202715111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 msgr2=0x565510efadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8330964640 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8330964640 1 -- 172.21.15.82:0/1202715111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef7800 msgr2=0x565510efb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8330964640 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef7800 0x565510efb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8330964640 1 -- 172.21.15.82:0/1202715111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565510c2b7d0 con 0x565510ef6e50 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8331165640 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8331966640 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef7800 0x565510efb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8330964640 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510efb310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f831c0ef3b0 tx=0x7f831c003990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a54f48915b12743 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.650+0000 7f8314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8314ff9640 1 -- 172.21.15.82:0/1202715111 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c04b050 con 0x565510ef6e50 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8314ff9640 1 -- 172.21.15.82:0/1202715111 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f831c0035f0 con 0x565510ef6e50 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8335fb4740 1 -- 172.21.15.82:0/1202715111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8324004050 con 0x565510ef6e50 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8314ff9640 1 -- 172.21.15.82:0/1202715111 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f831c004c80 con 0x565510ef6e50 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8335fb4740 10 client.25603 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8335fb4740 1 -- 172.21.15.82:0/1202715111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x565510efe290 con 0x565510ef6e50 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8314ff9640 1 -- 172.21.15.82:0/1202715111 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8324004050 con 0x565510ef6e50 2024-03-27T07:24:43.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8314ff9640 1 -- 172.21.15.82:0/1202715111 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f831c0c6500 con 0x565510ef6e50 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8335fb4740 10 client.25603 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8335fb4740 10 client.25603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8335fb4740 20 client.25603 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8335fb4740 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565510f0b930 0x565510f0dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8335fb4740 4 client.25603 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.651+0000 7f8335fb4740 1 -- 172.21.15.82:0/1202715111 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565510e5ac50 con 0x565510f0b930 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.652+0000 7f8331165640 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565510f0b930 0x565510f0dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.652+0000 7f8331165640 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565510f0b930 0x565510f0dd50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bd5b16fc592ad1d server_cookie=828ccfcd4b0c49b6 in_seq=0 out_seq=0 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.652+0000 7f8314ff9640 10 client.25603 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8314ff9640 1 -- 172.21.15.82:0/1202715111 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x565510e5ac50 con 0x565510f0b930 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8314ff9640 10 client.25603 handle_command_reply: tid=0 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 client.25603 shutdown 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 -- 172.21.15.82:0/1202715111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 msgr2=0x565510efb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510efb310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f831c0ef3b0 tx=0x7f831c003990 comp rx=0 tx=0).stop 2024-03-27T07:24:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 -- 172.21.15.82:0/1202715111 shutdown_connections 2024-03-27T07:24:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565510f0b930 0x565510f0dd50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef7800 0x565510efb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510efb310 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 --2- 172.21.15.82:0/1202715111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 -- 172.21.15.82:0/1202715111 >> 172.21.15.82:0/1202715111 conn(0x565510ee6450 msgr2=0x565510ee5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8314ff9640 0 client.25603 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 -- 172.21.15.82:0/1202715111 shutdown_connections 2024-03-27T07:24:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 1 -- 172.21.15.82:0/1202715111 wait complete. 2024-03-27T07:24:43.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.653+0000 7f8335fb4740 20 client.25603 trim_cache size 0 max 16384 2024-03-27T07:24:43.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.679+0000 7f8335fb4740 1 Processor -- start 2024-03-27T07:24:43.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.679+0000 7f8335fb4740 1 -- start start 2024-03-27T07:24:43.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.679+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.679+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510f070f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.679+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef7800 0x565510efad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.679+0000 7f8335fb4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1ade70 con 0x565510ef6e50 2024-03-27T07:24:43.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8335fb4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1ab740 con 0x565510ee3fb0 2024-03-27T07:24:43.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8335fb4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1a95b0 con 0x565510ef7800 2024-03-27T07:24:43.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8330964640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510f070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331165640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331966640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef7800 0x565510efad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331165640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35884/0 (socket says 172.21.15.82:35884) 2024-03-27T07:24:43.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331966640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef7800 0x565510efad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47176/0 (socket says 172.21.15.82:47176) 2024-03-27T07:24:43.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8330964640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510f070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42536/0 (socket says 172.21.15.82:42536) 2024-03-27T07:24:43.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331165640 1 -- 172.21.15.82:0/3765973542 learned_addr learned my addr 172.21.15.82:0/3765973542 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331165640 1 -- 172.21.15.82:0/3765973542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef7800 msgr2=0x565510efad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331165640 1 --2- 172.21.15.82:0/3765973542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef7800 0x565510efad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331165640 1 -- 172.21.15.82:0/3765973542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 msgr2=0x565510f070f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331165640 1 --2- 172.21.15.82:0/3765973542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510f070f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331165640 1 -- 172.21.15.82:0/3765973542 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565510f07630 con 0x565510ee3fb0 2024-03-27T07:24:43.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8330964640 1 --2- 172.21.15.82:0/3765973542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510f070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331966640 1 --2- 172.21.15.82:0/3765973542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef7800 0x565510efad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8331165640 1 --2- 172.21.15.82:0/3765973542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efd500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8328009760 tx=0x7f8328014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b51161ee3c29fa2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8316ffd640 1 -- 172.21.15.82:0/3765973542 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832802e070 con 0x565510ee3fb0 2024-03-27T07:24:43.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8316ffd640 1 -- 172.21.15.82:0/3765973542 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83280287b0 con 0x565510ee3fb0 2024-03-27T07:24:43.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.680+0000 7f8316ffd640 1 -- 172.21.15.82:0/3765973542 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832801fb60 con 0x565510ee3fb0 2024-03-27T07:24:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.681+0000 7f8335fb4740 1 -- 172.21.15.82:0/3765973542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 msgr2=0x565510efd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.681+0000 7f8335fb4740 1 --2- 172.21.15.82:0/3765973542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efd500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8328009760 tx=0x7f8328014000 comp rx=0 tx=0).stop 2024-03-27T07:24:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.681+0000 7f8335fb4740 1 -- 172.21.15.82:0/3765973542 shutdown_connections 2024-03-27T07:24:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.681+0000 7f8335fb4740 1 --2- 172.21.15.82:0/3765973542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ef6e50 0x565510f070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.681+0000 7f8335fb4740 1 --2- 172.21.15.82:0/3765973542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef7800 0x565510efad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.681+0000 7f8335fb4740 1 --2- 172.21.15.82:0/3765973542 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ee3fb0 0x565510efd500 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.681+0000 7f8335fb4740 1 -- 172.21.15.82:0/3765973542 >> 172.21.15.82:0/3765973542 conn(0x565510ee6450 msgr2=0x565510ef96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.682+0000 7f8335fb4740 1 -- 172.21.15.82:0/3765973542 shutdown_connections 2024-03-27T07:24:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.682+0000 7f8335fb4740 1 -- 172.21.15.82:0/3765973542 wait complete. 2024-03-27T07:24:43.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.682+0000 7f8335fb4740 1 -- start start 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.682+0000 7f8335fb4740 1 Processor -- start 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.682+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ee3fb0 0x565510f12a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.682+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510f12fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.682+0000 7f8335fb4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 0x565510f13500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8335fb4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1a9c00 con 0x565510ee3fb0 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8331165640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ee3fb0 0x565510f12a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8335fb4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1ab070 con 0x565510ef7800 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8335fb4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1aa2d0 con 0x565510ef6e50 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8331165640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ee3fb0 0x565510f12a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42544/0 (socket says 172.21.15.82:42544) 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8331966640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 0x565510f13500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8331165640 1 -- 172.21.15.82:0/3250466978 learned_addr learned my addr 172.21.15.82:0/3250466978 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8330964640 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510f12fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8335fb4740 10 client.0 _ll_register_callbacks cb 0x7f831c009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8330964640 1 -- 172.21.15.82:0/3250466978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 msgr2=0x565510f13500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8330964640 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 0x565510f13500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8330964640 1 -- 172.21.15.82:0/3250466978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ee3fb0 msgr2=0x565510f12a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8330964640 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ee3fb0 0x565510f12a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8330964640 1 -- 172.21.15.82:0/3250466978 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565510f70ce0 con 0x565510ef6e50 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8331165640 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ee3fb0 0x565510f12a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8331966640 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 0x565510f13500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8330964640 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510f12fc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f831c009430 tx=0x7f831c0ba5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f30d013769658bfd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8314ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.683+0000 7f8314ff9640 1 -- 172.21.15.82:0/3250466978 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c004c80 con 0x565510ef6e50 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8314ff9640 1 -- 172.21.15.82:0/3250466978 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f831c0efb70 con 0x565510ef6e50 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8335fb4740 1 -- 172.21.15.82:0/3250466978 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83280287b0 con 0x565510ef6e50 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8314ff9640 1 -- 172.21.15.82:0/3250466978 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f831c02cd10 con 0x565510ef6e50 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8335fb4740 10 client.25609 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:43.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8335fb4740 1 -- 172.21.15.82:0/3250466978 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x565510f70ce0 con 0x565510ef6e50 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8314ff9640 1 -- 172.21.15.82:0/3250466978 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83280287b0 con 0x565510ef6e50 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8314ff9640 1 -- 172.21.15.82:0/3250466978 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f831c0c6be0 con 0x565510ef6e50 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8335fb4740 10 client.25609 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8335fb4740 10 client.25609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8335fb4740 20 client.25609 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8335fb4740 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565510f724d0 0x565510f748f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8335fb4740 4 client.25609 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8335fb4740 1 -- 172.21.15.82:0/3250466978 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565510e54fa0 con 0x565510f724d0 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.684+0000 7f8331165640 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565510f724d0 0x565510f748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8314ff9640 10 client.25609 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8331165640 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565510f724d0 0x565510f748f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5f288d3142343ff server_cookie=a5acaf304192eb01 in_seq=0 out_seq=0 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8314ff9640 1 -- 172.21.15.82:0/3250466978 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565510e54fa0 con 0x565510f724d0 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8314ff9640 10 client.25609 handle_command_reply: tid=0 2024-03-27T07:24:43.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 client.25609 shutdown 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 -- 172.21.15.82:0/3250466978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 msgr2=0x565510f12fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510f12fc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f831c009430 tx=0x7f831c0ba5a0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 -- 172.21.15.82:0/3250466978 shutdown_connections 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565510ef7800 0x565510f13500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565510ef6e50 0x565510f12fc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565510f724d0 0x565510f748f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 --2- 172.21.15.82:0/3250466978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565510ee3fb0 0x565510f12a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8314ff9640 0 client.25609 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 -- 172.21.15.82:0/3250466978 >> 172.21.15.82:0/3250466978 conn(0x565510ee6450 msgr2=0x565510ee2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 -- 172.21.15.82:0/3250466978 shutdown_connections 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 1 -- 172.21.15.82:0/3250466978 wait complete. 2024-03-27T07:24:43.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.685+0000 7f8335fb4740 20 client.25609 trim_cache size 0 max 16384 2024-03-27T07:24:43.695 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:24:43.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 -- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83180a38a0 msgr2=0x7f83180a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83180a38a0 0x7f83180a5d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x565510ee4ad0 tx=0x7f8328009450 comp rx=0 tx=0).stop 2024-03-27T07:24:43.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 -- 172.21.15.82:0/2904513215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f832c101380 msgr2=0x7f832c1997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:43.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f832c101380 0x7f832c1997c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f831c009230 tx=0x7f831c02cba0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 -- 172.21.15.82:0/2904513215 shutdown_connections 2024-03-27T07:24:43.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83180a38a0 0x7f83180a5d60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f832c1069d0 0x7f832c1a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f832c101380 0x7f832c1997c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 --2- 172.21.15.82:0/2904513215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f832c1009c0 0x7f832c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:43.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 -- 172.21.15.82:0/2904513215 >> 172.21.15.82:0/2904513215 conn(0x7f832c077b50 msgr2=0x7f832c1031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:43.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 -- 172.21.15.82:0/2904513215 shutdown_connections 2024-03-27T07:24:43.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:43.686+0000 7f83333c9640 1 -- 172.21.15.82:0/2904513215 wait complete. 2024-03-27T07:24:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:43 smithi082 ceph-mon[32178]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:24:43.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:43 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2561871244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:24:44.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:43 smithi153 ceph-mon[36179]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:24:44.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:43 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2561871244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:24:44.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:43 smithi149 ceph-mon[36065]: pgmap v37: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:24:44.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:43 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2561871244' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:24:44.699 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T07:24:44.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:24:44.700 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T07:24:44.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.811+0000 7f957a372640 1 -- 172.21.15.82:0/780428949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574069650 msgr2=0x7f957410dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.811+0000 7f957a372640 1 --2- 172.21.15.82:0/780428949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574069650 0x7f957410dfb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9568009900 tx=0x7f956802bc30 comp rx=0 tx=0).stop 2024-03-27T07:24:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.811+0000 7f957a372640 1 -- 172.21.15.82:0/780428949 shutdown_connections 2024-03-27T07:24:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.811+0000 7f957a372640 1 --2- 172.21.15.82:0/780428949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574069650 0x7f957410dfb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.811+0000 7f957a372640 1 --2- 172.21.15.82:0/780428949 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f957410e4f0 0x7f95741108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.811+0000 7f957a372640 1 --2- 172.21.15.82:0/780428949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9574068d30 0x7f9574069110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.811+0000 7f957a372640 1 -- 172.21.15.82:0/780428949 >> 172.21.15.82:0/780428949 conn(0x7f9574077b50 msgr2=0x7f9574077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.811+0000 7f957a372640 1 -- 172.21.15.82:0/780428949 shutdown_connections 2024-03-27T07:24:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.811+0000 7f957a372640 1 -- 172.21.15.82:0/780428949 wait complete. 2024-03-27T07:24:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f957a372640 1 Processor -- start 2024-03-27T07:24:44.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f957a372640 1 -- start start 2024-03-27T07:24:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f957a372640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9574068d30 0x7f957419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f957a372640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574069650 0x7f957419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f957a372640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f957410e4f0 0x7f957419eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f95737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574069650 0x7f957419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f95737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574069650 0x7f957419ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42560/0 (socket says 172.21.15.82:42560) 2024-03-27T07:24:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f95737fe640 1 -- 172.21.15.82:0/1988235331 learned_addr learned my addr 172.21.15.82:0/1988235331 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95741140e0 con 0x7f9574069650 2024-03-27T07:24:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9574113f60 con 0x7f9574068d30 2024-03-27T07:24:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f9573fff640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9574068d30 0x7f957419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.812+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9574114260 con 0x7f957410e4f0 2024-03-27T07:24:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f9573fff640 1 -- 172.21.15.82:0/1988235331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f957410e4f0 msgr2=0x7f957419eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f9573fff640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f957410e4f0 0x7f957419eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f9573fff640 1 -- 172.21.15.82:0/1988235331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574069650 msgr2=0x7f957419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f9573fff640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574069650 0x7f957419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f9573fff640 1 -- 172.21.15.82:0/1988235331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957419f610 con 0x7f9574068d30 2024-03-27T07:24:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f95737fe640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574069650 0x7f957419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f9573fff640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9574068d30 0x7f957419a620 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f956400e9f0 tx=0x7f956400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f95717fa640 1 -- 172.21.15.82:0/1988235331 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956400ccc0 con 0x7f9574068d30 2024-03-27T07:24:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f957419f900 con 0x7f9574068d30 2024-03-27T07:24:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f95717fa640 1 -- 172.21.15.82:0/1988235331 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9564010910 con 0x7f9574068d30 2024-03-27T07:24:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f95717fa640 1 -- 172.21.15.82:0/1988235331 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9564018960 con 0x7f9574068d30 2024-03-27T07:24:44.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.813+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95741a7190 con 0x7f9574068d30 2024-03-27T07:24:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.816+0000 7f95717fa640 1 -- 172.21.15.82:0/1988235331 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7f9564010ac0 con 0x7f9574068d30 2024-03-27T07:24:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.816+0000 7f957d030740 1 Processor -- start 2024-03-27T07:24:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.816+0000 7f957d030740 1 -- start start 2024-03-27T07:24:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f957d030740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c38e50 0x55cf92c39230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f957d030740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c39770 0x55cf92c41e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f957d030740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92c44740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f957d030740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cf92b43c20 con 0x55cf92c42350 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f957d030740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55cf92b9c430 con 0x55cf92c38e50 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f957d030740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cf92b44900 con 0x55cf92c39770 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f95717fa640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f955c0a3920 0x7f955c0a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f9573fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c39770 0x55cf92c41e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f95737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92c44740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f957890f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c38e50 0x55cf92c39230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f957890f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c38e50 0x55cf92c39230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35918/0 (socket says 172.21.15.82:35918) 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f957890f640 1 -- 172.21.15.82:0/314742598 learned_addr learned my addr 172.21.15.82:0/314742598 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f9573fff640 1 --2- 172.21.15.82:0/314742598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c39770 0x55cf92c41e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47206/0 (socket says 172.21.15.82:47206) 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f95717fa640 1 -- 172.21.15.82:0/1988235331 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f95640d0740 con 0x7f9574068d30 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f957890f640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f955c0a3920 0x7f955c0a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f95737fe640 1 -- 172.21.15.82:0/314742598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c39770 msgr2=0x55cf92c41e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f95737fe640 1 --2- 172.21.15.82:0/314742598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c39770 0x55cf92c41e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f95737fe640 1 -- 172.21.15.82:0/314742598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c38e50 msgr2=0x55cf92c39230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.817+0000 7f95737fe640 1 --2- 172.21.15.82:0/314742598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c38e50 0x55cf92c39230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.818+0000 7f95737fe640 1 -- 172.21.15.82:0/314742598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf92b97180 con 0x55cf92c42350 2024-03-27T07:24:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.818+0000 7f9573fff640 1 --2- 172.21.15.82:0/314742598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c39770 0x55cf92c41e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.818+0000 7f95737fe640 1 --2- 172.21.15.82:0/314742598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92c44740 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9568006010 tx=0x7f95680095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f87153fbcf1678 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.818+0000 7f957890f640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f955c0a3920 0x7f955c0a5de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f956c009fd0 tx=0x7f956c009b10 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.818+0000 7f955a7fc640 1 -- 172.21.15.82:0/314742598 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568045070 con 0x55cf92c42350 2024-03-27T07:24:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.818+0000 7f955a7fc640 1 -- 172.21.15.82:0/314742598 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f956802c690 con 0x55cf92c42350 2024-03-27T07:24:44.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.818+0000 7f955a7fc640 1 -- 172.21.15.82:0/314742598 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568004f60 con 0x55cf92c42350 2024-03-27T07:24:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.819+0000 7f957d030740 1 -- 172.21.15.82:0/314742598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 msgr2=0x55cf92c44740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.819+0000 7f957d030740 1 --2- 172.21.15.82:0/314742598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92c44740 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9568006010 tx=0x7f95680095f0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.819+0000 7f957d030740 1 -- 172.21.15.82:0/314742598 shutdown_connections 2024-03-27T07:24:44.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.819+0000 7f957d030740 1 --2- 172.21.15.82:0/314742598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92c44740 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.819+0000 7f957d030740 1 --2- 172.21.15.82:0/314742598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c39770 0x55cf92c41e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.819+0000 7f957d030740 1 --2- 172.21.15.82:0/314742598 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c38e50 0x55cf92c39230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.819+0000 7f957d030740 1 -- 172.21.15.82:0/314742598 >> 172.21.15.82:0/314742598 conn(0x55cf92c33580 msgr2=0x55cf92c33960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.819+0000 7f957d030740 1 -- 172.21.15.82:0/314742598 shutdown_connections 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.819+0000 7f957d030740 1 -- 172.21.15.82:0/314742598 wait complete. 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.819+0000 7f957d030740 1 -- start start 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f957d030740 1 Processor -- start 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f957d030740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c41c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f957d030740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f957d030740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92c3f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f957d030740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cf92b57cc0 con 0x55cf92c42350 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f957d030740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55cf92b983e0 con 0x55cf92c39770 2024-03-27T07:24:44.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f957d030740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cf92c450e0 con 0x55cf92c38e50 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f957d030740 10 client.0 _ll_register_callbacks cb 0x55cf92b92f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f95737fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f9573fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c41c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f95737fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35920/0 (socket says 172.21.15.82:35920) 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f95737fe640 1 -- 172.21.15.82:0/252716474 learned_addr learned my addr 172.21.15.82:0/252716474 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f957890f640 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92c3f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f95737fe640 1 -- 172.21.15.82:0/252716474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 msgr2=0x55cf92c41c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f95737fe640 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c41c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f95737fe640 1 -- 172.21.15.82:0/252716474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 msgr2=0x55cf92c3f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f95737fe640 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92c3f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f95737fe640 1 -- 172.21.15.82:0/252716474 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf92b5eef0 con 0x55cf92c39770 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f9573fff640 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c41c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:44.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.820+0000 7f957890f640 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92c3f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f95737fe640 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3efd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f956802ceb0 tx=0x7f9568004d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e56504fa00c31bb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f95537fe640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f95537fe640 1 -- 172.21.15.82:0/252716474 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568045040 con 0x55cf92c39770 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f95537fe640 1 -- 172.21.15.82:0/252716474 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9568005370 con 0x55cf92c39770 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f957d030740 1 -- 172.21.15.82:0/252716474 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cf92ba9970 con 0x55cf92c39770 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f95537fe640 1 -- 172.21.15.82:0/252716474 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f956805a050 con 0x55cf92c39770 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f957d030740 10 client.25610 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f957d030740 1 -- 172.21.15.82:0/252716474 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55cf929787e0 con 0x55cf92c39770 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f95537fe640 1 -- 172.21.15.82:0/252716474 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9568005570 con 0x55cf92c39770 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f95537fe640 1 -- 172.21.15.82:0/252716474 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f956803f4d0 con 0x55cf92c39770 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f957d030740 10 client.25610 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:44.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f957d030740 10 client.25610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f957d030740 20 client.25610 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f957d030740 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cf92c51ff0 0x55cf92c543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f957d030740 4 client.25610 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.821+0000 7f957d030740 1 -- 172.21.15.82:0/252716474 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf92ba9970 con 0x55cf92c51ff0 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.822+0000 7f9573fff640 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cf92c51ff0 0x55cf92c543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.822+0000 7f95537fe640 10 client.25610 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.822+0000 7f9573fff640 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cf92c51ff0 0x55cf92c543e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e204454f84b77174 server_cookie=b072b31232ccbb62 in_seq=0 out_seq=0 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f95537fe640 1 -- 172.21.15.82:0/252716474 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55cf92ba9970 con 0x55cf92c51ff0 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f95537fe640 10 client.25610 handle_command_reply: tid=0 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 client.25610 shutdown 2024-03-27T07:24:44.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 -- 172.21.15.82:0/252716474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 msgr2=0x55cf92c3efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3efd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f956802ceb0 tx=0x7f9568004d20 comp rx=0 tx=0).stop 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 -- 172.21.15.82:0/252716474 shutdown_connections 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cf92c51ff0 0x55cf92c543e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92c3f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3efd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 --2- 172.21.15.82:0/252716474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c41c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f95537fe640 0 client.25610 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 -- 172.21.15.82:0/252716474 >> 172.21.15.82:0/252716474 conn(0x55cf92c33580 msgr2=0x55cf92c352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 -- 172.21.15.82:0/252716474 shutdown_connections 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 1 -- 172.21.15.82:0/252716474 wait complete. 2024-03-27T07:24:44.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.823+0000 7f957d030740 20 client.25610 trim_cache size 0 max 16384 2024-03-27T07:24:44.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f957d030740 1 Processor -- start 2024-03-27T07:24:44.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f957d030740 1 -- start start 2024-03-27T07:24:44.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f957d030740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c4dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f957d030740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c39770 0x55cf92c59a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f957d030740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c42350 0x55cf92c41700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f957d030740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95741b2180 con 0x55cf92c39770 2024-03-27T07:24:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f957d030740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95741afa50 con 0x55cf92c42350 2024-03-27T07:24:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f957d030740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95741ad8a0 con 0x55cf92c38e50 2024-03-27T07:24:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f95737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c39770 0x55cf92c59a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f95737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c39770 0x55cf92c59a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42590/0 (socket says 172.21.15.82:42590) 2024-03-27T07:24:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f95737fe640 1 -- 172.21.15.82:0/1365777735 learned_addr learned my addr 172.21.15.82:0/1365777735 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:44.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f9573fff640 1 --2- 172.21.15.82:0/1365777735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c4dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f957890f640 1 --2- 172.21.15.82:0/1365777735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c42350 0x55cf92c41700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f9573fff640 1 -- 172.21.15.82:0/1365777735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c42350 msgr2=0x55cf92c41700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f9573fff640 1 --2- 172.21.15.82:0/1365777735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c42350 0x55cf92c41700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f9573fff640 1 -- 172.21.15.82:0/1365777735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c39770 msgr2=0x55cf92c59a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f9573fff640 1 --2- 172.21.15.82:0/1365777735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c39770 0x55cf92c59a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.841+0000 7f9573fff640 1 -- 172.21.15.82:0/1365777735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf92c3df80 con 0x55cf92c38e50 2024-03-27T07:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.842+0000 7f9573fff640 1 --2- 172.21.15.82:0/1365777735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c4dd00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f95640cdd60 tx=0x7f956406e300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93db96121b46fa69 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.842+0000 7f9559ffb640 1 -- 172.21.15.82:0/1365777735 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95640a0a80 con 0x55cf92c38e50 2024-03-27T07:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.842+0000 7f9559ffb640 1 -- 172.21.15.82:0/1365777735 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95640a5340 con 0x55cf92c38e50 2024-03-27T07:24:44.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.842+0000 7f9559ffb640 1 -- 172.21.15.82:0/1365777735 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956409bd80 con 0x55cf92c38e50 2024-03-27T07:24:44.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 -- 172.21.15.82:0/1365777735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 msgr2=0x55cf92c4dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 --2- 172.21.15.82:0/1365777735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c4dd00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f95640cdd60 tx=0x7f956406e300 comp rx=0 tx=0).stop 2024-03-27T07:24:44.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 -- 172.21.15.82:0/1365777735 shutdown_connections 2024-03-27T07:24:44.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 --2- 172.21.15.82:0/1365777735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c39770 0x55cf92c59a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 --2- 172.21.15.82:0/1365777735 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c42350 0x55cf92c41700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 --2- 172.21.15.82:0/1365777735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c4dd00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 -- 172.21.15.82:0/1365777735 >> 172.21.15.82:0/1365777735 conn(0x55cf92c33580 msgr2=0x55cf92c32590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:44.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 -- 172.21.15.82:0/1365777735 shutdown_connections 2024-03-27T07:24:44.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 -- 172.21.15.82:0/1365777735 wait complete. 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 -- start start 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.843+0000 7f957d030740 1 Processor -- start 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f957d030740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c3be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f957d030740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f957d030740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92cb7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f957d030740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95741adf10 con 0x55cf92c42350 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f957d030740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f95741af380 con 0x55cf92c39770 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f957890f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92cb7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f95737fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f95737fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35942/0 (socket says 172.21.15.82:35942) 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f9573fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c3be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f95737fe640 1 -- 172.21.15.82:0/455782914 learned_addr learned my addr 172.21.15.82:0/455782914 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:44.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f957d030740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f95741ae5e0 con 0x55cf92c38e50 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.844+0000 7f957d030740 10 client.0 _ll_register_callbacks cb 0x7f956c009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95737fe640 1 -- 172.21.15.82:0/455782914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 msgr2=0x55cf92c3be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95737fe640 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c3be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95737fe640 1 -- 172.21.15.82:0/455782914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 msgr2=0x55cf92cb7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95737fe640 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92cb7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95737fe640 1 -- 172.21.15.82:0/455782914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf929d8f70 con 0x55cf92c39770 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f9573fff640 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c3be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95737fe640 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3c3d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9568042040 tx=0x7f9568005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44b56933b1471076 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95537fe640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95537fe640 1 -- 172.21.15.82:0/455782914 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9568045040 con 0x55cf92c39770 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95537fe640 1 -- 172.21.15.82:0/455782914 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9568004040 con 0x55cf92c39770 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f957d030740 1 -- 172.21.15.82:0/455782914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95640a5340 con 0x55cf92c39770 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95537fe640 1 -- 172.21.15.82:0/455782914 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f9568004240 con 0x55cf92c39770 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f957d030740 10 client.25616 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:44.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f957d030740 1 -- 172.21.15.82:0/455782914 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55cf92870170 con 0x55cf92c39770 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95537fe640 1 -- 172.21.15.82:0/455782914 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95640a5340 con 0x55cf92c39770 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.845+0000 7f95537fe640 1 -- 172.21.15.82:0/455782914 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f9568003710 con 0x55cf92c39770 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.846+0000 7f957d030740 10 client.25616 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.846+0000 7f957d030740 10 client.25616 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.846+0000 7f957d030740 20 client.25616 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.846+0000 7f957d030740 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cf92cb89a0 0x55cf92cbadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.846+0000 7f957d030740 4 client.25616 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.846+0000 7f957d030740 1 -- 172.21.15.82:0/455782914 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cf92ba3cc0 con 0x55cf92cb89a0 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.846+0000 7f9573fff640 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cf92cb89a0 0x55cf92cbadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.846+0000 7f9573fff640 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cf92cb89a0 0x55cf92cbadc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c83a488db7cf2 server_cookie=2b99ce37cefcb290 in_seq=0 out_seq=0 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.846+0000 7f95537fe640 10 client.25616 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.847+0000 7f95537fe640 1 -- 172.21.15.82:0/455782914 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cf92ba3cc0 con 0x55cf92cb89a0 2024-03-27T07:24:44.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.847+0000 7f95537fe640 10 client.25616 handle_command_reply: tid=0 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.847+0000 7f957d030740 1 client.25616 shutdown 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 1 -- 172.21.15.82:0/455782914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 msgr2=0x55cf92c3c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3c3d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9568042040 tx=0x7f9568005fd0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 1 -- 172.21.15.82:0/455782914 shutdown_connections 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cf92cb89a0 0x55cf92cbadc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cf92c42350 0x55cf92cb7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cf92c39770 0x55cf92c3c3d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 1 --2- 172.21.15.82:0/455782914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cf92c38e50 0x55cf92c3be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 1 -- 172.21.15.82:0/455782914 >> 172.21.15.82:0/455782914 conn(0x55cf92c33580 msgr2=0x55cf92c39c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f95537fe640 0 client.25616 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 1 -- 172.21.15.82:0/455782914 shutdown_connections 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 1 -- 172.21.15.82:0/455782914 wait complete. 2024-03-27T07:24:44.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.848+0000 7f957d030740 20 client.25616 trim_cache size 0 max 16384 2024-03-27T07:24:44.859 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:24:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-03-27T07:24:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "c8262571-ea41-4fa3-8540-e5bc2b114e88", 2024-03-27T07:24:44.859 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-03-27T07:24:44.859 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:24:44.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f955c0a3920 msgr2=0x7f955c0a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f955c0a3920 0x7f955c0a5de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f956c009fd0 tx=0x7f956c009b10 comp rx=0 tx=0).stop 2024-03-27T07:24:44.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9574068d30 msgr2=0x7f957419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9574068d30 0x7f957419a620 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f956400e9f0 tx=0x7f956400eeb0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 shutdown_connections 2024-03-27T07:24:44.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f955c0a3920 0x7f955c0a5de0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9574069650 0x7f957419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f957410e4f0 0x7f957419eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 --2- 172.21.15.82:0/1988235331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9574068d30 0x7f957419a620 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 >> 172.21.15.82:0/1988235331 conn(0x7f9574077b50 msgr2=0x7f957410fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:44.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 shutdown_connections 2024-03-27T07:24:44.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.849+0000 7f957a372640 1 -- 172.21.15.82:0/1988235331 wait complete. 2024-03-27T07:24:44.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:24:44.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.986+0000 7fe449777640 1 -- 172.21.15.82:0/1838744707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4441009c0 msgr2=0x7fe444100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.986+0000 7fe449777640 1 --2- 172.21.15.82:0/1838744707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4441009c0 0x7fe444100e40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe438009930 tx=0x7fe43802bc30 comp rx=0 tx=0).stop 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.986+0000 7fe449777640 1 -- 172.21.15.82:0/1838744707 shutdown_connections 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.986+0000 7fe449777640 1 --2- 172.21.15.82:0/1838744707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe4441009c0 0x7fe444100e40 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.986+0000 7fe449777640 1 --2- 172.21.15.82:0/1838744707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe444101380 0x7fe44410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.986+0000 7fe449777640 1 --2- 172.21.15.82:0/1838744707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4441069d0 0x7fe444106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.986+0000 7fe449777640 1 -- 172.21.15.82:0/1838744707 >> 172.21.15.82:0/1838744707 conn(0x7fe444077b50 msgr2=0x7fe444077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.987+0000 7fe449777640 1 -- 172.21.15.82:0/1838744707 shutdown_connections 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.987+0000 7fe449777640 1 -- 172.21.15.82:0/1838744707 wait complete. 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.987+0000 7fe449777640 1 Processor -- start 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.987+0000 7fe449777640 1 -- start start 2024-03-27T07:24:44.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.987+0000 7fe449777640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4441009c0 0x7fe444197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.987+0000 7fe449777640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444101380 0x7fe444197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.987+0000 7fe449777640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4441069d0 0x7fe44419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.987+0000 7fe449777640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe444110de0 con 0x7fe444101380 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.987+0000 7fe449777640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe444110c60 con 0x7fe4441069d0 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.987+0000 7fe449777640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe444110f60 con 0x7fe4441009c0 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe442ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4441009c0 0x7fe444197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4427fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444101380 0x7fe444197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4437fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4441069d0 0x7fe44419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe442ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4441009c0 0x7fe444197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47244/0 (socket says 172.21.15.82:47244) 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4437fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4441069d0 0x7fe44419bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35964/0 (socket says 172.21.15.82:35964) 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe442ffd640 1 -- 172.21.15.82:0/3221936294 learned_addr learned my addr 172.21.15.82:0/3221936294 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4427fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444101380 0x7fe444197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42616/0 (socket says 172.21.15.82:42616) 2024-03-27T07:24:44.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4427fc640 1 -- 172.21.15.82:0/3221936294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4441009c0 msgr2=0x7fe444197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4427fc640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4441009c0 0x7fe444197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4427fc640 1 -- 172.21.15.82:0/3221936294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4441069d0 msgr2=0x7fe44419bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4427fc640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4441069d0 0x7fe44419bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4427fc640 1 -- 172.21.15.82:0/3221936294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44419c2f0 con 0x7fe444101380 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe442ffd640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4441009c0 0x7fe444197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4437fe640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4441069d0 0x7fe44419bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe4427fc640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444101380 0x7fe444197840 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe438009230 tx=0x7fe43802cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe42bfff640 1 -- 172.21.15.82:0/3221936294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438041070 con 0x7fe444101380 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe42bfff640 1 -- 172.21.15.82:0/3221936294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe438004450 con 0x7fe444101380 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe449777640 1 -- 172.21.15.82:0/3221936294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe44419c580 con 0x7fe444101380 2024-03-27T07:24:44.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.989+0000 7fe449777640 1 -- 172.21.15.82:0/3221936294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4441a3e70 con 0x7fe444101380 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.988+0000 7fe42bfff640 1 -- 172.21.15.82:0/3221936294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438003cc0 con 0x7fe444101380 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe44c436740 1 Processor -- start 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe44c436740 1 -- start start 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe44c436740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x5565945782f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe44c436740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x556594583420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe44c436740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594585d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe44c436740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565944dc860 con 0x556594577f10 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe44c436740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5565944848d0 con 0x556594583960 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe44c436740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5565944d8810 con 0x556594578830 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe4437fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x5565945782f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe4437fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x5565945782f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42624/0 (socket says 172.21.15.82:42624) 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe4437fe640 1 -- 172.21.15.82:0/665154204 learned_addr learned my addr 172.21.15.82:0/665154204 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.991+0000 7fe442ffd640 1 --2- 172.21.15.82:0/665154204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x556594583420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.992+0000 7fe4437fe640 1 -- 172.21.15.82:0/665154204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 msgr2=0x556594583420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.992+0000 7fe4437fe640 1 --2- 172.21.15.82:0/665154204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x556594583420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.992+0000 7fe4437fe640 1 -- 172.21.15.82:0/665154204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 msgr2=0x556594585d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.992+0000 7fe4437fe640 1 --2- 172.21.15.82:0/665154204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594585d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.992+0000 7fe4437fe640 1 -- 172.21.15.82:0/665154204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55659448f120 con 0x556594577f10 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.992+0000 7fe42bfff640 1 -- 172.21.15.82:0/3221936294 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7fe438044070 con 0x7fe444101380 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.992+0000 7fe4437fe640 1 --2- 172.21.15.82:0/665154204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x5565945782f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe43c011810 tx=0x7fe43c011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8861e69c0550d488 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.992+0000 7fe4297fa640 1 -- 172.21.15.82:0/665154204 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c011310 con 0x556594577f10 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.992+0000 7fe4297fa640 1 -- 172.21.15.82:0/665154204 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe43c00f9a0 con 0x556594577f10 2024-03-27T07:24:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.992+0000 7fe4297fa640 1 -- 172.21.15.82:0/665154204 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c005740 con 0x556594577f10 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe42bfff640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe42c0a38a0 0x7fe42c0a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 -- 172.21.15.82:0/665154204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 msgr2=0x5565945782f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 --2- 172.21.15.82:0/665154204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x5565945782f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe43c011810 tx=0x7fe43c011cd0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 -- 172.21.15.82:0/665154204 shutdown_connections 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 --2- 172.21.15.82:0/665154204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594585d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 --2- 172.21.15.82:0/665154204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x556594583420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 --2- 172.21.15.82:0/665154204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x5565945782f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 -- 172.21.15.82:0/665154204 >> 172.21.15.82:0/665154204 conn(0x556594572980 msgr2=0x556594572d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 -- 172.21.15.82:0/665154204 shutdown_connections 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe442ffd640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe42c0a38a0 0x7fe42c0a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 -- 172.21.15.82:0/665154204 wait complete. 2024-03-27T07:24:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 -- start start 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.993+0000 7fe44c436740 1 Processor -- start 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe44c436740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594577f10 0x556594583420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe44c436740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594578830 0x55659457e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe44c436740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x55659457eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe44c436740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556594586750 con 0x556594578830 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe44c436740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556594497cd0 con 0x556594583960 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe44c436740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5565945868d0 con 0x556594577f10 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe44c436740 10 client.0 _ll_register_callbacks cb 0x556594489ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4427fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594578830 0x55659457e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4427fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594578830 0x55659457e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42634/0 (socket says 172.21.15.82:42634) 2024-03-27T07:24:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4427fc640 1 -- 172.21.15.82:0/1765989543 learned_addr learned my addr 172.21.15.82:0/1765989543 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe442ffd640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe42c0a38a0 0x7fe42c0a5d60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe434009640 tx=0x7fe434005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4437fe640 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x55659457eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe42bfff640 1 -- 172.21.15.82:0/3221936294 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe4380f12e0 con 0x7fe444101380 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4427fc640 1 -- 172.21.15.82:0/1765989543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594577f10 msgr2=0x556594583420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4427fc640 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594577f10 0x556594583420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4427fc640 1 -- 172.21.15.82:0/1765989543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 msgr2=0x55659457eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4427fc640 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x55659457eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4427fc640 1 -- 172.21.15.82:0/1765989543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565942ba7d0 con 0x556594578830 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4437fe640 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x55659457eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe4427fc640 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594578830 0x55659457e790 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe4380bd2b0 tx=0x7fe4380bd1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a1f518e93d523b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.994+0000 7fe426ff5640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:24:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe426ff5640 1 -- 172.21.15.82:0/1765989543 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43804b040 con 0x556594578830 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe426ff5640 1 -- 172.21.15.82:0/1765989543 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe4380d1bd0 con 0x556594578830 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe44c436740 1 -- 172.21.15.82:0/1765989543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe43c00f9a0 con 0x556594578830 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe426ff5640 1 -- 172.21.15.82:0/1765989543 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe4380da020 con 0x556594578830 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe44c436740 10 client.15804 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe44c436740 1 -- 172.21.15.82:0/1765989543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5565941f03f0 con 0x556594578830 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe426ff5640 1 -- 172.21.15.82:0/1765989543 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe43c00f9a0 con 0x556594578830 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe426ff5640 1 -- 172.21.15.82:0/1765989543 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fe4380dd070 con 0x556594578830 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe44c436740 10 client.15804 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe44c436740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe44c436740 20 client.15804 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe44c436740 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55659459a250 0x55659459c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe44c436740 4 client.15804 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:45.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe44c436740 1 -- 172.21.15.82:0/1765989543 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565944e9da0 con 0x55659459a250 2024-03-27T07:24:45.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.995+0000 7fe442ffd640 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55659459a250 0x55659459c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.996+0000 7fe426ff5640 10 client.15804 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:45.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.996+0000 7fe442ffd640 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55659459a250 0x55659459c6a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a13c8a1e162ff940 server_cookie=47432f51faa3f366 in_seq=0 out_seq=0 2024-03-27T07:24:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe426ff5640 1 -- 172.21.15.82:0/1765989543 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5565944e9da0 con 0x55659459a250 2024-03-27T07:24:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe426ff5640 10 client.15804 handle_command_reply: tid=0 2024-03-27T07:24:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 client.15804 shutdown 2024-03-27T07:24:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 -- 172.21.15.82:0/1765989543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594578830 msgr2=0x55659457e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594578830 0x55659457e790 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe4380bd2b0 tx=0x7fe4380bd1b0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 -- 172.21.15.82:0/1765989543 shutdown_connections 2024-03-27T07:24:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55659459a250 0x55659459c6a0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594578830 0x55659457e790 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe426ff5640 0 client.15804 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:45.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x55659457eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 --2- 172.21.15.82:0/1765989543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594577f10 0x556594583420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 -- 172.21.15.82:0/1765989543 >> 172.21.15.82:0/1765989543 conn(0x556594572980 msgr2=0x5565945746d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:45.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 -- 172.21.15.82:0/1765989543 shutdown_connections 2024-03-27T07:24:45.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 1 -- 172.21.15.82:0/1765989543 wait complete. 2024-03-27T07:24:45.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:44.997+0000 7fe44c436740 20 client.15804 trim_cache size 0 max 16384 2024-03-27T07:24:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.014+0000 7fe44c436740 1 Processor -- start 2024-03-27T07:24:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.014+0000 7fe44c436740 1 -- start start 2024-03-27T07:24:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.014+0000 7fe44c436740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594572d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.014+0000 7fe44c436740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x5565945a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe44c436740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594582ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe44c436740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4441adce0 con 0x556594577f10 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe44c436740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe4441ab5b0 con 0x556594583960 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe44c436740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4441a9420 con 0x556594578830 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe442ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594572d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe442ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594572d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42638/0 (socket says 172.21.15.82:42638) 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe442ffd640 1 -- 172.21.15.82:0/2711089911 learned_addr learned my addr 172.21.15.82:0/2711089911 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe4427fc640 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x5565945a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe4437fe640 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594582ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe4437fe640 1 -- 172.21.15.82:0/2711089911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 msgr2=0x5565945a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe4437fe640 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x5565945a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe4437fe640 1 -- 172.21.15.82:0/2711089911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 msgr2=0x556594572d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe4437fe640 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594572d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe4437fe640 1 -- 172.21.15.82:0/2711089911 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565941b00f0 con 0x556594583960 2024-03-27T07:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe4427fc640 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x5565945a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe442ffd640 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594572d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe4437fe640 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594582ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe43c005f10 tx=0x7fe43c009720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2279b7c0c03745ce server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.015+0000 7fe428ff9640 1 -- 172.21.15.82:0/2711089911 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c011190 con 0x556594583960 2024-03-27T07:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe428ff9640 1 -- 172.21.15.82:0/2711089911 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe43c028070 con 0x556594583960 2024-03-27T07:24:45.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe428ff9640 1 -- 172.21.15.82:0/2711089911 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00fea0 con 0x556594583960 2024-03-27T07:24:45.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe44c436740 1 -- 172.21.15.82:0/2711089911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 msgr2=0x556594582ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:45.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe44c436740 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594582ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe43c005f10 tx=0x7fe43c009720 comp rx=0 tx=0).stop 2024-03-27T07:24:45.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe44c436740 1 -- 172.21.15.82:0/2711089911 shutdown_connections 2024-03-27T07:24:45.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe44c436740 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594582ed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe44c436740 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x5565945a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe44c436740 1 --2- 172.21.15.82:0/2711089911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594572d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe44c436740 1 -- 172.21.15.82:0/2711089911 >> 172.21.15.82:0/2711089911 conn(0x556594572980 msgr2=0x556594574660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe44c436740 1 -- 172.21.15.82:0/2711089911 shutdown_connections 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.016+0000 7fe44c436740 1 -- 172.21.15.82:0/2711089911 wait complete. 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe44c436740 1 -- start start 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe44c436740 1 Processor -- start 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe44c436740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594595be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe44c436740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x5565945913c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe44c436740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594591900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe44c436740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe4441a9a70 con 0x556594577f10 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe44c436740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe4441aaee0 con 0x556594583960 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe44c436740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe4441aa140 con 0x556594578830 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe44c436740 10 client.0 _ll_register_callbacks cb 0x7fe438005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe442ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594595be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe442ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594595be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42644/0 (socket says 172.21.15.82:42644) 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe442ffd640 1 -- 172.21.15.82:0/1360635098 learned_addr learned my addr 172.21.15.82:0/1360635098 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe4437fe640 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594591900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.017+0000 7fe4427fc640 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x5565945913c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe4437fe640 1 -- 172.21.15.82:0/1360635098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 msgr2=0x5565945913c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe4437fe640 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x5565945913c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe4437fe640 1 -- 172.21.15.82:0/1360635098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 msgr2=0x556594595be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe4437fe640 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594595be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe4437fe640 1 -- 172.21.15.82:0/1360635098 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556594591ff0 con 0x556594583960 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe442ffd640 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594595be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe4427fc640 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x5565945913c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe4437fe640 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594591900 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe43c025040 tx=0x7fe43c005cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a7cef9a16eec44 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe426ff5640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe426ff5640 1 -- 172.21.15.82:0/1360635098 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c003970 con 0x556594583960 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe44c436740 1 -- 172.21.15.82:0/1360635098 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe43c028070 con 0x556594583960 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe426ff5640 1 -- 172.21.15.82:0/1360635098 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe43c003b10 con 0x556594583960 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe426ff5640 1 -- 172.21.15.82:0/1360635098 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe43c03a050 con 0x556594583960 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe44c436740 10 client.25631 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe44c436740 1 -- 172.21.15.82:0/1360635098 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5565946004b0 con 0x556594583960 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.018+0000 7fe426ff5640 1 -- 172.21.15.82:0/1360635098 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe43c028070 con 0x556594583960 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe426ff5640 1 -- 172.21.15.82:0/1360635098 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fe43c018070 con 0x556594583960 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe44c436740 10 client.25631 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe44c436740 10 client.25631 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe44c436740 20 client.25631 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe44c436740 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556594600a70 0x556594602e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe44c436740 4 client.25631 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe44c436740 1 -- 172.21.15.82:0/1360635098 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565945795c0 con 0x556594600a70 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe442ffd640 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556594600a70 0x556594602e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe442ffd640 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556594600a70 0x556594602e90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cb7d7ae4083b796 server_cookie=d6a433f59211121f in_seq=0 out_seq=0 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe426ff5640 10 client.25631 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe426ff5640 1 -- 172.21.15.82:0/1360635098 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5565945795c0 con 0x556594600a70 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.019+0000 7fe426ff5640 10 client.25631 handle_command_reply: tid=0 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 client.25631 shutdown 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 -- 172.21.15.82:0/1360635098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 msgr2=0x556594591900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594591900 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe43c025040 tx=0x7fe43c005cf0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 -- 172.21.15.82:0/1360635098 shutdown_connections 2024-03-27T07:24:45.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556594583960 0x556594591900 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556594578830 0x5565945913c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556594600a70 0x556594602e90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 --2- 172.21.15.82:0/1360635098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556594577f10 0x556594595be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 -- 172.21.15.82:0/1360635098 >> 172.21.15.82:0/1360635098 conn(0x556594572980 msgr2=0x556594571090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:45.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe426ff5640 0 client.25631 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:45.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 -- 172.21.15.82:0/1360635098 shutdown_connections 2024-03-27T07:24:45.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 1 -- 172.21.15.82:0/1360635098 wait complete. 2024-03-27T07:24:45.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.020+0000 7fe44c436740 20 client.25631 trim_cache size 0 max 16384 2024-03-27T07:24:45.030 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:24:45.030 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-27T07:24:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-03-27T07:24:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "c8262571-ea41-4fa3-8540-e5bc2b114e88": { 2024-03-27T07:24:45.032 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-03-27T07:24:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "c8262571-ea41-4fa3-8540-e5bc2b114e88", 2024-03-27T07:24:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-03-27T07:24:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:24:45.033 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:24:45.033 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:24:45.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 -- 172.21.15.82:0/3221936294 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe42c0a38a0 msgr2=0x7fe42c0a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:45.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe42c0a38a0 0x7fe42c0a5d60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe434009640 tx=0x7fe434005f90 comp rx=0 tx=0).stop 2024-03-27T07:24:45.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 -- 172.21.15.82:0/3221936294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444101380 msgr2=0x7fe444197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:45.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444101380 0x7fe444197840 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe438009230 tx=0x7fe43802cb20 comp rx=0 tx=0).stop 2024-03-27T07:24:45.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 -- 172.21.15.82:0/3221936294 shutdown_connections 2024-03-27T07:24:45.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe42c0a38a0 0x7fe42c0a5d60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe444101380 0x7fe444197840 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe4441069d0 0x7fe44419bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 --2- 172.21.15.82:0/3221936294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4441009c0 0x7fe444197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:45.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 -- 172.21.15.82:0/3221936294 >> 172.21.15.82:0/3221936294 conn(0x7fe444077b50 msgr2=0x7fe444103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:45.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 -- 172.21.15.82:0/3221936294 shutdown_connections 2024-03-27T07:24:45.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:24:45.021+0000 7fe449777640 1 -- 172.21.15.82:0/3221936294 wait complete. 2024-03-27T07:24:45.038 INFO:tasks.cephfs.filesystem:scrub status for tag:c8262571-ea41-4fa3-8540-e5bc2b114e88 - {'path': '/', 'tag': 'c8262571-ea41-4fa3-8540-e5bc2b114e88', 'options': 'recursive,force'} 2024-03-27T07:24:46.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:46 smithi153 ceph-mon[36179]: scrub queued for path: / 2024-03-27T07:24:46.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:46 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:46.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:46 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:24:46.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:46 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:46.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:46 smithi153 ceph-mon[36179]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:24:46.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:46 smithi082 ceph-mon[32178]: scrub queued for path: / 2024-03-27T07:24:46.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:46 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:46.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:46 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:24:46.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:46 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:46.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:46 smithi082 ceph-mon[32178]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:24:46.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:46 smithi149 ceph-mon[36065]: scrub queued for path: / 2024-03-27T07:24:46.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:46 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:46.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:46 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:24:46.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:46 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:24:46.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:46 smithi149 ceph-mon[36065]: pgmap v38: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:24:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.318+0000 7fe9be85c640 1 -- 172.21.15.82:0/1460005662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9b8102510 msgr2=0x7fe9b810e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.318+0000 7fe9be85c640 1 --2- 172.21.15.82:0/1460005662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9b8102510 0x7fe9b810e9d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009cd0 tx=0x7fe9b002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.318+0000 7fe9be85c640 1 -- 172.21.15.82:0/1460005662 shutdown_connections 2024-03-27T07:24:47.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.318+0000 7fe9be85c640 1 --2- 172.21.15.82:0/1460005662 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8101b50 0x7fe9b8101fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.318+0000 7fe9be85c640 1 --2- 172.21.15.82:0/1460005662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9b8102510 0x7fe9b810e9d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.318+0000 7fe9be85c640 1 --2- 172.21.15.82:0/1460005662 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b8107c10 0x7fe9b8107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.318+0000 7fe9be85c640 1 -- 172.21.15.82:0/1460005662 >> 172.21.15.82:0/1460005662 conn(0x7fe9b80fd600 msgr2=0x7fe9b80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.318+0000 7fe9be85c640 1 -- 172.21.15.82:0/1460005662 shutdown_connections 2024-03-27T07:24:47.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.318+0000 7fe9be85c640 1 -- 172.21.15.82:0/1460005662 wait complete. 2024-03-27T07:24:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.319+0000 7fe9be85c640 1 Processor -- start 2024-03-27T07:24:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.319+0000 7fe9be85c640 1 -- start start 2024-03-27T07:24:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9be85c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8101b50 0x7fe9b81980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9be85c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9b8102510 0x7fe9b8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9be85c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b8107c10 0x7fe9b819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9be85c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b8111f10 con 0x7fe9b8101b50 2024-03-27T07:24:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9be85c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b8111d90 con 0x7fe9b8107c10 2024-03-27T07:24:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8101b50 0x7fe9b81980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9bcdf9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b8107c10 0x7fe9b819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9b7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8101b50 0x7fe9b81980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42672/0 (socket says 172.21.15.82:42672) 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9b7fff640 1 -- 172.21.15.82:0/1759247802 learned_addr learned my addr 172.21.15.82:0/1759247802 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9b77fe640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9b8102510 0x7fe9b8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9be85c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b8112090 con 0x7fe9b8102510 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9b7fff640 1 -- 172.21.15.82:0/1759247802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9b8102510 msgr2=0x7fe9b8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9b7fff640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9b8102510 0x7fe9b8198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9b7fff640 1 -- 172.21.15.82:0/1759247802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b8107c10 msgr2=0x7fe9b819c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9b7fff640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b8107c10 0x7fe9b819c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9b7fff640 1 -- 172.21.15.82:0/1759247802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b819d0e0 con 0x7fe9b8101b50 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b8107c10 0x7fe9b819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.320+0000 7fe9b77fe640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9b8102510 0x7fe9b8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.321+0000 7fe9b7fff640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8101b50 0x7fe9b81980f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800e9f0 tx=0x7fe9a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.321+0000 7fe9b57fa640 1 -- 172.21.15.82:0/1759247802 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a800cd80 con 0x7fe9b8101b50 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.321+0000 7fe9b57fa640 1 -- 172.21.15.82:0/1759247802 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9a8010910 con 0x7fe9b8101b50 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.321+0000 7fe9b57fa640 1 -- 172.21.15.82:0/1759247802 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9a8018990 con 0x7fe9b8101b50 2024-03-27T07:24:47.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.321+0000 7fe9be85c640 1 -- 172.21.15.82:0/1759247802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b819d3d0 con 0x7fe9b8101b50 2024-03-27T07:24:47.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.321+0000 7fe9be85c640 1 -- 172.21.15.82:0/1759247802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b81a4c60 con 0x7fe9b8101b50 2024-03-27T07:24:47.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.324+0000 7fe9c1449740 1 Processor -- start 2024-03-27T07:24:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.324+0000 7fe9c1449740 1 -- start start 2024-03-27T07:24:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913f93f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f944f0 0x559913f94970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913fa5e80 0x559913fa8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9c1449740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559913f5acd0 con 0x559913fa5e80 2024-03-27T07:24:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9c1449740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x559913e9f950 con 0x559913f93b40 2024-03-27T07:24:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9c1449740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559913ef7e50 con 0x559913f944f0 2024-03-27T07:24:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9bcdf9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913f93f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9bcdf9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913f93f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:36016/0 (socket says 172.21.15.82:36016) 2024-03-27T07:24:47.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/3049399847 learned_addr learned my addr 172.21.15.82:0/3049399847 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9b77fe640 1 --2- 172.21.15.82:0/3049399847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913fa5e80 0x559913fa8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/3049399847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f944f0 msgr2=0x559913f94970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3049399847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f944f0 0x559913f94970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/3049399847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913fa5e80 msgr2=0x559913fa8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3049399847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913fa5e80 0x559913fa8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/3049399847 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559913c0c210 con 0x559913f93b40 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9b77fe640 1 --2- 172.21.15.82:0/3049399847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913fa5e80 0x559913fa8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.325+0000 7fe9b57fa640 1 -- 172.21.15.82:0/1759247802 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7fe9a8010ac0 con 0x7fe9b8101b50 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.326+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3049399847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913f93f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009cd0 tx=0x7fe9b00095d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8420e6040738dc3b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.326+0000 7fe99e7fc640 1 -- 172.21.15.82:0/3049399847 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0043020 con 0x559913f93b40 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.326+0000 7fe99e7fc640 1 -- 172.21.15.82:0/3049399847 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b002cca0 con 0x559913f93b40 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.326+0000 7fe99e7fc640 1 -- 172.21.15.82:0/3049399847 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0039040 con 0x559913f93b40 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.326+0000 7fe9b57fa640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9a00a39c0 0x7fe9a00a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9b7fff640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9a00a39c0 0x7fe9a00a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9c1449740 1 -- 172.21.15.82:0/3049399847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 msgr2=0x559913f93f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3049399847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913f93f20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009cd0 tx=0x7fe9b00095d0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9b57fa640 1 -- 172.21.15.82:0/1759247802 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe9a80d0730 con 0x7fe9b8101b50 2024-03-27T07:24:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9c1449740 1 -- 172.21.15.82:0/3049399847 shutdown_connections 2024-03-27T07:24:47.332 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3049399847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913fa5e80 0x559913fa8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3049399847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f944f0 0x559913f94970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3049399847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913f93f20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9c1449740 1 -- 172.21.15.82:0/3049399847 >> 172.21.15.82:0/3049399847 conn(0x559913f8ea10 msgr2=0x559913f8edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9b7fff640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9a00a39c0 0x7fe9a00a5e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80cddb0 tx=0x7fe9a80982f0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9c1449740 1 -- 172.21.15.82:0/3049399847 shutdown_connections 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.327+0000 7fe9c1449740 1 -- 172.21.15.82:0/3049399847 wait complete. 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.328+0000 7fe9c1449740 1 -- start start 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.328+0000 7fe9c1449740 1 Processor -- start 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.328+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f93b40 0x559913f9f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.328+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 0x559913f9fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.328+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913fa5e80 0x559913fa54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.328+0000 7fe9b77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 0x559913f9fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.333 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9bcdf9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f93b40 0x559913f9f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9bcdf9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f93b40 0x559913f9f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47330/0 (socket says 172.21.15.82:47330) 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9b77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 0x559913f9fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42700/0 (socket says 172.21.15.82:42700) 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/3349731319 learned_addr learned my addr 172.21.15.82:0/3349731319 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559913ef3e00 con 0x559913f944f0 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x559913ea0520 con 0x559913fa5e80 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559913eb38e0 con 0x559913f93b40 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913fa5e80 0x559913fa54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/3349731319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913fa5e80 msgr2=0x559913fa54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913fa5e80 0x559913fa54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/3349731319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 msgr2=0x559913f9fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 0x559913f9fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/3349731319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559913cd8620 con 0x559913f93b40 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f93b40 0x559913f9f7c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009ca0 tx=0x7fe9b0003b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0b15e8896a89383 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9977fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9c1449740 10 client.0 _ll_register_callbacks cb 0x559913eeea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b002cca0 con 0x559913f93b40 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9977fe640 1 -- 172.21.15.82:0/3349731319 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0039070 con 0x559913f93b40 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.329+0000 7fe9977fe640 1 -- 172.21.15.82:0/3349731319 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe9b0034c00 con 0x559913f93b40 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9977fe640 1 -- 172.21.15.82:0/3349731319 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe9b0043050 con 0x559913f93b40 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9c1449740 10 client.25648 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=22}) -- 0x559913fbce20 con 0x559913f93b40 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9977fe640 1 -- 172.21.15.82:0/3349731319 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fe9b003f480 con 0x559913f93b40 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9c1449740 10 client.25648 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9c1449740 10 client.25648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:47.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9c1449740 20 client.25648 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:47.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559913fbe170 0x559913fc0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9c1449740 4 client.25648 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:24:47.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe9b002cca0 con 0x559913fbe170 2024-03-27T07:24:47.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.330+0000 7fe9b77fe640 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559913fbe170 0x559913fc0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.331+0000 7fe9977fe640 10 client.25648 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:47.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.331+0000 7fe9b77fe640 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559913fbe170 0x559913fc0560 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79c7e7a9ff56ba4d server_cookie=4fd790e4e37669b1 in_seq=0 out_seq=0 2024-03-27T07:24:47.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.331+0000 7fe9977fe640 1 -- 172.21.15.82:0/3349731319 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7fe9b002cca0 con 0x559913fbe170 2024-03-27T07:24:47.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.331+0000 7fe9977fe640 10 client.25648 handle_command_reply: tid=0 2024-03-27T07:24:47.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.331+0000 7fe9c1449740 1 client.25648 shutdown 2024-03-27T07:24:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f93b40 msgr2=0x559913f9f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f93b40 0x559913f9f7c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009ca0 tx=0x7fe9b0003b20 comp rx=0 tx=0).stop 2024-03-27T07:24:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 shutdown_connections 2024-03-27T07:24:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559913fbe170 0x559913fc0560 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 0x559913f9fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9977fe640 0 client.25648 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913fa5e80 0x559913fa54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3349731319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f93b40 0x559913f9f7c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 >> 172.21.15.82:0/3349731319 conn(0x559913f8ea10 msgr2=0x559913f90760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 shutdown_connections 2024-03-27T07:24:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 1 -- 172.21.15.82:0/3349731319 wait complete. 2024-03-27T07:24:47.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.332+0000 7fe9c1449740 20 client.25648 trim_cache size 0 max 16384 2024-03-27T07:24:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.360+0000 7fe9c1449740 1 Processor -- start 2024-03-27T07:24:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.360+0000 7fe9c1449740 1 -- start start 2024-03-27T07:24:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f8ea10 0x559913f98c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f93b40 0x559913f8edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f944f0 0x559913fc5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9b77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f93b40 0x559913f8edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9bcdf9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f8ea10 0x559913f98c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9b77fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f93b40 0x559913f8edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42702/0 (socket says 172.21.15.82:42702) 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9b77fe640 1 -- 172.21.15.82:0/8021731 learned_addr learned my addr 172.21.15.82:0/8021731 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9bcdf9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f8ea10 0x559913f98c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:36032/0 (socket says 172.21.15.82:36032) 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9c1449740 1 -- 172.21.15.82:0/8021731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b81ada80 con 0x559913f93b40 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9c1449740 1 -- 172.21.15.82:0/8021731 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b81ab350 con 0x559913f8ea10 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.361+0000 7fe9c1449740 1 -- 172.21.15.82:0/8021731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b81a91c0 con 0x559913f944f0 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.362+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/8021731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f944f0 msgr2=0x559913fc5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.362+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/8021731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f944f0 0x559913fc5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.362+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/8021731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f93b40 msgr2=0x559913f8edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.362+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/8021731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f93b40 0x559913f8edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.362+0000 7fe9bcdf9640 1 -- 172.21.15.82:0/8021731 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559913fa85e0 con 0x559913f8ea10 2024-03-27T07:24:47.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.362+0000 7fe9b77fe640 1 --2- 172.21.15.82:0/8021731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f93b40 0x559913f8edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:24:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.362+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/8021731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f8ea10 0x559913f98c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0000f80 tx=0x7fe9b002c0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b419573a86f8ec56 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.362+0000 7fe99dffb640 1 -- 172.21.15.82:0/8021731 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b005b020 con 0x559913f8ea10 2024-03-27T07:24:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.362+0000 7fe99dffb640 1 -- 172.21.15.82:0/8021731 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9b0051070 con 0x559913f8ea10 2024-03-27T07:24:47.366 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.362+0000 7fe99dffb640 1 -- 172.21.15.82:0/8021731 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b00566b0 con 0x559913f8ea10 2024-03-27T07:24:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.363+0000 7fe9c1449740 1 -- 172.21.15.82:0/8021731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f8ea10 msgr2=0x559913f98c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.363+0000 7fe9c1449740 1 --2- 172.21.15.82:0/8021731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f8ea10 0x559913f98c30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0000f80 tx=0x7fe9b002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.369 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.363+0000 7fe9c1449740 1 -- 172.21.15.82:0/8021731 shutdown_connections 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.363+0000 7fe9c1449740 1 --2- 172.21.15.82:0/8021731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f93b40 0x559913f8edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.363+0000 7fe9c1449740 1 --2- 172.21.15.82:0/8021731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f944f0 0x559913fc5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.363+0000 7fe9c1449740 1 --2- 172.21.15.82:0/8021731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f8ea10 0x559913f98c30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.363+0000 7fe9c1449740 1 -- 172.21.15.82:0/8021731 >> 172.21.15.82:0/8021731 conn(0x559913fc08d0 msgr2=0x559913f8da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.363+0000 7fe9c1449740 1 -- 172.21.15.82:0/8021731 shutdown_connections 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.363+0000 7fe9c1449740 1 -- 172.21.15.82:0/8021731 wait complete. 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.363+0000 7fe9c1449740 1 -- start start 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9c1449740 1 Processor -- start 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f8ea10 0x559913fd0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913fd1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9c1449740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 0x559913fcf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9c1449740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b81a9810 con 0x559913f944f0 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9c1449740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b81aac80 con 0x559913f93b40 2024-03-27T07:24:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9c1449740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b81a9ee0 con 0x559913f8ea10 2024-03-27T07:24:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9c1449740 10 client.0 _ll_register_callbacks cb 0x7fe9ac009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:24:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9b77fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913fd1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9b77fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913fd1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:36046/0 (socket says 172.21.15.82:36046) 2024-03-27T07:24:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9b77fe640 1 -- 172.21.15.82:0/3943572383 learned_addr learned my addr 172.21.15.82:0/3943572383 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:24:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 0x559913fcf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.364+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f8ea10 0x559913fd0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9b77fe640 1 -- 172.21.15.82:0/3943572383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f8ea10 msgr2=0x559913fd0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9b77fe640 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f8ea10 0x559913fd0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9b77fe640 1 -- 172.21.15.82:0/3943572383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 msgr2=0x559913fcf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9b77fe640 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 0x559913fcf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9b77fe640 1 -- 172.21.15.82:0/3943572383 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559913fcf9a0 con 0x559913f93b40 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f8ea10 0x559913fd0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9b77fe640 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913fd1260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x559913f8fe30 tx=0x7fe9ac01f770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81517bc293e49dea server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9977fe640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9977fe640 1 -- 172.21.15.82:0/3943572383 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac004250 con 0x559913f93b40 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9977fe640 1 -- 172.21.15.82:0/3943572383 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe9ac0043f0 con 0x559913f93b40 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9c1449740 1 -- 172.21.15.82:0/3943572383 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b0051070 con 0x559913f93b40 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9977fe640 1 -- 172.21.15.82:0/3943572383 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fe9ac02c020 con 0x559913f93b40 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9c1449740 10 client.25649 fetch_fsmap learned FSMap version 22 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.365+0000 7fe9c1449740 1 -- 172.21.15.82:0/3943572383 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x559914024870 con 0x559913f93b40 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.366+0000 7fe9977fe640 1 -- 172.21.15.82:0/3943572383 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9ac023030 con 0x559913f93b40 2024-03-27T07:24:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.366+0000 7fe9977fe640 1 -- 172.21.15.82:0/3943572383 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fe9ac0314c0 con 0x559913f93b40 2024-03-27T07:24:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.366+0000 7fe9c1449740 10 client.25649 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:24:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.366+0000 7fe9c1449740 10 client.25649 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:24:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.366+0000 7fe9c1449740 20 client.25649 populate_metadata read hostname 'smithi082' 2024-03-27T07:24:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.366+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559913fa5e80 0x559914027000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:24:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.366+0000 7fe9c1449740 4 client.25649 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:24:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.366+0000 7fe9c1449740 1 -- 172.21.15.82:0/3943572383 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fe9b0051070 con 0x559913fa5e80 2024-03-27T07:24:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.366+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559913fa5e80 0x559914027000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:24:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.366+0000 7fe9977fe640 10 client.25649 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.367+0000 7fe9bcdf9640 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559913fa5e80 0x559914027000 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6adc8d6bc020996e server_cookie=b48a4679720b5200 in_seq=0 out_seq=0 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.369+0000 7fe9977fe640 1 -- 172.21.15.82:0/3943572383 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fe9b0051070 con 0x559913fa5e80 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9977fe640 10 client.25649 handle_command_reply: tid=0 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 client.25649 shutdown 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 -- 172.21.15.82:0/3943572383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 msgr2=0x559913fd1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913fd1260 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x559913f8fe30 tx=0x7fe9ac01f770 comp rx=0 tx=0).stop 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 -- 172.21.15.82:0/3943572383 shutdown_connections 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559913fa5e80 0x559914027000 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559913f944f0 0x559913fcf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559913f93b40 0x559913fd1260 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 --2- 172.21.15.82:0/3943572383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559913f8ea10 0x559913fd0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 -- 172.21.15.82:0/3943572383 >> 172.21.15.82:0/3943572383 conn(0x559913fc08d0 msgr2=0x559913f8da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9977fe640 0 client.25649 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:24:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 -- 172.21.15.82:0/3943572383 shutdown_connections 2024-03-27T07:24:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 1 -- 172.21.15.82:0/3943572383 wait complete. 2024-03-27T07:24:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.370+0000 7fe9c1449740 20 client.25649 trim_cache size 0 max 16384 2024-03-27T07:24:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:24:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:24:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:24:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:24:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 -- 172.21.15.82:0/1759247802 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9a00a39c0 msgr2=0x7fe9a00a5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9a00a39c0 0x7fe9a00a5e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80cddb0 tx=0x7fe9a80982f0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 -- 172.21.15.82:0/1759247802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8101b50 msgr2=0x7fe9b81980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:24:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8101b50 0x7fe9b81980f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe9a800e9f0 tx=0x7fe9a800eeb0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 -- 172.21.15.82:0/1759247802 shutdown_connections 2024-03-27T07:24:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9a00a39c0 0x7fe9a00a5e80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9b8107c10 0x7fe9b819c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9b8102510 0x7fe9b8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 --2- 172.21.15.82:0/1759247802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9b8101b50 0x7fe9b81980f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:24:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 -- 172.21.15.82:0/1759247802 >> 172.21.15.82:0/1759247802 conn(0x7fe9b80fd600 msgr2=0x7fe9b8108930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:24:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 -- 172.21.15.82:0/1759247802 shutdown_connections 2024-03-27T07:24:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:24:47.371+0000 7fe9be85c640 1 -- 172.21.15.82:0/1759247802 wait complete. 2024-03-27T07:24:48.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:48 smithi153 ceph-mon[36179]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T07:24:48.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:48 smithi082 ceph-mon[32178]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T07:24:48.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:48 smithi149 ceph-mon[36065]: pgmap v39: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T07:24:49.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:49 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:24:49.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:49 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:24:49.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:49 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:24:50.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:50 smithi082 ceph-mon[32178]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-27T07:24:50.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:50 smithi149 ceph-mon[36065]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-27T07:24:50.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:50 smithi153 ceph-mon[36179]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-03-27T07:24:52.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:52 smithi082 ceph-mon[32178]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T07:24:52.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:52 smithi149 ceph-mon[36065]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T07:24:52.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:52 smithi153 ceph-mon[36179]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T07:24:54.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:54 smithi082 ceph-mon[32178]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T07:24:54.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:54 smithi149 ceph-mon[36065]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T07:24:54.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:54 smithi153 ceph-mon[36179]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T07:24:56.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:56 smithi082 ceph-mon[32178]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T07:24:56.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:56 smithi149 ceph-mon[36065]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T07:24:56.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:56 smithi153 ceph-mon[36179]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T07:24:58.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:24:58 smithi082 ceph-mon[32178]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T07:24:58.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:24:58 smithi149 ceph-mon[36065]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T07:24:58.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:24:58 smithi153 ceph-mon[36179]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T07:25:00.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:00 smithi082 ceph-mon[32178]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:25:00.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:00 smithi149 ceph-mon[36065]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:25:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.508+0000 7f063e716640 1 -- 172.21.15.82:0/70229199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0638106a50 msgr2=0x7f0638106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.508+0000 7f063e716640 1 --2- 172.21.15.82:0/70229199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0638106a50 0x7f0638106e30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0628009900 tx=0x7f062802bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.509+0000 7f063e716640 1 -- 172.21.15.82:0/70229199 shutdown_connections 2024-03-27T07:25:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.509+0000 7f063e716640 1 --2- 172.21.15.82:0/70229199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0638101400 0x7f063810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.509+0000 7f063e716640 1 --2- 172.21.15.82:0/70229199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0638100a40 0x7f0638100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.509+0000 7f063e716640 1 --2- 172.21.15.82:0/70229199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0638106a50 0x7f0638106e30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.509+0000 7f063e716640 1 -- 172.21.15.82:0/70229199 >> 172.21.15.82:0/70229199 conn(0x7f0638077c60 msgr2=0x7f0638078070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.509+0000 7f063e716640 1 -- 172.21.15.82:0/70229199 shutdown_connections 2024-03-27T07:25:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.509+0000 7f063e716640 1 -- 172.21.15.82:0/70229199 wait complete. 2024-03-27T07:25:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.509+0000 7f063e716640 1 Processor -- start 2024-03-27T07:25:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f063e716640 1 -- start start 2024-03-27T07:25:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f063e716640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0638100a40 0x7f0638198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f063e716640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0638101400 0x7f0638198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f063e716640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0638106a50 0x7f063819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f0637fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0638100a40 0x7f0638198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f0637fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0638100a40 0x7f0638198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58326/0 (socket says 172.21.15.82:58326) 2024-03-27T07:25:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f063e716640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0638111f20 con 0x7f0638100a40 2024-03-27T07:25:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f0637fff640 1 -- 172.21.15.82:0/1583653682 learned_addr learned my addr 172.21.15.82:0/1583653682 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f06377fe640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0638101400 0x7f0638198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f063e716640 1 -- 172.21.15.82:0/1583653682 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0638111da0 con 0x7f0638106a50 2024-03-27T07:25:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f063e716640 1 -- 172.21.15.82:0/1583653682 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f06381120a0 con 0x7f0638101400 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.510+0000 7f063ccb3640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0638106a50 0x7f063819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f0637fff640 1 -- 172.21.15.82:0/1583653682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0638101400 msgr2=0x7f0638198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f0637fff640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0638101400 0x7f0638198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f0637fff640 1 -- 172.21.15.82:0/1583653682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0638106a50 msgr2=0x7f063819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f0637fff640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0638106a50 0x7f063819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f0637fff640 1 -- 172.21.15.82:0/1583653682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063819d2e0 con 0x7f0638100a40 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f06377fe640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0638101400 0x7f0638198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f063ccb3640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0638106a50 0x7f063819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f0637fff640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0638100a40 0x7f0638198340 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0628005940 tx=0x7f0628004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f06357fa640 1 -- 172.21.15.82:0/1583653682 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628041070 con 0x7f0638100a40 2024-03-27T07:25:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f06357fa640 1 -- 172.21.15.82:0/1583653682 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06280054e0 con 0x7f0638100a40 2024-03-27T07:25:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f06357fa640 1 -- 172.21.15.82:0/1583653682 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628003d00 con 0x7f0638100a40 2024-03-27T07:25:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f063e716640 1 -- 172.21.15.82:0/1583653682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063819d570 con 0x7f0638100a40 2024-03-27T07:25:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.511+0000 7f063e716640 1 -- 172.21.15.82:0/1583653682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06381a4e60 con 0x7f0638100a40 2024-03-27T07:25:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.514+0000 7f06413d0740 1 Processor -- start 2024-03-27T07:25:00.521 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.514+0000 7f06413d0740 1 -- start start 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f06413d0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f06413d0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3ba6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f06413d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 0x55dc7c3bcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f06413d0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dc7c373cd0 con 0x55dc7c3ad3d0 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f06413d0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55dc7c2b8950 con 0x55dc7c3acab0 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f06413d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55dc7c310e50 con 0x55dc7c3babf0 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f06357fa640 1 -- 172.21.15.82:0/1583653682 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) ==== 138603+0+0 (secure 0 0 0) 0x7f0628044070 con 0x7f0638100a40 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f0637fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3ba6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f063ccb3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f063ccb3640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ace90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:47940/0 (socket says 172.21.15.82:47940) 2024-03-27T07:25:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f06377fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 0x55dc7c3bcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f063ccb3640 1 -- 172.21.15.82:0/734781103 learned_addr learned my addr 172.21.15.82:0/734781103 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f0637fff640 1 -- 172.21.15.82:0/734781103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 msgr2=0x55dc7c3bcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f0637fff640 1 --2- 172.21.15.82:0/734781103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 0x55dc7c3bcfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f0637fff640 1 -- 172.21.15.82:0/734781103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3acab0 msgr2=0x55dc7c3ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f0637fff640 1 --2- 172.21.15.82:0/734781103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f0637fff640 1 -- 172.21.15.82:0/734781103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7c025210 con 0x55dc7c3ad3d0 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f063ccb3640 1 --2- 172.21.15.82:0/734781103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.515+0000 7f0637fff640 1 --2- 172.21.15.82:0/734781103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3ba6b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f06280ef3f0 tx=0x7f06280f5eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a9685b115f78b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.516+0000 7f061e7fc640 1 -- 172.21.15.82:0/734781103 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06280fabc0 con 0x55dc7c3ad3d0 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.516+0000 7f06357fa640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f06200a3a40 0x7f06200a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.516+0000 7f061e7fc640 1 -- 172.21.15.82:0/734781103 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06280ff070 con 0x55dc7c3ad3d0 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.516+0000 7f061e7fc640 1 -- 172.21.15.82:0/734781103 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06280f2560 con 0x55dc7c3ad3d0 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.516+0000 7f063ccb3640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f06200a3a40 0x7f06200a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.516+0000 7f06357fa640 1 -- 172.21.15.82:0/1583653682 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f06280f1d20 con 0x7f0638100a40 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f06413d0740 1 -- 172.21.15.82:0/734781103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3ad3d0 msgr2=0x55dc7c3ba6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f063ccb3640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f06200a3a40 0x7f06200a5f00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0630012bb0 tx=0x7f0630009500 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f06413d0740 1 --2- 172.21.15.82:0/734781103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3ba6b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f06280ef3f0 tx=0x7f06280f5eb0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f06413d0740 1 -- 172.21.15.82:0/734781103 shutdown_connections 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f06413d0740 1 --2- 172.21.15.82:0/734781103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3ba6b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f06413d0740 1 --2- 172.21.15.82:0/734781103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 0x55dc7c3bcfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f06413d0740 1 --2- 172.21.15.82:0/734781103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f06413d0740 1 -- 172.21.15.82:0/734781103 >> 172.21.15.82:0/734781103 conn(0x55dc7c3a7a10 msgr2=0x55dc7c3a7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:00.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f06413d0740 1 -- 172.21.15.82:0/734781103 shutdown_connections 2024-03-27T07:25:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f06413d0740 1 -- 172.21.15.82:0/734781103 wait complete. 2024-03-27T07:25:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.517+0000 7f06413d0740 1 -- start start 2024-03-27T07:25:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f06413d0740 1 Processor -- start 2024-03-27T07:25:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f06413d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 0x55dc7c3b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f06413d0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f06413d0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f06413d0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dc7c30ce00 con 0x55dc7c3babf0 2024-03-27T07:25:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f0637fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 0x55dc7c3b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f06413d0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55dc7c2b9520 con 0x55dc7c3ad3d0 2024-03-27T07:25:00.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f0637fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 0x55dc7c3b7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:56516/0 (socket says 172.21.15.82:56516) 2024-03-27T07:25:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f06413d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55dc7c2cc8e0 con 0x55dc7c3acab0 2024-03-27T07:25:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f0637fff640 1 -- 172.21.15.82:0/1211022406 learned_addr learned my addr 172.21.15.82:0/1211022406 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f063ccb3640 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f06413d0740 10 client.0 _ll_register_callbacks cb 0x55dc7c307a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f06377fe640 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f0637fff640 1 -- 172.21.15.82:0/1211022406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 msgr2=0x55dc7c3b81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f0637fff640 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3b81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f0637fff640 1 -- 172.21.15.82:0/1211022406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 msgr2=0x55dc7c3b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f0637fff640 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.518+0000 7f0637fff640 1 -- 172.21.15.82:0/1211022406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc7c0f1620 con 0x55dc7c3acab0 2024-03-27T07:25:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.519+0000 7f06377fe640 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3b81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:25:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.519+0000 7f063ccb3640 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.519+0000 7f0637fff640 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 0x55dc7c3b7c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06280ba270 tx=0x7f0628103e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47beda6b66f2be1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.519+0000 7f06177fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:25:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.519+0000 7f06177fe640 1 -- 172.21.15.82:0/1211022406 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062804b070 con 0x55dc7c3acab0 2024-03-27T07:25:00.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.519+0000 7f06177fe640 1 -- 172.21.15.82:0/1211022406 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f06280bc110 con 0x55dc7c3acab0 2024-03-27T07:25:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.519+0000 7f06413d0740 1 -- 172.21.15.82:0/1211022406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06280ff070 con 0x55dc7c3acab0 2024-03-27T07:25:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.519+0000 7f06177fe640 1 -- 172.21.15.82:0/1211022406 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f06280ba0b0 con 0x55dc7c3acab0 2024-03-27T07:25:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.519+0000 7f06413d0740 10 client.25663 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.519+0000 7f06413d0740 1 -- 172.21.15.82:0/1211022406 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55dc7c3c94f0 con 0x55dc7c3acab0 2024-03-27T07:25:00.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.520+0000 7f06177fe640 1 -- 172.21.15.82:0/1211022406 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06280ff070 con 0x55dc7c3acab0 2024-03-27T07:25:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.520+0000 7f06177fe640 1 -- 172.21.15.82:0/1211022406 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f06280be070 con 0x55dc7c3acab0 2024-03-27T07:25:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.520+0000 7f06413d0740 10 client.25663 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.520+0000 7f06413d0740 10 client.25663 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:00.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.520+0000 7f06413d0740 20 client.25663 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.520+0000 7f06413d0740 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55dc7c3ca9f0 0x55dc7c3ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.520+0000 7f06413d0740 4 client.25663 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.520+0000 7f06413d0740 1 -- 172.21.15.82:0/1211022406 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc7c31e390 con 0x55dc7c3ca9f0 2024-03-27T07:25:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.520+0000 7f06377fe640 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55dc7c3ca9f0 0x55dc7c3ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06177fe640 10 client.25663 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06377fe640 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55dc7c3ca9f0 0x55dc7c3ccde0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3751aafdc81c2377 server_cookie=ecb358b632408b8a in_seq=0 out_seq=0 2024-03-27T07:25:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06177fe640 1 -- 172.21.15.82:0/1211022406 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55dc7c31e390 con 0x55dc7c3ca9f0 2024-03-27T07:25:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06177fe640 10 client.25663 handle_command_reply: tid=0 2024-03-27T07:25:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06413d0740 1 client.25663 shutdown 2024-03-27T07:25:00.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06413d0740 1 -- 172.21.15.82:0/1211022406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 msgr2=0x55dc7c3b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06413d0740 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 0x55dc7c3b7c80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f06280ba270 tx=0x7f0628103e10 comp rx=0 tx=0).stop 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06413d0740 1 -- 172.21.15.82:0/1211022406 shutdown_connections 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06413d0740 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55dc7c3ca9f0 0x55dc7c3ccde0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06413d0740 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06413d0740 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3b81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06413d0740 1 --2- 172.21.15.82:0/1211022406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 0x55dc7c3b7c80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06413d0740 1 -- 172.21.15.82:0/1211022406 >> 172.21.15.82:0/1211022406 conn(0x55dc7c3a7a10 msgr2=0x55dc7c3a9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.521+0000 7f06177fe640 0 client.25663 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.522+0000 7f06413d0740 1 -- 172.21.15.82:0/1211022406 shutdown_connections 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.522+0000 7f06413d0740 1 -- 172.21.15.82:0/1211022406 wait complete. 2024-03-27T07:25:00.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.522+0000 7f06413d0740 20 client.25663 trim_cache size 0 max 16384 2024-03-27T07:25:00.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:00 smithi153 ceph-mon[36179]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T07:25:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.536+0000 7f06413d0740 1 Processor -- start 2024-03-27T07:25:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.536+0000 7f06413d0740 1 -- start start 2024-03-27T07:25:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.536+0000 7f06413d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ba3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.536+0000 7f06413d0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.536+0000 7f06413d0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f063ccb3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f063ccb3640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58352/0 (socket says 172.21.15.82:58352) 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f063ccb3640 1 -- 172.21.15.82:0/2156542541 learned_addr learned my addr 172.21.15.82:0/2156542541 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f06413d0740 1 -- 172.21.15.82:0/2156542541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06381addc0 con 0x55dc7c3babf0 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f06413d0740 1 -- 172.21.15.82:0/2156542541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f06381ab690 con 0x55dc7c3ad3d0 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f06413d0740 1 -- 172.21.15.82:0/2156542541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f06381a94e0 con 0x55dc7c3acab0 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f0637fff640 1 --2- 172.21.15.82:0/2156542541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ba3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f06377fe640 1 --2- 172.21.15.82:0/2156542541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f063ccb3640 1 -- 172.21.15.82:0/2156542541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 msgr2=0x55dc7c3ba3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f063ccb3640 1 --2- 172.21.15.82:0/2156542541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ba3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f063ccb3640 1 -- 172.21.15.82:0/2156542541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 msgr2=0x55dc7c3c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:00.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f063ccb3640 1 --2- 172.21.15.82:0/2156542541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f063ccb3640 1 -- 172.21.15.82:0/2156542541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc7c3ac3d0 con 0x55dc7c3babf0 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f063ccb3640 1 --2- 172.21.15.82:0/2156542541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8520 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f06300123f0 tx=0x7f063001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87d2ee8c3350e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f061dffb640 1 -- 172.21.15.82:0/2156542541 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630011e50 con 0x55dc7c3babf0 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f061dffb640 1 -- 172.21.15.82:0/2156542541 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0630012420 con 0x55dc7c3babf0 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.537+0000 7f061dffb640 1 -- 172.21.15.82:0/2156542541 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063001d850 con 0x55dc7c3babf0 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.538+0000 7f06413d0740 1 -- 172.21.15.82:0/2156542541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 msgr2=0x55dc7c3b8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.538+0000 7f06413d0740 1 --2- 172.21.15.82:0/2156542541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8520 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f06300123f0 tx=0x7f063001a000 comp rx=0 tx=0).stop 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.538+0000 7f06413d0740 1 -- 172.21.15.82:0/2156542541 shutdown_connections 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.538+0000 7f06413d0740 1 --2- 172.21.15.82:0/2156542541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3babf0 0x55dc7c3b8520 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.538+0000 7f06413d0740 1 --2- 172.21.15.82:0/2156542541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.546 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.538+0000 7f06413d0740 1 --2- 172.21.15.82:0/2156542541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ba3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.538+0000 7f06413d0740 1 -- 172.21.15.82:0/2156542541 >> 172.21.15.82:0/2156542541 conn(0x55dc7c3a7a10 msgr2=0x55dc7c3b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.538+0000 7f06413d0740 1 -- 172.21.15.82:0/2156542541 shutdown_connections 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.538+0000 7f06413d0740 1 -- 172.21.15.82:0/2156542541 wait complete. 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f06413d0740 1 -- start start 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f06413d0740 1 Processor -- start 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f06413d0740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ae800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f06413d0740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3aed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f06413d0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 0x55dc7c3af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f06413d0740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06381a9b50 con 0x55dc7c3acab0 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f06413d0740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f06381aafc0 con 0x55dc7c3ad3d0 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f06413d0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f06381aa220 con 0x55dc7c3babf0 2024-03-27T07:25:00.547 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f06413d0740 10 client.0 _ll_register_callbacks cb 0x7f0630009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f0637fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f0637fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ae800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58364/0 (socket says 172.21.15.82:58364) 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f0637fff640 1 -- 172.21.15.82:0/2117351705 learned_addr learned my addr 172.21.15.82:0/2117351705 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f063ccb3640 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 0x55dc7c3af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.539+0000 7f06377fe640 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f0637fff640 1 -- 172.21.15.82:0/2117351705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 msgr2=0x55dc7c3af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f0637fff640 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 0x55dc7c3af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f0637fff640 1 -- 172.21.15.82:0/2117351705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 msgr2=0x55dc7c3aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f0637fff640 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f0637fff640 1 -- 172.21.15.82:0/2117351705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc7c3bcfe0 con 0x55dc7c3acab0 2024-03-27T07:25:00.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f063ccb3640 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 0x55dc7c3af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f06377fe640 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f0637fff640 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ae800 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f06280ba7e0 tx=0x7f06280f5cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bef46cb84776e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f06177fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f06177fe640 1 -- 172.21.15.82:0/2117351705 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062804b040 con 0x55dc7c3acab0 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f06177fe640 1 -- 172.21.15.82:0/2117351705 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f06280f55e0 con 0x55dc7c3acab0 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f06413d0740 1 -- 172.21.15.82:0/2117351705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0630012420 con 0x55dc7c3acab0 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f06177fe640 1 -- 172.21.15.82:0/2117351705 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f06280bd770 con 0x55dc7c3acab0 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f06413d0740 10 client.15846 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.540+0000 7f06413d0740 1 -- 172.21.15.82:0/2117351705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55dc7c3bcfe0 con 0x55dc7c3acab0 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.541+0000 7f06177fe640 1 -- 172.21.15.82:0/2117351705 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0630012420 con 0x55dc7c3acab0 2024-03-27T07:25:00.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.541+0000 7f06177fe640 1 -- 172.21.15.82:0/2117351705 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f06280d8070 con 0x55dc7c3acab0 2024-03-27T07:25:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.541+0000 7f06413d0740 10 client.15846 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.541+0000 7f06413d0740 10 client.15846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.541+0000 7f06413d0740 20 client.15846 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.541+0000 7f06413d0740 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55dc7c3c2a40 0x55dc7c437520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.541+0000 7f06413d0740 4 client.15846 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:25:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.541+0000 7f06413d0740 1 -- 172.21.15.82:0/2117351705 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dc7c3186e0 con 0x55dc7c3c2a40 2024-03-27T07:25:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.541+0000 7f06377fe640 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55dc7c3c2a40 0x55dc7c437520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.542+0000 7f06177fe640 10 client.15846 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:00.550 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.542+0000 7f06377fe640 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55dc7c3c2a40 0x55dc7c437520 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec25f6d2b04ad4b6 server_cookie=af7fced721cc905b in_seq=0 out_seq=0 2024-03-27T07:25:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06177fe640 1 -- 172.21.15.82:0/2117351705 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dc7c3186e0 con 0x55dc7c3c2a40 2024-03-27T07:25:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06177fe640 10 client.15846 handle_command_reply: tid=0 2024-03-27T07:25:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 client.15846 shutdown 2024-03-27T07:25:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 -- 172.21.15.82:0/2117351705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3acab0 msgr2=0x55dc7c3ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ae800 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f06280ba7e0 tx=0x7f06280f5cf0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 -- 172.21.15.82:0/2117351705 shutdown_connections 2024-03-27T07:25:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55dc7c3babf0 0x55dc7c3af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55dc7c3ad3d0 0x55dc7c3aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55dc7c3c2a40 0x55dc7c437520 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 --2- 172.21.15.82:0/2117351705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc7c3acab0 0x55dc7c3ae800 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06177fe640 0 client.15846 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 -- 172.21.15.82:0/2117351705 >> 172.21.15.82:0/2117351705 conn(0x55dc7c3a7a10 msgr2=0x55dc7c3a61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 -- 172.21.15.82:0/2117351705 shutdown_connections 2024-03-27T07:25:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 1 -- 172.21.15.82:0/2117351705 wait complete. 2024-03-27T07:25:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.545+0000 7f06413d0740 20 client.15846 trim_cache size 0 max 16384 2024-03-27T07:25:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:25:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:25:00.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:25:00.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:25:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 -- 172.21.15.82:0/1583653682 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f06200a3a40 msgr2=0x7f06200a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f06200a3a40 0x7f06200a5f00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0630012bb0 tx=0x7f0630009500 comp rx=0 tx=0).stop 2024-03-27T07:25:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 -- 172.21.15.82:0/1583653682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0638100a40 msgr2=0x7f0638198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0638100a40 0x7f0638198340 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0628005940 tx=0x7f0628004270 comp rx=0 tx=0).stop 2024-03-27T07:25:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 -- 172.21.15.82:0/1583653682 shutdown_connections 2024-03-27T07:25:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f06200a3a40 0x7f06200a5f00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0638106a50 0x7f063819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0638101400 0x7f0638198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 --2- 172.21.15.82:0/1583653682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0638100a40 0x7f0638198340 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 -- 172.21.15.82:0/1583653682 >> 172.21.15.82:0/1583653682 conn(0x7f0638077c60 msgr2=0x7f0638103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 -- 172.21.15.82:0/1583653682 shutdown_connections 2024-03-27T07:25:00.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:00.546+0000 7f063e716640 1 -- 172.21.15.82:0/1583653682 wait complete. 2024-03-27T07:25:02.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:02 smithi082 ceph-mon[32178]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-03-27T07:25:02.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:02 smithi149 ceph-mon[36065]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-03-27T07:25:02.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:02 smithi153 ceph-mon[36179]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-03-27T07:25:04.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:04 smithi082 ceph-mon[32178]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-27T07:25:04.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:04 smithi149 ceph-mon[36065]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-27T07:25:04.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:04 smithi153 ceph-mon[36179]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-27T07:25:06.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:06 smithi082 ceph-mon[32178]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-27T07:25:06.439 INFO:tasks.workunit.client.0.smithi082.stderr:Note: switching to '155268c4e432a12433aa833f174f9fe3b1016ae0'. 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr:state without impacting any branches by switching back to a branch. 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr: git switch -c 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr:Or undo this operation with: 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr: git switch - 2024-03-27T07:25:06.440 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-27T07:25:06.441 INFO:tasks.workunit.client.0.smithi082.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-27T07:25:06.441 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-27T07:25:06.441 INFO:tasks.workunit.client.0.smithi082.stderr:HEAD is now at 155268c4e43 Merge PR #51993 into wip-rishabh-testing-20240326.131558 2024-03-27T07:25:06.446 DEBUG:teuthology.orchestra.run.smithi082:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-27T07:25:06.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:06 smithi149 ceph-mon[36065]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-27T07:25:06.514 INFO:tasks.workunit.client.0.smithi082.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-27T07:25:06.516 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-27T07:25:06.516 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-27T07:25:06.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:06 smithi153 ceph-mon[36179]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-27T07:25:07.247 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-27T07:25:07.322 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-27T07:25:07.363 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-27T07:25:07.365 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-27T07:25:07.365 INFO:tasks.workunit.client.0.smithi082.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-27T07:25:07.405 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-27T07:25:07.408 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:25:07.408 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-27T07:25:07.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:07 smithi082 ceph-mon[32178]: mgrmap e25: x(active, since 91s), standbys: y, z 2024-03-27T07:25:07.453 INFO:tasks.workunit:Running workunits matching suites/blogbench.sh on client.0... 2024-03-27T07:25:07.454 INFO:tasks.workunit:Running workunit suites/blogbench.sh... 2024-03-27T07:25:07.454 DEBUG:teuthology.orchestra.run.smithi082:workunit test suites/blogbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=155268c4e432a12433aa833f174f9fe3b1016ae0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-03-27T07:25:07.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:07 smithi149 ceph-mon[36065]: mgrmap e25: x(active, since 91s), standbys: y, z 2024-03-27T07:25:07.513 INFO:tasks.workunit.client.0.smithi082.stdout:getting blogbench 2024-03-27T07:25:07.513 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 'getting blogbench' 2024-03-27T07:25:07.513 INFO:tasks.workunit.client.0.smithi082.stderr:+ wget http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-03-27T07:25:07.535 INFO:tasks.workunit.client.0.smithi082.stderr:--2024-03-27 07:25:07-- http://download.ceph.com/qa/blogbench-1.0.tar.bz2 2024-03-27T07:25:07.535 INFO:tasks.workunit.client.0.smithi082.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-03-27T07:25:07.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:07 smithi153 ceph-mon[36179]: mgrmap e25: x(active, since 91s), standbys: y, z 2024-03-27T07:25:07.557 INFO:tasks.workunit.client.0.smithi082.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-03-27T07:25:07.577 INFO:tasks.workunit.client.0.smithi082.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-27T07:25:07.577 INFO:tasks.workunit.client.0.smithi082.stderr:Length: 103355 (101K) [application/octet-stream] 2024-03-27T07:25:07.578 INFO:tasks.workunit.client.0.smithi082.stderr:Saving to: ‘blogbench-1.0.tar.bz2’ 2024-03-27T07:25:07.580 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-27T07:25:07.620 INFO:tasks.workunit.client.0.smithi082.stderr: 0K .......... .......... .......... .......... .......... 49% 1.21M 0s 2024-03-27T07:25:07.639 INFO:tasks.workunit.client.0.smithi082.stderr: 50K .......... .......... .......... .......... .......... 99% 2.37M 0s 2024-03-27T07:25:07.639 INFO:tasks.workunit.client.0.smithi082.stderr: 100K 100% 1.74T=0.06s 2024-03-27T07:25:07.639 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-27T07:25:07.640 INFO:tasks.workunit.client.0.smithi082.stderr:2024-03-27 07:25:07 (1.62 MB/s) - ‘blogbench-1.0.tar.bz2’ saved [103355/103355] 2024-03-27T07:25:07.640 INFO:tasks.workunit.client.0.smithi082.stderr: 2024-03-27T07:25:07.640 INFO:tasks.workunit.client.0.smithi082.stderr:+ tar -xvf blogbench-1.0.tar.bz2 2024-03-27T07:25:07.667 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/ 2024-03-27T07:25:07.668 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/m4/ 2024-03-27T07:25:07.668 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/m4/acx_pthread.m4 2024-03-27T07:25:07.670 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/man/ 2024-03-27T07:25:07.670 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/man/blogbench.8 2024-03-27T07:25:07.672 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/man/Makefile.am 2024-03-27T07:25:07.674 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/man/Makefile.in 2024-03-27T07:25:07.675 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/ 2024-03-27T07:25:07.676 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/mysnprintf.c 2024-03-27T07:25:07.677 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/mysnprintf.h 2024-03-27T07:25:07.679 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/blogbench.c 2024-03-27T07:25:07.680 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/blogbench.h 2024-03-27T07:25:07.682 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/fakesnprintf.c 2024-03-27T07:25:07.683 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/fakesnprintf.h 2024-03-27T07:25:07.685 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/blogbench_p.h 2024-03-27T07:25:07.686 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/bsd-getopt_long.c 2024-03-27T07:25:07.688 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/bsd-getopt_long.h 2024-03-27T07:25:07.689 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/Makefile.am 2024-03-27T07:25:07.690 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/Makefile.in 2024-03-27T07:25:07.692 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/process.c 2024-03-27T07:25:07.693 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/globals.h 2024-03-27T07:25:07.695 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/commenter.c 2024-03-27T07:25:07.696 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/rewriter.c 2024-03-27T07:25:07.698 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/reader.c 2024-03-27T07:25:07.699 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/writer.c 2024-03-27T07:25:07.701 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/src/helpers.c 2024-03-27T07:25:07.702 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/NEWS 2024-03-27T07:25:07.703 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/compile 2024-03-27T07:25:07.704 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/depcomp 2024-03-27T07:25:07.704 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/aclocal.m4 2024-03-27T07:25:07.705 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/README 2024-03-27T07:25:07.706 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/configure 2024-03-27T07:25:07.710 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/configure.ac 2024-03-27T07:25:07.711 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/config.guess 2024-03-27T07:25:07.712 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/install-sh 2024-03-27T07:25:07.714 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/config.sub 2024-03-27T07:25:07.715 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/missing 2024-03-27T07:25:07.717 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/mkinstalldirs 2024-03-27T07:25:07.718 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/Makefile.am 2024-03-27T07:25:07.720 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/Makefile.in 2024-03-27T07:25:07.721 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/config.h.in 2024-03-27T07:25:07.723 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/AUTHORS 2024-03-27T07:25:07.724 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/INSTALL 2024-03-27T07:25:07.726 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/ChangeLog 2024-03-27T07:25:07.728 INFO:tasks.workunit.client.0.smithi082.stdout:blogbench-1.0/COPYING 2024-03-27T07:25:07.729 INFO:tasks.workunit.client.0.smithi082.stderr:+ cd blogbench-1.0/ 2024-03-27T07:25:07.730 INFO:tasks.workunit.client.0.smithi082.stdout:making blogbench 2024-03-27T07:25:07.730 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 'making blogbench' 2024-03-27T07:25:07.730 INFO:tasks.workunit.client.0.smithi082.stderr:+ ./configure 2024-03-27T07:25:07.849 INFO:tasks.workunit.client.0.smithi082.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-03-27T07:25:08.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:08 smithi082 ceph-mon[32178]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-27T07:25:08.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:08 smithi149 ceph-mon[36065]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-27T07:25:08.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:08 smithi153 ceph-mon[36179]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-03-27T07:25:08.856 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether build environment is sane... yes 2024-03-27T07:25:08.865 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gawk... gawk 2024-03-27T07:25:08.882 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether make sets $(MAKE)... yes 2024-03-27T07:25:08.910 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc... gcc 2024-03-27T07:25:08.962 INFO:tasks.workunit.client.0.smithi082.stdout:checking for C compiler default output file name... a.out 2024-03-27T07:25:08.963 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether the C compiler works... yes 2024-03-27T07:25:08.966 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether we are cross compiling... no 2024-03-27T07:25:09.004 INFO:tasks.workunit.client.0.smithi082.stdout:checking for suffix of executables... 2024-03-27T07:25:09.037 INFO:tasks.workunit.client.0.smithi082.stdout:checking for suffix of object files... o 2024-03-27T07:25:09.070 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether we are using the GNU C compiler... yes 2024-03-27T07:25:09.108 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether gcc accepts -g... yes 2024-03-27T07:25:09.184 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gcc option to accept ANSI C... none needed 2024-03-27T07:25:09.231 INFO:tasks.workunit.client.0.smithi082.stdout:checking for style of include used by make... GNU 2024-03-27T07:25:09.350 INFO:tasks.workunit.client.0.smithi082.stdout:checking dependency style of gcc... gcc3 2024-03-27T07:25:09.350 INFO:tasks.workunit.client.0.smithi082.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-03-27T07:25:09.408 INFO:tasks.workunit.client.0.smithi082.stdout:checking how to run the C preprocessor... gcc -E 2024-03-27T07:25:09.453 INFO:tasks.workunit.client.0.smithi082.stdout:checking for egrep... grep -E 2024-03-27T07:25:09.462 INFO:tasks.workunit.client.0.smithi082.stdout:checking for AIX... no 2024-03-27T07:25:09.548 INFO:tasks.workunit.client.0.smithi082.stdout:checking for library containing strerror... none required 2024-03-27T07:25:09.765 INFO:tasks.workunit.client.0.smithi082.stdout:checking for ANSI C header files... yes 2024-03-27T07:25:09.809 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-03-27T07:25:09.866 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/types.h... yes 2024-03-27T07:25:09.916 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/stat.h... yes 2024-03-27T07:25:09.969 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdlib.h... yes 2024-03-27T07:25:10.020 INFO:tasks.workunit.client.0.smithi082.stdout:checking for string.h... yes 2024-03-27T07:25:10.078 INFO:tasks.workunit.client.0.smithi082.stdout:checking for memory.h... yes 2024-03-27T07:25:10.128 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strings.h... yes 2024-03-27T07:25:10.177 INFO:tasks.workunit.client.0.smithi082.stdout:checking for inttypes.h... yes 2024-03-27T07:25:10.229 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdint.h... yes 2024-03-27T07:25:10.279 INFO:tasks.workunit.client.0.smithi082.stdout:checking for unistd.h... yes 2024-03-27T07:25:10.291 INFO:tasks.workunit.client.0.smithi082.stdout:checking for memory.h... (cached) yes 2024-03-27T07:25:10.296 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strings.h... (cached) yes 2024-03-27T07:25:10.301 INFO:tasks.workunit.client.0.smithi082.stdout:checking for unistd.h... (cached) yes 2024-03-27T07:25:10.356 INFO:tasks.workunit.client.0.smithi082.stdout:checking locale.h usability... yes 2024-03-27T07:25:10.376 INFO:tasks.workunit.client.0.smithi082.stdout:checking locale.h presence... yes 2024-03-27T07:25:10.376 INFO:tasks.workunit.client.0.smithi082.stdout:checking for locale.h... yes 2024-03-27T07:25:10.392 INFO:tasks.workunit.client.0.smithi082.stdout:checking for stdlib.h... (cached) yes 2024-03-27T07:25:10.396 INFO:tasks.workunit.client.0.smithi082.stdout:checking for string.h... (cached) yes 2024-03-27T07:25:10.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:10 smithi082 ceph-mon[32178]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-03-27T07:25:10.462 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/socket.h usability... yes 2024-03-27T07:25:10.488 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/socket.h presence... yes 2024-03-27T07:25:10.488 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/socket.h... yes 2024-03-27T07:25:10.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:10 smithi149 ceph-mon[36065]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-03-27T07:25:10.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:10 smithi153 ceph-mon[36179]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-03-27T07:25:10.541 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/time.h usability... yes 2024-03-27T07:25:10.561 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/time.h presence... yes 2024-03-27T07:25:10.562 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/time.h... yes 2024-03-27T07:25:10.621 INFO:tasks.workunit.client.0.smithi082.stdout:checking fcntl.h usability... yes 2024-03-27T07:25:10.641 INFO:tasks.workunit.client.0.smithi082.stdout:checking fcntl.h presence... yes 2024-03-27T07:25:10.642 INFO:tasks.workunit.client.0.smithi082.stdout:checking for fcntl.h... yes 2024-03-27T07:25:10.703 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/fcntl.h usability... yes 2024-03-27T07:25:10.728 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/fcntl.h presence... yes 2024-03-27T07:25:10.728 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/fcntl.h... yes 2024-03-27T07:25:10.807 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/param.h usability... yes 2024-03-27T07:25:10.831 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/param.h presence... yes 2024-03-27T07:25:10.832 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/param.h... yes 2024-03-27T07:25:10.886 INFO:tasks.workunit.client.0.smithi082.stdout:checking ioctl.h usability... no 2024-03-27T07:25:10.906 INFO:tasks.workunit.client.0.smithi082.stdout:checking ioctl.h presence... no 2024-03-27T07:25:10.907 INFO:tasks.workunit.client.0.smithi082.stdout:checking for ioctl.h... no 2024-03-27T07:25:10.960 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/ioctl.h usability... yes 2024-03-27T07:25:10.980 INFO:tasks.workunit.client.0.smithi082.stdout:checking sys/ioctl.h presence... yes 2024-03-27T07:25:10.980 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sys/ioctl.h... yes 2024-03-27T07:25:11.031 INFO:tasks.workunit.client.0.smithi082.stdout:checking return type of signal handlers... void 2024-03-27T07:25:11.076 INFO:tasks.workunit.client.0.smithi082.stdout:checking for size_t... yes 2024-03-27T07:25:11.115 INFO:tasks.workunit.client.0.smithi082.stdout:checking for dev_t... yes 2024-03-27T07:25:11.158 INFO:tasks.workunit.client.0.smithi082.stdout:checking for short... yes 2024-03-27T07:25:11.237 INFO:tasks.workunit.client.0.smithi082.stdout:checking size of short... 2 2024-03-27T07:25:11.281 INFO:tasks.workunit.client.0.smithi082.stdout:checking for int... yes 2024-03-27T07:25:11.351 INFO:tasks.workunit.client.0.smithi082.stdout:checking size of int... 4 2024-03-27T07:25:11.396 INFO:tasks.workunit.client.0.smithi082.stdout:checking for long... yes 2024-03-27T07:25:11.473 INFO:tasks.workunit.client.0.smithi082.stdout:checking size of long... 8 2024-03-27T07:25:11.522 INFO:tasks.workunit.client.0.smithi082.stdout:checking for long long... yes 2024-03-27T07:25:11.597 INFO:tasks.workunit.client.0.smithi082.stdout:checking size of long long... 8 2024-03-27T07:25:11.639 INFO:tasks.workunit.client.0.smithi082.stdout:checking for ssize_t... yes 2024-03-27T07:25:11.679 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sig_atomic_t... yes 2024-03-27T07:25:11.739 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether gcc needs -traditional... no 2024-03-27T07:25:11.774 INFO:tasks.workunit.client.0.smithi082.stdout:checking for an ANSI C-conforming const... yes 2024-03-27T07:25:11.797 INFO:tasks.workunit.client.0.smithi082.stdout:checking for inline... inline 2024-03-27T07:25:11.859 INFO:tasks.workunit.client.0.smithi082.stdout:checking for working alloca.h... yes 2024-03-27T07:25:11.908 INFO:tasks.workunit.client.0.smithi082.stdout:checking for alloca... yes 2024-03-27T07:25:11.985 INFO:tasks.workunit.client.0.smithi082.stdout:checking for working memcmp... yes 2024-03-27T07:25:12.042 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strftime... yes 2024-03-27T07:25:12.115 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether lstat dereferences a symlink specified with a trailing slash... yes 2024-03-27T07:25:12.173 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether stat accepts an empty string... no 2024-03-27T07:25:12.227 INFO:tasks.workunit.client.0.smithi082.stdout:checking for vprintf... yes 2024-03-27T07:25:12.286 INFO:tasks.workunit.client.0.smithi082.stdout:checking for _doprnt... no 2024-03-27T07:25:12.307 INFO:tasks.workunit.client.0.smithi082.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-03-27T07:25:12.319 INFO:tasks.workunit.client.0.smithi082.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-03-27T07:25:12.340 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:12 smithi153 ceph-mon[36179]: pgmap v51: 97 pgs: 97 active+clean; 2.6 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 130 KiB/s wr, 27 op/s 2024-03-27T07:25:12.384 INFO:tasks.workunit.client.0.smithi082.stdout:checking for the pthreads library -lpthreads... no 2024-03-27T07:25:12.436 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether pthreads work without any flags... yes 2024-03-27T07:25:12.437 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:12 smithi082 ceph-mon[32178]: pgmap v51: 97 pgs: 97 active+clean; 2.6 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 130 KiB/s wr, 27 op/s 2024-03-27T07:25:12.481 INFO:tasks.workunit.client.0.smithi082.stdout:checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE 2024-03-27T07:25:12.481 INFO:tasks.workunit.client.0.smithi082.stdout:checking if more special flags are required for pthreads... no 2024-03-27T07:25:12.481 INFO:tasks.workunit.client.0.smithi082.stdout:checking for cc_r... gcc 2024-03-27T07:25:12.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:12 smithi149 ceph-mon[36065]: pgmap v51: 97 pgs: 97 active+clean; 2.6 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 130 KiB/s wr, 27 op/s 2024-03-27T07:25:12.568 INFO:tasks.workunit.client.0.smithi082.stdout:checking for setrlimit... yes 2024-03-27T07:25:12.633 INFO:tasks.workunit.client.0.smithi082.stdout:checking for setproctitle... no 2024-03-27T07:25:12.710 INFO:tasks.workunit.client.0.smithi082.stdout:checking for getopt_long... yes 2024-03-27T07:25:12.772 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strtoull... yes 2024-03-27T07:25:12.835 INFO:tasks.workunit.client.0.smithi082.stdout:checking for strtoq... yes 2024-03-27T07:25:12.964 INFO:tasks.workunit.client.0.smithi082.stdout:checking for snprintf... yes 2024-03-27T07:25:13.046 INFO:tasks.workunit.client.0.smithi082.stdout:checking for vsnprintf... yes 2024-03-27T07:25:13.115 INFO:tasks.workunit.client.0.smithi082.stdout:checking for vfprintf... yes 2024-03-27T07:25:13.180 INFO:tasks.workunit.client.0.smithi082.stdout:checking for gethostname... yes 2024-03-27T07:25:13.242 INFO:tasks.workunit.client.0.smithi082.stdout:checking for setlocale... yes 2024-03-27T07:25:13.309 INFO:tasks.workunit.client.0.smithi082.stdout:checking for sync... yes 2024-03-27T07:25:13.377 INFO:tasks.workunit.client.0.smithi082.stdout:checking whether snprintf is C99 conformant... done 2024-03-27T07:25:13.388 INFO:tasks.workunit.client.0.smithi082.stdout:configure: creating ./config.status 2024-03-27T07:25:13.562 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating Makefile 2024-03-27T07:25:13.581 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating src/Makefile 2024-03-27T07:25:13.601 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating man/Makefile 2024-03-27T07:25:13.612 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: creating config.h 2024-03-27T07:25:13.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 -- 172.21.15.82:0/1632050410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02c8100a10 msgr2=0x7f02c8100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:13.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 --2- 172.21.15.82:0/1632050410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02c8100a10 0x7f02c8100e90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009930 tx=0x7f02b802bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:13.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 -- 172.21.15.82:0/1632050410 shutdown_connections 2024-03-27T07:25:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 --2- 172.21.15.82:0/1632050410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02c8100a10 0x7f02c8100e90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 --2- 172.21.15.82:0/1632050410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c81013d0 0x7f02c810d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 --2- 172.21.15.82:0/1632050410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c8106a20 0x7f02c8106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 -- 172.21.15.82:0/1632050410 >> 172.21.15.82:0/1632050410 conn(0x7f02c8077b30 msgr2=0x7f02c8077f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 -- 172.21.15.82:0/1632050410 shutdown_connections 2024-03-27T07:25:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 -- 172.21.15.82:0/1632050410 wait complete. 2024-03-27T07:25:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 Processor -- start 2024-03-27T07:25:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.639+0000 7f02cf695640 1 -- start start 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02cf695640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c8100a10 0x7f02c81991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02cf695640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02c81013d0 0x7f02c8199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02cf695640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c8106a20 0x7f02c81a4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02cf695640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8110e30 con 0x7f02c81013d0 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02cf695640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8110cb0 con 0x7f02c8100a10 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02cf695640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f02c8110fb0 con 0x7f02c8106a20 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02ccc30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02c81013d0 0x7f02c8199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02ccc30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02c81013d0 0x7f02c8199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58006/0 (socket says 172.21.15.82:58006) 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02ccc30640 1 -- 172.21.15.82:0/2709242944 learned_addr learned my addr 172.21.15.82:0/2709242944 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02cdc32640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c8106a20 0x7f02c81a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02cd431640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c8100a10 0x7f02c81991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02ccc30640 1 -- 172.21.15.82:0/2709242944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c8106a20 msgr2=0x7f02c81a4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02ccc30640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c8106a20 0x7f02c81a4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02ccc30640 1 -- 172.21.15.82:0/2709242944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c8100a10 msgr2=0x7f02c81991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02ccc30640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c8100a10 0x7f02c81991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02ccc30640 1 -- 172.21.15.82:0/2709242944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c81a4790 con 0x7f02c81013d0 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02ccc30640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02c81013d0 0x7f02c8199710 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009230 tx=0x7f02b802cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02be7fc640 1 -- 172.21.15.82:0/2709242944 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8041070 con 0x7f02c81013d0 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02cf695640 1 -- 172.21.15.82:0/2709242944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c81a4960 con 0x7f02c81013d0 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02be7fc640 1 -- 172.21.15.82:0/2709242944 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b8004450 con 0x7f02c81013d0 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02be7fc640 1 -- 172.21.15.82:0/2709242944 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8034440 con 0x7f02c81013d0 2024-03-27T07:25:13.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.640+0000 7f02cf695640 1 -- 172.21.15.82:0/2709242944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c81a4dc0 con 0x7f02c81013d0 2024-03-27T07:25:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.642+0000 7f02be7fc640 1 -- 172.21.15.82:0/2709242944 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f02b8044070 con 0x7f02c81013d0 2024-03-27T07:25:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02d227d740 1 Processor -- start 2024-03-27T07:25:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02d227d740 1 -- start start 2024-03-27T07:25:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02d227d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b4eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02d227d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4f530 0x565464b5c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02d227d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464b5efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02d227d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565464b15cd0 con 0x565464b5cbf0 2024-03-27T07:25:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02d227d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x565464a5a950 con 0x565464b4f530 2024-03-27T07:25:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02d227d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565464ab2e50 con 0x565464b4ec10 2024-03-27T07:25:13.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02be7fc640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02b40a3820 0x7f02b40a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02ccc30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464b5efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02cd431640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4f530 0x565464b5c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02cdc32640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b4eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02ccc30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464b5efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58022/0 (socket says 172.21.15.82:58022) 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02cdc32640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b4eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36934/0 (socket says 172.21.15.82:36934) 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02ccc30640 1 -- 172.21.15.82:0/900242585 learned_addr learned my addr 172.21.15.82:0/900242585 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02cdc32640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02b40a3820 0x7f02b40a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.643+0000 7f02be7fc640 1 -- 172.21.15.82:0/2709242944 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f02b80f1940 con 0x7f02c81013d0 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02cdc32640 1 -- 172.21.15.82:0/900242585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4f530 msgr2=0x565464b5c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02cdc32640 1 --2- 172.21.15.82:0/900242585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4f530 0x565464b5c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02cdc32640 1 -- 172.21.15.82:0/900242585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 msgr2=0x565464b5efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02cdc32640 1 --2- 172.21.15.82:0/900242585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464b5efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02cdc32640 1 -- 172.21.15.82:0/900242585 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654647c7210 con 0x565464b4ec10 2024-03-27T07:25:13.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02ccc30640 1 --2- 172.21.15.82:0/900242585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464b5efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02cdc32640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02b40a3820 0x7f02b40a5ce0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02c0010c40 tx=0x7f02c000c000 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02cdc32640 1 --2- 172.21.15.82:0/900242585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b4eff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005fd0 tx=0x7f02c0010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=855234df1ad3b9c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02b37fe640 1 -- 172.21.15.82:0/900242585 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0012e70 con 0x565464b4ec10 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02b37fe640 1 -- 172.21.15.82:0/900242585 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c0009ce0 con 0x565464b4ec10 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.644+0000 7f02b37fe640 1 -- 172.21.15.82:0/900242585 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0005020 con 0x565464b4ec10 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 -- 172.21.15.82:0/900242585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 msgr2=0x565464b4eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 --2- 172.21.15.82:0/900242585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b4eff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005fd0 tx=0x7f02c0010740 comp rx=0 tx=0).stop 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 -- 172.21.15.82:0/900242585 shutdown_connections 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 --2- 172.21.15.82:0/900242585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464b5efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 --2- 172.21.15.82:0/900242585 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4f530 0x565464b5c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 --2- 172.21.15.82:0/900242585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b4eff0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 -- 172.21.15.82:0/900242585 >> 172.21.15.82:0/900242585 conn(0x565464b49a10 msgr2=0x565464b49df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:13.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 -- 172.21.15.82:0/900242585 shutdown_connections 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 -- 172.21.15.82:0/900242585 wait complete. 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 -- start start 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.645+0000 7f02d227d740 1 Processor -- start 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02d227d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b59c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02d227d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4f530 0x565464b5a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02d227d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b5cbf0 0x565464b5a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02d227d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565464aaee00 con 0x565464b4f530 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02d227d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x565464a5b520 con 0x565464b5cbf0 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02d227d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565464a6e8e0 con 0x565464b4ec10 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02d227d740 10 client.0 _ll_register_callbacks cb 0x565464aa9a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02ccc30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4f530 0x565464b5a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02cd431640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b59c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02ccc30640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4f530 0x565464b5a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58036/0 (socket says 172.21.15.82:58036) 2024-03-27T07:25:13.658 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02ccc30640 1 -- 172.21.15.82:0/4158733873 learned_addr learned my addr 172.21.15.82:0/4158733873 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02cdc32640 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b5cbf0 0x565464b5a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02ccc30640 1 -- 172.21.15.82:0/4158733873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 msgr2=0x565464b59c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02ccc30640 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b59c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02ccc30640 1 -- 172.21.15.82:0/4158733873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b5cbf0 msgr2=0x565464b5a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02ccc30640 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b5cbf0 0x565464b5a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02ccc30640 1 -- 172.21.15.82:0/4158733873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565464893620 con 0x565464b4f530 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02cd431640 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b59c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02ccc30640 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4f530 0x565464b5a160 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f02b80bdc70 tx=0x7f02b8049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e93d6fe3dcbe9d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02b0ff9640 1 -- 172.21.15.82:0/4158733873 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b804b040 con 0x565464b4f530 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02b0ff9640 1 -- 172.21.15.82:0/4158733873 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f02b80ba350 con 0x565464b4f530 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02d227d740 1 -- 172.21.15.82:0/4158733873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x565464ac0390 con 0x565464b4f530 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.646+0000 7f02b0ff9640 1 -- 172.21.15.82:0/4158733873 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f02b8004c80 con 0x565464b4f530 2024-03-27T07:25:13.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02d227d740 10 client.15858 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02d227d740 1 -- 172.21.15.82:0/4158733873 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x565464b6b730 con 0x565464b4f530 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02b0ff9640 1 -- 172.21.15.82:0/4158733873 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x565464ac0390 con 0x565464b4f530 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02b0ff9640 1 -- 172.21.15.82:0/4158733873 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f02b80035f0 con 0x565464b4f530 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02d227d740 10 client.15858 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02d227d740 10 client.15858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02d227d740 20 client.15858 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02d227d740 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565464b6cb40 0x565464b6ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02d227d740 4 client.15858 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02d227d740 1 -- 172.21.15.82:0/4158733873 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565464aba6e0 con 0x565464b6cb40 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02cd431640 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565464b6cb40 0x565464b6ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02b0ff9640 10 client.15858 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.647+0000 7f02cd431640 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565464b6cb40 0x565464b6ef90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=956d5fd4a9a9d5be server_cookie=a57a2c7a5a160031 in_seq=0 out_seq=0 2024-03-27T07:25:13.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02b0ff9640 1 -- 172.21.15.82:0/4158733873 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x565464aba6e0 con 0x565464b6cb40 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02b0ff9640 10 client.15858 handle_command_reply: tid=0 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 client.15858 shutdown 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 -- 172.21.15.82:0/4158733873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4f530 msgr2=0x565464b5a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4f530 0x565464b5a160 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f02b80bdc70 tx=0x7f02b8049000 comp rx=0 tx=0).stop 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 -- 172.21.15.82:0/4158733873 shutdown_connections 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565464b6cb40 0x565464b6ef90 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4f530 0x565464b5a160 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02b0ff9640 0 client.15858 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b5cbf0 0x565464b5a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 --2- 172.21.15.82:0/4158733873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4ec10 0x565464b59c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 -- 172.21.15.82:0/4158733873 >> 172.21.15.82:0/4158733873 conn(0x565464b49a10 msgr2=0x565464b4b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 -- 172.21.15.82:0/4158733873 shutdown_connections 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 1 -- 172.21.15.82:0/4158733873 wait complete. 2024-03-27T07:25:13.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.649+0000 7f02d227d740 20 client.15858 trim_cache size 0 max 16384 2024-03-27T07:25:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.664+0000 7f02d227d740 1 Processor -- start 2024-03-27T07:25:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.664+0000 7f02d227d740 1 -- start start 2024-03-27T07:25:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.664+0000 7f02d227d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4ec10 0x565464b68230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.664+0000 7f02d227d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4f530 0x565464b74850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.664+0000 7f02d227d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b5cbf0 0x565464b4adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.664+0000 7f02d227d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02c81adcd0 con 0x565464b4ec10 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.664+0000 7f02d227d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02c81ab5a0 con 0x565464b4f530 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.664+0000 7f02d227d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f02c81a93f0 con 0x565464b5cbf0 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02cd431640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4ec10 0x565464b68230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02cd431640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4ec10 0x565464b68230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58044/0 (socket says 172.21.15.82:58044) 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02cd431640 1 -- 172.21.15.82:0/3693467552 learned_addr learned my addr 172.21.15.82:0/3693467552 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02ccc30640 1 --2- 172.21.15.82:0/3693467552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4f530 0x565464b74850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02cdc32640 1 --2- 172.21.15.82:0/3693467552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b5cbf0 0x565464b4adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02cd431640 1 -- 172.21.15.82:0/3693467552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b5cbf0 msgr2=0x565464b4adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02cd431640 1 --2- 172.21.15.82:0/3693467552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b5cbf0 0x565464b4adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02cd431640 1 -- 172.21.15.82:0/3693467552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4f530 msgr2=0x565464b74850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02cd431640 1 --2- 172.21.15.82:0/3693467552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4f530 0x565464b74850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02cd431640 1 -- 172.21.15.82:0/3693467552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565464b68770 con 0x565464b4ec10 2024-03-27T07:25:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02cd431640 1 --2- 172.21.15.82:0/3693467552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4ec10 0x565464b68230 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f02c4012990 tx=0x7f02c4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d8be3ce8019e92 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02b2ffd640 1 -- 172.21.15.82:0/3693467552 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c40122d0 con 0x565464b4ec10 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02b2ffd640 1 -- 172.21.15.82:0/3693467552 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c4026070 con 0x565464b4ec10 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.665+0000 7f02b2ffd640 1 -- 172.21.15.82:0/3693467552 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c400fba0 con 0x565464b4ec10 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 -- 172.21.15.82:0/3693467552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4ec10 msgr2=0x565464b68230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 --2- 172.21.15.82:0/3693467552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4ec10 0x565464b68230 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f02c4012990 tx=0x7f02c4005f90 comp rx=0 tx=0).stop 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 -- 172.21.15.82:0/3693467552 shutdown_connections 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 --2- 172.21.15.82:0/3693467552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b5cbf0 0x565464b4adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 --2- 172.21.15.82:0/3693467552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4f530 0x565464b74850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 --2- 172.21.15.82:0/3693467552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b4ec10 0x565464b68230 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 -- 172.21.15.82:0/3693467552 >> 172.21.15.82:0/3693467552 conn(0x565464b49a10 msgr2=0x565464b49df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 -- 172.21.15.82:0/3693467552 shutdown_connections 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 -- 172.21.15.82:0/3693467552 wait complete. 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 -- start start 2024-03-27T07:25:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.666+0000 7f02d227d740 1 Processor -- start 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02d227d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4ec10 0x565464b604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02d227d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4f530 0x565464b60a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02d227d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464bd1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02d227d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f02c81a9a60 con 0x565464b5cbf0 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02d227d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f02c81aaed0 con 0x565464b4ec10 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02d227d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f02c81aa130 con 0x565464b4f530 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02d227d740 10 client.0 _ll_register_callbacks cb 0x7f02b80bd8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02cdc32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464bd1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02ccc30640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4f530 0x565464b60a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02cdc32640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464bd1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58052/0 (socket says 172.21.15.82:58052) 2024-03-27T07:25:13.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02cdc32640 1 -- 172.21.15.82:0/1242527124 learned_addr learned my addr 172.21.15.82:0/1242527124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02cd431640 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4ec10 0x565464b604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02cdc32640 1 -- 172.21.15.82:0/1242527124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4f530 msgr2=0x565464b60a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02cdc32640 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4f530 0x565464b60a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02cdc32640 1 -- 172.21.15.82:0/1242527124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4ec10 msgr2=0x565464b604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02cdc32640 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4ec10 0x565464b604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02cdc32640 1 -- 172.21.15.82:0/1242527124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565464b612d0 con 0x565464b5cbf0 2024-03-27T07:25:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02ccc30640 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4f530 0x565464b60a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02cdc32640 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464bd1e80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005fd0 tx=0x7f02c0009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a66ef17ae2ffa2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:13.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.667+0000 7f02b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02b0ff9640 1 -- 172.21.15.82:0/1242527124 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02c0035060 con 0x565464b5cbf0 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02b0ff9640 1 -- 172.21.15.82:0/1242527124 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f02c000cc30 con 0x565464b5cbf0 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02d227d740 1 -- 172.21.15.82:0/1242527124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02c4026070 con 0x565464b5cbf0 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02b0ff9640 1 -- 172.21.15.82:0/1242527124 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f02c000ce30 con 0x565464b5cbf0 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02d227d740 10 client.15864 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02d227d740 1 -- 172.21.15.82:0/1242527124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x565464bd34d0 con 0x565464b5cbf0 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02b0ff9640 1 -- 172.21.15.82:0/1242527124 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02c4026070 con 0x565464b5cbf0 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02b0ff9640 1 -- 172.21.15.82:0/1242527124 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f02c000f040 con 0x565464b5cbf0 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02d227d740 10 client.15864 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02d227d740 10 client.15864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:13.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02d227d740 20 client.15864 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02d227d740 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565464b6cb40 0x565464bd59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02d227d740 4 client.15864 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:25:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02d227d740 1 -- 172.21.15.82:0/1242527124 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565464a38770 con 0x565464b6cb40 2024-03-27T07:25:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.668+0000 7f02cd431640 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565464b6cb40 0x565464bd59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.669+0000 7f02b0ff9640 10 client.15864 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:13.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.669+0000 7f02cd431640 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565464b6cb40 0x565464bd59d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fd6e4a40b20627e server_cookie=a58f7448c3fb6d78 in_seq=0 out_seq=0 2024-03-27T07:25:13.709 INFO:tasks.workunit.client.0.smithi082.stdout:config.status: executing depfiles commands 2024-03-27T07:25:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02b0ff9640 1 -- 172.21.15.82:0/1242527124 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565464a38770 con 0x565464b6cb40 2024-03-27T07:25:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02b0ff9640 10 client.15864 handle_command_reply: tid=0 2024-03-27T07:25:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 client.15864 shutdown 2024-03-27T07:25:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 -- 172.21.15.82:0/1242527124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 msgr2=0x565464bd1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464bd1e80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005fd0 tx=0x7f02c0009990 comp rx=0 tx=0).stop 2024-03-27T07:25:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 -- 172.21.15.82:0/1242527124 shutdown_connections 2024-03-27T07:25:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565464b6cb40 0x565464bd59d0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565464b5cbf0 0x565464bd1e80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.779 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565464b4f530 0x565464b60a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02b0ff9640 0 client.15864 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 --2- 172.21.15.82:0/1242527124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565464b4ec10 0x565464b604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 -- 172.21.15.82:0/1242527124 >> 172.21.15.82:0/1242527124 conn(0x565464b49a10 msgr2=0x565464b4adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 -- 172.21.15.82:0/1242527124 shutdown_connections 2024-03-27T07:25:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 1 -- 172.21.15.82:0/1242527124 wait complete. 2024-03-27T07:25:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.776+0000 7f02d227d740 20 client.15864 trim_cache size 0 max 16384 2024-03-27T07:25:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:25:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:25:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:25:13.780 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:25:13.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 -- 172.21.15.82:0/2709242944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02b40a3820 msgr2=0x7f02b40a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02b40a3820 0x7f02b40a5ce0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f02c0010c40 tx=0x7f02c000c000 comp rx=0 tx=0).stop 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 -- 172.21.15.82:0/2709242944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02c81013d0 msgr2=0x7f02c8199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02c81013d0 0x7f02c8199710 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009230 tx=0x7f02b802cba0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 -- 172.21.15.82:0/2709242944 shutdown_connections 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02b40a3820 0x7f02b40a5ce0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f02c81013d0 0x7f02c8199710 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02c8106a20 0x7f02c81a4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 --2- 172.21.15.82:0/2709242944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f02c8100a10 0x7f02c81991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 -- 172.21.15.82:0/2709242944 >> 172.21.15.82:0/2709242944 conn(0x7f02c8077b30 msgr2=0x7f02c8103520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 -- 172.21.15.82:0/2709242944 shutdown_connections 2024-03-27T07:25:13.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:13.777+0000 7f02cf695640 1 -- 172.21.15.82:0/2709242944 wait complete. 2024-03-27T07:25:13.868 INFO:tasks.workunit.client.0.smithi082.stderr:+ make 2024-03-27T07:25:13.878 INFO:tasks.workunit.client.0.smithi082.stdout:make all-recursive 2024-03-27T07:25:13.880 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-03-27T07:25:13.882 INFO:tasks.workunit.client.0.smithi082.stdout:Making all in src 2024-03-27T07:25:13.886 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-03-27T07:25:13.886 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT blogbench.o -MD -MP -MF ".deps/blogbench.Tpo" -c -o blogbench.o blogbench.c; \ 2024-03-27T07:25:13.886 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/blogbench.Tpo" ".deps/blogbench.Po"; else rm -f ".deps/blogbench.Tpo"; exit 1; fi 2024-03-27T07:25:13.994 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT process.o -MD -MP -MF ".deps/process.Tpo" -c -o process.o process.c; \ 2024-03-27T07:25:13.994 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/process.Tpo" ".deps/process.Po"; else rm -f ".deps/process.Tpo"; exit 1; fi 2024-03-27T07:25:14.089 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT writer.o -MD -MP -MF ".deps/writer.Tpo" -c -o writer.o writer.c; \ 2024-03-27T07:25:14.089 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/writer.Tpo" ".deps/writer.Po"; else rm -f ".deps/writer.Tpo"; exit 1; fi 2024-03-27T07:25:14.169 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT rewriter.o -MD -MP -MF ".deps/rewriter.Tpo" -c -o rewriter.o rewriter.c; \ 2024-03-27T07:25:14.169 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/rewriter.Tpo" ".deps/rewriter.Po"; else rm -f ".deps/rewriter.Tpo"; exit 1; fi 2024-03-27T07:25:14.242 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT reader.o -MD -MP -MF ".deps/reader.Tpo" -c -o reader.o reader.c; \ 2024-03-27T07:25:14.242 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/reader.Tpo" ".deps/reader.Po"; else rm -f ".deps/reader.Tpo"; exit 1; fi 2024-03-27T07:25:14.318 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT commenter.o -MD -MP -MF ".deps/commenter.Tpo" -c -o commenter.o commenter.c; \ 2024-03-27T07:25:14.318 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/commenter.Tpo" ".deps/commenter.Po"; else rm -f ".deps/commenter.Tpo"; exit 1; fi 2024-03-27T07:25:14.391 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT helpers.o -MD -MP -MF ".deps/helpers.Tpo" -c -o helpers.o helpers.c; \ 2024-03-27T07:25:14.392 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/helpers.Tpo" ".deps/helpers.Po"; else rm -f ".deps/helpers.Tpo"; exit 1; fi 2024-03-27T07:25:14.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:14 smithi082 ceph-mon[32178]: pgmap v52: 97 pgs: 97 active+clean; 2.6 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 129 KiB/s wr, 22 op/s 2024-03-27T07:25:14.491 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT bsd-getopt_long.o -MD -MP -MF ".deps/bsd-getopt_long.Tpo" -c -o bsd-getopt_long.o bsd-getopt_long.c; \ 2024-03-27T07:25:14.491 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/bsd-getopt_long.Tpo" ".deps/bsd-getopt_long.Po"; else rm -f ".deps/bsd-getopt_long.Tpo"; exit 1; fi 2024-03-27T07:25:14.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:14 smithi149 ceph-mon[36065]: pgmap v52: 97 pgs: 97 active+clean; 2.6 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 129 KiB/s wr, 22 op/s 2024-03-27T07:25:14.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:14 smithi153 ceph-mon[36179]: pgmap v52: 97 pgs: 97 active+clean; 2.6 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 129 KiB/s wr, 22 op/s 2024-03-27T07:25:14.556 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT fakesnprintf.o -MD -MP -MF ".deps/fakesnprintf.Tpo" -c -o fakesnprintf.o fakesnprintf.c; \ 2024-03-27T07:25:14.557 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/fakesnprintf.Tpo" ".deps/fakesnprintf.Po"; else rm -f ".deps/fakesnprintf.Tpo"; exit 1; fi 2024-03-27T07:25:14.617 INFO:tasks.workunit.client.0.smithi082.stdout:if gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -MT mysnprintf.o -MD -MP -MF ".deps/mysnprintf.Tpo" -c -o mysnprintf.o mysnprintf.c; \ 2024-03-27T07:25:14.617 INFO:tasks.workunit.client.0.smithi082.stdout:then mv -f ".deps/mysnprintf.Tpo" ".deps/mysnprintf.Po"; else rm -f ".deps/mysnprintf.Tpo"; exit 1; fi 2024-03-27T07:25:14.674 INFO:tasks.workunit.client.0.smithi082.stdout:gcc -g -O2 -o blogbench blogbench.o process.o writer.o rewriter.o reader.o commenter.o helpers.o bsd-getopt_long.o fakesnprintf.o mysnprintf.o 2024-03-27T07:25:14.694 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/src' 2024-03-27T07:25:14.694 INFO:tasks.workunit.client.0.smithi082.stdout:Making all in man 2024-03-27T07:25:14.701 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-03-27T07:25:14.702 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Nothing to be done for 'all'. 2024-03-27T07:25:14.702 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0/man' 2024-03-27T07:25:14.703 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-03-27T07:25:14.704 INFO:tasks.workunit.client.0.smithi082.stdout:make[2]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-03-27T07:25:14.704 INFO:tasks.workunit.client.0.smithi082.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/blogbench-1.0' 2024-03-27T07:25:14.704 INFO:tasks.workunit.client.0.smithi082.stderr:+ cd src 2024-03-27T07:25:14.705 INFO:tasks.workunit.client.0.smithi082.stderr:+ mkdir blogtest_in 2024-03-27T07:25:14.708 INFO:tasks.workunit.client.0.smithi082.stdout:running blogbench 2024-03-27T07:25:14.709 INFO:tasks.workunit.client.0.smithi082.stderr:+ echo 'running blogbench' 2024-03-27T07:25:14.709 INFO:tasks.workunit.client.0.smithi082.stderr:+ ./blogbench -d blogtest_in 2024-03-27T07:25:14.709 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-03-27T07:25:14.709 INFO:tasks.workunit.client.0.smithi082.stdout:Frequency = 10 secs 2024-03-27T07:25:14.709 INFO:tasks.workunit.client.0.smithi082.stdout:Scratch dir = [blogtest_in] 2024-03-27T07:25:15.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:25:15.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:25:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.146+0000 7fc0345d7640 1 -- 172.21.15.82:0/3145380280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc02c100d30 msgr2=0x7fc02c101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.146+0000 7fc0345d7640 1 --2- 172.21.15.82:0/3145380280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc02c100d30 0x7fc02c101190 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc020009900 tx=0x7fc02002bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.146+0000 7fc0345d7640 1 -- 172.21.15.82:0/3145380280 shutdown_connections 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.146+0000 7fc0345d7640 1 --2- 172.21.15.82:0/3145380280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc02c100d30 0x7fc02c101190 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.146+0000 7fc0345d7640 1 --2- 172.21.15.82:0/3145380280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc02c1016d0 0x7fc02c10d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.146+0000 7fc0345d7640 1 --2- 172.21.15.82:0/3145380280 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc02c106a80 0x7fc02c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.146+0000 7fc0345d7640 1 -- 172.21.15.82:0/3145380280 >> 172.21.15.82:0/3145380280 conn(0x7fc02c077810 msgr2=0x7fc02c077c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.146+0000 7fc0345d7640 1 -- 172.21.15.82:0/3145380280 shutdown_connections 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.146+0000 7fc0345d7640 1 -- 172.21.15.82:0/3145380280 wait complete. 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc0345d7640 1 Processor -- start 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc0345d7640 1 -- start start 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc0345d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc02c100d30 0x7fc02c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc0345d7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc02c1016d0 0x7fc02c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc0345d7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc02c106a80 0x7fc02c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc0345d7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c110dc0 con 0x7fc02c100d30 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc0345d7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c110c40 con 0x7fc02c106a80 2024-03-27T07:25:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc0345d7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c110f40 con 0x7fc02c1016d0 2024-03-27T07:25:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc032373640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc02c100d30 0x7fc02c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc032373640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc02c100d30 0x7fc02c198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58068/0 (socket says 172.21.15.82:58068) 2024-03-27T07:25:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc032373640 1 -- 172.21.15.82:0/125934731 learned_addr learned my addr 172.21.15.82:0/125934731 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc031b72640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc02c1016d0 0x7fc02c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc032b74640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc02c106a80 0x7fc02c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc032373640 1 -- 172.21.15.82:0/125934731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc02c1016d0 msgr2=0x7fc02c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc032373640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc02c1016d0 0x7fc02c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc032373640 1 -- 172.21.15.82:0/125934731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc02c106a80 msgr2=0x7fc02c19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.147+0000 7fc032373640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc02c106a80 0x7fc02c19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.148+0000 7fc032373640 1 -- 172.21.15.82:0/125934731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c19d310 con 0x7fc02c100d30 2024-03-27T07:25:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.148+0000 7fc032373640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc02c100d30 0x7fc02c198320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc02400db80 tx=0x7fc02400b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.148+0000 7fc02b7fe640 1 -- 172.21.15.82:0/125934731 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024017070 con 0x7fc02c100d30 2024-03-27T07:25:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.148+0000 7fc02b7fe640 1 -- 172.21.15.82:0/125934731 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc024003b70 con 0x7fc02c100d30 2024-03-27T07:25:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.148+0000 7fc0345d7640 1 -- 172.21.15.82:0/125934731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c19d600 con 0x7fc02c100d30 2024-03-27T07:25:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.148+0000 7fc02b7fe640 1 -- 172.21.15.82:0/125934731 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0240106c0 con 0x7fc02c100d30 2024-03-27T07:25:15.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.148+0000 7fc0345d7640 1 -- 172.21.15.82:0/125934731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c1a4e90 con 0x7fc02c100d30 2024-03-27T07:25:15.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.151+0000 7fc02b7fe640 1 -- 172.21.15.82:0/125934731 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fc024004020 con 0x7fc02c100d30 2024-03-27T07:25:15.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.151+0000 7fc0371c1740 1 Processor -- start 2024-03-27T07:25:15.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.151+0000 7fc0371c1740 1 -- start start 2024-03-27T07:25:15.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.151+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcf9a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.151+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcf9ab70 0x560cfcfa3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.151+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcfa3750 0x560cfcfa5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.151+0000 7fc0371c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560cfcefe860 con 0x560cfcfa3750 2024-03-27T07:25:15.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.151+0000 7fc0371c1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x560cfcea68d0 con 0x560cfcf9ab70 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.151+0000 7fc0371c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560cfcefa810 con 0x560cfcf9a250 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.151+0000 7fc02b7fe640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc0140a3780 0x7fc0140a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc032373640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcf9ab70 0x560cfcfa3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc031b72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcfa3750 0x560cfcfa5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc032b74640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcf9a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc031b72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcfa3750 0x560cfcfa5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58078/0 (socket says 172.21.15.82:58078) 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc031b72640 1 -- 172.21.15.82:0/2527465660 learned_addr learned my addr 172.21.15.82:0/2527465660 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc032b74640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc0140a3780 0x7fc0140a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc02b7fe640 1 -- 172.21.15.82:0/125934731 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fc0240cfde0 con 0x7fc02c100d30 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc031b72640 1 -- 172.21.15.82:0/2527465660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 msgr2=0x560cfcf9a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc031b72640 1 --2- 172.21.15.82:0/2527465660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcf9a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc031b72640 1 -- 172.21.15.82:0/2527465660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcf9ab70 msgr2=0x560cfcfa3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc031b72640 1 --2- 172.21.15.82:0/2527465660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcf9ab70 0x560cfcfa3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc031b72640 1 -- 172.21.15.82:0/2527465660 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfceb1120 con 0x560cfcfa3750 2024-03-27T07:25:15.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc032373640 1 --2- 172.21.15.82:0/2527465660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcf9ab70 0x560cfcfa3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:15.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc032b74640 1 --2- 172.21.15.82:0/2527465660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcf9a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:15.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc031b72640 1 --2- 172.21.15.82:0/2527465660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcfa3750 0x560cfcfa5b40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc02002cfd0 tx=0x7fc020005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f17a02533dfc6a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc032b74640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc0140a3780 0x7fc0140a5c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009710 tx=0x7fc01c005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc028bfe640 1 -- 172.21.15.82:0/2527465660 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020042070 con 0x560cfcfa3750 2024-03-27T07:25:15.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc028bfe640 1 -- 172.21.15.82:0/2527465660 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc02002ca80 con 0x560cfcfa3750 2024-03-27T07:25:15.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.152+0000 7fc028bfe640 1 -- 172.21.15.82:0/2527465660 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020004c70 con 0x560cfcfa3750 2024-03-27T07:25:15.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 -- 172.21.15.82:0/2527465660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcfa3750 msgr2=0x560cfcfa5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 --2- 172.21.15.82:0/2527465660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcfa3750 0x560cfcfa5b40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc02002cfd0 tx=0x7fc020005c00 comp rx=0 tx=0).stop 2024-03-27T07:25:15.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 -- 172.21.15.82:0/2527465660 shutdown_connections 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 --2- 172.21.15.82:0/2527465660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcfa3750 0x560cfcfa5b40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 --2- 172.21.15.82:0/2527465660 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcf9ab70 0x560cfcfa3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 --2- 172.21.15.82:0/2527465660 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcf9a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 -- 172.21.15.82:0/2527465660 >> 172.21.15.82:0/2527465660 conn(0x560cfcf94980 msgr2=0x560cfcf94d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 -- 172.21.15.82:0/2527465660 shutdown_connections 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 -- 172.21.15.82:0/2527465660 wait complete. 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 -- start start 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.153+0000 7fc0371c1740 1 Processor -- start 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcfa06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfa0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcfa1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc0371c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560cfcfa64e0 con 0x560cfcf9ab70 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc0371c1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x560cfceb9cd0 con 0x560cfcfa3750 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc0371c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x560cfcfa6660 con 0x560cfcf9a250 2024-03-27T07:25:15.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc0371c1740 10 client.0 _ll_register_callbacks cb 0x560cfceabee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc031b72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfa0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc031b72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfa0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58088/0 (socket says 172.21.15.82:58088) 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc031b72640 1 -- 172.21.15.82:0/1825300255 learned_addr learned my addr 172.21.15.82:0/1825300255 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc032373640 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcfa06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc032b74640 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcfa1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc031b72640 1 -- 172.21.15.82:0/1825300255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 msgr2=0x560cfcfa06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc031b72640 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcfa06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc031b72640 1 -- 172.21.15.82:0/1825300255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 msgr2=0x560cfcfa1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc031b72640 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcfa1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc031b72640 1 -- 172.21.15.82:0/1825300255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cfccdc7d0 con 0x560cfcf9ab70 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc031b72640 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfa0c20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc02002c170 tx=0x7fc0200092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fca2afd84717e38 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc011ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc011ffb640 1 -- 172.21.15.82:0/1825300255 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02004b070 con 0x560cfcf9ab70 2024-03-27T07:25:15.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc011ffb640 1 -- 172.21.15.82:0/1825300255 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fc020004240 con 0x560cfcf9ab70 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.154+0000 7fc0371c1740 1 -- 172.21.15.82:0/1825300255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc02002ca80 con 0x560cfcf9ab70 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc011ffb640 1 -- 172.21.15.82:0/1825300255 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc020057050 con 0x560cfcf9ab70 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc0371c1740 10 client.15876 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc0371c1740 1 -- 172.21.15.82:0/1825300255 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560cfcc123f0 con 0x560cfcf9ab70 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc011ffb640 1 -- 172.21.15.82:0/1825300255 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc02002ca80 con 0x560cfcf9ab70 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc011ffb640 1 -- 172.21.15.82:0/1825300255 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fc020003790 con 0x560cfcf9ab70 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc0371c1740 10 client.15876 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc0371c1740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc0371c1740 20 client.15876 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x560cfcfb3860 0x560cfcfb5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc0371c1740 4 client.15876 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc0371c1740 1 -- 172.21.15.82:0/1825300255 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560cfcf0bda0 con 0x560cfcfb3860 2024-03-27T07:25:15.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.155+0000 7fc032373640 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x560cfcfb3860 0x560cfcfb5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc011ffb640 10 client.15876 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc032373640 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x560cfcfb3860 0x560cfcfb5c50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c66a1b13a83ddb server_cookie=c885a4b659ee1cc8 in_seq=0 out_seq=0 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc011ffb640 1 -- 172.21.15.82:0/1825300255 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x560cfcf0bda0 con 0x560cfcfb3860 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc011ffb640 10 client.15876 handle_command_reply: tid=0 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 client.15876 shutdown 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 -- 172.21.15.82:0/1825300255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 msgr2=0x560cfcfa0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfa0c20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc02002c170 tx=0x7fc0200092b0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 -- 172.21.15.82:0/1825300255 shutdown_connections 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x560cfcfb3860 0x560cfcfb5c50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfa0c20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc011ffb640 0 client.15876 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcfa1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1825300255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcfa06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 -- 172.21.15.82:0/1825300255 >> 172.21.15.82:0/1825300255 conn(0x560cfcf94980 msgr2=0x560cfcf966d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 -- 172.21.15.82:0/1825300255 shutdown_connections 2024-03-27T07:25:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.156+0000 7fc0371c1740 1 -- 172.21.15.82:0/1825300255 wait complete. 2024-03-27T07:25:15.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.157+0000 7fc0371c1740 20 client.15876 trim_cache size 0 max 16384 2024-03-27T07:25:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc0371c1740 1 Processor -- start 2024-03-27T07:25:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc0371c1740 1 -- start start 2024-03-27T07:25:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9a250 0x560cfcfa2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9ab70 0x560cfcfabc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcf9f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc0371c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1afe60 con 0x560cfcf9a250 2024-03-27T07:25:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc0371c1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1ad730 con 0x560cfcfa3750 2024-03-27T07:25:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc0371c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1ab580 con 0x560cfcf9ab70 2024-03-27T07:25:15.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc032373640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9a250 0x560cfcfa2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc032373640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9a250 0x560cfcfa2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58092/0 (socket says 172.21.15.82:58092) 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc032373640 1 -- 172.21.15.82:0/671237811 learned_addr learned my addr 172.21.15.82:0/671237811 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc031b72640 1 --2- 172.21.15.82:0/671237811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9ab70 0x560cfcfabc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.174+0000 7fc032b74640 1 --2- 172.21.15.82:0/671237811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcf9f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc032373640 1 -- 172.21.15.82:0/671237811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9ab70 msgr2=0x560cfcfabc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc032373640 1 --2- 172.21.15.82:0/671237811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9ab70 0x560cfcfabc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc032373640 1 -- 172.21.15.82:0/671237811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 msgr2=0x560cfcf9f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc032373640 1 --2- 172.21.15.82:0/671237811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcf9f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc032373640 1 -- 172.21.15.82:0/671237811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560cfcbd20f0 con 0x560cfcf9a250 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc032373640 1 --2- 172.21.15.82:0/671237811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9a250 0x560cfcfa2e10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc0240cdb80 tx=0x7fc02406eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dabbdd475cb0a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc013fff640 1 -- 172.21.15.82:0/671237811 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0240a4c30 con 0x560cfcf9a250 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc013fff640 1 -- 172.21.15.82:0/671237811 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc024004310 con 0x560cfcf9a250 2024-03-27T07:25:15.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc013fff640 1 -- 172.21.15.82:0/671237811 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024098630 con 0x560cfcf9a250 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc0371c1740 1 -- 172.21.15.82:0/671237811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9a250 msgr2=0x560cfcfa2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc0371c1740 1 --2- 172.21.15.82:0/671237811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9a250 0x560cfcfa2e10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc0240cdb80 tx=0x7fc02406eca0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc0371c1740 1 -- 172.21.15.82:0/671237811 shutdown_connections 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc0371c1740 1 --2- 172.21.15.82:0/671237811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcf9f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc0371c1740 1 --2- 172.21.15.82:0/671237811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9ab70 0x560cfcfabc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc0371c1740 1 --2- 172.21.15.82:0/671237811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9a250 0x560cfcfa2e10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc0371c1740 1 -- 172.21.15.82:0/671237811 >> 172.21.15.82:0/671237811 conn(0x560cfcf94980 msgr2=0x560cfcfa06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc0371c1740 1 -- 172.21.15.82:0/671237811 shutdown_connections 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.175+0000 7fc0371c1740 1 -- 172.21.15.82:0/671237811 wait complete. 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc0371c1740 1 -- start start 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc0371c1740 1 Processor -- start 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcf9e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfba970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc0371c1740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcfbaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc0371c1740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1abbf0 con 0x560cfcf9ab70 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc0371c1740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1ad060 con 0x560cfcfa3750 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc0371c1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1ac2c0 con 0x560cfcf9a250 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc0371c1740 10 client.0 _ll_register_callbacks cb 0x7fc01c009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc031b72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfba970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc031b72640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfba970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58094/0 (socket says 172.21.15.82:58094) 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc031b72640 1 -- 172.21.15.82:0/1347062017 learned_addr learned my addr 172.21.15.82:0/1347062017 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc032373640 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcf9e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc032b74640 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcfbaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc031b72640 1 -- 172.21.15.82:0/1347062017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 msgr2=0x560cfcf9e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc031b72640 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcf9e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc031b72640 1 -- 172.21.15.82:0/1347062017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 msgr2=0x560cfcfbaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc031b72640 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcfbaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc031b72640 1 -- 172.21.15.82:0/1347062017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560cfcfbb6e0 con 0x560cfcf9ab70 2024-03-27T07:25:15.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc031b72640 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfba970 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc020006010 tx=0x7fc020005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8815851859e6fc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.176+0000 7fc011ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc011ffb640 1 -- 172.21.15.82:0/1347062017 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020054070 con 0x560cfcf9ab70 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc011ffb640 1 -- 172.21.15.82:0/1347062017 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fc020004240 con 0x560cfcf9ab70 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc0371c1740 1 -- 172.21.15.82:0/1347062017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc024004310 con 0x560cfcf9ab70 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc011ffb640 1 -- 172.21.15.82:0/1347062017 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc020063050 con 0x560cfcf9ab70 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc0371c1740 10 client.15882 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc0371c1740 1 -- 172.21.15.82:0/1347062017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x560cfd01d9a0 con 0x560cfcf9ab70 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc011ffb640 1 -- 172.21.15.82:0/1347062017 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc024004310 con 0x560cfcf9ab70 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc011ffb640 1 -- 172.21.15.82:0/1347062017 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fc020004f30 con 0x560cfcf9ab70 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc0371c1740 10 client.15882 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc0371c1740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc0371c1740 20 client.15882 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:15.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x560cfd01e000 0x560cfd020420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc0371c1740 4 client.15882 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc0371c1740 1 -- 172.21.15.82:0/1347062017 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560cfcf060f0 con 0x560cfd01e000 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.177+0000 7fc032373640 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x560cfd01e000 0x560cfd020420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc011ffb640 10 client.15882 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc032373640 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x560cfd01e000 0x560cfd020420 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34754795ad88ead2 server_cookie=3d273fe7c30cf317 in_seq=0 out_seq=0 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc011ffb640 1 -- 172.21.15.82:0/1347062017 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560cfcf060f0 con 0x560cfd01e000 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc011ffb640 10 client.15882 handle_command_reply: tid=0 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 client.15882 shutdown 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 -- 172.21.15.82:0/1347062017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 msgr2=0x560cfcfba970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfba970 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc020006010 tx=0x7fc020005dd0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 -- 172.21.15.82:0/1347062017 shutdown_connections 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x560cfd01e000 0x560cfd020420 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560cfcf9ab70 0x560cfcfba970 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc011ffb640 0 client.15882 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:15.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x560cfcfa3750 0x560cfcfbaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 --2- 172.21.15.82:0/1347062017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x560cfcf9a250 0x560cfcf9e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 -- 172.21.15.82:0/1347062017 >> 172.21.15.82:0/1347062017 conn(0x560cfcf94980 msgr2=0x560cfcf9f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 -- 172.21.15.82:0/1347062017 shutdown_connections 2024-03-27T07:25:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 1 -- 172.21.15.82:0/1347062017 wait complete. 2024-03-27T07:25:15.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0371c1740 20 client.15882 trim_cache size 0 max 16384 2024-03-27T07:25:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:25:15.188 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-03-27T07:25:15.188 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-03-27T07:25:15.188 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:25:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0345d7640 1 -- 172.21.15.82:0/125934731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc0140a3780 msgr2=0x7fc0140a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0345d7640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc0140a3780 0x7fc0140a5c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009710 tx=0x7fc01c005f90 comp rx=0 tx=0).stop 2024-03-27T07:25:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0345d7640 1 -- 172.21.15.82:0/125934731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc02c100d30 msgr2=0x7fc02c198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.178+0000 7fc0345d7640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc02c100d30 0x7fc02c198320 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc02400db80 tx=0x7fc02400b630 comp rx=0 tx=0).stop 2024-03-27T07:25:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.179+0000 7fc0345d7640 1 -- 172.21.15.82:0/125934731 shutdown_connections 2024-03-27T07:25:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.179+0000 7fc0345d7640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc0140a3780 0x7fc0140a5c40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.179+0000 7fc0345d7640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc02c106a80 0x7fc02c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.179+0000 7fc0345d7640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc02c1016d0 0x7fc02c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.179+0000 7fc0345d7640 1 --2- 172.21.15.82:0/125934731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc02c100d30 0x7fc02c198320 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.179+0000 7fc0345d7640 1 -- 172.21.15.82:0/125934731 >> 172.21.15.82:0/125934731 conn(0x7fc02c077810 msgr2=0x7fc02c100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.179+0000 7fc0345d7640 1 -- 172.21.15.82:0/125934731 shutdown_connections 2024-03-27T07:25:15.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.179+0000 7fc0345d7640 1 -- 172.21.15.82:0/125934731 wait complete. 2024-03-27T07:25:15.191 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T07:25:15.192 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:25:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.291+0000 7f103fb5e640 1 -- 172.21.15.82:0/3696543924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038103780 msgr2=0x7f103810bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.291+0000 7f103fb5e640 1 --2- 172.21.15.82:0/3696543924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038103780 0x7f103810bc60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1028009900 tx=0x7f102802bcd0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.291+0000 7f103fb5e640 1 -- 172.21.15.82:0/3696543924 shutdown_connections 2024-03-27T07:25:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.291+0000 7f103fb5e640 1 --2- 172.21.15.82:0/3696543924 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038103780 0x7f103810bc60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.291+0000 7f103fb5e640 1 --2- 172.21.15.82:0/3696543924 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f103810c1a0 0x7f103810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.291+0000 7f103fb5e640 1 --2- 172.21.15.82:0/3696543924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1038102e60 0x7f1038103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.291+0000 7f103fb5e640 1 -- 172.21.15.82:0/3696543924 >> 172.21.15.82:0/3696543924 conn(0x7f1038077bb0 msgr2=0x7f1038077fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.291+0000 7f103fb5e640 1 -- 172.21.15.82:0/3696543924 shutdown_connections 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.291+0000 7f103fb5e640 1 -- 172.21.15.82:0/3696543924 wait complete. 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103fb5e640 1 Processor -- start 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103fb5e640 1 -- start start 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103fb5e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038102e60 0x7f1038198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103fb5e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1038103780 0x7f1038198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103fb5e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f103810c1a0 0x7f103819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103fb5e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1038111f70 con 0x7f1038102e60 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103fb5e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1038111df0 con 0x7f1038103780 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103fb5e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10381120f0 con 0x7f103810c1a0 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103d8fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038102e60 0x7f1038198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103d8fa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038102e60 0x7f1038198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58106/0 (socket says 172.21.15.82:58106) 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103d8fa640 1 -- 172.21.15.82:0/1518442299 learned_addr learned my addr 172.21.15.82:0/1518442299 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103d0f9640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1038103780 0x7f1038198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.292+0000 7f103e0fb640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f103810c1a0 0x7f103819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f103d8fa640 1 -- 172.21.15.82:0/1518442299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f103810c1a0 msgr2=0x7f103819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f103d8fa640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f103810c1a0 0x7f103819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f103d8fa640 1 -- 172.21.15.82:0/1518442299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1038103780 msgr2=0x7f1038198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f103d8fa640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1038103780 0x7f1038198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f103d8fa640 1 -- 172.21.15.82:0/1518442299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103819d500 con 0x7f1038102e60 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f103d8fa640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038102e60 0x7f1038198510 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f103400e9f0 tx=0x7f103400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f102effd640 1 -- 172.21.15.82:0/1518442299 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103400ccc0 con 0x7f1038102e60 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f103fb5e640 1 -- 172.21.15.82:0/1518442299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103819d7f0 con 0x7f1038102e60 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f102effd640 1 -- 172.21.15.82:0/1518442299 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1034010910 con 0x7f1038102e60 2024-03-27T07:25:15.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f102effd640 1 -- 172.21.15.82:0/1518442299 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10340188a0 con 0x7f1038102e60 2024-03-27T07:25:15.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.293+0000 7f103fb5e640 1 -- 172.21.15.82:0/1518442299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10381a5080 con 0x7f1038102e60 2024-03-27T07:25:15.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.294+0000 7f103fb5e640 1 -- 172.21.15.82:0/1518442299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1038068d90 con 0x7f1038102e60 2024-03-27T07:25:15.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.295+0000 7f102effd640 1 -- 172.21.15.82:0/1518442299 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f1034010ac0 con 0x7f1038102e60 2024-03-27T07:25:15.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.295+0000 7f102effd640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10240a3780 0x7f10240a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.295+0000 7f103d0f9640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10240a3780 0x7f10240a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.295+0000 7f102effd640 1 -- 172.21.15.82:0/1518442299 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f10340d0500 con 0x7f1038102e60 2024-03-27T07:25:15.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.296+0000 7f103d0f9640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10240a3780 0x7f10240a5c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f102802efd0 tx=0x7f102802cf90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.300+0000 7f102effd640 1 -- 172.21.15.82:0/1518442299 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f103409cde0 con 0x7f1038102e60 2024-03-27T07:25:15.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.515+0000 7f103fb5e640 1 -- 172.21.15.82:0/1518442299 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1038107320 con 0x7f1038102e60 2024-03-27T07:25:15.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.515+0000 7f102effd640 1 -- 172.21.15.82:0/1518442299 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+11860 (secure 0 0 0) 0x7f103409c6e0 con 0x7f1038102e60 2024-03-27T07:25:15.518 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:25:15.518 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:23:33.807990+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:25:15.518 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 22 2024-03-27T07:25:15.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 -- 172.21.15.82:0/1518442299 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10240a3780 msgr2=0x7f10240a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10240a3780 0x7f10240a5c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f102802efd0 tx=0x7f102802cf90 comp rx=0 tx=0).stop 2024-03-27T07:25:15.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 -- 172.21.15.82:0/1518442299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038102e60 msgr2=0x7f1038198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038102e60 0x7f1038198510 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f103400e9f0 tx=0x7f103400edf0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 -- 172.21.15.82:0/1518442299 shutdown_connections 2024-03-27T07:25:15.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10240a3780 0x7f10240a5c40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f103810c1a0 0x7f103819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1038103780 0x7f1038198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 --2- 172.21.15.82:0/1518442299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1038102e60 0x7f1038198510 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 -- 172.21.15.82:0/1518442299 >> 172.21.15.82:0/1518442299 conn(0x7f1038077bb0 msgr2=0x7f10380fef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 -- 172.21.15.82:0/1518442299 shutdown_connections 2024-03-27T07:25:15.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.518+0000 7f103fb5e640 1 -- 172.21.15.82:0/1518442299 wait complete. 2024-03-27T07:25:15.532 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T07:25:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.633+0000 7f3ca82af640 1 -- 172.21.15.82:0/3252377980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca0101ae0 msgr2=0x7f3ca0101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.633+0000 7f3ca82af640 1 --2- 172.21.15.82:0/3252377980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca0101ae0 0x7f3ca0101f60 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009930 tx=0x7f3c9002bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.633+0000 7f3ca82af640 1 -- 172.21.15.82:0/3252377980 shutdown_connections 2024-03-27T07:25:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.633+0000 7f3ca82af640 1 --2- 172.21.15.82:0/3252377980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca0101ae0 0x7f3ca0101f60 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.633+0000 7f3ca82af640 1 --2- 172.21.15.82:0/3252377980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ca01024a0 0x7f3ca010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.633+0000 7f3ca82af640 1 --2- 172.21.15.82:0/3252377980 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca0107b80 0x7f3ca0107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.633+0000 7f3ca82af640 1 -- 172.21.15.82:0/3252377980 >> 172.21.15.82:0/3252377980 conn(0x7f3ca0078f50 msgr2=0x7f3ca0079360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.633+0000 7f3ca82af640 1 -- 172.21.15.82:0/3252377980 shutdown_connections 2024-03-27T07:25:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.633+0000 7f3ca82af640 1 -- 172.21.15.82:0/3252377980 wait complete. 2024-03-27T07:25:15.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca82af640 1 Processor -- start 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca82af640 1 -- start start 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca82af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca0101ae0 0x7f3ca0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca82af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ca01024a0 0x7f3ca01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca82af640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca0107b80 0x7f3ca019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca82af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0111ed0 con 0x7f3ca0101ae0 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca82af640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0111d50 con 0x7f3ca0107b80 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca82af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca0112050 con 0x7f3ca01024a0 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca604b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca0101ae0 0x7f3ca0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca604b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca0101ae0 0x7f3ca0198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58124/0 (socket says 172.21.15.82:58124) 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca604b640 1 -- 172.21.15.82:0/1774830049 learned_addr learned my addr 172.21.15.82:0/1774830049 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca584a640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ca01024a0 0x7f3ca01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca684c640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca0107b80 0x7f3ca019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca604b640 1 -- 172.21.15.82:0/1774830049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ca01024a0 msgr2=0x7f3ca01989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca604b640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ca01024a0 0x7f3ca01989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca604b640 1 -- 172.21.15.82:0/1774830049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca0107b80 msgr2=0x7f3ca019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca604b640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca0107b80 0x7f3ca019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.634+0000 7f3ca604b640 1 -- 172.21.15.82:0/1774830049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca019d410 con 0x7f3ca0101ae0 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.635+0000 7f3ca604b640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca0101ae0 0x7f3ca0198470 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00ea60 tx=0x7f3c9c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.635+0000 7f3c977fe640 1 -- 172.21.15.82:0/1774830049 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00cde0 con 0x7f3ca0101ae0 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.635+0000 7f3c977fe640 1 -- 172.21.15.82:0/1774830049 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c9c0035f0 con 0x7f3ca0101ae0 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.635+0000 7f3ca82af640 1 -- 172.21.15.82:0/1774830049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca019d700 con 0x7f3ca0101ae0 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.635+0000 7f3c977fe640 1 -- 172.21.15.82:0/1774830049 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c010670 con 0x7f3ca0101ae0 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.635+0000 7f3ca82af640 1 -- 172.21.15.82:0/1774830049 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca01a4f90 con 0x7f3ca0101ae0 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3c977fe640 1 -- 172.21.15.82:0/1774830049 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f3c9c0037a0 con 0x7f3ca0101ae0 2024-03-27T07:25:15.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3caaf73740 1 Processor -- start 2024-03-27T07:25:15.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3caaf73740 1 -- start start 2024-03-27T07:25:15.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa71c7b0 0x5629fa71cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71d0d0 0x5629fa725770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa725cb0 0x5629fa7280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3caaf73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5629fa680710 con 0x5629fa71c7b0 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3caaf73740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5629fa628af0 con 0x5629fa71d0d0 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3caaf73740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5629fa67c6c0 con 0x5629fa725cb0 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3ca684c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa71c7b0 0x5629fa71cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3c977fe640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c8c0a3780 0x7f3c8c0a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.638+0000 7f3ca604b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71d0d0 0x5629fa725770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca684c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa71c7b0 0x5629fa71cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58130/0 (socket says 172.21.15.82:58130) 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca684c640 1 -- 172.21.15.82:0/1424968468 learned_addr learned my addr 172.21.15.82:0/1424968468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca584a640 1 --2- 172.21.15.82:0/1424968468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa725cb0 0x5629fa7280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca684c640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c8c0a3780 0x7f3c8c0a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3c977fe640 1 -- 172.21.15.82:0/1774830049 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f3c9c0d0340 con 0x7f3ca0101ae0 2024-03-27T07:25:15.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca584a640 1 -- 172.21.15.82:0/1424968468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71d0d0 msgr2=0x5629fa725770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca584a640 1 --2- 172.21.15.82:0/1424968468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71d0d0 0x5629fa725770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca584a640 1 -- 172.21.15.82:0/1424968468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa71c7b0 msgr2=0x5629fa71cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca584a640 1 --2- 172.21.15.82:0/1424968468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa71c7b0 0x5629fa71cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca584a640 1 -- 172.21.15.82:0/1424968468 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629fa3943f0 con 0x5629fa725cb0 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca684c640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c8c0a3780 0x7f3c8c0a5c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c980099e0 tx=0x7f3c98004ab0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3ca584a640 1 --2- 172.21.15.82:0/1424968468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa725cb0 0x5629fa7280a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009230 tx=0x7f3c90009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2f39e09644e5697 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3c94bfe640 1 -- 172.21.15.82:0/1424968468 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90042070 con 0x5629fa725cb0 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3c94bfe640 1 -- 172.21.15.82:0/1424968468 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c90004030 con 0x5629fa725cb0 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.639+0000 7f3c94bfe640 1 -- 172.21.15.82:0/1424968468 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90004b20 con 0x5629fa725cb0 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.640+0000 7f3caaf73740 1 -- 172.21.15.82:0/1424968468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa725cb0 msgr2=0x5629fa7280a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.640+0000 7f3caaf73740 1 --2- 172.21.15.82:0/1424968468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa725cb0 0x5629fa7280a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009230 tx=0x7f3c90009610 comp rx=0 tx=0).stop 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.640+0000 7f3caaf73740 1 -- 172.21.15.82:0/1424968468 shutdown_connections 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.640+0000 7f3caaf73740 1 --2- 172.21.15.82:0/1424968468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa725cb0 0x5629fa7280a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.640+0000 7f3caaf73740 1 --2- 172.21.15.82:0/1424968468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71d0d0 0x5629fa725770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.640+0000 7f3caaf73740 1 --2- 172.21.15.82:0/1424968468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa71c7b0 0x5629fa71cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.640+0000 7f3caaf73740 1 -- 172.21.15.82:0/1424968468 >> 172.21.15.82:0/1424968468 conn(0x5629fa716ee0 msgr2=0x5629fa7172c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.640+0000 7f3caaf73740 1 -- 172.21.15.82:0/1424968468 shutdown_connections 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.640+0000 7f3caaf73740 1 -- 172.21.15.82:0/1424968468 wait complete. 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.640+0000 7f3caaf73740 1 -- start start 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3caaf73740 1 Processor -- start 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71c7b0 0x5629fa722cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71d0d0 0x5629fa7231f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa723730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3caaf73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5629fa728a40 con 0x5629fa725cb0 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3caaf73740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5629fa63beb0 con 0x5629fa71d0d0 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3caaf73740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5629fa728bc0 con 0x5629fa71c7b0 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3caaf73740 10 client.0 _ll_register_callbacks cb 0x5629fa6786a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:15.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca684c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa723730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca604b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71c7b0 0x5629fa722cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca684c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa723730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58146/0 (socket says 172.21.15.82:58146) 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca604b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71c7b0 0x5629fa722cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37042/0 (socket says 172.21.15.82:37042) 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca684c640 1 -- 172.21.15.82:0/3918834834 learned_addr learned my addr 172.21.15.82:0/3918834834 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca584a640 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71d0d0 0x5629fa7231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca684c640 1 -- 172.21.15.82:0/3918834834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71c7b0 msgr2=0x5629fa722cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca684c640 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71c7b0 0x5629fa722cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca684c640 1 -- 172.21.15.82:0/3918834834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71d0d0 msgr2=0x5629fa7231f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca684c640 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71d0d0 0x5629fa7231f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca684c640 1 -- 172.21.15.82:0/3918834834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629fa45e7d0 con 0x5629fa725cb0 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca604b640 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71c7b0 0x5629fa722cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3ca684c640 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa723730 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3c98003ba0 tx=0x7f3c98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5d98d1d642fab6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3c89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3c89ffb640 1 -- 172.21.15.82:0/3918834834 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98003c90 con 0x5629fa725cb0 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.641+0000 7f3c89ffb640 1 -- 172.21.15.82:0/3918834834 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f3c980045c0 con 0x5629fa725cb0 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3caaf73740 1 -- 172.21.15.82:0/3918834834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c90004030 con 0x5629fa725cb0 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3c89ffb640 1 -- 172.21.15.82:0/3918834834 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3c98003e30 con 0x5629fa725cb0 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3caaf73740 10 client.15900 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3caaf73740 1 -- 172.21.15.82:0/3918834834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5629fa734d30 con 0x5629fa725cb0 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3c89ffb640 1 -- 172.21.15.82:0/3918834834 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c90004030 con 0x5629fa725cb0 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3c89ffb640 1 -- 172.21.15.82:0/3918834834 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f3c980056d0 con 0x5629fa725cb0 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3caaf73740 10 client.15900 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3caaf73740 10 client.15900 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3caaf73740 20 client.15900 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3caaf73740 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x5629fa736240 0x5629fa7386c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3caaf73740 4 client.15900 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3caaf73740 1 -- 172.21.15.82:0/3918834834 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629fa68dc50 con 0x5629fa736240 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.642+0000 7f3ca604b640 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x5629fa736240 0x5629fa7386c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.643+0000 7f3c89ffb640 10 client.15900 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.643+0000 7f3ca604b640 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x5629fa736240 0x5629fa7386c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=914597de1ad6e0ba server_cookie=bf0a08745b3ce053 in_seq=0 out_seq=0 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3c89ffb640 1 -- 172.21.15.82:0/3918834834 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5629fa68dc50 con 0x5629fa736240 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3c89ffb640 10 client.15900 handle_command_reply: tid=0 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 client.15900 shutdown 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 -- 172.21.15.82:0/3918834834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 msgr2=0x5629fa723730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa723730 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3c98003ba0 tx=0x7f3c98004a40 comp rx=0 tx=0).stop 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 -- 172.21.15.82:0/3918834834 shutdown_connections 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x5629fa736240 0x5629fa7386c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa723730 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71d0d0 0x5629fa7231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3c89ffb640 0 client.15900 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:25:15.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 --2- 172.21.15.82:0/3918834834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71c7b0 0x5629fa722cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 -- 172.21.15.82:0/3918834834 >> 172.21.15.82:0/3918834834 conn(0x5629fa716ee0 msgr2=0x5629fa718c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 -- 172.21.15.82:0/3918834834 shutdown_connections 2024-03-27T07:25:15.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 1 -- 172.21.15.82:0/3918834834 wait complete. 2024-03-27T07:25:15.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.644+0000 7f3caaf73740 20 client.15900 trim_cache size 0 max 16384 2024-03-27T07:25:15.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3caaf73740 1 Processor -- start 2024-03-27T07:25:15.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3caaf73740 1 -- start start 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71c7b0 0x5629fa7253e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71d0d0 0x5629fa731810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa715e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3caaf73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca01aff90 con 0x5629fa725cb0 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3caaf73740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca01ad860 con 0x5629fa71c7b0 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3caaf73740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca01ab6b0 con 0x5629fa71d0d0 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3ca684c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa715e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3ca684c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa715e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58154/0 (socket says 172.21.15.82:58154) 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3ca684c640 1 -- 172.21.15.82:0/2376992939 learned_addr learned my addr 172.21.15.82:0/2376992939 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3ca604b640 1 --2- 172.21.15.82:0/2376992939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71c7b0 0x5629fa7253e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3ca584a640 1 --2- 172.21.15.82:0/2376992939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71d0d0 0x5629fa731810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3ca684c640 1 -- 172.21.15.82:0/2376992939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71d0d0 msgr2=0x5629fa731810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3ca684c640 1 --2- 172.21.15.82:0/2376992939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71d0d0 0x5629fa731810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3ca684c640 1 -- 172.21.15.82:0/2376992939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71c7b0 msgr2=0x5629fa7253e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3ca684c640 1 --2- 172.21.15.82:0/2376992939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71c7b0 0x5629fa7253e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.657+0000 7f3ca684c640 1 -- 172.21.15.82:0/2376992939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629fa716d10 con 0x5629fa725cb0 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3ca684c640 1 --2- 172.21.15.82:0/2376992939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa715e80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800ec10 tx=0x7f3c98013610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc1fca7345f3bab server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3c8bfff640 1 -- 172.21.15.82:0/2376992939 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98013af0 con 0x5629fa725cb0 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3c8bfff640 1 -- 172.21.15.82:0/2376992939 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c98037070 con 0x5629fa725cb0 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3c8bfff640 1 -- 172.21.15.82:0/2376992939 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98004670 con 0x5629fa725cb0 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3caaf73740 1 -- 172.21.15.82:0/2376992939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 msgr2=0x5629fa715e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3caaf73740 1 --2- 172.21.15.82:0/2376992939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa715e80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800ec10 tx=0x7f3c98013610 comp rx=0 tx=0).stop 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3caaf73740 1 -- 172.21.15.82:0/2376992939 shutdown_connections 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3caaf73740 1 --2- 172.21.15.82:0/2376992939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa715e80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3caaf73740 1 --2- 172.21.15.82:0/2376992939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71d0d0 0x5629fa731810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3caaf73740 1 --2- 172.21.15.82:0/2376992939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71c7b0 0x5629fa7253e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3caaf73740 1 -- 172.21.15.82:0/2376992939 >> 172.21.15.82:0/2376992939 conn(0x5629fa716ee0 msgr2=0x5629fa715770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3caaf73740 1 -- 172.21.15.82:0/2376992939 shutdown_connections 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.658+0000 7f3caaf73740 1 -- 172.21.15.82:0/2376992939 wait complete. 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3caaf73740 1 -- start start 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3caaf73740 1 Processor -- start 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71c7b0 0x5629fa7298c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71d0d0 0x5629fa729e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3caaf73740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa72a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3caaf73740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca01abd20 con 0x5629fa725cb0 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3caaf73740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca01ad190 con 0x5629fa71c7b0 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3caaf73740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca01ac3f0 con 0x5629fa71d0d0 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3caaf73740 10 client.0 _ll_register_callbacks cb 0x7f3c98013a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:15.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca684c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa72a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca604b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71c7b0 0x5629fa7298c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca684c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa72a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58168/0 (socket says 172.21.15.82:58168) 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca684c640 1 -- 172.21.15.82:0/1399205539 learned_addr learned my addr 172.21.15.82:0/1399205539 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca584a640 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71d0d0 0x5629fa729e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca684c640 1 -- 172.21.15.82:0/1399205539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71d0d0 msgr2=0x5629fa729e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca684c640 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71d0d0 0x5629fa729e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca684c640 1 -- 172.21.15.82:0/1399205539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71c7b0 msgr2=0x5629fa7298c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca684c640 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71c7b0 0x5629fa7298c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca684c640 1 -- 172.21.15.82:0/1399205539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629fa79b770 con 0x5629fa725cb0 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3ca684c640 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa72a340 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3c98010480 tx=0x7f3c98003fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8cb33c74647809 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.659+0000 7f3c89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3c89ffb640 1 -- 172.21.15.82:0/1399205539 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98004410 con 0x5629fa725cb0 2024-03-27T07:25:15.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3c89ffb640 1 -- 172.21.15.82:0/1399205539 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f3c980045b0 con 0x5629fa725cb0 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3caaf73740 1 -- 172.21.15.82:0/1399205539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c98037070 con 0x5629fa725cb0 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3c89ffb640 1 -- 172.21.15.82:0/1399205539 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3c9804a050 con 0x5629fa725cb0 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3caaf73740 10 client.15906 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3caaf73740 1 -- 172.21.15.82:0/1399205539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5629fa79ca30 con 0x5629fa725cb0 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3c89ffb640 1 -- 172.21.15.82:0/1399205539 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c98037070 con 0x5629fa725cb0 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3c89ffb640 1 -- 172.21.15.82:0/1399205539 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f3c9803c860 con 0x5629fa725cb0 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3caaf73740 10 client.15906 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3caaf73740 10 client.15906 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3caaf73740 20 client.15906 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3caaf73740 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x5629fa79d090 0x5629fa79f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3caaf73740 4 client.15906 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3caaf73740 1 -- 172.21.15.82:0/1399205539 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5629fa687fa0 con 0x5629fa79d090 2024-03-27T07:25:15.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.660+0000 7f3ca604b640 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x5629fa79d090 0x5629fa79f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3c89ffb640 10 client.15906 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3ca604b640 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x5629fa79d090 0x5629fa79f480 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ad4684ff2c87ae4 server_cookie=7baf4ccdf4fb64a9 in_seq=0 out_seq=0 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3c89ffb640 1 -- 172.21.15.82:0/1399205539 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5629fa687fa0 con 0x5629fa79d090 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3c89ffb640 10 client.15906 handle_command_reply: tid=0 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 client.15906 shutdown 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 -- 172.21.15.82:0/1399205539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 msgr2=0x5629fa72a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa72a340 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3c98010480 tx=0x7f3c98003fd0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 -- 172.21.15.82:0/1399205539 shutdown_connections 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x5629fa79d090 0x5629fa79f480 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5629fa725cb0 0x5629fa72a340 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5629fa71d0d0 0x5629fa729e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 --2- 172.21.15.82:0/1399205539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5629fa71c7b0 0x5629fa7298c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3c89ffb640 0 client.15906 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:25:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 -- 172.21.15.82:0/1399205539 >> 172.21.15.82:0/1399205539 conn(0x5629fa716ee0 msgr2=0x5629fa7234e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 -- 172.21.15.82:0/1399205539 shutdown_connections 2024-03-27T07:25:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 1 -- 172.21.15.82:0/1399205539 wait complete. 2024-03-27T07:25:15.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.661+0000 7f3caaf73740 20 client.15906 trim_cache size 0 max 16384 2024-03-27T07:25:15.671 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:25:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 -- 172.21.15.82:0/1774830049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c8c0a3780 msgr2=0x7f3c8c0a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c8c0a3780 0x7f3c8c0a5c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c980099e0 tx=0x7f3c98004ab0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 -- 172.21.15.82:0/1774830049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca0101ae0 msgr2=0x7f3ca0198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca0101ae0 0x7f3ca0198470 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00ea60 tx=0x7f3c9c00ef20 comp rx=0 tx=0).stop 2024-03-27T07:25:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 -- 172.21.15.82:0/1774830049 shutdown_connections 2024-03-27T07:25:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c8c0a3780 0x7f3c8c0a5c40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3ca0107b80 0x7f3ca019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ca01024a0 0x7f3ca01989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 --2- 172.21.15.82:0/1774830049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ca0101ae0 0x7f3ca0198470 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 -- 172.21.15.82:0/1774830049 >> 172.21.15.82:0/1774830049 conn(0x7f3ca0078f50 msgr2=0x7f3ca01045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 -- 172.21.15.82:0/1774830049 shutdown_connections 2024-03-27T07:25:15.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.662+0000 7f3ca82af640 1 -- 172.21.15.82:0/1774830049 wait complete. 2024-03-27T07:25:15.674 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T07:25:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 -- 172.21.15.82:0/788552437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e01013c0 msgr2=0x7f93e010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 --2- 172.21.15.82:0/788552437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e01013c0 0x7f93e010d8d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009cd0 tx=0x7f93d802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 -- 172.21.15.82:0/788552437 shutdown_connections 2024-03-27T07:25:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 --2- 172.21.15.82:0/788552437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e01013c0 0x7f93e010d8d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 --2- 172.21.15.82:0/788552437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e0100a00 0x7f93e0100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 --2- 172.21.15.82:0/788552437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0106a10 0x7f93e0106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 -- 172.21.15.82:0/788552437 >> 172.21.15.82:0/788552437 conn(0x7f93e0076dd0 msgr2=0x7f93e00771e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 -- 172.21.15.82:0/788552437 shutdown_connections 2024-03-27T07:25:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 -- 172.21.15.82:0/788552437 wait complete. 2024-03-27T07:25:15.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 Processor -- start 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.776+0000 7f93e862a640 1 -- start start 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e862a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e0100a00 0x7f93e01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e862a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e01013c0 0x7f93e01988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e862a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0106a10 0x7f93e019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e862a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93e0110e20 con 0x7f93e01013c0 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e862a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93e0110ca0 con 0x7f93e0100a00 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e862a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93e0110fa0 con 0x7f93e0106a10 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e5bc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e01013c0 0x7f93e01988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e5bc5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e01013c0 0x7f93e01988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58192/0 (socket says 172.21.15.82:58192) 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e5bc5640 1 -- 172.21.15.82:0/3063633982 learned_addr learned my addr 172.21.15.82:0/3063633982 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0106a10 0x7f93e019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e63c6640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e0100a00 0x7f93e01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e5bc5640 1 -- 172.21.15.82:0/3063633982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0106a10 msgr2=0x7f93e019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e5bc5640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0106a10 0x7f93e019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e5bc5640 1 -- 172.21.15.82:0/3063633982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e0100a00 msgr2=0x7f93e01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e5bc5640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e0100a00 0x7f93e01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e5bc5640 1 -- 172.21.15.82:0/3063633982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e019d390 con 0x7f93e01013c0 2024-03-27T07:25:15.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e5bc5640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e01013c0 0x7f93e01988e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f93d000e9f0 tx=0x7f93d000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93d77fe640 1 -- 172.21.15.82:0/3063633982 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d000cd80 con 0x7f93e01013c0 2024-03-27T07:25:15.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93d77fe640 1 -- 172.21.15.82:0/3063633982 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d0010910 con 0x7f93e01013c0 2024-03-27T07:25:15.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e862a640 1 -- 172.21.15.82:0/3063633982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e019d680 con 0x7f93e01013c0 2024-03-27T07:25:15.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93d77fe640 1 -- 172.21.15.82:0/3063633982 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d0018990 con 0x7f93e01013c0 2024-03-27T07:25:15.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.777+0000 7f93e862a640 1 -- 172.21.15.82:0/3063633982 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e01a4f10 con 0x7f93e01013c0 2024-03-27T07:25:15.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.780+0000 7f93d77fe640 1 -- 172.21.15.82:0/3063633982 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f93d0010ac0 con 0x7f93e01013c0 2024-03-27T07:25:15.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.780+0000 7f93eb214740 1 Processor -- start 2024-03-27T07:25:15.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93eb214740 1 -- start start 2024-03-27T07:25:15.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93eb214740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93eb214740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316c30d0 0x5621316cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93eb214740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316cbcb0 0x5621316ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93eb214740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562131626710 con 0x5621316c30d0 2024-03-27T07:25:15.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93eb214740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5621315ceaf0 con 0x5621316cbcb0 2024-03-27T07:25:15.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93eb214740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5621316226c0 con 0x5621316c27b0 2024-03-27T07:25:15.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e63c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316c30d0 0x5621316cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e63c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316c30d0 0x5621316cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58198/0 (socket says 172.21.15.82:58198) 2024-03-27T07:25:15.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e63c6640 1 -- 172.21.15.82:0/4239964222 learned_addr learned my addr 172.21.15.82:0/4239964222 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/4239964222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e5bc5640 1 --2- 172.21.15.82:0/4239964222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316cbcb0 0x5621316ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93d77fe640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93cc0a3780 0x7f93cc0a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e63c6640 1 -- 172.21.15.82:0/4239964222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 msgr2=0x5621316c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e63c6640 1 --2- 172.21.15.82:0/4239964222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e63c6640 1 -- 172.21.15.82:0/4239964222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316cbcb0 msgr2=0x5621316ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e63c6640 1 --2- 172.21.15.82:0/4239964222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316cbcb0 0x5621316ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e63c6640 1 -- 172.21.15.82:0/4239964222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56213133a3f0 con 0x5621316c30d0 2024-03-27T07:25:15.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e5bc5640 1 --2- 172.21.15.82:0/4239964222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316cbcb0 0x5621316ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:15.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93cc0a3780 0x7f93cc0a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93d77fe640 1 -- 172.21.15.82:0/3063633982 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f93d00d0400 con 0x7f93e01013c0 2024-03-27T07:25:15.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.781+0000 7f93e63c6640 1 --2- 172.21.15.82:0/4239964222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316c30d0 0x5621316cb770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009ca0 tx=0x7f93dc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9514d42ac49b3a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93d4bfe640 1 -- 172.21.15.82:0/4239964222 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc01e070 con 0x5621316c30d0 2024-03-27T07:25:15.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93d4bfe640 1 -- 172.21.15.82:0/4239964222 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93dc019b10 con 0x5621316c30d0 2024-03-27T07:25:15.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93d4bfe640 1 -- 172.21.15.82:0/4239964222 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00ea70 con 0x5621316c30d0 2024-03-27T07:25:15.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93eb214740 1 -- 172.21.15.82:0/4239964222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316c30d0 msgr2=0x5621316cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93cc0a3780 0x7f93cc0a5c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93d8005cc0 tx=0x7f93d802e040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93eb214740 1 --2- 172.21.15.82:0/4239964222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316c30d0 0x5621316cb770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009ca0 tx=0x7f93dc011810 comp rx=0 tx=0).stop 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93eb214740 1 -- 172.21.15.82:0/4239964222 shutdown_connections 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93eb214740 1 --2- 172.21.15.82:0/4239964222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316c30d0 0x5621316cb770 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93eb214740 1 --2- 172.21.15.82:0/4239964222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316cbcb0 0x5621316ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93eb214740 1 --2- 172.21.15.82:0/4239964222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.782+0000 7f93eb214740 1 -- 172.21.15.82:0/4239964222 >> 172.21.15.82:0/4239964222 conn(0x5621316bcee0 msgr2=0x5621316bd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 1 -- 172.21.15.82:0/4239964222 shutdown_connections 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 1 -- 172.21.15.82:0/4239964222 wait complete. 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 1 -- start start 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 1 Processor -- start 2024-03-27T07:25:15.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 0x5621316c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316c9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5621316ceaa0 con 0x5621316cbcb0 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5621315e1eb0 con 0x5621316c30d0 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5621316cec20 con 0x5621316c27b0 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93eb214740 10 client.0 _ll_register_callbacks cb 0x56213161e6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93e6bc7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93e6bc7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58206/0 (socket says 172.21.15.82:58206) 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93e6bc7640 1 -- 172.21.15.82:0/1466893804 learned_addr learned my addr 172.21.15.82:0/1466893804 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93e63c6640 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93e5bc5640 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 0x5621316c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93e6bc7640 1 -- 172.21.15.82:0/1466893804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 msgr2=0x5621316c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93e6bc7640 1 -- 172.21.15.82:0/1466893804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 msgr2=0x5621316c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 0x5621316c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.783+0000 7f93e6bc7640 1 -- 172.21.15.82:0/1466893804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621314047d0 con 0x5621316cbcb0 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93e5bc5640 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 0x5621316c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316c9790 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009a60 tx=0x7f93d8005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fc5af21b7de44c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1466893804 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8039040 con 0x5621316cbcb0 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1466893804 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f93d8041670 con 0x5621316cbcb0 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93eb214740 1 -- 172.21.15.82:0/1466893804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93dc019b10 con 0x5621316cbcb0 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1466893804 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f93d805b050 con 0x5621316cbcb0 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93eb214740 10 client.15918 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93eb214740 1 -- 172.21.15.82:0/1466893804 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5621316dad70 con 0x5621316cbcb0 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1466893804 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93dc019b10 con 0x5621316cbcb0 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1466893804 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f93d803f040 con 0x5621316cbcb0 2024-03-27T07:25:15.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93eb214740 10 client.15918 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93eb214740 10 client.15918 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93eb214740 20 client.15918 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93eb214740 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x5621316dc280 0x5621316de6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93eb214740 4 client.15918 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.784+0000 7f93eb214740 1 -- 172.21.15.82:0/1466893804 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562131633c50 con 0x5621316dc280 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.785+0000 7f93e63c6640 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x5621316dc280 0x5621316de6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.785+0000 7f93c9ffb640 10 client.15918 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.785+0000 7f93e63c6640 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x5621316dc280 0x5621316de6b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2d4c3ab51a144915 server_cookie=b709a3a6d78a8c37 in_seq=0 out_seq=0 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1466893804 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x562131633c50 con 0x5621316dc280 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93c9ffb640 10 client.15918 handle_command_reply: tid=0 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 client.15918 shutdown 2024-03-27T07:25:15.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 -- 172.21.15.82:0/1466893804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 msgr2=0x5621316c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316c9790 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009a60 tx=0x7f93d8005c50 comp rx=0 tx=0).stop 2024-03-27T07:25:15.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 -- 172.21.15.82:0/1466893804 shutdown_connections 2024-03-27T07:25:15.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x5621316dc280 0x5621316de6b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316c9790 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 0x5621316c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 --2- 172.21.15.82:0/1466893804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93c9ffb640 0 client.15918 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:25:15.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 -- 172.21.15.82:0/1466893804 >> 172.21.15.82:0/1466893804 conn(0x5621316bcee0 msgr2=0x5621316bec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 -- 172.21.15.82:0/1466893804 shutdown_connections 2024-03-27T07:25:15.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 1 -- 172.21.15.82:0/1466893804 wait complete. 2024-03-27T07:25:15.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.786+0000 7f93eb214740 20 client.15918 trim_cache size 0 max 16384 2024-03-27T07:25:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93eb214740 1 Processor -- start 2024-03-27T07:25:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93eb214740 1 -- start start 2024-03-27T07:25:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93eb214740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c27b0 0x5621316cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93eb214740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c30d0 0x5621316d7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93eb214740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93eb214740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01affe0 con 0x5621316cbcb0 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93eb214740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01ad8b0 con 0x5621316c27b0 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93eb214740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01ab700 con 0x5621316c30d0 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93e6bc7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93e6bc7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316e3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58220/0 (socket says 172.21.15.82:58220) 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93e6bc7640 1 -- 172.21.15.82:0/135802773 learned_addr learned my addr 172.21.15.82:0/135802773 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93e5bc5640 1 --2- 172.21.15.82:0/135802773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c30d0 0x5621316d7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.799+0000 7f93e63c6640 1 --2- 172.21.15.82:0/135802773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c27b0 0x5621316cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.800+0000 7f93e6bc7640 1 -- 172.21.15.82:0/135802773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c30d0 msgr2=0x5621316d7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.800+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/135802773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c30d0 0x5621316d7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.800+0000 7f93e6bc7640 1 -- 172.21.15.82:0/135802773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c27b0 msgr2=0x5621316cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.800+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/135802773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c27b0 0x5621316cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.800+0000 7f93e6bc7640 1 -- 172.21.15.82:0/135802773 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621316c2f00 con 0x5621316cbcb0 2024-03-27T07:25:15.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.800+0000 7f93e63c6640 1 --2- 172.21.15.82:0/135802773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c27b0 0x5621316cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.800+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/135802773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316e3f80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f93d802c700 tx=0x7f93d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d3f2819a601aca server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.800+0000 7f93cbfff640 1 -- 172.21.15.82:0/135802773 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8039070 con 0x5621316cbcb0 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.800+0000 7f93cbfff640 1 -- 172.21.15.82:0/135802773 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d8064070 con 0x5621316cbcb0 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.800+0000 7f93cbfff640 1 -- 172.21.15.82:0/135802773 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d804dcf0 con 0x5621316cbcb0 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 -- 172.21.15.82:0/135802773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 msgr2=0x5621316e3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 --2- 172.21.15.82:0/135802773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316e3f80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f93d802c700 tx=0x7f93d8009b20 comp rx=0 tx=0).stop 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 -- 172.21.15.82:0/135802773 shutdown_connections 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 --2- 172.21.15.82:0/135802773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316e3f80 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 --2- 172.21.15.82:0/135802773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c30d0 0x5621316d7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 --2- 172.21.15.82:0/135802773 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c27b0 0x5621316cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 -- 172.21.15.82:0/135802773 >> 172.21.15.82:0/135802773 conn(0x5621316bcee0 msgr2=0x5621316bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 -- 172.21.15.82:0/135802773 shutdown_connections 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 -- 172.21.15.82:0/135802773 wait complete. 2024-03-27T07:25:15.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 -- start start 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 Processor -- start 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 0x5621316d0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01abd70 con 0x5621316cbcb0 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01ad1e0 con 0x5621316c30d0 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93e01ac440 con 0x5621316c27b0 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93eb214740 10 client.0 _ll_register_callbacks cb 0x7f93dc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93e6bc7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93e6bc7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316d05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58234/0 (socket says 172.21.15.82:58234) 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93e6bc7640 1 -- 172.21.15.82:0/1600692657 learned_addr learned my addr 172.21.15.82:0/1600692657 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93e63c6640 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.801+0000 7f93e5bc5640 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 0x5621316d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93e6bc7640 1 -- 172.21.15.82:0/1600692657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 msgr2=0x5621316cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93e6bc7640 1 -- 172.21.15.82:0/1600692657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 msgr2=0x5621316d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 0x5621316d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93e6bc7640 1 -- 172.21.15.82:0/1600692657 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621317418a0 con 0x5621316cbcb0 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93e6bc7640 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316d05c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f93d802c630 tx=0x7f93d80329f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ec3cefd979dc85 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1600692657 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d806d060 con 0x5621316cbcb0 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93eb214740 1 -- 172.21.15.82:0/1600692657 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93d8064070 con 0x5621316cbcb0 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1600692657 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f93d804d6c0 con 0x5621316cbcb0 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1600692657 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f93d8039040 con 0x5621316cbcb0 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93eb214740 10 client.15924 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93eb214740 1 -- 172.21.15.82:0/1600692657 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x562131742ba0 con 0x5621316cbcb0 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1600692657 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93d8064070 con 0x5621316cbcb0 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1600692657 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f93d8041970 con 0x5621316cbcb0 2024-03-27T07:25:15.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93eb214740 10 client.15924 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93eb214740 10 client.15924 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93eb214740 20 client.15924 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.802+0000 7f93eb214740 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x562131743150 0x562131745570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 4 client.15924 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 -- 172.21.15.82:0/1600692657 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56213162dfa0 con 0x562131743150 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93e63c6640 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x562131743150 0x562131745570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93c9ffb640 10 client.15924 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93e63c6640 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x562131743150 0x562131745570 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d7420e7f06869b00 server_cookie=4aad81a4df803be5 in_seq=0 out_seq=0 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93c9ffb640 1 -- 172.21.15.82:0/1600692657 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56213162dfa0 con 0x562131743150 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93c9ffb640 10 client.15924 handle_command_reply: tid=0 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 client.15924 shutdown 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 -- 172.21.15.82:0/1600692657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 msgr2=0x5621316d05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316d05c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f93d802c630 tx=0x7f93d80329f0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 -- 172.21.15.82:0/1600692657 shutdown_connections 2024-03-27T07:25:15.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x562131743150 0x562131745570 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5621316cbcb0 0x5621316d05c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93c9ffb640 0 client.15924 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:25:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5621316c30d0 0x5621316d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 --2- 172.21.15.82:0/1600692657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5621316c27b0 0x5621316cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 -- 172.21.15.82:0/1600692657 >> 172.21.15.82:0/1600692657 conn(0x5621316bcee0 msgr2=0x5621316c8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 -- 172.21.15.82:0/1600692657 shutdown_connections 2024-03-27T07:25:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 1 -- 172.21.15.82:0/1600692657 wait complete. 2024-03-27T07:25:15.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.803+0000 7f93eb214740 20 client.15924 trim_cache size 0 max 16384 2024-03-27T07:25:15.812 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:25:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 -- 172.21.15.82:0/3063633982 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93cc0a3780 msgr2=0x7f93cc0a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93cc0a3780 0x7f93cc0a5c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93d8005cc0 tx=0x7f93d802e040 comp rx=0 tx=0).stop 2024-03-27T07:25:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 -- 172.21.15.82:0/3063633982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e01013c0 msgr2=0x7f93e01988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e01013c0 0x7f93e01988e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f93d000e9f0 tx=0x7f93d000eeb0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 -- 172.21.15.82:0/3063633982 shutdown_connections 2024-03-27T07:25:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93cc0a3780 0x7f93cc0a5c40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e01013c0 0x7f93e01988e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e0106a10 0x7f93e019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 --2- 172.21.15.82:0/3063633982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93e0100a00 0x7f93e01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 -- 172.21.15.82:0/3063633982 >> 172.21.15.82:0/3063633982 conn(0x7f93e0076dd0 msgr2=0x7f93e006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 -- 172.21.15.82:0/3063633982 shutdown_connections 2024-03-27T07:25:15.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.804+0000 7f93e862a640 1 -- 172.21.15.82:0/3063633982 wait complete. 2024-03-27T07:25:15.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T07:25:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.919+0000 7f394c676640 1 -- 172.21.15.82:0/169203118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3944107b90 msgr2=0x7f3944107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.919+0000 7f394c676640 1 --2- 172.21.15.82:0/169203118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3944107b90 0x7f3944107f70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3940009cd0 tx=0x7f394002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.919+0000 7f394c676640 1 -- 172.21.15.82:0/169203118 shutdown_connections 2024-03-27T07:25:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.919+0000 7f394c676640 1 --2- 172.21.15.82:0/169203118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39441024b0 0x7f394410e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.919+0000 7f394c676640 1 --2- 172.21.15.82:0/169203118 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3944101af0 0x7f3944101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.919+0000 7f394c676640 1 --2- 172.21.15.82:0/169203118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3944107b90 0x7f3944107f70 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.919+0000 7f394c676640 1 -- 172.21.15.82:0/169203118 >> 172.21.15.82:0/169203118 conn(0x7f39440fd580 msgr2=0x7f39440ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394c676640 1 -- 172.21.15.82:0/169203118 shutdown_connections 2024-03-27T07:25:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394c676640 1 -- 172.21.15.82:0/169203118 wait complete. 2024-03-27T07:25:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394c676640 1 Processor -- start 2024-03-27T07:25:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394c676640 1 -- start start 2024-03-27T07:25:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394c676640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3944101af0 0x7f3944073e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394c676640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39441024b0 0x7f3944074390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394c676640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3944107b90 0x7f39440748d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394c676640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3944111ee0 con 0x7f39441024b0 2024-03-27T07:25:15.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394c676640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3944111d60 con 0x7f3944101af0 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394c676640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3944112060 con 0x7f3944107b90 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f3949c11640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39441024b0 0x7f3944074390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394a412640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3944101af0 0x7f3944073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f3949c11640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39441024b0 0x7f3944074390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58252/0 (socket says 172.21.15.82:58252) 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f3949c11640 1 -- 172.21.15.82:0/1506588194 learned_addr learned my addr 172.21.15.82:0/1506588194 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.920+0000 7f394ac13640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3944107b90 0x7f39440748d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f3949c11640 1 -- 172.21.15.82:0/1506588194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3944107b90 msgr2=0x7f39440748d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f3949c11640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3944107b90 0x7f39440748d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f3949c11640 1 -- 172.21.15.82:0/1506588194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3944101af0 msgr2=0x7f3944073e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f3949c11640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3944101af0 0x7f3944073e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f3949c11640 1 -- 172.21.15.82:0/1506588194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39441a6960 con 0x7f39441024b0 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f394a412640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3944101af0 0x7f3944073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:15.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f3949c11640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39441024b0 0x7f3944074390 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f393400e9f0 tx=0x7f393400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f393b7fe640 1 -- 172.21.15.82:0/1506588194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393400cd80 con 0x7f39441024b0 2024-03-27T07:25:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f393b7fe640 1 -- 172.21.15.82:0/1506588194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3934010910 con 0x7f39441024b0 2024-03-27T07:25:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f394c676640 1 -- 172.21.15.82:0/1506588194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39441a6c50 con 0x7f39441024b0 2024-03-27T07:25:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f393b7fe640 1 -- 172.21.15.82:0/1506588194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934018990 con 0x7f39441024b0 2024-03-27T07:25:15.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.921+0000 7f394c676640 1 -- 172.21.15.82:0/1506588194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39441a71a0 con 0x7f39441024b0 2024-03-27T07:25:15.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.923+0000 7f393b7fe640 1 -- 172.21.15.82:0/1506588194 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f3934010ac0 con 0x7f39441024b0 2024-03-27T07:25:15.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394f266740 1 Processor -- start 2024-03-27T07:25:15.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394f266740 1 -- start start 2024-03-27T07:25:15.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394f266740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc35b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394f266740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394f266740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394f266740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a5bfb99710 con 0x55a5bfc357b0 2024-03-27T07:25:15.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f393b7fe640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f39300a3800 0x7f39300a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394f266740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55a5bfb41af0 con 0x55a5bfc360d0 2024-03-27T07:25:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394f266740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a5bfb956c0 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394ac13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc35b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394ac13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc35b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58254/0 (socket says 172.21.15.82:58254) 2024-03-27T07:25:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394ac13640 1 -- 172.21.15.82:0/847341322 learned_addr learned my addr 172.21.15.82:0/847341322 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394a412640 1 --2- 172.21.15.82:0/847341322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394ac13640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f39300a3800 0x7f39300a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f3949c11640 1 --2- 172.21.15.82:0/847341322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f393b7fe640 1 -- 172.21.15.82:0/1506588194 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f39340d0370 con 0x7f39441024b0 2024-03-27T07:25:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394a412640 1 -- 172.21.15.82:0/847341322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc3ecb0 msgr2=0x55a5bfc410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394a412640 1 --2- 172.21.15.82:0/847341322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394a412640 1 -- 172.21.15.82:0/847341322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 msgr2=0x55a5bfc35b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394a412640 1 --2- 172.21.15.82:0/847341322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc35b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.924+0000 7f394a412640 1 -- 172.21.15.82:0/847341322 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5bf8ad3f0 con 0x55a5bfc360d0 2024-03-27T07:25:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.925+0000 7f394ac13640 1 --2- 172.21.15.82:0/847341322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc35b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.925+0000 7f394a412640 1 --2- 172.21.15.82:0/847341322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f394002c700 tx=0x7f3940009880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86a2811a130bf529 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.925+0000 7f394ac13640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f39300a3800 0x7f39300a5cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f393c011980 tx=0x7f393c005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.925+0000 7f3938ff9640 1 -- 172.21.15.82:0/847341322 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940043070 con 0x55a5bfc360d0 2024-03-27T07:25:15.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.925+0000 7f3938ff9640 1 -- 172.21.15.82:0/847341322 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f394002cca0 con 0x55a5bfc360d0 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.925+0000 7f3938ff9640 1 -- 172.21.15.82:0/847341322 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940039040 con 0x55a5bfc360d0 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 -- 172.21.15.82:0/847341322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 msgr2=0x55a5bfc3e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 --2- 172.21.15.82:0/847341322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f394002c700 tx=0x7f3940009880 comp rx=0 tx=0).stop 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 -- 172.21.15.82:0/847341322 shutdown_connections 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 --2- 172.21.15.82:0/847341322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 --2- 172.21.15.82:0/847341322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3e770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 --2- 172.21.15.82:0/847341322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc35b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 -- 172.21.15.82:0/847341322 >> 172.21.15.82:0/847341322 conn(0x55a5bfc2fee0 msgr2=0x55a5bfc302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 -- 172.21.15.82:0/847341322 shutdown_connections 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 -- 172.21.15.82:0/847341322 wait complete. 2024-03-27T07:25:15.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 -- start start 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 Processor -- start 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 0x55a5bfc3bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc3c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a5bfc41a40 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55a5bfb54eb0 con 0x55a5bfc360d0 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55a5bfc41bc0 con 0x55a5bfc357b0 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394f266740 10 client.0 _ll_register_callbacks cb 0x55a5bfb916a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394ac13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc3c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394ac13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc3c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58266/0 (socket says 172.21.15.82:58266) 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394ac13640 1 -- 172.21.15.82:0/1757774424 learned_addr learned my addr 172.21.15.82:0/1757774424 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f3949c11640 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.926+0000 7f394a412640 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 0x55a5bfc3bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f394ac13640 1 -- 172.21.15.82:0/1757774424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 msgr2=0x55a5bfc3bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f394ac13640 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 0x55a5bfc3bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f394ac13640 1 -- 172.21.15.82:0/1757774424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 msgr2=0x55a5bfc3c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f394ac13640 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f394ac13640 1 -- 172.21.15.82:0/1757774424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5bf9777d0 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f394ac13640 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc3c690 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f393c004580 tx=0x7f393c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5a2ad7ffff46f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f392dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f392dffb640 1 -- 172.21.15.82:0/1757774424 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c003d70 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f392dffb640 1 -- 172.21.15.82:0/1757774424 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f393c005020 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f394f266740 1 -- 172.21.15.82:0/1757774424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f394002cca0 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f392dffb640 1 -- 172.21.15.82:0/1757774424 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f393c009a20 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f394f266740 10 client.15936 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f394f266740 1 -- 172.21.15.82:0/1757774424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55a5bfc4dc70 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.927+0000 7f392dffb640 1 -- 172.21.15.82:0/1757774424 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f394002cca0 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.928+0000 7f392dffb640 1 -- 172.21.15.82:0/1757774424 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f393c027070 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.928+0000 7f394f266740 10 client.15936 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.928+0000 7f394f266740 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.928+0000 7f394f266740 20 client.15936 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.928+0000 7f394f266740 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55a5bfc4f180 0x55a5bfc515d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.928+0000 7f394f266740 4 client.15936 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.928+0000 7f394f266740 1 -- 172.21.15.82:0/1757774424 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5bfba6c50 con 0x55a5bfc4f180 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.928+0000 7f394a412640 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55a5bfc4f180 0x55a5bfc515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.928+0000 7f392dffb640 10 client.15936 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.928+0000 7f394a412640 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55a5bfc4f180 0x55a5bfc515d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af13c002b6f988ff server_cookie=cfb70efd379931af in_seq=0 out_seq=0 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f392dffb640 1 -- 172.21.15.82:0/1757774424 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55a5bfba6c50 con 0x55a5bfc4f180 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f392dffb640 10 client.15936 handle_command_reply: tid=0 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 client.15936 shutdown 2024-03-27T07:25:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 -- 172.21.15.82:0/1757774424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 msgr2=0x55a5bfc3c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc3c690 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f393c004580 tx=0x7f393c0046c0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 -- 172.21.15.82:0/1757774424 shutdown_connections 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55a5bfc4f180 0x55a5bfc515d0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc3c690 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f392dffb640 0 client.15936 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 --2- 172.21.15.82:0/1757774424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 0x55a5bfc3bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 -- 172.21.15.82:0/1757774424 >> 172.21.15.82:0/1757774424 conn(0x55a5bfc2fee0 msgr2=0x55a5bfc31c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 -- 172.21.15.82:0/1757774424 shutdown_connections 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 1 -- 172.21.15.82:0/1757774424 wait complete. 2024-03-27T07:25:15.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.929+0000 7f394f266740 20 client.15936 trim_cache size 0 max 16384 2024-03-27T07:25:15.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394f266740 1 Processor -- start 2024-03-27T07:25:15.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394f266740 1 -- start start 2024-03-27T07:25:15.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394f266740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc4a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394f266740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394f266740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc56ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394f266740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f39441b2280 con 0x55a5bfc357b0 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394f266740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f39441afb50 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394f266740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39441ad9a0 con 0x55a5bfc360d0 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394a412640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc4a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394a412640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc4a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58270/0 (socket says 172.21.15.82:58270) 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.942+0000 7f394a412640 1 -- 172.21.15.82:0/937711043 learned_addr learned my addr 172.21.15.82:0/937711043 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f394ac13640 1 --2- 172.21.15.82:0/937711043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc56ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f3949c11640 1 --2- 172.21.15.82:0/937711043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f394a412640 1 -- 172.21.15.82:0/937711043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc360d0 msgr2=0x55a5bfc3c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f394a412640 1 --2- 172.21.15.82:0/937711043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f394a412640 1 -- 172.21.15.82:0/937711043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc3ecb0 msgr2=0x55a5bfc56ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f394a412640 1 --2- 172.21.15.82:0/937711043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc56ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f394a412640 1 -- 172.21.15.82:0/937711043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5bfc35f00 con 0x55a5bfc357b0 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f394a412640 1 --2- 172.21.15.82:0/937711043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc4a7e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3940005cc0 tx=0x7f3940005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b570403c63544e4a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f392ffff640 1 -- 172.21.15.82:0/937711043 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394002de60 con 0x55a5bfc357b0 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f392ffff640 1 -- 172.21.15.82:0/937711043 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39400522d0 con 0x55a5bfc357b0 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f392ffff640 1 -- 172.21.15.82:0/937711043 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940039040 con 0x55a5bfc357b0 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f394f266740 1 -- 172.21.15.82:0/937711043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 msgr2=0x55a5bfc4a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.943+0000 7f394f266740 1 --2- 172.21.15.82:0/937711043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc4a7e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3940005cc0 tx=0x7f3940005c50 comp rx=0 tx=0).stop 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 -- 172.21.15.82:0/937711043 shutdown_connections 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 --2- 172.21.15.82:0/937711043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc56ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 --2- 172.21.15.82:0/937711043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc360d0 0x55a5bfc3c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 --2- 172.21.15.82:0/937711043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc357b0 0x55a5bfc4a7e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 -- 172.21.15.82:0/937711043 >> 172.21.15.82:0/937711043 conn(0x55a5bfc2fee0 msgr2=0x55a5bfc2e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 -- 172.21.15.82:0/937711043 shutdown_connections 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 -- 172.21.15.82:0/937711043 wait complete. 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 -- start start 2024-03-27T07:25:15.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 Processor -- start 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 0x55a5bfc38b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc39060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f39441ae010 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f39441af480 con 0x55a5bfc360d0 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39441ae6e0 con 0x55a5bfc357b0 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394f266740 10 client.0 _ll_register_callbacks cb 0x7f393c004410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394ac13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394ac13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58282/0 (socket says 172.21.15.82:58282) 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394ac13640 1 -- 172.21.15.82:0/940116438 learned_addr learned my addr 172.21.15.82:0/940116438 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394a412640 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 0x55a5bfc38b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f3949c11640 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc39060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394ac13640 1 -- 172.21.15.82:0/940116438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 msgr2=0x55a5bfc38b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394ac13640 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 0x55a5bfc38b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394ac13640 1 -- 172.21.15.82:0/940116438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 msgr2=0x55a5bfc39060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.944+0000 7f394ac13640 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc39060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394ac13640 1 -- 172.21.15.82:0/940116438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5bfcb4720 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394a412640 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 0x55a5bfc38b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394ac13640 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc395a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f393c0097c0 tx=0x7f393c009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d726187cb1f3e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f392dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f392dffb640 1 -- 172.21.15.82:0/940116438 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c035030 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f392dffb640 1 -- 172.21.15.82:0/940116438 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f393c003bd0 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394f266740 1 -- 172.21.15.82:0/940116438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39400522d0 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f392dffb640 1 -- 172.21.15.82:0/940116438 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f393c03e020 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394f266740 10 client.15942 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394f266740 1 -- 172.21.15.82:0/940116438 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x55a5bfcb59e0 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f392dffb640 1 -- 172.21.15.82:0/940116438 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39400522d0 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f392dffb640 1 -- 172.21.15.82:0/940116438 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f393c027040 con 0x55a5bfc3ecb0 2024-03-27T07:25:15.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394f266740 10 client.15942 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394f266740 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394f266740 20 client.15942 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394f266740 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55a5bfcb60d0 0x55a5bfcb84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394f266740 4 client.15942 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.945+0000 7f394f266740 1 -- 172.21.15.82:0/940116438 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a5bfba0fa0 con 0x55a5bfcb60d0 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394a412640 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55a5bfcb60d0 0x55a5bfcb84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f392dffb640 10 client.15942 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394a412640 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55a5bfcb60d0 0x55a5bfcb84f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cda664cd97b1af56 server_cookie=27a26c29124ceace in_seq=0 out_seq=0 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f392dffb640 1 -- 172.21.15.82:0/940116438 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a5bfba0fa0 con 0x55a5bfcb60d0 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f392dffb640 10 client.15942 handle_command_reply: tid=0 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 client.15942 shutdown 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 -- 172.21.15.82:0/940116438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 msgr2=0x55a5bfc395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc395a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f393c0097c0 tx=0x7f393c009ef0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 -- 172.21.15.82:0/940116438 shutdown_connections 2024-03-27T07:25:15.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55a5bfcb60d0 0x55a5bfcb84f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5bfc3ecb0 0x55a5bfc395a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f392dffb640 0 client.15942 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:15.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55a5bfc360d0 0x55a5bfc39060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 --2- 172.21.15.82:0/940116438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55a5bfc357b0 0x55a5bfc38b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 -- 172.21.15.82:0/940116438 >> 172.21.15.82:0/940116438 conn(0x55a5bfc2fee0 msgr2=0x55a5bfc3c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 -- 172.21.15.82:0/940116438 shutdown_connections 2024-03-27T07:25:15.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 1 -- 172.21.15.82:0/940116438 wait complete. 2024-03-27T07:25:15.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.946+0000 7f394f266740 20 client.15942 trim_cache size 0 max 16384 2024-03-27T07:25:15.955 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:25:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 -- 172.21.15.82:0/1506588194 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f39300a3800 msgr2=0x7f39300a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f39300a3800 0x7f39300a5cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f393c011980 tx=0x7f393c005f90 comp rx=0 tx=0).stop 2024-03-27T07:25:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 -- 172.21.15.82:0/1506588194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39441024b0 msgr2=0x7f3944074390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39441024b0 0x7f3944074390 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f393400e9f0 tx=0x7f393400eeb0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 -- 172.21.15.82:0/1506588194 shutdown_connections 2024-03-27T07:25:15.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f39300a3800 0x7f39300a5cc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39441024b0 0x7f3944074390 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3944107b90 0x7f39440748d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 --2- 172.21.15.82:0/1506588194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3944101af0 0x7f3944073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:15.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 -- 172.21.15.82:0/1506588194 >> 172.21.15.82:0/1506588194 conn(0x7f39440fd580 msgr2=0x7f39440fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:15.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 -- 172.21.15.82:0/1506588194 shutdown_connections 2024-03-27T07:25:15.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:15.947+0000 7f394c676640 1 -- 172.21.15.82:0/1506588194 wait complete. 2024-03-27T07:25:16.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:16 smithi082 ceph-mon[32178]: pgmap v53: 97 pgs: 97 active+clean; 2.6 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 129 KiB/s wr, 22 op/s 2024-03-27T07:25:16.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:16 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1518442299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:25:16.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:16 smithi149 ceph-mon[36065]: pgmap v53: 97 pgs: 97 active+clean; 2.6 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 129 KiB/s wr, 22 op/s 2024-03-27T07:25:16.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:16 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1518442299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:25:16.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:16 smithi153 ceph-mon[36179]: pgmap v53: 97 pgs: 97 active+clean; 2.6 MiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 129 KiB/s wr, 22 op/s 2024-03-27T07:25:16.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:16 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1518442299' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:25:16.961 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T07:25:16.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:25:16.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T07:25:17.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.076+0000 7fca29af4640 1 -- 172.21.15.82:0/1539947326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca24101ae0 msgr2=0x7fca24101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.076+0000 7fca29af4640 1 --2- 172.21.15.82:0/1539947326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca24101ae0 0x7fca24101f60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fca18009930 tx=0x7fca1802bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:17.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.076+0000 7fca29af4640 1 -- 172.21.15.82:0/1539947326 shutdown_connections 2024-03-27T07:25:17.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.076+0000 7fca29af4640 1 --2- 172.21.15.82:0/1539947326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca24101ae0 0x7fca24101f60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.076+0000 7fca29af4640 1 --2- 172.21.15.82:0/1539947326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca241024a0 0x7fca2410e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.076+0000 7fca29af4640 1 --2- 172.21.15.82:0/1539947326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca24107b80 0x7fca24107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.076+0000 7fca29af4640 1 -- 172.21.15.82:0/1539947326 >> 172.21.15.82:0/1539947326 conn(0x7fca24078f50 msgr2=0x7fca24079360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.076+0000 7fca29af4640 1 -- 172.21.15.82:0/1539947326 shutdown_connections 2024-03-27T07:25:17.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.076+0000 7fca29af4640 1 -- 172.21.15.82:0/1539947326 wait complete. 2024-03-27T07:25:17.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.077+0000 7fca29af4640 1 Processor -- start 2024-03-27T07:25:17.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.077+0000 7fca29af4640 1 -- start start 2024-03-27T07:25:17.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.077+0000 7fca29af4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca24101ae0 0x7fca24198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.077+0000 7fca29af4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca241024a0 0x7fca24198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.077+0000 7fca29af4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca24107b80 0x7fca2419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.077+0000 7fca29af4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca24111f20 con 0x7fca241024a0 2024-03-27T07:25:17.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.077+0000 7fca29af4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fca24111da0 con 0x7fca24107b80 2024-03-27T07:25:17.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca29af4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca241120a0 con 0x7fca24101ae0 2024-03-27T07:25:17.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca22ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca241024a0 0x7fca24198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca22ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca241024a0 0x7fca24198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58294/0 (socket says 172.21.15.82:58294) 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca22ffd640 1 -- 172.21.15.82:0/2392192267 learned_addr learned my addr 172.21.15.82:0/2392192267 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca237fe640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca24101ae0 0x7fca24198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca23fff640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca24107b80 0x7fca2419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca22ffd640 1 -- 172.21.15.82:0/2392192267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca24101ae0 msgr2=0x7fca24198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca22ffd640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca24101ae0 0x7fca24198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca22ffd640 1 -- 172.21.15.82:0/2392192267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca24107b80 msgr2=0x7fca2419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca22ffd640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca24107b80 0x7fca2419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca22ffd640 1 -- 172.21.15.82:0/2392192267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2419d410 con 0x7fca241024a0 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca22ffd640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca241024a0 0x7fca24198960 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fca18009900 tx=0x7fca18004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca20ff9640 1 -- 172.21.15.82:0/2392192267 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18043020 con 0x7fca241024a0 2024-03-27T07:25:17.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca20ff9640 1 -- 172.21.15.82:0/2392192267 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca180054e0 con 0x7fca241024a0 2024-03-27T07:25:17.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca29af4640 1 -- 172.21.15.82:0/2392192267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2419d6a0 con 0x7fca241024a0 2024-03-27T07:25:17.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca20ff9640 1 -- 172.21.15.82:0/2392192267 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18003bb0 con 0x7fca241024a0 2024-03-27T07:25:17.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.078+0000 7fca29af4640 1 -- 172.21.15.82:0/2392192267 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca241a4f90 con 0x7fca241024a0 2024-03-27T07:25:17.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.080+0000 7fca20ff9640 1 -- 172.21.15.82:0/2392192267 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fca18046020 con 0x7fca241024a0 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca2c7b8740 1 Processor -- start 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca2c7b8740 1 -- start start 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca20ff9640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fca0c0a3780 0x7fca0c0a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622ef9fde50 0x5622ef9fe230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fe770 0x5622efa06e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622efa07350 0x5622efa09740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5622ef908c20 con 0x5622ef9fe770 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5622ef961430 con 0x5622efa07350 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5622ef909900 con 0x5622ef9fde50 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca23fff640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fca0c0a3780 0x7fca0c0a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca20ff9640 1 -- 172.21.15.82:0/2392192267 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fca180f1f70 con 0x7fca241024a0 2024-03-27T07:25:17.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca22ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fe770 0x5622efa06e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca22ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fe770 0x5622efa06e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58306/0 (socket says 172.21.15.82:58306) 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca237fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622ef9fde50 0x5622ef9fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca22ffd640 1 -- 172.21.15.82:0/3880828406 learned_addr learned my addr 172.21.15.82:0/3880828406 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca23fff640 1 --2- 172.21.15.82:0/3880828406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622efa07350 0x5622efa09740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca22ffd640 1 -- 172.21.15.82:0/3880828406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622ef9fde50 msgr2=0x5622ef9fe230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.081+0000 7fca22ffd640 1 --2- 172.21.15.82:0/3880828406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622ef9fde50 0x5622ef9fe230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.082+0000 7fca22ffd640 1 -- 172.21.15.82:0/3880828406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622efa07350 msgr2=0x5622efa09740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.082+0000 7fca22ffd640 1 --2- 172.21.15.82:0/3880828406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622efa07350 0x5622efa09740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.082+0000 7fca22ffd640 1 -- 172.21.15.82:0/3880828406 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622ef95c180 con 0x5622ef9fe770 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.082+0000 7fca23fff640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fca0c0a3780 0x7fca0c0a5c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca1c005fd0 tx=0x7fca1c009e00 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.082+0000 7fca22ffd640 1 --2- 172.21.15.82:0/3880828406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fe770 0x5622efa06e10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fca180c69a0 tx=0x7fca18003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86259d600669f2e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.082+0000 7fca09ffb640 1 -- 172.21.15.82:0/3880828406 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180efe60 con 0x5622ef9fe770 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.082+0000 7fca09ffb640 1 -- 172.21.15.82:0/3880828406 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca18004c80 con 0x5622ef9fe770 2024-03-27T07:25:17.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.082+0000 7fca09ffb640 1 -- 172.21.15.82:0/3880828406 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180ef990 con 0x5622ef9fe770 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.082+0000 7fca2c7b8740 1 -- 172.21.15.82:0/3880828406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fe770 msgr2=0x5622efa06e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.082+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/3880828406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fe770 0x5622efa06e10 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fca180c69a0 tx=0x7fca18003680 comp rx=0 tx=0).stop 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 -- 172.21.15.82:0/3880828406 shutdown_connections 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/3880828406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fe770 0x5622efa06e10 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/3880828406 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622efa07350 0x5622efa09740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/3880828406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622ef9fde50 0x5622ef9fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 -- 172.21.15.82:0/3880828406 >> 172.21.15.82:0/3880828406 conn(0x5622ef9f8580 msgr2=0x5622ef9f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 -- 172.21.15.82:0/3880828406 shutdown_connections 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 -- 172.21.15.82:0/3880828406 wait complete. 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 -- start start 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 Processor -- start 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa06bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622efa03f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622efa07350 0x5622efa044a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5622ef91ccc0 con 0x5622ef9fde50 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5622ef95d3e0 con 0x5622ef9fe770 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.083+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5622efa09f00 con 0x5622efa07350 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca2c7b8740 10 client.0 _ll_register_callbacks cb 0x5622ef957f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca237fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa06bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca237fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa06bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58316/0 (socket says 172.21.15.82:58316) 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca237fe640 1 -- 172.21.15.82:0/1691376754 learned_addr learned my addr 172.21.15.82:0/1691376754 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca22ffd640 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622efa03f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca23fff640 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622efa07350 0x5622efa044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca237fe640 1 -- 172.21.15.82:0/1691376754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622efa07350 msgr2=0x5622efa044a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca237fe640 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622efa07350 0x5622efa044a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca237fe640 1 -- 172.21.15.82:0/1691376754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 msgr2=0x5622efa03f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca237fe640 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622efa03f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca237fe640 1 -- 172.21.15.82:0/1691376754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622ef923ef0 con 0x5622ef9fde50 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca237fe640 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa06bd0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fca14012740 tx=0x7fca14012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8454e511b1ed035 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca02ffd640 1 -- 172.21.15.82:0/1691376754 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1400f920 con 0x5622ef9fde50 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca02ffd640 1 -- 172.21.15.82:0/1691376754 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fca1400fac0 con 0x5622ef9fde50 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1691376754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca18004c80 con 0x5622ef9fde50 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca02ffd640 1 -- 172.21.15.82:0/1691376754 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fca1400fcc0 con 0x5622ef9fde50 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca2c7b8740 10 client.15954 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1691376754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5622ef73d7e0 con 0x5622ef9fde50 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.084+0000 7fca02ffd640 1 -- 172.21.15.82:0/1691376754 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca18004c80 con 0x5622ef9fde50 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.085+0000 7fca02ffd640 1 -- 172.21.15.82:0/1691376754 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fca1401c420 con 0x5622ef9fde50 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.085+0000 7fca2c7b8740 10 client.15954 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.085+0000 7fca2c7b8740 10 client.15954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.085+0000 7fca2c7b8740 20 client.15954 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.085+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5622efa16f30 0x5622efa193f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.085+0000 7fca2c7b8740 4 client.15954 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.085+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1691376754 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622ef96e970 con 0x5622efa16f30 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.085+0000 7fca22ffd640 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5622efa16f30 0x5622efa193f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.085+0000 7fca22ffd640 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5622efa16f30 0x5622efa193f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=451e1a34e21dbe2b server_cookie=e952986eb5e45ce8 in_seq=0 out_seq=0 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.085+0000 7fca02ffd640 10 client.15954 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca02ffd640 1 -- 172.21.15.82:0/1691376754 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5622ef96e970 con 0x5622efa16f30 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca02ffd640 10 client.15954 handle_command_reply: tid=0 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca2c7b8740 1 client.15954 shutdown 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1691376754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 msgr2=0x5622efa06bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa06bd0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fca14012740 tx=0x7fca14012c00 comp rx=0 tx=0).stop 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1691376754 shutdown_connections 2024-03-27T07:25:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622efa07350 0x5622efa044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622efa03f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5622efa16f30 0x5622efa193f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/1691376754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa06bd0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1691376754 >> 172.21.15.82:0/1691376754 conn(0x5622ef9f8580 msgr2=0x5622ef9fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.086+0000 7fca02ffd640 0 client.15954 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.087+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1691376754 shutdown_connections 2024-03-27T07:25:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.087+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1691376754 wait complete. 2024-03-27T07:25:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.087+0000 7fca2c7b8740 20 client.15954 trim_cache size 0 max 16384 2024-03-27T07:25:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca2c7b8740 1 Processor -- start 2024-03-27T07:25:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca2c7b8740 1 -- start start 2024-03-27T07:25:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622ef9fde50 0x5622efa12a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622ef9ff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622efa07350 0x5622efa1ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca241aff40 con 0x5622efa07350 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fca241ad810 con 0x5622ef9fe770 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca241ab660 con 0x5622ef9fde50 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca23fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622efa07350 0x5622efa1ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca23fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622efa07350 0x5622efa1ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58332/0 (socket says 172.21.15.82:58332) 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca23fff640 1 -- 172.21.15.82:0/1391888972 learned_addr learned my addr 172.21.15.82:0/1391888972 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca237fe640 1 --2- 172.21.15.82:0/1391888972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622ef9fde50 0x5622efa12a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.104+0000 7fca22ffd640 1 --2- 172.21.15.82:0/1391888972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622ef9ff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.105+0000 7fca23fff640 1 -- 172.21.15.82:0/1391888972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622ef9fde50 msgr2=0x5622efa12a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.105+0000 7fca23fff640 1 --2- 172.21.15.82:0/1391888972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622ef9fde50 0x5622efa12a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.105+0000 7fca23fff640 1 -- 172.21.15.82:0/1391888972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 msgr2=0x5622ef9ff4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.105+0000 7fca23fff640 1 --2- 172.21.15.82:0/1391888972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622ef9ff4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.105+0000 7fca23fff640 1 -- 172.21.15.82:0/1391888972 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622ef9fe5a0 con 0x5622efa07350 2024-03-27T07:25:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.105+0000 7fca23fff640 1 --2- 172.21.15.82:0/1391888972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622efa07350 0x5622efa1ecc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fca1c013630 tx=0x7fca1c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b5ae34f4abde67 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.105+0000 7fca097fa640 1 -- 172.21.15.82:0/1391888972 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c01fe30 con 0x5622efa07350 2024-03-27T07:25:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.105+0000 7fca097fa640 1 -- 172.21.15.82:0/1391888972 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1c003e50 con 0x5622efa07350 2024-03-27T07:25:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.105+0000 7fca097fa640 1 -- 172.21.15.82:0/1391888972 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1c004510 con 0x5622efa07350 2024-03-27T07:25:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1391888972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622efa07350 msgr2=0x5622efa1ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/1391888972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622efa07350 0x5622efa1ecc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fca1c013630 tx=0x7fca1c009500 comp rx=0 tx=0).stop 2024-03-27T07:25:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1391888972 shutdown_connections 2024-03-27T07:25:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/1391888972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622efa07350 0x5622efa1ecc0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/1391888972 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622ef9ff4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/1391888972 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622ef9fde50 0x5622efa12a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1391888972 >> 172.21.15.82:0/1391888972 conn(0x5622ef9f8580 msgr2=0x5622ef9fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1391888972 shutdown_connections 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 -- 172.21.15.82:0/1391888972 wait complete. 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 -- start start 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.106+0000 7fca2c7b8740 1 Processor -- start 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa0f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622efa0a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca2c7b8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622efa07350 0x5622efa0ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fca241abcd0 con 0x5622ef9fde50 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fca241ad140 con 0x5622ef9fe770 2024-03-27T07:25:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca2c7b8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca241ac3a0 con 0x5622efa07350 2024-03-27T07:25:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca2c7b8740 10 client.0 _ll_register_callbacks cb 0x7fca14009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca237fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa0f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca237fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa0f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58334/0 (socket says 172.21.15.82:58334) 2024-03-27T07:25:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca237fe640 1 -- 172.21.15.82:0/2989658575 learned_addr learned my addr 172.21.15.82:0/2989658575 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca23fff640 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622efa07350 0x5622efa0ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca22ffd640 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622efa0a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca237fe640 1 -- 172.21.15.82:0/2989658575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622efa07350 msgr2=0x5622efa0ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca237fe640 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622efa07350 0x5622efa0ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca237fe640 1 -- 172.21.15.82:0/2989658575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 msgr2=0x5622efa0a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca237fe640 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622efa0a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca237fe640 1 -- 172.21.15.82:0/2989658575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622ef79df70 con 0x5622ef9fde50 2024-03-27T07:25:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca237fe640 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa0f100 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fca14001eb0 tx=0x7fca1401c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581d9015994807b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca02ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca02ffd640 1 -- 172.21.15.82:0/2989658575 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14029030 con 0x5622ef9fde50 2024-03-27T07:25:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca02ffd640 1 -- 172.21.15.82:0/2989658575 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fca14018040 con 0x5622ef9fde50 2024-03-27T07:25:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca2c7b8740 1 -- 172.21.15.82:0/2989658575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca1c003e50 con 0x5622ef9fde50 2024-03-27T07:25:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca02ffd640 1 -- 172.21.15.82:0/2989658575 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fca14033050 con 0x5622ef9fde50 2024-03-27T07:25:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.107+0000 7fca2c7b8740 10 client.15960 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca2c7b8740 1 -- 172.21.15.82:0/2989658575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5622ef635170 con 0x5622ef9fde50 2024-03-27T07:25:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca02ffd640 1 -- 172.21.15.82:0/2989658575 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca1c003e50 con 0x5622ef9fde50 2024-03-27T07:25:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca02ffd640 1 -- 172.21.15.82:0/2989658575 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7fca14003710 con 0x5622ef9fde50 2024-03-27T07:25:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca2c7b8740 10 client.15960 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca2c7b8740 10 client.15960 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca2c7b8740 20 client.15960 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5622efa7d5a0 0x5622efa7f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca2c7b8740 4 client.15960 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T07:25:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca2c7b8740 1 -- 172.21.15.82:0/2989658575 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5622ef968cc0 con 0x5622efa7d5a0 2024-03-27T07:25:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca22ffd640 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5622efa7d5a0 0x5622efa7f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca02ffd640 10 client.15960 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.108+0000 7fca22ffd640 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5622efa7d5a0 0x5622efa7f9c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b320a5f1fc5d92e2 server_cookie=f0a9ebcd84cc1ae6 in_seq=0 out_seq=0 2024-03-27T07:25:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca02ffd640 1 -- 172.21.15.82:0/2989658575 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5622ef968cc0 con 0x5622efa7d5a0 2024-03-27T07:25:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca02ffd640 10 client.15960 handle_command_reply: tid=0 2024-03-27T07:25:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 client.15960 shutdown 2024-03-27T07:25:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 -- 172.21.15.82:0/2989658575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 msgr2=0x5622efa0f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa0f100 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fca14001eb0 tx=0x7fca1401c630 comp rx=0 tx=0).stop 2024-03-27T07:25:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 -- 172.21.15.82:0/2989658575 shutdown_connections 2024-03-27T07:25:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5622efa07350 0x5622efa0ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5622ef9fe770 0x5622efa0a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5622efa7d5a0 0x5622efa7f9c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 --2- 172.21.15.82:0/2989658575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622ef9fde50 0x5622efa0f100 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca02ffd640 0 client.15960 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 -- 172.21.15.82:0/2989658575 >> 172.21.15.82:0/2989658575 conn(0x5622ef9f8580 msgr2=0x5622ef9f7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 -- 172.21.15.82:0/2989658575 shutdown_connections 2024-03-27T07:25:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 1 -- 172.21.15.82:0/2989658575 wait complete. 2024-03-27T07:25:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.110+0000 7fca2c7b8740 20 client.15960 trim_cache size 0 max 16384 2024-03-27T07:25:17.122 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:25:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-03-27T07:25:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "398ca2d5-0456-4091-b53b-9d6829459295", 2024-03-27T07:25:17.122 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-03-27T07:25:17.122 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:25:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 -- 172.21.15.82:0/2392192267 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fca0c0a3780 msgr2=0x7fca0c0a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fca0c0a3780 0x7fca0c0a5c40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fca1c005fd0 tx=0x7fca1c009e00 comp rx=0 tx=0).stop 2024-03-27T07:25:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 -- 172.21.15.82:0/2392192267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca241024a0 msgr2=0x7fca24198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca241024a0 0x7fca24198960 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fca18009900 tx=0x7fca18004360 comp rx=0 tx=0).stop 2024-03-27T07:25:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 -- 172.21.15.82:0/2392192267 shutdown_connections 2024-03-27T07:25:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fca0c0a3780 0x7fca0c0a5c40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca241024a0 0x7fca24198960 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fca24107b80 0x7fca2419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 --2- 172.21.15.82:0/2392192267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca24101ae0 0x7fca24198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 -- 172.21.15.82:0/2392192267 >> 172.21.15.82:0/2392192267 conn(0x7fca24078f50 msgr2=0x7fca24104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 -- 172.21.15.82:0/2392192267 shutdown_connections 2024-03-27T07:25:17.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.111+0000 7fca29af4640 1 -- 172.21.15.82:0/2392192267 wait complete. 2024-03-27T07:25:17.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:25:17.125 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:25:17.155 INFO:tasks.workunit.client.0.smithi082.stdout:Spawning 3 writers... 2024-03-27T07:25:17.155 INFO:tasks.workunit.client.0.smithi082.stdout:Spawning 1 rewriters... 2024-03-27T07:25:17.155 INFO:tasks.workunit.client.0.smithi082.stdout:Spawning 5 commenters... 2024-03-27T07:25:17.155 INFO:tasks.workunit.client.0.smithi082.stdout:Spawning 100 readers... 2024-03-27T07:25:17.156 INFO:tasks.workunit.client.0.smithi082.stdout:Benchmarking for 30 iterations. 2024-03-27T07:25:17.156 INFO:tasks.workunit.client.0.smithi082.stdout:The test will run during 5 minutes. 2024-03-27T07:25:17.156 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-03-27T07:25:17.156 INFO:tasks.workunit.client.0.smithi082.stdout: Nb blogs R articles W articles R pictures W pictures R comments W comments 2024-03-27T07:25:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.229+0000 7f503b577640 1 -- 172.21.15.82:0/3247126517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50341066d0 msgr2=0x7f5034106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.229+0000 7f503b577640 1 --2- 172.21.15.82:0/3247126517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50341066d0 0x7f5034106b50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5024009900 tx=0x7f502402bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.229+0000 7f503b577640 1 -- 172.21.15.82:0/3247126517 shutdown_connections 2024-03-27T07:25:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.229+0000 7f503b577640 1 --2- 172.21.15.82:0/3247126517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f50341066d0 0x7f5034106b50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.229+0000 7f503b577640 1 --2- 172.21.15.82:0/3247126517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5034107090 0x7f503410e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.229+0000 7f503b577640 1 --2- 172.21.15.82:0/3247126517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5034069130 0x7f5034069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.229+0000 7f503b577640 1 -- 172.21.15.82:0/3247126517 >> 172.21.15.82:0/3247126517 conn(0x7f5034077b50 msgr2=0x7f5034077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.229+0000 7f503b577640 1 -- 172.21.15.82:0/3247126517 shutdown_connections 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.229+0000 7f503b577640 1 -- 172.21.15.82:0/3247126517 wait complete. 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f503b577640 1 Processor -- start 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f503b577640 1 -- start start 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f503b577640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034069130 0x7f50341983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f503b577640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50341066d0 0x7f50341988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f503b577640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5034107090 0x7f503419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f503b577640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5034111ed0 con 0x7f5034069130 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f503b577640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5034111d50 con 0x7f5034107090 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f503b577640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5034112050 con 0x7f50341066d0 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f5039313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034069130 0x7f50341983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f5039313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034069130 0x7f50341983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58348/0 (socket says 172.21.15.82:58348) 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f5039313640 1 -- 172.21.15.82:0/3285151374 learned_addr learned my addr 172.21.15.82:0/3285151374 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:17.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f5039b14640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5034107090 0x7f503419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f5038b12640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50341066d0 0x7f50341988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f5039313640 1 -- 172.21.15.82:0/3285151374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50341066d0 msgr2=0x7f50341988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f5039313640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50341066d0 0x7f50341988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f5039313640 1 -- 172.21.15.82:0/3285151374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5034107090 msgr2=0x7f503419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f5039313640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5034107090 0x7f503419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.230+0000 7f5039313640 1 -- 172.21.15.82:0/3285151374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f503419d3a0 con 0x7f5034069130 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.231+0000 7f5039313640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034069130 0x7f50341983b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f503000e9f0 tx=0x7f503000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.231+0000 7f502a7fc640 1 -- 172.21.15.82:0/3285151374 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503000cd80 con 0x7f5034069130 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.231+0000 7f502a7fc640 1 -- 172.21.15.82:0/3285151374 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5030010910 con 0x7f5034069130 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.231+0000 7f503b577640 1 -- 172.21.15.82:0/3285151374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f503419d690 con 0x7f5034069130 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.231+0000 7f502a7fc640 1 -- 172.21.15.82:0/3285151374 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030018990 con 0x7f5034069130 2024-03-27T07:25:17.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.231+0000 7f503b577640 1 -- 172.21.15.82:0/3285151374 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50341a4f20 con 0x7f5034069130 2024-03-27T07:25:17.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.233+0000 7f502a7fc640 1 -- 172.21.15.82:0/3285151374 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f5030010ac0 con 0x7f5034069130 2024-03-27T07:25:17.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.233+0000 7f503e23a740 1 Processor -- start 2024-03-27T07:25:17.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.233+0000 7f503e23a740 1 -- start start 2024-03-27T07:25:17.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f503e23a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef785c30 0x5562ef786010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f503e23a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 0x5562ef793620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f503e23a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef793b60 0x5562ef795f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f503e23a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5562ef6ea860 con 0x5562ef793b60 2024-03-27T07:25:17.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f503e23a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5562ef6928d0 con 0x5562ef7865e0 2024-03-27T07:25:17.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f503e23a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5562ef6e6810 con 0x5562ef785c30 2024-03-27T07:25:17.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f502a7fc640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f50200a3780 0x7f50200a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5038b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef793b60 0x5562ef795f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5039b14640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f50200a3780 0x7f50200a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5039313640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 0x5562ef793620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5038b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef793b60 0x5562ef795f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58356/0 (socket says 172.21.15.82:58356) 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5038b12640 1 -- 172.21.15.82:0/2137148612 learned_addr learned my addr 172.21.15.82:0/2137148612 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5039b14640 1 --2- 172.21.15.82:0/2137148612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef785c30 0x5562ef786010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f502a7fc640 1 -- 172.21.15.82:0/3285151374 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f50300d0400 con 0x7f5034069130 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5038b12640 1 -- 172.21.15.82:0/2137148612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef785c30 msgr2=0x5562ef786010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5038b12640 1 --2- 172.21.15.82:0/2137148612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef785c30 0x5562ef786010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5038b12640 1 -- 172.21.15.82:0/2137148612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 msgr2=0x5562ef793620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5038b12640 1 --2- 172.21.15.82:0/2137148612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 0x5562ef793620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5038b12640 1 -- 172.21.15.82:0/2137148612 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ef69d120 con 0x5562ef793b60 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5039313640 1 --2- 172.21.15.82:0/2137148612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 0x5562ef793620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:17.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5039b14640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f50200a3780 0x7f50200a5c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f502c005fd0 tx=0x7f502c009e80 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f5038b12640 1 --2- 172.21.15.82:0/2137148612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef793b60 0x5562ef795f50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f502402cfd0 tx=0x7f5024005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24e7ce8149e8d55 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.234+0000 7f501f7fe640 1 -- 172.21.15.82:0/2137148612 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024042070 con 0x5562ef793b60 2024-03-27T07:25:17.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f501f7fe640 1 -- 172.21.15.82:0/2137148612 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f502402c690 con 0x5562ef793b60 2024-03-27T07:25:17.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f501f7fe640 1 -- 172.21.15.82:0/2137148612 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024004f00 con 0x5562ef793b60 2024-03-27T07:25:17.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f503e23a740 1 -- 172.21.15.82:0/2137148612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef793b60 msgr2=0x5562ef795f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f503e23a740 1 --2- 172.21.15.82:0/2137148612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef793b60 0x5562ef795f50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f502402cfd0 tx=0x7f5024005c00 comp rx=0 tx=0).stop 2024-03-27T07:25:17.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f503e23a740 1 -- 172.21.15.82:0/2137148612 shutdown_connections 2024-03-27T07:25:17.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f503e23a740 1 --2- 172.21.15.82:0/2137148612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef793b60 0x5562ef795f50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f503e23a740 1 --2- 172.21.15.82:0/2137148612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 0x5562ef793620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f503e23a740 1 --2- 172.21.15.82:0/2137148612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef785c30 0x5562ef786010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f503e23a740 1 -- 172.21.15.82:0/2137148612 >> 172.21.15.82:0/2137148612 conn(0x5562ef780980 msgr2=0x5562ef780d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f503e23a740 1 -- 172.21.15.82:0/2137148612 shutdown_connections 2024-03-27T07:25:17.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.235+0000 7f503e23a740 1 -- 172.21.15.82:0/2137148612 wait complete. 2024-03-27T07:25:17.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f503e23a740 1 -- start start 2024-03-27T07:25:17.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f503e23a740 1 Processor -- start 2024-03-27T07:25:17.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f503e23a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 0x5562ef790b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f503e23a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef791070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f503e23a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef7915b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f503e23a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5562ef7968c0 con 0x5562ef7865e0 2024-03-27T07:25:17.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f503e23a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5562ef6a5cd0 con 0x5562ef785c30 2024-03-27T07:25:17.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f503e23a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5562ef796a40 con 0x5562ef793b60 2024-03-27T07:25:17.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f503e23a740 10 client.0 _ll_register_callbacks cb 0x5562ef697ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:17.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5038b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef791070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5038b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef791070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58372/0 (socket says 172.21.15.82:58372) 2024-03-27T07:25:17.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5039313640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 0x5562ef790b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5038b12640 1 -- 172.21.15.82:0/32848176 learned_addr learned my addr 172.21.15.82:0/32848176 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:17.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5039b14640 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef7915b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5038b12640 1 -- 172.21.15.82:0/32848176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 msgr2=0x5562ef7915b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5038b12640 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef7915b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5038b12640 1 -- 172.21.15.82:0/32848176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 msgr2=0x5562ef790b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5038b12640 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 0x5562ef790b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5038b12640 1 -- 172.21.15.82:0/32848176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ef4c87d0 con 0x5562ef7865e0 2024-03-27T07:25:17.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.236+0000 7f5039313640 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 0x5562ef790b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:17.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f5038b12640 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef791070 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5024000c00 tx=0x7f502402cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f597b2a79e50da7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f501cff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:17.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f501cff9640 1 -- 172.21.15.82:0/32848176 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502404b070 con 0x5562ef7865e0 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f501cff9640 1 -- 172.21.15.82:0/32848176 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f5024004230 con 0x5562ef7865e0 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f503e23a740 1 -- 172.21.15.82:0/32848176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5562ef6f7da0 con 0x5562ef7865e0 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f501cff9640 1 -- 172.21.15.82:0/32848176 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f5024054050 con 0x5562ef7865e0 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f503e23a740 10 client.15972 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f503e23a740 1 -- 172.21.15.82:0/32848176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5562ef3fe3f0 con 0x5562ef7865e0 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f501cff9640 1 -- 172.21.15.82:0/32848176 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5562ef6f7da0 con 0x5562ef7865e0 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f501cff9640 1 -- 172.21.15.82:0/32848176 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f502404e020 con 0x5562ef7865e0 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f503e23a740 10 client.15972 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f503e23a740 10 client.15972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f503e23a740 20 client.15972 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:17.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f503e23a740 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5562ef7a3d20 0x5562ef7a6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f503e23a740 4 client.15972 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.237+0000 7f503e23a740 1 -- 172.21.15.82:0/32848176 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562ef6f20f0 con 0x5562ef7a3d20 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.238+0000 7f5039313640 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5562ef7a3d20 0x5562ef7a6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.238+0000 7f501cff9640 10 client.15972 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.238+0000 7f5039313640 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5562ef7a3d20 0x5562ef7a6110 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba099688aed1f49 server_cookie=142872a5865c2aab in_seq=0 out_seq=0 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f501cff9640 1 -- 172.21.15.82:0/32848176 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5562ef6f20f0 con 0x5562ef7a3d20 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f501cff9640 10 client.15972 handle_command_reply: tid=0 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 client.15972 shutdown 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 -- 172.21.15.82:0/32848176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 msgr2=0x5562ef791070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef791070 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5024000c00 tx=0x7f502402cb30 comp rx=0 tx=0).stop 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 -- 172.21.15.82:0/32848176 shutdown_connections 2024-03-27T07:25:17.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5562ef7a3d20 0x5562ef7a6110 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef791070 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f501cff9640 0 client.15972 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef7915b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 --2- 172.21.15.82:0/32848176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 0x5562ef790b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 -- 172.21.15.82:0/32848176 >> 172.21.15.82:0/32848176 conn(0x5562ef780980 msgr2=0x5562ef7826d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 -- 172.21.15.82:0/32848176 shutdown_connections 2024-03-27T07:25:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 1 -- 172.21.15.82:0/32848176 wait complete. 2024-03-27T07:25:17.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.240+0000 7f503e23a740 20 client.15972 trim_cache size 0 max 16384 2024-03-27T07:25:17.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f503e23a740 1 Processor -- start 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f503e23a740 1 -- start start 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f503e23a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 0x5562ef78fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f503e23a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef78be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f503e23a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef79f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f503e23a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50341adce0 con 0x5562ef7865e0 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f503e23a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f50341ab5b0 con 0x5562ef785c30 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f503e23a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f50341a9400 con 0x5562ef793b60 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f5038b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef78be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f5038b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef78be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58382/0 (socket says 172.21.15.82:58382) 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.258+0000 7f5038b12640 1 -- 172.21.15.82:0/1786647450 learned_addr learned my addr 172.21.15.82:0/1786647450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f5039313640 1 --2- 172.21.15.82:0/1786647450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 0x5562ef78fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f5039b14640 1 --2- 172.21.15.82:0/1786647450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef79f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f5038b12640 1 -- 172.21.15.82:0/1786647450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 msgr2=0x5562ef79f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f5038b12640 1 --2- 172.21.15.82:0/1786647450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef79f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f5038b12640 1 -- 172.21.15.82:0/1786647450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 msgr2=0x5562ef78fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f5038b12640 1 --2- 172.21.15.82:0/1786647450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 0x5562ef78fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f5038b12640 1 -- 172.21.15.82:0/1786647450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562ef3be0f0 con 0x5562ef7865e0 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f5038b12640 1 --2- 172.21.15.82:0/1786647450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef78be40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5024003980 tx=0x7f5024005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b1532c64d4534 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f501effd640 1 -- 172.21.15.82:0/1786647450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502404b070 con 0x5562ef7865e0 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f501effd640 1 -- 172.21.15.82:0/1786647450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5024005850 con 0x5562ef7865e0 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.259+0000 7f501effd640 1 -- 172.21.15.82:0/1786647450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024042040 con 0x5562ef7865e0 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 -- 172.21.15.82:0/1786647450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 msgr2=0x5562ef78be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 --2- 172.21.15.82:0/1786647450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef78be40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5024003980 tx=0x7f5024005c00 comp rx=0 tx=0).stop 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 -- 172.21.15.82:0/1786647450 shutdown_connections 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 --2- 172.21.15.82:0/1786647450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef7865e0 0x5562ef78be40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 --2- 172.21.15.82:0/1786647450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef79f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 --2- 172.21.15.82:0/1786647450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef785c30 0x5562ef78fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 -- 172.21.15.82:0/1786647450 >> 172.21.15.82:0/1786647450 conn(0x5562ef780980 msgr2=0x5562ef7825e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 -- 172.21.15.82:0/1786647450 shutdown_connections 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 -- 172.21.15.82:0/1786647450 wait complete. 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 -- start start 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 Processor -- start 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef785c30 0x5562ef79bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 0x5562ef797230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef797770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f50341a9a70 con 0x5562ef785c30 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f50341aaee0 con 0x5562ef7865e0 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f50341aa140 con 0x5562ef793b60 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f503e23a740 10 client.0 _ll_register_callbacks cb 0x7f503000cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.260+0000 7f5039313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef785c30 0x5562ef79bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f5039313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef785c30 0x5562ef79bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58390/0 (socket says 172.21.15.82:58390) 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f5039313640 1 -- 172.21.15.82:0/3853715186 learned_addr learned my addr 172.21.15.82:0/3853715186 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f5039b14640 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef797770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f5038b12640 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 0x5562ef797230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f5039313640 1 -- 172.21.15.82:0/3853715186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 msgr2=0x5562ef797770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f5039313640 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef797770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f5039313640 1 -- 172.21.15.82:0/3853715186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 msgr2=0x5562ef797230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f5039313640 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 0x5562ef797230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f5039313640 1 -- 172.21.15.82:0/3853715186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562ef797db0 con 0x5562ef785c30 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f5039313640 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef785c30 0x5562ef79bdc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f503000e9c0 tx=0x7f5030025360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eecf68492a76df3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f501cff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f501cff9640 1 -- 172.21.15.82:0/3853715186 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030025170 con 0x5562ef785c30 2024-03-27T07:25:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f501cff9640 1 -- 172.21.15.82:0/3853715186 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f50300cde20 con 0x5562ef785c30 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f503e23a740 1 -- 172.21.15.82:0/3853715186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5024005850 con 0x5562ef785c30 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f501cff9640 1 -- 172.21.15.82:0/3853715186 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f50300ce020 con 0x5562ef785c30 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f503e23a740 10 client.15978 fetch_fsmap learned FSMap version 22 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f503e23a740 1 -- 172.21.15.82:0/3853715186 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=4+}) -- 0x5562ef809c40 con 0x5562ef785c30 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f501cff9640 1 -- 172.21.15.82:0/3853715186 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5024005850 con 0x5562ef785c30 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f501cff9640 1 -- 172.21.15.82:0/3853715186 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 22) ==== 8338+0+0 (secure 0 0 0) 0x7f50300cf040 con 0x5562ef785c30 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f503e23a740 10 client.15978 fetch_fsmap finished waiting for FSMap version 22 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f503e23a740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f503e23a740 20 client.15978 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f503e23a740 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5562ef7a3d20 0x5562ef80c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f503e23a740 4 client.15978 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.261+0000 7f503e23a740 1 -- 172.21.15.82:0/3853715186 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5562ef66f540 con 0x5562ef7a3d20 2024-03-27T07:25:17.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.262+0000 7f5038b12640 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5562ef7a3d20 0x5562ef80c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:17.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.262+0000 7f501cff9640 10 client.15978 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:17.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.262+0000 7f5038b12640 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5562ef7a3d20 0x5562ef80c380 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f5a03935fdb4e03 server_cookie=8735f9bab466f5a5 in_seq=0 out_seq=0 2024-03-27T07:25:17.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.265+0000 7f501cff9640 1 -- 172.21.15.82:0/3853715186 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5562ef66f540 con 0x5562ef7a3d20 2024-03-27T07:25:17.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.265+0000 7f501cff9640 10 client.15978 handle_command_reply: tid=0 2024-03-27T07:25:17.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.265+0000 7f503e23a740 1 client.15978 shutdown 2024-03-27T07:25:17.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 1 -- 172.21.15.82:0/3853715186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef785c30 msgr2=0x5562ef79bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef785c30 0x5562ef79bdc0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f503000e9c0 tx=0x7f5030025360 comp rx=0 tx=0).stop 2024-03-27T07:25:17.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 1 -- 172.21.15.82:0/3853715186 shutdown_connections 2024-03-27T07:25:17.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5562ef793b60 0x5562ef797770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5562ef7865e0 0x5562ef797230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5562ef7a3d20 0x5562ef80c380 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 1 --2- 172.21.15.82:0/3853715186 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5562ef785c30 0x5562ef79bdc0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f501cff9640 0 client.15978 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:17.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 1 -- 172.21.15.82:0/3853715186 >> 172.21.15.82:0/3853715186 conn(0x5562ef780980 msgr2=0x5562ef790ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 1 -- 172.21.15.82:0/3853715186 shutdown_connections 2024-03-27T07:25:17.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 1 -- 172.21.15.82:0/3853715186 wait complete. 2024-03-27T07:25:17.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503e23a740 20 client.15978 trim_cache size 0 max 16384 2024-03-27T07:25:17.274 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:25:17.274 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-27T07:25:17.274 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-03-27T07:25:17.275 INFO:teuthology.orchestra.run.smithi082.stdout: "398ca2d5-0456-4091-b53b-9d6829459295": { 2024-03-27T07:25:17.275 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-03-27T07:25:17.275 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "398ca2d5-0456-4091-b53b-9d6829459295", 2024-03-27T07:25:17.275 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-03-27T07:25:17.275 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:25:17.275 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:25:17.275 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503b577640 1 -- 172.21.15.82:0/3285151374 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f50200a3780 msgr2=0x7f50200a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503b577640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f50200a3780 0x7f50200a5c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f502c005fd0 tx=0x7f502c009e80 comp rx=0 tx=0).stop 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503b577640 1 -- 172.21.15.82:0/3285151374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034069130 msgr2=0x7f50341983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503b577640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034069130 0x7f50341983b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f503000e9f0 tx=0x7f503000eeb0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503b577640 1 -- 172.21.15.82:0/3285151374 shutdown_connections 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503b577640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f50200a3780 0x7f50200a5c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503b577640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5034107090 0x7f503419cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503b577640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50341066d0 0x7f50341988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503b577640 1 --2- 172.21.15.82:0/3285151374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5034069130 0x7f50341983b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.266+0000 7f503b577640 1 -- 172.21.15.82:0/3285151374 >> 172.21.15.82:0/3285151374 conn(0x7f5034077b50 msgr2=0x7f50340fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:17.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.267+0000 7f503b577640 1 -- 172.21.15.82:0/3285151374 shutdown_connections 2024-03-27T07:25:17.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:17.267+0000 7f503b577640 1 -- 172.21.15.82:0/3285151374 wait complete. 2024-03-27T07:25:17.280 INFO:tasks.cephfs.filesystem:scrub status for tag:398ca2d5-0456-4091-b53b-9d6829459295 - {'path': '/', 'tag': '398ca2d5-0456-4091-b53b-9d6829459295', 'options': 'recursive,force'} 2024-03-27T07:25:18.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:18 smithi082 ceph-mon[32178]: pgmap v54: 97 pgs: 97 active+clean; 5.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 485 KiB/s wr, 93 op/s 2024-03-27T07:25:18.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:18 smithi082 ceph-mon[32178]: scrub queued for path: / 2024-03-27T07:25:18.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:18 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:18.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:18 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:18.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:18 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:18.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:18 smithi149 ceph-mon[36065]: pgmap v54: 97 pgs: 97 active+clean; 5.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 485 KiB/s wr, 93 op/s 2024-03-27T07:25:18.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:18 smithi149 ceph-mon[36065]: scrub queued for path: / 2024-03-27T07:25:18.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:18 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:18.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:18 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:18.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:18 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:18.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:18 smithi153 ceph-mon[36179]: pgmap v54: 97 pgs: 97 active+clean; 5.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 485 KiB/s wr, 93 op/s 2024-03-27T07:25:18.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:18 smithi153 ceph-mon[36179]: scrub queued for path: / 2024-03-27T07:25:18.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:18 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:18.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:18 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:18.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:18 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:19.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:19 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:25:19.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:19 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:25:19.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:19 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:25:20.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:20 smithi082 ceph-mon[32178]: pgmap v55: 97 pgs: 97 active+clean; 5.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 463 KiB/s wr, 77 op/s 2024-03-27T07:25:20.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:20 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:20.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:20 smithi149 ceph-mon[36065]: pgmap v55: 97 pgs: 97 active+clean; 5.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 463 KiB/s wr, 77 op/s 2024-03-27T07:25:20.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:20 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:20.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:20 smithi153 ceph-mon[36179]: pgmap v55: 97 pgs: 97 active+clean; 5.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 463 KiB/s wr, 77 op/s 2024-03-27T07:25:20.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:20 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:21.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:21 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:21 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:21 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:22.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:22 smithi082 ceph-mon[32178]: pgmap v56: 97 pgs: 97 active+clean; 10 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 915 KiB/s wr, 105 op/s 2024-03-27T07:25:22.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:22 smithi149 ceph-mon[36065]: pgmap v56: 97 pgs: 97 active+clean; 10 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 915 KiB/s wr, 105 op/s 2024-03-27T07:25:22.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:22 smithi153 ceph-mon[36179]: pgmap v56: 97 pgs: 97 active+clean; 10 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 915 KiB/s wr, 105 op/s 2024-03-27T07:25:24.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:24 smithi082 ceph-mon[32178]: pgmap v57: 97 pgs: 97 active+clean; 10 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 808 KiB/s wr, 98 op/s 2024-03-27T07:25:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:24 smithi149 ceph-mon[36065]: pgmap v57: 97 pgs: 97 active+clean; 10 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 808 KiB/s wr, 98 op/s 2024-03-27T07:25:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:24 smithi153 ceph-mon[36179]: pgmap v57: 97 pgs: 97 active+clean; 10 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 808 KiB/s wr, 98 op/s 2024-03-27T07:25:25.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:25 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:25.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:25 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:25.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:25 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:26.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:26 smithi082 ceph-mon[32178]: pgmap v58: 97 pgs: 97 active+clean; 10 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 808 KiB/s wr, 98 op/s 2024-03-27T07:25:26.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:26 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:26.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:26 smithi149 ceph-mon[36065]: pgmap v58: 97 pgs: 97 active+clean; 10 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 808 KiB/s wr, 98 op/s 2024-03-27T07:25:26.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:26 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:26.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:26 smithi153 ceph-mon[36179]: pgmap v58: 97 pgs: 97 active+clean; 10 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 808 KiB/s wr, 98 op/s 2024-03-27T07:25:26.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:26 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:25:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 -- 172.21.15.82:0/3637475320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ec101660 msgr2=0x7f36ec10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 --2- 172.21.15.82:0/3637475320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ec101660 0x7f36ec10d880 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009ca0 tx=0x7f36e402c0f0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 -- 172.21.15.82:0/3637475320 shutdown_connections 2024-03-27T07:25:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 --2- 172.21.15.82:0/3637475320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ec101660 0x7f36ec10d880 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.879 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 --2- 172.21.15.82:0/3637475320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec100ca0 0x7f36ec101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 --2- 172.21.15.82:0/3637475320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36ec1059f0 0x7f36ec105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 -- 172.21.15.82:0/3637475320 >> 172.21.15.82:0/3637475320 conn(0x7f36ec0778a0 msgr2=0x7f36ec077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 -- 172.21.15.82:0/3637475320 shutdown_connections 2024-03-27T07:25:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 -- 172.21.15.82:0/3637475320 wait complete. 2024-03-27T07:25:26.880 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 Processor -- start 2024-03-27T07:25:26.881 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.877+0000 7f36f1fe2640 1 -- start start 2024-03-27T07:25:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36f1fe2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec100ca0 0x7f36ec1973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36f1fe2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ec101660 0x7f36ec1978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36f1fe2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36ec1059f0 0x7f36ec19bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36f1fe2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec110f10 con 0x7f36ec101660 2024-03-27T07:25:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36f1fe2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec110d90 con 0x7f36ec1059f0 2024-03-27T07:25:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36f1fe2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec111090 con 0x7f36ec100ca0 2024-03-27T07:25:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36eaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ec101660 0x7f36ec1978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36eaffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ec101660 0x7f36ec1978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39942/0 (socket says 172.21.15.82:39942) 2024-03-27T07:25:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36eaffd640 1 -- 172.21.15.82:0/2643308944 learned_addr learned my addr 172.21.15.82:0/2643308944 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:26.882 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec100ca0 0x7f36ec1973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36ebfff640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36ec1059f0 0x7f36ec19bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36eaffd640 1 -- 172.21.15.82:0/2643308944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec100ca0 msgr2=0x7f36ec1973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36eaffd640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec100ca0 0x7f36ec1973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36eaffd640 1 -- 172.21.15.82:0/2643308944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36ec1059f0 msgr2=0x7f36ec19bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36eaffd640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36ec1059f0 0x7f36ec19bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36eaffd640 1 -- 172.21.15.82:0/2643308944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36ec19c350 con 0x7f36ec101660 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36eaffd640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ec101660 0x7f36ec1978f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f36e000eb00 tx=0x7f36e000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36e8ff9640 1 -- 172.21.15.82:0/2643308944 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e000bc30 con 0x7f36ec101660 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36f1fe2640 1 -- 172.21.15.82:0/2643308944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36ec19c640 con 0x7f36ec101660 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36e8ff9640 1 -- 172.21.15.82:0/2643308944 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36e000bdd0 con 0x7f36ec101660 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36e8ff9640 1 -- 172.21.15.82:0/2643308944 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0017410 con 0x7f36ec101660 2024-03-27T07:25:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.878+0000 7f36f1fe2640 1 -- 172.21.15.82:0/2643308944 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36ec0691d0 con 0x7f36ec101660 2024-03-27T07:25:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.880+0000 7f36e8ff9640 1 -- 172.21.15.82:0/2643308944 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f36e0005020 con 0x7f36ec101660 2024-03-27T07:25:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36f4bd5740 1 Processor -- start 2024-03-27T07:25:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36e8ff9640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f36d40a3820 0x7f36d40a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36f4bd5740 1 -- start start 2024-03-27T07:25:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36ebfff640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f36d40a3820 0x7f36d40a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36e8ff9640 1 -- 172.21.15.82:0/2643308944 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f36e00d1960 con 0x7f36ec101660 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b96c10 0x55fdf0b96ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b97530 0x55fdf0ba46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fdf0b5dcd0 con 0x55fdf0ba4bf0 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55fdf0aa2950 con 0x55fdf0b97530 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fdf0afae50 con 0x55fdf0b96c10 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36eaffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b97530 0x55fdf0ba46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36eb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b96c10 0x55fdf0b96ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36eb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b96c10 0x55fdf0b96ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:34694/0 (socket says 172.21.15.82:34694) 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.881+0000 7f36eb7fe640 1 -- 172.21.15.82:0/1676826124 learned_addr learned my addr 172.21.15.82:0/1676826124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36ebfff640 1 --2- 172.21.15.82:0/1676826124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36eb7fe640 1 -- 172.21.15.82:0/1676826124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b97530 msgr2=0x55fdf0ba46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/1676826124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b97530 0x55fdf0ba46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36ebfff640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f36d40a3820 0x7f36d40a5ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f36e4004af0 tx=0x7f36e4032360 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36eb7fe640 1 -- 172.21.15.82:0/1676826124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 msgr2=0x55fdf0ba6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/1676826124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36eb7fe640 1 -- 172.21.15.82:0/1676826124 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdf080f210 con 0x55fdf0b96c10 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/1676826124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b96c10 0x55fdf0b96ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36dc009c70 tx=0x7f36dc011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aac4124fb22795c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36d1ffb640 1 -- 172.21.15.82:0/1676826124 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc004230 con 0x55fdf0b96c10 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36d1ffb640 1 -- 172.21.15.82:0/1676826124 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36dc0043d0 con 0x55fdf0b96c10 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.882+0000 7f36d1ffb640 1 -- 172.21.15.82:0/1676826124 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc019740 con 0x55fdf0b96c10 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 -- 172.21.15.82:0/1676826124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b96c10 msgr2=0x55fdf0b96ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/1676826124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b96c10 0x55fdf0b96ff0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f36dc009c70 tx=0x7f36dc011810 comp rx=0 tx=0).stop 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 -- 172.21.15.82:0/1676826124 shutdown_connections 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/1676826124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/1676826124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b97530 0x55fdf0ba46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/1676826124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b96c10 0x55fdf0b96ff0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 -- 172.21.15.82:0/1676826124 >> 172.21.15.82:0/1676826124 conn(0x55fdf0b91a10 msgr2=0x55fdf0b91df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 -- 172.21.15.82:0/1676826124 shutdown_connections 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 -- 172.21.15.82:0/1676826124 wait complete. 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 -- start start 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.883+0000 7f36f4bd5740 1 Processor -- start 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0ba1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b97530 0x55fdf0ba20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fdf0af6e00 con 0x55fdf0b96c10 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55fdf0aa3520 con 0x55fdf0ba4bf0 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fdf0ab68e0 con 0x55fdf0b97530 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36f4bd5740 10 client.0 _ll_register_callbacks cb 0x55fdf0af1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36eb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0ba1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36eb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0ba1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39966/0 (socket says 172.21.15.82:39966) 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36eb7fe640 1 -- 172.21.15.82:0/2129354939 learned_addr learned my addr 172.21.15.82:0/2129354939 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36eaffd640 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b97530 0x55fdf0ba20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36ebfff640 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36eb7fe640 1 -- 172.21.15.82:0/2129354939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b97530 msgr2=0x55fdf0ba20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b97530 0x55fdf0ba20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36eb7fe640 1 -- 172.21.15.82:0/2129354939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0ba4bf0 msgr2=0x55fdf0ba2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36eb7fe640 1 -- 172.21.15.82:0/2129354939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdf08db620 con 0x55fdf0b96c10 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0ba1bb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f36dc000c00 tx=0x7f36dc009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af324f6f633d42a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36caffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36caffd640 1 -- 172.21.15.82:0/2129354939 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc027020 con 0x55fdf0b96c10 2024-03-27T07:25:26.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36caffd640 1 -- 172.21.15.82:0/2129354939 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f36dc005240 con 0x55fdf0b96c10 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.884+0000 7f36f4bd5740 1 -- 172.21.15.82:0/2129354939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36dc0043d0 con 0x55fdf0b96c10 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36caffd640 1 -- 172.21.15.82:0/2129354939 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f36dc032050 con 0x55fdf0b96c10 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36f4bd5740 10 client.15990 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36f4bd5740 1 -- 172.21.15.82:0/2129354939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fdf0bb3730 con 0x55fdf0b96c10 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36caffd640 1 -- 172.21.15.82:0/2129354939 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36dc0043d0 con 0x55fdf0b96c10 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36caffd640 1 -- 172.21.15.82:0/2129354939 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f36dc018070 con 0x55fdf0b96c10 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36f4bd5740 10 client.15990 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36f4bd5740 10 client.15990 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36f4bd5740 20 client.15990 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fdf0bb4ad0 0x55fdf0bb6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36f4bd5740 4 client.15990 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36f4bd5740 1 -- 172.21.15.82:0/2129354939 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdf0b08390 con 0x55fdf0bb4ad0 2024-03-27T07:25:26.895 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.885+0000 7f36eaffd640 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fdf0bb4ad0 0x55fdf0bb6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.886+0000 7f36caffd640 10 client.15990 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.886+0000 7f36eaffd640 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fdf0bb4ad0 0x55fdf0bb6ec0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75e29a2788648715 server_cookie=4c56d5a9007092c1 in_seq=0 out_seq=0 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36caffd640 1 -- 172.21.15.82:0/2129354939 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55fdf0b08390 con 0x55fdf0bb4ad0 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36caffd640 10 client.15990 handle_command_reply: tid=0 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 client.15990 shutdown 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 -- 172.21.15.82:0/2129354939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 msgr2=0x55fdf0ba1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0ba1bb0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f36dc000c00 tx=0x7f36dc009ee0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 -- 172.21.15.82:0/2129354939 shutdown_connections 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b97530 0x55fdf0ba20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fdf0bb4ad0 0x55fdf0bb6ec0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/2129354939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0ba1bb0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.896 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36caffd640 0 client.15990 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 -- 172.21.15.82:0/2129354939 >> 172.21.15.82:0/2129354939 conn(0x55fdf0b91a10 msgr2=0x55fdf0b93760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 -- 172.21.15.82:0/2129354939 shutdown_connections 2024-03-27T07:25:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 1 -- 172.21.15.82:0/2129354939 wait complete. 2024-03-27T07:25:26.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.887+0000 7f36f4bd5740 20 client.15990 trim_cache size 0 max 16384 2024-03-27T07:25:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.903+0000 7f36f4bd5740 1 Processor -- start 2024-03-27T07:25:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.903+0000 7f36f4bd5740 1 -- start start 2024-03-27T07:25:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.903+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b96c10 0x55fdf0ba42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.907 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.903+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b97530 0x55fdf0bb0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.908 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.903+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0bbc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.903+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1aded0 con 0x55fdf0ba4bf0 2024-03-27T07:25:26.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.903+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1ab740 con 0x55fdf0b96c10 2024-03-27T07:25:26.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.903+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1a9590 con 0x55fdf0b97530 2024-03-27T07:25:26.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.903+0000 7f36ebfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0bbc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36ebfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0bbc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39976/0 (socket says 172.21.15.82:39976) 2024-03-27T07:25:26.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36ebfff640 1 -- 172.21.15.82:0/3186574449 learned_addr learned my addr 172.21.15.82:0/3186574449 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:26.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/3186574449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b96c10 0x55fdf0ba42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36eaffd640 1 --2- 172.21.15.82:0/3186574449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b97530 0x55fdf0bb0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36ebfff640 1 -- 172.21.15.82:0/3186574449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b97530 msgr2=0x55fdf0bb0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36ebfff640 1 --2- 172.21.15.82:0/3186574449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b97530 0x55fdf0bb0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36ebfff640 1 -- 172.21.15.82:0/3186574449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b96c10 msgr2=0x55fdf0ba42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36ebfff640 1 --2- 172.21.15.82:0/3186574449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b96c10 0x55fdf0ba42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36ebfff640 1 -- 172.21.15.82:0/3186574449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdf0ba6fe0 con 0x55fdf0ba4bf0 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36ebfff640 1 --2- 172.21.15.82:0/3186574449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0bbc6f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f36e4037040 tx=0x7f36e4042040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68d4742705058c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36d17fa640 1 -- 172.21.15.82:0/3186574449 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e4039040 con 0x55fdf0ba4bf0 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36d17fa640 1 -- 172.21.15.82:0/3186574449 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36e4047070 con 0x55fdf0ba4bf0 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.904+0000 7f36d17fa640 1 -- 172.21.15.82:0/3186574449 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e40346a0 con 0x55fdf0ba4bf0 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3186574449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 msgr2=0x55fdf0bbc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/3186574449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0bbc6f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f36e4037040 tx=0x7f36e4042040 comp rx=0 tx=0).stop 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3186574449 shutdown_connections 2024-03-27T07:25:26.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/3186574449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0bbc6f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/3186574449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0b97530 0x55fdf0bb0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/3186574449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b96c10 0x55fdf0ba42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3186574449 >> 172.21.15.82:0/3186574449 conn(0x55fdf0b91a10 msgr2=0x55fdf0b90a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3186574449 shutdown_connections 2024-03-27T07:25:26.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3186574449 wait complete. 2024-03-27T07:25:26.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 -- start start 2024-03-27T07:25:26.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.905+0000 7f36f4bd5740 1 Processor -- start 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0bac400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b97530 0x55fdf0bac940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36f4bd5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1a9c00 con 0x55fdf0b96c10 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1ab070 con 0x55fdf0b97530 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36f4bd5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f36ec1aa2d0 con 0x55fdf0ba4bf0 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36f4bd5740 10 client.0 _ll_register_callbacks cb 0x7f36e4045030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36eb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0bac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36eb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0bac400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39992/0 (socket says 172.21.15.82:39992) 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36eb7fe640 1 -- 172.21.15.82:0/3736186526 learned_addr learned my addr 172.21.15.82:0/3736186526 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36eaffd640 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b97530 0x55fdf0bac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36ebfff640 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36eb7fe640 1 -- 172.21.15.82:0/3736186526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0ba4bf0 msgr2=0x55fdf0ba88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36eb7fe640 1 -- 172.21.15.82:0/3736186526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b97530 msgr2=0x55fdf0bac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b97530 0x55fdf0bac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36eb7fe640 1 -- 172.21.15.82:0/3736186526 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdf0ba9010 con 0x55fdf0b96c10 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36eb7fe640 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0bac400 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f36dc004b20 tx=0x7f36dc009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60df911867e0e48c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36caffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36caffd640 1 -- 172.21.15.82:0/3736186526 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36dc027070 con 0x55fdf0b96c10 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36caffd640 1 -- 172.21.15.82:0/3736186526 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f36dc0097a0 con 0x55fdf0b96c10 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3736186526 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36e4047070 con 0x55fdf0b96c10 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36caffd640 1 -- 172.21.15.82:0/3736186526 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f36dc0042f0 con 0x55fdf0b96c10 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36f4bd5740 10 client.15996 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.906+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3736186526 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fdf0c1b740 con 0x55fdf0b96c10 2024-03-27T07:25:26.918 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36caffd640 1 -- 172.21.15.82:0/3736186526 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36e4047070 con 0x55fdf0b96c10 2024-03-27T07:25:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36caffd640 1 -- 172.21.15.82:0/3736186526 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f36dc018040 con 0x55fdf0b96c10 2024-03-27T07:25:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36f4bd5740 10 client.15996 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36f4bd5740 10 client.15996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36f4bd5740 20 client.15996 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fdf0c1bf10 0x55fdf0c1e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36f4bd5740 4 client.15996 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:25:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3736186526 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fdf0b026e0 con 0x55fdf0c1bf10 2024-03-27T07:25:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36eaffd640 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fdf0c1bf10 0x55fdf0c1e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36caffd640 10 client.15996 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:26.919 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:26.907+0000 7f36eaffd640 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fdf0c1bf10 0x55fdf0c1e330 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=368e46491318675c server_cookie=a415ad6a06041424 in_seq=0 out_seq=0 2024-03-27T07:25:27.156 INFO:tasks.workunit.client.0.smithi082.stdout: 10 61694 760 39594 578 7734 652 2024-03-27T07:25:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36caffd640 1 -- 172.21.15.82:0/3736186526 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fdf0b026e0 con 0x55fdf0c1bf10 2024-03-27T07:25:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36caffd640 10 client.15996 handle_command_reply: tid=0 2024-03-27T07:25:27.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 client.15996 shutdown 2024-03-27T07:25:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3736186526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 msgr2=0x55fdf0bac400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0bac400 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f36dc004b20 tx=0x7f36dc009af0 comp rx=0 tx=0).stop 2024-03-27T07:25:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3736186526 shutdown_connections 2024-03-27T07:25:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fdf0ba4bf0 0x55fdf0ba88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:27.380 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fdf0b97530 0x55fdf0bac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fdf0c1bf10 0x55fdf0c1e330 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 --2- 172.21.15.82:0/3736186526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fdf0b96c10 0x55fdf0bac400 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36caffd640 0 client.15996 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:27.381 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3736186526 >> 172.21.15.82:0/3736186526 conn(0x55fdf0b91a10 msgr2=0x55fdf0ba1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3736186526 shutdown_connections 2024-03-27T07:25:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 1 -- 172.21.15.82:0/3736186526 wait complete. 2024-03-27T07:25:27.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.375+0000 7f36f4bd5740 20 client.15996 trim_cache size 0 max 16384 2024-03-27T07:25:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:25:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:25:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:25:27.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:25:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 -- 172.21.15.82:0/2643308944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f36d40a3820 msgr2=0x7f36d40a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f36d40a3820 0x7f36d40a5ce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f36e4004af0 tx=0x7f36e4032360 comp rx=0 tx=0).stop 2024-03-27T07:25:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 -- 172.21.15.82:0/2643308944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ec101660 msgr2=0x7f36ec1978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:27.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ec101660 0x7f36ec1978f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f36e000eb00 tx=0x7f36e000ef00 comp rx=0 tx=0).stop 2024-03-27T07:25:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 -- 172.21.15.82:0/2643308944 shutdown_connections 2024-03-27T07:25:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f36d40a3820 0x7f36d40a5ce0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f36ec101660 0x7f36ec1978f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:27.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f36ec1059f0 0x7f36ec19bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 --2- 172.21.15.82:0/2643308944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36ec100ca0 0x7f36ec1973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 -- 172.21.15.82:0/2643308944 >> 172.21.15.82:0/2643308944 conn(0x7f36ec0778a0 msgr2=0x7f36ec0ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 -- 172.21.15.82:0/2643308944 shutdown_connections 2024-03-27T07:25:27.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:27.376+0000 7f36f1fe2640 1 -- 172.21.15.82:0/2643308944 wait complete. 2024-03-27T07:25:29.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:28 smithi149 ceph-mon[36065]: pgmap v59: 97 pgs: 97 active+clean; 16 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 217 op/s 2024-03-27T07:25:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:28 smithi153 ceph-mon[36179]: pgmap v59: 97 pgs: 97 active+clean; 16 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 217 op/s 2024-03-27T07:25:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:28 smithi082 ceph-mon[32178]: pgmap v59: 97 pgs: 97 active+clean; 16 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 217 op/s 2024-03-27T07:25:31.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:30 smithi149 ceph-mon[36065]: pgmap v60: 97 pgs: 97 active+clean; 16 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1001 KiB/s wr, 146 op/s 2024-03-27T07:25:31.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:30 smithi153 ceph-mon[36179]: pgmap v60: 97 pgs: 97 active+clean; 16 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1001 KiB/s wr, 146 op/s 2024-03-27T07:25:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:30 smithi082 ceph-mon[32178]: pgmap v60: 97 pgs: 97 active+clean; 16 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1001 KiB/s wr, 146 op/s 2024-03-27T07:25:33.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:32 smithi149 ceph-mon[36065]: pgmap v61: 97 pgs: 97 active+clean; 57 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 437 op/s 2024-03-27T07:25:33.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:32 smithi153 ceph-mon[36179]: pgmap v61: 97 pgs: 97 active+clean; 57 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 437 op/s 2024-03-27T07:25:33.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:32 smithi082 ceph-mon[32178]: pgmap v61: 97 pgs: 97 active+clean; 57 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 5.1 MiB/s wr, 437 op/s 2024-03-27T07:25:35.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:34 smithi149 ceph-mon[36065]: pgmap v62: 97 pgs: 97 active+clean; 57 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.6 MiB/s wr, 409 op/s 2024-03-27T07:25:35.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:34 smithi153 ceph-mon[36179]: pgmap v62: 97 pgs: 97 active+clean; 57 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.6 MiB/s wr, 409 op/s 2024-03-27T07:25:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:34 smithi082 ceph-mon[32178]: pgmap v62: 97 pgs: 97 active+clean; 57 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.6 MiB/s wr, 409 op/s 2024-03-27T07:25:36.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:36 smithi082 ceph-mon[32178]: pgmap v63: 97 pgs: 97 active+clean; 57 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.6 MiB/s wr, 409 op/s 2024-03-27T07:25:37.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:36 smithi149 ceph-mon[36065]: pgmap v63: 97 pgs: 97 active+clean; 57 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.6 MiB/s wr, 409 op/s 2024-03-27T07:25:37.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:36 smithi153 ceph-mon[36179]: pgmap v63: 97 pgs: 97 active+clean; 57 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 4.6 MiB/s wr, 409 op/s 2024-03-27T07:25:37.156 INFO:tasks.workunit.client.0.smithi082.stdout: 21 334026 583 222717 666 89308 1108 2024-03-27T07:25:39.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:38 smithi149 ceph-mon[36065]: pgmap v64: 97 pgs: 97 active+clean; 63 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.4 MiB/s wr, 478 op/s 2024-03-27T07:25:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:38 smithi153 ceph-mon[36179]: pgmap v64: 97 pgs: 97 active+clean; 63 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.4 MiB/s wr, 478 op/s 2024-03-27T07:25:39.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:38 smithi082 ceph-mon[32178]: pgmap v64: 97 pgs: 97 active+clean; 63 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.4 MiB/s wr, 478 op/s 2024-03-27T07:25:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.467+0000 7fe586f81640 1 -- 172.21.15.82:0/3545736183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe580101af0 msgr2=0x7fe580101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.467+0000 7fe586f81640 1 --2- 172.21.15.82:0/3545736183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe580101af0 0x7fe580101f70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009930 tx=0x7fe56c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.467+0000 7fe586f81640 1 -- 172.21.15.82:0/3545736183 shutdown_connections 2024-03-27T07:25:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.467+0000 7fe586f81640 1 --2- 172.21.15.82:0/3545736183 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe580101af0 0x7fe580101f70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.467+0000 7fe586f81640 1 --2- 172.21.15.82:0/3545736183 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe5801024b0 0x7fe58010e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.467+0000 7fe586f81640 1 --2- 172.21.15.82:0/3545736183 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe580107b90 0x7fe580107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.467+0000 7fe586f81640 1 -- 172.21.15.82:0/3545736183 >> 172.21.15.82:0/3545736183 conn(0x7fe5800fd5e0 msgr2=0x7fe5800ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.467+0000 7fe586f81640 1 -- 172.21.15.82:0/3545736183 shutdown_connections 2024-03-27T07:25:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.467+0000 7fe586f81640 1 -- 172.21.15.82:0/3545736183 wait complete. 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe586f81640 1 Processor -- start 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe586f81640 1 -- start start 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe586f81640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe580101af0 0x7fe580073e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe586f81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5801024b0 0x7fe580074390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe586f81640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe580107b90 0x7fe5800748d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe586f81640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe580111f10 con 0x7fe5801024b0 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe586f81640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe580111d90 con 0x7fe580107b90 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe586f81640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe580112090 con 0x7fe580101af0 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe57ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5801024b0 0x7fe580074390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe57ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5801024b0 0x7fe580074390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36534/0 (socket says 172.21.15.82:36534) 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe57ffff640 1 -- 172.21.15.82:0/1899700855 learned_addr learned my addr 172.21.15.82:0/1899700855 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe584d1d640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe580101af0 0x7fe580073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.468+0000 7fe58551e640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe580107b90 0x7fe5800748d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe57ffff640 1 -- 172.21.15.82:0/1899700855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe580101af0 msgr2=0x7fe580073e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe57ffff640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe580101af0 0x7fe580073e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe57ffff640 1 -- 172.21.15.82:0/1899700855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe580107b90 msgr2=0x7fe5800748d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe57ffff640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe580107b90 0x7fe5800748d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe57ffff640 1 -- 172.21.15.82:0/1899700855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5801a6850 con 0x7fe5801024b0 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe58551e640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe580107b90 0x7fe5800748d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe57ffff640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5801024b0 0x7fe580074390 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009230 tx=0x7fe56c02cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe57dffb640 1 -- 172.21.15.82:0/1899700855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c041070 con 0x7fe5801024b0 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe57dffb640 1 -- 172.21.15.82:0/1899700855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe56c004450 con 0x7fe5801024b0 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe586f81640 1 -- 172.21.15.82:0/1899700855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5801a6ae0 con 0x7fe5801024b0 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe57dffb640 1 -- 172.21.15.82:0/1899700855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c003e50 con 0x7fe5801024b0 2024-03-27T07:25:40.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.469+0000 7fe586f81640 1 -- 172.21.15.82:0/1899700855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5801a7020 con 0x7fe5801024b0 2024-03-27T07:25:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.471+0000 7fe57dffb640 1 -- 172.21.15.82:0/1899700855 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fe56c044070 con 0x7fe5801024b0 2024-03-27T07:25:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe589b6d740 1 Processor -- start 2024-03-27T07:25:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe589b6d740 1 -- start start 2024-03-27T07:25:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe57dffb640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe5700a3a70 0x7fe5700a5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe58551e640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe5700a3a70 0x7fe5700a5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d298b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d29942a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2996bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe57dffb640 1 -- 172.21.15.82:0/1899700855 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe56c0f1870 con 0x7fe5801024b0 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe589b6d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5620d2951cd0 con 0x5620d29947e0 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe589b6d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5620d2896950 con 0x5620d298ba10 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe589b6d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5620d28eee50 con 0x5620d298b0f0 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe58551e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2996bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe57ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d29942a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe584d1d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d298b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe58551e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2996bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36546/0 (socket says 172.21.15.82:36546) 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe58551e640 1 -- 172.21.15.82:0/3749738913 learned_addr learned my addr 172.21.15.82:0/3749738913 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe57ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d29942a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42026/0 (socket says 172.21.15.82:42026) 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe58551e640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe5700a3a70 0x7fe5700a5f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe578012880 tx=0x7fe578012c80 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe57ffff640 1 -- 172.21.15.82:0/3749738913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 msgr2=0x5620d298b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:40.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe57ffff640 1 --2- 172.21.15.82:0/3749738913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d298b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe57ffff640 1 -- 172.21.15.82:0/3749738913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 msgr2=0x5620d2996bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe57ffff640 1 --2- 172.21.15.82:0/3749738913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2996bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe57ffff640 1 -- 172.21.15.82:0/3749738913 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d2603210 con 0x5620d298ba10 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.472+0000 7fe58551e640 1 --2- 172.21.15.82:0/3749738913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2996bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.473+0000 7fe57ffff640 1 --2- 172.21.15.82:0/3749738913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d29942a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0ef120 tx=0x7fe56c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84d432b17b49cf9a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.473+0000 7fe56affd640 1 -- 172.21.15.82:0/3749738913 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c04b040 con 0x5620d298ba10 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.473+0000 7fe56affd640 1 -- 172.21.15.82:0/3749738913 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe56c0be260 con 0x5620d298ba10 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.473+0000 7fe56affd640 1 -- 172.21.15.82:0/3749738913 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c003710 con 0x5620d298ba10 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 -- 172.21.15.82:0/3749738913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 msgr2=0x5620d29942a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 --2- 172.21.15.82:0/3749738913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d29942a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0ef120 tx=0x7fe56c009260 comp rx=0 tx=0).stop 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 -- 172.21.15.82:0/3749738913 shutdown_connections 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 --2- 172.21.15.82:0/3749738913 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2996bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 --2- 172.21.15.82:0/3749738913 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d29942a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 --2- 172.21.15.82:0/3749738913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d298b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 -- 172.21.15.82:0/3749738913 >> 172.21.15.82:0/3749738913 conn(0x5620d2985a10 msgr2=0x5620d2985df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 -- 172.21.15.82:0/3749738913 shutdown_connections 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 -- 172.21.15.82:0/3749738913 wait complete. 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 -- start start 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 Processor -- start 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.474+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298b0f0 0x5620d29917f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298ba10 0x5620d2991d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2992270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe589b6d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5620d28eae00 con 0x5620d29947e0 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe589b6d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5620d2897520 con 0x5620d298b0f0 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe589b6d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5620d28aa8e0 con 0x5620d298ba10 2024-03-27T07:25:40.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe589b6d740 10 client.0 _ll_register_callbacks cb 0x5620d28e5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe584d1d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298b0f0 0x5620d29917f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe58551e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2992270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe584d1d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298b0f0 0x5620d29917f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42040/0 (socket says 172.21.15.82:42040) 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe57ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298ba10 0x5620d2991d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe584d1d640 1 -- 172.21.15.82:0/3360492790 learned_addr learned my addr 172.21.15.82:0/3360492790 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe584d1d640 1 -- 172.21.15.82:0/3360492790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298ba10 msgr2=0x5620d2991d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe584d1d640 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298ba10 0x5620d2991d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe584d1d640 1 -- 172.21.15.82:0/3360492790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 msgr2=0x5620d2992270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe584d1d640 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2992270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe584d1d640 1 -- 172.21.15.82:0/3360492790 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d26cf620 con 0x5620d298b0f0 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe584d1d640 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298b0f0 0x5620d29917f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe574012770 tx=0x7fe574012b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b88dafce59ee47b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe55ffff640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe55ffff640 1 -- 172.21.15.82:0/3360492790 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574004030 con 0x5620d298b0f0 2024-03-27T07:25:40.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe589b6d740 1 -- 172.21.15.82:0/3360492790 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe56c0be260 con 0x5620d298b0f0 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.475+0000 7fe55ffff640 1 -- 172.21.15.82:0/3360492790 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe5740041d0 con 0x5620d298b0f0 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe55ffff640 1 -- 172.21.15.82:0/3360492790 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe574004410 con 0x5620d298b0f0 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe589b6d740 10 client.25826 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe589b6d740 1 -- 172.21.15.82:0/3360492790 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5620d29a30a0 con 0x5620d298b0f0 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe55ffff640 1 -- 172.21.15.82:0/3360492790 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe56c0be260 con 0x5620d298b0f0 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe55ffff640 1 -- 172.21.15.82:0/3360492790 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe574003bc0 con 0x5620d298b0f0 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe589b6d740 10 client.25826 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe589b6d740 10 client.25826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe589b6d740 20 client.25826 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe589b6d740 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5620d29a45b0 0x5620d29a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe589b6d740 4 client.25826 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe589b6d740 1 -- 172.21.15.82:0/3360492790 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620d28fc390 con 0x5620d29a45b0 2024-03-27T07:25:40.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe57ffff640 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5620d29a45b0 0x5620d29a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe55ffff640 10 client.25826 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.476+0000 7fe57ffff640 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5620d29a45b0 0x5620d29a69e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=467eca8f4252a06 server_cookie=5c83a0df9960863f in_seq=0 out_seq=0 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe55ffff640 1 -- 172.21.15.82:0/3360492790 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5620d28fc390 con 0x5620d29a45b0 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe55ffff640 10 client.25826 handle_command_reply: tid=0 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe589b6d740 1 client.25826 shutdown 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe589b6d740 1 -- 172.21.15.82:0/3360492790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298b0f0 msgr2=0x5620d29917f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe589b6d740 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298b0f0 0x5620d29917f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe574012770 tx=0x7fe574012b70 comp rx=0 tx=0).stop 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe589b6d740 1 -- 172.21.15.82:0/3360492790 shutdown_connections 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe589b6d740 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5620d29a45b0 0x5620d29a69e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe589b6d740 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2992270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe589b6d740 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298ba10 0x5620d2991d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe589b6d740 1 --2- 172.21.15.82:0/3360492790 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298b0f0 0x5620d29917f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe55ffff640 0 client.25826 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:40.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.478+0000 7fe589b6d740 1 -- 172.21.15.82:0/3360492790 >> 172.21.15.82:0/3360492790 conn(0x5620d2985a10 msgr2=0x5620d2987760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.479+0000 7fe589b6d740 1 -- 172.21.15.82:0/3360492790 shutdown_connections 2024-03-27T07:25:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.479+0000 7fe589b6d740 1 -- 172.21.15.82:0/3360492790 wait complete. 2024-03-27T07:25:40.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.479+0000 7fe589b6d740 20 client.25826 trim_cache size 0 max 16384 2024-03-27T07:25:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe589b6d740 1 Processor -- start 2024-03-27T07:25:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe589b6d740 1 -- start start 2024-03-27T07:25:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d2993f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d299fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2987570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe589b6d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801b21d0 con 0x5620d29947e0 2024-03-27T07:25:40.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe589b6d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801afa40 con 0x5620d298ba10 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe589b6d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801ad890 con 0x5620d298b0f0 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe58551e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2987570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe57ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d299fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe584d1d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d2993f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe57ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d299fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42052/0 (socket says 172.21.15.82:42052) 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe58551e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2987570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36556/0 (socket says 172.21.15.82:36556) 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe57ffff640 1 -- 172.21.15.82:0/4026981742 learned_addr learned my addr 172.21.15.82:0/4026981742 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe57ffff640 1 -- 172.21.15.82:0/4026981742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 msgr2=0x5620d2993f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe57ffff640 1 --2- 172.21.15.82:0/4026981742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d2993f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe57ffff640 1 -- 172.21.15.82:0/4026981742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 msgr2=0x5620d2987570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe57ffff640 1 --2- 172.21.15.82:0/4026981742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2987570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe57ffff640 1 -- 172.21.15.82:0/4026981742 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d298fd40 con 0x5620d298ba10 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.494+0000 7fe58551e640 1 --2- 172.21.15.82:0/4026981742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2987570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:40.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.495+0000 7fe57ffff640 1 --2- 172.21.15.82:0/4026981742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d299fb80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0ef1d0 tx=0x7fe56c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87a93393cc4fb9d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.495+0000 7fe56a7fc640 1 -- 172.21.15.82:0/4026981742 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c04b040 con 0x5620d298ba10 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.495+0000 7fe56a7fc640 1 -- 172.21.15.82:0/4026981742 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe56c0c1f10 con 0x5620d298ba10 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.495+0000 7fe56a7fc640 1 -- 172.21.15.82:0/4026981742 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c0ba1d0 con 0x5620d298ba10 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 -- 172.21.15.82:0/4026981742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 msgr2=0x5620d299fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 --2- 172.21.15.82:0/4026981742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d299fb80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0ef1d0 tx=0x7fe56c000bc0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 -- 172.21.15.82:0/4026981742 shutdown_connections 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 --2- 172.21.15.82:0/4026981742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d29947e0 0x5620d2987570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 --2- 172.21.15.82:0/4026981742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d298ba10 0x5620d299fb80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 --2- 172.21.15.82:0/4026981742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d2993f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 -- 172.21.15.82:0/4026981742 >> 172.21.15.82:0/4026981742 conn(0x5620d2985a10 msgr2=0x5620d2986e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 -- 172.21.15.82:0/4026981742 shutdown_connections 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 -- 172.21.15.82:0/4026981742 wait complete. 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 -- start start 2024-03-27T07:25:40.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 Processor -- start 2024-03-27T07:25:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d298e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d298ba10 0x5620d298ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d29947e0 0x5620d298f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801adf00 con 0x5620d298ba10 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801af370 con 0x5620d29947e0 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe5801ae5d0 con 0x5620d298b0f0 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe589b6d740 10 client.0 _ll_register_callbacks cb 0x7fe574009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe57ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d298ba10 0x5620d298ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe57ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d298ba10 0x5620d298ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36566/0 (socket says 172.21.15.82:36566) 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe57ffff640 1 -- 172.21.15.82:0/2895213648 learned_addr learned my addr 172.21.15.82:0/2895213648 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.496+0000 7fe584d1d640 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d298e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe58551e640 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d29947e0 0x5620d298f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe57ffff640 1 -- 172.21.15.82:0/2895213648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 msgr2=0x5620d298e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe57ffff640 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d298e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe57ffff640 1 -- 172.21.15.82:0/2895213648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d29947e0 msgr2=0x5620d298f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe57ffff640 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d29947e0 0x5620d298f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe57ffff640 1 -- 172.21.15.82:0/2895213648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d2a09b20 con 0x5620d298ba10 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe57ffff640 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d298ba10 0x5620d298ed30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0096c0 tx=0x7fe56c005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95d2b0aa1f78b73 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe55ffff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe55ffff640 1 -- 172.21.15.82:0/2895213648 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c04b070 con 0x5620d298ba10 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe589b6d740 1 -- 172.21.15.82:0/2895213648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe56c0c1f10 con 0x5620d298ba10 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe55ffff640 1 -- 172.21.15.82:0/2895213648 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fe56c0ef290 con 0x5620d298ba10 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe55ffff640 1 -- 172.21.15.82:0/2895213648 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe56c0c67d0 con 0x5620d298ba10 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe589b6d740 10 client.16014 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe589b6d740 1 -- 172.21.15.82:0/2895213648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5620d2a0add0 con 0x5620d298ba10 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.497+0000 7fe55ffff640 1 -- 172.21.15.82:0/2895213648 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe56c0c1f10 con 0x5620d298ba10 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.498+0000 7fe55ffff640 1 -- 172.21.15.82:0/2895213648 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe56c0dcb30 con 0x5620d298ba10 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.498+0000 7fe589b6d740 10 client.16014 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.498+0000 7fe589b6d740 10 client.16014 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.498+0000 7fe589b6d740 20 client.16014 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:40.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.498+0000 7fe589b6d740 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5620d2a0b160 0x5620d2a0d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.498+0000 7fe589b6d740 4 client.16014 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:25:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.498+0000 7fe589b6d740 1 -- 172.21.15.82:0/2895213648 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5620d28f66e0 con 0x5620d2a0b160 2024-03-27T07:25:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.498+0000 7fe584d1d640 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5620d2a0b160 0x5620d2a0d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.498+0000 7fe55ffff640 10 client.16014 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:40.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.498+0000 7fe584d1d640 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5620d2a0b160 0x5620d2a0d550 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5acfb68a8a76d2e server_cookie=6320b156e234346d in_seq=0 out_seq=0 2024-03-27T07:25:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe55ffff640 1 -- 172.21.15.82:0/2895213648 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5620d28f66e0 con 0x5620d2a0b160 2024-03-27T07:25:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe55ffff640 10 client.16014 handle_command_reply: tid=0 2024-03-27T07:25:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe589b6d740 1 client.16014 shutdown 2024-03-27T07:25:40.819 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe589b6d740 1 -- 172.21.15.82:0/2895213648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d298ba10 msgr2=0x5620d298ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe589b6d740 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d298ba10 0x5620d298ed30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0096c0 tx=0x7fe56c005b50 comp rx=0 tx=0).stop 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe589b6d740 1 -- 172.21.15.82:0/2895213648 shutdown_connections 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe589b6d740 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5620d2a0b160 0x5620d2a0d550 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe589b6d740 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620d298ba10 0x5620d298ed30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe589b6d740 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5620d29947e0 0x5620d298f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe55ffff640 0 client.16014 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe589b6d740 1 --2- 172.21.15.82:0/2895213648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5620d298b0f0 0x5620d298e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.816+0000 7fe589b6d740 1 -- 172.21.15.82:0/2895213648 >> 172.21.15.82:0/2895213648 conn(0x5620d2985a10 msgr2=0x5620d29876f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe589b6d740 1 -- 172.21.15.82:0/2895213648 shutdown_connections 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe589b6d740 1 -- 172.21.15.82:0/2895213648 wait complete. 2024-03-27T07:25:40.820 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe589b6d740 20 client.16014 trim_cache size 0 max 16384 2024-03-27T07:25:40.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:25:40.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:25:40.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:25:40.821 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 -- 172.21.15.82:0/1899700855 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe5700a3a70 msgr2=0x7fe5700a5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe5700a3a70 0x7fe5700a5f30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe578012880 tx=0x7fe578012c80 comp rx=0 tx=0).stop 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 -- 172.21.15.82:0/1899700855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5801024b0 msgr2=0x7fe580074390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5801024b0 0x7fe580074390 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009230 tx=0x7fe56c02cb30 comp rx=0 tx=0).stop 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 -- 172.21.15.82:0/1899700855 shutdown_connections 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe5700a3a70 0x7fe5700a5f30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe5801024b0 0x7fe580074390 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe580107b90 0x7fe5800748d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 --2- 172.21.15.82:0/1899700855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe580101af0 0x7fe580073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 -- 172.21.15.82:0/1899700855 >> 172.21.15.82:0/1899700855 conn(0x7fe5800fd5e0 msgr2=0x7fe5800fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:40.822 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 -- 172.21.15.82:0/1899700855 shutdown_connections 2024-03-27T07:25:40.823 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:40.817+0000 7fe586f81640 1 -- 172.21.15.82:0/1899700855 wait complete. 2024-03-27T07:25:41.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:40 smithi149 ceph-mon[36065]: pgmap v65: 97 pgs: 97 active+clean; 63 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 360 op/s 2024-03-27T07:25:41.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:40 smithi153 ceph-mon[36179]: pgmap v65: 97 pgs: 97 active+clean; 63 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 360 op/s 2024-03-27T07:25:41.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:40 smithi082 ceph-mon[32178]: pgmap v65: 97 pgs: 97 active+clean; 63 MiB data, 445 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.8 MiB/s wr, 360 op/s 2024-03-27T07:25:42.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:41 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:25:42.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:41 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:25:42.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:41 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:25:43.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:42 smithi149 ceph-mon[36065]: pgmap v66: 97 pgs: 97 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 466 op/s 2024-03-27T07:25:43.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:42 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:42 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:42 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:42 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:42 smithi153 ceph-mon[36179]: pgmap v66: 97 pgs: 97 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 466 op/s 2024-03-27T07:25:43.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:42 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:42 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:42 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:42 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:42 smithi082 ceph-mon[32178]: pgmap v66: 97 pgs: 97 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 466 op/s 2024-03-27T07:25:43.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:42 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:42 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:42 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:43.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:42 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:43 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:25:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:43 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:25:44.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:43 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:44.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:43 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:25:44.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:43 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:25:44.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:43 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:44.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:43 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:25:44.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:43 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:25:44.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:43 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:25:45.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:44 smithi149 ceph-mon[36065]: pgmap v67: 97 pgs: 97 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-03-27T07:25:45.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:44 smithi153 ceph-mon[36179]: pgmap v67: 97 pgs: 97 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-03-27T07:25:45.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:44 smithi082 ceph-mon[32178]: pgmap v67: 97 pgs: 97 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-03-27T07:25:47.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:46 smithi149 ceph-mon[36065]: pgmap v68: 97 pgs: 97 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-03-27T07:25:47.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:46 smithi153 ceph-mon[36179]: pgmap v68: 97 pgs: 97 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-03-27T07:25:47.156 INFO:tasks.workunit.client.0.smithi082.stdout: 38 394096 648 290520 852 132696 1103 2024-03-27T07:25:47.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:46 smithi082 ceph-mon[32178]: pgmap v68: 97 pgs: 97 active+clean; 66 MiB data, 453 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 175 op/s 2024-03-27T07:25:47.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:25:47.282 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:25:47.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.415+0000 7f6a1e113640 1 -- 172.21.15.82:0/3497489621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a181009e0 msgr2=0x7f6a18100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.415+0000 7f6a1e113640 1 --2- 172.21.15.82:0/3497489621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a181009e0 0x7f6a18100e60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009930 tx=0x7f6a0c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:47.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.415+0000 7f6a1e113640 1 -- 172.21.15.82:0/3497489621 shutdown_connections 2024-03-27T07:25:47.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.415+0000 7f6a1e113640 1 --2- 172.21.15.82:0/3497489621 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a181009e0 0x7f6a18100e60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.415+0000 7f6a1e113640 1 --2- 172.21.15.82:0/3497489621 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a181013a0 0x7f6a1810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.415+0000 7f6a1e113640 1 --2- 172.21.15.82:0/3497489621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a181069f0 0x7f6a18106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.415+0000 7f6a1e113640 1 -- 172.21.15.82:0/3497489621 >> 172.21.15.82:0/3497489621 conn(0x7f6a18077b20 msgr2=0x7f6a18077f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:47.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.415+0000 7f6a1e113640 1 -- 172.21.15.82:0/3497489621 shutdown_connections 2024-03-27T07:25:47.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.415+0000 7f6a1e113640 1 -- 172.21.15.82:0/3497489621 wait complete. 2024-03-27T07:25:47.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.416+0000 7f6a1e113640 1 Processor -- start 2024-03-27T07:25:47.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.416+0000 7f6a1e113640 1 -- start start 2024-03-27T07:25:47.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.416+0000 7f6a1e113640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a181009e0 0x7f6a18199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.416+0000 7f6a1e113640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a181013a0 0x7f6a181997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a1e113640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a181069f0 0x7f6a181a4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a1e113640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a18110e00 con 0x7f6a181009e0 2024-03-27T07:25:47.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a1e113640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a18110c80 con 0x7f6a181069f0 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a1e113640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a18110f80 con 0x7f6a181013a0 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a177fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a181009e0 0x7f6a18199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a177fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a181009e0 0x7f6a18199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36590/0 (socket says 172.21.15.82:36590) 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a177fe640 1 -- 172.21.15.82:0/4042049098 learned_addr learned my addr 172.21.15.82:0/4042049098 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a17fff640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a181069f0 0x7f6a181a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a16ffd640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a181013a0 0x7f6a181997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a177fe640 1 -- 172.21.15.82:0/4042049098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a181013a0 msgr2=0x7f6a181997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a177fe640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a181013a0 0x7f6a181997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a177fe640 1 -- 172.21.15.82:0/4042049098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a181069f0 msgr2=0x7f6a181a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a177fe640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a181069f0 0x7f6a181a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a177fe640 1 -- 172.21.15.82:0/4042049098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a181a4840 con 0x7f6a181009e0 2024-03-27T07:25:47.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a17fff640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a181069f0 0x7f6a181a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a177fe640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a181009e0 0x7f6a18199280 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800e9f0 tx=0x7f6a0800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a14ff9640 1 -- 172.21.15.82:0/4042049098 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0800cd80 con 0x7f6a181009e0 2024-03-27T07:25:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a14ff9640 1 -- 172.21.15.82:0/4042049098 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a08005500 con 0x7f6a181009e0 2024-03-27T07:25:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.417+0000 7f6a1e113640 1 -- 172.21.15.82:0/4042049098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a181a4a10 con 0x7f6a181009e0 2024-03-27T07:25:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.418+0000 7f6a14ff9640 1 -- 172.21.15.82:0/4042049098 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08010690 con 0x7f6a181009e0 2024-03-27T07:25:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.418+0000 7f6a1e113640 1 -- 172.21.15.82:0/4042049098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a181a4ee0 con 0x7f6a181009e0 2024-03-27T07:25:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.420+0000 7f6a14ff9640 1 -- 172.21.15.82:0/4042049098 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f6a08010830 con 0x7f6a181009e0 2024-03-27T07:25:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.420+0000 7f6a20ddb740 1 Processor -- start 2024-03-27T07:25:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.420+0000 7f6a14ff9640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6a000a3780 0x7f6a000a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.420+0000 7f6a20ddb740 1 -- start start 2024-03-27T07:25:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.420+0000 7f6a17fff640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6a000a3780 0x7f6a000a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a14ff9640 1 -- 172.21.15.82:0/4042049098 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f6a080d0460 con 0x7f6a181009e0 2024-03-27T07:25:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 0x563959233630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233b70 0x56395923c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56395923c750 0x56395923eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563959197860 con 0x56395923c750 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56395913f8d0 con 0x563959233b70 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563959193810 con 0x563959233250 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a177fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 0x563959233630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a177fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 0x563959233630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:34798/0 (socket says 172.21.15.82:34798) 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a177fe640 1 -- 172.21.15.82:0/1448460450 learned_addr learned my addr 172.21.15.82:0/1448460450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a16ffd640 1 --2- 172.21.15.82:0/1448460450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233b70 0x56395923c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a17fff640 1 --2- 172.21.15.82:0/1448460450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56395923c750 0x56395923eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a17fff640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6a000a3780 0x7f6a000a5c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a10005fd0 tx=0x7f6a10011bd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a177fe640 1 -- 172.21.15.82:0/1448460450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233b70 msgr2=0x56395923c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a177fe640 1 --2- 172.21.15.82:0/1448460450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233b70 0x56395923c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a177fe640 1 -- 172.21.15.82:0/1448460450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56395923c750 msgr2=0x56395923eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a177fe640 1 --2- 172.21.15.82:0/1448460450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56395923c750 0x56395923eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a177fe640 1 -- 172.21.15.82:0/1448460450 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56395914a120 con 0x563959233250 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a16ffd640 1 --2- 172.21.15.82:0/1448460450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233b70 0x56395923c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.421+0000 7f6a177fe640 1 --2- 172.21.15.82:0/1448460450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 0x563959233630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a08098aa0 tx=0x7f6a0809bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b3a01dd0dbb0ba6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f69fdffb640 1 -- 172.21.15.82:0/1448460450 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a080b4020 con 0x563959233250 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f69fdffb640 1 -- 172.21.15.82:0/1448460450 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a080a09f0 con 0x563959233250 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f69fdffb640 1 -- 172.21.15.82:0/1448460450 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a080a4e20 con 0x563959233250 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f6a20ddb740 1 -- 172.21.15.82:0/1448460450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 msgr2=0x563959233630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/1448460450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 0x563959233630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a08098aa0 tx=0x7f6a0809bfa0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f6a20ddb740 1 -- 172.21.15.82:0/1448460450 shutdown_connections 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/1448460450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56395923c750 0x56395923eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/1448460450 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233b70 0x56395923c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/1448460450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 0x563959233630 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f6a20ddb740 1 -- 172.21.15.82:0/1448460450 >> 172.21.15.82:0/1448460450 conn(0x56395922d980 msgr2=0x56395922dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f6a20ddb740 1 -- 172.21.15.82:0/1448460450 shutdown_connections 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.422+0000 7f6a20ddb740 1 -- 172.21.15.82:0/1448460450 wait complete. 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a20ddb740 1 -- start start 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a20ddb740 1 Processor -- start 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x5639592397d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x563959239d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 0x56395923a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56395923f540 con 0x563959233b70 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563959152cd0 con 0x563959233250 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56395923f6c0 con 0x56395923c750 2024-03-27T07:25:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a20ddb740 10 client.0 _ll_register_callbacks cb 0x563959144ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a16ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x563959239d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a177fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x5639592397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a16ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x563959239d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36612/0 (socket says 172.21.15.82:36612) 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 0x56395923a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.423+0000 7f6a16ffd640 1 -- 172.21.15.82:0/3072057632 learned_addr learned my addr 172.21.15.82:0/3072057632 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.424+0000 7f6a177fe640 1 -- 172.21.15.82:0/3072057632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 msgr2=0x56395923a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.424+0000 7f6a177fe640 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 0x56395923a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.424+0000 7f6a177fe640 1 -- 172.21.15.82:0/3072057632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 msgr2=0x563959239d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.424+0000 7f6a177fe640 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x563959239d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.424+0000 7f6a177fe640 1 -- 172.21.15.82:0/3072057632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563958f757d0 con 0x563959233250 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.424+0000 7f6a177fe640 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x5639592397d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c6a0 tx=0x7f6a08004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8e2e7ca8e366adf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.424+0000 7f69f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:25:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.424+0000 7f69f6ffd640 1 -- 172.21.15.82:0/3072057632 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a080bb050 con 0x563959233250 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.424+0000 7f69f6ffd640 1 -- 172.21.15.82:0/3072057632 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f6a080b5bd0 con 0x563959233250 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.424+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3072057632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a080a09f0 con 0x563959233250 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f69f6ffd640 1 -- 172.21.15.82:0/3072057632 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6a080b4040 con 0x563959233250 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f6a20ddb740 10 client.25844 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3072057632 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563958eab3f0 con 0x563959233250 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f69f6ffd640 1 -- 172.21.15.82:0/3072057632 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a080a09f0 con 0x563959233250 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f69f6ffd640 1 -- 172.21.15.82:0/3072057632 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6a0809ba90 con 0x563959233250 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f6a20ddb740 10 client.25844 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f6a20ddb740 10 client.25844 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f6a20ddb740 20 client.25844 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56395924c9b0 0x56395924eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f6a20ddb740 4 client.25844 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3072057632 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639591a4da0 con 0x56395924c9b0 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.425+0000 7f6a16ffd640 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56395924c9b0 0x56395924eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.426+0000 7f69f6ffd640 10 client.25844 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.426+0000 7f6a16ffd640 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56395924c9b0 0x56395924eda0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65bda1fff2b8849b server_cookie=6f63e40a5093050a in_seq=0 out_seq=0 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f69f6ffd640 1 -- 172.21.15.82:0/3072057632 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5639591a4da0 con 0x56395924c9b0 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f69f6ffd640 10 client.25844 handle_command_reply: tid=0 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 client.25844 shutdown 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3072057632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 msgr2=0x5639592397d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x5639592397d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c6a0 tx=0x7f6a08004940 comp rx=0 tx=0).stop 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3072057632 shutdown_connections 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56395924c9b0 0x56395924eda0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x563959239d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 0x56395923a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f69f6ffd640 0 client.25844 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/3072057632 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x5639592397d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3072057632 >> 172.21.15.82:0/3072057632 conn(0x56395922d980 msgr2=0x56395922f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3072057632 shutdown_connections 2024-03-27T07:25:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.427+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3072057632 wait complete. 2024-03-27T07:25:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.428+0000 7f6a20ddb740 20 client.25844 trim_cache size 0 max 16384 2024-03-27T07:25:47.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a20ddb740 1 Processor -- start 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a20ddb740 1 -- start start 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x56395923bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x5639592482e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 0x5639592543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a181b0020 con 0x563959233b70 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a181ad890 con 0x563959233250 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a181ab6e0 con 0x56395923c750 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a177fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x56395923bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 0x5639592543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a177fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x56395923bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42106/0 (socket says 172.21.15.82:42106) 2024-03-27T07:25:47.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.452+0000 7f6a177fe640 1 -- 172.21.15.82:0/3210468703 learned_addr learned my addr 172.21.15.82:0/3210468703 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.453+0000 7f6a17fff640 1 -- 172.21.15.82:0/3210468703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 msgr2=0x56395923bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.453+0000 7f6a17fff640 1 --2- 172.21.15.82:0/3210468703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x56395923bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.453+0000 7f6a17fff640 1 -- 172.21.15.82:0/3210468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 msgr2=0x5639592482e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:25:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.453+0000 7f6a17fff640 1 --2- 172.21.15.82:0/3210468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x5639592482e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.453+0000 7f6a17fff640 1 -- 172.21.15.82:0/3210468703 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563958e6b0f0 con 0x56395923c750 2024-03-27T07:25:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.453+0000 7f6a177fe640 1 --2- 172.21.15.82:0/3210468703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x56395923bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:47.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.453+0000 7f6a17fff640 1 --2- 172.21.15.82:0/3210468703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 0x5639592543d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56395922eb10 tx=0x7f6a1001c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a46893d009e0dff5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:47.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.454+0000 7f69fd7fa640 1 -- 172.21.15.82:0/3210468703 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a10017040 con 0x56395923c750 2024-03-27T07:25:47.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.454+0000 7f69fd7fa640 1 -- 172.21.15.82:0/3210468703 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a10019050 con 0x56395923c750 2024-03-27T07:25:47.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.455+0000 7f69fd7fa640 1 -- 172.21.15.82:0/3210468703 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a10023bc0 con 0x56395923c750 2024-03-27T07:25:47.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.455+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3210468703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 msgr2=0x5639592543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.455+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/3210468703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 0x5639592543d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x56395922eb10 tx=0x7f6a1001c000 comp rx=0 tx=0).stop 2024-03-27T07:25:47.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.465+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3210468703 shutdown_connections 2024-03-27T07:25:47.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.465+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/3210468703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x5639592482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.465+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/3210468703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56395923c750 0x5639592543d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.465+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/3210468703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563959233250 0x56395923bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.465+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3210468703 >> 172.21.15.82:0/3210468703 conn(0x56395922d980 msgr2=0x563959239790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.471+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3210468703 shutdown_connections 2024-03-27T07:25:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.471+0000 7f6a20ddb740 1 -- 172.21.15.82:0/3210468703 wait complete. 2024-03-27T07:25:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.471+0000 7f6a20ddb740 1 -- start start 2024-03-27T07:25:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.472+0000 7f6a20ddb740 1 Processor -- start 2024-03-27T07:25:47.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.472+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 0x5639592bf190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x563959244910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a20ddb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56395923c750 0x5639592365a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6a181abd50 con 0x563959233b70 2024-03-27T07:25:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6a181ad1c0 con 0x56395923c750 2024-03-27T07:25:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a20ddb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6a181ac420 con 0x563959233250 2024-03-27T07:25:47.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a20ddb740 10 client.0 _ll_register_callbacks cb 0x7f6a10011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:47.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56395923c750 0x5639592365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a17fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56395923c750 0x5639592365a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42110/0 (socket says 172.21.15.82:42110) 2024-03-27T07:25:47.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a17fff640 1 -- 172.21.15.82:0/367933145 learned_addr learned my addr 172.21.15.82:0/367933145 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:47.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a16ffd640 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x563959244910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a17fff640 1 -- 172.21.15.82:0/367933145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 msgr2=0x5639592bf190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:25:47.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.473+0000 7f6a17fff640 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 0x5639592bf190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.474+0000 7f6a17fff640 1 -- 172.21.15.82:0/367933145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 msgr2=0x563959244910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:47.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.474+0000 7f6a17fff640 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x563959244910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.474+0000 7f6a17fff640 1 -- 172.21.15.82:0/367933145 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563959245000 con 0x56395923c750 2024-03-27T07:25:47.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.474+0000 7f6a20ddb740 1 -- 172.21.15.82:0/367933145 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a10019050 con 0x56395923c750 2024-03-27T07:25:47.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.474+0000 7f6a16ffd640 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x563959244910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:47.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.474+0000 7f6a17fff640 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56395923c750 0x5639592365a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a10015010 tx=0x7f6a10011650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca8db3da1001eb46 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.499+0000 7f69f6ffd640 10 client.25850 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:25:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.499+0000 7f69f6ffd640 1 -- 172.21.15.82:0/367933145 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a10031020 con 0x56395923c750 2024-03-27T07:25:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.499+0000 7f69f6ffd640 1 -- 172.21.15.82:0/367933145 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f6a100237c0 con 0x56395923c750 2024-03-27T07:25:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.499+0000 7f69f6ffd640 1 -- 172.21.15.82:0/367933145 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6a10017070 con 0x56395923c750 2024-03-27T07:25:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.499+0000 7f6a20ddb740 10 client.25850 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.499+0000 7f6a20ddb740 1 -- 172.21.15.82:0/367933145 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({fsmap=26}) -- 0x5639592cc690 con 0x56395923c750 2024-03-27T07:25:47.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.504+0000 7f69f6ffd640 1 -- 172.21.15.82:0/367933145 <== mon.2 v2:172.21.15.149:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6a100239c0 con 0x56395923c750 2024-03-27T07:25:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.505+0000 7f6a20ddb740 10 client.25850 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.505+0000 7f6a20ddb740 10 client.25850 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.505+0000 7f6a20ddb740 20 client.25850 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.505+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5639592ccb90 0x5639592cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.505+0000 7f6a20ddb740 4 client.25850 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:25:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.505+0000 7f6a20ddb740 1 -- 172.21.15.82:0/367933145 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56395919f0f0 con 0x5639592ccb90 2024-03-27T07:25:47.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.505+0000 7f6a177fe640 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5639592ccb90 0x5639592cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.506+0000 7f69f6ffd640 10 client.25850 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:47.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.506+0000 7f6a177fe640 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5639592ccb90 0x5639592cefb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d278cf88a9223f56 server_cookie=25acd4a254c7975 in_seq=0 out_seq=0 2024-03-27T07:25:47.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.510+0000 7f69f6ffd640 1 -- 172.21.15.82:0/367933145 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56395919f0f0 con 0x5639592ccb90 2024-03-27T07:25:47.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.510+0000 7f69f6ffd640 10 client.25850 handle_command_reply: tid=0 2024-03-27T07:25:47.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.510+0000 7f6a20ddb740 1 client.25850 shutdown 2024-03-27T07:25:47.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.514+0000 7f6a20ddb740 1 -- 172.21.15.82:0/367933145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56395923c750 msgr2=0x5639592365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.514+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56395923c750 0x5639592365a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a10015010 tx=0x7f6a10011650 comp rx=0 tx=0).stop 2024-03-27T07:25:47.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.514+0000 7f6a20ddb740 1 -- 172.21.15.82:0/367933145 shutdown_connections 2024-03-27T07:25:47.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.514+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5639592ccb90 0x5639592cefb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.514+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563959233b70 0x563959244910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.514+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56395923c750 0x5639592365a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.514+0000 7f6a20ddb740 1 --2- 172.21.15.82:0/367933145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563959233250 0x5639592bf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.514+0000 7f6a20ddb740 1 -- 172.21.15.82:0/367933145 >> 172.21.15.82:0/367933145 conn(0x56395922d980 msgr2=0x56395922f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:47.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.516+0000 7f69f6ffd640 0 client.25850 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:47.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.516+0000 7f6a20ddb740 1 -- 172.21.15.82:0/367933145 shutdown_connections 2024-03-27T07:25:47.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.516+0000 7f6a20ddb740 1 -- 172.21.15.82:0/367933145 wait complete. 2024-03-27T07:25:47.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.516+0000 7f6a20ddb740 20 client.25850 trim_cache size 0 max 16384 2024-03-27T07:25:47.520 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:25:47.520 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-03-27T07:25:47.520 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-03-27T07:25:47.520 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:25:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.532+0000 7f6a1e113640 1 -- 172.21.15.82:0/4042049098 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6a000a3780 msgr2=0x7f6a000a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.532+0000 7f6a1e113640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6a000a3780 0x7f6a000a5c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a10005fd0 tx=0x7f6a10011bd0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.532+0000 7f6a1e113640 1 -- 172.21.15.82:0/4042049098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a181009e0 msgr2=0x7f6a18199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.532+0000 7f6a1e113640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a181009e0 0x7f6a18199280 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800e9f0 tx=0x7f6a0800edf0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.538+0000 7f6a1e113640 1 -- 172.21.15.82:0/4042049098 shutdown_connections 2024-03-27T07:25:47.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.538+0000 7f6a1e113640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6a000a3780 0x7f6a000a5c40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.538+0000 7f6a1e113640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6a181069f0 0x7f6a181a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.538+0000 7f6a1e113640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6a181013a0 0x7f6a181997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.538+0000 7f6a1e113640 1 --2- 172.21.15.82:0/4042049098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6a181009e0 0x7f6a18199280 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.539+0000 7f6a1e113640 1 -- 172.21.15.82:0/4042049098 >> 172.21.15.82:0/4042049098 conn(0x7f6a18077b20 msgr2=0x7f6a18103270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:47.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.539+0000 7f6a1e113640 1 -- 172.21.15.82:0/4042049098 shutdown_connections 2024-03-27T07:25:47.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.539+0000 7f6a1e113640 1 -- 172.21.15.82:0/4042049098 wait complete. 2024-03-27T07:25:47.569 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T07:25:47.569 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:25:47.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.724+0000 7f4be91e2640 1 -- 172.21.15.82:0/849225353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4be4101410 msgr2=0x7f4be410d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.724+0000 7f4be91e2640 1 --2- 172.21.15.82:0/849225353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4be4101410 0x7f4be410d920 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009cd0 tx=0x7f4bdc02c0f0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.725+0000 7f4be91e2640 1 -- 172.21.15.82:0/849225353 shutdown_connections 2024-03-27T07:25:47.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.725+0000 7f4be91e2640 1 --2- 172.21.15.82:0/849225353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4be4101410 0x7f4be410d920 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.725+0000 7f4be91e2640 1 --2- 172.21.15.82:0/849225353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be4100a50 0x7f4be4100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.725+0000 7f4be91e2640 1 --2- 172.21.15.82:0/849225353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4be4106a60 0x7f4be4106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.725+0000 7f4be91e2640 1 -- 172.21.15.82:0/849225353 >> 172.21.15.82:0/849225353 conn(0x7f4be4077b50 msgr2=0x7f4be4077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.725+0000 7f4be91e2640 1 -- 172.21.15.82:0/849225353 shutdown_connections 2024-03-27T07:25:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.725+0000 7f4be91e2640 1 -- 172.21.15.82:0/849225353 wait complete. 2024-03-27T07:25:47.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.725+0000 7f4be91e2640 1 Processor -- start 2024-03-27T07:25:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be91e2640 1 -- start start 2024-03-27T07:25:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be91e2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4be4100a50 0x7f4be4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be91e2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4be4101410 0x7f4be4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be91e2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be4106a60 0x7f4be419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be91e2640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4be4110e70 con 0x7f4be4100a50 2024-03-27T07:25:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be91e2640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f4be4110cf0 con 0x7f4be4101410 2024-03-27T07:25:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be91e2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4be4110ff0 con 0x7f4be4106a60 2024-03-27T07:25:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4be4100a50 0x7f4be4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be259c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4be4101410 0x7f4be4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4be4100a50 0x7f4be4198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34744/0 (socket says 172.21.15.82:34744) 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be2d9d640 1 -- 172.21.15.82:0/2535144331 learned_addr learned my addr 172.21.15.82:0/2535144331 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be259c640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4be4101410 0x7f4be4198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:46842/0 (socket says 172.21.15.82:46842) 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be359e640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be4106a60 0x7f4be419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be2d9d640 1 -- 172.21.15.82:0/2535144331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be4106a60 msgr2=0x7f4be419ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be2d9d640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be4106a60 0x7f4be419ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be2d9d640 1 -- 172.21.15.82:0/2535144331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4be4101410 msgr2=0x7f4be4198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be2d9d640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4be4101410 0x7f4be4198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be2d9d640 1 -- 172.21.15.82:0/2535144331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be419d400 con 0x7f4be4100a50 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be259c640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4be4101410 0x7f4be4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.726+0000 7f4be2d9d640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4be4100a50 0x7f4be4198410 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400e9f0 tx=0x7f4bd400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.727+0000 7f4bcbfff640 1 -- 172.21.15.82:0/2535144331 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd400cd80 con 0x7f4be4100a50 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.727+0000 7f4be91e2640 1 -- 172.21.15.82:0/2535144331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be419d6f0 con 0x7f4be4100a50 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.727+0000 7f4bcbfff640 1 -- 172.21.15.82:0/2535144331 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4bd4010910 con 0x7f4be4100a50 2024-03-27T07:25:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.727+0000 7f4bcbfff640 1 -- 172.21.15.82:0/2535144331 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4018990 con 0x7f4be4100a50 2024-03-27T07:25:47.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.727+0000 7f4be91e2640 1 -- 172.21.15.82:0/2535144331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be41a4f80 con 0x7f4be4100a50 2024-03-27T07:25:47.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.728+0000 7f4be91e2640 1 -- 172.21.15.82:0/2535144331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be4068940 con 0x7f4be4100a50 2024-03-27T07:25:47.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.729+0000 7f4bcbfff640 1 -- 172.21.15.82:0/2535144331 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f4bd4010ac0 con 0x7f4be4100a50 2024-03-27T07:25:47.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.729+0000 7f4bcbfff640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4bcc0a3780 0x7f4bcc0a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:47.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.730+0000 7f4be259c640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4bcc0a3780 0x7f4bcc0a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:47.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.730+0000 7f4bcbfff640 1 -- 172.21.15.82:0/2535144331 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f4bd40d0320 con 0x7f4be4100a50 2024-03-27T07:25:47.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.730+0000 7f4be259c640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4bcc0a3780 0x7f4bcc0a5c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4be41005a0 tx=0x7f4bd8005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:47.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:47.734+0000 7f4bcbfff640 1 -- 172.21.15.82:0/2535144331 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4bd409c5b0 con 0x7f4be4100a50 2024-03-27T07:25:48.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.228+0000 7f4be91e2640 1 -- 172.21.15.82:0/2535144331 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4be4109ff0 con 0x7f4be4100a50 2024-03-27T07:25:48.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.229+0000 7f4bcbfff640 1 -- 172.21.15.82:0/2535144331 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11866 (secure 0 0 0) 0x7f4bd40a08b0 con 0x7f4be4100a50 2024-03-27T07:25:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:25:48.233 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:25:25.065944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:25:48.234 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2024-03-27T07:25:48.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.253+0000 7f4be91e2640 1 -- 172.21.15.82:0/2535144331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4bcc0a3780 msgr2=0x7f4bcc0a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.253+0000 7f4be91e2640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4bcc0a3780 0x7f4bcc0a5c40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4be41005a0 tx=0x7f4bd8005f90 comp rx=0 tx=0).stop 2024-03-27T07:25:48.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.253+0000 7f4be91e2640 1 -- 172.21.15.82:0/2535144331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4be4100a50 msgr2=0x7f4be4198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.253+0000 7f4be91e2640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4be4100a50 0x7f4be4198410 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4bd400e9f0 tx=0x7f4bd400eeb0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.262+0000 7f4be91e2640 1 -- 172.21.15.82:0/2535144331 shutdown_connections 2024-03-27T07:25:48.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.262+0000 7f4be91e2640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4bcc0a3780 0x7f4bcc0a5c40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.262+0000 7f4be91e2640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be4106a60 0x7f4be419ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.262+0000 7f4be91e2640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f4be4101410 0x7f4be4198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.262+0000 7f4be91e2640 1 --2- 172.21.15.82:0/2535144331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4be4100a50 0x7f4be4198410 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.262+0000 7f4be91e2640 1 -- 172.21.15.82:0/2535144331 >> 172.21.15.82:0/2535144331 conn(0x7f4be4077b50 msgr2=0x7f4be4068f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.262+0000 7f4be91e2640 1 -- 172.21.15.82:0/2535144331 shutdown_connections 2024-03-27T07:25:48.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.262+0000 7f4be91e2640 1 -- 172.21.15.82:0/2535144331 wait complete. 2024-03-27T07:25:48.308 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T07:25:48.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.516+0000 7f7375d1e640 1 -- 172.21.15.82:0/3638146383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737010e3a0 msgr2=0x7f737010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.516+0000 7f7375d1e640 1 --2- 172.21.15.82:0/3638146383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737010e3a0 0x7f737010e820 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7360009900 tx=0x7f736002bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:48.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.517+0000 7f7375d1e640 1 -- 172.21.15.82:0/3638146383 shutdown_connections 2024-03-27T07:25:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.517+0000 7f7375d1e640 1 --2- 172.21.15.82:0/3638146383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737010e3a0 0x7f737010e820 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.517+0000 7f7375d1e640 1 --2- 172.21.15.82:0/3638146383 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f737011b330 0x7f737011d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.517+0000 7f7375d1e640 1 --2- 172.21.15.82:0/3638146383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370110370 0x7f737010de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.517+0000 7f7375d1e640 1 -- 172.21.15.82:0/3638146383 >> 172.21.15.82:0/3638146383 conn(0x7f737006cc30 msgr2=0x7f737006d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.517+0000 7f7375d1e640 1 -- 172.21.15.82:0/3638146383 shutdown_connections 2024-03-27T07:25:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.517+0000 7f7375d1e640 1 -- 172.21.15.82:0/3638146383 wait complete. 2024-03-27T07:25:48.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.518+0000 7f7375d1e640 1 Processor -- start 2024-03-27T07:25:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.519+0000 7f7375d1e640 1 -- start start 2024-03-27T07:25:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.519+0000 7f7375d1e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f737010e3a0 0x7f73701a7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.519+0000 7f7375d1e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370110370 0x7f73701a7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.519+0000 7f7375d1e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737011b330 0x7f73701abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.519+0000 7f7375d1e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7370120cf0 con 0x7f737011b330 2024-03-27T07:25:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.519+0000 7f7375d1e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7370120b70 con 0x7f737010e3a0 2024-03-27T07:25:48.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.519+0000 7f7375d1e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7370120e70 con 0x7f7370110370 2024-03-27T07:25:48.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736f7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f737010e3a0 0x7f73701a7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736f7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f737010e3a0 0x7f73701a7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:46860/0 (socket says 172.21.15.82:46860) 2024-03-27T07:25:48.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736f7fe640 1 -- 172.21.15.82:0/2027222249 learned_addr learned my addr 172.21.15.82:0/2027222249 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736effd640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370110370 0x7f73701a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736f7fe640 1 -- 172.21.15.82:0/2027222249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370110370 msgr2=0x7f73701a7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736f7fe640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370110370 0x7f73701a7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736f7fe640 1 -- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737011b330 msgr2=0x7f73701abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736ffff640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737011b330 0x7f73701abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736f7fe640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737011b330 0x7f73701abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736f7fe640 1 -- 172.21.15.82:0/2027222249 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73701ac200 con 0x7f737010e3a0 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.520+0000 7f736ffff640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737011b330 0x7f73701abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.521+0000 7f736f7fe640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f737010e3a0 0x7f73701a7210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f736400c890 tx=0x7f736400cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.521+0000 7f736cff9640 1 -- 172.21.15.82:0/2027222249 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364004220 con 0x7f737010e3a0 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.521+0000 7f7375d1e640 1 -- 172.21.15.82:0/2027222249 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73701ac4f0 con 0x7f737010e3a0 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.521+0000 7f7375d1e640 1 -- 172.21.15.82:0/2027222249 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73701b3d80 con 0x7f737010e3a0 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.521+0000 7f736cff9640 1 -- 172.21.15.82:0/2027222249 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f73640043c0 con 0x7f737010e3a0 2024-03-27T07:25:48.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.521+0000 7f736cff9640 1 -- 172.21.15.82:0/2027222249 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73640049e0 con 0x7f737010e3a0 2024-03-27T07:25:48.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.525+0000 7f73789e3740 1 Processor -- start 2024-03-27T07:25:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f736cff9640 1 -- 172.21.15.82:0/2027222249 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f7364004c40 con 0x7f737010e3a0 2024-03-27T07:25:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f73789e3740 1 -- start start 2024-03-27T07:25:48.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f73789e3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 0x556f134e5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f73789e3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ee770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f73789e3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 0x556f134f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f73789e3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f13449710 con 0x556f134e60d0 2024-03-27T07:25:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f73789e3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556f133f1af0 con 0x556f134e57b0 2024-03-27T07:25:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f73789e3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556f134456c0 con 0x556f134eecb0 2024-03-27T07:25:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f736effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 0x556f134f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f736effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 0x556f134f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42128/0 (socket says 172.21.15.82:42128) 2024-03-27T07:25:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.526+0000 7f736effd640 1 -- 172.21.15.82:0/805907225 learned_addr learned my addr 172.21.15.82:0/805907225 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.527+0000 7f736f7fe640 1 --2- 172.21.15.82:0/805907225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ee770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.527+0000 7f736ffff640 1 --2- 172.21.15.82:0/805907225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 0x556f134e5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.527+0000 7f736effd640 1 -- 172.21.15.82:0/805907225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 msgr2=0x556f134e5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.527+0000 7f736effd640 1 --2- 172.21.15.82:0/805907225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 0x556f134e5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.527+0000 7f736effd640 1 -- 172.21.15.82:0/805907225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 msgr2=0x556f134ee770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.527+0000 7f736effd640 1 --2- 172.21.15.82:0/805907225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ee770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.527+0000 7f736effd640 1 -- 172.21.15.82:0/805907225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f1315d3f0 con 0x556f134eecb0 2024-03-27T07:25:48.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.527+0000 7f736effd640 1 --2- 172.21.15.82:0/805907225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 0x556f134f10a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7360009900 tx=0x7f7360005e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d42f94df2ef28f99 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.530+0000 7f7355ffb640 1 -- 172.21.15.82:0/805907225 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360044020 con 0x556f134eecb0 2024-03-27T07:25:48.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.530+0000 7f7355ffb640 1 -- 172.21.15.82:0/805907225 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7360004240 con 0x556f134eecb0 2024-03-27T07:25:48.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.531+0000 7f736f7fe640 1 --2- 172.21.15.82:0/805907225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ee770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.531+0000 7f73789e3740 1 -- 172.21.15.82:0/805907225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 msgr2=0x556f134f10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.531+0000 7f73789e3740 1 --2- 172.21.15.82:0/805907225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 0x556f134f10a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7360009900 tx=0x7f7360005e60 comp rx=0 tx=0).stop 2024-03-27T07:25:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.531+0000 7f73789e3740 1 -- 172.21.15.82:0/805907225 shutdown_connections 2024-03-27T07:25:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.531+0000 7f73789e3740 1 --2- 172.21.15.82:0/805907225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ee770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.531+0000 7f73789e3740 1 --2- 172.21.15.82:0/805907225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 0x556f134f10a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.531+0000 7f73789e3740 1 --2- 172.21.15.82:0/805907225 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 0x556f134e5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.531+0000 7f73789e3740 1 -- 172.21.15.82:0/805907225 >> 172.21.15.82:0/805907225 conn(0x556f134dfee0 msgr2=0x556f134e02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.531+0000 7f736cff9640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f73580a36c0 0x7f73580a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.532+0000 7f736effd640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f73580a36c0 0x7f73580a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.532+0000 7f736cff9640 1 -- 172.21.15.82:0/2027222249 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f73640cfdc0 con 0x7f737010e3a0 2024-03-27T07:25:48.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.532+0000 7f73789e3740 1 -- 172.21.15.82:0/805907225 shutdown_connections 2024-03-27T07:25:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.533+0000 7f736effd640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f73580a36c0 0x7f73580a5b80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x556f134e1070 tx=0x7f73600052d0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.533+0000 7f73789e3740 1 -- 172.21.15.82:0/805907225 wait complete. 2024-03-27T07:25:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.533+0000 7f73789e3740 1 -- start start 2024-03-27T07:25:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.533+0000 7f73789e3740 1 Processor -- start 2024-03-27T07:25:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f73789e3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 0x556f134ebbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f73789e3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ec0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f73789e3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 0x556f134ec630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f73789e3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f134f1a90 con 0x556f134e60d0 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f73789e3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556f13404eb0 con 0x556f134e57b0 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f73789e3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556f134f1c10 con 0x556f134eecb0 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f73789e3740 10 client.0 _ll_register_callbacks cb 0x556f134416a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f736effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ec0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f736effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ec0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34776/0 (socket says 172.21.15.82:34776) 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f736effd640 1 -- 172.21.15.82:0/1395488169 learned_addr learned my addr 172.21.15.82:0/1395488169 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f736f7fe640 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 0x556f134ebbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f736ffff640 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 0x556f134ec630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f736f7fe640 1 -- 172.21.15.82:0/1395488169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 msgr2=0x556f134ec630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f736f7fe640 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 0x556f134ec630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f736f7fe640 1 -- 172.21.15.82:0/1395488169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 msgr2=0x556f134ec0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f736f7fe640 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ec0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.534+0000 7f736f7fe640 1 -- 172.21.15.82:0/1395488169 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f132277d0 con 0x556f134e57b0 2024-03-27T07:25:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.535+0000 7f736effd640 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ec0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.535+0000 7f736f7fe640 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 0x556f134ebbb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f73640cd500 tx=0x7f73640987a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c79ec0247039954d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.535+0000 7f73537f6640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:25:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.535+0000 7f73537f6640 1 -- 172.21.15.82:0/1395488169 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736401d040 con 0x556f134e57b0 2024-03-27T07:25:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.535+0000 7f73789e3740 1 -- 172.21.15.82:0/1395488169 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7360004240 con 0x556f134e57b0 2024-03-27T07:25:48.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.535+0000 7f73537f6640 1 -- 172.21.15.82:0/1395488169 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f73640cd780 con 0x556f134e57b0 2024-03-27T07:25:48.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.535+0000 7f73537f6640 1 -- 172.21.15.82:0/1395488169 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f736409bda0 con 0x556f134e57b0 2024-03-27T07:25:48.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.535+0000 7f73789e3740 10 client.25868 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:48.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.535+0000 7f73789e3740 1 -- 172.21.15.82:0/1395488169 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556f134fdad0 con 0x556f134e57b0 2024-03-27T07:25:48.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.536+0000 7f73537f6640 1 -- 172.21.15.82:0/1395488169 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7360004240 con 0x556f134e57b0 2024-03-27T07:25:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.537+0000 7f73537f6640 1 -- 172.21.15.82:0/1395488169 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f73640a4c20 con 0x556f134e57b0 2024-03-27T07:25:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.537+0000 7f73789e3740 10 client.25868 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.537+0000 7f73789e3740 10 client.25868 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:25:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.537+0000 7f73789e3740 20 client.25868 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.537+0000 7f73789e3740 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x556f134ff030 0x556f135014d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.537+0000 7f73789e3740 4 client.25868 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.537+0000 7f73789e3740 1 -- 172.21.15.82:0/1395488169 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f13456c50 con 0x556f134ff030 2024-03-27T07:25:48.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.537+0000 7f736effd640 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x556f134ff030 0x556f135014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.537+0000 7f736effd640 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x556f134ff030 0x556f135014d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25c43f98d746159e server_cookie=36bbb89c61bc2e2e in_seq=0 out_seq=0 2024-03-27T07:25:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.537+0000 7f73537f6640 10 client.25868 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:25:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73537f6640 1 -- 172.21.15.82:0/1395488169 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556f13456c50 con 0x556f134ff030 2024-03-27T07:25:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73537f6640 10 client.25868 handle_command_reply: tid=0 2024-03-27T07:25:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73789e3740 1 client.25868 shutdown 2024-03-27T07:25:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73789e3740 1 -- 172.21.15.82:0/1395488169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 msgr2=0x556f134ebbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73789e3740 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 0x556f134ebbb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f73640cd500 tx=0x7f73640987a0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73789e3740 1 -- 172.21.15.82:0/1395488169 shutdown_connections 2024-03-27T07:25:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73789e3740 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x556f134ff030 0x556f135014d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73789e3740 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e60d0 0x556f134ec0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73789e3740 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134eecb0 0x556f134ec630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73789e3740 1 --2- 172.21.15.82:0/1395488169 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134e57b0 0x556f134ebbb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73789e3740 1 -- 172.21.15.82:0/1395488169 >> 172.21.15.82:0/1395488169 conn(0x556f134dfee0 msgr2=0x556f134e1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.538+0000 7f73537f6640 0 client.25868 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:25:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.539+0000 7f73789e3740 1 -- 172.21.15.82:0/1395488169 shutdown_connections 2024-03-27T07:25:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.539+0000 7f73789e3740 1 -- 172.21.15.82:0/1395488169 wait complete. 2024-03-27T07:25:48.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.539+0000 7f73789e3740 20 client.25868 trim_cache size 0 max 16384 2024-03-27T07:25:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f73789e3740 1 Processor -- start 2024-03-27T07:25:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f73789e3740 1 -- start start 2024-03-27T07:25:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f73789e3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 0x556f134ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f73789e3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f134fa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f73789e3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 0x556f134ec450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f73789e3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f735c010fc0 con 0x556f134e57b0 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f73789e3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f735c00e830 con 0x556f134eecb0 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f73789e3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f735c00c680 con 0x556f134e60d0 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f736f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 0x556f134ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f736effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f134fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f736ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 0x556f134ec450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f736effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f134fa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42156/0 (socket says 172.21.15.82:42156) 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.560+0000 7f736effd640 1 -- 172.21.15.82:0/49327812 learned_addr learned my addr 172.21.15.82:0/49327812 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.561+0000 7f736effd640 1 -- 172.21.15.82:0/49327812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 msgr2=0x556f134ec450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.561+0000 7f736effd640 1 --2- 172.21.15.82:0/49327812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 0x556f134ec450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.561+0000 7f736effd640 1 -- 172.21.15.82:0/49327812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 msgr2=0x556f134ee2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.561+0000 7f736effd640 1 --2- 172.21.15.82:0/49327812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 0x556f134ee2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.561+0000 7f736effd640 1 -- 172.21.15.82:0/49327812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f134dfd10 con 0x556f134e60d0 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.561+0000 7f736effd640 1 --2- 172.21.15.82:0/49327812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f134fa910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7360036040 tx=0x7f7360049000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6de66e91af322388 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.561+0000 7f73557fa640 1 -- 172.21.15.82:0/49327812 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360044040 con 0x556f134e60d0 2024-03-27T07:25:48.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.561+0000 7f73557fa640 1 -- 172.21.15.82:0/49327812 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f736005b070 con 0x556f134e60d0 2024-03-27T07:25:48.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.561+0000 7f73557fa640 1 -- 172.21.15.82:0/49327812 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7360040470 con 0x556f134e60d0 2024-03-27T07:25:48.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 -- 172.21.15.82:0/49327812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 msgr2=0x556f134fa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 --2- 172.21.15.82:0/49327812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f134fa910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7360036040 tx=0x7f7360049000 comp rx=0 tx=0).stop 2024-03-27T07:25:48.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 -- 172.21.15.82:0/49327812 shutdown_connections 2024-03-27T07:25:48.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 --2- 172.21.15.82:0/49327812 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 0x556f134ec450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 --2- 172.21.15.82:0/49327812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f134fa910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 --2- 172.21.15.82:0/49327812 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 0x556f134ee2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 -- 172.21.15.82:0/49327812 >> 172.21.15.82:0/49327812 conn(0x556f134dfee0 msgr2=0x556f134df000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 -- 172.21.15.82:0/49327812 shutdown_connections 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 -- 172.21.15.82:0/49327812 wait complete. 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 -- start start 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.562+0000 7f73789e3740 1 Processor -- start 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f73789e3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 0x556f1355d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f73789e3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f1355dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f73789e3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 0x556f134f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f73789e3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f735c00ccf0 con 0x556f134e57b0 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f73789e3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f735c00e160 con 0x556f134eecb0 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f73789e3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f735c00d3c0 con 0x556f134e60d0 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f73789e3740 10 client.0 _ll_register_callbacks cb 0x7f7364004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 0x556f1355d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f1355dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 0x556f1355d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34790/0 (socket says 172.21.15.82:34790) 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f1355dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42172/0 (socket says 172.21.15.82:42172) 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736f7fe640 1 -- 172.21.15.82:0/1505303398 learned_addr learned my addr 172.21.15.82:0/1505303398 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736ffff640 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 0x556f134f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736ffff640 1 -- 172.21.15.82:0/1505303398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 msgr2=0x556f1355dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736ffff640 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f1355dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736ffff640 1 -- 172.21.15.82:0/1505303398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 msgr2=0x556f1355d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736ffff640 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 0x556f1355d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736ffff640 1 -- 172.21.15.82:0/1505303398 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f134f27d0 con 0x556f134eecb0 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f736ffff640 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 0x556f134f20e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7368005fd0 tx=0x7f7368004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fdb422d6840d92b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.563+0000 7f73537f6640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73537f6640 1 -- 172.21.15.82:0/1505303398 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368012660 con 0x556f134eecb0 2024-03-27T07:25:48.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73537f6640 1 -- 172.21.15.82:0/1505303398 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f7368012800 con 0x556f134eecb0 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73789e3740 1 -- 172.21.15.82:0/1505303398 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f736005b070 con 0x556f134eecb0 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73537f6640 1 -- 172.21.15.82:0/1505303398 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7368012a00 con 0x556f134eecb0 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73789e3740 10 client.25874 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73789e3740 1 -- 172.21.15.82:0/1505303398 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556f13564fa0 con 0x556f134eecb0 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73537f6640 1 -- 172.21.15.82:0/1505303398 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f736005b070 con 0x556f134eecb0 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73537f6640 1 -- 172.21.15.82:0/1505303398 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7368026c90 con 0x556f134eecb0 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73789e3740 10 client.25874 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73789e3740 10 client.25874 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73789e3740 20 client.25874 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73789e3740 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x556f135656d0 0x556f13567af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73789e3740 4 client.25874 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.564+0000 7f73789e3740 1 -- 172.21.15.82:0/1505303398 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556f13450fa0 con 0x556f135656d0 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.565+0000 7f736f7fe640 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x556f135656d0 0x556f13567af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.565+0000 7f73537f6640 10 client.25874 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.565+0000 7f736f7fe640 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x556f135656d0 0x556f13567af0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f8481f122cc343a9 server_cookie=371b24415166bb42 in_seq=0 out_seq=0 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.565+0000 7f73537f6640 1 -- 172.21.15.82:0/1505303398 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556f13450fa0 con 0x556f135656d0 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.565+0000 7f73537f6640 10 client.25874 handle_command_reply: tid=0 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.565+0000 7f73789e3740 1 client.25874 shutdown 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.565+0000 7f73789e3740 1 -- 172.21.15.82:0/1505303398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 msgr2=0x556f134f20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.565+0000 7f73789e3740 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 0x556f134f20e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7368005fd0 tx=0x7f7368004410 comp rx=0 tx=0).stop 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f73789e3740 1 -- 172.21.15.82:0/1505303398 shutdown_connections 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f73789e3740 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x556f135656d0 0x556f13567af0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f73789e3740 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556f134eecb0 0x556f134f20e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f73789e3740 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f134e60d0 0x556f1355dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f73537f6640 0 client.25874 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f73789e3740 1 --2- 172.21.15.82:0/1505303398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f134e57b0 0x556f1355d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f73789e3740 1 -- 172.21.15.82:0/1505303398 >> 172.21.15.82:0/1505303398 conn(0x556f134dfee0 msgr2=0x556f134ea350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f73789e3740 1 -- 172.21.15.82:0/1505303398 shutdown_connections 2024-03-27T07:25:48.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f73789e3740 1 -- 172.21.15.82:0/1505303398 wait complete. 2024-03-27T07:25:48.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f73789e3740 20 client.25874 trim_cache size 0 max 16384 2024-03-27T07:25:48.574 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f7375d1e640 1 -- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f73580a36c0 msgr2=0x7f73580a5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f7375d1e640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f73580a36c0 0x7f73580a5b80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x556f134e1070 tx=0x7f73600052d0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f7375d1e640 1 -- 172.21.15.82:0/2027222249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f737010e3a0 msgr2=0x7f73701a7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.566+0000 7f7375d1e640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f737010e3a0 0x7f73701a7210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f736400c890 tx=0x7f736400cd50 comp rx=0 tx=0).stop 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.567+0000 7f7375d1e640 1 -- 172.21.15.82:0/2027222249 shutdown_connections 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.567+0000 7f7375d1e640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f73580a36c0 0x7f73580a5b80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.567+0000 7f7375d1e640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f737011b330 0x7f73701abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.567+0000 7f7375d1e640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370110370 0x7f73701a7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.567+0000 7f7375d1e640 1 --2- 172.21.15.82:0/2027222249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f737010e3a0 0x7f73701a7210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.567+0000 7f7375d1e640 1 -- 172.21.15.82:0/2027222249 >> 172.21.15.82:0/2027222249 conn(0x7f737006cc30 msgr2=0x7f7370072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.567+0000 7f7375d1e640 1 -- 172.21.15.82:0/2027222249 shutdown_connections 2024-03-27T07:25:48.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.567+0000 7f7375d1e640 1 -- 172.21.15.82:0/2027222249 wait complete. 2024-03-27T07:25:48.591 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T07:25:48.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.734+0000 7f6cd450d640 1 -- 172.21.15.82:0/2484997638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ccc107090 msgr2=0x7f6ccc10e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.734+0000 7f6cd450d640 1 --2- 172.21.15.82:0/2484997638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ccc107090 0x7f6ccc10e950 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009900 tx=0x7f6cbc02bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.735+0000 7f6cd450d640 1 -- 172.21.15.82:0/2484997638 shutdown_connections 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.735+0000 7f6cd450d640 1 --2- 172.21.15.82:0/2484997638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ccc107090 0x7f6ccc10e950 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.735+0000 7f6cd450d640 1 --2- 172.21.15.82:0/2484997638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ccc1066d0 0x7f6ccc106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.735+0000 7f6cd450d640 1 --2- 172.21.15.82:0/2484997638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ccc069130 0x7f6ccc069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.735+0000 7f6cd450d640 1 -- 172.21.15.82:0/2484997638 >> 172.21.15.82:0/2484997638 conn(0x7f6ccc077b50 msgr2=0x7f6ccc077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.735+0000 7f6cd450d640 1 -- 172.21.15.82:0/2484997638 shutdown_connections 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.735+0000 7f6cd450d640 1 -- 172.21.15.82:0/2484997638 wait complete. 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.735+0000 7f6cd450d640 1 Processor -- start 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.735+0000 7f6cd450d640 1 -- start start 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.735+0000 7f6cd450d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ccc069130 0x7f6ccc198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd450d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ccc1066d0 0x7f6ccc1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd450d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ccc107090 0x7f6ccc19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd450d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc111ed0 con 0x7f6ccc107090 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd450d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc111d50 con 0x7f6ccc1066d0 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd450d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc112050 con 0x7f6ccc069130 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd22a9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ccc069130 0x7f6ccc198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd2aaa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ccc107090 0x7f6ccc19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd2aaa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ccc107090 0x7f6ccc19cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34802/0 (socket says 172.21.15.82:34802) 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd2aaa640 1 -- 172.21.15.82:0/1247272922 learned_addr learned my addr 172.21.15.82:0/1247272922 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd22a9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ccc069130 0x7f6ccc198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42188/0 (socket says 172.21.15.82:42188) 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd1aa8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ccc1066d0 0x7f6ccc1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd2aaa640 1 -- 172.21.15.82:0/1247272922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ccc069130 msgr2=0x7f6ccc198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd2aaa640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ccc069130 0x7f6ccc198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd2aaa640 1 -- 172.21.15.82:0/1247272922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ccc1066d0 msgr2=0x7f6ccc1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd2aaa640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ccc1066d0 0x7f6ccc1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd2aaa640 1 -- 172.21.15.82:0/1247272922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc19d380 con 0x7f6ccc107090 2024-03-27T07:25:48.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd1aa8640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ccc1066d0 0x7f6ccc1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:48.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.736+0000 7f6cd2aaa640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ccc107090 0x7f6ccc19cc50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009230 tx=0x7f6cbc02cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.739+0000 7f6ccb7fe640 1 -- 172.21.15.82:0/1247272922 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc041070 con 0x7f6ccc107090 2024-03-27T07:25:48.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.739+0000 7f6ccb7fe640 1 -- 172.21.15.82:0/1247272922 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cbc004450 con 0x7f6ccc107090 2024-03-27T07:25:48.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.739+0000 7f6cd450d640 1 -- 172.21.15.82:0/1247272922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ccc19d610 con 0x7f6ccc107090 2024-03-27T07:25:48.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.739+0000 7f6ccb7fe640 1 -- 172.21.15.82:0/1247272922 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc003d30 con 0x7f6ccc107090 2024-03-27T07:25:48.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.739+0000 7f6cd450d640 1 -- 172.21.15.82:0/1247272922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ccc1a4f00 con 0x7f6ccc107090 2024-03-27T07:25:48.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.741+0000 7f6ccb7fe640 1 -- 172.21.15.82:0/1247272922 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f6cbc044070 con 0x7f6ccc107090 2024-03-27T07:25:48.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.741+0000 7f6cd71cd740 1 Processor -- start 2024-03-27T07:25:48.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd71cd740 1 -- start start 2024-03-27T07:25:48.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e627b0 0x55b967e62b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e6b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 0x55b967e6e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b967dc6710 con 0x55b967e627b0 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b967d6eaf0 con 0x55b967e630d0 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b967dc26c0 con 0x55b967e6bcb0 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6ccb7fe640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6cb40a3800 0x7f6cb40a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd22a9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e6b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd1aa8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e627b0 0x55b967e62b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd22a9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e6b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:46926/0 (socket says 172.21.15.82:46926) 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd22a9640 1 -- 172.21.15.82:0/2843819612 learned_addr learned my addr 172.21.15.82:0/2843819612 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd1aa8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e627b0 0x55b967e62b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34818/0 (socket says 172.21.15.82:34818) 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd2aaa640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6cb40a3800 0x7f6cb40a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd1aa8640 1 --2- 172.21.15.82:0/2843819612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 0x55b967e6e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6ccb7fe640 1 -- 172.21.15.82:0/1247272922 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f6cbc0f1a60 con 0x7f6ccc107090 2024-03-27T07:25:48.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd22a9640 1 -- 172.21.15.82:0/2843819612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 msgr2=0x55b967e6e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/2843819612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 0x55b967e6e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd22a9640 1 -- 172.21.15.82:0/2843819612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e627b0 msgr2=0x55b967e62b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/2843819612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e627b0 0x55b967e62b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.742+0000 7f6cd22a9640 1 -- 172.21.15.82:0/2843819612 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b967ada3f0 con 0x55b967e630d0 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.743+0000 7f6cd2aaa640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6cb40a3800 0x7f6cb40a5cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0ef3c0 tx=0x7f6cbc02bc30 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.743+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/2843819612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e6b770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009fd0 tx=0x7f6cc4013c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebd5c45c0f499aa3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.743+0000 7f6cc8bfe640 1 -- 172.21.15.82:0/2843819612 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400ea50 con 0x55b967e630d0 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.743+0000 7f6cc8bfe640 1 -- 172.21.15.82:0/2843819612 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc4003e50 con 0x55b967e630d0 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.743+0000 7f6cc8bfe640 1 -- 172.21.15.82:0/2843819612 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4004810 con 0x55b967e630d0 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 -- 172.21.15.82:0/2843819612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 msgr2=0x55b967e6b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/2843819612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e6b770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009fd0 tx=0x7f6cc4013c60 comp rx=0 tx=0).stop 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 -- 172.21.15.82:0/2843819612 shutdown_connections 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/2843819612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 0x55b967e6e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/2843819612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e6b770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/2843819612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e627b0 0x55b967e62b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 -- 172.21.15.82:0/2843819612 >> 172.21.15.82:0/2843819612 conn(0x55b967e5cee0 msgr2=0x55b967e5d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 -- 172.21.15.82:0/2843819612 shutdown_connections 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 -- 172.21.15.82:0/2843819612 wait complete. 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 -- start start 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 Processor -- start 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 0x55b967e68cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e691f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 0x55b967e69730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b967e6eaa0 con 0x55b967e6bcb0 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b967d81eb0 con 0x55b967e630d0 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.744+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b967e6ec20 con 0x55b967e627b0 2024-03-27T07:25:48.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd71cd740 10 client.0 _ll_register_callbacks cb 0x55b967dbe6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd1aa8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 0x55b967e69730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd22a9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd22a9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e691f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:46938/0 (socket says 172.21.15.82:46938) 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd22a9640 1 -- 172.21.15.82:0/4081458308 learned_addr learned my addr 172.21.15.82:0/4081458308 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd1aa8640 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 0x55b967e68cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd22a9640 1 -- 172.21.15.82:0/4081458308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 msgr2=0x55b967e68cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 0x55b967e68cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd22a9640 1 -- 172.21.15.82:0/4081458308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 msgr2=0x55b967e69730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 0x55b967e69730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd22a9640 1 -- 172.21.15.82:0/4081458308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b967ba47d0 con 0x55b967e630d0 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e691f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4004470 tx=0x7f6cc4009c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28d73f71f3b706 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:25:48.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/4081458308 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4022040 con 0x55b967e630d0 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/4081458308 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f6cc4004650 con 0x55b967e630d0 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.745+0000 7f6cd71cd740 1 -- 172.21.15.82:0/4081458308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cc4003e50 con 0x55b967e630d0 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/4081458308 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6cc4034050 con 0x55b967e630d0 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cd71cd740 10 client.25886 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cd71cd740 1 -- 172.21.15.82:0/4081458308 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b967e7ad60 con 0x55b967e630d0 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/4081458308 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc4003e50 con 0x55b967e630d0 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/4081458308 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6cc4025070 con 0x55b967e630d0 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cd71cd740 10 client.25886 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cd71cd740 10 client.25886 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cd71cd740 20 client.25886 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b967e7c1c0 0x55b967e7e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cd71cd740 4 client.25886 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:48.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cd71cd740 1 -- 172.21.15.82:0/4081458308 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b967dd3c50 con 0x55b967e7c1c0 2024-03-27T07:25:48.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.746+0000 7f6cd1aa8640 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b967e7c1c0 0x55b967e7e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.747+0000 7f6cd1aa8640 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b967e7c1c0 0x55b967e7e5b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29508ecbaa5c1700 server_cookie=bc01d0d3c665a752 in_seq=0 out_seq=0 2024-03-27T07:25:48.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.747+0000 7f6cb1ffb640 10 client.25886 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:25:48.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.753+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/4081458308 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b967dd3c50 con 0x55b967e7c1c0 2024-03-27T07:25:48.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.753+0000 7f6cb1ffb640 10 client.25886 handle_command_reply: tid=0 2024-03-27T07:25:48.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 client.25886 shutdown 2024-03-27T07:25:48.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 -- 172.21.15.82:0/4081458308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 msgr2=0x55b967e691f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e691f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4004470 tx=0x7f6cc4009c80 comp rx=0 tx=0).stop 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 -- 172.21.15.82:0/4081458308 shutdown_connections 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b967e7c1c0 0x55b967e7e5b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 0x55b967e69730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cb1ffb640 0 client.25886 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e691f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/4081458308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 0x55b967e68cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 -- 172.21.15.82:0/4081458308 >> 172.21.15.82:0/4081458308 conn(0x55b967e5cee0 msgr2=0x55b967e5ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 -- 172.21.15.82:0/4081458308 shutdown_connections 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 1 -- 172.21.15.82:0/4081458308 wait complete. 2024-03-27T07:25:48.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.754+0000 7f6cd71cd740 20 client.25886 trim_cache size 0 max 16384 2024-03-27T07:25:48.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.769+0000 7f6cd71cd740 1 Processor -- start 2024-03-27T07:25:48.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.769+0000 7f6cd71cd740 1 -- start start 2024-03-27T07:25:48.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.769+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e627b0 0x55b967e778a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.769+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e630d0 0x55b967e69550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.769+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 0x55b967e83c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.769+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc1addf0 con 0x55b967e630d0 2024-03-27T07:25:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.769+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc1ab660 con 0x55b967e627b0 2024-03-27T07:25:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.769+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc1a94d0 con 0x55b967e6bcb0 2024-03-27T07:25:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd22a9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e630d0 0x55b967e69550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd1aa8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e627b0 0x55b967e778a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd22a9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e630d0 0x55b967e69550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34836/0 (socket says 172.21.15.82:34836) 2024-03-27T07:25:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd22a9640 1 -- 172.21.15.82:0/1663593953 learned_addr learned my addr 172.21.15.82:0/1663593953 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd1aa8640 1 --2- 172.21.15.82:0/1663593953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 0x55b967e83c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd22a9640 1 -- 172.21.15.82:0/1663593953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 msgr2=0x55b967e83c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/1663593953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 0x55b967e83c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd22a9640 1 -- 172.21.15.82:0/1663593953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e627b0 msgr2=0x55b967e778a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/1663593953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e627b0 0x55b967e778a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd22a9640 1 -- 172.21.15.82:0/1663593953 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b967e5cd10 con 0x55b967e630d0 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd1aa8640 1 --2- 172.21.15.82:0/1663593953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 0x55b967e83c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/1663593953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e630d0 0x55b967e69550 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4005c40 tx=0x7f6cc4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ba2ddee34bcd61 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cb3fff640 1 -- 172.21.15.82:0/1663593953 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4009ea0 con 0x55b967e630d0 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cb3fff640 1 -- 172.21.15.82:0/1663593953 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc402b070 con 0x55b967e630d0 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.770+0000 7f6cb3fff640 1 -- 172.21.15.82:0/1663593953 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400ed60 con 0x55b967e630d0 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 -- 172.21.15.82:0/1663593953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e630d0 msgr2=0x55b967e69550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/1663593953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e630d0 0x55b967e69550 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4005c40 tx=0x7f6cc4009580 comp rx=0 tx=0).stop 2024-03-27T07:25:48.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 -- 172.21.15.82:0/1663593953 shutdown_connections 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/1663593953 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e630d0 0x55b967e69550 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/1663593953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e6bcb0 0x55b967e83c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/1663593953 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e627b0 0x55b967e778a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 -- 172.21.15.82:0/1663593953 >> 172.21.15.82:0/1663593953 conn(0x55b967e5cee0 msgr2=0x55b967e5eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 -- 172.21.15.82:0/1663593953 shutdown_connections 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 -- 172.21.15.82:0/1663593953 wait complete. 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 -- start start 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.771+0000 7f6cd71cd740 1 Processor -- start 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 0x55b967e73fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e6f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd71cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 0x55b967e6f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc1a9b20 con 0x55b967e6bcb0 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc1aaf90 con 0x55b967e630d0 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd71cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc1aa1f0 con 0x55b967e627b0 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd71cd740 10 client.0 _ll_register_callbacks cb 0x7f6cc0009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd1aa8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 0x55b967e6f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd1aa8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 0x55b967e73fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd1aa8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 0x55b967e73fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42216/0 (socket says 172.21.15.82:42216) 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd1aa8640 1 -- 172.21.15.82:0/751524000 learned_addr learned my addr 172.21.15.82:0/751524000 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e6f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd1aa8640 1 -- 172.21.15.82:0/751524000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 msgr2=0x55b967e73fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd1aa8640 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 0x55b967e73fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd1aa8640 1 -- 172.21.15.82:0/751524000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 msgr2=0x55b967e6f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd1aa8640 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e6f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd1aa8640 1 -- 172.21.15.82:0/751524000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b967e70030 con 0x55b967e6bcb0 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd1aa8640 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 0x55b967e6f990 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x55b967e7ec10 tx=0x7f6cc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bafb091883870f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/751524000 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc001c040 con 0x55b967e6bcb0 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/751524000 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f6cc00035f0 con 0x55b967e6bcb0 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd71cd740 1 -- 172.21.15.82:0/751524000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cc402b070 con 0x55b967e6bcb0 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/751524000 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6cc0037050 con 0x55b967e6bcb0 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.772+0000 7f6cd71cd740 10 client.16068 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.773+0000 7f6cd71cd740 1 -- 172.21.15.82:0/751524000 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b967ee21b0 con 0x55b967e6bcb0 2024-03-27T07:25:48.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.773+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/751524000 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cc402b070 con 0x55b967e6bcb0 2024-03-27T07:25:48.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.773+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/751524000 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6cc0027ce0 con 0x55b967e6bcb0 2024-03-27T07:25:48.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.773+0000 7f6cd71cd740 10 client.16068 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:48.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.773+0000 7f6cd71cd740 10 client.16068 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:25:48.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.773+0000 7f6cd71cd740 20 client.16068 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:48.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.773+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b967ee2a10 0x55b967ee4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.773+0000 7f6cd71cd740 4 client.16068 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:25:48.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.773+0000 7f6cd71cd740 1 -- 172.21.15.82:0/751524000 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b967dcdfa0 con 0x55b967ee2a10 2024-03-27T07:25:48.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.773+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b967ee2a10 0x55b967ee4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.774+0000 7f6cb1ffb640 10 client.16068 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:25:48.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.774+0000 7f6cd22a9640 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b967ee2a10 0x55b967ee4e30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0fcc1fde05884b1 server_cookie=6e524c3180c91437 in_seq=0 out_seq=0 2024-03-27T07:25:48.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cb1ffb640 1 -- 172.21.15.82:0/751524000 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b967dcdfa0 con 0x55b967ee2a10 2024-03-27T07:25:48.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cb1ffb640 10 client.16068 handle_command_reply: tid=0 2024-03-27T07:25:48.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 client.16068 shutdown 2024-03-27T07:25:48.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 -- 172.21.15.82:0/751524000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 msgr2=0x55b967e6f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 0x55b967e6f990 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x55b967e7ec10 tx=0x7f6cc0004730 comp rx=0 tx=0).stop 2024-03-27T07:25:48.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 -- 172.21.15.82:0/751524000 shutdown_connections 2024-03-27T07:25:48.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55b967ee2a10 0x55b967ee4e30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b967e6bcb0 0x55b967e6f990 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cb1ffb640 0 client.16068 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:25:48.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b967e630d0 0x55b967e6f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 --2- 172.21.15.82:0/751524000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b967e627b0 0x55b967e73fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 -- 172.21.15.82:0/751524000 >> 172.21.15.82:0/751524000 conn(0x55b967e5cee0 msgr2=0x55b967e5e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 -- 172.21.15.82:0/751524000 shutdown_connections 2024-03-27T07:25:48.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 1 -- 172.21.15.82:0/751524000 wait complete. 2024-03-27T07:25:48.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.776+0000 7f6cd71cd740 20 client.16068 trim_cache size 0 max 16384 2024-03-27T07:25:48.786 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:25:48.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 -- 172.21.15.82:0/1247272922 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6cb40a3800 msgr2=0x7f6cb40a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6cb40a3800 0x7f6cb40a5cc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc0ef3c0 tx=0x7f6cbc02bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:48.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 -- 172.21.15.82:0/1247272922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ccc107090 msgr2=0x7f6ccc19cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ccc107090 0x7f6ccc19cc50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009230 tx=0x7f6cbc02cb30 comp rx=0 tx=0).stop 2024-03-27T07:25:48.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 -- 172.21.15.82:0/1247272922 shutdown_connections 2024-03-27T07:25:48.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6cb40a3800 0x7f6cb40a5cc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ccc107090 0x7f6ccc19cc50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6ccc1066d0 0x7f6ccc1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 --2- 172.21.15.82:0/1247272922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ccc069130 0x7f6ccc198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 -- 172.21.15.82:0/1247272922 >> 172.21.15.82:0/1247272922 conn(0x7f6ccc077b50 msgr2=0x7f6ccc0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 -- 172.21.15.82:0/1247272922 shutdown_connections 2024-03-27T07:25:48.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.777+0000 7f6cd450d640 1 -- 172.21.15.82:0/1247272922 wait complete. 2024-03-27T07:25:48.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T07:25:48.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.895+0000 7f2075dc9640 1 -- 172.21.15.82:0/86629499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20701009c0 msgr2=0x7f2070100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.895+0000 7f2075dc9640 1 --2- 172.21.15.82:0/86629499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20701009c0 0x7f2070100e40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2060009930 tx=0x7f206002bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:48.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.895+0000 7f2075dc9640 1 -- 172.21.15.82:0/86629499 shutdown_connections 2024-03-27T07:25:48.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.895+0000 7f2075dc9640 1 --2- 172.21.15.82:0/86629499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20701009c0 0x7f2070100e40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.895+0000 7f2075dc9640 1 --2- 172.21.15.82:0/86629499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f2070101380 0x7f207010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.895+0000 7f2075dc9640 1 --2- 172.21.15.82:0/86629499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20701069d0 0x7f2070106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.895+0000 7f2075dc9640 1 -- 172.21.15.82:0/86629499 >> 172.21.15.82:0/86629499 conn(0x7f2070077b50 msgr2=0x7f2070077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.895+0000 7f2075dc9640 1 -- 172.21.15.82:0/86629499 shutdown_connections 2024-03-27T07:25:48.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.895+0000 7f2075dc9640 1 -- 172.21.15.82:0/86629499 wait complete. 2024-03-27T07:25:48.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f2075dc9640 1 Processor -- start 2024-03-27T07:25:48.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f2075dc9640 1 -- start start 2024-03-27T07:25:48.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f2075dc9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20701009c0 0x7f20701983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f2075dc9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2070101380 0x7f2070198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f2075dc9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20701069d0 0x7f207019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f2075dc9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2070110de0 con 0x7f2070101380 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f2075dc9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2070110c60 con 0x7f20701009c0 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f2075dc9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2070110f60 con 0x7f20701069d0 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f206effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2070101380 0x7f2070198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f206effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2070101380 0x7f2070198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34850/0 (socket says 172.21.15.82:34850) 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f206effd640 1 -- 172.21.15.82:0/1557919289 learned_addr learned my addr 172.21.15.82:0/1557919289 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f206ffff640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20701069d0 0x7f207019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f206f7fe640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20701009c0 0x7f20701983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f206effd640 1 -- 172.21.15.82:0/1557919289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20701069d0 msgr2=0x7f207019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f206effd640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20701069d0 0x7f207019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f206effd640 1 -- 172.21.15.82:0/1557919289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20701009c0 msgr2=0x7f20701983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f206effd640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20701009c0 0x7f20701983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.896+0000 7f206effd640 1 -- 172.21.15.82:0/1557919289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f207019d3e0 con 0x7f2070101380 2024-03-27T07:25:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.897+0000 7f206effd640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2070101380 0x7f2070198930 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2060009230 tx=0x7f206002cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.897+0000 7f206cff9640 1 -- 172.21.15.82:0/1557919289 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2060041070 con 0x7f2070101380 2024-03-27T07:25:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.897+0000 7f206cff9640 1 -- 172.21.15.82:0/1557919289 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2060004450 con 0x7f2070101380 2024-03-27T07:25:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.897+0000 7f206cff9640 1 -- 172.21.15.82:0/1557919289 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2060003e50 con 0x7f2070101380 2024-03-27T07:25:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.897+0000 7f2075dc9640 1 -- 172.21.15.82:0/1557919289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f207019d670 con 0x7f2070101380 2024-03-27T07:25:48.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.897+0000 7f2075dc9640 1 -- 172.21.15.82:0/1557919289 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20701a4f60 con 0x7f2070101380 2024-03-27T07:25:48.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f206cff9640 1 -- 172.21.15.82:0/1557919289 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f2060044070 con 0x7f2070101380 2024-03-27T07:25:48.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f20789b3740 1 Processor -- start 2024-03-27T07:25:48.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f20789b3740 1 -- start start 2024-03-27T07:25:48.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f20789b3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482ca7b0 0x55c5482cab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f20789b3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f20789b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482d3cb0 0x55c5482d60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f20789b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c54822e710 con 0x55c5482d3cb0 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f20789b3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55c5481d6af0 con 0x55c5482cb0d0 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f20789b3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c54822a6c0 con 0x55c5482ca7b0 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f206effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482d3cb0 0x55c5482d60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f206effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482d3cb0 0x55c5482d60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34854/0 (socket says 172.21.15.82:34854) 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f206f7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f206ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482ca7b0 0x55c5482cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.899+0000 7f206effd640 1 -- 172.21.15.82:0/339321901 learned_addr learned my addr 172.21.15.82:0/339321901 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206cff9640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f205c0a3920 0x7f205c0a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206f7fe640 1 -- 172.21.15.82:0/339321901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482ca7b0 msgr2=0x55c5482cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206f7fe640 1 --2- 172.21.15.82:0/339321901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482ca7b0 0x55c5482cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206f7fe640 1 -- 172.21.15.82:0/339321901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482d3cb0 msgr2=0x55c5482d60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206f7fe640 1 --2- 172.21.15.82:0/339321901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482d3cb0 0x55c5482d60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206f7fe640 1 -- 172.21.15.82:0/339321901 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c547f423f0 con 0x55c5482cb0d0 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206effd640 1 --2- 172.21.15.82:0/339321901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482d3cb0 0x55c5482d60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206ffff640 1 --2- 172.21.15.82:0/339321901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482ca7b0 0x55c5482cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206ffff640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f205c0a3920 0x7f205c0a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206cff9640 1 -- 172.21.15.82:0/1557919289 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f20600f18a0 con 0x7f2070101380 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206f7fe640 1 --2- 172.21.15.82:0/339321901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d3770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2058009c00 tx=0x7f2058011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=659b63ac62ed842f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f2065ffb640 1 -- 172.21.15.82:0/339321901 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058004050 con 0x55c5482cb0d0 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f206ffff640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f205c0a3920 0x7f205c0a5de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2068005fd0 tx=0x7f2068004a40 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f2065ffb640 1 -- 172.21.15.82:0/339321901 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2058005500 con 0x55c5482cb0d0 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.900+0000 7f2065ffb640 1 -- 172.21.15.82:0/339321901 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058004d90 con 0x55c5482cb0d0 2024-03-27T07:25:48.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 -- 172.21.15.82:0/339321901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 msgr2=0x55c5482d3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 --2- 172.21.15.82:0/339321901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d3770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2058009c00 tx=0x7f2058011810 comp rx=0 tx=0).stop 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 -- 172.21.15.82:0/339321901 shutdown_connections 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 --2- 172.21.15.82:0/339321901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482d3cb0 0x55c5482d60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 --2- 172.21.15.82:0/339321901 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d3770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 --2- 172.21.15.82:0/339321901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482ca7b0 0x55c5482cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 -- 172.21.15.82:0/339321901 >> 172.21.15.82:0/339321901 conn(0x55c5482c4ee0 msgr2=0x55c5482c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 -- 172.21.15.82:0/339321901 shutdown_connections 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 -- 172.21.15.82:0/339321901 wait complete. 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 -- start start 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.901+0000 7f20789b3740 1 Processor -- start 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f20789b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f20789b3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f20789b3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482d3cb0 0x55c5482d1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f20789b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c5482d6aa0 con 0x55c5482ca7b0 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f20789b3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55c5481e9eb0 con 0x55c5482cb0d0 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f20789b3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c5482d6c20 con 0x55c5482d3cb0 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f20789b3740 10 client.0 _ll_register_callbacks cb 0x55c5482266a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34858/0 (socket says 172.21.15.82:34858) 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206f7fe640 1 -- 172.21.15.82:0/1095360511 learned_addr learned my addr 172.21.15.82:0/1095360511 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206ffff640 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482d3cb0 0x55c5482d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206f7fe640 1 -- 172.21.15.82:0/1095360511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482d3cb0 msgr2=0x55c5482d1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206f7fe640 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482d3cb0 0x55c5482d1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206f7fe640 1 -- 172.21.15.82:0/1095360511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 msgr2=0x55c5482d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206f7fe640 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206f7fe640 1 -- 172.21.15.82:0/1095360511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c54800c7d0 con 0x55c5482ca7b0 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206effd640 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f206f7fe640 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d0cd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2058004910 tx=0x7f2058005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769ee8131ab29069 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f204effd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f204effd640 1 -- 172.21.15.82:0/1095360511 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058029070 con 0x55c5482ca7b0 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f204effd640 1 -- 172.21.15.82:0/1095360511 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f2058004f20 con 0x55c5482ca7b0 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.902+0000 7f20789b3740 1 -- 172.21.15.82:0/1095360511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2058005500 con 0x55c5482ca7b0 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f204effd640 1 -- 172.21.15.82:0/1095360511 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2058035050 con 0x55c5482ca7b0 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f20789b3740 10 client.16080 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f20789b3740 1 -- 172.21.15.82:0/1095360511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c5482e2d50 con 0x55c5482ca7b0 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f204effd640 1 -- 172.21.15.82:0/1095360511 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2058005500 con 0x55c5482ca7b0 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f204effd640 1 -- 172.21.15.82:0/1095360511 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2058003c90 con 0x55c5482ca7b0 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f20789b3740 10 client.16080 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f20789b3740 10 client.16080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f20789b3740 20 client.16080 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:48.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f20789b3740 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c5482e4100 0x55c5482e64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f20789b3740 4 client.16080 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f20789b3740 1 -- 172.21.15.82:0/1095360511 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c54823bc50 con 0x55c5482e4100 2024-03-27T07:25:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.903+0000 7f206effd640 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c5482e4100 0x55c5482e64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.904+0000 7f204effd640 10 client.16080 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.904+0000 7f206effd640 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c5482e4100 0x55c5482e64f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f682fee44a506a8c server_cookie=72ef0d1a8cd0174c in_seq=0 out_seq=0 2024-03-27T07:25:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.904+0000 7f204effd640 1 -- 172.21.15.82:0/1095360511 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c54823bc50 con 0x55c5482e4100 2024-03-27T07:25:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.904+0000 7f204effd640 10 client.16080 handle_command_reply: tid=0 2024-03-27T07:25:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 client.16080 shutdown 2024-03-27T07:25:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 -- 172.21.15.82:0/1095360511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 msgr2=0x55c5482d0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d0cd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2058004910 tx=0x7f2058005d90 comp rx=0 tx=0).stop 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 -- 172.21.15.82:0/1095360511 shutdown_connections 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482d3cb0 0x55c5482d1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c5482e4100 0x55c5482e64f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 --2- 172.21.15.82:0/1095360511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d0cd0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f204effd640 0 client.16080 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 -- 172.21.15.82:0/1095360511 >> 172.21.15.82:0/1095360511 conn(0x55c5482c4ee0 msgr2=0x55c5482c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 -- 172.21.15.82:0/1095360511 shutdown_connections 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 1 -- 172.21.15.82:0/1095360511 wait complete. 2024-03-27T07:25:48.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.905+0000 7f20789b3740 20 client.16080 trim_cache size 0 max 16384 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f20789b3740 1 Processor -- start 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f20789b3740 1 -- start start 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f20789b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f20789b3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f20789b3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482d3cb0 0x55c5482ebd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f20789b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f20701b0010 con 0x55c5482ca7b0 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f20789b3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f20701ad880 con 0x55c5482cb0d0 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f20789b3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20701ab6d0 con 0x55c5482d3cb0 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f206f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f206f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34868/0 (socket says 172.21.15.82:34868) 2024-03-27T07:25:48.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f206f7fe640 1 -- 172.21.15.82:0/3220777529 learned_addr learned my addr 172.21.15.82:0/3220777529 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f206effd640 1 --2- 172.21.15.82:0/3220777529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.918+0000 7f206ffff640 1 --2- 172.21.15.82:0/3220777529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482d3cb0 0x55c5482ebd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.919+0000 7f206f7fe640 1 -- 172.21.15.82:0/3220777529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482d3cb0 msgr2=0x55c5482ebd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.919+0000 7f206f7fe640 1 --2- 172.21.15.82:0/3220777529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482d3cb0 0x55c5482ebd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.919+0000 7f206f7fe640 1 -- 172.21.15.82:0/3220777529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 msgr2=0x55c5482d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.919+0000 7f206f7fe640 1 --2- 172.21.15.82:0/3220777529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.919+0000 7f206f7fe640 1 -- 172.21.15.82:0/3220777529 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5482c5ab0 con 0x55c5482ca7b0 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.919+0000 7f206effd640 1 --2- 172.21.15.82:0/3220777529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.919+0000 7f206f7fe640 1 --2- 172.21.15.82:0/3220777529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d3400 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2058005e00 tx=0x7f2058004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c958c506a0871cd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.919+0000 7f20657fa640 1 -- 172.21.15.82:0/3220777529 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058029070 con 0x55c5482ca7b0 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.919+0000 7f20657fa640 1 -- 172.21.15.82:0/3220777529 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20580045f0 con 0x55c5482ca7b0 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.919+0000 7f20657fa640 1 -- 172.21.15.82:0/3220777529 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20580039f0 con 0x55c5482ca7b0 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 -- 172.21.15.82:0/3220777529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 msgr2=0x55c5482d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 --2- 172.21.15.82:0/3220777529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d3400 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2058005e00 tx=0x7f2058004a70 comp rx=0 tx=0).stop 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 -- 172.21.15.82:0/3220777529 shutdown_connections 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 --2- 172.21.15.82:0/3220777529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482d3cb0 0x55c5482ebd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 --2- 172.21.15.82:0/3220777529 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482cb0d0 0x55c5482d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 --2- 172.21.15.82:0/3220777529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482d3400 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 -- 172.21.15.82:0/3220777529 >> 172.21.15.82:0/3220777529 conn(0x55c5482c4ee0 msgr2=0x55c5482c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 -- 172.21.15.82:0/3220777529 shutdown_connections 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 -- 172.21.15.82:0/3220777529 wait complete. 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 -- start start 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 Processor -- start 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482dc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482cb0d0 0x55c5482d7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482d3cb0 0x55c5482d79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f20701abd40 con 0x55c5482ca7b0 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f20701ad1b0 con 0x55c5482d3cb0 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f20701ac410 con 0x55c5482cb0d0 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.920+0000 7f20789b3740 10 client.0 _ll_register_callbacks cb 0x7f20600f7420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482dc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482dc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34876/0 (socket says 172.21.15.82:34876) 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206f7fe640 1 -- 172.21.15.82:0/2018835344 learned_addr learned my addr 172.21.15.82:0/2018835344 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206ffff640 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482d3cb0 0x55c5482d79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206effd640 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482cb0d0 0x55c5482d7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206f7fe640 1 -- 172.21.15.82:0/2018835344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482cb0d0 msgr2=0x55c5482d7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206f7fe640 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482cb0d0 0x55c5482d7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206f7fe640 1 -- 172.21.15.82:0/2018835344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482d3cb0 msgr2=0x55c5482d79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206f7fe640 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482d3cb0 0x55c5482d79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206f7fe640 1 -- 172.21.15.82:0/2018835344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5482d81d0 con 0x55c5482ca7b0 2024-03-27T07:25:48.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f206f7fe640 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482dc110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2058009690 tx=0x7f2058009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abff208fc56b9598 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f204effd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f204effd640 1 -- 172.21.15.82:0/2018835344 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058029070 con 0x55c5482ca7b0 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f204effd640 1 -- 172.21.15.82:0/2018835344 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f2058023b10 con 0x55c5482ca7b0 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f20789b3740 1 -- 172.21.15.82:0/2018835344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20580045f0 con 0x55c5482ca7b0 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f204effd640 1 -- 172.21.15.82:0/2018835344 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2058023d50 con 0x55c5482ca7b0 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f20789b3740 10 client.16086 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f20789b3740 1 -- 172.21.15.82:0/2018835344 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c54834a320 con 0x55c5482ca7b0 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.921+0000 7f204effd640 1 -- 172.21.15.82:0/2018835344 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20580045f0 con 0x55c5482ca7b0 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f204effd640 1 -- 172.21.15.82:0/2018835344 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2058005020 con 0x55c5482ca7b0 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f20789b3740 10 client.16086 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f20789b3740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f20789b3740 20 client.16086 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:48.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f20789b3740 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c54834a920 0x55c54834cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f20789b3740 4 client.16086 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f20789b3740 1 -- 172.21.15.82:0/2018835344 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c548235fa0 con 0x55c54834a920 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f206effd640 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c54834a920 0x55c54834cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f206effd640 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c54834a920 0x55c54834cd40 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5c7f4e2de20c0dd server_cookie=e004d05d380789ce in_seq=0 out_seq=0 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f204effd640 10 client.16086 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f204effd640 1 -- 172.21.15.82:0/2018835344 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c548235fa0 con 0x55c54834a920 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f204effd640 10 client.16086 handle_command_reply: tid=0 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.922+0000 7f20789b3740 1 client.16086 shutdown 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 1 -- 172.21.15.82:0/2018835344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 msgr2=0x55c5482dc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482dc110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2058009690 tx=0x7f2058009a50 comp rx=0 tx=0).stop 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 1 -- 172.21.15.82:0/2018835344 shutdown_connections 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c5482d3cb0 0x55c5482d79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c5482cb0d0 0x55c5482d7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c54834a920 0x55c54834cd40 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 1 --2- 172.21.15.82:0/2018835344 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c5482ca7b0 0x55c5482dc110 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f204effd640 0 client.16086 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:48.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 1 -- 172.21.15.82:0/2018835344 >> 172.21.15.82:0/2018835344 conn(0x55c5482c4ee0 msgr2=0x55c5482c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 1 -- 172.21.15.82:0/2018835344 shutdown_connections 2024-03-27T07:25:48.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 1 -- 172.21.15.82:0/2018835344 wait complete. 2024-03-27T07:25:48.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f20789b3740 20 client.16086 trim_cache size 0 max 16384 2024-03-27T07:25:48.932 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:25:48.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 -- 172.21.15.82:0/1557919289 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f205c0a3920 msgr2=0x7f205c0a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f205c0a3920 0x7f205c0a5de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2068005fd0 tx=0x7f2068004a40 comp rx=0 tx=0).stop 2024-03-27T07:25:48.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 -- 172.21.15.82:0/1557919289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2070101380 msgr2=0x7f2070198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:48.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2070101380 0x7f2070198930 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2060009230 tx=0x7f206002cb30 comp rx=0 tx=0).stop 2024-03-27T07:25:48.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 -- 172.21.15.82:0/1557919289 shutdown_connections 2024-03-27T07:25:48.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f205c0a3920 0x7f205c0a5de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2070101380 0x7f2070198930 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20701069d0 0x7f207019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 --2- 172.21.15.82:0/1557919289 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f20701009c0 0x7f20701983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:48.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 -- 172.21.15.82:0/1557919289 >> 172.21.15.82:0/1557919289 conn(0x7f2070077b50 msgr2=0x7f2070068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:48.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 -- 172.21.15.82:0/1557919289 shutdown_connections 2024-03-27T07:25:48.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:48.923+0000 7f2075dc9640 1 -- 172.21.15.82:0/1557919289 wait complete. 2024-03-27T07:25:48.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:48 smithi082 ceph-mon[32178]: pgmap v69: 97 pgs: 97 active+clean; 74 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 222 op/s 2024-03-27T07:25:48.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:48 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2535144331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:25:49.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:48 smithi149 ceph-mon[36065]: pgmap v69: 97 pgs: 97 active+clean; 74 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 222 op/s 2024-03-27T07:25:49.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:48 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2535144331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:25:49.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:48 smithi153 ceph-mon[36179]: pgmap v69: 97 pgs: 97 active+clean; 74 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 222 op/s 2024-03-27T07:25:49.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:48 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2535144331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:25:49.937 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T07:25:49.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:25:49.938 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T07:25:50.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.056+0000 7f03a56c9640 1 -- 172.21.15.82:0/1159621996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03a01009c0 msgr2=0x7f03a0100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.056+0000 7f03a56c9640 1 --2- 172.21.15.82:0/1159621996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03a01009c0 0x7f03a0100e40 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0394009930 tx=0x7f039402bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.056+0000 7f03a56c9640 1 -- 172.21.15.82:0/1159621996 shutdown_connections 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.056+0000 7f03a56c9640 1 --2- 172.21.15.82:0/1159621996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03a01009c0 0x7f03a0100e40 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.056+0000 7f03a56c9640 1 --2- 172.21.15.82:0/1159621996 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a0101380 0x7f03a010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.056+0000 7f03a56c9640 1 --2- 172.21.15.82:0/1159621996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03a01069d0 0x7f03a0106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.056+0000 7f03a56c9640 1 -- 172.21.15.82:0/1159621996 >> 172.21.15.82:0/1159621996 conn(0x7f03a0077b50 msgr2=0x7f03a0077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.056+0000 7f03a56c9640 1 -- 172.21.15.82:0/1159621996 shutdown_connections 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.056+0000 7f03a56c9640 1 -- 172.21.15.82:0/1159621996 wait complete. 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f03a56c9640 1 Processor -- start 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f03a56c9640 1 -- start start 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f03a56c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03a01009c0 0x7f03a0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f03a56c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03a0101380 0x7f03a0199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f03a56c9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a01069d0 0x7f03a01a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f03a56c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03a0110de0 con 0x7f03a0101380 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f03a56c9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03a0110c60 con 0x7f03a01069d0 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f03a56c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f03a0110f60 con 0x7f03a01009c0 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f039e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03a0101380 0x7f03a0199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f039e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03a0101380 0x7f03a0199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34884/0 (socket says 172.21.15.82:34884) 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f039e7fc640 1 -- 172.21.15.82:0/839378212 learned_addr learned my addr 172.21.15.82:0/839378212 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f039effd640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03a01009c0 0x7f03a0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f039f7fe640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a01069d0 0x7f03a01a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f039e7fc640 1 -- 172.21.15.82:0/839378212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03a01009c0 msgr2=0x7f03a0199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f039e7fc640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03a01009c0 0x7f03a0199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f039e7fc640 1 -- 172.21.15.82:0/839378212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a01069d0 msgr2=0x7f03a01a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f039e7fc640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a01069d0 0x7f03a01a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.057+0000 7f039e7fc640 1 -- 172.21.15.82:0/839378212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a01a47c0 con 0x7f03a0101380 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.058+0000 7f039e7fc640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03a0101380 0x7f03a0199740 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0394009230 tx=0x7f039402cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.058+0000 7f0387fff640 1 -- 172.21.15.82:0/839378212 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394041070 con 0x7f03a0101380 2024-03-27T07:25:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.058+0000 7f03a56c9640 1 -- 172.21.15.82:0/839378212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a01a4990 con 0x7f03a0101380 2024-03-27T07:25:50.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.058+0000 7f0387fff640 1 -- 172.21.15.82:0/839378212 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0394004450 con 0x7f03a0101380 2024-03-27T07:25:50.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.058+0000 7f0387fff640 1 -- 172.21.15.82:0/839378212 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0394034440 con 0x7f03a0101380 2024-03-27T07:25:50.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.058+0000 7f03a56c9640 1 -- 172.21.15.82:0/839378212 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a01a4e50 con 0x7f03a0101380 2024-03-27T07:25:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.060+0000 7f0387fff640 1 -- 172.21.15.82:0/839378212 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f0394044070 con 0x7f03a0101380 2024-03-27T07:25:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.060+0000 7f03a8392740 1 Processor -- start 2024-03-27T07:25:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f03a8392740 1 -- start start 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f0387fff640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f03880a3780 0x7f03880a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f03a8392740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 0x55cefb4c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f03a8392740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c4770 0x55cefb4cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f03a8392740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 0x55cefb4cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f03a8392740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cefb3cec20 con 0x55cefb4cd350 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f03a8392740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55cefb427430 con 0x55cefb4c4770 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f03a8392740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cefb3cf900 con 0x55cefb4c3e50 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039f7fe640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f03880a3780 0x7f03880a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 0x55cefb4c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039e7fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c4770 0x55cefb4cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 0x55cefb4cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 0x55cefb4c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42312/0 (socket says 172.21.15.82:42312) 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039effd640 1 -- 172.21.15.82:0/2873205199 learned_addr learned my addr 172.21.15.82:0/2873205199 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f0387fff640 1 -- 172.21.15.82:0/839378212 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f03940f1940 con 0x7f03a0101380 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039effd640 1 -- 172.21.15.82:0/2873205199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c4770 msgr2=0x55cefb4cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039effd640 1 --2- 172.21.15.82:0/2873205199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c4770 0x55cefb4cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039effd640 1 -- 172.21.15.82:0/2873205199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 msgr2=0x55cefb4cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039effd640 1 --2- 172.21.15.82:0/2873205199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 0x55cefb4cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039effd640 1 -- 172.21.15.82:0/2873205199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cefb422180 con 0x55cefb4c3e50 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039e7fc640 1 --2- 172.21.15.82:0/2873205199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c4770 0x55cefb4cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039f7fe640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f03880a3780 0x7f03880a5c40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0398005fd0 tx=0x7f0398009df0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.061+0000 7f039effd640 1 --2- 172.21.15.82:0/2873205199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 0x55cefb4c4230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0390009ca0 tx=0x7f03900107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62647ca05cd3936b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.062+0000 7f03857fa640 1 -- 172.21.15.82:0/2873205199 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039001e070 con 0x55cefb4c3e50 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.062+0000 7f03857fa640 1 -- 172.21.15.82:0/2873205199 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0390009e50 con 0x55cefb4c3e50 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.062+0000 7f03857fa640 1 -- 172.21.15.82:0/2873205199 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03900119c0 con 0x55cefb4c3e50 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 -- 172.21.15.82:0/2873205199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 msgr2=0x55cefb4c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 --2- 172.21.15.82:0/2873205199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 0x55cefb4c4230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0390009ca0 tx=0x7f03900107a0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 -- 172.21.15.82:0/2873205199 shutdown_connections 2024-03-27T07:25:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 --2- 172.21.15.82:0/2873205199 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 0x55cefb4cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 --2- 172.21.15.82:0/2873205199 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c4770 0x55cefb4cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 --2- 172.21.15.82:0/2873205199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 0x55cefb4c4230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 -- 172.21.15.82:0/2873205199 >> 172.21.15.82:0/2873205199 conn(0x55cefb4be580 msgr2=0x55cefb4be960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 -- 172.21.15.82:0/2873205199 shutdown_connections 2024-03-27T07:25:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 -- 172.21.15.82:0/2873205199 wait complete. 2024-03-27T07:25:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 -- start start 2024-03-27T07:25:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.063+0000 7f03a8392740 1 Processor -- start 2024-03-27T07:25:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f03a8392740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c3e50 0x55cefb4ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f03a8392740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 0x55cefb4ca070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f03a8392740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 0x55cefb4ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f03a8392740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cefb3e2cc0 con 0x55cefb4cd350 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f03a8392740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55cefb4233e0 con 0x55cefb4c3e50 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f03a8392740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55cefb4d0140 con 0x55cefb4c4770 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f03a8392740 10 client.0 _ll_register_callbacks cb 0x55cefb41df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 0x55cefb4ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c3e50 0x55cefb4ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 0x55cefb4ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34904/0 (socket says 172.21.15.82:34904) 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c3e50 0x55cefb4ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:47036/0 (socket says 172.21.15.82:47036) 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039f7fe640 1 -- 172.21.15.82:0/2447502964 learned_addr learned my addr 172.21.15.82:0/2447502964 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039e7fc640 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 0x55cefb4ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039e7fc640 1 -- 172.21.15.82:0/2447502964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c3e50 msgr2=0x55cefb4ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039e7fc640 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c3e50 0x55cefb4ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039e7fc640 1 -- 172.21.15.82:0/2447502964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 msgr2=0x55cefb4ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039e7fc640 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 0x55cefb4ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039e7fc640 1 -- 172.21.15.82:0/2447502964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cefb3e9ef0 con 0x55cefb4c4770 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039f7fe640 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 0x55cefb4ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039effd640 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c3e50 0x55cefb4ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f039e7fc640 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 0x55cefb4ca070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03940ef1f0 tx=0x7f0394009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=991059241c59da9a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.064+0000 7f0382ff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f0382ff5640 1 -- 172.21.15.82:0/2447502964 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039404b040 con 0x55cefb4c4770 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f03a8392740 1 -- 172.21.15.82:0/2447502964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0390009e50 con 0x55cefb4c4770 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f0382ff5640 1 -- 172.21.15.82:0/2447502964 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f03940035f0 con 0x55cefb4c4770 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f0382ff5640 1 -- 172.21.15.82:0/2447502964 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f03940bd640 con 0x55cefb4c4770 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f03a8392740 10 client.25921 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f03a8392740 1 -- 172.21.15.82:0/2447502964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55cefb2037e0 con 0x55cefb4c4770 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f0382ff5640 1 -- 172.21.15.82:0/2447502964 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0390009e50 con 0x55cefb4c4770 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f0382ff5640 1 -- 172.21.15.82:0/2447502964 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f03940c6410 con 0x55cefb4c4770 2024-03-27T07:25:50.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f03a8392740 10 client.25921 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f03a8392740 10 client.25921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f03a8392740 20 client.25921 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f03a8392740 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cefb4dd190 0x55cefb4df5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f03a8392740 4 client.25921 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.065+0000 7f03a8392740 1 -- 172.21.15.82:0/2447502964 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cefb434970 con 0x55cefb4dd190 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.066+0000 7f039effd640 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cefb4dd190 0x55cefb4df5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.066+0000 7f0382ff5640 10 client.25921 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.066+0000 7f039effd640 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cefb4dd190 0x55cefb4df5c0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37fe0018a9798ef6 server_cookie=379c4d3b0eb44065 in_seq=0 out_seq=0 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f0382ff5640 1 -- 172.21.15.82:0/2447502964 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55cefb434970 con 0x55cefb4dd190 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f0382ff5640 10 client.25921 handle_command_reply: tid=0 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 client.25921 shutdown 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 -- 172.21.15.82:0/2447502964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 msgr2=0x55cefb4ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 0x55cefb4ca070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f03940ef1f0 tx=0x7f0394009620 comp rx=0 tx=0).stop 2024-03-27T07:25:50.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 -- 172.21.15.82:0/2447502964 shutdown_connections 2024-03-27T07:25:50.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cefb4dd190 0x55cefb4df5c0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4cd350 0x55cefb4ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 0x55cefb4ca070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 --2- 172.21.15.82:0/2447502964 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4c3e50 0x55cefb4ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f0382ff5640 0 client.25921 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:50.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 -- 172.21.15.82:0/2447502964 >> 172.21.15.82:0/2447502964 conn(0x55cefb4be580 msgr2=0x55cefb4c02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 -- 172.21.15.82:0/2447502964 shutdown_connections 2024-03-27T07:25:50.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 1 -- 172.21.15.82:0/2447502964 wait complete. 2024-03-27T07:25:50.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.067+0000 7f03a8392740 20 client.25921 trim_cache size 0 max 16384 2024-03-27T07:25:50.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.086+0000 7f03a8392740 1 Processor -- start 2024-03-27T07:25:50.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.086+0000 7f03a8392740 1 -- start start 2024-03-27T07:25:50.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.086+0000 7f03a8392740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 0x55cefb4e4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.086+0000 7f03a8392740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c4770 0x55cefb4c0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.086+0000 7f03a8392740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4cd350 0x55cefb4d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.086+0000 7f03a8392740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01adcd0 con 0x55cefb4c4770 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.086+0000 7f03a8392740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01ab540 con 0x55cefb4cd350 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.086+0000 7f03a8392740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01a93b0 con 0x55cefb4c3e50 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.086+0000 7f039e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c4770 0x55cefb4c0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f039e7fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c4770 0x55cefb4c0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34918/0 (socket says 172.21.15.82:34918) 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f039effd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 0x55cefb4e4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f039e7fc640 1 -- 172.21.15.82:0/280172717 learned_addr learned my addr 172.21.15.82:0/280172717 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f039f7fe640 1 --2- 172.21.15.82:0/280172717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4cd350 0x55cefb4d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f039e7fc640 1 -- 172.21.15.82:0/280172717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 msgr2=0x55cefb4e4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f039e7fc640 1 --2- 172.21.15.82:0/280172717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 0x55cefb4e4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f039e7fc640 1 -- 172.21.15.82:0/280172717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4cd350 msgr2=0x55cefb4d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f039e7fc640 1 --2- 172.21.15.82:0/280172717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4cd350 0x55cefb4d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f039e7fc640 1 -- 172.21.15.82:0/280172717 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cefb4ca960 con 0x55cefb4c4770 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f039e7fc640 1 --2- 172.21.15.82:0/280172717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c4770 0x55cefb4c0060 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0394009900 tx=0x7f039402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9257d1d73dfb241 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f0384ff9640 1 -- 172.21.15.82:0/280172717 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03940a19c0 con 0x55cefb4c4770 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f0384ff9640 1 -- 172.21.15.82:0/280172717 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0394004c80 con 0x55cefb4c4770 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.087+0000 7f0384ff9640 1 -- 172.21.15.82:0/280172717 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03940bdab0 con 0x55cefb4c4770 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 -- 172.21.15.82:0/280172717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c4770 msgr2=0x55cefb4c0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 --2- 172.21.15.82:0/280172717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c4770 0x55cefb4c0060 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0394009900 tx=0x7f039402bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 -- 172.21.15.82:0/280172717 shutdown_connections 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 --2- 172.21.15.82:0/280172717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c4770 0x55cefb4c0060 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 --2- 172.21.15.82:0/280172717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4cd350 0x55cefb4d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 --2- 172.21.15.82:0/280172717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c3e50 0x55cefb4e4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 -- 172.21.15.82:0/280172717 >> 172.21.15.82:0/280172717 conn(0x55cefb4be580 msgr2=0x55cefb4bf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 -- 172.21.15.82:0/280172717 shutdown_connections 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 -- 172.21.15.82:0/280172717 wait complete. 2024-03-27T07:25:50.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 -- start start 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.088+0000 7f03a8392740 1 Processor -- start 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f03a8392740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c3e50 0x55cefb4d1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f03a8392740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 0x55cefb4d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f03a8392740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4cd350 0x55cefb5424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f03a8392740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01a9a00 con 0x55cefb4c3e50 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f03a8392740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01aae70 con 0x55cefb4cd350 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f03a8392740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f03a01aa0d0 con 0x55cefb4c4770 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f03a8392740 10 client.0 _ll_register_callbacks cb 0x7f039402cd90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c3e50 0x55cefb4d1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039effd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c3e50 0x55cefb4d1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34930/0 (socket says 172.21.15.82:34930) 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039effd640 1 -- 172.21.15.82:0/737526513 learned_addr learned my addr 172.21.15.82:0/737526513 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039e7fc640 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 0x55cefb4d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039f7fe640 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4cd350 0x55cefb5424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039effd640 1 -- 172.21.15.82:0/737526513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 msgr2=0x55cefb4d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039effd640 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 0x55cefb4d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039effd640 1 -- 172.21.15.82:0/737526513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4cd350 msgr2=0x55cefb5424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039effd640 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4cd350 0x55cefb5424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039effd640 1 -- 172.21.15.82:0/737526513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cefb263f70 con 0x55cefb4c3e50 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f039effd640 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c3e50 0x55cefb4d1360 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0390011550 tx=0x7f0390011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0949ddb77c06acd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f0382ff5640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f0382ff5640 1 -- 172.21.15.82:0/737526513 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039001e040 con 0x55cefb4c3e50 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f0382ff5640 1 -- 172.21.15.82:0/737526513 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f0390009d90 con 0x55cefb4c3e50 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.089+0000 7f03a8392740 1 -- 172.21.15.82:0/737526513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0394004c80 con 0x55cefb4c3e50 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f0382ff5640 1 -- 172.21.15.82:0/737526513 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0390037050 con 0x55cefb4c3e50 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f03a8392740 10 client.16104 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f03a8392740 1 -- 172.21.15.82:0/737526513 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55cefb0fb170 con 0x55cefb4c3e50 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f0382ff5640 1 -- 172.21.15.82:0/737526513 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0394004c80 con 0x55cefb4c3e50 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f0382ff5640 1 -- 172.21.15.82:0/737526513 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0390011a60 con 0x55cefb4c3e50 2024-03-27T07:25:50.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f03a8392740 10 client.16104 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f03a8392740 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f03a8392740 20 client.16104 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f03a8392740 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cefb543e90 0x55cefb5462b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f03a8392740 4 client.16104 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f03a8392740 1 -- 172.21.15.82:0/737526513 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cefb42ecc0 con 0x55cefb543e90 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.090+0000 7f039e7fc640 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cefb543e90 0x55cefb5462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.091+0000 7f0382ff5640 10 client.16104 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.091+0000 7f039e7fc640 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cefb543e90 0x55cefb5462b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b633f837430ceea1 server_cookie=874ace536336b4f5 in_seq=0 out_seq=0 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.091+0000 7f0382ff5640 1 -- 172.21.15.82:0/737526513 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cefb42ecc0 con 0x55cefb543e90 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.091+0000 7f0382ff5640 10 client.16104 handle_command_reply: tid=0 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.091+0000 7f03a8392740 1 client.16104 shutdown 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.091+0000 7f03a8392740 1 -- 172.21.15.82:0/737526513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c3e50 msgr2=0x55cefb4d1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a8392740 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c3e50 0x55cefb4d1360 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0390011550 tx=0x7f0390011580 comp rx=0 tx=0).stop 2024-03-27T07:25:50.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a8392740 1 -- 172.21.15.82:0/737526513 shutdown_connections 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a8392740 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55cefb4cd350 0x55cefb5424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a8392740 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55cefb4c4770 0x55cefb4d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a8392740 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55cefb543e90 0x55cefb5462b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a8392740 1 --2- 172.21.15.82:0/737526513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cefb4c3e50 0x55cefb4d1360 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a8392740 1 -- 172.21.15.82:0/737526513 >> 172.21.15.82:0/737526513 conn(0x55cefb4be580 msgr2=0x55cefb4c01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f0382ff5640 0 client.16104 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a8392740 1 -- 172.21.15.82:0/737526513 shutdown_connections 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a8392740 1 -- 172.21.15.82:0/737526513 wait complete. 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a8392740 20 client.16104 trim_cache size 0 max 16384 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:25:50.100 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-03-27T07:25:50.101 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "ecdb60e2-27f2-41d0-bdfd-27f3c18aff96", 2024-03-27T07:25:50.101 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-03-27T07:25:50.101 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:25:50.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 -- 172.21.15.82:0/839378212 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f03880a3780 msgr2=0x7f03880a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f03880a3780 0x7f03880a5c40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0398005fd0 tx=0x7f0398009df0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 -- 172.21.15.82:0/839378212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03a0101380 msgr2=0x7f03a0199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03a0101380 0x7f03a0199740 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0394009230 tx=0x7f039402cba0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 -- 172.21.15.82:0/839378212 shutdown_connections 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f03880a3780 0x7f03880a5c40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03a0101380 0x7f03a0199740 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f03a01069d0 0x7f03a01a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 --2- 172.21.15.82:0/839378212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03a01009c0 0x7f03a0199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 -- 172.21.15.82:0/839378212 >> 172.21.15.82:0/839378212 conn(0x7f03a0077b50 msgr2=0x7f03a0103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 -- 172.21.15.82:0/839378212 shutdown_connections 2024-03-27T07:25:50.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.092+0000 7f03a56c9640 1 -- 172.21.15.82:0/839378212 wait complete. 2024-03-27T07:25:50.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:25:50.106 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:25:50.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 -- 172.21.15.82:0/2638155198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3874069130 msgr2=0x7f3874069510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 --2- 172.21.15.82:0/2638155198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3874069130 0x7f3874069510 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3864009900 tx=0x7f386402bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:50.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 -- 172.21.15.82:0/2638155198 shutdown_connections 2024-03-27T07:25:50.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 --2- 172.21.15.82:0/2638155198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3874107090 0x7f387410e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 --2- 172.21.15.82:0/2638155198 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f38741066d0 0x7f3874106b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 --2- 172.21.15.82:0/2638155198 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3874069130 0x7f3874069510 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 -- 172.21.15.82:0/2638155198 >> 172.21.15.82:0/2638155198 conn(0x7f3874077b50 msgr2=0x7f3874077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 -- 172.21.15.82:0/2638155198 shutdown_connections 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 -- 172.21.15.82:0/2638155198 wait complete. 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 Processor -- start 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.214+0000 7f387a24e640 1 -- start start 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f387a24e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3874069130 0x7f3874198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f387a24e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38741066d0 0x7f3874198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f387a24e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874107090 0x7f387419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f387a24e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3874111ed0 con 0x7f38741066d0 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f387a24e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3874111d50 con 0x7f3874107090 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f387a24e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3874112050 con 0x7f3874069130 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3872ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38741066d0 0x7f3874198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3872ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38741066d0 0x7f3874198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34952/0 (socket says 172.21.15.82:34952) 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3872ffd640 1 -- 172.21.15.82:0/1877074736 learned_addr learned my addr 172.21.15.82:0/1877074736 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3873fff640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874107090 0x7f387419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f38737fe640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3874069130 0x7f3874198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3872ffd640 1 -- 172.21.15.82:0/1877074736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3874069130 msgr2=0x7f3874198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3872ffd640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3874069130 0x7f3874198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3872ffd640 1 -- 172.21.15.82:0/1877074736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874107090 msgr2=0x7f387419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3872ffd640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874107090 0x7f387419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3872ffd640 1 -- 172.21.15.82:0/1877074736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387419d3d0 con 0x7f38741066d0 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3872ffd640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38741066d0 0x7f3874198970 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f386800d950 tx=0x7f386800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3870ff9640 1 -- 172.21.15.82:0/1877074736 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868017030 con 0x7f38741066d0 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3870ff9640 1 -- 172.21.15.82:0/1877074736 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3868004020 con 0x7f38741066d0 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f387a24e640 1 -- 172.21.15.82:0/1877074736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387419d6c0 con 0x7f38741066d0 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.215+0000 7f3870ff9640 1 -- 172.21.15.82:0/1877074736 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38680047a0 con 0x7f38741066d0 2024-03-27T07:25:50.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.216+0000 7f387a24e640 1 -- 172.21.15.82:0/1877074736 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38741a4f50 con 0x7f38741066d0 2024-03-27T07:25:50.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f3870ff9640 1 -- 172.21.15.82:0/1877074736 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f38680041d0 con 0x7f38741066d0 2024-03-27T07:25:50.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f387ce34740 1 Processor -- start 2024-03-27T07:25:50.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f387ce34740 1 -- start start 2024-03-27T07:25:50.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f387ce34740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x558403994360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f387ce34740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 0x5584039a1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f387ce34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x5584039a3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f3870ff9640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f385c0a3780 0x7f385c0a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f387ce34740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5584038f8860 con 0x558403993f80 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f387ce34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5584038a08d0 con 0x5584039a1b60 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f387ce34740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5584038f4810 con 0x5584039948a0 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f3873fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x558403994360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f38737fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 0x5584039a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f3873fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x558403994360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34954/0 (socket says 172.21.15.82:34954) 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f3873fff640 1 -- 172.21.15.82:0/2308311476 learned_addr learned my addr 172.21.15.82:0/2308311476 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f38737fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 0x5584039a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42376/0 (socket says 172.21.15.82:42376) 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f3870ff9640 1 -- 172.21.15.82:0/1877074736 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f38680cfa00 con 0x7f38741066d0 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f3872ffd640 1 --2- 172.21.15.82:0/2308311476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x5584039a3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.218+0000 7f3873fff640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f385c0a3780 0x7f385c0a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f38737fe640 1 -- 172.21.15.82:0/2308311476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 msgr2=0x5584039a3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f38737fe640 1 --2- 172.21.15.82:0/2308311476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x5584039a3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f38737fe640 1 -- 172.21.15.82:0/2308311476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 msgr2=0x558403994360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f38737fe640 1 --2- 172.21.15.82:0/2308311476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x558403994360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f38737fe640 1 -- 172.21.15.82:0/2308311476 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584038ab120 con 0x5584039948a0 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f3873fff640 1 --2- 172.21.15.82:0/2308311476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x558403994360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f38737fe640 1 --2- 172.21.15.82:0/2308311476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 0x5584039a1620 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3864000c00 tx=0x7f3864009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76bf040512477a7e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f3873fff640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f385c0a3780 0x7f385c0a5c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f386c0099e0 tx=0x7f386c009500 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f3859ffb640 1 -- 172.21.15.82:0/2308311476 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864042070 con 0x5584039948a0 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f3859ffb640 1 -- 172.21.15.82:0/2308311476 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f386402ca80 con 0x5584039948a0 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.219+0000 7f3859ffb640 1 -- 172.21.15.82:0/2308311476 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864004f00 con 0x5584039948a0 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.220+0000 7f387ce34740 1 -- 172.21.15.82:0/2308311476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 msgr2=0x5584039a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.220+0000 7f387ce34740 1 --2- 172.21.15.82:0/2308311476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 0x5584039a1620 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3864000c00 tx=0x7f3864009610 comp rx=0 tx=0).stop 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.220+0000 7f387ce34740 1 -- 172.21.15.82:0/2308311476 shutdown_connections 2024-03-27T07:25:50.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.220+0000 7f387ce34740 1 --2- 172.21.15.82:0/2308311476 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x5584039a3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.220+0000 7f387ce34740 1 --2- 172.21.15.82:0/2308311476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 0x5584039a1620 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.220+0000 7f387ce34740 1 --2- 172.21.15.82:0/2308311476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x558403994360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.220+0000 7f387ce34740 1 -- 172.21.15.82:0/2308311476 >> 172.21.15.82:0/2308311476 conn(0x55840398e980 msgr2=0x55840398ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.220+0000 7f387ce34740 1 -- 172.21.15.82:0/2308311476 shutdown_connections 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.220+0000 7f387ce34740 1 -- 172.21.15.82:0/2308311476 wait complete. 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.220+0000 7f387ce34740 1 -- start start 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f387ce34740 1 Processor -- start 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f387ce34740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558403993f80 0x55840399eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f387ce34740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039948a0 0x55840399f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f387ce34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x55840399f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f387ce34740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5584039a48c0 con 0x5584039948a0 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f387ce34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5584038b3cd0 con 0x5584039a1b60 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f387ce34740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5584039a4a40 con 0x558403993f80 2024-03-27T07:25:50.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f387ce34740 10 client.0 _ll_register_callbacks cb 0x5584038a5ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f3872ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039948a0 0x55840399f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f38737fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558403993f80 0x55840399eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f3872ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039948a0 0x55840399f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34966/0 (socket says 172.21.15.82:34966) 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f3872ffd640 1 -- 172.21.15.82:0/2085202766 learned_addr learned my addr 172.21.15.82:0/2085202766 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f3873fff640 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x55840399f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f3872ffd640 1 -- 172.21.15.82:0/2085202766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558403993f80 msgr2=0x55840399eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f3872ffd640 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558403993f80 0x55840399eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f3872ffd640 1 -- 172.21.15.82:0/2085202766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 msgr2=0x55840399f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f3872ffd640 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x55840399f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.221+0000 7f3872ffd640 1 -- 172.21.15.82:0/2085202766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584036d67d0 con 0x5584039948a0 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f3872ffd640 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039948a0 0x55840399f0b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3868098040 tx=0x7f3868097930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e54fc14619114d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f3852ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f3852ffd640 1 -- 172.21.15.82:0/2085202766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386809b540 con 0x5584039948a0 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f3852ffd640 1 -- 172.21.15.82:0/2085202766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f3868021ca0 con 0x5584039948a0 2024-03-27T07:25:50.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f387ce34740 1 -- 172.21.15.82:0/2085202766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f386402ca80 con 0x5584039948a0 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f3852ffd640 1 -- 172.21.15.82:0/2085202766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f386809c2e0 con 0x5584039948a0 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f387ce34740 10 client.16116 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f387ce34740 1 -- 172.21.15.82:0/2085202766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55840360c3f0 con 0x5584039948a0 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f3852ffd640 1 -- 172.21.15.82:0/2085202766 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f386402ca80 con 0x5584039948a0 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f3852ffd640 1 -- 172.21.15.82:0/2085202766 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f38680babb0 con 0x5584039948a0 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f387ce34740 10 client.16116 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f387ce34740 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f387ce34740 20 client.16116 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f387ce34740 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5584039b2230 0x5584039b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f387ce34740 4 client.16116 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f387ce34740 1 -- 172.21.15.82:0/2085202766 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558403905da0 con 0x5584039b2230 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.222+0000 7f38737fe640 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5584039b2230 0x5584039b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.223+0000 7f38737fe640 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5584039b2230 0x5584039b4620 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8fc94a139156cb8 server_cookie=77769a223929f842 in_seq=0 out_seq=0 2024-03-27T07:25:50.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.223+0000 7f3852ffd640 10 client.16116 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:50.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.226+0000 7f3852ffd640 1 -- 172.21.15.82:0/2085202766 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x558403905da0 con 0x5584039b2230 2024-03-27T07:25:50.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.226+0000 7f3852ffd640 10 client.16116 handle_command_reply: tid=0 2024-03-27T07:25:50.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 client.16116 shutdown 2024-03-27T07:25:50.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 -- 172.21.15.82:0/2085202766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039948a0 msgr2=0x55840399f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039948a0 0x55840399f0b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3868098040 tx=0x7f3868097930 comp rx=0 tx=0).stop 2024-03-27T07:25:50.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 -- 172.21.15.82:0/2085202766 shutdown_connections 2024-03-27T07:25:50.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5584039b2230 0x5584039b4620 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039948a0 0x55840399f0b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f3852ffd640 0 client.16116 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:50.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x55840399f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 --2- 172.21.15.82:0/2085202766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558403993f80 0x55840399eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 -- 172.21.15.82:0/2085202766 >> 172.21.15.82:0/2085202766 conn(0x55840398e980 msgr2=0x5584039906d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 -- 172.21.15.82:0/2085202766 shutdown_connections 2024-03-27T07:25:50.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 1 -- 172.21.15.82:0/2085202766 wait complete. 2024-03-27T07:25:50.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.227+0000 7f387ce34740 20 client.16116 trim_cache size 0 max 16384 2024-03-27T07:25:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.245+0000 7f387ce34740 1 Processor -- start 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.245+0000 7f387ce34740 1 -- start start 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f387ce34740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x5584039a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f387ce34740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 0x5584039ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f387ce34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x5584039b9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f387ce34740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38741ade80 con 0x558403993f80 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f387ce34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38741ab6f0 con 0x5584039a1b60 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f387ce34740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38741a9560 con 0x5584039948a0 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x5584039a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38737fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x5584039a12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34978/0 (socket says 172.21.15.82:34978) 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38737fe640 1 -- 172.21.15.82:0/1098061326 learned_addr learned my addr 172.21.15.82:0/1098061326 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f3873fff640 1 --2- 172.21.15.82:0/1098061326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x5584039b9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f3872ffd640 1 --2- 172.21.15.82:0/1098061326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 0x5584039ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38737fe640 1 -- 172.21.15.82:0/1098061326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 msgr2=0x5584039ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38737fe640 1 --2- 172.21.15.82:0/1098061326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 0x5584039ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38737fe640 1 -- 172.21.15.82:0/1098061326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 msgr2=0x5584039b9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38737fe640 1 --2- 172.21.15.82:0/1098061326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x5584039b9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38737fe640 1 -- 172.21.15.82:0/1098061326 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584035cc0f0 con 0x558403993f80 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38737fe640 1 --2- 172.21.15.82:0/1098061326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x5584039a12a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3864005ec0 tx=0x7f3864009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283f97e42d1c407d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38597fa640 1 -- 172.21.15.82:0/1098061326 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864054070 con 0x558403993f80 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38597fa640 1 -- 172.21.15.82:0/1098061326 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3864004a50 con 0x558403993f80 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.246+0000 7f38597fa640 1 -- 172.21.15.82:0/1098061326 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864042040 con 0x558403993f80 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.247+0000 7f387ce34740 1 -- 172.21.15.82:0/1098061326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 msgr2=0x5584039a12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.247+0000 7f387ce34740 1 --2- 172.21.15.82:0/1098061326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x5584039a12a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3864005ec0 tx=0x7f3864009680 comp rx=0 tx=0).stop 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.247+0000 7f387ce34740 1 -- 172.21.15.82:0/1098061326 shutdown_connections 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.247+0000 7f387ce34740 1 --2- 172.21.15.82:0/1098061326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039a1b60 0x5584039b9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.247+0000 7f387ce34740 1 --2- 172.21.15.82:0/1098061326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5584039948a0 0x5584039ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.247+0000 7f387ce34740 1 --2- 172.21.15.82:0/1098061326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558403993f80 0x5584039a12a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.247+0000 7f387ce34740 1 -- 172.21.15.82:0/1098061326 >> 172.21.15.82:0/1098061326 conn(0x55840398e980 msgr2=0x55840398d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.247+0000 7f387ce34740 1 -- 172.21.15.82:0/1098061326 shutdown_connections 2024-03-27T07:25:50.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.247+0000 7f387ce34740 1 -- 172.21.15.82:0/1098061326 wait complete. 2024-03-27T07:25:50.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.247+0000 7f387ce34740 1 -- start start 2024-03-27T07:25:50.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f387ce34740 1 Processor -- start 2024-03-27T07:25:50.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f387ce34740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558403993f80 0x5584039a9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f387ce34740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039948a0 0x55840399b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f387ce34740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039a1b60 0x55840399b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f387ce34740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f38741a9bb0 con 0x5584039a1b60 2024-03-27T07:25:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f387ce34740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f38741ab020 con 0x5584039948a0 2024-03-27T07:25:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f387ce34740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f38741aa280 con 0x558403993f80 2024-03-27T07:25:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f387ce34740 10 client.0 _ll_register_callbacks cb 0x7f3868097f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f3873fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039a1b60 0x55840399b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f3873fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039a1b60 0x55840399b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34992/0 (socket says 172.21.15.82:34992) 2024-03-27T07:25:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f3873fff640 1 -- 172.21.15.82:0/1477588127 learned_addr learned my addr 172.21.15.82:0/1477588127 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f38737fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558403993f80 0x5584039a9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f3872ffd640 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039948a0 0x55840399b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f3873fff640 1 -- 172.21.15.82:0/1477588127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558403993f80 msgr2=0x5584039a9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f3873fff640 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558403993f80 0x5584039a9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f3873fff640 1 -- 172.21.15.82:0/1477588127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039948a0 msgr2=0x55840399b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f3873fff640 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039948a0 0x55840399b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.248+0000 7f3873fff640 1 -- 172.21.15.82:0/1477588127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840399c210 con 0x5584039a1b60 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.249+0000 7f3873fff640 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039a1b60 0x55840399b9e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f386c011a50 tx=0x7f386c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5862d00c1d08af6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.249+0000 7f3852ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.249+0000 7f3852ffd640 1 -- 172.21.15.82:0/1477588127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0047e0 con 0x5584039a1b60 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.249+0000 7f387ce34740 1 -- 172.21.15.82:0/1477588127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3864004a50 con 0x5584039a1b60 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.249+0000 7f3852ffd640 1 -- 172.21.15.82:0/1477588127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f386c004b20 con 0x5584039a1b60 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.249+0000 7f3852ffd640 1 -- 172.21.15.82:0/1477588127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f386c004d20 con 0x5584039a1b60 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.249+0000 7f387ce34740 10 client.16122 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.249+0000 7f387ce34740 1 -- 172.21.15.82:0/1477588127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558403a182e0 con 0x5584039a1b60 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.249+0000 7f3852ffd640 1 -- 172.21.15.82:0/1477588127 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3864004a50 con 0x5584039a1b60 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.250+0000 7f3852ffd640 1 -- 172.21.15.82:0/1477588127 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f386c01d040 con 0x5584039a1b60 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.250+0000 7f387ce34740 10 client.16122 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.250+0000 7f387ce34740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.250+0000 7f387ce34740 20 client.16122 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.250+0000 7f387ce34740 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558403a18b20 0x558403a1af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.250+0000 7f387ce34740 4 client.16122 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.250+0000 7f387ce34740 1 -- 172.21.15.82:0/1477588127 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5584039000f0 con 0x558403a18b20 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.250+0000 7f38737fe640 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558403a18b20 0x558403a1af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.250+0000 7f3852ffd640 10 client.16122 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.250+0000 7f38737fe640 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558403a18b20 0x558403a1af40 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd35bde2b1b6dbe4 server_cookie=5dd0e5d90401e28e in_seq=0 out_seq=0 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f3852ffd640 1 -- 172.21.15.82:0/1477588127 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5584039000f0 con 0x558403a18b20 2024-03-27T07:25:50.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f3852ffd640 10 client.16122 handle_command_reply: tid=0 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 client.16122 shutdown 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 -- 172.21.15.82:0/1477588127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039a1b60 msgr2=0x55840399b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039a1b60 0x55840399b9e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f386c011a50 tx=0x7f386c004a40 comp rx=0 tx=0).stop 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 -- 172.21.15.82:0/1477588127 shutdown_connections 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558403a18b20 0x558403a1af40 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5584039a1b60 0x55840399b9e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5584039948a0 0x55840399b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 --2- 172.21.15.82:0/1477588127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558403993f80 0x5584039a9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 -- 172.21.15.82:0/1477588127 >> 172.21.15.82:0/1477588127 conn(0x55840398e980 msgr2=0x55840399f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f3852ffd640 0 client.16122 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 -- 172.21.15.82:0/1477588127 shutdown_connections 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 1 -- 172.21.15.82:0/1477588127 wait complete. 2024-03-27T07:25:50.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.251+0000 7f387ce34740 20 client.16122 trim_cache size 0 max 16384 2024-03-27T07:25:50.260 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:25:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (314 inodes in the stack)", 2024-03-27T07:25:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-03-27T07:25:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "ecdb60e2-27f2-41d0-bdfd-27f3c18aff96": { 2024-03-27T07:25:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-03-27T07:25:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "ecdb60e2-27f2-41d0-bdfd-27f3c18aff96", 2024-03-27T07:25:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-03-27T07:25:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:25:50.260 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:25:50.260 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:25:50.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 -- 172.21.15.82:0/1877074736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f385c0a3780 msgr2=0x7f385c0a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f385c0a3780 0x7f385c0a5c40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f386c0099e0 tx=0x7f386c009500 comp rx=0 tx=0).stop 2024-03-27T07:25:50.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 -- 172.21.15.82:0/1877074736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38741066d0 msgr2=0x7f3874198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:50.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38741066d0 0x7f3874198970 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f386800d950 tx=0x7f386800de10 comp rx=0 tx=0).stop 2024-03-27T07:25:50.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 -- 172.21.15.82:0/1877074736 shutdown_connections 2024-03-27T07:25:50.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f385c0a3780 0x7f385c0a5c40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f38741066d0 0x7f3874198970 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3874107090 0x7f387419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 --2- 172.21.15.82:0/1877074736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3874069130 0x7f3874198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:50.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 -- 172.21.15.82:0/1877074736 >> 172.21.15.82:0/1877074736 conn(0x7f3874077b50 msgr2=0x7f38740fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:50.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 -- 172.21.15.82:0/1877074736 shutdown_connections 2024-03-27T07:25:50.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:25:50.252+0000 7f387a24e640 1 -- 172.21.15.82:0/1877074736 wait complete. 2024-03-27T07:25:50.267 INFO:tasks.cephfs.filesystem:scrub status for tag:ecdb60e2-27f2-41d0-bdfd-27f3c18aff96 - {'path': '/', 'tag': 'ecdb60e2-27f2-41d0-bdfd-27f3c18aff96', 'options': 'recursive,force'} 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: pgmap v70: 97 pgs: 97 active+clean; 74 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub queued for path: / 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:51.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:51.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:51.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:50 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: pgmap v70: 97 pgs: 97 active+clean; 74 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub queued for path: / 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:51.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.040 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:51.040 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:50 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: pgmap v70: 97 pgs: 97 active+clean; 74 MiB data, 457 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-03-27T07:25:51.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub queued for path: / 2024-03-27T07:25:51.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:51.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:51.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:50 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:52.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:51 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:52.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:51 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:52.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:51 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:52.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:51 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:52.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:51 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:25:52.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:51 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:52.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:51 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:52.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:51 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:52.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:51 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:52.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:51 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:52.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:51 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:52.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:51 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:25:52.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:51 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:52.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:51 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:51 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:51 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:51 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:51 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:51 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:25:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:51 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:52.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:51 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:25:53.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:52 smithi149 ceph-mon[36065]: pgmap v71: 97 pgs: 97 active+clean; 82 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 258 op/s 2024-03-27T07:25:53.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:52 smithi153 ceph-mon[36179]: pgmap v71: 97 pgs: 97 active+clean; 82 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 258 op/s 2024-03-27T07:25:53.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:52 smithi082 ceph-mon[32178]: pgmap v71: 97 pgs: 97 active+clean; 82 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.3 MiB/s wr, 258 op/s 2024-03-27T07:25:53.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.963+0000 7fd12469d640 1 -- 172.21.15.82:0/481680245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c101af0 msgr2=0x7fd11c101f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.963+0000 7fd12469d640 1 --2- 172.21.15.82:0/481680245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c101af0 0x7fd11c101f70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009930 tx=0x7fd10c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:25:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.964+0000 7fd12469d640 1 -- 172.21.15.82:0/481680245 shutdown_connections 2024-03-27T07:25:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.964+0000 7fd12469d640 1 --2- 172.21.15.82:0/481680245 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd11c1024b0 0x7fd11c10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.964+0000 7fd12469d640 1 --2- 172.21.15.82:0/481680245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c101af0 0x7fd11c101f70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.964+0000 7fd12469d640 1 --2- 172.21.15.82:0/481680245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c107b90 0x7fd11c107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.964+0000 7fd12469d640 1 -- 172.21.15.82:0/481680245 >> 172.21.15.82:0/481680245 conn(0x7fd11c0fd5e0 msgr2=0x7fd11c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.965+0000 7fd12469d640 1 -- 172.21.15.82:0/481680245 shutdown_connections 2024-03-27T07:25:53.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.965+0000 7fd12469d640 1 -- 172.21.15.82:0/481680245 wait complete. 2024-03-27T07:25:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.965+0000 7fd12469d640 1 Processor -- start 2024-03-27T07:25:53.969 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.966+0000 7fd12469d640 1 -- start start 2024-03-27T07:25:53.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.968+0000 7fd12469d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c101af0 0x7fd11c075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.968+0000 7fd12469d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd11c1024b0 0x7fd11c073e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.968+0000 7fd12469d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c107b90 0x7fd11c074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.968+0000 7fd12469d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c111fe0 con 0x7fd11c101af0 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.968+0000 7fd12469d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c111e60 con 0x7fd11c1024b0 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.968+0000 7fd12469d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd11c112160 con 0x7fd11c107b90 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.968+0000 7fd122c3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c107b90 0x7fd11c074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.968+0000 7fd122c3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c107b90 0x7fd11c074490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42420/0 (socket says 172.21.15.82:42420) 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.968+0000 7fd122c3a640 1 -- 172.21.15.82:0/2447558055 learned_addr learned my addr 172.21.15.82:0/2447558055 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.969+0000 7fd122439640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c101af0 0x7fd11c075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.969+0000 7fd122439640 1 -- 172.21.15.82:0/2447558055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c107b90 msgr2=0x7fd11c074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.969+0000 7fd122439640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c107b90 0x7fd11c074490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.969+0000 7fd122439640 1 -- 172.21.15.82:0/2447558055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd11c1024b0 msgr2=0x7fd11c073e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.969+0000 7fd122439640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd11c1024b0 0x7fd11c073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.969+0000 7fd122439640 1 -- 172.21.15.82:0/2447558055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11c1aaea0 con 0x7fd11c101af0 2024-03-27T07:25:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.970+0000 7fd122439640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c101af0 0x7fd11c075a50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd11800b3f0 tx=0x7fd11800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.971+0000 7fd1137fe640 1 -- 172.21.15.82:0/2447558055 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd118015020 con 0x7fd11c101af0 2024-03-27T07:25:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.971+0000 7fd12469d640 1 -- 172.21.15.82:0/2447558055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11c1ab0d0 con 0x7fd11c101af0 2024-03-27T07:25:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.971+0000 7fd12469d640 1 -- 172.21.15.82:0/2447558055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11c1ab620 con 0x7fd11c101af0 2024-03-27T07:25:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.972+0000 7fd1137fe640 1 -- 172.21.15.82:0/2447558055 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd118011d10 con 0x7fd11c101af0 2024-03-27T07:25:53.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.972+0000 7fd1137fe640 1 -- 172.21.15.82:0/2447558055 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11800f2e0 con 0x7fd11c101af0 2024-03-27T07:25:53.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.977+0000 7fd127363740 1 Processor -- start 2024-03-27T07:25:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.977+0000 7fd1137fe640 1 -- 172.21.15.82:0/2447558055 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fd118018020 con 0x7fd11c101af0 2024-03-27T07:25:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.978+0000 7fd1137fe640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1080a3870 0x7fd1080a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.979+0000 7fd1137fe640 1 -- 172.21.15.82:0/2447558055 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fd1180cfd00 con 0x7fd11c101af0 2024-03-27T07:25:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.980+0000 7fd127363740 1 -- start start 2024-03-27T07:25:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.980+0000 7fd122c3a640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1080a3870 0x7fd1080a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:53.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.980+0000 7fd127363740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe25d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.980+0000 7fd127363740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe2662a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.980+0000 7fd127363740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe268bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.980+0000 7fd127363740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623fe223cd0 con 0x5623fe25d0f0 2024-03-27T07:25:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.980+0000 7fd127363740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5623fe168950 con 0x5623fe25da10 2024-03-27T07:25:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.980+0000 7fd127363740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5623fe1c0e50 con 0x5623fe2667e0 2024-03-27T07:25:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd122c3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe268bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:53.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd121c38640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe2662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd122c3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe268bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42436/0 (socket says 172.21.15.82:42436) 2024-03-27T07:25:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd122c3a640 1 -- 172.21.15.82:0/1130641352 learned_addr learned my addr 172.21.15.82:0/1130641352 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd122439640 1 --2- 172.21.15.82:0/1130641352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe25d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd122c3a640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1080a3870 0x7fd1080a5d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1140077c0 tx=0x7fd114007bc0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd122c3a640 1 -- 172.21.15.82:0/1130641352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 msgr2=0x5623fe2662a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd122c3a640 1 --2- 172.21.15.82:0/1130641352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe2662a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd122c3a640 1 -- 172.21.15.82:0/1130641352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 msgr2=0x5623fe25d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd122c3a640 1 --2- 172.21.15.82:0/1130641352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe25d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.981+0000 7fd122c3a640 1 -- 172.21.15.82:0/1130641352 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623fded5210 con 0x5623fe2667e0 2024-03-27T07:25:53.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.982+0000 7fd122c3a640 1 --2- 172.21.15.82:0/1130641352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe268bd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd114009d90 tx=0x7fd11401c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b29174580cb00c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:53.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.983+0000 7fd110ff9640 1 -- 172.21.15.82:0/1130641352 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114028070 con 0x5623fe2667e0 2024-03-27T07:25:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.983+0000 7fd110ff9640 1 -- 172.21.15.82:0/1130641352 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd11401f070 con 0x5623fe2667e0 2024-03-27T07:25:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.983+0000 7fd110ff9640 1 -- 172.21.15.82:0/1130641352 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd114012050 con 0x5623fe2667e0 2024-03-27T07:25:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.984+0000 7fd127363740 1 -- 172.21.15.82:0/1130641352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 msgr2=0x5623fe268bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.984+0000 7fd127363740 1 --2- 172.21.15.82:0/1130641352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe268bd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd114009d90 tx=0x7fd11401c000 comp rx=0 tx=0).stop 2024-03-27T07:25:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.985+0000 7fd127363740 1 -- 172.21.15.82:0/1130641352 shutdown_connections 2024-03-27T07:25:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.985+0000 7fd127363740 1 --2- 172.21.15.82:0/1130641352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe268bd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.985+0000 7fd127363740 1 --2- 172.21.15.82:0/1130641352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe2662a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.985+0000 7fd127363740 1 --2- 172.21.15.82:0/1130641352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe25d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.985+0000 7fd127363740 1 -- 172.21.15.82:0/1130641352 >> 172.21.15.82:0/1130641352 conn(0x5623fe257a10 msgr2=0x5623fe257df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:53.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.986+0000 7fd127363740 1 -- 172.21.15.82:0/1130641352 shutdown_connections 2024-03-27T07:25:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.986+0000 7fd127363740 1 -- 172.21.15.82:0/1130641352 wait complete. 2024-03-27T07:25:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.987+0000 7fd127363740 1 -- start start 2024-03-27T07:25:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.987+0000 7fd127363740 1 Processor -- start 2024-03-27T07:25:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.987+0000 7fd127363740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe2637e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.987+0000 7fd127363740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25da10 0x5623fe263d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.987+0000 7fd127363740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe2667e0 0x5623fe264260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.987+0000 7fd127363740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5623fe1bce00 con 0x5623fe25d0f0 2024-03-27T07:25:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.987+0000 7fd127363740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5623fe169520 con 0x5623fe2667e0 2024-03-27T07:25:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.987+0000 7fd127363740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5623fe17c8e0 con 0x5623fe25da10 2024-03-27T07:25:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.988+0000 7fd127363740 10 client.0 _ll_register_callbacks cb 0x5623fe1b7a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.988+0000 7fd121c38640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25da10 0x5623fe263d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.988+0000 7fd121c38640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25da10 0x5623fe263d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42438/0 (socket says 172.21.15.82:42438) 2024-03-27T07:25:53.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.988+0000 7fd121c38640 1 -- 172.21.15.82:0/3288562071 learned_addr learned my addr 172.21.15.82:0/3288562071 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.989+0000 7fd121c38640 1 -- 172.21.15.82:0/3288562071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe2667e0 msgr2=0x5623fe264260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.989+0000 7fd121c38640 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe2667e0 0x5623fe264260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.989+0000 7fd121c38640 1 -- 172.21.15.82:0/3288562071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 msgr2=0x5623fe2637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.989+0000 7fd121c38640 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe2637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.989+0000 7fd121c38640 1 -- 172.21.15.82:0/3288562071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623fdfa1620 con 0x5623fe25da10 2024-03-27T07:25:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.989+0000 7fd121c38640 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25da10 0x5623fe263d20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009900 tx=0x7fd10c02cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d17746449571ffc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:53.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.989+0000 7fd105ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:25:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.990+0000 7fd105ffb640 1 -- 172.21.15.82:0/3288562071 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c045020 con 0x5623fe25da10 2024-03-27T07:25:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.990+0000 7fd127363740 1 -- 172.21.15.82:0/3288562071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd11401f070 con 0x5623fe25da10 2024-03-27T07:25:53.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.990+0000 7fd105ffb640 1 -- 172.21.15.82:0/3288562071 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fd10c005040 con 0x5623fe25da10 2024-03-27T07:25:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.991+0000 7fd105ffb640 1 -- 172.21.15.82:0/3288562071 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd10c005240 con 0x5623fe25da10 2024-03-27T07:25:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.992+0000 7fd127363740 10 client.25957 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.992+0000 7fd127363740 1 -- 172.21.15.82:0/3288562071 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5623fe286380 con 0x5623fe25da10 2024-03-27T07:25:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.993+0000 7fd105ffb640 1 -- 172.21.15.82:0/3288562071 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd11401f070 con 0x5623fe25da10 2024-03-27T07:25:53.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.993+0000 7fd105ffb640 1 -- 172.21.15.82:0/3288562071 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd10c0035f0 con 0x5623fe25da10 2024-03-27T07:25:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.993+0000 7fd127363740 10 client.25957 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.993+0000 7fd127363740 10 client.25957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.993+0000 7fd127363740 20 client.25957 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.994+0000 7fd127363740 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5623fe287900 0x5623fe289da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.994+0000 7fd127363740 4 client.25957 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:25:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.994+0000 7fd127363740 1 -- 172.21.15.82:0/3288562071 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623fe1ce390 con 0x5623fe287900 2024-03-27T07:25:53.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:53.994+0000 7fd122439640 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5623fe287900 0x5623fe289da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.002+0000 7fd122439640 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5623fe287900 0x5623fe289da0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=384ba0fb793df83e server_cookie=16f2465f9c0b8f4b in_seq=0 out_seq=0 2024-03-27T07:25:54.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.003+0000 7fd105ffb640 10 client.25957 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:54.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.006+0000 7fd105ffb640 1 -- 172.21.15.82:0/3288562071 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5623fe1ce390 con 0x5623fe287900 2024-03-27T07:25:54.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.006+0000 7fd105ffb640 10 client.25957 handle_command_reply: tid=0 2024-03-27T07:25:54.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.007+0000 7fd127363740 1 client.25957 shutdown 2024-03-27T07:25:54.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.007+0000 7fd127363740 1 -- 172.21.15.82:0/3288562071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25da10 msgr2=0x5623fe263d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:54.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.007+0000 7fd127363740 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25da10 0x5623fe263d20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd10c009900 tx=0x7fd10c02cab0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.008+0000 7fd127363740 1 -- 172.21.15.82:0/3288562071 shutdown_connections 2024-03-27T07:25:54.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.008+0000 7fd127363740 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe2667e0 0x5623fe264260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.008+0000 7fd127363740 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25da10 0x5623fe263d20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.008+0000 7fd127363740 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5623fe287900 0x5623fe289da0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.008+0000 7fd127363740 1 --2- 172.21.15.82:0/3288562071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe2637e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.008+0000 7fd127363740 1 -- 172.21.15.82:0/3288562071 >> 172.21.15.82:0/3288562071 conn(0x5623fe257a10 msgr2=0x5623fe259760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:54.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.008+0000 7fd105ffb640 0 client.25957 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:54.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.009+0000 7fd127363740 1 -- 172.21.15.82:0/3288562071 shutdown_connections 2024-03-27T07:25:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.009+0000 7fd127363740 1 -- 172.21.15.82:0/3288562071 wait complete. 2024-03-27T07:25:54.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.009+0000 7fd127363740 20 client.25957 trim_cache size 0 max 16384 2024-03-27T07:25:54.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.043+0000 7fd127363740 1 Processor -- start 2024-03-27T07:25:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.044+0000 7fd127363740 1 -- start start 2024-03-27T07:25:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.044+0000 7fd127363740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe265f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.044+0000 7fd127363740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe271e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.044+0000 7fd127363740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe259570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.044+0000 7fd127363740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd100011030 con 0x5623fe25d0f0 2024-03-27T07:25:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.044+0000 7fd127363740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd10000e8a0 con 0x5623fe25da10 2024-03-27T07:25:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.044+0000 7fd127363740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd10000c6f0 con 0x5623fe2667e0 2024-03-27T07:25:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.045+0000 7fd122c3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe259570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.045+0000 7fd122c3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe259570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42446/0 (socket says 172.21.15.82:42446) 2024-03-27T07:25:54.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.045+0000 7fd122c3a640 1 -- 172.21.15.82:0/320097194 learned_addr learned my addr 172.21.15.82:0/320097194 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.045+0000 7fd122439640 1 --2- 172.21.15.82:0/320097194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe265f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.045+0000 7fd122439640 1 -- 172.21.15.82:0/320097194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 msgr2=0x5623fe259570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.045+0000 7fd122439640 1 --2- 172.21.15.82:0/320097194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe259570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.045+0000 7fd122439640 1 -- 172.21.15.82:0/320097194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 msgr2=0x5623fe271e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:25:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.045+0000 7fd122439640 1 --2- 172.21.15.82:0/320097194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe271e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.045+0000 7fd122439640 1 -- 172.21.15.82:0/320097194 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623fe258bd0 con 0x5623fe25d0f0 2024-03-27T07:25:54.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.046+0000 7fd122439640 1 --2- 172.21.15.82:0/320097194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe265f10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd1180cd5b0 tx=0x7fd1180bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26b5938c1b35dce server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.046+0000 7fd107fff640 1 -- 172.21.15.82:0/320097194 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1180b4070 con 0x5623fe25d0f0 2024-03-27T07:25:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.046+0000 7fd107fff640 1 -- 172.21.15.82:0/320097194 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd11809a2f0 con 0x5623fe25d0f0 2024-03-27T07:25:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.046+0000 7fd107fff640 1 -- 172.21.15.82:0/320097194 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd118096b60 con 0x5623fe25d0f0 2024-03-27T07:25:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.048+0000 7fd127363740 1 -- 172.21.15.82:0/320097194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 msgr2=0x5623fe265f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.048+0000 7fd127363740 1 --2- 172.21.15.82:0/320097194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe265f10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd1180cd5b0 tx=0x7fd1180bc040 comp rx=0 tx=0).stop 2024-03-27T07:25:54.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.048+0000 7fd127363740 1 -- 172.21.15.82:0/320097194 shutdown_connections 2024-03-27T07:25:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.048+0000 7fd127363740 1 --2- 172.21.15.82:0/320097194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe2667e0 0x5623fe259570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.048+0000 7fd127363740 1 --2- 172.21.15.82:0/320097194 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe271e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.048+0000 7fd127363740 1 --2- 172.21.15.82:0/320097194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe25d0f0 0x5623fe265f10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.048+0000 7fd127363740 1 -- 172.21.15.82:0/320097194 >> 172.21.15.82:0/320097194 conn(0x5623fe257a10 msgr2=0x5623fe258e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:54.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.048+0000 7fd127363740 1 -- 172.21.15.82:0/320097194 shutdown_connections 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.048+0000 7fd127363740 1 -- 172.21.15.82:0/320097194 wait complete. 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.048+0000 7fd127363740 1 -- start start 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd127363740 1 Processor -- start 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd127363740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25d0f0 0x5623fe260520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd127363740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe260a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd127363740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe2667e0 0x5623fe260fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd127363740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd10000cd60 con 0x5623fe2667e0 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd127363740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd10000e1d0 con 0x5623fe25da10 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd127363740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd10000d430 con 0x5623fe25d0f0 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd127363740 10 client.0 _ll_register_callbacks cb 0x7fd10c0044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd121c38640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe260a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd121c38640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe260a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:47138/0 (socket says 172.21.15.82:47138) 2024-03-27T07:25:54.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.049+0000 7fd121c38640 1 -- 172.21.15.82:0/3496252514 learned_addr learned my addr 172.21.15.82:0/3496252514 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:25:54.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.050+0000 7fd122439640 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25d0f0 0x5623fe260520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.050+0000 7fd121c38640 1 -- 172.21.15.82:0/3496252514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25d0f0 msgr2=0x5623fe260520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.050+0000 7fd121c38640 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25d0f0 0x5623fe260520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.050+0000 7fd121c38640 1 -- 172.21.15.82:0/3496252514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe2667e0 msgr2=0x5623fe260fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:25:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.050+0000 7fd121c38640 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe2667e0 0x5623fe260fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.050+0000 7fd121c38640 1 -- 172.21.15.82:0/3496252514 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623fe2fde10 con 0x5623fe25da10 2024-03-27T07:25:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.050+0000 7fd121c38640 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe260a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd10c003bd0 tx=0x7fd10c003e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa26b35e9cfd4931 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:25:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.051+0000 7fd105ffb640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:25:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.051+0000 7fd105ffb640 1 -- 172.21.15.82:0/3496252514 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd10c000e60 con 0x5623fe25da10 2024-03-27T07:25:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.051+0000 7fd105ffb640 1 -- 172.21.15.82:0/3496252514 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fd10c0046c0 con 0x5623fe25da10 2024-03-27T07:25:54.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.051+0000 7fd127363740 1 -- 172.21.15.82:0/3496252514 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd11809a2f0 con 0x5623fe25da10 2024-03-27T07:25:54.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.052+0000 7fd105ffb640 1 -- 172.21.15.82:0/3496252514 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd10c045070 con 0x5623fe25da10 2024-03-27T07:25:54.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.053+0000 7fd127363740 10 client.25952 fetch_fsmap learned FSMap version 26 2024-03-27T07:25:54.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.053+0000 7fd127363740 1 -- 172.21.15.82:0/3496252514 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5623fe2ff100 con 0x5623fe25da10 2024-03-27T07:25:54.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.053+0000 7fd105ffb640 1 -- 172.21.15.82:0/3496252514 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd11809a2f0 con 0x5623fe25da10 2024-03-27T07:25:54.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.053+0000 7fd105ffb640 1 -- 172.21.15.82:0/3496252514 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd10c0345e0 con 0x5623fe25da10 2024-03-27T07:25:54.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.054+0000 7fd127363740 10 client.25952 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:25:54.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.054+0000 7fd127363740 10 client.25952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:25:54.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.054+0000 7fd127363740 20 client.25952 populate_metadata read hostname 'smithi082' 2024-03-27T07:25:54.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.054+0000 7fd127363740 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5623fe2ff8e0 0x5623fe301d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:25:54.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.054+0000 7fd127363740 4 client.25952 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:25:54.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.054+0000 7fd127363740 1 -- 172.21.15.82:0/3496252514 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623fe1c86e0 con 0x5623fe2ff8e0 2024-03-27T07:25:54.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.059+0000 7fd122439640 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5623fe2ff8e0 0x5623fe301d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:25:54.073 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.071+0000 7fd105ffb640 10 client.25952 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:54.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:54.071+0000 7fd122439640 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5623fe2ff8e0 0x5623fe301d00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=544765a665a8f2ad server_cookie=5a9cc9826c716ac4 in_seq=0 out_seq=0 2024-03-27T07:25:55.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:54 smithi149 ceph-mon[36065]: pgmap v72: 97 pgs: 97 active+clean; 82 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-03-27T07:25:55.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:54 smithi153 ceph-mon[36179]: pgmap v72: 97 pgs: 97 active+clean; 82 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-03-27T07:25:55.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:54 smithi082 ceph-mon[32178]: pgmap v72: 97 pgs: 97 active+clean; 82 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-03-27T07:25:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd105ffb640 1 -- 172.21.15.82:0/3496252514 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623fe1c86e0 con 0x5623fe2ff8e0 2024-03-27T07:25:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd105ffb640 10 client.25952 handle_command_reply: tid=0 2024-03-27T07:25:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 client.25952 shutdown 2024-03-27T07:25:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 -- 172.21.15.82:0/3496252514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 msgr2=0x5623fe260a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe260a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd10c003bd0 tx=0x7fd10c003e80 comp rx=0 tx=0).stop 2024-03-27T07:25:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 -- 172.21.15.82:0/3496252514 shutdown_connections 2024-03-27T07:25:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5623fe2ff8e0 0x5623fe301d00 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5623fe2667e0 0x5623fe260fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd105ffb640 0 client.25952 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:25:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5623fe25da10 0x5623fe260a60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 --2- 172.21.15.82:0/3496252514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5623fe25d0f0 0x5623fe260520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 -- 172.21.15.82:0/3496252514 >> 172.21.15.82:0/3496252514 conn(0x5623fe257a10 msgr2=0x5623fe264010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 -- 172.21.15.82:0/3496252514 shutdown_connections 2024-03-27T07:25:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 1 -- 172.21.15.82:0/3496252514 wait complete. 2024-03-27T07:25:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.504+0000 7fd127363740 20 client.25952 trim_cache size 0 max 16384 2024-03-27T07:25:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:25:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:25:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:25:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:25:55.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 -- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1080a3870 msgr2=0x7fd1080a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1080a3870 0x7fd1080a5d30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1140077c0 tx=0x7fd114007bc0 comp rx=0 tx=0).stop 2024-03-27T07:25:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 -- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c101af0 msgr2=0x7fd11c075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:25:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c101af0 0x7fd11c075a50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd11800b3f0 tx=0x7fd11800b8b0 comp rx=0 tx=0).stop 2024-03-27T07:25:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 -- 172.21.15.82:0/2447558055 shutdown_connections 2024-03-27T07:25:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1080a3870 0x7fd1080a5d30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd11c107b90 0x7fd11c074490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd11c1024b0 0x7fd11c073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 --2- 172.21.15.82:0/2447558055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd11c101af0 0x7fd11c075a50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:25:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 -- 172.21.15.82:0/2447558055 >> 172.21.15.82:0/2447558055 conn(0x7fd11c0fd5e0 msgr2=0x7fd11c0fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:25:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 -- 172.21.15.82:0/2447558055 shutdown_connections 2024-03-27T07:25:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:25:55.505+0000 7fd12469d640 1 -- 172.21.15.82:0/2447558055 wait complete. 2024-03-27T07:25:57.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:56 smithi149 ceph-mon[36065]: pgmap v73: 97 pgs: 97 active+clean; 82 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-03-27T07:25:57.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:56 smithi153 ceph-mon[36179]: pgmap v73: 97 pgs: 97 active+clean; 82 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-03-27T07:25:57.156 INFO:tasks.workunit.client.0.smithi082.stdout: 51 288995 563 228182 626 107029 676 2024-03-27T07:25:57.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:56 smithi082 ceph-mon[32178]: pgmap v73: 97 pgs: 97 active+clean; 82 MiB data, 465 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-03-27T07:25:59.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:58 smithi149 ceph-mon[36065]: pgmap v74: 97 pgs: 97 active+clean; 207 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 928 op/s 2024-03-27T07:25:59.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:58 smithi153 ceph-mon[36179]: pgmap v74: 97 pgs: 97 active+clean; 207 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 928 op/s 2024-03-27T07:25:59.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:58 smithi082 ceph-mon[32178]: pgmap v74: 97 pgs: 97 active+clean; 207 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 928 op/s 2024-03-27T07:26:00.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:25:59 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:25:59 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:00.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:25:59 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:01.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:00 smithi153 ceph-mon[36179]: pgmap v75: 97 pgs: 97 active+clean; 207 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 881 op/s 2024-03-27T07:26:01.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:00 smithi082 ceph-mon[32178]: pgmap v75: 97 pgs: 97 active+clean; 207 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 881 op/s 2024-03-27T07:26:01.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:00 smithi149 ceph-mon[36065]: pgmap v75: 97 pgs: 97 active+clean; 207 MiB data, 632 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 881 op/s 2024-03-27T07:26:03.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:02 smithi153 ceph-mon[36179]: pgmap v76: 97 pgs: 97 active+clean; 212 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 983 op/s 2024-03-27T07:26:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:02 smithi082 ceph-mon[32178]: pgmap v76: 97 pgs: 97 active+clean; 212 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 983 op/s 2024-03-27T07:26:03.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:02 smithi149 ceph-mon[36065]: pgmap v76: 97 pgs: 97 active+clean; 212 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 983 op/s 2024-03-27T07:26:04.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:03 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:26:04.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:03 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:26:04.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:03 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:26:05.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:04 smithi153 ceph-mon[36179]: pgmap v77: 97 pgs: 97 active+clean; 212 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 878 op/s 2024-03-27T07:26:05.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:04 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:26:05.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:04 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:26:05.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:04 smithi082 ceph-mon[32178]: pgmap v77: 97 pgs: 97 active+clean; 212 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 878 op/s 2024-03-27T07:26:05.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:04 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:26:05.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:04 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:26:05.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:04 smithi149 ceph-mon[36065]: pgmap v77: 97 pgs: 97 active+clean; 212 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 878 op/s 2024-03-27T07:26:05.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:04 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:26:05.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:04 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:26:07.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:06 smithi153 ceph-mon[36179]: pgmap v78: 97 pgs: 97 active+clean; 212 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 878 op/s 2024-03-27T07:26:07.156 INFO:tasks.workunit.client.0.smithi082.stdout: 56 161192 350 115516 237 64900 845 2024-03-27T07:26:07.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:06 smithi082 ceph-mon[32178]: pgmap v78: 97 pgs: 97 active+clean; 212 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 878 op/s 2024-03-27T07:26:07.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:06 smithi149 ceph-mon[36065]: pgmap v78: 97 pgs: 97 active+clean; 212 MiB data, 637 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 12 MiB/s wr, 878 op/s 2024-03-27T07:26:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 -- 172.21.15.82:0/781562857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6974100cd0 msgr2=0x7f6974106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 --2- 172.21.15.82:0/781562857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6974100cd0 0x7f6974106800 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f6960009930 tx=0x7f696002bc80 comp rx=0 tx=0).stop 2024-03-27T07:26:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 -- 172.21.15.82:0/781562857 shutdown_connections 2024-03-27T07:26:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 --2- 172.21.15.82:0/781562857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6974100cd0 0x7f6974106800 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 --2- 172.21.15.82:0/781562857 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6974106f30 0x7f697410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 --2- 172.21.15.82:0/781562857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6974100320 0x7f6974100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 -- 172.21.15.82:0/781562857 >> 172.21.15.82:0/781562857 conn(0x7f6974077010 msgr2=0x7f69740fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 -- 172.21.15.82:0/781562857 shutdown_connections 2024-03-27T07:26:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 -- 172.21.15.82:0/781562857 wait complete. 2024-03-27T07:26:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 Processor -- start 2024-03-27T07:26:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.595+0000 7f697ac29640 1 -- start start 2024-03-27T07:26:08.600 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f697ac29640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6974100320 0x7f6974198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f697ac29640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6974106f30 0x7f6974198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f697ac29640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697419ccc0 0x7f697419d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f697ac29640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6974111f40 con 0x7f6974106f30 2024-03-27T07:26:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f697ac29640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6974111dc0 con 0x7f6974100320 2024-03-27T07:26:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f697ac29640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69741120c0 con 0x7f697419ccc0 2024-03-27T07:26:08.601 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6973fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6974106f30 0x7f6974198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6973fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6974106f30 0x7f6974198940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46700/0 (socket says 172.21.15.82:46700) 2024-03-27T07:26:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6973fff640 1 -- 172.21.15.82:0/1339064211 learned_addr learned my addr 172.21.15.82:0/1339064211 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f69789c5640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6974100320 0x7f6974198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f69791c6640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697419ccc0 0x7f697419d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6973fff640 1 -- 172.21.15.82:0/1339064211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697419ccc0 msgr2=0x7f697419d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6973fff640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697419ccc0 0x7f697419d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6973fff640 1 -- 172.21.15.82:0/1339064211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6974100320 msgr2=0x7f6974198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6973fff640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6974100320 0x7f6974198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6973fff640 1 -- 172.21.15.82:0/1339064211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f697419d7b0 con 0x7f6974106f30 2024-03-27T07:26:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6973fff640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6974106f30 0x7f6974198940 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6960000c00 tx=0x7f696002cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6971ffb640 1 -- 172.21.15.82:0/1339064211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960041070 con 0x7f6974106f30 2024-03-27T07:26:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6971ffb640 1 -- 172.21.15.82:0/1339064211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6960004450 con 0x7f6974106f30 2024-03-27T07:26:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f6971ffb640 1 -- 172.21.15.82:0/1339064211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6960034440 con 0x7f6974106f30 2024-03-27T07:26:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.596+0000 7f697ac29640 1 -- 172.21.15.82:0/1339064211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f697419da40 con 0x7f6974106f30 2024-03-27T07:26:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.597+0000 7f697ac29640 1 -- 172.21.15.82:0/1339064211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69741a51b0 con 0x7f6974106f30 2024-03-27T07:26:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f6971ffb640 1 -- 172.21.15.82:0/1339064211 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f6960044070 con 0x7f6974106f30 2024-03-27T07:26:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f697d80b740 1 Processor -- start 2024-03-27T07:26:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f697d80b740 1 -- start start 2024-03-27T07:26:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f6971ffb640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f69640a3820 0x7f69640a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f697d80b740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc70f0 0x5582c9cc74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f697d80b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9cd02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f697d80b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cd2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f6971ffb640 1 -- 172.21.15.82:0/1339064211 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f69600f1a50 con 0x7f6974106f30 2024-03-27T07:26:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f697d80b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5582c9c8dcd0 con 0x5582c9cc7a10 2024-03-27T07:26:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f697d80b740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5582c9bd2950 con 0x5582c9cc70f0 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f697d80b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5582c9c2ae50 con 0x5582c9cd07e0 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.599+0000 7f69791c6640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f69640a3820 0x7f69640a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f6973fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9cd02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f6973fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9cd02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46714/0 (socket says 172.21.15.82:46714) 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f69789c5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc70f0 0x5582c9cc74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f6973fff640 1 -- 172.21.15.82:0/1718173630 learned_addr learned my addr 172.21.15.82:0/1718173630 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f6973fff640 1 -- 172.21.15.82:0/1718173630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 msgr2=0x5582c9cd2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f6973fff640 1 --2- 172.21.15.82:0/1718173630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cd2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f6973fff640 1 -- 172.21.15.82:0/1718173630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc70f0 msgr2=0x5582c9cc74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f6973fff640 1 --2- 172.21.15.82:0/1718173630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc70f0 0x5582c9cc74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f6973fff640 1 -- 172.21.15.82:0/1718173630 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582c993f210 con 0x5582c9cc7a10 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f69791c6640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f69640a3820 0x7f69640a5ce0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f696c005fd0 tx=0x7f696c010740 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f6973fff640 1 --2- 172.21.15.82:0/1718173630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9cd02a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f69600ba250 tx=0x7f69600bdc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d441f02818f74dc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f695effd640 1 -- 172.21.15.82:0/1718173630 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696004b070 con 0x5582c9cc7a10 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f695effd640 1 -- 172.21.15.82:0/1718173630 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69600c20f0 con 0x5582c9cc7a10 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.600+0000 7f695effd640 1 -- 172.21.15.82:0/1718173630 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69600ef470 con 0x5582c9cc7a10 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 -- 172.21.15.82:0/1718173630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 msgr2=0x5582c9cd02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 --2- 172.21.15.82:0/1718173630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9cd02a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f69600ba250 tx=0x7f69600bdc80 comp rx=0 tx=0).stop 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 -- 172.21.15.82:0/1718173630 shutdown_connections 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 --2- 172.21.15.82:0/1718173630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9cd02a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 --2- 172.21.15.82:0/1718173630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cd2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 --2- 172.21.15.82:0/1718173630 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc70f0 0x5582c9cc74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 -- 172.21.15.82:0/1718173630 >> 172.21.15.82:0/1718173630 conn(0x5582c9cc1a10 msgr2=0x5582c9cc1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 -- 172.21.15.82:0/1718173630 shutdown_connections 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 -- 172.21.15.82:0/1718173630 wait complete. 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 -- start start 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.601+0000 7f697d80b740 1 Processor -- start 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f697d80b740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc70f0 0x5582c9ccd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f697d80b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9ccdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f697d80b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f697d80b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5582c9c26e00 con 0x5582c9cc7a10 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f697d80b740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5582c9bd3520 con 0x5582c9cc70f0 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f697d80b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5582c9be68e0 con 0x5582c9cd07e0 2024-03-27T07:26:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f697d80b740 10 client.0 _ll_register_callbacks cb 0x5582c9c21a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6973fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9ccdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6973fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9ccdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46724/0 (socket says 172.21.15.82:46724) 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6973fff640 1 -- 172.21.15.82:0/3184099580 learned_addr learned my addr 172.21.15.82:0/3184099580 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f69791c6640 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f69789c5640 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc70f0 0x5582c9ccd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6973fff640 1 -- 172.21.15.82:0/3184099580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 msgr2=0x5582c9cce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6973fff640 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6973fff640 1 -- 172.21.15.82:0/3184099580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc70f0 msgr2=0x5582c9ccd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6973fff640 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc70f0 0x5582c9ccd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6973fff640 1 -- 172.21.15.82:0/3184099580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582c9a0b620 con 0x5582c9cc7a10 2024-03-27T07:26:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6973fff640 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9ccdcf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f69600ef7f0 tx=0x7f696002bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcf3a6e48cf2853 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6953fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6953fff640 1 -- 172.21.15.82:0/3184099580 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696004b030 con 0x5582c9cc7a10 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6953fff640 1 -- 172.21.15.82:0/3184099580 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f69600ba460 con 0x5582c9cc7a10 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f697d80b740 1 -- 172.21.15.82:0/3184099580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69600c20f0 con 0x5582c9cc7a10 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f6953fff640 1 -- 172.21.15.82:0/3184099580 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f69600c69b0 con 0x5582c9cc7a10 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.602+0000 7f697d80b740 10 client.16143 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f697d80b740 1 -- 172.21.15.82:0/3184099580 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5582c9ce3410 con 0x5582c9cc7a10 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f6953fff640 1 -- 172.21.15.82:0/3184099580 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f69600c20f0 con 0x5582c9cc7a10 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f6953fff640 1 -- 172.21.15.82:0/3184099580 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f69600bd240 con 0x5582c9cc7a10 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f697d80b740 10 client.16143 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f697d80b740 10 client.16143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:08.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f697d80b740 20 client.16143 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:08.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f697d80b740 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5582c9ce4760 0x5582c9ce6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f697d80b740 4 client.16143 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:08.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f697d80b740 1 -- 172.21.15.82:0/3184099580 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582c9c38390 con 0x5582c9ce4760 2024-03-27T07:26:08.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f69789c5640 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5582c9ce4760 0x5582c9ce6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f6953fff640 10 client.16143 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:08.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.603+0000 7f69789c5640 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5582c9ce4760 0x5582c9ce6b50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40efc013749887b2 server_cookie=a87af4f39ee622e5 in_seq=0 out_seq=0 2024-03-27T07:26:08.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f6953fff640 1 -- 172.21.15.82:0/3184099580 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5582c9c38390 con 0x5582c9ce4760 2024-03-27T07:26:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f6953fff640 10 client.16143 handle_command_reply: tid=0 2024-03-27T07:26:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 client.16143 shutdown 2024-03-27T07:26:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 -- 172.21.15.82:0/3184099580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 msgr2=0x5582c9ccdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9ccdcf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f69600ef7f0 tx=0x7f696002bc80 comp rx=0 tx=0).stop 2024-03-27T07:26:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 -- 172.21.15.82:0/3184099580 shutdown_connections 2024-03-27T07:26:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5582c9ce4760 0x5582c9ce6b50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc7a10 0x5582c9ccdcf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f6953fff640 0 client.16143 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 --2- 172.21.15.82:0/3184099580 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc70f0 0x5582c9ccd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 -- 172.21.15.82:0/3184099580 >> 172.21.15.82:0/3184099580 conn(0x5582c9cc1a10 msgr2=0x5582c9cc3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 -- 172.21.15.82:0/3184099580 shutdown_connections 2024-03-27T07:26:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 1 -- 172.21.15.82:0/3184099580 wait complete. 2024-03-27T07:26:08.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.604+0000 7f697d80b740 20 client.16143 trim_cache size 0 max 16384 2024-03-27T07:26:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f697d80b740 1 Processor -- start 2024-03-27T07:26:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f697d80b740 1 -- start start 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f697d80b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc70f0 0x5582c9ccfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f697d80b740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 0x5582c9cdfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f697d80b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cc3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f697d80b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69741ade20 con 0x5582c9cc70f0 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f697d80b740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f69741ab690 con 0x5582c9cc7a10 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f697d80b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69741a9520 con 0x5582c9cd07e0 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f69789c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc70f0 0x5582c9ccfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f69789c5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc70f0 0x5582c9ccfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46734/0 (socket says 172.21.15.82:46734) 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f69789c5640 1 -- 172.21.15.82:0/3759770043 learned_addr learned my addr 172.21.15.82:0/3759770043 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f69791c6640 1 --2- 172.21.15.82:0/3759770043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cc3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.619+0000 7f6973fff640 1 --2- 172.21.15.82:0/3759770043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 0x5582c9cdfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f69789c5640 1 -- 172.21.15.82:0/3759770043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 msgr2=0x5582c9cc3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:08.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f69789c5640 1 --2- 172.21.15.82:0/3759770043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cc3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f69789c5640 1 -- 172.21.15.82:0/3759770043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 msgr2=0x5582c9cdfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f69789c5640 1 --2- 172.21.15.82:0/3759770043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 0x5582c9cdfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f69789c5640 1 -- 172.21.15.82:0/3759770043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582c9ce71d0 con 0x5582c9cc70f0 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f6973fff640 1 --2- 172.21.15.82:0/3759770043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 0x5582c9cdfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f69789c5640 1 --2- 172.21.15.82:0/3759770043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc70f0 0x5582c9ccfee0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f696800b890 tx=0x7f696800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f95dea392421286 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f695e7fc640 1 -- 172.21.15.82:0/3759770043 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968026070 con 0x5582c9cc70f0 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f695e7fc640 1 -- 172.21.15.82:0/3759770043 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6968020690 con 0x5582c9cc70f0 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f695e7fc640 1 -- 172.21.15.82:0/3759770043 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6968011b50 con 0x5582c9cc70f0 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f697d80b740 1 -- 172.21.15.82:0/3759770043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc70f0 msgr2=0x5582c9ccfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f697d80b740 1 --2- 172.21.15.82:0/3759770043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc70f0 0x5582c9ccfee0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f696800b890 tx=0x7f696800b390 comp rx=0 tx=0).stop 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f697d80b740 1 -- 172.21.15.82:0/3759770043 shutdown_connections 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f697d80b740 1 --2- 172.21.15.82:0/3759770043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cd07e0 0x5582c9cc3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f697d80b740 1 --2- 172.21.15.82:0/3759770043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 0x5582c9cdfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f697d80b740 1 --2- 172.21.15.82:0/3759770043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cc70f0 0x5582c9ccfee0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f697d80b740 1 -- 172.21.15.82:0/3759770043 >> 172.21.15.82:0/3759770043 conn(0x5582c9cc1a10 msgr2=0x5582c9cc2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.620+0000 7f697d80b740 1 -- 172.21.15.82:0/3759770043 shutdown_connections 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f697d80b740 1 -- 172.21.15.82:0/3759770043 wait complete. 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f697d80b740 1 -- start start 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f697d80b740 1 Processor -- start 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f697d80b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cc70f0 0x5582c9cd7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f697d80b740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 0x5582c9cd8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f697d80b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cd07e0 0x5582c9cd88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f697d80b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f69741a9b70 con 0x5582c9cd07e0 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f697d80b740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f69741aafc0 con 0x5582c9cc7a10 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f697d80b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f69741aa220 con 0x5582c9cc70f0 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f697d80b740 10 client.0 _ll_register_callbacks cb 0x7f696800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:08.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f69791c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cd07e0 0x5582c9cd88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f69789c5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cc70f0 0x5582c9cd7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f69791c6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cd07e0 0x5582c9cd88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:46736/0 (socket says 172.21.15.82:46736) 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f69789c5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cc70f0 0x5582c9cd7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:49480/0 (socket says 172.21.15.82:49480) 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f69791c6640 1 -- 172.21.15.82:0/304458251 learned_addr learned my addr 172.21.15.82:0/304458251 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.621+0000 7f6973fff640 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 0x5582c9cd8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f69791c6640 1 -- 172.21.15.82:0/304458251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cc70f0 msgr2=0x5582c9cd7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f69791c6640 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cc70f0 0x5582c9cd7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f69791c6640 1 -- 172.21.15.82:0/304458251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 msgr2=0x5582c9cd8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f69791c6640 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 0x5582c9cd8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f69791c6640 1 -- 172.21.15.82:0/304458251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582c9d49a90 con 0x5582c9cd07e0 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f69791c6640 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cd07e0 0x5582c9cd88c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f696c012dc0 tx=0x7f696c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dd318bd04db914 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f6953fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f6953fff640 1 -- 172.21.15.82:0/304458251 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f696c011e30 con 0x5582c9cd07e0 2024-03-27T07:26:08.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f6953fff640 1 -- 172.21.15.82:0/304458251 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f696c003970 con 0x5582c9cd07e0 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f697d80b740 1 -- 172.21.15.82:0/304458251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6968020690 con 0x5582c9cd07e0 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f6953fff640 1 -- 172.21.15.82:0/304458251 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f696c003b70 con 0x5582c9cd07e0 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f697d80b740 10 client.16149 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f697d80b740 1 -- 172.21.15.82:0/304458251 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5582c9d4ad10 con 0x5582c9cd07e0 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f6953fff640 1 -- 172.21.15.82:0/304458251 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6968020690 con 0x5582c9cd07e0 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f6953fff640 1 -- 172.21.15.82:0/304458251 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f696c00f040 con 0x5582c9cd07e0 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f697d80b740 10 client.16149 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f697d80b740 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f697d80b740 20 client.16149 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f697d80b740 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5582c9d4b4d0 0x5582c9d4d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f697d80b740 4 client.16149 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.622+0000 7f697d80b740 1 -- 172.21.15.82:0/304458251 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5582c9c326e0 con 0x5582c9d4b4d0 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.623+0000 7f69789c5640 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5582c9d4b4d0 0x5582c9d4d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:08.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.623+0000 7f6953fff640 10 client.16149 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:08.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:08.623+0000 7f69789c5640 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5582c9d4b4d0 0x5582c9d4d8f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=168658e0c2512ccc server_cookie=190a6ad291acf3af in_seq=0 out_seq=0 2024-03-27T07:26:09.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:08 smithi153 ceph-mon[36179]: pgmap v79: 97 pgs: 97 active+clean; 215 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 927 op/s 2024-03-27T07:26:09.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:08 smithi082 ceph-mon[32178]: pgmap v79: 97 pgs: 97 active+clean; 215 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 927 op/s 2024-03-27T07:26:09.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:08 smithi149 ceph-mon[36065]: pgmap v79: 97 pgs: 97 active+clean; 215 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 12 MiB/s wr, 927 op/s 2024-03-27T07:26:10.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:09 smithi153 ceph-mon[36179]: pgmap v80: 97 pgs: 97 active+clean; 215 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-03-27T07:26:10.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:09 smithi082 ceph-mon[32178]: pgmap v80: 97 pgs: 97 active+clean; 215 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-03-27T07:26:10.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:09 smithi149 ceph-mon[36065]: pgmap v80: 97 pgs: 97 active+clean; 215 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 151 op/s 2024-03-27T07:26:12.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:12 smithi082 ceph-mon[32178]: pgmap v81: 97 pgs: 97 active+clean; 225 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 376 op/s 2024-03-27T07:26:12.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:12 smithi149 ceph-mon[36065]: pgmap v81: 97 pgs: 97 active+clean; 225 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 376 op/s 2024-03-27T07:26:12.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:12 smithi153 ceph-mon[36179]: pgmap v81: 97 pgs: 97 active+clean; 225 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 376 op/s 2024-03-27T07:26:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.370+0000 7f6953fff640 1 -- 172.21.15.82:0/304458251 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5582c9c326e0 con 0x5582c9d4b4d0 2024-03-27T07:26:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.370+0000 7f6953fff640 10 client.16149 handle_command_reply: tid=0 2024-03-27T07:26:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.370+0000 7f697d80b740 1 client.16149 shutdown 2024-03-27T07:26:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 1 -- 172.21.15.82:0/304458251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cd07e0 msgr2=0x5582c9cd88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cd07e0 0x5582c9cd88c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f696c012dc0 tx=0x7f696c004ab0 comp rx=0 tx=0).stop 2024-03-27T07:26:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 1 -- 172.21.15.82:0/304458251 shutdown_connections 2024-03-27T07:26:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5582c9d4b4d0 0x5582c9d4d8f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5582c9cd07e0 0x5582c9cd88c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f6953fff640 0 client.16149 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:14.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5582c9cc7a10 0x5582c9cd8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 1 --2- 172.21.15.82:0/304458251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5582c9cc70f0 0x5582c9cd7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 1 -- 172.21.15.82:0/304458251 >> 172.21.15.82:0/304458251 conn(0x5582c9cc1a10 msgr2=0x5582c9cc36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 1 -- 172.21.15.82:0/304458251 shutdown_connections 2024-03-27T07:26:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 1 -- 172.21.15.82:0/304458251 wait complete. 2024-03-27T07:26:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697d80b740 20 client.16149 trim_cache size 0 max 16384 2024-03-27T07:26:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:26:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:26:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:26:14.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:26:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697ac29640 1 -- 172.21.15.82:0/1339064211 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f69640a3820 msgr2=0x7f69640a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697ac29640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f69640a3820 0x7f69640a5ce0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f696c005fd0 tx=0x7f696c010740 comp rx=0 tx=0).stop 2024-03-27T07:26:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697ac29640 1 -- 172.21.15.82:0/1339064211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6974106f30 msgr2=0x7f6974198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.371+0000 7f697ac29640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6974106f30 0x7f6974198940 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6960000c00 tx=0x7f696002cbe0 comp rx=0 tx=0).stop 2024-03-27T07:26:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.372+0000 7f697ac29640 1 -- 172.21.15.82:0/1339064211 shutdown_connections 2024-03-27T07:26:14.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.372+0000 7f697ac29640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f69640a3820 0x7f69640a5ce0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.372+0000 7f697ac29640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6974106f30 0x7f6974198940 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.372+0000 7f697ac29640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f697419ccc0 0x7f697419d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.372+0000 7f697ac29640 1 --2- 172.21.15.82:0/1339064211 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6974100320 0x7f6974198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.372+0000 7f697ac29640 1 -- 172.21.15.82:0/1339064211 >> 172.21.15.82:0/1339064211 conn(0x7f6974077010 msgr2=0x7f69740fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.372+0000 7f697ac29640 1 -- 172.21.15.82:0/1339064211 shutdown_connections 2024-03-27T07:26:14.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:14.372+0000 7f697ac29640 1 -- 172.21.15.82:0/1339064211 wait complete. 2024-03-27T07:26:14.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:14 smithi082 ceph-mon[32178]: pgmap v82: 97 pgs: 97 active+clean; 225 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 274 op/s 2024-03-27T07:26:14.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:14 smithi149 ceph-mon[36065]: pgmap v82: 97 pgs: 97 active+clean; 225 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 274 op/s 2024-03-27T07:26:14.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:14 smithi153 ceph-mon[36179]: pgmap v82: 97 pgs: 97 active+clean; 225 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 274 op/s 2024-03-27T07:26:16.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:16 smithi082 ceph-mon[32178]: pgmap v83: 97 pgs: 97 active+clean; 225 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 274 op/s 2024-03-27T07:26:16.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:16 smithi149 ceph-mon[36065]: pgmap v83: 97 pgs: 97 active+clean; 225 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 274 op/s 2024-03-27T07:26:16.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:16 smithi153 ceph-mon[36179]: pgmap v83: 97 pgs: 97 active+clean; 225 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 274 op/s 2024-03-27T07:26:17.157 INFO:tasks.workunit.client.0.smithi082.stdout: 77 236988 984 176764 1296 93174 1085 2024-03-27T07:26:18.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:18 smithi082 ceph-mon[32178]: pgmap v84: 97 pgs: 97 active+clean; 230 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 343 op/s 2024-03-27T07:26:18.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:18 smithi149 ceph-mon[36065]: pgmap v84: 97 pgs: 97 active+clean; 230 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 343 op/s 2024-03-27T07:26:18.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:18 smithi153 ceph-mon[36179]: pgmap v84: 97 pgs: 97 active+clean; 230 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 343 op/s 2024-03-27T07:26:20.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:26:20.268 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:26:20.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.374+0000 7fa262165640 1 -- 172.21.15.82:0/2192820207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa25c102d90 msgr2=0x7fa25c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.374+0000 7fa262165640 1 --2- 172.21.15.82:0/2192820207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa25c102d90 0x7fa25c103170 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa250009900 tx=0x7fa25002bcd0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.374+0000 7fa262165640 1 -- 172.21.15.82:0/2192820207 shutdown_connections 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.374+0000 7fa262165640 1 --2- 172.21.15.82:0/2192820207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c10c160 0x7fa25c10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.374+0000 7fa262165640 1 --2- 172.21.15.82:0/2192820207 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa25c1036b0 0x7fa25c10bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.374+0000 7fa262165640 1 --2- 172.21.15.82:0/2192820207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa25c102d90 0x7fa25c103170 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.374+0000 7fa262165640 1 -- 172.21.15.82:0/2192820207 >> 172.21.15.82:0/2192820207 conn(0x7fa25c076dd0 msgr2=0x7fa25c0771e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.374+0000 7fa262165640 1 -- 172.21.15.82:0/2192820207 shutdown_connections 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.374+0000 7fa262165640 1 -- 172.21.15.82:0/2192820207 wait complete. 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa262165640 1 Processor -- start 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa262165640 1 -- start start 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa262165640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa25c102d90 0x7fa25c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa262165640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c1036b0 0x7fa25c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa262165640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa25c10c160 0x7fa25c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa262165640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c111ef0 con 0x7fa25c102d90 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa262165640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c111d70 con 0x7fa25c10c160 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa262165640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c112070 con 0x7fa25c1036b0 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa25b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa25c102d90 0x7fa25c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa25b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa25c102d90 0x7fa25c1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55918/0 (socket says 172.21.15.82:55918) 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa25b7fe640 1 -- 172.21.15.82:0/1009234070 learned_addr learned my addr 172.21.15.82:0/1009234070 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa25affd640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c1036b0 0x7fa25c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa25bfff640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa25c10c160 0x7fa25c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa25b7fe640 1 -- 172.21.15.82:0/1009234070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c1036b0 msgr2=0x7fa25c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa25b7fe640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c1036b0 0x7fa25c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa25b7fe640 1 -- 172.21.15.82:0/1009234070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa25c10c160 msgr2=0x7fa25c19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa25b7fe640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa25c10c160 0x7fa25c19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.375+0000 7fa25b7fe640 1 -- 172.21.15.82:0/1009234070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25c19d3c0 con 0x7fa25c102d90 2024-03-27T07:26:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.376+0000 7fa25b7fe640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa25c102d90 0x7fa25c1983d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa250005940 tx=0x7fa25002cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.376+0000 7fa258ff9640 1 -- 172.21.15.82:0/1009234070 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250041070 con 0x7fa25c102d90 2024-03-27T07:26:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.376+0000 7fa262165640 1 -- 172.21.15.82:0/1009234070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25c19d650 con 0x7fa25c102d90 2024-03-27T07:26:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.376+0000 7fa258ff9640 1 -- 172.21.15.82:0/1009234070 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa250004450 con 0x7fa25c102d90 2024-03-27T07:26:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.376+0000 7fa258ff9640 1 -- 172.21.15.82:0/1009234070 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250003df0 con 0x7fa25c102d90 2024-03-27T07:26:20.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.376+0000 7fa262165640 1 -- 172.21.15.82:0/1009234070 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa25c1a4f40 con 0x7fa25c102d90 2024-03-27T07:26:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.378+0000 7fa258ff9640 1 -- 172.21.15.82:0/1009234070 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fa250044070 con 0x7fa25c102d90 2024-03-27T07:26:20.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.378+0000 7fa264e2c740 1 Processor -- start 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.378+0000 7fa264e2c740 1 -- start start 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.378+0000 7fa258ff9640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa2440a3780 0x7fa2440a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.378+0000 7fa25bfff640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa2440a3780 0x7fa2440a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa258ff9640 1 -- 172.21.15.82:0/1009234070 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa2500f1aa0 con 0x7fa25c102d90 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8e250 0x56383ee8e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee97210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee97750 0x56383ee99b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa264e2c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56383edf2860 con 0x56383ee8eb70 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa264e2c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56383ed9a8d0 con 0x56383ee8e250 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa264e2c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56383edee810 con 0x56383ee97750 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee97210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee97210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55922/0 (socket says 172.21.15.82:55922) 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25affd640 1 -- 172.21.15.82:0/3888667754 learned_addr learned my addr 172.21.15.82:0/3888667754 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25b7fe640 1 --2- 172.21.15.82:0/3888667754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8e250 0x56383ee8e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25bfff640 1 --2- 172.21.15.82:0/3888667754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee97750 0x56383ee99b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25affd640 1 -- 172.21.15.82:0/3888667754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee97750 msgr2=0x56383ee99b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25affd640 1 --2- 172.21.15.82:0/3888667754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee97750 0x56383ee99b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25affd640 1 -- 172.21.15.82:0/3888667754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8e250 msgr2=0x56383ee8e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25affd640 1 --2- 172.21.15.82:0/3888667754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8e250 0x56383ee8e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25affd640 1 -- 172.21.15.82:0/3888667754 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383eda5120 con 0x56383ee8eb70 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25bfff640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa2440a3780 0x7fa2440a5c40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa25c06b200 tx=0x7fa254010740 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa25affd640 1 --2- 172.21.15.82:0/3888667754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee97210 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009c90 tx=0x7fa24c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a04caa5591696dd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa241ffb640 1 -- 172.21.15.82:0/3888667754 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c01e070 con 0x56383ee8eb70 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa241ffb640 1 -- 172.21.15.82:0/3888667754 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa24c019b10 con 0x56383ee8eb70 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.379+0000 7fa241ffb640 1 -- 172.21.15.82:0/3888667754 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00eae0 con 0x56383ee8eb70 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.380+0000 7fa264e2c740 1 -- 172.21.15.82:0/3888667754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 msgr2=0x56383ee97210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.380+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3888667754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee97210 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009c90 tx=0x7fa24c011810 comp rx=0 tx=0).stop 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.380+0000 7fa264e2c740 1 -- 172.21.15.82:0/3888667754 shutdown_connections 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.380+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3888667754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee97210 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.380+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3888667754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee97750 0x56383ee99b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.380+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3888667754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8e250 0x56383ee8e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.380+0000 7fa264e2c740 1 -- 172.21.15.82:0/3888667754 >> 172.21.15.82:0/3888667754 conn(0x56383ee88980 msgr2=0x56383ee88d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.380+0000 7fa264e2c740 1 -- 172.21.15.82:0/3888667754 shutdown_connections 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.380+0000 7fa264e2c740 1 -- 172.21.15.82:0/3888667754 wait complete. 2024-03-27T07:26:20.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.380+0000 7fa264e2c740 1 -- start start 2024-03-27T07:26:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa264e2c740 1 Processor -- start 2024-03-27T07:26:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 0x56383ee947c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8eb70 0x56383ee94d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee95240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa264e2c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56383ee9a540 con 0x56383ee97750 2024-03-27T07:26:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa264e2c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56383edadcd0 con 0x56383ee8eb70 2024-03-27T07:26:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa264e2c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56383ee9a6c0 con 0x56383ee8e250 2024-03-27T07:26:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa264e2c740 10 client.0 _ll_register_callbacks cb 0x56383ed9fee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 0x56383ee947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee95240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25affd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8eb70 0x56383ee94d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 0x56383ee947c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37324/0 (socket says 172.21.15.82:37324) 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25b7fe640 1 -- 172.21.15.82:0/2369409642 learned_addr learned my addr 172.21.15.82:0/2369409642 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25bfff640 1 -- 172.21.15.82:0/2369409642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 msgr2=0x56383ee947c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25bfff640 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 0x56383ee947c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25bfff640 1 -- 172.21.15.82:0/2369409642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8eb70 msgr2=0x56383ee94d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25bfff640 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8eb70 0x56383ee94d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25bfff640 1 -- 172.21.15.82:0/2369409642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383ebd07d0 con 0x56383ee97750 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25b7fe640 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 0x56383ee947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa25bfff640 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee95240 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa254005fd0 tx=0x7fa254004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f396b0b085fd3084 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa23affd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.381+0000 7fa23affd640 1 -- 172.21.15.82:0/2369409642 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25402c060 con 0x56383ee97750 2024-03-27T07:26:20.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa23affd640 1 -- 172.21.15.82:0/2369409642 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa25401ee10 con 0x56383ee97750 2024-03-27T07:26:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa264e2c740 1 -- 172.21.15.82:0/2369409642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa24c019b10 con 0x56383ee97750 2024-03-27T07:26:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa23affd640 1 -- 172.21.15.82:0/2369409642 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa254031460 con 0x56383ee97750 2024-03-27T07:26:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa264e2c740 10 client.16161 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa264e2c740 1 -- 172.21.15.82:0/2369409642 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56383eb063f0 con 0x56383ee97750 2024-03-27T07:26:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa23affd640 1 -- 172.21.15.82:0/2369409642 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa24c019b10 con 0x56383ee97750 2024-03-27T07:26:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa23affd640 1 -- 172.21.15.82:0/2369409642 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fa25400f040 con 0x56383ee97750 2024-03-27T07:26:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa264e2c740 10 client.16161 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa264e2c740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa264e2c740 20 client.16161 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:20.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa264e2c740 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56383eea7bd0 0x56383eea9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa264e2c740 4 client.16161 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa264e2c740 1 -- 172.21.15.82:0/2369409642 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56383edffda0 con 0x56383eea7bd0 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.382+0000 7fa25b7fe640 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56383eea7bd0 0x56383eea9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.383+0000 7fa25b7fe640 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56383eea7bd0 0x56383eea9ff0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef6711277195f39f server_cookie=c95b0fa84d58dd97 in_seq=0 out_seq=0 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.383+0000 7fa23affd640 10 client.16161 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.383+0000 7fa23affd640 1 -- 172.21.15.82:0/2369409642 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56383edffda0 con 0x56383eea7bd0 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.383+0000 7fa23affd640 10 client.16161 handle_command_reply: tid=0 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.383+0000 7fa264e2c740 1 client.16161 shutdown 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.383+0000 7fa264e2c740 1 -- 172.21.15.82:0/2369409642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 msgr2=0x56383ee95240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.383+0000 7fa264e2c740 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee95240 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa254005fd0 tx=0x7fa254004ab0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.383+0000 7fa264e2c740 1 -- 172.21.15.82:0/2369409642 shutdown_connections 2024-03-27T07:26:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.384+0000 7fa264e2c740 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56383eea7bd0 0x56383eea9ff0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.384+0000 7fa264e2c740 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee95240 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.384+0000 7fa264e2c740 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8eb70 0x56383ee94d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.384+0000 7fa264e2c740 1 --2- 172.21.15.82:0/2369409642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 0x56383ee947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.384+0000 7fa23affd640 0 client.16161 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.384+0000 7fa264e2c740 1 -- 172.21.15.82:0/2369409642 >> 172.21.15.82:0/2369409642 conn(0x56383ee88980 msgr2=0x56383ee8a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.384+0000 7fa264e2c740 1 -- 172.21.15.82:0/2369409642 shutdown_connections 2024-03-27T07:26:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.384+0000 7fa264e2c740 1 -- 172.21.15.82:0/2369409642 wait complete. 2024-03-27T07:26:20.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.384+0000 7fa264e2c740 20 client.16161 trim_cache size 0 max 16384 2024-03-27T07:26:20.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa264e2c740 1 Processor -- start 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa264e2c740 1 -- start start 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 0x56383ee96ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8eb70 0x56383ee93700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee839e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa264e2c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1b0060 con 0x56383ee97750 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa264e2c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1ad8d0 con 0x56383ee8eb70 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa264e2c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1ab720 con 0x56383ee8e250 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa25bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee839e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa25bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee839e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55940/0 (socket says 172.21.15.82:55940) 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa25bfff640 1 -- 172.21.15.82:0/3626267458 learned_addr learned my addr 172.21.15.82:0/3626267458 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa25b7fe640 1 --2- 172.21.15.82:0/3626267458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 0x56383ee96ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa25affd640 1 --2- 172.21.15.82:0/3626267458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8eb70 0x56383ee93700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa25bfff640 1 -- 172.21.15.82:0/3626267458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 msgr2=0x56383ee96ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa25bfff640 1 --2- 172.21.15.82:0/3626267458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 0x56383ee96ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa25bfff640 1 -- 172.21.15.82:0/3626267458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8eb70 msgr2=0x56383ee93700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa25bfff640 1 --2- 172.21.15.82:0/3626267458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8eb70 0x56383ee93700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.401+0000 7fa25bfff640 1 -- 172.21.15.82:0/3626267458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383eac60f0 con 0x56383ee97750 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa25bfff640 1 --2- 172.21.15.82:0/3626267458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee839e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa254009770 tx=0x7fa254005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cf0c3eb91f3223 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa2417fa640 1 -- 172.21.15.82:0/3626267458 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25401e790 con 0x56383ee97750 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa2417fa640 1 -- 172.21.15.82:0/3626267458 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa254003e50 con 0x56383ee97750 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa2417fa640 1 -- 172.21.15.82:0/3626267458 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254004020 con 0x56383ee97750 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa264e2c740 1 -- 172.21.15.82:0/3626267458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 msgr2=0x56383ee839e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3626267458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee839e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa254009770 tx=0x7fa254005bf0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa264e2c740 1 -- 172.21.15.82:0/3626267458 shutdown_connections 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3626267458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee97750 0x56383ee839e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3626267458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8eb70 0x56383ee93700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3626267458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee8e250 0x56383ee96ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa264e2c740 1 -- 172.21.15.82:0/3626267458 >> 172.21.15.82:0/3626267458 conn(0x56383ee88980 msgr2=0x56383ee8a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa264e2c740 1 -- 172.21.15.82:0/3626267458 shutdown_connections 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.402+0000 7fa264e2c740 1 -- 172.21.15.82:0/3626267458 wait complete. 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa264e2c740 1 -- start start 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa264e2c740 1 Processor -- start 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8e250 0x56383ee9b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee9b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa264e2c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee97750 0x56383ee9bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa264e2c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1abd90 con 0x56383ee8eb70 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa264e2c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1ad200 con 0x56383ee8e250 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa264e2c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa25c1ac460 con 0x56383ee97750 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa264e2c740 10 client.0 _ll_register_callbacks cb 0x7fa254009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:20.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa25affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee9b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa25affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee9b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55956/0 (socket says 172.21.15.82:55956) 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa25b7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8e250 0x56383ee9b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa25affd640 1 -- 172.21.15.82:0/3507644579 learned_addr learned my addr 172.21.15.82:0/3507644579 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa25bfff640 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee97750 0x56383ee9bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa25affd640 1 -- 172.21.15.82:0/3507644579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee97750 msgr2=0x56383ee9bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa25affd640 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee97750 0x56383ee9bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa25affd640 1 -- 172.21.15.82:0/3507644579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8e250 msgr2=0x56383ee9b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa25affd640 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8e250 0x56383ee9b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.403+0000 7fa25affd640 1 -- 172.21.15.82:0/3507644579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383ef0cef0 con 0x56383ee8eb70 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa25affd640 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee9b6e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009be0 tx=0x7fa24c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1aadb9e49c85ac0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa23affd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa23affd640 1 -- 172.21.15.82:0/3507644579 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c029030 con 0x56383ee8eb70 2024-03-27T07:26:20.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa264e2c740 1 -- 172.21.15.82:0/3507644579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa254003e50 con 0x56383ee8eb70 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa23affd640 1 -- 172.21.15.82:0/3507644579 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa24c005250 con 0x56383ee8eb70 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa23affd640 1 -- 172.21.15.82:0/3507644579 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa24c032020 con 0x56383ee8eb70 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa264e2c740 10 client.16167 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa264e2c740 1 -- 172.21.15.82:0/3507644579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56383ef0e180 con 0x56383ee8eb70 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa23affd640 1 -- 172.21.15.82:0/3507644579 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa254003e50 con 0x56383ee8eb70 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa23affd640 1 -- 172.21.15.82:0/3507644579 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fa24c0035f0 con 0x56383ee8eb70 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa264e2c740 10 client.16167 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa264e2c740 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa264e2c740 20 client.16167 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56383ef0e710 0x56383ef10b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa264e2c740 4 client.16167 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.404+0000 7fa264e2c740 1 -- 172.21.15.82:0/3507644579 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56383edfa0f0 con 0x56383ef0e710 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa25b7fe640 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56383ef0e710 0x56383ef10b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa23affd640 10 client.16167 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:20.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa25b7fe640 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56383ef0e710 0x56383ef10b30 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca12a262f27ef962 server_cookie=f7d636afc1ebaf3b in_seq=0 out_seq=0 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa23affd640 1 -- 172.21.15.82:0/3507644579 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56383edfa0f0 con 0x56383ef0e710 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa23affd640 10 client.16167 handle_command_reply: tid=0 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 client.16167 shutdown 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 -- 172.21.15.82:0/3507644579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 msgr2=0x56383ee9b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee9b6e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009be0 tx=0x7fa24c005850 comp rx=0 tx=0).stop 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 -- 172.21.15.82:0/3507644579 shutdown_connections 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56383ef0e710 0x56383ef10b30 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56383ee8eb70 0x56383ee9b6e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa23affd640 0 client.16167 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56383ee97750 0x56383ee9bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 --2- 172.21.15.82:0/3507644579 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56383ee8e250 0x56383ee9b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 -- 172.21.15.82:0/3507644579 >> 172.21.15.82:0/3507644579 conn(0x56383ee88980 msgr2=0x56383ee94780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 -- 172.21.15.82:0/3507644579 shutdown_connections 2024-03-27T07:26:20.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 1 -- 172.21.15.82:0/3507644579 wait complete. 2024-03-27T07:26:20.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.405+0000 7fa264e2c740 20 client.16167 trim_cache size 0 max 16384 2024-03-27T07:26:20.415 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:26:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-03-27T07:26:20.415 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-03-27T07:26:20.415 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:26:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 -- 172.21.15.82:0/1009234070 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa2440a3780 msgr2=0x7fa2440a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa2440a3780 0x7fa2440a5c40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa25c06b200 tx=0x7fa254010740 comp rx=0 tx=0).stop 2024-03-27T07:26:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 -- 172.21.15.82:0/1009234070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa25c102d90 msgr2=0x7fa25c1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa25c102d90 0x7fa25c1983d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa250005940 tx=0x7fa25002cc40 comp rx=0 tx=0).stop 2024-03-27T07:26:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 -- 172.21.15.82:0/1009234070 shutdown_connections 2024-03-27T07:26:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa2440a3780 0x7fa2440a5c40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa25c10c160 0x7fa25c19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c1036b0 0x7fa25c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 --2- 172.21.15.82:0/1009234070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa25c102d90 0x7fa25c1983d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 -- 172.21.15.82:0/1009234070 >> 172.21.15.82:0/1009234070 conn(0x7fa25c076dd0 msgr2=0x7fa25c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 -- 172.21.15.82:0/1009234070 shutdown_connections 2024-03-27T07:26:20.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.406+0000 7fa262165640 1 -- 172.21.15.82:0/1009234070 wait complete. 2024-03-27T07:26:20.417 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:20 smithi082 ceph-mon[32178]: pgmap v85: 97 pgs: 97 active+clean; 230 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 294 op/s 2024-03-27T07:26:20.419 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T07:26:20.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:26:20.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:20 smithi149 ceph-mon[36065]: pgmap v85: 97 pgs: 97 active+clean; 230 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 294 op/s 2024-03-27T07:26:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.524+0000 7f29a1802640 1 -- 172.21.15.82:0/2286080912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f299c106840 msgr2=0x7f299c106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.524+0000 7f29a1802640 1 --2- 172.21.15.82:0/2286080912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f299c106840 0x7f299c106c20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f298c009930 tx=0x7f298c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:26:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.524+0000 7f29a1802640 1 -- 172.21.15.82:0/2286080912 shutdown_connections 2024-03-27T07:26:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.524+0000 7f29a1802640 1 --2- 172.21.15.82:0/2286080912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c1011f0 0x7f299c10d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.524+0000 7f29a1802640 1 --2- 172.21.15.82:0/2286080912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f299c100830 0x7f299c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.524+0000 7f29a1802640 1 --2- 172.21.15.82:0/2286080912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f299c106840 0x7f299c106c20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.524+0000 7f29a1802640 1 -- 172.21.15.82:0/2286080912 >> 172.21.15.82:0/2286080912 conn(0x7f299c0fc300 msgr2=0x7f299c0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.524+0000 7f29a1802640 1 -- 172.21.15.82:0/2286080912 shutdown_connections 2024-03-27T07:26:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.524+0000 7f29a1802640 1 -- 172.21.15.82:0/2286080912 wait complete. 2024-03-27T07:26:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.524+0000 7f29a1802640 1 Processor -- start 2024-03-27T07:26:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f29a1802640 1 -- start start 2024-03-27T07:26:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f29a1802640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f299c100830 0x7f299c1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f29a1802640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c1011f0 0x7f299c1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f29a1802640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f299c106840 0x7f299c1a4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f29a1802640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f299c110c10 con 0x7f299c100830 2024-03-27T07:26:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f29a1802640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f299c110a90 con 0x7f299c1011f0 2024-03-27T07:26:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f29a1802640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f299c110d90 con 0x7f299c106840 2024-03-27T07:26:20.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f299affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f299c100830 0x7f299c1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f299affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f299c100830 0x7f299c1990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55974/0 (socket says 172.21.15.82:55974) 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f299affd640 1 -- 172.21.15.82:0/3740048006 learned_addr learned my addr 172.21.15.82:0/3740048006 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f299b7fe640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f299c106840 0x7f299c1a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f299a7fc640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c1011f0 0x7f299c1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f299affd640 1 -- 172.21.15.82:0/3740048006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f299c106840 msgr2=0x7f299c1a4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f299affd640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f299c106840 0x7f299c1a4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f299affd640 1 -- 172.21.15.82:0/3740048006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c1011f0 msgr2=0x7f299c1995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f299affd640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c1011f0 0x7f299c1995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.525+0000 7f299affd640 1 -- 172.21.15.82:0/3740048006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299c1a4670 con 0x7f299c100830 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.526+0000 7f299affd640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f299c100830 0x7f299c1990b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f298c009230 tx=0x7f298c02cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.526+0000 7f29a0800640 1 -- 172.21.15.82:0/3740048006 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c041070 con 0x7f299c100830 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.526+0000 7f29a0800640 1 -- 172.21.15.82:0/3740048006 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f298c004450 con 0x7f299c100830 2024-03-27T07:26:20.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.526+0000 7f29a0800640 1 -- 172.21.15.82:0/3740048006 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298c034440 con 0x7f299c100830 2024-03-27T07:26:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.526+0000 7f29a1802640 1 -- 172.21.15.82:0/3740048006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f299c1a4840 con 0x7f299c100830 2024-03-27T07:26:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.526+0000 7f29a1802640 1 -- 172.21.15.82:0/3740048006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f299c1a4d00 con 0x7f299c100830 2024-03-27T07:26:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.527+0000 7f29a1802640 1 -- 172.21.15.82:0/3740048006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f299c101f70 con 0x7f299c100830 2024-03-27T07:26:20.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.528+0000 7f29a0800640 1 -- 172.21.15.82:0/3740048006 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f298c044070 con 0x7f299c100830 2024-03-27T07:26:20.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.529+0000 7f29a0800640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f29840a3800 0x7f29840a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.529+0000 7f299a7fc640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f29840a3800 0x7f29840a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.529+0000 7f29a0800640 1 -- 172.21.15.82:0/3740048006 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f298c0f18c0 con 0x7f299c100830 2024-03-27T07:26:20.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.529+0000 7f299a7fc640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f29840a3800 0x7f29840a5cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f299c06abd0 tx=0x7f299000b410 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.534+0000 7f29a0800640 1 -- 172.21.15.82:0/3740048006 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f298c0bdc60 con 0x7f299c100830 2024-03-27T07:26:20.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:20 smithi153 ceph-mon[36179]: pgmap v85: 97 pgs: 97 active+clean; 230 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 294 op/s 2024-03-27T07:26:20.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.778+0000 7f29a1802640 1 -- 172.21.15.82:0/3740048006 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f299c108da0 con 0x7f299c100830 2024-03-27T07:26:20.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.779+0000 7f29a0800640 1 -- 172.21.15.82:0/3740048006 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11866 (secure 0 0 0) 0x7f298c0c1f60 con 0x7f299c100830 2024-03-27T07:26:20.781 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:26:20.782 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:25:25.065944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:26:20.782 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.781+0000 7f29a1802640 1 -- 172.21.15.82:0/3740048006 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f29840a3800 msgr2=0x7f29840a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.781+0000 7f29a1802640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f29840a3800 0x7f29840a5cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f299c06abd0 tx=0x7f299000b410 comp rx=0 tx=0).stop 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.781+0000 7f29a1802640 1 -- 172.21.15.82:0/3740048006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f299c100830 msgr2=0x7f299c1990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.781+0000 7f29a1802640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f299c100830 0x7f299c1990b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f298c009230 tx=0x7f298c02cba0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.782+0000 7f29a1802640 1 -- 172.21.15.82:0/3740048006 shutdown_connections 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.782+0000 7f29a1802640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f29840a3800 0x7f29840a5cc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.782+0000 7f29a1802640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f299c106840 0x7f299c1a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.782+0000 7f29a1802640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f299c1011f0 0x7f299c1995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.782+0000 7f29a1802640 1 --2- 172.21.15.82:0/3740048006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f299c100830 0x7f299c1990b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.782+0000 7f29a1802640 1 -- 172.21.15.82:0/3740048006 >> 172.21.15.82:0/3740048006 conn(0x7f299c0fc300 msgr2=0x7f299c0fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.782+0000 7f29a1802640 1 -- 172.21.15.82:0/3740048006 shutdown_connections 2024-03-27T07:26:20.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.782+0000 7f29a1802640 1 -- 172.21.15.82:0/3740048006 wait complete. 2024-03-27T07:26:20.795 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T07:26:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 -- 172.21.15.82:0/315797511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd901069d0 msgr2=0x7fbd90106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 --2- 172.21.15.82:0/315797511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd901069d0 0x7fbd90106db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbd80009860 tx=0x7fbd8002bb70 comp rx=0 tx=0).stop 2024-03-27T07:26:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 -- 172.21.15.82:0/315797511 shutdown_connections 2024-03-27T07:26:20.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 --2- 172.21.15.82:0/315797511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd90101380 0x7fbd9010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 --2- 172.21.15.82:0/315797511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd901009c0 0x7fbd90100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 --2- 172.21.15.82:0/315797511 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd901069d0 0x7fbd90106db0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 -- 172.21.15.82:0/315797511 >> 172.21.15.82:0/315797511 conn(0x7fbd90077b50 msgr2=0x7fbd90077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 -- 172.21.15.82:0/315797511 shutdown_connections 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 -- 172.21.15.82:0/315797511 wait complete. 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 Processor -- start 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.901+0000 7fbd9631e640 1 -- start start 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd9631e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd901009c0 0x7fbd90197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd9631e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd90101380 0x7fbd90197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd9631e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd901069d0 0x7fbd9019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd9631e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd90110db0 con 0x7fbd901009c0 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd9631e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd90110c30 con 0x7fbd90101380 2024-03-27T07:26:20.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd9631e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbd90110f30 con 0x7fbd901069d0 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd901009c0 0x7fbd90197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd901009c0 0x7fbd90197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55996/0 (socket says 172.21.15.82:55996) 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8ffff640 1 -- 172.21.15.82:0/482486666 learned_addr learned my addr 172.21.15.82:0/482486666 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd948bb640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd901069d0 0x7fbd9019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8f7fe640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd90101380 0x7fbd90197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8ffff640 1 -- 172.21.15.82:0/482486666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd901069d0 msgr2=0x7fbd9019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8ffff640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd901069d0 0x7fbd9019bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8ffff640 1 -- 172.21.15.82:0/482486666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd90101380 msgr2=0x7fbd90197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8ffff640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd90101380 0x7fbd90197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8ffff640 1 -- 172.21.15.82:0/482486666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9019c300 con 0x7fbd901009c0 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8ffff640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd901009c0 0x7fbd90197310 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbd80037040 tx=0x7fbd800045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8d7fa640 1 -- 172.21.15.82:0/482486666 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80044020 con 0x7fbd901009c0 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd9631e640 1 -- 172.21.15.82:0/482486666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9019c590 con 0x7fbd901009c0 2024-03-27T07:26:20.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8d7fa640 1 -- 172.21.15.82:0/482486666 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd8002c9f0 con 0x7fbd901009c0 2024-03-27T07:26:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd8d7fa640 1 -- 172.21.15.82:0/482486666 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80039040 con 0x7fbd901009c0 2024-03-27T07:26:20.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.902+0000 7fbd9631e640 1 -- 172.21.15.82:0/482486666 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd90068cb0 con 0x7fbd901009c0 2024-03-27T07:26:20.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd8d7fa640 1 -- 172.21.15.82:0/482486666 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fbd80047020 con 0x7fbd901009c0 2024-03-27T07:26:20.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd98fe5740 1 Processor -- start 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd98fe5740 1 -- start start 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63460 0x55650df63840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd8d7fa640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbd780a3780 0x7fbd780a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df63d80 0x55650df70b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df710c0 0x55650df734b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55650dec7710 con 0x55650df710c0 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55650de6faf0 con 0x55650df63460 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55650dec36c0 con 0x55650df63d80 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd948bb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df710c0 0x55650df734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd8ffff640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbd780a3780 0x7fbd780a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd948bb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63460 0x55650df63840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd948bb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63460 0x55650df63840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:50960/0 (socket says 172.21.15.82:50960) 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd8f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df63d80 0x55650df70b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd948bb640 1 -- 172.21.15.82:0/2133082866 learned_addr learned my addr 172.21.15.82:0/2133082866 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.905+0000 7fbd8d7fa640 1 -- 172.21.15.82:0/482486666 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fbd800f4240 con 0x7fbd901009c0 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.906+0000 7fbd948bb640 1 -- 172.21.15.82:0/2133082866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df63d80 msgr2=0x55650df70b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.906+0000 7fbd948bb640 1 --2- 172.21.15.82:0/2133082866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df63d80 0x55650df70b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.906+0000 7fbd948bb640 1 -- 172.21.15.82:0/2133082866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df710c0 msgr2=0x55650df734b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.906+0000 7fbd948bb640 1 --2- 172.21.15.82:0/2133082866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df710c0 0x55650df734b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.906+0000 7fbd948bb640 1 -- 172.21.15.82:0/2133082866 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55650dbdb3f0 con 0x55650df63460 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.906+0000 7fbd8ffff640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbd780a3780 0x7fbd780a5c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd800f1ba0 tx=0x7fbd800ab040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.906+0000 7fbd948bb640 1 --2- 172.21.15.82:0/2133082866 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63460 0x55650df63840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800eb20 tx=0x7fbd880095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab6754dd6c4e9d89 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.906+0000 7fbd767fc640 1 -- 172.21.15.82:0/2133082866 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8800e030 con 0x55650df63460 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.906+0000 7fbd767fc640 1 -- 172.21.15.82:0/2133082866 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd8800e1d0 con 0x55650df63460 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.906+0000 7fbd767fc640 1 -- 172.21.15.82:0/2133082866 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88004300 con 0x55650df63460 2024-03-27T07:26:20.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 -- 172.21.15.82:0/2133082866 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63460 msgr2=0x55650df63840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/2133082866 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63460 0x55650df63840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbd8800eb20 tx=0x7fbd880095c0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 -- 172.21.15.82:0/2133082866 shutdown_connections 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/2133082866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df710c0 0x55650df734b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/2133082866 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df63d80 0x55650df70b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/2133082866 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63460 0x55650df63840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 -- 172.21.15.82:0/2133082866 >> 172.21.15.82:0/2133082866 conn(0x55650df5dee0 msgr2=0x55650df5e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 -- 172.21.15.82:0/2133082866 shutdown_connections 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 -- 172.21.15.82:0/2133082866 wait complete. 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 -- start start 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.907+0000 7fbd98fe5740 1 Processor -- start 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df63460 0x55650df6e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63d80 0x55650df6e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df710c0 0x55650df6eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55650df73f00 con 0x55650df63d80 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55650de82eb0 con 0x55650df710c0 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55650df74080 con 0x55650df63460 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd98fe5740 10 client.0 _ll_register_callbacks cb 0x55650debf6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd8f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63d80 0x55650df6e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd8f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63d80 0x55650df6e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56016/0 (socket says 172.21.15.82:56016) 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd948bb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df63460 0x55650df6e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd8f7fe640 1 -- 172.21.15.82:0/3647595008 learned_addr learned my addr 172.21.15.82:0/3647595008 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd948bb640 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df710c0 0x55650df6eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd8f7fe640 1 -- 172.21.15.82:0/3647595008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df63460 msgr2=0x55650df6e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd8f7fe640 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df63460 0x55650df6e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd8f7fe640 1 -- 172.21.15.82:0/3647595008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df710c0 msgr2=0x55650df6eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd8f7fe640 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df710c0 0x55650df6eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd8f7fe640 1 -- 172.21.15.82:0/3647595008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55650dca57d0 con 0x55650df63d80 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd8f7fe640 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63d80 0x55650df6e5e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbd84012770 tx=0x7fbd84012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3a4ba4e991b670 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/3647595008 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8400f920 con 0x55650df63d80 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/3647595008 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fbd8400fac0 con 0x55650df63d80 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.908+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3647595008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd8800e1d0 con 0x55650df63d80 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/3647595008 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbd8400fcc0 con 0x55650df63d80 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd98fe5740 10 client.16185 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3647595008 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55650df80250 con 0x55650df63d80 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/3647595008 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd8800e1d0 con 0x55650df63d80 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/3647595008 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fbd8401c420 con 0x55650df63d80 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd98fe5740 10 client.16185 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd98fe5740 10 client.16185 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd98fe5740 20 client.16185 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:20.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55650df81940 0x55650df83d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd98fe5740 4 client.16185 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3647595008 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55650ded4c50 con 0x55650df81940 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.909+0000 7fbd948bb640 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55650df81940 0x55650df83d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd6f7fe640 10 client.16185 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd948bb640 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55650df81940 0x55650df83d80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5c1c2fff0cb6c1ca server_cookie=2109e9fe9f9b8441 in_seq=0 out_seq=0 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/3647595008 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55650ded4c50 con 0x55650df81940 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd6f7fe640 10 client.16185 handle_command_reply: tid=0 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd98fe5740 1 client.16185 shutdown 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3647595008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63d80 msgr2=0x55650df6e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63d80 0x55650df6e5e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbd84012770 tx=0x7fbd84012c30 comp rx=0 tx=0).stop 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3647595008 shutdown_connections 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55650df81940 0x55650df83d80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63d80 0x55650df6e5e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df710c0 0x55650df6eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd6f7fe640 0 client.16185 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:26:20.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/3647595008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df63460 0x55650df6e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3647595008 >> 172.21.15.82:0/3647595008 conn(0x55650df5dee0 msgr2=0x55650df5fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.910+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3647595008 shutdown_connections 2024-03-27T07:26:20.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.911+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3647595008 wait complete. 2024-03-27T07:26:20.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.911+0000 7fbd98fe5740 20 client.16185 trim_cache size 0 max 16384 2024-03-27T07:26:20.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.923+0000 7fbd98fe5740 1 Processor -- start 2024-03-27T07:26:20.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.923+0000 7fbd98fe5740 1 -- start start 2024-03-27T07:26:20.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df7cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 0x55650df6e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df710c0 0x55650df89690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901adf30 con 0x55650df63460 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901ab7a0 con 0x55650df63d80 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901a95f0 con 0x55650df710c0 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd948bb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df7cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd948bb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df7cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56030/0 (socket says 172.21.15.82:56030) 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd948bb640 1 -- 172.21.15.82:0/3652400638 learned_addr learned my addr 172.21.15.82:0/3652400638 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd8f7fe640 1 --2- 172.21.15.82:0/3652400638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 0x55650df6e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd948bb640 1 --2- 172.21.15.82:0/3652400638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df710c0 0x55650df89690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd948bb640 1 -- 172.21.15.82:0/3652400638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df710c0 msgr2=0x55650df89690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd948bb640 1 --2- 172.21.15.82:0/3652400638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df710c0 0x55650df89690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd948bb640 1 -- 172.21.15.82:0/3652400638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 msgr2=0x55650df6e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd948bb640 1 --2- 172.21.15.82:0/3652400638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 0x55650df6e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd948bb640 1 -- 172.21.15.82:0/3652400638 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55650df63bb0 con 0x55650df63460 2024-03-27T07:26:20.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd8f7fe640 1 --2- 172.21.15.82:0/3652400638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 0x55650df6e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:20.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd948bb640 1 --2- 172.21.15.82:0/3652400638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df7cd40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009fd0 tx=0x7fbd880095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471774080d28f1d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd75ffb640 1 -- 172.21.15.82:0/3652400638 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88033020 con 0x55650df63460 2024-03-27T07:26:20.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd75ffb640 1 -- 172.21.15.82:0/3652400638 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd88003e50 con 0x55650df63460 2024-03-27T07:26:20.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.924+0000 7fbd75ffb640 1 -- 172.21.15.82:0/3652400638 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88022040 con 0x55650df63460 2024-03-27T07:26:20.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.925+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3652400638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 msgr2=0x55650df7cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.925+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/3652400638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df7cd40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbd88009fd0 tx=0x7fbd880095c0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.925+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3652400638 shutdown_connections 2024-03-27T07:26:20.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.925+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/3652400638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df710c0 0x55650df89690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.925+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/3652400638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 0x55650df6e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.925+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/3652400638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df7cd40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.925+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3652400638 >> 172.21.15.82:0/3652400638 conn(0x55650df5dee0 msgr2=0x55650df5c770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.925+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3652400638 shutdown_connections 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.925+0000 7fbd98fe5740 1 -- 172.21.15.82:0/3652400638 wait complete. 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.925+0000 7fbd98fe5740 1 -- start start 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd98fe5740 1 Processor -- start 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df6ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 0x55650df6b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd98fe5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df710c0 0x55650df6b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901a9c60 con 0x55650df63460 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901ab0d0 con 0x55650df63d80 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd98fe5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fbd901aa330 con 0x55650df710c0 2024-03-27T07:26:20.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd98fe5740 10 client.0 _ll_register_callbacks cb 0x7fbd84009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd948bb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df6ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd948bb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df6ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56032/0 (socket says 172.21.15.82:56032) 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd948bb640 1 -- 172.21.15.82:0/1753403954 learned_addr learned my addr 172.21.15.82:0/1753403954 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd8f7fe640 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 0x55650df6b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd948bb640 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df710c0 0x55650df6b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd948bb640 1 -- 172.21.15.82:0/1753403954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df710c0 msgr2=0x55650df6b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd948bb640 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df710c0 0x55650df6b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd948bb640 1 -- 172.21.15.82:0/1753403954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 msgr2=0x55650df6b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd948bb640 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 0x55650df6b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd948bb640 1 -- 172.21.15.82:0/1753403954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55650dfe6cc0 con 0x55650df63460 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd948bb640 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df6ac10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbd880054d0 tx=0x7fbd880098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f01bc977a2d912 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.926+0000 7fbd6f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/1753403954 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd88033070 con 0x55650df63460 2024-03-27T07:26:20.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/1753403954 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fbd88003970 con 0x55650df63460 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd98fe5740 1 -- 172.21.15.82:0/1753403954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd88003e50 con 0x55650df63460 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/1753403954 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbd88003b70 con 0x55650df63460 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd98fe5740 10 client.16191 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd98fe5740 1 -- 172.21.15.82:0/1753403954 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55650dfe7f70 con 0x55650df63460 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/1753403954 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbd88003e50 con 0x55650df63460 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/1753403954 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fbd88028040 con 0x55650df63460 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd98fe5740 10 client.16191 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd98fe5740 10 client.16191 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd98fe5740 20 client.16191 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55650dfe8460 0x55650dfea880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd98fe5740 4 client.16191 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd98fe5740 1 -- 172.21.15.82:0/1753403954 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55650decefa0 con 0x55650dfe8460 2024-03-27T07:26:20.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.927+0000 7fbd8f7fe640 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55650dfe8460 0x55650dfea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd6f7fe640 10 client.16191 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd8f7fe640 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55650dfe8460 0x55650dfea880 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=25db6b0c3934bf99 server_cookie=d93a5bd627e0bed1 in_seq=0 out_seq=0 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd6f7fe640 1 -- 172.21.15.82:0/1753403954 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55650decefa0 con 0x55650dfe8460 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd6f7fe640 10 client.16191 handle_command_reply: tid=0 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 client.16191 shutdown 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 -- 172.21.15.82:0/1753403954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 msgr2=0x55650df6ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df6ac10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbd880054d0 tx=0x7fbd880098e0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 -- 172.21.15.82:0/1753403954 shutdown_connections 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55650dfe8460 0x55650dfea880 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55650df710c0 0x55650df6b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55650df63d80 0x55650df6b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd6f7fe640 0 client.16191 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 --2- 172.21.15.82:0/1753403954 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55650df63460 0x55650df6ac10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 -- 172.21.15.82:0/1753403954 >> 172.21.15.82:0/1753403954 conn(0x55650df5dee0 msgr2=0x55650df5f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 -- 172.21.15.82:0/1753403954 shutdown_connections 2024-03-27T07:26:20.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 1 -- 172.21.15.82:0/1753403954 wait complete. 2024-03-27T07:26:20.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.928+0000 7fbd98fe5740 20 client.16191 trim_cache size 0 max 16384 2024-03-27T07:26:20.938 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:26:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 -- 172.21.15.82:0/482486666 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbd780a3780 msgr2=0x7fbd780a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbd780a3780 0x7fbd780a5c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbd800f1ba0 tx=0x7fbd800ab040 comp rx=0 tx=0).stop 2024-03-27T07:26:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 -- 172.21.15.82:0/482486666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd901009c0 msgr2=0x7fbd90197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd901009c0 0x7fbd90197310 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbd80037040 tx=0x7fbd800045b0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 -- 172.21.15.82:0/482486666 shutdown_connections 2024-03-27T07:26:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fbd780a3780 0x7fbd780a5c40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd901069d0 0x7fbd9019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fbd90101380 0x7fbd90197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 --2- 172.21.15.82:0/482486666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd901009c0 0x7fbd90197310 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:20.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 -- 172.21.15.82:0/482486666 >> 172.21.15.82:0/482486666 conn(0x7fbd90077b50 msgr2=0x7fbd901032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:20.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 -- 172.21.15.82:0/482486666 shutdown_connections 2024-03-27T07:26:20.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:20.929+0000 7fbd9631e640 1 -- 172.21.15.82:0/482486666 wait complete. 2024-03-27T07:26:20.942 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T07:26:21.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.047+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2352183228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2281013c0 msgr2=0x7fc22810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.047+0000 7fc22e6bc640 1 --2- 172.21.15.82:0/2352183228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2281013c0 0x7fc22810d8d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc220009cd0 tx=0x7fc22002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.047+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2352183228 shutdown_connections 2024-03-27T07:26:21.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.047+0000 7fc22e6bc640 1 --2- 172.21.15.82:0/2352183228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2281013c0 0x7fc22810d8d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.047+0000 7fc22e6bc640 1 --2- 172.21.15.82:0/2352183228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc228100a00 0x7fc228100e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.047+0000 7fc22e6bc640 1 --2- 172.21.15.82:0/2352183228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc228106a10 0x7fc228106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.047+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2352183228 >> 172.21.15.82:0/2352183228 conn(0x7fc228076dd0 msgr2=0x7fc2280771e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.047+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2352183228 shutdown_connections 2024-03-27T07:26:21.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.047+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2352183228 wait complete. 2024-03-27T07:26:21.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc22e6bc640 1 Processor -- start 2024-03-27T07:26:21.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc22e6bc640 1 -- start start 2024-03-27T07:26:21.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc22e6bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc228100a00 0x7fc2281983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc22e6bc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2281013c0 0x7fc228198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc22e6bc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc228106a10 0x7fc22819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc22e6bc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc228110e20 con 0x7fc228100a00 2024-03-27T07:26:21.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc22e6bc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc228110ca0 con 0x7fc2281013c0 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc22e6bc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc228110fa0 con 0x7fc228106a10 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc227fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc228100a00 0x7fc2281983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc227fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc228100a00 0x7fc2281983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56052/0 (socket says 172.21.15.82:56052) 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc227fff640 1 -- 172.21.15.82:0/2302521535 learned_addr learned my addr 172.21.15.82:0/2302521535 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc22cc59640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc228106a10 0x7fc22819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.048+0000 7fc2277fe640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2281013c0 0x7fc228198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc227fff640 1 -- 172.21.15.82:0/2302521535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc228106a10 msgr2=0x7fc22819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc227fff640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc228106a10 0x7fc22819cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc227fff640 1 -- 172.21.15.82:0/2302521535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2281013c0 msgr2=0x7fc228198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc227fff640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2281013c0 0x7fc228198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc227fff640 1 -- 172.21.15.82:0/2302521535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22819d3d0 con 0x7fc228100a00 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc227fff640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc228100a00 0x7fc2281983e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00e9f0 tx=0x7fc21c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc2257fa640 1 -- 172.21.15.82:0/2302521535 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00cd80 con 0x7fc228100a00 2024-03-27T07:26:21.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc2257fa640 1 -- 172.21.15.82:0/2302521535 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc21c010910 con 0x7fc228100a00 2024-03-27T07:26:21.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2302521535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22819d6c0 con 0x7fc228100a00 2024-03-27T07:26:21.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc2257fa640 1 -- 172.21.15.82:0/2302521535 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21c018990 con 0x7fc228100a00 2024-03-27T07:26:21.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.049+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2302521535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2281a4f50 con 0x7fc228100a00 2024-03-27T07:26:21.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.051+0000 7fc2257fa640 1 -- 172.21.15.82:0/2302521535 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fc21c010ac0 con 0x7fc228100a00 2024-03-27T07:26:21.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.051+0000 7fc231378740 1 Processor -- start 2024-03-27T07:26:21.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.051+0000 7fc231378740 1 -- start start 2024-03-27T07:26:21.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc231378740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede388c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc2257fa640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc2100a3780 0x7fc2100a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc231378740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 0x561cede45b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc231378740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 0x561cede484b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc231378740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561cedd9c710 con 0x561cede384e0 2024-03-27T07:26:21.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc231378740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561cedd44af0 con 0x561cede38e00 2024-03-27T07:26:21.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc231378740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561cedd986c0 con 0x561cede460c0 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc22cc59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc227fff640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc2100a3780 0x7fc2100a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc22cc59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56068/0 (socket says 172.21.15.82:56068) 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc22cc59640 1 -- 172.21.15.82:0/88012943 learned_addr learned my addr 172.21.15.82:0/88012943 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc2277fe640 1 --2- 172.21.15.82:0/88012943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 0x561cede45b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc22cc59640 1 --2- 172.21.15.82:0/88012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 0x561cede484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc2257fa640 1 -- 172.21.15.82:0/2302521535 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fc21c0d0320 con 0x7fc228100a00 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc2277fe640 1 -- 172.21.15.82:0/88012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 msgr2=0x561cede484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc2277fe640 1 --2- 172.21.15.82:0/88012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 0x561cede484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc2277fe640 1 -- 172.21.15.82:0/88012943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 msgr2=0x561cede388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc2277fe640 1 --2- 172.21.15.82:0/88012943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc2277fe640 1 -- 172.21.15.82:0/88012943 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cedab03f0 con 0x561cede38e00 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc22cc59640 1 --2- 172.21.15.82:0/88012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 0x561cede484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:21.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc227fff640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc2100a3780 0x7fc2100a5c40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc21c064340 tx=0x7fc21c09f040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc2277fe640 1 --2- 172.21.15.82:0/88012943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 0x561cede45b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc218005d00 tx=0x7fc2180107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=283e71d1164b85fe server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.052+0000 7fc20e7fc640 1 -- 172.21.15.82:0/88012943 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc21801c480 con 0x561cede38e00 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc20e7fc640 1 -- 172.21.15.82:0/88012943 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc21801cb00 con 0x561cede38e00 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc20e7fc640 1 -- 172.21.15.82:0/88012943 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218011b80 con 0x561cede38e00 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc231378740 1 -- 172.21.15.82:0/88012943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 msgr2=0x561cede45b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc231378740 1 --2- 172.21.15.82:0/88012943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 0x561cede45b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc218005d00 tx=0x7fc2180107a0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc231378740 1 -- 172.21.15.82:0/88012943 shutdown_connections 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc231378740 1 --2- 172.21.15.82:0/88012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 0x561cede484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc231378740 1 --2- 172.21.15.82:0/88012943 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 0x561cede45b80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc231378740 1 --2- 172.21.15.82:0/88012943 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede388c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc231378740 1 -- 172.21.15.82:0/88012943 >> 172.21.15.82:0/88012943 conn(0x561cede32ee0 msgr2=0x561cede332c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc231378740 1 -- 172.21.15.82:0/88012943 shutdown_connections 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc231378740 1 -- 172.21.15.82:0/88012943 wait complete. 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.053+0000 7fc231378740 1 -- start start 2024-03-27T07:26:21.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc231378740 1 Processor -- start 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc231378740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede43130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc231378740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede38e00 0x561cede43670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc231378740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede460c0 0x561cede43bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc231378740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561cede48e80 con 0x561cede384e0 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc231378740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561cedd57eb0 con 0x561cede460c0 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc231378740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561cede49000 con 0x561cede38e00 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc231378740 10 client.0 _ll_register_callbacks cb 0x561cedd946a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc22cc59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede43130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc22cc59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede43130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56074/0 (socket says 172.21.15.82:56074) 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc22cc59640 1 -- 172.21.15.82:0/708624313 learned_addr learned my addr 172.21.15.82:0/708624313 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc2277fe640 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede38e00 0x561cede43670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc22cc59640 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede460c0 0x561cede43bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc22cc59640 1 -- 172.21.15.82:0/708624313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede38e00 msgr2=0x561cede43670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc22cc59640 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede38e00 0x561cede43670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc22cc59640 1 -- 172.21.15.82:0/708624313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede460c0 msgr2=0x561cede43bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc22cc59640 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede460c0 0x561cede43bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.054+0000 7fc22cc59640 1 -- 172.21.15.82:0/708624313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cedb7a7d0 con 0x561cede384e0 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc22cc59640 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede43130 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc220005cc0 tx=0x7fc220009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a07bafc7aedac07 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc2077fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc2077fe640 1 -- 172.21.15.82:0/708624313 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220039040 con 0x561cede384e0 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc2077fe640 1 -- 172.21.15.82:0/708624313 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fc220032860 con 0x561cede384e0 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc231378740 1 -- 172.21.15.82:0/708624313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc21801cb00 con 0x561cede384e0 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc2077fe640 1 -- 172.21.15.82:0/708624313 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc220003970 con 0x561cede384e0 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc231378740 10 client.16203 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc231378740 1 -- 172.21.15.82:0/708624313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561cede551e0 con 0x561cede384e0 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc2077fe640 1 -- 172.21.15.82:0/708624313 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc21801cb00 con 0x561cede384e0 2024-03-27T07:26:21.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc2077fe640 1 -- 172.21.15.82:0/708624313 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc22003f070 con 0x561cede384e0 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc231378740 10 client.16203 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc231378740 10 client.16203 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc231378740 20 client.16203 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc231378740 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561cede56640 0x561cede58aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc231378740 4 client.16203 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.055+0000 7fc231378740 1 -- 172.21.15.82:0/708624313 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cedda9c50 con 0x561cede56640 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.056+0000 7fc2277fe640 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561cede56640 0x561cede58aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.056+0000 7fc2077fe640 10 client.16203 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.056+0000 7fc2277fe640 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561cede56640 0x561cede58aa0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c2b52350f97200a0 server_cookie=1b7d8fdd32ea4c61 in_seq=0 out_seq=0 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.058+0000 7fc2077fe640 1 -- 172.21.15.82:0/708624313 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561cedda9c50 con 0x561cede56640 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.058+0000 7fc2077fe640 10 client.16203 handle_command_reply: tid=0 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.058+0000 7fc231378740 1 client.16203 shutdown 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 1 -- 172.21.15.82:0/708624313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 msgr2=0x561cede43130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede43130 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc220005cc0 tx=0x7fc220009820 comp rx=0 tx=0).stop 2024-03-27T07:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 1 -- 172.21.15.82:0/708624313 shutdown_connections 2024-03-27T07:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561cede56640 0x561cede58aa0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede460c0 0x561cede43bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede38e00 0x561cede43670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 1 --2- 172.21.15.82:0/708624313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede43130 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc2077fe640 0 client.16203 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 1 -- 172.21.15.82:0/708624313 >> 172.21.15.82:0/708624313 conn(0x561cede32ee0 msgr2=0x561cede34c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 1 -- 172.21.15.82:0/708624313 shutdown_connections 2024-03-27T07:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 1 -- 172.21.15.82:0/708624313 wait complete. 2024-03-27T07:26:21.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.059+0000 7fc231378740 20 client.16203 trim_cache size 0 max 16384 2024-03-27T07:26:21.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.072+0000 7fc231378740 1 Processor -- start 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.072+0000 7fc231378740 1 -- start start 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.072+0000 7fc231378740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede384e0 0x561cede45860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.072+0000 7fc231378740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede38e00 0x561cede51c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc231378740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede460c0 0x561cede5e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc231378740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc2281adef0 con 0x561cede460c0 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc231378740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc2281ab760 con 0x561cede384e0 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc231378740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2281a95b0 con 0x561cede38e00 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc22cc59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede460c0 0x561cede5e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc22cc59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede460c0 0x561cede5e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56086/0 (socket says 172.21.15.82:56086) 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc2277fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede38e00 0x561cede51c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc22cc59640 1 -- 172.21.15.82:0/1157818337 learned_addr learned my addr 172.21.15.82:0/1157818337 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:21.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc22cc59640 1 --2- 172.21.15.82:0/1157818337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede384e0 0x561cede45860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc22cc59640 1 -- 172.21.15.82:0/1157818337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede38e00 msgr2=0x561cede51c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc22cc59640 1 --2- 172.21.15.82:0/1157818337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede38e00 0x561cede51c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc22cc59640 1 -- 172.21.15.82:0/1157818337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede384e0 msgr2=0x561cede45860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc22cc59640 1 --2- 172.21.15.82:0/1157818337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede384e0 0x561cede45860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc22cc59640 1 -- 172.21.15.82:0/1157818337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cede38c30 con 0x561cede460c0 2024-03-27T07:26:21.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc22cc59640 1 --2- 172.21.15.82:0/1157818337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede460c0 0x561cede5e370 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc220004aa0 tx=0x7fc220036040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fcc6300a7c831d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc20dffb640 1 -- 172.21.15.82:0/1157818337 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220039030 con 0x561cede460c0 2024-03-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc20dffb640 1 -- 172.21.15.82:0/1157818337 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc220003ff0 con 0x561cede460c0 2024-03-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.073+0000 7fc20dffb640 1 -- 172.21.15.82:0/1157818337 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220004510 con 0x561cede460c0 2024-03-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.074+0000 7fc231378740 1 -- 172.21.15.82:0/1157818337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede460c0 msgr2=0x561cede5e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.074+0000 7fc231378740 1 --2- 172.21.15.82:0/1157818337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede460c0 0x561cede5e370 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc220004aa0 tx=0x7fc220036040 comp rx=0 tx=0).stop 2024-03-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.074+0000 7fc231378740 1 -- 172.21.15.82:0/1157818337 shutdown_connections 2024-03-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.074+0000 7fc231378740 1 --2- 172.21.15.82:0/1157818337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede460c0 0x561cede5e370 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.074+0000 7fc231378740 1 --2- 172.21.15.82:0/1157818337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede38e00 0x561cede51c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.074+0000 7fc231378740 1 --2- 172.21.15.82:0/1157818337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede384e0 0x561cede45860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.074+0000 7fc231378740 1 -- 172.21.15.82:0/1157818337 >> 172.21.15.82:0/1157818337 conn(0x561cede32ee0 msgr2=0x561cede43980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.074+0000 7fc231378740 1 -- 172.21.15.82:0/1157818337 shutdown_connections 2024-03-27T07:26:21.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.074+0000 7fc231378740 1 -- 172.21.15.82:0/1157818337 wait complete. 2024-03-27T07:26:21.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.074+0000 7fc231378740 1 -- start start 2024-03-27T07:26:21.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc231378740 1 Processor -- start 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc231378740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede49e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc231378740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 0x561cede4a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc231378740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 0x561cede4a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc231378740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc2281a9c20 con 0x561cede384e0 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc231378740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc2281ab090 con 0x561cede38e00 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc231378740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc2281aa2f0 con 0x561cede460c0 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc231378740 10 client.0 _ll_register_callbacks cb 0x7fc220009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc22cc59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede49e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc22cc59640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede49e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56088/0 (socket says 172.21.15.82:56088) 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc22cc59640 1 -- 172.21.15.82:0/34680443 learned_addr learned my addr 172.21.15.82:0/34680443 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc2277fe640 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 0x561cede4a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc22cc59640 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 0x561cede4a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc22cc59640 1 -- 172.21.15.82:0/34680443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 msgr2=0x561cede4a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc22cc59640 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 0x561cede4a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc22cc59640 1 -- 172.21.15.82:0/34680443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 msgr2=0x561cede4a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc22cc59640 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 0x561cede4a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc22cc59640 1 -- 172.21.15.82:0/34680443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cedebbc40 con 0x561cede384e0 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc22cc59640 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede49e40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc220004240 tx=0x7fc220032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62df87e4f75aa31 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc2077fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc2077fe640 1 -- 172.21.15.82:0/34680443 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2200345c0 con 0x561cede384e0 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc2077fe640 1 -- 172.21.15.82:0/34680443 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fc220003b10 con 0x561cede384e0 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.075+0000 7fc231378740 1 -- 172.21.15.82:0/34680443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc220003ff0 con 0x561cede384e0 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc2077fe640 1 -- 172.21.15.82:0/34680443 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc2200098e0 con 0x561cede384e0 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc231378740 10 client.16209 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc231378740 1 -- 172.21.15.82:0/34680443 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561cedebcf20 con 0x561cede384e0 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc2077fe640 1 -- 172.21.15.82:0/34680443 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc220003ff0 con 0x561cede384e0 2024-03-27T07:26:21.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc2077fe640 1 -- 172.21.15.82:0/34680443 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc22003f070 con 0x561cede384e0 2024-03-27T07:26:21.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc231378740 10 client.16209 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:21.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc231378740 10 client.16209 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:26:21.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc231378740 20 client.16209 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:21.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc231378740 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561cedebd6a0 0x561cedebfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc231378740 4 client.16209 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:26:21.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc231378740 1 -- 172.21.15.82:0/34680443 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561cedda3fa0 con 0x561cedebd6a0 2024-03-27T07:26:21.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.076+0000 7fc2277fe640 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561cedebd6a0 0x561cedebfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.077+0000 7fc2077fe640 10 client.16209 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:26:21.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.077+0000 7fc2277fe640 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561cedebd6a0 0x561cedebfa90 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=69caa903491318a0 server_cookie=5c5f9ba0a047c4e4 in_seq=0 out_seq=0 2024-03-27T07:26:21.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc2077fe640 1 -- 172.21.15.82:0/34680443 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561cedda3fa0 con 0x561cedebd6a0 2024-03-27T07:26:21.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc2077fe640 10 client.16209 handle_command_reply: tid=0 2024-03-27T07:26:21.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 client.16209 shutdown 2024-03-27T07:26:21.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 -- 172.21.15.82:0/34680443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 msgr2=0x561cede49e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede49e40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc220004240 tx=0x7fc220032d30 comp rx=0 tx=0).stop 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 -- 172.21.15.82:0/34680443 shutdown_connections 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x561cedebd6a0 0x561cedebfa90 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561cede460c0 0x561cede4a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561cede38e00 0x561cede4a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 --2- 172.21.15.82:0/34680443 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561cede384e0 0x561cede49e40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc2077fe640 0 client.16209 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 -- 172.21.15.82:0/34680443 >> 172.21.15.82:0/34680443 conn(0x561cede32ee0 msgr2=0x561cede430f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 -- 172.21.15.82:0/34680443 shutdown_connections 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 1 -- 172.21.15.82:0/34680443 wait complete. 2024-03-27T07:26:21.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc231378740 20 client.16209 trim_cache size 0 max 16384 2024-03-27T07:26:21.089 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:26:21.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2302521535 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc2100a3780 msgr2=0x7fc2100a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc22e6bc640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc2100a3780 0x7fc2100a5c40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc21c064340 tx=0x7fc21c09f040 comp rx=0 tx=0).stop 2024-03-27T07:26:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2302521535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc228100a00 msgr2=0x7fc2281983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.080+0000 7fc22e6bc640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc228100a00 0x7fc2281983e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00e9f0 tx=0x7fc21c00eeb0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.081+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2302521535 shutdown_connections 2024-03-27T07:26:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.081+0000 7fc22e6bc640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc2100a3780 0x7fc2100a5c40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.081+0000 7fc22e6bc640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc228106a10 0x7fc22819cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.081+0000 7fc22e6bc640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc2281013c0 0x7fc228198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.081+0000 7fc22e6bc640 1 --2- 172.21.15.82:0/2302521535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc228100a00 0x7fc2281983e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.081+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2302521535 >> 172.21.15.82:0/2302521535 conn(0x7fc228076dd0 msgr2=0x7fc22806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.081+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2302521535 shutdown_connections 2024-03-27T07:26:21.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.081+0000 7fc22e6bc640 1 -- 172.21.15.82:0/2302521535 wait complete. 2024-03-27T07:26:21.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T07:26:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.197+0000 7fd411119640 1 -- 172.21.15.82:0/2280405528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40c1024a0 msgr2=0x7fd40c10e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.197+0000 7fd411119640 1 --2- 172.21.15.82:0/2280405528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40c1024a0 0x7fd40c10e9b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009cd0 tx=0x7fd3fc02c0f0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.197+0000 7fd411119640 1 -- 172.21.15.82:0/2280405528 shutdown_connections 2024-03-27T07:26:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.197+0000 7fd411119640 1 --2- 172.21.15.82:0/2280405528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40c1024a0 0x7fd40c10e9b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.197+0000 7fd411119640 1 --2- 172.21.15.82:0/2280405528 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40c101ae0 0x7fd40c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.197+0000 7fd411119640 1 --2- 172.21.15.82:0/2280405528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd40c107b80 0x7fd40c107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.197+0000 7fd411119640 1 -- 172.21.15.82:0/2280405528 >> 172.21.15.82:0/2280405528 conn(0x7fd40c078f50 msgr2=0x7fd40c079360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.197+0000 7fd411119640 1 -- 172.21.15.82:0/2280405528 shutdown_connections 2024-03-27T07:26:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.197+0000 7fd411119640 1 -- 172.21.15.82:0/2280405528 wait complete. 2024-03-27T07:26:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd411119640 1 Processor -- start 2024-03-27T07:26:21.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd411119640 1 -- start start 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd411119640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40c101ae0 0x7fd40c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd411119640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd40c1024a0 0x7fd40c198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd411119640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40c107b80 0x7fd40c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd411119640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c111f00 con 0x7fd40c107b80 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd411119640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c111d80 con 0x7fd40c101ae0 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd411119640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c112080 con 0x7fd40c1024a0 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd40b59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40c107b80 0x7fd40c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd40b59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40c107b80 0x7fd40c19ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56112/0 (socket says 172.21.15.82:56112) 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd40b59e640 1 -- 172.21.15.82:0/924572484 learned_addr learned my addr 172.21.15.82:0/924572484 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd40a59c640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd40c1024a0 0x7fd40c198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.198+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40c101ae0 0x7fd40c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd40b59e640 1 -- 172.21.15.82:0/924572484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd40c1024a0 msgr2=0x7fd40c198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd40b59e640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd40c1024a0 0x7fd40c198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd40b59e640 1 -- 172.21.15.82:0/924572484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40c101ae0 msgr2=0x7fd40c198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd40b59e640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40c101ae0 0x7fd40c198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd40b59e640 1 -- 172.21.15.82:0/924572484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c19d3f0 con 0x7fd40c107b80 2024-03-27T07:26:21.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd40b59e640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40c107b80 0x7fd40c19ccc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0348f0 tx=0x7fd3fc032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd403fff640 1 -- 172.21.15.82:0/924572484 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc041020 con 0x7fd40c107b80 2024-03-27T07:26:21.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd411119640 1 -- 172.21.15.82:0/924572484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40c19d680 con 0x7fd40c107b80 2024-03-27T07:26:21.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd403fff640 1 -- 172.21.15.82:0/924572484 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3fc032e80 con 0x7fd40c107b80 2024-03-27T07:26:21.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd403fff640 1 -- 172.21.15.82:0/924572484 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc039040 con 0x7fd40c107b80 2024-03-27T07:26:21.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.199+0000 7fd411119640 1 -- 172.21.15.82:0/924572484 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40c1a4f70 con 0x7fd40c107b80 2024-03-27T07:26:21.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.201+0000 7fd403fff640 1 -- 172.21.15.82:0/924572484 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fd3fc044020 con 0x7fd40c107b80 2024-03-27T07:26:21.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd413dd7740 1 Processor -- start 2024-03-27T07:26:21.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd413dd7740 1 -- start start 2024-03-27T07:26:21.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86bbc0 0x56527a86bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86c4e0 0x56527a874b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a8750c0 0x56527a8774b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd413dd7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56527a7cb710 con 0x56527a86bbc0 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd413dd7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56527a773af0 con 0x56527a86c4e0 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd413dd7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56527a7c76c0 con 0x56527a8750c0 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86bbc0 0x56527a86bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86bbc0 0x56527a86bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56128/0 (socket says 172.21.15.82:56128) 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40a59c640 1 -- 172.21.15.82:0/3637549090 learned_addr learned my addr 172.21.15.82:0/3637549090 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3637549090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86c4e0 0x56527a874b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd403fff640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd3f80a3780 0x7fd3f80a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3637549090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a8750c0 0x56527a8774b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40a59c640 1 -- 172.21.15.82:0/3637549090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a8750c0 msgr2=0x56527a8774b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3637549090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a8750c0 0x56527a8774b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40a59c640 1 -- 172.21.15.82:0/3637549090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86c4e0 msgr2=0x56527a874b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3637549090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86c4e0 0x56527a874b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40b59e640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd3f80a3780 0x7fd3f80a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40a59c640 1 -- 172.21.15.82:0/3637549090 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56527a4df3f0 con 0x56527a86bbc0 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.202+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3637549090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86c4e0 0x56527a874b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.203+0000 7fd403fff640 1 -- 172.21.15.82:0/924572484 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fd3fc0f1b40 con 0x7fd40c107b80 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.203+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3637549090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86bbc0 0x56527a86bfa0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40135a0 tx=0x7fd3f4009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85eb8ecd402c832b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.203+0000 7fd4017fa640 1 -- 172.21.15.82:0/3637549090 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4004050 con 0x56527a86bbc0 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.203+0000 7fd4017fa640 1 -- 172.21.15.82:0/3637549090 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3f40041f0 con 0x56527a86bbc0 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.203+0000 7fd4017fa640 1 -- 172.21.15.82:0/3637549090 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400f7a0 con 0x56527a86bbc0 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.203+0000 7fd413dd7740 1 -- 172.21.15.82:0/3637549090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86bbc0 msgr2=0x56527a86bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.203+0000 7fd40b59e640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd3f80a3780 0x7fd3f80a5c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0ef4a0 tx=0x7fd3fc08f040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.203+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3637549090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86bbc0 0x56527a86bfa0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40135a0 tx=0x7fd3f4009850 comp rx=0 tx=0).stop 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 -- 172.21.15.82:0/3637549090 shutdown_connections 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3637549090 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a8750c0 0x56527a8774b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3637549090 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86c4e0 0x56527a874b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3637549090 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86bbc0 0x56527a86bfa0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 -- 172.21.15.82:0/3637549090 >> 172.21.15.82:0/3637549090 conn(0x56527a8662f0 msgr2=0x56527a8666d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 -- 172.21.15.82:0/3637549090 shutdown_connections 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 -- 172.21.15.82:0/3637549090 wait complete. 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 -- start start 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 Processor -- start 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86bbc0 0x56527a872060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a8725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 0x56527a872ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56527a877e50 con 0x56527a86c4e0 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56527a786eb0 con 0x56527a8750c0 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56527a877fd0 con 0x56527a86bbc0 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd413dd7740 10 client.0 _ll_register_callbacks cb 0x56527a7c36a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:21.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd40ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a8725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd40ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a8725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56130/0 (socket says 172.21.15.82:56130) 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd40ad9d640 1 -- 172.21.15.82:0/3947163796 learned_addr learned my addr 172.21.15.82:0/3947163796 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.204+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86bbc0 0x56527a872060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 0x56527a872ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd40ad9d640 1 -- 172.21.15.82:0/3947163796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86bbc0 msgr2=0x56527a872060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86bbc0 0x56527a872060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd40ad9d640 1 -- 172.21.15.82:0/3947163796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 msgr2=0x56527a872ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 0x56527a872ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd40ad9d640 1 -- 172.21.15.82:0/3947163796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56527a5a97d0 con 0x56527a86c4e0 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a8725a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd4040126e0 tx=0x7fd404012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee7e02db6bfcfa8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd3f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3947163796 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4040120d0 con 0x56527a86c4e0 2024-03-27T07:26:21.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3947163796 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fd40400f920 con 0x56527a86c4e0 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd413dd7740 1 -- 172.21.15.82:0/3947163796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3f40041f0 con 0x56527a86c4e0 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3947163796 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd404012270 con 0x56527a86c4e0 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd413dd7740 10 client.16221 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd413dd7740 1 -- 172.21.15.82:0/3947163796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56527a884110 con 0x56527a86c4e0 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3947163796 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3f40041f0 con 0x56527a86c4e0 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3947163796 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd40401c420 con 0x56527a86c4e0 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd413dd7740 10 client.16221 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd413dd7740 10 client.16221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd413dd7740 20 client.16221 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.205+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56527a8856c0 0x56527a887b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.206+0000 7fd413dd7740 4 client.16221 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.206+0000 7fd413dd7740 1 -- 172.21.15.82:0/3947163796 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56527a7d8c50 con 0x56527a8856c0 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.206+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56527a8856c0 0x56527a887b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.206+0000 7fd3f27fc640 10 client.16221 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:21.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.206+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56527a8856c0 0x56527a887b00 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41c0daa7b1a434f6 server_cookie=68591dce4404bad3 in_seq=0 out_seq=0 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3947163796 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56527a7d8c50 con 0x56527a8856c0 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd3f27fc640 10 client.16221 handle_command_reply: tid=0 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 client.16221 shutdown 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 -- 172.21.15.82:0/3947163796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 msgr2=0x56527a8725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a8725a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd4040126e0 tx=0x7fd404012ba0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 -- 172.21.15.82:0/3947163796 shutdown_connections 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56527a8856c0 0x56527a887b00 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a8725a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 0x56527a872ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3947163796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86bbc0 0x56527a872060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd3f27fc640 0 client.16221 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 -- 172.21.15.82:0/3947163796 >> 172.21.15.82:0/3947163796 conn(0x56527a8662f0 msgr2=0x56527a861000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 -- 172.21.15.82:0/3947163796 shutdown_connections 2024-03-27T07:26:21.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 1 -- 172.21.15.82:0/3947163796 wait complete. 2024-03-27T07:26:21.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.207+0000 7fd413dd7740 20 client.16221 trim_cache size 0 max 16384 2024-03-27T07:26:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.220+0000 7fd413dd7740 1 Processor -- start 2024-03-27T07:26:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.220+0000 7fd413dd7740 1 -- start start 2024-03-27T07:26:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86bbc0 0x56527a880c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a872900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 0x56527a860e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd413dd7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1adec0 con 0x56527a86c4e0 2024-03-27T07:26:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd413dd7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1ab730 con 0x56527a8750c0 2024-03-27T07:26:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd413dd7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1a95a0 con 0x56527a86bbc0 2024-03-27T07:26:21.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a872900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a872900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56136/0 (socket says 172.21.15.82:56136) 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40ad9d640 1 -- 172.21.15.82:0/3363677608 learned_addr learned my addr 172.21.15.82:0/3363677608 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3363677608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86bbc0 0x56527a880c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3363677608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 0x56527a860e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40ad9d640 1 -- 172.21.15.82:0/3363677608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86bbc0 msgr2=0x56527a880c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3363677608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86bbc0 0x56527a880c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40ad9d640 1 -- 172.21.15.82:0/3363677608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 msgr2=0x56527a860e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3363677608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 0x56527a860e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40ad9d640 1 -- 172.21.15.82:0/3363677608 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56527a866120 con 0x56527a86c4e0 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3363677608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 0x56527a860e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3363677608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a872900 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd40401c910 tx=0x7fd40400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a8ddac04407214 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd400ff9640 1 -- 172.21.15.82:0/3363677608 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd404029030 con 0x56527a86c4e0 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd400ff9640 1 -- 172.21.15.82:0/3363677608 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd40400fe00 con 0x56527a86c4e0 2024-03-27T07:26:21.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.221+0000 7fd400ff9640 1 -- 172.21.15.82:0/3363677608 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd404005090 con 0x56527a86c4e0 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 -- 172.21.15.82:0/3363677608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 msgr2=0x56527a872900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3363677608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a872900 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd40401c910 tx=0x7fd40400f790 comp rx=0 tx=0).stop 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 -- 172.21.15.82:0/3363677608 shutdown_connections 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3363677608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a86c4e0 0x56527a872900 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3363677608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a8750c0 0x56527a860e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3363677608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86bbc0 0x56527a880c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 -- 172.21.15.82:0/3363677608 >> 172.21.15.82:0/3363677608 conn(0x56527a8662f0 msgr2=0x56527a860770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 -- 172.21.15.82:0/3363677608 shutdown_connections 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 -- 172.21.15.82:0/3363677608 wait complete. 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 -- start start 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.222+0000 7fd413dd7740 1 Processor -- start 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86bbc0 0x56527a87d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86c4e0 0x56527a878990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd413dd7740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a8750c0 0x56527a878fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd413dd7740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1a9bf0 con 0x56527a8750c0 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd413dd7740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1ab060 con 0x56527a86bbc0 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd413dd7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c1aa2c0 con 0x56527a86c4e0 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd413dd7740 10 client.0 _ll_register_callbacks cb 0x7fd404009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a8750c0 0x56527a878fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a8750c0 0x56527a878fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56152/0 (socket says 172.21.15.82:56152) 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40a59c640 1 -- 172.21.15.82:0/3047233875 learned_addr learned my addr 172.21.15.82:0/3047233875 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86c4e0 0x56527a878990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86bbc0 0x56527a87d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40a59c640 1 -- 172.21.15.82:0/3047233875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86c4e0 msgr2=0x56527a878990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86c4e0 0x56527a878990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40a59c640 1 -- 172.21.15.82:0/3047233875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86bbc0 msgr2=0x56527a87d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:21.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86bbc0 0x56527a87d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40a59c640 1 -- 172.21.15.82:0/3047233875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56527a8797a0 con 0x56527a8750c0 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd40a59c640 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a8750c0 0x56527a878fa0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4013ef0 tx=0x7fd404009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af17fc9f63376566 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd3f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3047233875 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4005210 con 0x56527a8750c0 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3047233875 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fd3f40053b0 con 0x56527a8750c0 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd413dd7740 1 -- 172.21.15.82:0/3047233875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd40400fe00 con 0x56527a8750c0 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3047233875 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd3f40055b0 con 0x56527a8750c0 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd413dd7740 10 client.16227 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.223+0000 7fd413dd7740 1 -- 172.21.15.82:0/3047233875 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56527a8ebb00 con 0x56527a8750c0 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3047233875 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd40400fe00 con 0x56527a8750c0 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3047233875 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd3f401e070 con 0x56527a8750c0 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd413dd7740 10 client.16227 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd413dd7740 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:21.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd413dd7740 20 client.16227 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56527a8ec0f0 0x56527a8ee510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd413dd7740 4 client.16227 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd413dd7740 1 -- 172.21.15.82:0/3047233875 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56527a7d2fa0 con 0x56527a8ec0f0 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56527a8ec0f0 0x56527a8ee510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd3f27fc640 10 client.16227 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd40ad9d640 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56527a8ec0f0 0x56527a8ee510 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24a8abeae8bb5a2f server_cookie=e2766e6390bc8db1 in_seq=0 out_seq=0 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd3f27fc640 1 -- 172.21.15.82:0/3047233875 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56527a7d2fa0 con 0x56527a8ec0f0 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd3f27fc640 10 client.16227 handle_command_reply: tid=0 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.224+0000 7fd413dd7740 1 client.16227 shutdown 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 1 -- 172.21.15.82:0/3047233875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a8750c0 msgr2=0x56527a878fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a8750c0 0x56527a878fa0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4013ef0 tx=0x7fd404009e10 comp rx=0 tx=0).stop 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 1 -- 172.21.15.82:0/3047233875 shutdown_connections 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56527a8ec0f0 0x56527a8ee510 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56527a8750c0 0x56527a878fa0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd3f27fc640 0 client.16227 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56527a86c4e0 0x56527a878990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 1 --2- 172.21.15.82:0/3047233875 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56527a86bbc0 0x56527a87d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 1 -- 172.21.15.82:0/3047233875 >> 172.21.15.82:0/3047233875 conn(0x56527a8662f0 msgr2=0x56527a867640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 1 -- 172.21.15.82:0/3047233875 shutdown_connections 2024-03-27T07:26:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 1 -- 172.21.15.82:0/3047233875 wait complete. 2024-03-27T07:26:21.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd413dd7740 20 client.16227 trim_cache size 0 max 16384 2024-03-27T07:26:21.234 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:26:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 -- 172.21.15.82:0/924572484 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd3f80a3780 msgr2=0x7fd3f80a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd3f80a3780 0x7fd3f80a5c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0ef4a0 tx=0x7fd3fc08f040 comp rx=0 tx=0).stop 2024-03-27T07:26:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 -- 172.21.15.82:0/924572484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40c107b80 msgr2=0x7fd40c19ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40c107b80 0x7fd40c19ccc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc0348f0 tx=0x7fd3fc032c90 comp rx=0 tx=0).stop 2024-03-27T07:26:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 -- 172.21.15.82:0/924572484 shutdown_connections 2024-03-27T07:26:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd3f80a3780 0x7fd3f80a5c40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd40c107b80 0x7fd40c19ccc0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd40c1024a0 0x7fd40c198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 --2- 172.21.15.82:0/924572484 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd40c101ae0 0x7fd40c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:21.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 -- 172.21.15.82:0/924572484 >> 172.21.15.82:0/924572484 conn(0x7fd40c078f50 msgr2=0x7fd40c1045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:21.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 -- 172.21.15.82:0/924572484 shutdown_connections 2024-03-27T07:26:21.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:21.225+0000 7fd411119640 1 -- 172.21.15.82:0/924572484 wait complete. 2024-03-27T07:26:21.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:21 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3740048006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:26:21.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:21 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3740048006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:26:21.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:21 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3740048006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:26:22.238 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T07:26:22.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:26:22.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T07:26:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.350+0000 7f9795255640 1 -- 172.21.15.82:0/3434636582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9790068d30 msgr2=0x7f9790069110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.350+0000 7f9795255640 1 --2- 172.21.15.82:0/3434636582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9790068d30 0x7f9790069110 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9780009900 tx=0x7f978002bc30 comp rx=0 tx=0).stop 2024-03-27T07:26:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.351+0000 7f9795255640 1 -- 172.21.15.82:0/3434636582 shutdown_connections 2024-03-27T07:26:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.351+0000 7f9795255640 1 --2- 172.21.15.82:0/3434636582 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f979010e4f0 0x7f97901108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.351+0000 7f9795255640 1 --2- 172.21.15.82:0/3434636582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790069650 0x7f979010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.351+0000 7f9795255640 1 --2- 172.21.15.82:0/3434636582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9790068d30 0x7f9790069110 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.351+0000 7f9795255640 1 -- 172.21.15.82:0/3434636582 >> 172.21.15.82:0/3434636582 conn(0x7f9790077b50 msgr2=0x7f9790077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.351+0000 7f9795255640 1 -- 172.21.15.82:0/3434636582 shutdown_connections 2024-03-27T07:26:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.351+0000 7f9795255640 1 -- 172.21.15.82:0/3434636582 wait complete. 2024-03-27T07:26:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.351+0000 7f9795255640 1 Processor -- start 2024-03-27T07:26:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.351+0000 7f9795255640 1 -- start start 2024-03-27T07:26:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9795255640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9790068d30 0x7f979019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9795255640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790069650 0x7f979019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9795255640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979010e4f0 0x7f979019eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9795255640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9790114090 con 0x7f979010e4f0 2024-03-27T07:26:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9795255640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9790113f10 con 0x7f9790068d30 2024-03-27T07:26:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9795255640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9790114210 con 0x7f9790069650 2024-03-27T07:26:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979010e4f0 0x7f979019eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790069650 0x7f979019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978ed9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9790068d30 0x7f979019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979010e4f0 0x7f979019eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56164/0 (socket says 172.21.15.82:56164) 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790069650 0x7f979019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37536/0 (socket says 172.21.15.82:37536) 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978f59e640 1 -- 172.21.15.82:0/1962174210 learned_addr learned my addr 172.21.15.82:0/1962174210 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978f59e640 1 -- 172.21.15.82:0/1962174210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790069650 msgr2=0x7f979019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978f59e640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790069650 0x7f979019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978f59e640 1 -- 172.21.15.82:0/1962174210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9790068d30 msgr2=0x7f979019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978f59e640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9790068d30 0x7f979019a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978f59e640 1 -- 172.21.15.82:0/1962174210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979019f600 con 0x7f979010e4f0 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f978f59e640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979010e4f0 0x7f979019eed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f978800eb40 tx=0x7f978800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9777fff640 1 -- 172.21.15.82:0/1962174210 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788004b20 con 0x7f979010e4f0 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9795255640 1 -- 172.21.15.82:0/1962174210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f979019f8f0 con 0x7f979010e4f0 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9777fff640 1 -- 172.21.15.82:0/1962174210 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9788004cc0 con 0x7f979010e4f0 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9777fff640 1 -- 172.21.15.82:0/1962174210 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788010850 con 0x7f979010e4f0 2024-03-27T07:26:22.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.352+0000 7f9795255640 1 -- 172.21.15.82:0/1962174210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97901a7180 con 0x7f979010e4f0 2024-03-27T07:26:22.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f9777fff640 1 -- 172.21.15.82:0/1962174210 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f9788005020 con 0x7f979010e4f0 2024-03-27T07:26:22.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f9797e43740 1 Processor -- start 2024-03-27T07:26:22.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f9797e43740 1 -- start start 2024-03-27T07:26:22.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f9797e43740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6329e50 0x55f4f632a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f9797e43740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 0x55f4f6332e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f9797e43740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f6335740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f9797e43740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f4f6234c20 con 0x55f4f6333350 2024-03-27T07:26:22.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f9797e43740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f4f628d430 con 0x55f4f6329e50 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f9777fff640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f97780a3780 0x7f97780a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f9797e43740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f4f6235900 con 0x55f4f632a770 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f978e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f6335740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f978ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 0x55f4f6332e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f978e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f6335740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56180/0 (socket says 172.21.15.82:56180) 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f978ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 0x55f4f6332e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37552/0 (socket says 172.21.15.82:37552) 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.355+0000 7f978e59c640 1 -- 172.21.15.82:0/2170382167 learned_addr learned my addr 172.21.15.82:0/2170382167 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f978f59e640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f97780a3780 0x7f97780a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f978e59c640 1 --2- 172.21.15.82:0/2170382167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6329e50 0x55f4f632a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f9777fff640 1 -- 172.21.15.82:0/1962174210 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f97880d0810 con 0x7f979010e4f0 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f978e59c640 1 -- 172.21.15.82:0/2170382167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 msgr2=0x55f4f6332e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f978e59c640 1 --2- 172.21.15.82:0/2170382167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 0x55f4f6332e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f978e59c640 1 -- 172.21.15.82:0/2170382167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6329e50 msgr2=0x55f4f632a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f978e59c640 1 --2- 172.21.15.82:0/2170382167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6329e50 0x55f4f632a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f978e59c640 1 -- 172.21.15.82:0/2170382167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f6288180 con 0x55f4f6333350 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f978ed9d640 1 --2- 172.21.15.82:0/2170382167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 0x55f4f6332e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f978e59c640 1 --2- 172.21.15.82:0/2170382167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f6335740 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f978400b6c0 tx=0x7f978400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d2d01e7b721714 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f978f59e640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f97780a3780 0x7f97780a5c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f97880ce060 tx=0x7f9788091e80 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f97757fa640 1 -- 172.21.15.82:0/2170382167 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784012d00 con 0x55f4f6333350 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f97757fa640 1 -- 172.21.15.82:0/2170382167 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9784010770 con 0x55f4f6333350 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.356+0000 7f97757fa640 1 -- 172.21.15.82:0/2170382167 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97840037f0 con 0x55f4f6333350 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 -- 172.21.15.82:0/2170382167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 msgr2=0x55f4f6335740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 --2- 172.21.15.82:0/2170382167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f6335740 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f978400b6c0 tx=0x7f978400b650 comp rx=0 tx=0).stop 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 -- 172.21.15.82:0/2170382167 shutdown_connections 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 --2- 172.21.15.82:0/2170382167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f6335740 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 --2- 172.21.15.82:0/2170382167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 0x55f4f6332e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 --2- 172.21.15.82:0/2170382167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6329e50 0x55f4f632a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 -- 172.21.15.82:0/2170382167 >> 172.21.15.82:0/2170382167 conn(0x55f4f6324580 msgr2=0x55f4f6324960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 -- 172.21.15.82:0/2170382167 shutdown_connections 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 -- 172.21.15.82:0/2170382167 wait complete. 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 -- start start 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 Processor -- start 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f6329e50 0x55f4f6332d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.357+0000 7f9797e43740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f632a770 0x55f4f63300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9797e43740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f63306b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9797e43740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f4f6248cc0 con 0x55f4f6333350 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9797e43740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f4f62893e0 con 0x55f4f632a770 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9797e43740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f4f6336140 con 0x55f4f6329e50 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9797e43740 10 client.0 _ll_register_callbacks cb 0x55f4f6283f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f63306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978ed9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f632a770 0x55f4f63300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f63306b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56188/0 (socket says 172.21.15.82:56188) 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978e59c640 1 -- 172.21.15.82:0/152855242 learned_addr learned my addr 172.21.15.82:0/152855242 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978e59c640 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f6329e50 0x55f4f6332d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978e59c640 1 -- 172.21.15.82:0/152855242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f6329e50 msgr2=0x55f4f6332d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978e59c640 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f6329e50 0x55f4f6332d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978e59c640 1 -- 172.21.15.82:0/152855242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f632a770 msgr2=0x55f4f63300a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978e59c640 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f632a770 0x55f4f63300a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978e59c640 1 -- 172.21.15.82:0/152855242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4f624fef0 con 0x55f4f6333350 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978ed9d640 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f632a770 0x55f4f63300a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f978e59c640 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f63306b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f978400be00 tx=0x7f9784014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca34cd9a787cde10 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9772ff5640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9772ff5640 1 -- 172.21.15.82:0/152855242 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784010b30 con 0x55f4f6333350 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9772ff5640 1 -- 172.21.15.82:0/152855242 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f978401f470 con 0x55f4f6333350 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9797e43740 1 -- 172.21.15.82:0/152855242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9784010770 con 0x55f4f6333350 2024-03-27T07:26:22.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9772ff5640 1 -- 172.21.15.82:0/152855242 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9784034050 con 0x55f4f6333350 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9797e43740 10 client.16239 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.358+0000 7f9797e43740 1 -- 172.21.15.82:0/152855242 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f4f60697e0 con 0x55f4f6333350 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f9772ff5640 1 -- 172.21.15.82:0/152855242 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9784010770 con 0x55f4f6333350 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f9772ff5640 1 -- 172.21.15.82:0/152855242 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f978401d370 con 0x55f4f6333350 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f9797e43740 10 client.16239 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f9797e43740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f9797e43740 20 client.16239 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f9797e43740 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f4f6343140 0x55f4f6345530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f9797e43740 4 client.16239 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f9797e43740 1 -- 172.21.15.82:0/152855242 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4f629a970 con 0x55f4f6343140 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f978ed9d640 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f4f6343140 0x55f4f6345530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f978ed9d640 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f4f6343140 0x55f4f6345530 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6199636bb475f79 server_cookie=beecf1ea7054b9 in_seq=0 out_seq=0 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.359+0000 7f9772ff5640 10 client.16239 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:22.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.360+0000 7f9772ff5640 1 -- 172.21.15.82:0/152855242 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f4f629a970 con 0x55f4f6343140 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.360+0000 7f9772ff5640 10 client.16239 handle_command_reply: tid=0 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.360+0000 7f9797e43740 1 client.16239 shutdown 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 1 -- 172.21.15.82:0/152855242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 msgr2=0x55f4f63306b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f63306b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f978400be00 tx=0x7f9784014040 comp rx=0 tx=0).stop 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 1 -- 172.21.15.82:0/152855242 shutdown_connections 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f4f6343140 0x55f4f6345530 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6333350 0x55f4f63306b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f632a770 0x55f4f63300a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 1 --2- 172.21.15.82:0/152855242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f6329e50 0x55f4f6332d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 1 -- 172.21.15.82:0/152855242 >> 172.21.15.82:0/152855242 conn(0x55f4f6324580 msgr2=0x55f4f63262d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9772ff5640 0 client.16239 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 1 -- 172.21.15.82:0/152855242 shutdown_connections 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 1 -- 172.21.15.82:0/152855242 wait complete. 2024-03-27T07:26:22.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.361+0000 7f9797e43740 20 client.16239 trim_cache size 0 max 16384 2024-03-27T07:26:22.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f9797e43740 1 Processor -- start 2024-03-27T07:26:22.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f9797e43740 1 -- start start 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f9797e43740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f6329e50 0x55f4f633ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f9797e43740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f632a770 0x55f4f632ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f9797e43740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6333350 0x55f4f634acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f9797e43740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97901b2290 con 0x55f4f632a770 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f9797e43740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f97901afb00 con 0x55f4f6333350 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f9797e43740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97901ad950 con 0x55f4f6329e50 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f978ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f632a770 0x55f4f632ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f978ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f632a770 0x55f4f632ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56194/0 (socket says 172.21.15.82:56194) 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f978ed9d640 1 -- 172.21.15.82:0/1867020418 learned_addr learned my addr 172.21.15.82:0/1867020418 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f978e59c640 1 --2- 172.21.15.82:0/1867020418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f6329e50 0x55f4f633ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.379+0000 7f978e59c640 1 --2- 172.21.15.82:0/1867020418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6333350 0x55f4f634acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.380+0000 7f978ed9d640 1 -- 172.21.15.82:0/1867020418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f6329e50 msgr2=0x55f4f633ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.380+0000 7f978ed9d640 1 --2- 172.21.15.82:0/1867020418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f6329e50 0x55f4f633ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.380+0000 7f978ed9d640 1 -- 172.21.15.82:0/1867020418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6333350 msgr2=0x55f4f634acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.380+0000 7f978ed9d640 1 --2- 172.21.15.82:0/1867020418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6333350 0x55f4f634acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.380+0000 7f978ed9d640 1 -- 172.21.15.82:0/1867020418 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4f60c9f70 con 0x55f4f632a770 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.380+0000 7f978ed9d640 1 --2- 172.21.15.82:0/1867020418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f632a770 0x55f4f632ef50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9780009900 tx=0x7f9780005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05444e697a1a6c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.380+0000 7f9774ff9640 1 -- 172.21.15.82:0/1867020418 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978004c070 con 0x55f4f632a770 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.380+0000 7f9774ff9640 1 -- 172.21.15.82:0/1867020418 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9780048b80 con 0x55f4f632a770 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.380+0000 7f9774ff9640 1 -- 172.21.15.82:0/1867020418 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780004920 con 0x55f4f632a770 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 -- 172.21.15.82:0/1867020418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f632a770 msgr2=0x55f4f632ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 --2- 172.21.15.82:0/1867020418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f632a770 0x55f4f632ef50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9780009900 tx=0x7f9780005dd0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 -- 172.21.15.82:0/1867020418 shutdown_connections 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 --2- 172.21.15.82:0/1867020418 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f632a770 0x55f4f632ef50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 --2- 172.21.15.82:0/1867020418 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6333350 0x55f4f634acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 --2- 172.21.15.82:0/1867020418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f6329e50 0x55f4f633ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 -- 172.21.15.82:0/1867020418 >> 172.21.15.82:0/1867020418 conn(0x55f4f6324580 msgr2=0x55f4f632e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 -- 172.21.15.82:0/1867020418 shutdown_connections 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 -- 172.21.15.82:0/1867020418 wait complete. 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 -- start start 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 Processor -- start 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6329e50 0x55f4f633b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 0x55f4f632c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6333350 0x55f4f632c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97901adfc0 con 0x55f4f6329e50 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f97901af430 con 0x55f4f6333350 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f97901ae690 con 0x55f4f632a770 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f9797e43740 10 client.0 _ll_register_callbacks cb 0x7f978400bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f978e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6329e50 0x55f4f633b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f978e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6329e50 0x55f4f633b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56196/0 (socket says 172.21.15.82:56196) 2024-03-27T07:26:22.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f978e59c640 1 -- 172.21.15.82:0/4244254413 learned_addr learned my addr 172.21.15.82:0/4244254413 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.381+0000 7f978ed9d640 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 0x55f4f632c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f978e59c640 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6333350 0x55f4f632c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f978e59c640 1 -- 172.21.15.82:0/4244254413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 msgr2=0x55f4f632c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f978e59c640 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 0x55f4f632c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f978e59c640 1 -- 172.21.15.82:0/4244254413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6333350 msgr2=0x55f4f632c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f978e59c640 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6333350 0x55f4f632c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f978e59c640 1 -- 172.21.15.82:0/4244254413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4f5f61170 con 0x55f4f6329e50 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f978e59c640 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6329e50 0x55f4f633b3c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f978401d8e0 tx=0x7f9784014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e503246bce8f469e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f9772ff5640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f9772ff5640 1 -- 172.21.15.82:0/4244254413 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784010740 con 0x55f4f6329e50 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f9772ff5640 1 -- 172.21.15.82:0/4244254413 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f978400b410 con 0x55f4f6329e50 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f9797e43740 1 -- 172.21.15.82:0/4244254413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9780048b80 con 0x55f4f6329e50 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f9772ff5640 1 -- 172.21.15.82:0/4244254413 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f978401d370 con 0x55f4f6329e50 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f9797e43740 10 client.16245 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:22.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f9797e43740 1 -- 172.21.15.82:0/4244254413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f4f62584e0 con 0x55f4f6329e50 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f9772ff5640 1 -- 172.21.15.82:0/4244254413 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9780048b80 con 0x55f4f6329e50 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f9772ff5640 1 -- 172.21.15.82:0/4244254413 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9784037040 con 0x55f4f6329e50 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.382+0000 7f9797e43740 10 client.16245 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.383+0000 7f9797e43740 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.383+0000 7f9797e43740 20 client.16245 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.383+0000 7f9797e43740 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f4f63a91c0 0x55f4f63ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.383+0000 7f9797e43740 4 client.16245 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.383+0000 7f9797e43740 1 -- 172.21.15.82:0/4244254413 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f4f6294cc0 con 0x55f4f63a91c0 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.383+0000 7f978ed9d640 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f4f63a91c0 0x55f4f63ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.383+0000 7f9772ff5640 10 client.16245 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:22.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.383+0000 7f978ed9d640 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f4f63a91c0 0x55f4f63ab5e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6ae1e2747c66b07 server_cookie=ca97b4c9b160bf0b in_seq=0 out_seq=0 2024-03-27T07:26:22.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9772ff5640 1 -- 172.21.15.82:0/4244254413 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f4f6294cc0 con 0x55f4f63a91c0 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9772ff5640 10 client.16245 handle_command_reply: tid=0 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 client.16245 shutdown 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 -- 172.21.15.82:0/4244254413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6329e50 msgr2=0x55f4f633b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6329e50 0x55f4f633b3c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f978401d8e0 tx=0x7f9784014040 comp rx=0 tx=0).stop 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 -- 172.21.15.82:0/4244254413 shutdown_connections 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f4f6333350 0x55f4f632c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f4f632a770 0x55f4f632c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f4f63a91c0 0x55f4f63ab5e0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 --2- 172.21.15.82:0/4244254413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f4f6329e50 0x55f4f633b3c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9772ff5640 0 client.16245 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 -- 172.21.15.82:0/4244254413 >> 172.21.15.82:0/4244254413 conn(0x55f4f6324580 msgr2=0x55f4f632f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 -- 172.21.15.82:0/4244254413 shutdown_connections 2024-03-27T07:26:22.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 1 -- 172.21.15.82:0/4244254413 wait complete. 2024-03-27T07:26:22.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9797e43740 20 client.16245 trim_cache size 0 max 16384 2024-03-27T07:26:22.393 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:26:22.393 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-03-27T07:26:22.393 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "327a9382-51d3-43db-8b9f-c0d7250e40ac", 2024-03-27T07:26:22.393 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-03-27T07:26:22.393 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:26:22.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9795255640 1 -- 172.21.15.82:0/1962174210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f97780a3780 msgr2=0x7f97780a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9795255640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f97780a3780 0x7f97780a5c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f97880ce060 tx=0x7f9788091e80 comp rx=0 tx=0).stop 2024-03-27T07:26:22.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9795255640 1 -- 172.21.15.82:0/1962174210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979010e4f0 msgr2=0x7f979019eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.387+0000 7f9795255640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979010e4f0 0x7f979019eed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f978800eb40 tx=0x7f978800c2d0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.388+0000 7f9795255640 1 -- 172.21.15.82:0/1962174210 shutdown_connections 2024-03-27T07:26:22.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.388+0000 7f9795255640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f97780a3780 0x7f97780a5c40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.388+0000 7f9795255640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f979010e4f0 0x7f979019eed0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.388+0000 7f9795255640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9790069650 0x7f979019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.388+0000 7f9795255640 1 --2- 172.21.15.82:0/1962174210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9790068d30 0x7f979019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.388+0000 7f9795255640 1 -- 172.21.15.82:0/1962174210 >> 172.21.15.82:0/1962174210 conn(0x7f9790077b50 msgr2=0x7f979010fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.388+0000 7f9795255640 1 -- 172.21.15.82:0/1962174210 shutdown_connections 2024-03-27T07:26:22.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.388+0000 7f9795255640 1 -- 172.21.15.82:0/1962174210 wait complete. 2024-03-27T07:26:22.400 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:22 smithi082 ceph-mon[32178]: pgmap v86: 97 pgs: 97 active+clean; 311 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.9 MiB/s wr, 688 op/s 2024-03-27T07:26:22.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:26:22.401 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:26:22.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:22 smithi149 ceph-mon[36065]: pgmap v86: 97 pgs: 97 active+clean; 311 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.9 MiB/s wr, 688 op/s 2024-03-27T07:26:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.513+0000 7fee21a9a640 1 -- 172.21.15.82:0/2511945441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee1c1009c0 msgr2=0x7fee1c100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.513+0000 7fee21a9a640 1 --2- 172.21.15.82:0/2511945441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee1c1009c0 0x7fee1c100e40 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fee10009930 tx=0x7fee1002bc30 comp rx=0 tx=0).stop 2024-03-27T07:26:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.513+0000 7fee21a9a640 1 -- 172.21.15.82:0/2511945441 shutdown_connections 2024-03-27T07:26:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.513+0000 7fee21a9a640 1 --2- 172.21.15.82:0/2511945441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee1c1009c0 0x7fee1c100e40 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.513+0000 7fee21a9a640 1 --2- 172.21.15.82:0/2511945441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee1c101380 0x7fee1c10d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.513+0000 7fee21a9a640 1 --2- 172.21.15.82:0/2511945441 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee1c1069d0 0x7fee1c106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.513+0000 7fee21a9a640 1 -- 172.21.15.82:0/2511945441 >> 172.21.15.82:0/2511945441 conn(0x7fee1c077b50 msgr2=0x7fee1c077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.513+0000 7fee21a9a640 1 -- 172.21.15.82:0/2511945441 shutdown_connections 2024-03-27T07:26:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.513+0000 7fee21a9a640 1 -- 172.21.15.82:0/2511945441 wait complete. 2024-03-27T07:26:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee21a9a640 1 Processor -- start 2024-03-27T07:26:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee21a9a640 1 -- start start 2024-03-27T07:26:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee21a9a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee1c1009c0 0x7fee1c10e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee21a9a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee1c101380 0x7fee1c10e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee21a9a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee1c1069d0 0x7fee1c10ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee21a9a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c111ef0 con 0x7fee1c1009c0 2024-03-27T07:26:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee21a9a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c111d70 con 0x7fee1c101380 2024-03-27T07:26:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee21a9a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c112070 con 0x7fee1c1069d0 2024-03-27T07:26:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee1c1009c0 0x7fee1c10e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee1c1009c0 0x7fee1c10e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56226/0 (socket says 172.21.15.82:56226) 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee1b7fe640 1 -- 172.21.15.82:0/4281894654 learned_addr learned my addr 172.21.15.82:0/4281894654 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee1affd640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee1c101380 0x7fee1c10e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee1bfff640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee1c1069d0 0x7fee1c10ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee1b7fe640 1 -- 172.21.15.82:0/4281894654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee1c1069d0 msgr2=0x7fee1c10ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee1c1069d0 0x7fee1c10ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee1b7fe640 1 -- 172.21.15.82:0/4281894654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee1c101380 msgr2=0x7fee1c10e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee1c101380 0x7fee1c10e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.514+0000 7fee1b7fe640 1 -- 172.21.15.82:0/4281894654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee1c1a6910 con 0x7fee1c1009c0 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.515+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee1c1009c0 0x7fee1c10e1a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00e9f0 tx=0x7fee0c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.515+0000 7fee18ff9640 1 -- 172.21.15.82:0/4281894654 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c00cd80 con 0x7fee1c1009c0 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.515+0000 7fee18ff9640 1 -- 172.21.15.82:0/4281894654 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee0c010910 con 0x7fee1c1009c0 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.515+0000 7fee18ff9640 1 -- 172.21.15.82:0/4281894654 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c018990 con 0x7fee1c1009c0 2024-03-27T07:26:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.515+0000 7fee21a9a640 1 -- 172.21.15.82:0/4281894654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee1c1a6c00 con 0x7fee1c1009c0 2024-03-27T07:26:22.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.515+0000 7fee21a9a640 1 -- 172.21.15.82:0/4281894654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee1c1a7170 con 0x7fee1c1009c0 2024-03-27T07:26:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.517+0000 7fee18ff9640 1 -- 172.21.15.82:0/4281894654 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fee0c010ac0 con 0x7fee1c1009c0 2024-03-27T07:26:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee24680740 1 Processor -- start 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee24680740 1 -- start start 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee24680740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db16630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee24680740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db1f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee24680740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db1f750 0x55c31db21b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee24680740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c31da7a860 con 0x55c31db16b70 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee24680740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55c31da228d0 con 0x55c31db16250 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee24680740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c31da76810 con 0x55c31db1f750 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee18ff9640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fee040a3800 0x7fee040a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db1f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db1f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56234/0 (socket says 172.21.15.82:56234) 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3319685672 learned_addr learned my addr 172.21.15.82:0/3319685672 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee1affd640 1 --2- 172.21.15.82:0/3319685672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db1f750 0x55c31db21b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee1bfff640 1 --2- 172.21.15.82:0/3319685672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db16630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee1bfff640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fee040a3800 0x7fee040a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee18ff9640 1 -- 172.21.15.82:0/4281894654 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fee0c0d03f0 con 0x7fee1c1009c0 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3319685672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db1f750 msgr2=0x55c31db21b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.518+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/3319685672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db1f750 0x55c31db21b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.519+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3319685672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 msgr2=0x55c31db16630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.519+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/3319685672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db16630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.519+0000 7fee1b7fe640 1 -- 172.21.15.82:0/3319685672 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31da2d120 con 0x55c31db16b70 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.519+0000 7fee1bfff640 1 --2- 172.21.15.82:0/3319685672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db16630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.519+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/3319685672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db1f210 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0cdb90 tx=0x7fee0c024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca596b523fde702 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.519+0000 7fee01ffb640 1 -- 172.21.15.82:0/3319685672 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c09c570 con 0x55c31db16b70 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.519+0000 7fee01ffb640 1 -- 172.21.15.82:0/3319685672 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee0c0a0920 con 0x55c31db16b70 2024-03-27T07:26:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.519+0000 7fee01ffb640 1 -- 172.21.15.82:0/3319685672 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c018b30 con 0x55c31db16b70 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 -- 172.21.15.82:0/3319685672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 msgr2=0x55c31db1f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 --2- 172.21.15.82:0/3319685672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db1f210 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0cdb90 tx=0x7fee0c024000 comp rx=0 tx=0).stop 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee1bfff640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fee040a3800 0x7fee040a5cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fee14005c40 tx=0x7fee14009500 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 -- 172.21.15.82:0/3319685672 shutdown_connections 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 --2- 172.21.15.82:0/3319685672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db1f210 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 --2- 172.21.15.82:0/3319685672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db1f750 0x55c31db21b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 --2- 172.21.15.82:0/3319685672 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db16630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 -- 172.21.15.82:0/3319685672 >> 172.21.15.82:0/3319685672 conn(0x55c31db10980 msgr2=0x55c31db10d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 -- 172.21.15.82:0/3319685672 shutdown_connections 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 -- 172.21.15.82:0/3319685672 wait complete. 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 -- start start 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.520+0000 7fee24680740 1 Processor -- start 2024-03-27T07:26:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee24680740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db16250 0x55c31db1c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee24680740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16b70 0x55c31db1cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee24680740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db1d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee24680740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c31db22540 con 0x55c31db1f750 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee24680740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55c31da35cd0 con 0x55c31db16b70 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee24680740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55c31db226c0 con 0x55c31db16250 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee24680740 10 client.0 _ll_register_callbacks cb 0x55c31da27ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db1d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db16250 0x55c31db1c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db1d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56248/0 (socket says 172.21.15.82:56248) 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1bfff640 1 -- 172.21.15.82:0/3905907388 learned_addr learned my addr 172.21.15.82:0/3905907388 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1affd640 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16b70 0x55c31db1cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1bfff640 1 -- 172.21.15.82:0/3905907388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db16250 msgr2=0x55c31db1c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1bfff640 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db16250 0x55c31db1c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1bfff640 1 -- 172.21.15.82:0/3905907388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16b70 msgr2=0x55c31db1cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1bfff640 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16b70 0x55c31db1cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1bfff640 1 -- 172.21.15.82:0/3905907388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31d8587d0 con 0x55c31db1f750 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fee1bfff640 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db1d150 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fee14004300 tx=0x7fee14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfc060b8df2002e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fedfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.521+0000 7fedfaffd640 1 -- 172.21.15.82:0/3905907388 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14024070 con 0x55c31db1f750 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fedfaffd640 1 -- 172.21.15.82:0/3905907388 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fee14020480 con 0x55c31db1f750 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fee24680740 1 -- 172.21.15.82:0/3905907388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee0c0a0920 con 0x55c31db1f750 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fedfaffd640 1 -- 172.21.15.82:0/3905907388 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fee1402f050 con 0x55c31db1f750 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fee24680740 10 client.16257 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fee24680740 1 -- 172.21.15.82:0/3905907388 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c31d78e3f0 con 0x55c31db1f750 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fedfaffd640 1 -- 172.21.15.82:0/3905907388 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee0c0a0920 con 0x55c31db1f750 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fedfaffd640 1 -- 172.21.15.82:0/3905907388 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fee1401d050 con 0x55c31db1f750 2024-03-27T07:26:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fee24680740 10 client.16257 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fee24680740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fee24680740 20 client.16257 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fee24680740 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c31db2fb30 0x55c31db31f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fee24680740 4 client.16257 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fee24680740 1 -- 172.21.15.82:0/3905907388 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c31da87da0 con 0x55c31db2fb30 2024-03-27T07:26:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.522+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c31db2fb30 0x55c31db31f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.523+0000 7fedfaffd640 10 client.16257 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.523+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c31db2fb30 0x55c31db31f50 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95cd0cc63ad1aa15 server_cookie=74bf36ee18636acb in_seq=0 out_seq=0 2024-03-27T07:26:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fedfaffd640 1 -- 172.21.15.82:0/3905907388 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c31da87da0 con 0x55c31db2fb30 2024-03-27T07:26:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fedfaffd640 10 client.16257 handle_command_reply: tid=0 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 client.16257 shutdown 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 -- 172.21.15.82:0/3905907388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 msgr2=0x55c31db1d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db1d150 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fee14004300 tx=0x7fee14004a40 comp rx=0 tx=0).stop 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 -- 172.21.15.82:0/3905907388 shutdown_connections 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c31db2fb30 0x55c31db31f50 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db1d150 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16b70 0x55c31db1cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fedfaffd640 0 client.16257 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 --2- 172.21.15.82:0/3905907388 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db16250 0x55c31db1c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 -- 172.21.15.82:0/3905907388 >> 172.21.15.82:0/3905907388 conn(0x55c31db10980 msgr2=0x55c31db126d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 -- 172.21.15.82:0/3905907388 shutdown_connections 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 1 -- 172.21.15.82:0/3905907388 wait complete. 2024-03-27T07:26:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.526+0000 7fee24680740 20 client.16257 trim_cache size 0 max 16384 2024-03-27T07:26:22.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:22 smithi153 ceph-mon[36179]: pgmap v86: 97 pgs: 97 active+clean; 311 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.9 MiB/s wr, 688 op/s 2024-03-27T07:26:22.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee24680740 1 Processor -- start 2024-03-27T07:26:22.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee24680740 1 -- start start 2024-03-27T07:26:22.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee24680740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db1ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee24680740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db16b70 0x55c31db10d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee24680740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db2b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee24680740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c1b2260 con 0x55c31db1f750 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee24680740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c1afad0 con 0x55c31db16250 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee24680740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c1ad920 con 0x55c31db16b70 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db2b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee1bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db2b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56260/0 (socket says 172.21.15.82:56260) 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee1bfff640 1 -- 172.21.15.82:0/133234437 learned_addr learned my addr 172.21.15.82:0/133234437 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/133234437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db1ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee1affd640 1 --2- 172.21.15.82:0/133234437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db16b70 0x55c31db10d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee1bfff640 1 -- 172.21.15.82:0/133234437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db16b70 msgr2=0x55c31db10d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee1bfff640 1 --2- 172.21.15.82:0/133234437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db16b70 0x55c31db10d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee1bfff640 1 -- 172.21.15.82:0/133234437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 msgr2=0x55c31db1ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee1bfff640 1 --2- 172.21.15.82:0/133234437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db1ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.544+0000 7fee1bfff640 1 -- 172.21.15.82:0/133234437 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31db169a0 con 0x55c31db1f750 2024-03-27T07:26:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.545+0000 7fee1bfff640 1 --2- 172.21.15.82:0/133234437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db2b340 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fee1401f6c0 tx=0x7fee14009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347392564d4b499b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.545+0000 7fee017fa640 1 -- 172.21.15.82:0/133234437 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14024040 con 0x55c31db1f750 2024-03-27T07:26:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.545+0000 7fee017fa640 1 -- 172.21.15.82:0/133234437 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee1401fe10 con 0x55c31db1f750 2024-03-27T07:26:22.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.545+0000 7fee017fa640 1 -- 172.21.15.82:0/133234437 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee14020c40 con 0x55c31db1f750 2024-03-27T07:26:22.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 -- 172.21.15.82:0/133234437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 msgr2=0x55c31db2b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 --2- 172.21.15.82:0/133234437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db2b340 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fee1401f6c0 tx=0x7fee14009bf0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 -- 172.21.15.82:0/133234437 shutdown_connections 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 --2- 172.21.15.82:0/133234437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db1f750 0x55c31db2b340 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 --2- 172.21.15.82:0/133234437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db16b70 0x55c31db10d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 --2- 172.21.15.82:0/133234437 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db1ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 -- 172.21.15.82:0/133234437 >> 172.21.15.82:0/133234437 conn(0x55c31db10980 msgr2=0x55c31db0f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 -- 172.21.15.82:0/133234437 shutdown_connections 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 -- 172.21.15.82:0/133234437 wait complete. 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 -- start start 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 Processor -- start 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.546+0000 7fee24680740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db231a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee24680740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db236e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee24680740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db1f750 0x55c31db23c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee24680740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c1adf90 con 0x55c31db16b70 2024-03-27T07:26:22.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee24680740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c1af400 con 0x55c31db16250 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee24680740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fee1c1ae660 con 0x55c31db1f750 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee24680740 10 client.0 _ll_register_callbacks cb 0x7fee14003970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56268/0 (socket says 172.21.15.82:56268) 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1affd640 1 -- 172.21.15.82:0/2449861458 learned_addr learned my addr 172.21.15.82:0/2449861458 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1bfff640 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db1f750 0x55c31db23c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1affd640 1 -- 172.21.15.82:0/2449861458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db1f750 msgr2=0x55c31db23c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1affd640 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db1f750 0x55c31db23c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1affd640 1 -- 172.21.15.82:0/2449861458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 msgr2=0x55c31db231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1affd640 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1affd640 1 -- 172.21.15.82:0/2449861458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31d74e0f0 con 0x55c31db16b70 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee1affd640 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db236e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fee10009930 tx=0x7fee1002ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee5734a1855440a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:22.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fedfaffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fedfaffd640 1 -- 172.21.15.82:0/2449861458 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee10005030 con 0x55c31db16b70 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fedfaffd640 1 -- 172.21.15.82:0/2449861458 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fee100051d0 con 0x55c31db16b70 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fee24680740 1 -- 172.21.15.82:0/2449861458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee1401fe10 con 0x55c31db16b70 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.547+0000 7fedfaffd640 1 -- 172.21.15.82:0/2449861458 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fee100053d0 con 0x55c31db16b70 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fee24680740 10 client.16263 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fee24680740 1 -- 172.21.15.82:0/2449861458 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c31db95f20 con 0x55c31db16b70 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fedfaffd640 1 -- 172.21.15.82:0/2449861458 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee1401fe10 con 0x55c31db16b70 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fedfaffd640 1 -- 172.21.15.82:0/2449861458 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fee100037b0 con 0x55c31db16b70 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fee24680740 10 client.16263 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fee24680740 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fee24680740 20 client.16263 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fee24680740 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c31db96730 0x55c31db98b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:22.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fee24680740 4 client.16263 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fee24680740 1 -- 172.21.15.82:0/2449861458 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c31da820f0 con 0x55c31db96730 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.548+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c31db96730 0x55c31db98b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fedfaffd640 10 client.16263 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee1b7fe640 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c31db96730 0x55c31db98b50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f83ce0ace89f4a1 server_cookie=dd9b3f5d80509d54 in_seq=0 out_seq=0 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fedfaffd640 1 -- 172.21.15.82:0/2449861458 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c31da820f0 con 0x55c31db96730 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fedfaffd640 10 client.16263 handle_command_reply: tid=0 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 client.16263 shutdown 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 -- 172.21.15.82:0/2449861458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 msgr2=0x55c31db236e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db236e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fee10009930 tx=0x7fee1002ce30 comp rx=0 tx=0).stop 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 -- 172.21.15.82:0/2449861458 shutdown_connections 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55c31db96730 0x55c31db98b50 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c31db16b70 0x55c31db236e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fedfaffd640 0 client.16263 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:22.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55c31db1f750 0x55c31db23c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 --2- 172.21.15.82:0/2449861458 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55c31db16250 0x55c31db231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 -- 172.21.15.82:0/2449861458 >> 172.21.15.82:0/2449861458 conn(0x55c31db10980 msgr2=0x55c31db1cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 -- 172.21.15.82:0/2449861458 shutdown_connections 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 1 -- 172.21.15.82:0/2449861458 wait complete. 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.549+0000 7fee24680740 20 client.16263 trim_cache size 0 max 16384 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "327a9382-51d3-43db-8b9f-c0d7250e40ac": { 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-03-27T07:26:22.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "327a9382-51d3-43db-8b9f-c0d7250e40ac", 2024-03-27T07:26:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-03-27T07:26:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:26:22.559 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:26:22.559 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 -- 172.21.15.82:0/4281894654 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fee040a3800 msgr2=0x7fee040a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fee040a3800 0x7fee040a5cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fee14005c40 tx=0x7fee14009500 comp rx=0 tx=0).stop 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 -- 172.21.15.82:0/4281894654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee1c1009c0 msgr2=0x7fee1c10e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee1c1009c0 0x7fee1c10e1a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00e9f0 tx=0x7fee0c00eeb0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 -- 172.21.15.82:0/4281894654 shutdown_connections 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fee040a3800 0x7fee040a5cc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee1c1069d0 0x7fee1c10ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fee1c101380 0x7fee1c10e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 --2- 172.21.15.82:0/4281894654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee1c1009c0 0x7fee1c10e1a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 -- 172.21.15.82:0/4281894654 >> 172.21.15.82:0/4281894654 conn(0x7fee1c077b50 msgr2=0x7fee1c103210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 -- 172.21.15.82:0/4281894654 shutdown_connections 2024-03-27T07:26:22.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:22.550+0000 7fee21a9a640 1 -- 172.21.15.82:0/4281894654 wait complete. 2024-03-27T07:26:22.563 INFO:tasks.cephfs.filesystem:scrub status for tag:327a9382-51d3-43db-8b9f-c0d7250e40ac - {'path': '/', 'tag': '327a9382-51d3-43db-8b9f-c0d7250e40ac', 'options': 'recursive,force'} 2024-03-27T07:26:23.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:23 smithi082 ceph-mon[32178]: scrub queued for path: / 2024-03-27T07:26:23.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:23 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:23.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:23 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:23.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:23 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:23.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:23 smithi149 ceph-mon[36065]: scrub queued for path: / 2024-03-27T07:26:23.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:23 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:23.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:23 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:23.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:23 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:23 smithi153 ceph-mon[36179]: scrub queued for path: / 2024-03-27T07:26:23.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:23 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:23.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:23 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:23.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:23 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:24.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:24.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:24.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:24.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: pgmap v87: 97 pgs: 97 active+clean; 311 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.0 MiB/s wr, 463 op/s 2024-03-27T07:26:24.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:24.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:24.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:24.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:24 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: pgmap v87: 97 pgs: 97 active+clean; 311 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.0 MiB/s wr, 463 op/s 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:24.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:24 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: pgmap v87: 97 pgs: 97 active+clean; 311 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.0 MiB/s wr, 463 op/s 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:24 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:25.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:25 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:25.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:25 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:25.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:25 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:25.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:25 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:25.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:25 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:25.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:25 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:25.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:25 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:25.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:25 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:25.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:25 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:25.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:25 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:25.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:25 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:25.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:25 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: pgmap v88: 97 pgs: 97 active+clean; 311 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.0 MiB/s wr, 463 op/s 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:26 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:26.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: pgmap v88: 97 pgs: 97 active+clean; 311 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.0 MiB/s wr, 463 op/s 2024-03-27T07:26:26.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:26 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:26.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: pgmap v88: 97 pgs: 97 active+clean; 311 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 8.0 MiB/s wr, 463 op/s 2024-03-27T07:26:26.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:26.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:26.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:26 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.157 INFO:tasks.workunit.client.0.smithi082.stdout: 88 228614 611 173496 713 82765 387 2024-03-27T07:26:27.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.452 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.456 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.458 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.459 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.461 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.462 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.463 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.465 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.466 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.467 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.468 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.469 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:27.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.478+0000 7fb27f9bf640 1 -- 172.21.15.82:0/763402519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb278108b50 msgr2=0x7fb278109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:27.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.479+0000 7fb27f9bf640 1 --2- 172.21.15.82:0/763402519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb278108b50 0x7fb278109650 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb274009900 tx=0x7fb27402bc60 comp rx=0 tx=0).stop 2024-03-27T07:26:27.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.479+0000 7fb27f9bf640 1 -- 172.21.15.82:0/763402519 shutdown_connections 2024-03-27T07:26:27.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.479+0000 7fb27f9bf640 1 --2- 172.21.15.82:0/763402519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb278108fc0 0x7fb278109b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.479+0000 7fb27f9bf640 1 --2- 172.21.15.82:0/763402519 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb27810d610 0x7fb27810daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.479+0000 7fb27f9bf640 1 --2- 172.21.15.82:0/763402519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb278108b50 0x7fb278109650 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.479+0000 7fb27f9bf640 1 -- 172.21.15.82:0/763402519 >> 172.21.15.82:0/763402519 conn(0x7fb27806cbf0 msgr2=0x7fb27806d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:27.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.479+0000 7fb27f9bf640 1 -- 172.21.15.82:0/763402519 shutdown_connections 2024-03-27T07:26:27.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.479+0000 7fb27f9bf640 1 -- 172.21.15.82:0/763402519 wait complete. 2024-03-27T07:26:27.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.480+0000 7fb27f9bf640 1 Processor -- start 2024-03-27T07:26:27.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.480+0000 7fb27f9bf640 1 -- start start 2024-03-27T07:26:27.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.480+0000 7fb27f9bf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb278108b50 0x7fb278118cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.480+0000 7fb27f9bf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb278108fc0 0x7fb2781191f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27d75b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb278108b50 0x7fb278118cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27d75b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb278108b50 0x7fb278118cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56286/0 (socket says 172.21.15.82:56286) 2024-03-27T07:26:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27f9bf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb27810d610 0x7fb278119730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27cf5a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb278108fc0 0x7fb2781191f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27f9bf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781164f0 con 0x7fb278108b50 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27f9bf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb278116370 con 0x7fb27810d610 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27f9bf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb278116670 con 0x7fb278108fc0 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27cf5a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb278108fc0 0x7fb2781191f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37656/0 (socket says 172.21.15.82:37656) 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27cf5a640 1 -- 172.21.15.82:0/2180955521 learned_addr learned my addr 172.21.15.82:0/2180955521 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27df5c640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb27810d610 0x7fb278119730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27cf5a640 1 -- 172.21.15.82:0/2180955521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb27810d610 msgr2=0x7fb278119730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb27810d610 0x7fb278119730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27cf5a640 1 -- 172.21.15.82:0/2180955521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb278108b50 msgr2=0x7fb278118cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb278108b50 0x7fb278118cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.481+0000 7fb27cf5a640 1 -- 172.21.15.82:0/2180955521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2781b34a0 con 0x7fb278108fc0 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.482+0000 7fb27d75b640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb278108b50 0x7fb278118cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.482+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb278108fc0 0x7fb2781191f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb26800e9f0 tx=0x7fb26800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.482+0000 7fb26e7fc640 1 -- 172.21.15.82:0/2180955521 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26800cd80 con 0x7fb278108fc0 2024-03-27T07:26:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.482+0000 7fb26e7fc640 1 -- 172.21.15.82:0/2180955521 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb268005500 con 0x7fb278108fc0 2024-03-27T07:26:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.482+0000 7fb26e7fc640 1 -- 172.21.15.82:0/2180955521 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268010690 con 0x7fb278108fc0 2024-03-27T07:26:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.482+0000 7fb27f9bf640 1 -- 172.21.15.82:0/2180955521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2781b3790 con 0x7fb278108fc0 2024-03-27T07:26:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.482+0000 7fb27f9bf640 1 -- 172.21.15.82:0/2180955521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2781b3c90 con 0x7fb278108fc0 2024-03-27T07:26:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.485+0000 7fb26e7fc640 1 -- 172.21.15.82:0/2180955521 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fb2680046c0 con 0x7fb278108fc0 2024-03-27T07:26:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.486+0000 7fb26e7fc640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb2640a38a0 0x7fb2640a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.486+0000 7fb26e7fc640 1 -- 172.21.15.82:0/2180955521 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fb2680d0430 con 0x7fb278108fc0 2024-03-27T07:26:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.486+0000 7fb27d75b640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb2640a38a0 0x7fb2640a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.486+0000 7fb27d75b640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb2640a38a0 0x7fb2640a5d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb274000c00 tx=0x7fb27402c7a0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb28259c740 1 Processor -- start 2024-03-27T07:26:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb28259c740 1 -- start start 2024-03-27T07:26:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb28259c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e6530f0 0x56498e6534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb28259c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e653a10 0x56498e65c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb28259c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e65c7e0 0x56498e65ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb28259c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56498e619cd0 con 0x56498e65c7e0 2024-03-27T07:26:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb28259c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56498e55e950 con 0x56498e6530f0 2024-03-27T07:26:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb28259c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56498e5b6e50 con 0x56498e653a10 2024-03-27T07:26:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb27cf5a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e653a10 0x56498e65c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb27d75b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e6530f0 0x56498e6534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb27cf5a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e653a10 0x56498e65c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37662/0 (socket says 172.21.15.82:37662) 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb27cf5a640 1 -- 172.21.15.82:0/4089946015 learned_addr learned my addr 172.21.15.82:0/4089946015 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb27df5c640 1 --2- 172.21.15.82:0/4089946015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e65c7e0 0x56498e65ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb27cf5a640 1 -- 172.21.15.82:0/4089946015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e6530f0 msgr2=0x56498e6534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/4089946015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e6530f0 0x56498e6534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb27cf5a640 1 -- 172.21.15.82:0/4089946015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e65c7e0 msgr2=0x56498e65ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/4089946015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e65c7e0 0x56498e65ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.487+0000 7fb27cf5a640 1 -- 172.21.15.82:0/4089946015 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56498e2cb210 con 0x56498e653a10 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.488+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/4089946015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e653a10 0x56498e65c2a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb268098fe0 tx=0x7fb26809bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ac9e3f5ee052104 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.488+0000 7fb2637fe640 1 -- 172.21.15.82:0/4089946015 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26809c610 con 0x56498e653a10 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.488+0000 7fb2637fe640 1 -- 172.21.15.82:0/4089946015 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb268098040 con 0x56498e653a10 2024-03-27T07:26:27.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.488+0000 7fb2637fe640 1 -- 172.21.15.82:0/4089946015 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2680a4df0 con 0x56498e653a10 2024-03-27T07:26:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 -- 172.21.15.82:0/4089946015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e653a10 msgr2=0x56498e65c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 --2- 172.21.15.82:0/4089946015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e653a10 0x56498e65c2a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb268098fe0 tx=0x7fb26809bf70 comp rx=0 tx=0).stop 2024-03-27T07:26:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 -- 172.21.15.82:0/4089946015 shutdown_connections 2024-03-27T07:26:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 --2- 172.21.15.82:0/4089946015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e65c7e0 0x56498e65ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 --2- 172.21.15.82:0/4089946015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e653a10 0x56498e65c2a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 --2- 172.21.15.82:0/4089946015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e6530f0 0x56498e6534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 -- 172.21.15.82:0/4089946015 >> 172.21.15.82:0/4089946015 conn(0x56498e64da10 msgr2=0x56498e64ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 -- 172.21.15.82:0/4089946015 shutdown_connections 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 -- 172.21.15.82:0/4089946015 wait complete. 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 -- start start 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.489+0000 7fb28259c740 1 Processor -- start 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb28259c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 0x56498e659900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb28259c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e659e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb28259c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 0x56498e65a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb28259c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56498e5b2e00 con 0x56498e6530f0 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb28259c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56498e55f520 con 0x56498e653a10 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb28259c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56498e5728e0 con 0x56498e65c7e0 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb28259c740 10 client.0 _ll_register_callbacks cb 0x56498e5ada00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb27cf5a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e659e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb27d75b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 0x56498e659900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb27df5c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 0x56498e65a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb27df5c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 0x56498e65a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37676/0 (socket says 172.21.15.82:37676) 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb27df5c640 1 -- 172.21.15.82:0/2389523653 learned_addr learned my addr 172.21.15.82:0/2389523653 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.490+0000 7fb27cf5a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e659e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:51196/0 (socket says 172.21.15.82:51196) 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb27df5c640 1 -- 172.21.15.82:0/2389523653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 msgr2=0x56498e659e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb27df5c640 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e659e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb27df5c640 1 -- 172.21.15.82:0/2389523653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 msgr2=0x56498e659900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb27df5c640 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 0x56498e659900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb27df5c640 1 -- 172.21.15.82:0/2389523653 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56498e397620 con 0x56498e65c7e0 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e659e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb27df5c640 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 0x56498e65a380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb2700116f0 tx=0x7fb270011bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52660b2089323403 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb260ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb260ff9640 1 -- 172.21.15.82:0/2389523653 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb270010be0 con 0x56498e65c7e0 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb260ff9640 1 -- 172.21.15.82:0/2389523653 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fb270010d80 con 0x56498e65c7e0 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb28259c740 1 -- 172.21.15.82:0/2389523653 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb268098040 con 0x56498e65c7e0 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb260ff9640 1 -- 172.21.15.82:0/2389523653 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb270004b20 con 0x56498e65c7e0 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb28259c740 10 client.26101 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb28259c740 1 -- 172.21.15.82:0/2389523653 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56498e66b4c0 con 0x56498e65c7e0 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.491+0000 7fb260ff9640 1 -- 172.21.15.82:0/2389523653 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb268098040 con 0x56498e65c7e0 2024-03-27T07:26:27.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.492+0000 7fb260ff9640 1 -- 172.21.15.82:0/2389523653 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb270011ce0 con 0x56498e65c7e0 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.492+0000 7fb28259c740 10 client.26101 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.492+0000 7fb28259c740 10 client.26101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.492+0000 7fb28259c740 20 client.26101 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.492+0000 7fb28259c740 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56498e66c9d0 0x56498e66edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.492+0000 7fb28259c740 4 client.26101 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.492+0000 7fb28259c740 1 -- 172.21.15.82:0/2389523653 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56498e5c4390 con 0x56498e66c9d0 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.492+0000 7fb27d75b640 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56498e66c9d0 0x56498e66edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.492+0000 7fb27d75b640 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56498e66c9d0 0x56498e66edc0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d646e492b778b7c7 server_cookie=4e0ad73c1b4741fe in_seq=0 out_seq=0 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.492+0000 7fb260ff9640 10 client.26101 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.494+0000 7fb260ff9640 1 -- 172.21.15.82:0/2389523653 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56498e5c4390 con 0x56498e66c9d0 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.494+0000 7fb260ff9640 10 client.26101 handle_command_reply: tid=0 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.494+0000 7fb28259c740 1 client.26101 shutdown 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 1 -- 172.21.15.82:0/2389523653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 msgr2=0x56498e65a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 0x56498e65a380 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb2700116f0 tx=0x7fb270011bb0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 1 -- 172.21.15.82:0/2389523653 shutdown_connections 2024-03-27T07:26:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 0x56498e65a380 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e659e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56498e66c9d0 0x56498e66edc0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 1 --2- 172.21.15.82:0/2389523653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 0x56498e659900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 1 -- 172.21.15.82:0/2389523653 >> 172.21.15.82:0/2389523653 conn(0x56498e64da10 msgr2=0x56498e64f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb260ff9640 0 client.26101 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 1 -- 172.21.15.82:0/2389523653 shutdown_connections 2024-03-27T07:26:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 1 -- 172.21.15.82:0/2389523653 wait complete. 2024-03-27T07:26:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.495+0000 7fb28259c740 20 client.26101 trim_cache size 0 max 16384 2024-03-27T07:26:27.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.517 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.518 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.519 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.520 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.521 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.524 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.526 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.527 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.528 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.529 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.530 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.531 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.532 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.533 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:27.534 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.526+0000 7fb28259c740 1 Processor -- start 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.526+0000 7fb28259c740 1 -- start start 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb28259c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 0x56498e667eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb28259c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e6485f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb28259c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 0x56498e65a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb28259c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781beff0 con 0x56498e6530f0 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb28259c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781bc860 con 0x56498e653a10 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb28259c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781ba6b0 con 0x56498e65c7e0 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27d75b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 0x56498e667eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27d75b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 0x56498e667eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56310/0 (socket says 172.21.15.82:56310) 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27d75b640 1 -- 172.21.15.82:0/2494655648 learned_addr learned my addr 172.21.15.82:0/2494655648 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/2494655648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e6485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27df5c640 1 --2- 172.21.15.82:0/2494655648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 0x56498e65a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27d75b640 1 -- 172.21.15.82:0/2494655648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 msgr2=0x56498e65a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27d75b640 1 --2- 172.21.15.82:0/2494655648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 0x56498e65a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27d75b640 1 -- 172.21.15.82:0/2494655648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 msgr2=0x56498e6485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27d75b640 1 --2- 172.21.15.82:0/2494655648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e6485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27d75b640 1 -- 172.21.15.82:0/2494655648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56498e6588b0 con 0x56498e6530f0 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb27d75b640 1 --2- 172.21.15.82:0/2494655648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 0x56498e667eb0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb274009900 tx=0x7fb27403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cf33ef157c1e5c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.527+0000 7fb262ffd640 1 -- 172.21.15.82:0/2494655648 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274045040 con 0x56498e6530f0 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb262ffd640 1 -- 172.21.15.82:0/2494655648 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb274051030 con 0x56498e6530f0 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb262ffd640 1 -- 172.21.15.82:0/2494655648 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274005230 con 0x56498e6530f0 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb28259c740 1 -- 172.21.15.82:0/2494655648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 msgr2=0x56498e667eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb28259c740 1 --2- 172.21.15.82:0/2494655648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 0x56498e667eb0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb274009900 tx=0x7fb27403c000 comp rx=0 tx=0).stop 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb28259c740 1 -- 172.21.15.82:0/2494655648 shutdown_connections 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb28259c740 1 --2- 172.21.15.82:0/2494655648 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e65c7e0 0x56498e65a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb28259c740 1 --2- 172.21.15.82:0/2494655648 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e6485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb28259c740 1 --2- 172.21.15.82:0/2494655648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e6530f0 0x56498e667eb0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb28259c740 1 -- 172.21.15.82:0/2494655648 >> 172.21.15.82:0/2494655648 conn(0x56498e64da10 msgr2=0x56498e64ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb28259c740 1 -- 172.21.15.82:0/2494655648 shutdown_connections 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.528+0000 7fb28259c740 1 -- 172.21.15.82:0/2494655648 wait complete. 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.529+0000 7fb28259c740 1 -- start start 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.529+0000 7fb28259c740 1 Processor -- start 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.529+0000 7fb28259c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e6530f0 0x56498e664720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.529+0000 7fb28259c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e65fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.529+0000 7fb28259c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e65c7e0 0x56498e660020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.529+0000 7fb28259c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781bad20 con 0x56498e65c7e0 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.529+0000 7fb28259c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781bc190 con 0x56498e653a10 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.529+0000 7fb28259c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb2781bb3f0 con 0x56498e6530f0 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.529+0000 7fb28259c740 10 client.0 _ll_register_callbacks cb 0x7fb270009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.529+0000 7fb27d75b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e6530f0 0x56498e664720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27cf5a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e65fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27d75b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e6530f0 0x56498e664720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37688/0 (socket says 172.21.15.82:37688) 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27df5c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e65c7e0 0x56498e660020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27d75b640 1 -- 172.21.15.82:0/1252013558 learned_addr learned my addr 172.21.15.82:0/1252013558 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27cf5a640 1 -- 172.21.15.82:0/1252013558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e6530f0 msgr2=0x56498e664720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e6530f0 0x56498e664720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27cf5a640 1 -- 172.21.15.82:0/1252013558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e65c7e0 msgr2=0x56498e660020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e65c7e0 0x56498e660020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27cf5a640 1 -- 172.21.15.82:0/1252013558 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56498e65ef40 con 0x56498e653a10 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27d75b640 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e6530f0 0x56498e664720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb27cf5a640 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e65fae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x56498e652ba0 tx=0x7fb26809c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4500a9ed495d93b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb260ff9640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:26:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb260ff9640 1 -- 172.21.15.82:0/1252013558 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2680b9070 con 0x56498e653a10 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb28259c740 1 -- 172.21.15.82:0/1252013558 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb274051030 con 0x56498e653a10 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb260ff9640 1 -- 172.21.15.82:0/1252013558 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fb2680bb2c0 con 0x56498e653a10 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb260ff9640 1 -- 172.21.15.82:0/1252013558 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb26809c610 con 0x56498e653a10 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb28259c740 10 client.26102 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.530+0000 7fb28259c740 1 -- 172.21.15.82:0/1252013558 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56498e6d2ae0 con 0x56498e653a10 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.531+0000 7fb260ff9640 1 -- 172.21.15.82:0/1252013558 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb274051030 con 0x56498e653a10 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.531+0000 7fb260ff9640 1 -- 172.21.15.82:0/1252013558 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb268085b50 con 0x56498e653a10 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.531+0000 7fb28259c740 10 client.26102 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.531+0000 7fb28259c740 10 client.26102 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.531+0000 7fb28259c740 20 client.26102 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.531+0000 7fb28259c740 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56498e6d2db0 0x56498e6d51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.531+0000 7fb28259c740 4 client.26102 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.531+0000 7fb28259c740 1 -- 172.21.15.82:0/1252013558 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56498e5be6e0 con 0x56498e6d2db0 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.531+0000 7fb27d75b640 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56498e6d2db0 0x56498e6d51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.532+0000 7fb260ff9640 10 client.26102 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:27.544 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:27.532+0000 7fb27d75b640 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56498e6d2db0 0x56498e6d51a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67ac493a21478b5a server_cookie=81839df3c9e216a in_seq=0 out_seq=0 2024-03-27T07:26:27.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.549 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.551 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.552 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.553 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.554 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.555 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.556 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.557 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.558 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.559 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.560 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.561 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.562 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.563 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.564 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.565 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.566 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.567 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.568 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.569 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.570 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.571 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.572 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.573 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.573 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.573 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.573 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.573 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:27.573 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:27.573 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb260ff9640 1 -- 172.21.15.82:0/1252013558 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56498e5be6e0 con 0x56498e6d2db0 2024-03-27T07:26:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb260ff9640 10 client.26102 handle_command_reply: tid=0 2024-03-27T07:26:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 client.26102 shutdown 2024-03-27T07:26:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 -- 172.21.15.82:0/1252013558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 msgr2=0x56498e65fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e65fae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x56498e652ba0 tx=0x7fb26809c490 comp rx=0 tx=0).stop 2024-03-27T07:26:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 -- 172.21.15.82:0/1252013558 shutdown_connections 2024-03-27T07:26:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56498e6d2db0 0x56498e6d51a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:28.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56498e65c7e0 0x56498e660020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56498e653a10 0x56498e65fae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb260ff9640 0 client.26102 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 --2- 172.21.15.82:0/1252013558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56498e6530f0 0x56498e664720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 -- 172.21.15.82:0/1252013558 >> 172.21.15.82:0/1252013558 conn(0x56498e64da10 msgr2=0x56498e64ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 -- 172.21.15.82:0/1252013558 shutdown_connections 2024-03-27T07:26:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 1 -- 172.21.15.82:0/1252013558 wait complete. 2024-03-27T07:26:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.351+0000 7fb28259c740 20 client.26102 trim_cache size 0 max 16384 2024-03-27T07:26:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:26:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:26:28.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:26:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:26:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 -- 172.21.15.82:0/2180955521 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb2640a38a0 msgr2=0x7fb2640a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:28.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb2640a38a0 0x7fb2640a5d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb274000c00 tx=0x7fb27402c7a0 comp rx=0 tx=0).stop 2024-03-27T07:26:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 -- 172.21.15.82:0/2180955521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb278108fc0 msgr2=0x7fb2781191f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb278108fc0 0x7fb2781191f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb26800e9f0 tx=0x7fb26800eeb0 comp rx=0 tx=0).stop 2024-03-27T07:26:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 -- 172.21.15.82:0/2180955521 shutdown_connections 2024-03-27T07:26:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb2640a38a0 0x7fb2640a5d60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb27810d610 0x7fb278119730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb278108fc0 0x7fb2781191f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 --2- 172.21.15.82:0/2180955521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb278108b50 0x7fb278118cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 -- 172.21.15.82:0/2180955521 >> 172.21.15.82:0/2180955521 conn(0x7fb27806cbf0 msgr2=0x7fb27810c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 -- 172.21.15.82:0/2180955521 shutdown_connections 2024-03-27T07:26:28.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:28.352+0000 7fb27f9bf640 1 -- 172.21.15.82:0/2180955521 wait complete. 2024-03-27T07:26:28.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:28.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:28.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:28.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:28 smithi082 ceph-mon[32178]: pgmap v89: 97 pgs: 97 active+clean; 346 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 806 op/s 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:28.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:28.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:28.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:28.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:28.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:28 smithi149 ceph-mon[36065]: pgmap v89: 97 pgs: 97 active+clean; 346 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 806 op/s 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:28.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:28.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:28.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:28.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:28.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:28.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:28 smithi153 ceph-mon[36179]: pgmap v89: 97 pgs: 97 active+clean; 346 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 806 op/s 2024-03-27T07:26:30.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:30 smithi082 ceph-mon[32178]: pgmap v90: 97 pgs: 97 active+clean; 346 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 738 op/s 2024-03-27T07:26:30.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:30 smithi149 ceph-mon[36065]: pgmap v90: 97 pgs: 97 active+clean; 346 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 738 op/s 2024-03-27T07:26:30.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:30 smithi153 ceph-mon[36179]: pgmap v90: 97 pgs: 97 active+clean; 346 MiB data, 765 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 10 MiB/s wr, 738 op/s 2024-03-27T07:26:32.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:32 smithi082 ceph-mon[32178]: pgmap v91: 97 pgs: 97 active+clean; 346 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-03-27T07:26:32.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:32 smithi149 ceph-mon[36065]: pgmap v91: 97 pgs: 97 active+clean; 346 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-03-27T07:26:32.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:32 smithi153 ceph-mon[36179]: pgmap v91: 97 pgs: 97 active+clean; 346 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 11 MiB/s wr, 1.09k op/s 2024-03-27T07:26:34.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:34 smithi082 ceph-mon[32178]: pgmap v92: 97 pgs: 97 active+clean; 346 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 699 op/s 2024-03-27T07:26:34.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:34 smithi149 ceph-mon[36065]: pgmap v92: 97 pgs: 97 active+clean; 346 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 699 op/s 2024-03-27T07:26:34.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:34 smithi153 ceph-mon[36179]: pgmap v92: 97 pgs: 97 active+clean; 346 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 699 op/s 2024-03-27T07:26:35.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.449 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.450 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:35.451 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:35.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:35.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.443 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.446 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:36.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.448 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:36 smithi082 ceph-mon[32178]: pgmap v93: 97 pgs: 97 active+clean; 346 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 699 op/s 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.508 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.509 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.510 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.511 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.512 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.513 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.514 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.515 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:36.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.516 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:36 smithi149 ceph-mon[36065]: pgmap v93: 97 pgs: 97 active+clean; 346 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 699 op/s 2024-03-27T07:26:36.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.541 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.542 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.543 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.544 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.546 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.547 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:36.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:36.548 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:36 smithi153 ceph-mon[36179]: pgmap v93: 97 pgs: 97 active+clean; 346 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 699 op/s 2024-03-27T07:26:37.157 INFO:tasks.workunit.client.0.smithi082.stdout: 103 993703 917 731672 617 326532 426 2024-03-27T07:26:38.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:38 smithi082 ceph-mon[32178]: pgmap v94: 97 pgs: 97 active+clean; 351 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 777 op/s 2024-03-27T07:26:38.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:38 smithi149 ceph-mon[36065]: pgmap v94: 97 pgs: 97 active+clean; 351 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 777 op/s 2024-03-27T07:26:38.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:38 smithi153 ceph-mon[36179]: pgmap v94: 97 pgs: 97 active+clean; 351 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.6 MiB/s wr, 777 op/s 2024-03-27T07:26:40.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:40 smithi082 ceph-mon[32178]: pgmap v95: 97 pgs: 97 active+clean; 351 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 433 op/s 2024-03-27T07:26:40.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:40 smithi149 ceph-mon[36065]: pgmap v95: 97 pgs: 97 active+clean; 351 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 433 op/s 2024-03-27T07:26:40.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:40 smithi153 ceph-mon[36179]: pgmap v95: 97 pgs: 97 active+clean; 351 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 433 op/s 2024-03-27T07:26:41.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.619+0000 7ff6dd33a640 1 -- 172.21.15.82:0/2242161326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d8113aa0 msgr2=0x7ff6d8115e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:41.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.619+0000 7ff6dd33a640 1 --2- 172.21.15.82:0/2242161326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d8113aa0 0x7ff6d8115e90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009900 tx=0x7ff6c802bcf0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.629+0000 7ff6dd33a640 1 -- 172.21.15.82:0/2242161326 shutdown_connections 2024-03-27T07:26:41.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.629+0000 7ff6dd33a640 1 --2- 172.21.15.82:0/2242161326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d8113aa0 0x7ff6d8115e90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.629+0000 7ff6dd33a640 1 --2- 172.21.15.82:0/2242161326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6d810ae10 0x7ff6d8113560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.629+0000 7ff6dd33a640 1 --2- 172.21.15.82:0/2242161326 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6d810a4f0 0x7ff6d810a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.629+0000 7ff6dd33a640 1 -- 172.21.15.82:0/2242161326 >> 172.21.15.82:0/2242161326 conn(0x7ff6d806cad0 msgr2=0x7ff6d806cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:41.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.629+0000 7ff6dd33a640 1 -- 172.21.15.82:0/2242161326 shutdown_connections 2024-03-27T07:26:41.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.629+0000 7ff6dd33a640 1 -- 172.21.15.82:0/2242161326 wait complete. 2024-03-27T07:26:41.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.630+0000 7ff6dd33a640 1 Processor -- start 2024-03-27T07:26:41.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.631+0000 7ff6dd33a640 1 -- start start 2024-03-27T07:26:41.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.631+0000 7ff6dd33a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6d810a4f0 0x7ff6d81a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.631+0000 7ff6dd33a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d810ae10 0x7ff6d81a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.631+0000 7ff6dd33a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6d8113aa0 0x7ff6d819ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.631+0000 7ff6dd33a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8119560 con 0x7ff6d810ae10 2024-03-27T07:26:41.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.631+0000 7ff6dd33a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81193e0 con 0x7ff6d8113aa0 2024-03-27T07:26:41.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.631+0000 7ff6dd33a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81196e0 con 0x7ff6d810a4f0 2024-03-27T07:26:41.634 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.631+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6d810a4f0 0x7ff6d81a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.631+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6d810a4f0 0x7ff6d81a66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:55112/0 (socket says 172.21.15.82:55112) 2024-03-27T07:26:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.631+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/3509551543 learned_addr learned my addr 172.21.15.82:0/3509551543 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.632+0000 7ff6d77fe640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6d8113aa0 0x7ff6d819ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.632+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/3509551543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6d8113aa0 msgr2=0x7ff6d819ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.632+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6d8113aa0 0x7ff6d819ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.632+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/3509551543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d810ae10 msgr2=0x7ff6d81a6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.632+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d810ae10 0x7ff6d81a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.632+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/3509551543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d819f330 con 0x7ff6d810a4f0 2024-03-27T07:26:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.632+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6d810a4f0 0x7ff6d81a66d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00b4a0 tx=0x7ff6cc00b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:41.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.633+0000 7ff6c7fff640 1 -- 172.21.15.82:0/3509551543 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc014070 con 0x7ff6d810a4f0 2024-03-27T07:26:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.633+0000 7ff6dd33a640 1 -- 172.21.15.82:0/3509551543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d819f620 con 0x7ff6d810a4f0 2024-03-27T07:26:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.633+0000 7ff6dd33a640 1 -- 172.21.15.82:0/3509551543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d81bc450 con 0x7ff6d810a4f0 2024-03-27T07:26:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.634+0000 7ff6c7fff640 1 -- 172.21.15.82:0/3509551543 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6cc010af0 con 0x7ff6d810a4f0 2024-03-27T07:26:41.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.634+0000 7ff6c7fff640 1 -- 172.21.15.82:0/3509551543 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc017d10 con 0x7ff6d810a4f0 2024-03-27T07:26:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.640+0000 7ff6dfffb740 1 Processor -- start 2024-03-27T07:26:41.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.640+0000 7ff6dfffb740 1 -- start start 2024-03-27T07:26:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.640+0000 7ff6dfffb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51290 0x563e14a51670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.640+0000 7ff6dfffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51bb0 0x563e14a5a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.640+0000 7ff6dfffb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a5cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.640+0000 7ff6dfffb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563e14a17cd0 con 0x563e14a5a980 2024-03-27T07:26:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.640+0000 7ff6dfffb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563e1495c950 con 0x563e14a51290 2024-03-27T07:26:41.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.640+0000 7ff6dfffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563e149b4e50 con 0x563e14a51bb0 2024-03-27T07:26:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.641+0000 7ff6d67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a5cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.641+0000 7ff6d67fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a5cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50822/0 (socket says 172.21.15.82:50822) 2024-03-27T07:26:41.646 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.641+0000 7ff6d77fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51290 0x563e14a51670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.641+0000 7ff6d67fc640 1 -- 172.21.15.82:0/2245244363 learned_addr learned my addr 172.21.15.82:0/2245244363 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:41.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.642+0000 7ff6d67fc640 1 -- 172.21.15.82:0/2245244363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51bb0 msgr2=0x563e14a5a440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:26:41.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.642+0000 7ff6d67fc640 1 --2- 172.21.15.82:0/2245244363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51bb0 0x563e14a5a440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.642+0000 7ff6d67fc640 1 -- 172.21.15.82:0/2245244363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51290 msgr2=0x563e14a51670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:41.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.643+0000 7ff6c7fff640 1 -- 172.21.15.82:0/3509551543 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7ff6cc017070 con 0x7ff6d810a4f0 2024-03-27T07:26:41.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.643+0000 7ff6d67fc640 1 --2- 172.21.15.82:0/2245244363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51290 0x563e14a51670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.643+0000 7ff6d67fc640 1 -- 172.21.15.82:0/2245244363 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e146c9210 con 0x563e14a5a980 2024-03-27T07:26:41.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.643+0000 7ff6d67fc640 1 --2- 172.21.15.82:0/2245244363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a5cd70 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009fa0 tx=0x7ff6d000b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717457875470742 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:41.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.644+0000 7ff6c57fa640 1 -- 172.21.15.82:0/2245244363 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000bce0 con 0x563e14a5a980 2024-03-27T07:26:41.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.645+0000 7ff6c57fa640 1 -- 172.21.15.82:0/2245244363 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6d0017070 con 0x563e14a5a980 2024-03-27T07:26:41.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.646+0000 7ff6dfffb740 1 -- 172.21.15.82:0/2245244363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 msgr2=0x563e14a5cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:41.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.646+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/2245244363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a5cd70 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009fa0 tx=0x7ff6d000b4e0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.646+0000 7ff6c7fff640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff6c00a3900 0x7ff6c00a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.647+0000 7ff6c7fff640 1 -- 172.21.15.82:0/3509551543 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7ff6cc0cf1d0 con 0x7ff6d810a4f0 2024-03-27T07:26:41.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.647+0000 7ff6d77fe640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff6c00a3900 0x7ff6c00a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.648+0000 7ff6d77fe640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff6c00a3900 0x7ff6c00a5dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6c802cfd0 tx=0x7ff6c8005fd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:41.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.649+0000 7ff6dfffb740 1 -- 172.21.15.82:0/2245244363 shutdown_connections 2024-03-27T07:26:41.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.649+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/2245244363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a5cd70 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.649+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/2245244363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51bb0 0x563e14a5a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.649+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/2245244363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51290 0x563e14a51670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.649+0000 7ff6dfffb740 1 -- 172.21.15.82:0/2245244363 >> 172.21.15.82:0/2245244363 conn(0x563e14a4bbb0 msgr2=0x563e14a4bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:41.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.649+0000 7ff6dfffb740 1 -- 172.21.15.82:0/2245244363 shutdown_connections 2024-03-27T07:26:41.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.649+0000 7ff6dfffb740 1 -- 172.21.15.82:0/2245244363 wait complete. 2024-03-27T07:26:41.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.649+0000 7ff6dfffb740 1 -- start start 2024-03-27T07:26:41.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.649+0000 7ff6dfffb740 1 Processor -- start 2024-03-27T07:26:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6dfffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a57930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6dfffb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51bb0 0x563e14a57e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6dfffb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 0x563e14a583b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6dfffb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563e149b0e00 con 0x563e14a51bb0 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6dfffb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563e1495d520 con 0x563e14a5a980 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6dfffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563e149708e0 con 0x563e14a51290 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6dfffb740 10 client.0 _ll_register_callbacks cb 0x563e149aba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a57930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a57930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:55120/0 (socket says 172.21.15.82:55120) 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/3720993522 learned_addr learned my addr 172.21.15.82:0/3720993522 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.650+0000 7ff6d77fe640 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 0x563e14a583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6d67fc640 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51bb0 0x563e14a57e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6d77fe640 1 -- 172.21.15.82:0/3720993522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 msgr2=0x563e14a57930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6d77fe640 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a57930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6d77fe640 1 -- 172.21.15.82:0/3720993522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51bb0 msgr2=0x563e14a57e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:41.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6d77fe640 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51bb0 0x563e14a57e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6d77fe640 1 -- 172.21.15.82:0/3720993522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e14795620 con 0x563e14a5a980 2024-03-27T07:26:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a57930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6d67fc640 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51bb0 0x563e14a57e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6d77fe640 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 0x563e14a583b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8036040 tx=0x7ff6c802bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68f17a91e787d818 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:26:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.651+0000 7ff6be7fc640 1 -- 172.21.15.82:0/3720993522 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c804f020 con 0x563e14a5a980 2024-03-27T07:26:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.652+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3720993522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d0017070 con 0x563e14a5a980 2024-03-27T07:26:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.652+0000 7ff6be7fc640 1 -- 172.21.15.82:0/3720993522 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7ff6c8004f80 con 0x563e14a5a980 2024-03-27T07:26:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.652+0000 7ff6be7fc640 1 -- 172.21.15.82:0/3720993522 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff6c8004c50 con 0x563e14a5a980 2024-03-27T07:26:41.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.652+0000 7ff6dfffb740 10 client.26111 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:41.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.652+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3720993522 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563e14a69600 con 0x563e14a5a980 2024-03-27T07:26:41.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.652+0000 7ff6be7fc640 1 -- 172.21.15.82:0/3720993522 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6d0017070 con 0x563e14a5a980 2024-03-27T07:26:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.653+0000 7ff6be7fc640 1 -- 172.21.15.82:0/3720993522 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff6c804b480 con 0x563e14a5a980 2024-03-27T07:26:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.653+0000 7ff6dfffb740 10 client.26111 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.653+0000 7ff6dfffb740 10 client.26111 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.653+0000 7ff6dfffb740 20 client.26111 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.653+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563e14a6ab30 0x563e14a6cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.653+0000 7ff6dfffb740 4 client.26111 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.653+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3720993522 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e149c2390 con 0x563e14a6ab30 2024-03-27T07:26:41.659 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.653+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563e14a6ab30 0x563e14a6cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.654+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563e14a6ab30 0x563e14a6cf50 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1ab59e8ea8db052 server_cookie=23c3ab9d7761dc03 in_seq=0 out_seq=0 2024-03-27T07:26:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.654+0000 7ff6be7fc640 10 client.26111 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6be7fc640 1 -- 172.21.15.82:0/3720993522 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x563e149c2390 con 0x563e14a6ab30 2024-03-27T07:26:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6be7fc640 10 client.26111 handle_command_reply: tid=0 2024-03-27T07:26:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 client.26111 shutdown 2024-03-27T07:26:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3720993522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 msgr2=0x563e14a583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 0x563e14a583b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8036040 tx=0x7ff6c802bcf0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3720993522 shutdown_connections 2024-03-27T07:26:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563e14a6ab30 0x563e14a6cf50 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51bb0 0x563e14a57e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 0x563e14a583b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/3720993522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a57930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3720993522 >> 172.21.15.82:0/3720993522 conn(0x563e14a4bbb0 msgr2=0x563e14a4d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6be7fc640 0 client.26111 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3720993522 shutdown_connections 2024-03-27T07:26:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3720993522 wait complete. 2024-03-27T07:26:41.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.655+0000 7ff6dfffb740 20 client.26111 trim_cache size 0 max 16384 2024-03-27T07:26:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.697+0000 7ff6dfffb740 1 Processor -- start 2024-03-27T07:26:41.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.697+0000 7ff6dfffb740 1 -- start start 2024-03-27T07:26:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.698+0000 7ff6dfffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a5a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.698+0000 7ff6dfffb740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51bb0 0x563e14a66130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.698+0000 7ff6dfffb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a46750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6dfffb740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b8010fb0 con 0x563e14a5a980 2024-03-27T07:26:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6dfffb740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b800e820 con 0x563e14a51bb0 2024-03-27T07:26:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d67fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51bb0 0x563e14a66130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6dfffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b800c670 con 0x563e14a51290 2024-03-27T07:26:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d67fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51bb0 0x563e14a66130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:36562/0 (socket says 172.21.15.82:36562) 2024-03-27T07:26:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a5a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d67fc640 1 -- 172.21.15.82:0/3789842457 learned_addr learned my addr 172.21.15.82:0/3789842457 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d77fe640 1 --2- 172.21.15.82:0/3789842457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a46750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/3789842457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51bb0 msgr2=0x563e14a66130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/3789842457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51bb0 0x563e14a66130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/3789842457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 msgr2=0x563e14a46750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/3789842457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a46750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/3789842457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e14a55eb0 con 0x563e14a51290 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d67fc640 1 --2- 172.21.15.82:0/3789842457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51bb0 0x563e14a66130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d77fe640 1 --2- 172.21.15.82:0/3789842457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a46750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.699+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/3789842457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a5a060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0ccf70 tx=0x7ff6cc01b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d4586baaa0c19bd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.700+0000 7ff6c4ff9640 1 -- 172.21.15.82:0/3789842457 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0ae020 con 0x563e14a51290 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.700+0000 7ff6c4ff9640 1 -- 172.21.15.82:0/3789842457 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6cc010ca0 con 0x563e14a51290 2024-03-27T07:26:41.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.700+0000 7ff6c4ff9640 1 -- 172.21.15.82:0/3789842457 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc01e040 con 0x563e14a51290 2024-03-27T07:26:41.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.701+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3789842457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 msgr2=0x563e14a5a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.701+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/3789842457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a5a060 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0ccf70 tx=0x7ff6cc01b040 comp rx=0 tx=0).stop 2024-03-27T07:26:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.701+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3789842457 shutdown_connections 2024-03-27T07:26:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.702+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/3789842457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a5a980 0x563e14a46750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.702+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/3789842457 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a51bb0 0x563e14a66130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.702+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/3789842457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51290 0x563e14a5a060 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.702+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3789842457 >> 172.21.15.82:0/3789842457 conn(0x563e14a4bbb0 msgr2=0x563e14a4bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.702+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3789842457 shutdown_connections 2024-03-27T07:26:41.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.702+0000 7ff6dfffb740 1 -- 172.21.15.82:0/3789842457 wait complete. 2024-03-27T07:26:41.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.703+0000 7ff6dfffb740 1 -- start start 2024-03-27T07:26:41.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.703+0000 7ff6dfffb740 1 Processor -- start 2024-03-27T07:26:41.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.703+0000 7ff6dfffb740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51290 0x563e14a5df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51290 0x563e14a5df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6d6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51290 0x563e14a5df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50852/0 (socket says 172.21.15.82:50852) 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/1075167989 learned_addr learned my addr 172.21.15.82:0/1075167989 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51bb0 0x563e14a5e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 0x563e14a5ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b800cce0 con 0x563e14a51290 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b800e150 con 0x563e14a5a980 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b800d3b0 con 0x563e14a51bb0 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6d67fc640 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51bb0 0x563e14a5e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6d77fe640 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 0x563e14a5ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6dfffb740 10 client.0 _ll_register_callbacks cb 0x7ff6c8042070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/1075167989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51bb0 msgr2=0x563e14a5e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51bb0 0x563e14a5e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/1075167989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 msgr2=0x563e14a5ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:41.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 0x563e14a5ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:41.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.704+0000 7ff6d6ffd640 1 -- 172.21.15.82:0/1075167989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e14acfe90 con 0x563e14a51290 2024-03-27T07:26:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.705+0000 7ff6d6ffd640 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51290 0x563e14a5df80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc09b450 tx=0x7ff6cc0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff69452132d1f84f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.705+0000 7ff6be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.705+0000 7ff6be7fc640 1 -- 172.21.15.82:0/1075167989 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc0ae050 con 0x563e14a51290 2024-03-27T07:26:41.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.705+0000 7ff6be7fc640 1 -- 172.21.15.82:0/1075167989 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7ff6cc017560 con 0x563e14a51290 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.705+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6cc010ca0 con 0x563e14a51290 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.705+0000 7ff6be7fc640 1 -- 172.21.15.82:0/1075167989 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff6cc01e070 con 0x563e14a51290 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.705+0000 7ff6dfffb740 10 client.16293 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.705+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563e14ad1050 con 0x563e14a51290 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.706+0000 7ff6be7fc640 1 -- 172.21.15.82:0/1075167989 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff6cc010ca0 con 0x563e14a51290 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.706+0000 7ff6be7fc640 1 -- 172.21.15.82:0/1075167989 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff6cc097210 con 0x563e14a51290 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.706+0000 7ff6dfffb740 10 client.16293 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.706+0000 7ff6dfffb740 10 client.16293 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.706+0000 7ff6dfffb740 20 client.16293 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.706+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563e14ad1740 0x563e14ad3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:41.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.706+0000 7ff6dfffb740 4 client.16293 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:26:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.706+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563e149bc6e0 con 0x563e14ad1740 2024-03-27T07:26:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.706+0000 7ff6d67fc640 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563e14ad1740 0x563e14ad3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.707+0000 7ff6be7fc640 10 client.16293 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:41.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:41.707+0000 7ff6d67fc640 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563e14ad1740 0x563e14ad3b60 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd84811c9662ff91 server_cookie=817e8a182f40834f in_seq=0 out_seq=0 2024-03-27T07:26:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.408+0000 7ff6be7fc640 1 -- 172.21.15.82:0/1075167989 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563e149bc6e0 con 0x563e14ad1740 2024-03-27T07:26:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.408+0000 7ff6be7fc640 10 client.16293 handle_command_reply: tid=0 2024-03-27T07:26:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.408+0000 7ff6dfffb740 1 client.16293 shutdown 2024-03-27T07:26:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51290 msgr2=0x563e14a5df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51290 0x563e14a5df80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc09b450 tx=0x7ff6cc0047d0 comp rx=0 tx=0).stop 2024-03-27T07:26:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 shutdown_connections 2024-03-27T07:26:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563e14a5a980 0x563e14a5ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:42.412 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563e14a51bb0 0x563e14a5e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563e14ad1740 0x563e14ad3b60 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 1 --2- 172.21.15.82:0/1075167989 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563e14a51290 0x563e14a5df80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 >> 172.21.15.82:0/1075167989 conn(0x563e14a4bbb0 msgr2=0x563e14a4cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6be7fc640 0 client.16293 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 shutdown_connections 2024-03-27T07:26:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 1 -- 172.21.15.82:0/1075167989 wait complete. 2024-03-27T07:26:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dfffb740 20 client.16293 trim_cache size 0 max 16384 2024-03-27T07:26:42.413 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:26:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:26:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:26:42.414 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:26:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dd33a640 1 -- 172.21.15.82:0/3509551543 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff6c00a3900 msgr2=0x7ff6c00a5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dd33a640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff6c00a3900 0x7ff6c00a5dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6c802cfd0 tx=0x7ff6c8005fd0 comp rx=0 tx=0).stop 2024-03-27T07:26:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dd33a640 1 -- 172.21.15.82:0/3509551543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6d810a4f0 msgr2=0x7ff6d81a66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dd33a640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6d810a4f0 0x7ff6d81a66d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00b4a0 tx=0x7ff6cc00b960 comp rx=0 tx=0).stop 2024-03-27T07:26:42.415 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dd33a640 1 -- 172.21.15.82:0/3509551543 shutdown_connections 2024-03-27T07:26:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dd33a640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff6c00a3900 0x7ff6c00a5dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.409+0000 7ff6dd33a640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff6d810ae10 0x7ff6d81a6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.410+0000 7ff6dd33a640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff6d8113aa0 0x7ff6d819ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.410+0000 7ff6dd33a640 1 --2- 172.21.15.82:0/3509551543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6d810a4f0 0x7ff6d81a66d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.410+0000 7ff6dd33a640 1 -- 172.21.15.82:0/3509551543 >> 172.21.15.82:0/3509551543 conn(0x7ff6d806cad0 msgr2=0x7ff6d81094e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.410+0000 7ff6dd33a640 1 -- 172.21.15.82:0/3509551543 shutdown_connections 2024-03-27T07:26:42.416 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:42.410+0000 7ff6dd33a640 1 -- 172.21.15.82:0/3509551543 wait complete. 2024-03-27T07:26:42.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:42 smithi082 ceph-mon[32178]: pgmap v96: 97 pgs: 97 active+clean; 357 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 476 op/s 2024-03-27T07:26:42.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:42 smithi149 ceph-mon[36065]: pgmap v96: 97 pgs: 97 active+clean; 357 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 476 op/s 2024-03-27T07:26:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:42 smithi153 ceph-mon[36179]: pgmap v96: 97 pgs: 97 active+clean; 357 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 476 op/s 2024-03-27T07:26:44.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:44 smithi082 ceph-mon[32178]: pgmap v97: 97 pgs: 97 active+clean; 357 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 120 op/s 2024-03-27T07:26:44.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:44 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:26:44.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:44 smithi149 ceph-mon[36065]: pgmap v97: 97 pgs: 97 active+clean; 357 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 120 op/s 2024-03-27T07:26:44.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:44 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:26:44.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:44 smithi153 ceph-mon[36179]: pgmap v97: 97 pgs: 97 active+clean; 357 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 120 op/s 2024-03-27T07:26:44.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:44 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:26:45.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:45 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:26:45.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:45 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:26:45.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:45 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:26:45.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:45 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:26:45.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:45 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:26:45.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:45 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:26:45.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:45 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:26:45.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:45 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:26:45.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:45 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:26:46.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:46 smithi153 ceph-mon[36179]: pgmap v98: 97 pgs: 97 active+clean; 357 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 120 op/s 2024-03-27T07:26:46.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:46 smithi082 ceph-mon[32178]: pgmap v98: 97 pgs: 97 active+clean; 357 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 120 op/s 2024-03-27T07:26:46.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:46 smithi149 ceph-mon[36065]: pgmap v98: 97 pgs: 97 active+clean; 357 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 120 op/s 2024-03-27T07:26:47.157 INFO:tasks.workunit.client.0.smithi082.stdout: 128 1098595 1208 793127 1390 330979 949 2024-03-27T07:26:48.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:48 smithi153 ceph-mon[36179]: pgmap v99: 97 pgs: 97 active+clean; 367 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-03-27T07:26:48.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:48 smithi082 ceph-mon[32178]: pgmap v99: 97 pgs: 97 active+clean; 367 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-03-27T07:26:48.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:48 smithi149 ceph-mon[36065]: pgmap v99: 97 pgs: 97 active+clean; 367 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 247 op/s 2024-03-27T07:26:49.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:49 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:26:49.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:49 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:26:49.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:49 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:26:49.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:49 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:26:49.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:49 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:26:49.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:49 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:26:50.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:50 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:26:50.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:50 smithi153 ceph-mon[36179]: pgmap v100: 97 pgs: 97 active+clean; 367 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 169 op/s 2024-03-27T07:26:50.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:50 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:26:50.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:50 smithi082 ceph-mon[32178]: pgmap v100: 97 pgs: 97 active+clean; 367 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 169 op/s 2024-03-27T07:26:50.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:50 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:26:50.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:50 smithi149 ceph-mon[36065]: pgmap v100: 97 pgs: 97 active+clean; 367 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 169 op/s 2024-03-27T07:26:52.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:52 smithi153 ceph-mon[36179]: pgmap v101: 97 pgs: 97 active+clean; 497 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 682 op/s 2024-03-27T07:26:52.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:26:52.564 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:26:52.591 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:52 smithi082 ceph-mon[32178]: pgmap v101: 97 pgs: 97 active+clean; 497 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 682 op/s 2024-03-27T07:26:52.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.672+0000 7f7440e6b640 1 -- 172.21.15.82:0/7972269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f743c104910 msgr2=0x7f743c108950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.672+0000 7f7440e6b640 1 --2- 172.21.15.82:0/7972269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f743c104910 0x7f743c108950 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7424009900 tx=0x7f742402bc30 comp rx=0 tx=0).stop 2024-03-27T07:26:52.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.672+0000 7f7440e6b640 1 -- 172.21.15.82:0/7972269 shutdown_connections 2024-03-27T07:26:52.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.672+0000 7f7440e6b640 1 --2- 172.21.15.82:0/7972269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f743c104910 0x7f743c108950 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.672+0000 7f7440e6b640 1 --2- 172.21.15.82:0/7972269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f743c109030 0x7f743c110c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.672+0000 7f7440e6b640 1 --2- 172.21.15.82:0/7972269 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c103f60 0x7f743c104340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.672+0000 7f7440e6b640 1 -- 172.21.15.82:0/7972269 >> 172.21.15.82:0/7972269 conn(0x7f743c0ff7a0 msgr2=0x7f743c101bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:52.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.672+0000 7f7440e6b640 1 -- 172.21.15.82:0/7972269 shutdown_connections 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.672+0000 7f7440e6b640 1 -- 172.21.15.82:0/7972269 wait complete. 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7440e6b640 1 Processor -- start 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7440e6b640 1 -- start start 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7440e6b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f743c103f60 0x7f743c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7440e6b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f743c109030 0x7f743c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7440e6b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c19ef00 0x7f743c19f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7440e6b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1140a0 con 0x7f743c109030 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7440e6b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f743c113f20 con 0x7f743c19ef00 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7440e6b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f743c114220 con 0x7f743c103f60 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7431d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f743c109030 0x7f743c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f743a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f743c103f60 0x7f743c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7431d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f743c109030 0x7f743c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36162/0 (socket says 172.21.15.82:36162) 2024-03-27T07:26:52.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f743a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f743c103f60 0x7f743c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:50656/0 (socket says 172.21.15.82:50656) 2024-03-27T07:26:52.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.673+0000 7f7431d9b640 1 -- 172.21.15.82:0/280816043 learned_addr learned my addr 172.21.15.82:0/280816043 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:52.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f743ad9d640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c19ef00 0x7f743c19f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7431d9b640 1 -- 172.21.15.82:0/280816043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f743c103f60 msgr2=0x7f743c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7431d9b640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f743c103f60 0x7f743c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7431d9b640 1 -- 172.21.15.82:0/280816043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c19ef00 msgr2=0x7f743c19f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7431d9b640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c19ef00 0x7f743c19f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7431d9b640 1 -- 172.21.15.82:0/280816043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f743c19f9f0 con 0x7f743c109030 2024-03-27T07:26:52.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f743a59c640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f743c103f60 0x7f743c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:52.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7431d9b640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f743c109030 0x7f743c19ab80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7424036040 tx=0x7f742402cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:52.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7433fff640 1 -- 172.21.15.82:0/280816043 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424041070 con 0x7f743c109030 2024-03-27T07:26:52.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7433fff640 1 -- 172.21.15.82:0/280816043 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7424004450 con 0x7f743c109030 2024-03-27T07:26:52.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7440e6b640 1 -- 172.21.15.82:0/280816043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f743c19fc80 con 0x7f743c109030 2024-03-27T07:26:52.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7433fff640 1 -- 172.21.15.82:0/280816043 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7424003dc0 con 0x7f743c109030 2024-03-27T07:26:52.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.674+0000 7f7440e6b640 1 -- 172.21.15.82:0/280816043 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f743c1a74a0 con 0x7f743c109030 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.676+0000 7f7433fff640 1 -- 172.21.15.82:0/280816043 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f7424044070 con 0x7f743c109030 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f7443a50740 1 Processor -- start 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f7443a50740 1 -- start start 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f7443a50740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 0x55b2c359d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f7443a50740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 0x55b2c35a6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f7443a50740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c35a6750 0x55b2c35a8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f7443a50740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b2c3501860 con 0x55b2c35a6750 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f7443a50740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b2c34a98d0 con 0x55b2c359db70 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f7443a50740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b2c34fd810 con 0x55b2c359d250 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f743ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 0x55b2c359d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f7431d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c35a6750 0x55b2c35a8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f743a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 0x55b2c35a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f743ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 0x55b2c359d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:50670/0 (socket says 172.21.15.82:50670) 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f743ad9d640 1 -- 172.21.15.82:0/1916679848 learned_addr learned my addr 172.21.15.82:0/1916679848 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.677+0000 7f7433fff640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74280a3800 0x7f74280a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f743a59c640 1 -- 172.21.15.82:0/1916679848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 msgr2=0x55b2c359d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f743a59c640 1 --2- 172.21.15.82:0/1916679848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 0x55b2c359d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f743a59c640 1 -- 172.21.15.82:0/1916679848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c35a6750 msgr2=0x55b2c35a8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f743a59c640 1 --2- 172.21.15.82:0/1916679848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c35a6750 0x55b2c35a8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f743a59c640 1 -- 172.21.15.82:0/1916679848 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c34b4120 con 0x55b2c359db70 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f7431d9b640 1 --2- 172.21.15.82:0/1916679848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c35a6750 0x55b2c35a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f743ad9d640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74280a3800 0x7f74280a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f7433fff640 1 -- 172.21.15.82:0/280816043 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f74240f19f0 con 0x7f743c109030 2024-03-27T07:26:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f743a59c640 1 --2- 172.21.15.82:0/1916679848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 0x55b2c35a6210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f742c009fd0 tx=0x7f742c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=105f4e0080772017 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f7430d99640 1 -- 172.21.15.82:0/1916679848 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c004030 con 0x55b2c359db70 2024-03-27T07:26:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f743ad9d640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74280a3800 0x7f74280a5cc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7434010610 tx=0x7f7434004a40 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f7430d99640 1 -- 172.21.15.82:0/1916679848 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f742c005500 con 0x55b2c359db70 2024-03-27T07:26:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.678+0000 7f7430d99640 1 -- 172.21.15.82:0/1916679848 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c004d80 con 0x55b2c359db70 2024-03-27T07:26:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 -- 172.21.15.82:0/1916679848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 msgr2=0x55b2c35a6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 --2- 172.21.15.82:0/1916679848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 0x55b2c35a6210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f742c009fd0 tx=0x7f742c0118d0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 -- 172.21.15.82:0/1916679848 shutdown_connections 2024-03-27T07:26:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 --2- 172.21.15.82:0/1916679848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c35a6750 0x55b2c35a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 --2- 172.21.15.82:0/1916679848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 0x55b2c35a6210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 --2- 172.21.15.82:0/1916679848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 0x55b2c359d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 -- 172.21.15.82:0/1916679848 >> 172.21.15.82:0/1916679848 conn(0x55b2c3597980 msgr2=0x55b2c3597d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 -- 172.21.15.82:0/1916679848 shutdown_connections 2024-03-27T07:26:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 -- 172.21.15.82:0/1916679848 wait complete. 2024-03-27T07:26:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 -- start start 2024-03-27T07:26:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 Processor -- start 2024-03-27T07:26:52.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359d250 0x55b2c35a3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 0x55b2c35a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 0x55b2c35a4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b2c35a9540 con 0x55b2c359d250 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b2c34bccd0 con 0x55b2c359db70 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.679+0000 7f7443a50740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b2c35a96c0 con 0x55b2c35a6750 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f7443a50740 10 client.0 _ll_register_callbacks cb 0x55b2c34aeee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f743a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359d250 0x55b2c35a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f7431d9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 0x55b2c35a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f743a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359d250 0x55b2c35a3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36176/0 (socket says 172.21.15.82:36176) 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f743ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 0x55b2c35a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f743a59c640 1 -- 172.21.15.82:0/826251729 learned_addr learned my addr 172.21.15.82:0/826251729 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f743a59c640 1 -- 172.21.15.82:0/826251729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 msgr2=0x55b2c35a4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:52.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f743a59c640 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 0x55b2c35a4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f743a59c640 1 -- 172.21.15.82:0/826251729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 msgr2=0x55b2c35a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f743a59c640 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 0x55b2c35a3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f743a59c640 1 -- 172.21.15.82:0/826251729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2c32df7d0 con 0x55b2c359d250 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f743a59c640 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359d250 0x55b2c35a3790 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f742c011dd0 tx=0x7f742c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67d8444dafb07dc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f7421ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f7421ffb640 1 -- 172.21.15.82:0/826251729 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742c028020 con 0x55b2c359d250 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f7421ffb640 1 -- 172.21.15.82:0/826251729 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f742c016040 con 0x55b2c359d250 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f7443a50740 1 -- 172.21.15.82:0/826251729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f742c005500 con 0x55b2c359d250 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f7421ffb640 1 -- 172.21.15.82:0/826251729 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f742c033050 con 0x55b2c359d250 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f7443a50740 10 client.16305 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.680+0000 7f7443a50740 1 -- 172.21.15.82:0/826251729 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b2c32153f0 con 0x55b2c359d250 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7421ffb640 1 -- 172.21.15.82:0/826251729 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f742c005500 con 0x55b2c359d250 2024-03-27T07:26:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7421ffb640 1 -- 172.21.15.82:0/826251729 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f742c004f60 con 0x55b2c359d250 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7443a50740 10 client.16305 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7443a50740 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7443a50740 20 client.16305 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7443a50740 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b2c35b6af0 0x55b2c35b8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7443a50740 4 client.16305 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7443a50740 1 -- 172.21.15.82:0/826251729 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2c350eda0 con 0x55b2c35b6af0 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7431d9b640 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b2c35b6af0 0x55b2c35b8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7421ffb640 10 client.16305 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.681+0000 7f7431d9b640 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b2c35b6af0 0x55b2c35b8ee0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e69f01da07ecd5b6 server_cookie=748ec4a83fe8d203 in_seq=0 out_seq=0 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7421ffb640 1 -- 172.21.15.82:0/826251729 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b2c350eda0 con 0x55b2c35b6af0 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7421ffb640 10 client.16305 handle_command_reply: tid=0 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 client.16305 shutdown 2024-03-27T07:26:52.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 -- 172.21.15.82:0/826251729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359d250 msgr2=0x55b2c35a3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359d250 0x55b2c35a3790 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f742c011dd0 tx=0x7f742c0038a0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 -- 172.21.15.82:0/826251729 shutdown_connections 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 0x55b2c35a4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359db70 0x55b2c35a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b2c35b6af0 0x55b2c35b8ee0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 --2- 172.21.15.82:0/826251729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359d250 0x55b2c35a3790 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7421ffb640 0 client.16305 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 -- 172.21.15.82:0/826251729 >> 172.21.15.82:0/826251729 conn(0x55b2c3597980 msgr2=0x55b2c35996d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 -- 172.21.15.82:0/826251729 shutdown_connections 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 1 -- 172.21.15.82:0/826251729 wait complete. 2024-03-27T07:26:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.682+0000 7f7443a50740 20 client.16305 trim_cache size 0 max 16384 2024-03-27T07:26:52.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7443a50740 1 Processor -- start 2024-03-27T07:26:52.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7443a50740 1 -- start start 2024-03-27T07:26:52.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7443a50740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359d250 0x55b2c35a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7443a50740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7443a50740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 0x55b2c35be790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7443a50740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1b22f0 con 0x55b2c359db70 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7443a50740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1afb60 con 0x55b2c359d250 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7443a50740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1ad9d0 con 0x55b2c35a6750 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7431d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7431d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36186/0 (socket says 172.21.15.82:36186) 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7431d9b640 1 -- 172.21.15.82:0/2945523683 learned_addr learned my addr 172.21.15.82:0/2945523683 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f743ad9d640 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 0x55b2c35be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f743a59c640 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359d250 0x55b2c35a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7431d9b640 1 -- 172.21.15.82:0/2945523683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 msgr2=0x55b2c35be790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7431d9b640 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 0x55b2c35be790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7431d9b640 1 -- 172.21.15.82:0/2945523683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359d250 msgr2=0x55b2c35a5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7431d9b640 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359d250 0x55b2c35a5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f7431d9b640 1 -- 172.21.15.82:0/2945523683 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2c31d50f0 con 0x55b2c359db70 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f743ad9d640 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 0x55b2c35be790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.700+0000 7f743a59c640 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359d250 0x55b2c35a5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7431d9b640 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35b22e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f74240ef790 tx=0x7f74240de040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8751b6f9ee43289d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7423fff640 1 -- 172.21.15.82:0/2945523683 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742404b040 con 0x55b2c359db70 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7423fff640 1 -- 172.21.15.82:0/2945523683 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74240bdd90 con 0x55b2c359db70 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7423fff640 1 -- 172.21.15.82:0/2945523683 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240de0b0 con 0x55b2c359db70 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7443a50740 1 -- 172.21.15.82:0/2945523683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 msgr2=0x55b2c35b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7443a50740 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35b22e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f74240ef790 tx=0x7f74240de040 comp rx=0 tx=0).stop 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7443a50740 1 -- 172.21.15.82:0/2945523683 shutdown_connections 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7443a50740 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35b22e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7443a50740 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c35a6750 0x55b2c35be790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7443a50740 1 --2- 172.21.15.82:0/2945523683 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c359d250 0x55b2c35a5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7443a50740 1 -- 172.21.15.82:0/2945523683 >> 172.21.15.82:0/2945523683 conn(0x55b2c3597980 msgr2=0x55b2c35a27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:52.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7443a50740 1 -- 172.21.15.82:0/2945523683 shutdown_connections 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.701+0000 7f7443a50740 1 -- 172.21.15.82:0/2945523683 wait complete. 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7443a50740 1 -- start start 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7443a50740 1 Processor -- start 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7443a50740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 0x55b2c35a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7443a50740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7443a50740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c35a6750 0x55b2c361adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7443a50740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1ae020 con 0x55b2c359db70 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7443a50740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1af490 con 0x55b2c35a6750 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7443a50740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f743c1ae6f0 con 0x55b2c359d250 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7443a50740 10 client.0 _ll_register_callbacks cb 0x7f74240ba400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:52.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7431d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7431d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36190/0 (socket says 172.21.15.82:36190) 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7431d9b640 1 -- 172.21.15.82:0/2083623274 learned_addr learned my addr 172.21.15.82:0/2083623274 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f743a59c640 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 0x55b2c35a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f743ad9d640 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c35a6750 0x55b2c361adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7431d9b640 1 -- 172.21.15.82:0/2083623274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 msgr2=0x55b2c35a9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7431d9b640 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 0x55b2c35a9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7431d9b640 1 -- 172.21.15.82:0/2083623274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c35a6750 msgr2=0x55b2c361adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7431d9b640 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c35a6750 0x55b2c361adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7431d9b640 1 -- 172.21.15.82:0/2083623274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2c361b2f0 con 0x55b2c359db70 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7431d9b640 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35aa000 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f742404c000 tx=0x7f74240f5150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3cf43158949e90 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.702+0000 7f7421ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7421ffb640 1 -- 172.21.15.82:0/2083623274 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74240d7070 con 0x55b2c359db70 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7421ffb640 1 -- 172.21.15.82:0/2083623274 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f74240bc090 con 0x55b2c359db70 2024-03-27T07:26:52.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7443a50740 1 -- 172.21.15.82:0/2083623274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74240bdd90 con 0x55b2c359db70 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7421ffb640 1 -- 172.21.15.82:0/2083623274 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f742404b040 con 0x55b2c359db70 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7443a50740 10 client.16311 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7443a50740 1 -- 172.21.15.82:0/2083623274 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b2c361c570 con 0x55b2c359db70 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7421ffb640 1 -- 172.21.15.82:0/2083623274 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74240bdd90 con 0x55b2c359db70 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7421ffb640 1 -- 172.21.15.82:0/2083623274 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f74240ef410 con 0x55b2c359db70 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7443a50740 10 client.16311 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7443a50740 10 client.16311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7443a50740 20 client.16311 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7443a50740 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b2c361cb80 0x55b2c361ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7443a50740 4 client.16311 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f7443a50740 1 -- 172.21.15.82:0/2083623274 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2c35090f0 con 0x55b2c361cb80 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.703+0000 7f743a59c640 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b2c361cb80 0x55b2c361ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7421ffb640 10 client.16311 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f743a59c640 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b2c361cb80 0x55b2c361ef70 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6a9fbc9e8fe82a9 server_cookie=4dea3a10616c90ca in_seq=0 out_seq=0 2024-03-27T07:26:52.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7421ffb640 1 -- 172.21.15.82:0/2083623274 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b2c35090f0 con 0x55b2c361cb80 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7421ffb640 10 client.16311 handle_command_reply: tid=0 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 client.16311 shutdown 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 -- 172.21.15.82:0/2083623274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 msgr2=0x55b2c35aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35aa000 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f742404c000 tx=0x7f74240f5150 comp rx=0 tx=0).stop 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 -- 172.21.15.82:0/2083623274 shutdown_connections 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b2c361cb80 0x55b2c361ef70 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b2c359db70 0x55b2c35aa000 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b2c35a6750 0x55b2c361adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 --2- 172.21.15.82:0/2083623274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b2c359d250 0x55b2c35a9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7421ffb640 0 client.16311 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:52.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 -- 172.21.15.82:0/2083623274 >> 172.21.15.82:0/2083623274 conn(0x55b2c3597980 msgr2=0x55b2c3596090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 -- 172.21.15.82:0/2083623274 shutdown_connections 2024-03-27T07:26:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 1 -- 172.21.15.82:0/2083623274 wait complete. 2024-03-27T07:26:52.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7443a50740 20 client.16311 trim_cache size 0 max 16384 2024-03-27T07:26:52.714 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:26:52.714 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-03-27T07:26:52.714 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-03-27T07:26:52.714 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:26:52.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7440e6b640 1 -- 172.21.15.82:0/280816043 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74280a3800 msgr2=0x7f74280a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7440e6b640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74280a3800 0x7f74280a5cc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7434010610 tx=0x7f7434004a40 comp rx=0 tx=0).stop 2024-03-27T07:26:52.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7440e6b640 1 -- 172.21.15.82:0/280816043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f743c109030 msgr2=0x7f743c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7440e6b640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f743c109030 0x7f743c19ab80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7424036040 tx=0x7f742402cb20 comp rx=0 tx=0).stop 2024-03-27T07:26:52.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7440e6b640 1 -- 172.21.15.82:0/280816043 shutdown_connections 2024-03-27T07:26:52.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7440e6b640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74280a3800 0x7f74280a5cc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7440e6b640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f743c109030 0x7f743c19ab80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7440e6b640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f743c19ef00 0x7f743c19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7440e6b640 1 --2- 172.21.15.82:0/280816043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f743c103f60 0x7f743c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.704+0000 7f7440e6b640 1 -- 172.21.15.82:0/280816043 >> 172.21.15.82:0/280816043 conn(0x7f743c0ff7a0 msgr2=0x7f743c100b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:52.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.705+0000 7f7440e6b640 1 -- 172.21.15.82:0/280816043 shutdown_connections 2024-03-27T07:26:52.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.705+0000 7f7440e6b640 1 -- 172.21.15.82:0/280816043 wait complete. 2024-03-27T07:26:52.717 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T07:26:52.718 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:26:52.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:52 smithi149 ceph-mon[36065]: pgmap v101: 97 pgs: 97 active+clean; 497 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 682 op/s 2024-03-27T07:26:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.860+0000 7f39a75bc640 1 -- 172.21.15.82:0/3609344717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a0100a50 msgr2=0x7f39a0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.860+0000 7f39a75bc640 1 --2- 172.21.15.82:0/3609344717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a0100a50 0x7f39a0100ed0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3990009930 tx=0x7f399002bc30 comp rx=0 tx=0).stop 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.860+0000 7f39a75bc640 1 -- 172.21.15.82:0/3609344717 shutdown_connections 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.860+0000 7f39a75bc640 1 --2- 172.21.15.82:0/3609344717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a0100a50 0x7f39a0100ed0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.860+0000 7f39a75bc640 1 --2- 172.21.15.82:0/3609344717 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39a0101410 0x7f39a010d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.860+0000 7f39a75bc640 1 --2- 172.21.15.82:0/3609344717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39a0106a60 0x7f39a0106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.860+0000 7f39a75bc640 1 -- 172.21.15.82:0/3609344717 >> 172.21.15.82:0/3609344717 conn(0x7f39a0077b50 msgr2=0x7f39a0077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a75bc640 1 -- 172.21.15.82:0/3609344717 shutdown_connections 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a75bc640 1 -- 172.21.15.82:0/3609344717 wait complete. 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a75bc640 1 Processor -- start 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a75bc640 1 -- start start 2024-03-27T07:26:52.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a75bc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a0100a50 0x7f39a01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a75bc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39a0101410 0x7f39a01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a75bc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39a0106a60 0x7f39a019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a75bc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f39a0111f70 con 0x7f39a0100a50 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a75bc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f39a0111df0 con 0x7f39a0106a60 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a75bc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f39a01120f0 con 0x7f39a0101410 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a5358640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a0100a50 0x7f39a01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a5358640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a0100a50 0x7f39a01984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36208/0 (socket says 172.21.15.82:36208) 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a5358640 1 -- 172.21.15.82:0/3724729131 learned_addr learned my addr 172.21.15.82:0/3724729131 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a4b57640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39a0101410 0x7f39a01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.861+0000 7f39a5b59640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39a0106a60 0x7f39a019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39a5358640 1 -- 172.21.15.82:0/3724729131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39a0101410 msgr2=0x7f39a01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39a5358640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39a0101410 0x7f39a01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39a5358640 1 -- 172.21.15.82:0/3724729131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39a0106a60 msgr2=0x7f39a019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39a5358640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39a0106a60 0x7f39a019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39a5358640 1 -- 172.21.15.82:0/3724729131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a019d450 con 0x7f39a0100a50 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39a5358640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a0100a50 0x7f39a01984b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f399800eb90 tx=0x7f399800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39967fc640 1 -- 172.21.15.82:0/3724729131 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998004d20 con 0x7f39a0100a50 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39a75bc640 1 -- 172.21.15.82:0/3724729131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a019d740 con 0x7f39a0100a50 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39967fc640 1 -- 172.21.15.82:0/3724729131 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f399800ee90 con 0x7f39a0100a50 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39967fc640 1 -- 172.21.15.82:0/3724729131 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3998010830 con 0x7f39a0100a50 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.862+0000 7f39a75bc640 1 -- 172.21.15.82:0/3724729131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a01a4fd0 con 0x7f39a0100a50 2024-03-27T07:26:52.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.863+0000 7f39a75bc640 1 -- 172.21.15.82:0/3724729131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a0068940 con 0x7f39a0100a50 2024-03-27T07:26:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.864+0000 7f39967fc640 1 -- 172.21.15.82:0/3724729131 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f3998005020 con 0x7f39a0100a50 2024-03-27T07:26:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.865+0000 7f39967fc640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f398c0a3780 0x7f398c0a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.865+0000 7f39a4b57640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f398c0a3780 0x7f398c0a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.865+0000 7f39967fc640 1 -- 172.21.15.82:0/3724729131 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f39980d0650 con 0x7f39a0100a50 2024-03-27T07:26:52.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.865+0000 7f39a4b57640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f398c0a3780 0x7f398c0a5c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3990005ab0 tx=0x7f3990005fd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:52.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:52.869+0000 7f39967fc640 1 -- 172.21.15.82:0/3724729131 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f399809cf30 con 0x7f39a0100a50 2024-03-27T07:26:53.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.094+0000 7f39a75bc640 1 -- 172.21.15.82:0/3724729131 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39a0108fe0 con 0x7f39a0100a50 2024-03-27T07:26:53.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.095+0000 7f39967fc640 1 -- 172.21.15.82:0/3724729131 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11866 (secure 0 0 0) 0x7f399809c830 con 0x7f39a0100a50 2024-03-27T07:26:53.098 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:26:53.098 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:25:25.065944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:26:53.098 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2024-03-27T07:26:53.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 -- 172.21.15.82:0/3724729131 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f398c0a3780 msgr2=0x7f398c0a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f398c0a3780 0x7f398c0a5c40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3990005ab0 tx=0x7f3990005fd0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 -- 172.21.15.82:0/3724729131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a0100a50 msgr2=0x7f39a01984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a0100a50 0x7f39a01984b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f399800eb90 tx=0x7f399800c6a0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 -- 172.21.15.82:0/3724729131 shutdown_connections 2024-03-27T07:26:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f398c0a3780 0x7f398c0a5c40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f39a0106a60 0x7f39a019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39a0101410 0x7f39a01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 --2- 172.21.15.82:0/3724729131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f39a0100a50 0x7f39a01984b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 -- 172.21.15.82:0/3724729131 >> 172.21.15.82:0/3724729131 conn(0x7f39a0077b50 msgr2=0x7f39a01032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 -- 172.21.15.82:0/3724729131 shutdown_connections 2024-03-27T07:26:53.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.097+0000 7f39a75bc640 1 -- 172.21.15.82:0/3724729131 wait complete. 2024-03-27T07:26:53.111 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T07:26:53.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.217+0000 7f823b8af640 1 -- 172.21.15.82:0/2318817982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82341066d0 msgr2=0x7f8234106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.217+0000 7f823b8af640 1 --2- 172.21.15.82:0/2318817982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82341066d0 0x7f8234106b50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8224009900 tx=0x7f822402bc30 comp rx=0 tx=0).stop 2024-03-27T07:26:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.217+0000 7f823b8af640 1 -- 172.21.15.82:0/2318817982 shutdown_connections 2024-03-27T07:26:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.217+0000 7f823b8af640 1 --2- 172.21.15.82:0/2318817982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82341066d0 0x7f8234106b50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.217+0000 7f823b8af640 1 --2- 172.21.15.82:0/2318817982 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8234107090 0x7f823410e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.217+0000 7f823b8af640 1 --2- 172.21.15.82:0/2318817982 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8234069130 0x7f8234069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.217+0000 7f823b8af640 1 -- 172.21.15.82:0/2318817982 >> 172.21.15.82:0/2318817982 conn(0x7f8234077b50 msgr2=0x7f8234077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f823b8af640 1 -- 172.21.15.82:0/2318817982 shutdown_connections 2024-03-27T07:26:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f823b8af640 1 -- 172.21.15.82:0/2318817982 wait complete. 2024-03-27T07:26:53.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f823b8af640 1 Processor -- start 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f823b8af640 1 -- start start 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f823b8af640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8234069130 0x7f82341983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f823b8af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82341066d0 0x7f8234198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f823b8af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8234107090 0x7f823419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f823b8af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8234111ed0 con 0x7f8234107090 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f823b8af640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8234111d50 con 0x7f8234069130 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f823b8af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8234112050 con 0x7f82341066d0 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f8239e4c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8234107090 0x7f823419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f8239e4c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8234107090 0x7f823419cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36220/0 (socket says 172.21.15.82:36220) 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f8239e4c640 1 -- 172.21.15.82:0/239464836 learned_addr learned my addr 172.21.15.82:0/239464836 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.218+0000 7f8238e4a640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82341066d0 0x7f8234198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f823964b640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8234069130 0x7f82341983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f8239e4c640 1 -- 172.21.15.82:0/239464836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82341066d0 msgr2=0x7f8234198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f8239e4c640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82341066d0 0x7f8234198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f8239e4c640 1 -- 172.21.15.82:0/239464836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8234069130 msgr2=0x7f82341983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f8239e4c640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8234069130 0x7f82341983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f8239e4c640 1 -- 172.21.15.82:0/239464836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823419d3c0 con 0x7f8234107090 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f823964b640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8234069130 0x7f82341983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f8239e4c640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8234107090 0x7f823419cc90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f822c00eb10 tx=0x7f822c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f822a7fc640 1 -- 172.21.15.82:0/239464836 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c004b20 con 0x7f8234107090 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f822a7fc640 1 -- 172.21.15.82:0/239464836 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f822c004cc0 con 0x7f8234107090 2024-03-27T07:26:53.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f823b8af640 1 -- 172.21.15.82:0/239464836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823419d6b0 con 0x7f8234107090 2024-03-27T07:26:53.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f822a7fc640 1 -- 172.21.15.82:0/239464836 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f822c010760 con 0x7f8234107090 2024-03-27T07:26:53.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.219+0000 7f823b8af640 1 -- 172.21.15.82:0/239464836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82341a4f40 con 0x7f8234107090 2024-03-27T07:26:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.221+0000 7f822a7fc640 1 -- 172.21.15.82:0/239464836 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f822c005020 con 0x7f8234107090 2024-03-27T07:26:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823e575740 1 Processor -- start 2024-03-27T07:26:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823e575740 1 -- start start 2024-03-27T07:26:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823e575740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 0x56388c707b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823e575740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c710770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823e575740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c7130a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823e575740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56388c66b710 con 0x56388c7080d0 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823e575740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56388c613af0 con 0x56388c7077b0 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823e575740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56388c6676c0 con 0x56388c710cb0 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f822a7fc640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f82200a3800 0x7f82200a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823964b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c710770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823964b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c710770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36222/0 (socket says 172.21.15.82:36222) 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f8238e4a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 0x56388c707b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823964b640 1 -- 172.21.15.82:0/2769644916 learned_addr learned my addr 172.21.15.82:0/2769644916 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f8239e4c640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f82200a3800 0x7f82200a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f8238e4a640 1 --2- 172.21.15.82:0/2769644916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c7130a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f822a7fc640 1 -- 172.21.15.82:0/239464836 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f822c0d0750 con 0x7f8234107090 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823964b640 1 -- 172.21.15.82:0/2769644916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 msgr2=0x56388c7130a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823964b640 1 --2- 172.21.15.82:0/2769644916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c7130a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823964b640 1 -- 172.21.15.82:0/2769644916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 msgr2=0x56388c707b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823964b640 1 --2- 172.21.15.82:0/2769644916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 0x56388c707b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823964b640 1 -- 172.21.15.82:0/2769644916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388c37f3f0 con 0x56388c7080d0 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f8238e4a640 1 --2- 172.21.15.82:0/2769644916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 0x56388c707b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f8239e4c640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f82200a3800 0x7f82200a5cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f822c09c8c0 tx=0x7f822c06c400 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.222+0000 7f823964b640 1 --2- 172.21.15.82:0/2769644916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c710770 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8230009d50 tx=0x7f82300117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd646133bcf0b07 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f821f7fe640 1 -- 172.21.15.82:0/2769644916 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230012650 con 0x56388c7080d0 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f821f7fe640 1 -- 172.21.15.82:0/2769644916 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8230009e40 con 0x56388c7080d0 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f821f7fe640 1 -- 172.21.15.82:0/2769644916 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823000fbf0 con 0x56388c7080d0 2024-03-27T07:26:53.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f823e575740 1 -- 172.21.15.82:0/2769644916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 msgr2=0x56388c710770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f823e575740 1 --2- 172.21.15.82:0/2769644916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c710770 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8230009d50 tx=0x7f82300117b0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f823e575740 1 -- 172.21.15.82:0/2769644916 shutdown_connections 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f823e575740 1 --2- 172.21.15.82:0/2769644916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c710770 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f823e575740 1 --2- 172.21.15.82:0/2769644916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c7130a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f823e575740 1 --2- 172.21.15.82:0/2769644916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 0x56388c707b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f823e575740 1 -- 172.21.15.82:0/2769644916 >> 172.21.15.82:0/2769644916 conn(0x56388c701ee0 msgr2=0x56388c7022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f823e575740 1 -- 172.21.15.82:0/2769644916 shutdown_connections 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.223+0000 7f823e575740 1 -- 172.21.15.82:0/2769644916 wait complete. 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f823e575740 1 -- start start 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f823e575740 1 Processor -- start 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f823e575740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 0x56388c70dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f823e575740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c7080d0 0x56388c70e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f823e575740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c710cb0 0x56388c70e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f823e575740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56388c713aa0 con 0x56388c7077b0 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f823e575740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56388c626eb0 con 0x56388c710cb0 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f823e575740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56388c713c20 con 0x56388c7080d0 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f823e575740 10 client.0 _ll_register_callbacks cb 0x56388c6636a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f8238e4a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 0x56388c70dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f8238e4a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 0x56388c70dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36224/0 (socket says 172.21.15.82:36224) 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f8238e4a640 1 -- 172.21.15.82:0/3931566864 learned_addr learned my addr 172.21.15.82:0/3931566864 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f823964b640 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c7080d0 0x56388c70e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.224+0000 7f8238e4a640 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c710cb0 0x56388c70e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f8238e4a640 1 -- 172.21.15.82:0/3931566864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c7080d0 msgr2=0x56388c70e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f8238e4a640 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c7080d0 0x56388c70e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f8238e4a640 1 -- 172.21.15.82:0/3931566864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c710cb0 msgr2=0x56388c70e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f8238e4a640 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c710cb0 0x56388c70e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f8238e4a640 1 -- 172.21.15.82:0/3931566864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388c4497d0 con 0x56388c7077b0 2024-03-27T07:26:53.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f8238e4a640 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 0x56388c70dcb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f822402c170 tx=0x7f822402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a69fbb0fe79869 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f821cff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f821cff9640 1 -- 172.21.15.82:0/3931566864 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224004ad0 con 0x56388c7077b0 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f821cff9640 1 -- 172.21.15.82:0/3931566864 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f8224004ec0 con 0x56388c7077b0 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f823e575740 1 -- 172.21.15.82:0/3931566864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56388c678c50 con 0x56388c7077b0 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f821cff9640 1 -- 172.21.15.82:0/3931566864 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8224004c70 con 0x56388c7077b0 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f823e575740 10 client.16329 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f823e575740 1 -- 172.21.15.82:0/3931566864 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56388c71fd30 con 0x56388c7077b0 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f821cff9640 1 -- 172.21.15.82:0/3931566864 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56388c678c50 con 0x56388c7077b0 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f821cff9640 1 -- 172.21.15.82:0/3931566864 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8224003c20 con 0x56388c7077b0 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f823e575740 10 client.16329 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f823e575740 10 client.16329 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f823e575740 20 client.16329 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f823e575740 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56388c7211f0 0x56388c7235e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f823e575740 4 client.16329 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:53.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.225+0000 7f823e575740 1 -- 172.21.15.82:0/3931566864 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56388c672fa0 con 0x56388c7211f0 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.226+0000 7f823964b640 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56388c7211f0 0x56388c7235e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.226+0000 7f821cff9640 10 client.16329 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.226+0000 7f823964b640 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56388c7211f0 0x56388c7235e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e99aa117a725590c server_cookie=763b52b8087bd2b5 in_seq=0 out_seq=0 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f821cff9640 1 -- 172.21.15.82:0/3931566864 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56388c672fa0 con 0x56388c7211f0 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f821cff9640 10 client.16329 handle_command_reply: tid=0 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 client.16329 shutdown 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 -- 172.21.15.82:0/3931566864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 msgr2=0x56388c70dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 0x56388c70dcb0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f822402c170 tx=0x7f822402bc30 comp rx=0 tx=0).stop 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 -- 172.21.15.82:0/3931566864 shutdown_connections 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56388c7211f0 0x56388c7235e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c710cb0 0x56388c70e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c7080d0 0x56388c70e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f821cff9640 0 client.16329 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 --2- 172.21.15.82:0/3931566864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 0x56388c70dcb0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 -- 172.21.15.82:0/3931566864 >> 172.21.15.82:0/3931566864 conn(0x56388c701ee0 msgr2=0x56388c703c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 -- 172.21.15.82:0/3931566864 shutdown_connections 2024-03-27T07:26:53.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 1 -- 172.21.15.82:0/3931566864 wait complete. 2024-03-27T07:26:53.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.227+0000 7f823e575740 20 client.16329 trim_cache size 0 max 16384 2024-03-27T07:26:53.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.240+0000 7f823e575740 1 Processor -- start 2024-03-27T07:26:53.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.240+0000 7f823e575740 1 -- start start 2024-03-27T07:26:53.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.240+0000 7f823e575740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 0x56388c71c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.240+0000 7f823e575740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c70e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.240+0000 7f823e575740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c728dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.240+0000 7f823e575740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f82341b0190 con 0x56388c7080d0 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.240+0000 7f823e575740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82341ada00 con 0x56388c7077b0 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.240+0000 7f823e575740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82341ab850 con 0x56388c710cb0 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823964b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c70e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823964b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c70e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36228/0 (socket says 172.21.15.82:36228) 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823964b640 1 -- 172.21.15.82:0/3634353737 learned_addr learned my addr 172.21.15.82:0/3634353737 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f8238e4a640 1 --2- 172.21.15.82:0/3634353737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 0x56388c71c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f8238e4a640 1 --2- 172.21.15.82:0/3634353737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c728dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823964b640 1 -- 172.21.15.82:0/3634353737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 msgr2=0x56388c728dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823964b640 1 --2- 172.21.15.82:0/3634353737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c728dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823964b640 1 -- 172.21.15.82:0/3634353737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 msgr2=0x56388c71c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823964b640 1 --2- 172.21.15.82:0/3634353737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 0x56388c71c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823964b640 1 -- 172.21.15.82:0/3634353737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56388c723ba0 con 0x56388c7080d0 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f8238e4a640 1 --2- 172.21.15.82:0/3634353737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c728dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823964b640 1 --2- 172.21.15.82:0/3634353737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c70e550 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8230009a00 tx=0x7f823000f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d4e6682d753bd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f821effd640 1 -- 172.21.15.82:0/3634353737 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823000f670 con 0x56388c7080d0 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f821effd640 1 -- 172.21.15.82:0/3634353737 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8230005520 con 0x56388c7080d0 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f821effd640 1 -- 172.21.15.82:0/3634353737 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82300291d0 con 0x56388c7080d0 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823e575740 1 -- 172.21.15.82:0/3634353737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 msgr2=0x56388c70e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.241+0000 7f823e575740 1 --2- 172.21.15.82:0/3634353737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c70e550 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8230009a00 tx=0x7f823000f830 comp rx=0 tx=0).stop 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.242+0000 7f823e575740 1 -- 172.21.15.82:0/3634353737 shutdown_connections 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.242+0000 7f823e575740 1 --2- 172.21.15.82:0/3634353737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7080d0 0x56388c70e550 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.242+0000 7f823e575740 1 --2- 172.21.15.82:0/3634353737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c728dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.242+0000 7f823e575740 1 --2- 172.21.15.82:0/3634353737 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7077b0 0x56388c71c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.242+0000 7f823e575740 1 -- 172.21.15.82:0/3634353737 >> 172.21.15.82:0/3634353737 conn(0x56388c701ee0 msgr2=0x56388c700770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.242+0000 7f823e575740 1 -- 172.21.15.82:0/3634353737 shutdown_connections 2024-03-27T07:26:53.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.242+0000 7f823e575740 1 -- 172.21.15.82:0/3634353737 wait complete. 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.242+0000 7f823e575740 1 -- start start 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.242+0000 7f823e575740 1 Processor -- start 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.243+0000 7f823e575740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 0x56388c718ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.243+0000 7f823e575740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7080d0 0x56388c714270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.243+0000 7f823e575740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c7147b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.243+0000 7f823e575740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f82341abec0 con 0x56388c7077b0 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.243+0000 7f823e575740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f82341ad330 con 0x56388c7080d0 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.243+0000 7f823e575740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82341ac590 con 0x56388c710cb0 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.243+0000 7f823e575740 10 client.0 _ll_register_callbacks cb 0x7f8224004130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.243+0000 7f823964b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7080d0 0x56388c714270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.243+0000 7f823964b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7080d0 0x56388c714270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:41952/0 (socket says 172.21.15.82:41952) 2024-03-27T07:26:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.243+0000 7f823964b640 1 -- 172.21.15.82:0/273526704 learned_addr learned my addr 172.21.15.82:0/273526704 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.248+0000 7f823964b640 1 -- 172.21.15.82:0/273526704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 msgr2=0x56388c7147b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:26:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.248+0000 7f823964b640 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c7147b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.248+0000 7f823964b640 1 -- 172.21.15.82:0/273526704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 msgr2=0x56388c718ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:26:53.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.248+0000 7f823964b640 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 0x56388c718ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.248+0000 7f823964b640 1 -- 172.21.15.82:0/273526704 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56388c714d20 con 0x56388c7080d0 2024-03-27T07:26:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.253+0000 7f823964b640 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7080d0 0x56388c714270 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f823001c040 tx=0x7f82300117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7cc19c29231887 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.253+0000 7f821cff9640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:26:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.253+0000 7f821cff9640 1 -- 172.21.15.82:0/273526704 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230036060 con 0x56388c7080d0 2024-03-27T07:26:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.254+0000 7f823e575740 1 -- 172.21.15.82:0/273526704 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8230005520 con 0x56388c7080d0 2024-03-27T07:26:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.254+0000 7f821cff9640 1 -- 172.21.15.82:0/273526704 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f8230009530 con 0x56388c7080d0 2024-03-27T07:26:53.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.254+0000 7f821cff9640 1 -- 172.21.15.82:0/273526704 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8230005340 con 0x56388c7080d0 2024-03-27T07:26:53.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.254+0000 7f823e575740 10 client.26159 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:53.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.254+0000 7f823e575740 1 -- 172.21.15.82:0/273526704 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56388c78b500 con 0x56388c7080d0 2024-03-27T07:26:53.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.254+0000 7f821cff9640 1 -- 172.21.15.82:0/273526704 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8230005520 con 0x56388c7080d0 2024-03-27T07:26:53.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.255+0000 7f821cff9640 1 -- 172.21.15.82:0/273526704 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f82300035f0 con 0x56388c7080d0 2024-03-27T07:26:53.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.255+0000 7f823e575740 10 client.26159 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:53.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.255+0000 7f823e575740 10 client.26159 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:26:53.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.255+0000 7f823e575740 20 client.26159 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:53.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.255+0000 7f823e575740 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56388c78bb90 0x56388c78e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.255+0000 7f823e575740 4 client.26159 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:26:53.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.255+0000 7f823e575740 1 -- 172.21.15.82:0/273526704 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56388c5f06a0 con 0x56388c78bb90 2024-03-27T07:26:53.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.260+0000 7f8238e4a640 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56388c78bb90 0x56388c78e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.263+0000 7f821cff9640 10 client.26159 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:26:53.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.263+0000 7f8238e4a640 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56388c78bb90 0x56388c78e050 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1f3f1a2d52a33b5b server_cookie=80861497434d8806 in_seq=0 out_seq=0 2024-03-27T07:26:53.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.263+0000 7f821cff9640 1 -- 172.21.15.82:0/273526704 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56388c5f06a0 con 0x56388c78bb90 2024-03-27T07:26:53.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.263+0000 7f821cff9640 10 client.26159 handle_command_reply: tid=0 2024-03-27T07:26:53.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.263+0000 7f823e575740 1 client.26159 shutdown 2024-03-27T07:26:53.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.263+0000 7f823e575740 1 -- 172.21.15.82:0/273526704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7080d0 msgr2=0x56388c714270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.263+0000 7f823e575740 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7080d0 0x56388c714270 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f823001c040 tx=0x7f82300117b0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.263+0000 7f823e575740 1 -- 172.21.15.82:0/273526704 shutdown_connections 2024-03-27T07:26:53.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.264+0000 7f823e575740 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x56388c78bb90 0x56388c78e050 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.264+0000 7f823e575740 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56388c710cb0 0x56388c7147b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.264+0000 7f823e575740 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56388c7080d0 0x56388c714270 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.264+0000 7f823e575740 1 --2- 172.21.15.82:0/273526704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56388c7077b0 0x56388c718ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.264+0000 7f823e575740 1 -- 172.21.15.82:0/273526704 >> 172.21.15.82:0/273526704 conn(0x56388c701ee0 msgr2=0x56388c703070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.264+0000 7f821cff9640 0 client.26159 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:26:53.281 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:26:53.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.275+0000 7f823e575740 1 -- 172.21.15.82:0/273526704 shutdown_connections 2024-03-27T07:26:53.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.275+0000 7f823e575740 1 -- 172.21.15.82:0/273526704 wait complete. 2024-03-27T07:26:53.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.275+0000 7f823e575740 20 client.26159 trim_cache size 0 max 16384 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.276+0000 7f823b8af640 1 -- 172.21.15.82:0/239464836 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f82200a3800 msgr2=0x7f82200a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.276+0000 7f823b8af640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f82200a3800 0x7f82200a5cc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f822c09c8c0 tx=0x7f822c06c400 comp rx=0 tx=0).stop 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.276+0000 7f823b8af640 1 -- 172.21.15.82:0/239464836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8234107090 msgr2=0x7f823419cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.276+0000 7f823b8af640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8234107090 0x7f823419cc90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f822c00eb10 tx=0x7f822c00c2d0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.276+0000 7f823b8af640 1 -- 172.21.15.82:0/239464836 shutdown_connections 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.276+0000 7f823b8af640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f82200a3800 0x7f82200a5cc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.276+0000 7f823b8af640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8234107090 0x7f823419cc90 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.276+0000 7f823b8af640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f82341066d0 0x7f8234198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.276+0000 7f823b8af640 1 --2- 172.21.15.82:0/239464836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8234069130 0x7f82341983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.276+0000 7f823b8af640 1 -- 172.21.15.82:0/239464836 >> 172.21.15.82:0/239464836 conn(0x7f8234077b50 msgr2=0x7f82340fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.277+0000 7f823b8af640 1 -- 172.21.15.82:0/239464836 shutdown_connections 2024-03-27T07:26:53.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.277+0000 7f823b8af640 1 -- 172.21.15.82:0/239464836 wait complete. 2024-03-27T07:26:53.307 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.411+0000 7f5fcc577640 1 -- 172.21.15.82:0/3564368315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fc4100a00 msgr2=0x7f5fc4100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.411+0000 7f5fcc577640 1 --2- 172.21.15.82:0/3564368315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fc4100a00 0x7f5fc4100e80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009930 tx=0x7f5fb402bc30 comp rx=0 tx=0).stop 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.411+0000 7f5fcc577640 1 -- 172.21.15.82:0/3564368315 shutdown_connections 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.411+0000 7f5fcc577640 1 --2- 172.21.15.82:0/3564368315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fc4100a00 0x7f5fc4100e80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.411+0000 7f5fcc577640 1 --2- 172.21.15.82:0/3564368315 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc41013c0 0x7f5fc410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.411+0000 7f5fcc577640 1 --2- 172.21.15.82:0/3564368315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4106a10 0x7f5fc4106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.411+0000 7f5fcc577640 1 -- 172.21.15.82:0/3564368315 >> 172.21.15.82:0/3564368315 conn(0x7f5fc4076dd0 msgr2=0x7f5fc40771e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.411+0000 7f5fcc577640 1 -- 172.21.15.82:0/3564368315 shutdown_connections 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.411+0000 7f5fcc577640 1 -- 172.21.15.82:0/3564368315 wait complete. 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fcc577640 1 Processor -- start 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fcc577640 1 -- start start 2024-03-27T07:26:53.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fcc577640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fc4100a00 0x7f5fc4197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fcc577640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc41013c0 0x7f5fc4197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fcc577640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4106a10 0x7f5fc419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fcc577640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4110e20 con 0x7f5fc4100a00 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fcc577640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4110ca0 con 0x7f5fc41013c0 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fcc577640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc4110fa0 con 0x7f5fc4106a10 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fca313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fc4100a00 0x7f5fc4197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fca313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fc4100a00 0x7f5fc4197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36244/0 (socket says 172.21.15.82:36244) 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fca313640 1 -- 172.21.15.82:0/117942806 learned_addr learned my addr 172.21.15.82:0/117942806 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc41013c0 0x7f5fc4197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fcab14640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4106a10 0x7f5fc419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fca313640 1 -- 172.21.15.82:0/117942806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4106a10 msgr2=0x7f5fc419bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fca313640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4106a10 0x7f5fc419bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fca313640 1 -- 172.21.15.82:0/117942806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc41013c0 msgr2=0x7f5fc4197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fca313640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc41013c0 0x7f5fc4197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fca313640 1 -- 172.21.15.82:0/117942806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc419c310 con 0x7f5fc4100a00 2024-03-27T07:26:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.412+0000 7f5fcab14640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4106a10 0x7f5fc419bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.413+0000 7f5fca313640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fc4100a00 0x7f5fc4197320 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000e9f0 tx=0x7f5fc000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.413+0000 7f5fbb7fe640 1 -- 172.21.15.82:0/117942806 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc000cd80 con 0x7f5fc4100a00 2024-03-27T07:26:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.413+0000 7f5fcc577640 1 -- 172.21.15.82:0/117942806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc419c600 con 0x7f5fc4100a00 2024-03-27T07:26:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.413+0000 7f5fbb7fe640 1 -- 172.21.15.82:0/117942806 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fc0005500 con 0x7f5fc4100a00 2024-03-27T07:26:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.413+0000 7f5fbb7fe640 1 -- 172.21.15.82:0/117942806 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0010690 con 0x7f5fc4100a00 2024-03-27T07:26:53.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.413+0000 7f5fcc577640 1 -- 172.21.15.82:0/117942806 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc41a3e90 con 0x7f5fc4100a00 2024-03-27T07:26:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.415+0000 7f5fbb7fe640 1 -- 172.21.15.82:0/117942806 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f5fc00046c0 con 0x7f5fc4100a00 2024-03-27T07:26:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.415+0000 7f5fcf237740 1 Processor -- start 2024-03-27T07:26:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fcf237740 1 -- start start 2024-03-27T07:26:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fbb7fe640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5fb00a3780 0x7f5fb00a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c32b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c330d0 0x564201c3b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c3bcb0 0x564201c3e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fbb7fe640 1 -- 172.21.15.82:0/117942806 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f5fc00d04c0 con 0x7f5fc4100a00 2024-03-27T07:26:53.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fcf237740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564201b96710 con 0x564201c327b0 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fcf237740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x564201b3eaf0 con 0x564201c3bcb0 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fcf237740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564201b926c0 con 0x564201c330d0 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fcab14640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5fb00a3780 0x7f5fb00a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fca313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c32b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fca313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c32b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36254/0 (socket says 172.21.15.82:36254) 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fca313640 1 -- 172.21.15.82:0/1574138558 learned_addr learned my addr 172.21.15.82:0/1574138558 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/1574138558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c330d0 0x564201c3b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fcab14640 1 --2- 172.21.15.82:0/1574138558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c3bcb0 0x564201c3e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fca313640 1 -- 172.21.15.82:0/1574138558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c330d0 msgr2=0x564201c3b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fca313640 1 --2- 172.21.15.82:0/1574138558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c330d0 0x564201c3b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fca313640 1 -- 172.21.15.82:0/1574138558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c3bcb0 msgr2=0x564201c3e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fca313640 1 --2- 172.21.15.82:0/1574138558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c3bcb0 0x564201c3e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fca313640 1 -- 172.21.15.82:0/1574138558 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642018aa3f0 con 0x564201c327b0 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/1574138558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c330d0 0x564201c3b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fcab14640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5fb00a3780 0x7f5fb00a5c40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009fd0 tx=0x7f5fbc014cb0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.416+0000 7f5fca313640 1 --2- 172.21.15.82:0/1574138558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c32b90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00a4de0 tx=0x7f5fc009c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec6fef339fcae1c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fb8bfe640 1 -- 172.21.15.82:0/1574138558 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00b5070 con 0x564201c327b0 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fb8bfe640 1 -- 172.21.15.82:0/1574138558 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fc009c6a0 con 0x564201c327b0 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fb8bfe640 1 -- 172.21.15.82:0/1574138558 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc009c900 con 0x564201c327b0 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fcf237740 1 -- 172.21.15.82:0/1574138558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 msgr2=0x564201c32b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1574138558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c32b90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00a4de0 tx=0x7f5fc009c1e0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fcf237740 1 -- 172.21.15.82:0/1574138558 shutdown_connections 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1574138558 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c3bcb0 0x564201c3e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1574138558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c330d0 0x564201c3b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1574138558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c32b90 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fcf237740 1 -- 172.21.15.82:0/1574138558 >> 172.21.15.82:0/1574138558 conn(0x564201c2cee0 msgr2=0x564201c2d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fcf237740 1 -- 172.21.15.82:0/1574138558 shutdown_connections 2024-03-27T07:26:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.417+0000 7f5fcf237740 1 -- 172.21.15.82:0/1574138558 wait complete. 2024-03-27T07:26:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcf237740 1 -- start start 2024-03-27T07:26:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcf237740 1 Processor -- start 2024-03-27T07:26:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c38d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c330d0 0x564201c39290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201c397d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcf237740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564201c3ea40 con 0x564201c327b0 2024-03-27T07:26:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcf237740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x564201b51eb0 con 0x564201c330d0 2024-03-27T07:26:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcf237740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x564201c3ebc0 con 0x564201c3bcb0 2024-03-27T07:26:53.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcf237740 10 client.0 _ll_register_callbacks cb 0x564201b8e6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fca313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c38d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fca313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c38d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36266/0 (socket says 172.21.15.82:36266) 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fca313640 1 -- 172.21.15.82:0/3214282884 learned_addr learned my addr 172.21.15.82:0/3214282884 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c330d0 0x564201c39290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcab14640 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201c397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fca313640 1 -- 172.21.15.82:0/3214282884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 msgr2=0x564201c397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fca313640 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201c397d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fca313640 1 -- 172.21.15.82:0/3214282884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c330d0 msgr2=0x564201c39290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fca313640 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c330d0 0x564201c39290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fca313640 1 -- 172.21.15.82:0/3214282884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642019747d0 con 0x564201c327b0 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fcab14640 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201c397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c330d0 0x564201c39290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:53.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fca313640 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c38d50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0098b00 tx=0x7f5fc00cdbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71082450d6f1ae9a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.418+0000 7f5fadffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fadffb640 1 -- 172.21.15.82:0/3214282884 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00b9020 con 0x564201c327b0 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fadffb640 1 -- 172.21.15.82:0/3214282884 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f5fc009cb10 con 0x564201c327b0 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fcf237740 1 -- 172.21.15.82:0/3214282884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fc009c6a0 con 0x564201c327b0 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fadffb640 1 -- 172.21.15.82:0/3214282884 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5fc00b5040 con 0x564201c327b0 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fcf237740 10 client.16344 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fcf237740 1 -- 172.21.15.82:0/3214282884 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564201c4ad40 con 0x564201c327b0 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fadffb640 1 -- 172.21.15.82:0/3214282884 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fc009c6a0 con 0x564201c327b0 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fadffb640 1 -- 172.21.15.82:0/3214282884 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5fc00a4e80 con 0x564201c327b0 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fcf237740 10 client.16344 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fcf237740 10 client.16344 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fcf237740 20 client.16344 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:53.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fcf237740 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x564201c4c090 0x564201c4e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fcf237740 4 client.16344 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fcf237740 1 -- 172.21.15.82:0/3214282884 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564201ba3c50 con 0x564201c4c090 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.419+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x564201c4c090 0x564201c4e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.420+0000 7f5fadffb640 10 client.16344 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.420+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x564201c4c090 0x564201c4e480 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd4bdedbcafc7314 server_cookie=838397ca5ab9d92 in_seq=0 out_seq=0 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fadffb640 1 -- 172.21.15.82:0/3214282884 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x564201ba3c50 con 0x564201c4c090 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fadffb640 10 client.16344 handle_command_reply: tid=0 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 client.16344 shutdown 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 -- 172.21.15.82:0/3214282884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 msgr2=0x564201c38d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c38d50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0098b00 tx=0x7f5fc00cdbf0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 -- 172.21.15.82:0/3214282884 shutdown_connections 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x564201c4c090 0x564201c4e480 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201c397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c330d0 0x564201c39290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fadffb640 0 client.16344 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:26:53.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 --2- 172.21.15.82:0/3214282884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c327b0 0x564201c38d50 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 -- 172.21.15.82:0/3214282884 >> 172.21.15.82:0/3214282884 conn(0x564201c2cee0 msgr2=0x564201c2ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 -- 172.21.15.82:0/3214282884 shutdown_connections 2024-03-27T07:26:53.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 1 -- 172.21.15.82:0/3214282884 wait complete. 2024-03-27T07:26:53.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.421+0000 7f5fcf237740 20 client.16344 trim_cache size 0 max 16384 2024-03-27T07:26:53.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.434+0000 7f5fcf237740 1 Processor -- start 2024-03-27T07:26:53.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fcf237740 1 -- start start 2024-03-27T07:26:53.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 0x564201c3b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201c395f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fcf237740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc41aefa0 con 0x564201c330d0 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fcf237740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc41ac810 con 0x564201c327b0 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fcf237740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc41aa660 con 0x564201c3bcb0 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fc9b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fc9b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36282/0 (socket says 172.21.15.82:36282) 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fc9b12640 1 -- 172.21.15.82:0/1839793865 learned_addr learned my addr 172.21.15.82:0/1839793865 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fca313640 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 0x564201c3b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fcab14640 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201c395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fc9b12640 1 -- 172.21.15.82:0/1839793865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 msgr2=0x564201c395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201c395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fc9b12640 1 -- 172.21.15.82:0/1839793865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 msgr2=0x564201c3b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 0x564201c3b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fc9b12640 1 -- 172.21.15.82:0/1839793865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564201c3ea90 con 0x564201c330d0 2024-03-27T07:26:53.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fca313640 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 0x564201c3b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:53.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fcab14640 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201c395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:53.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c516a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4005ab0 tx=0x7f5fb4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d49a785c805756f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5faffff640 1 -- 172.21.15.82:0/1839793865 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb404b070 con 0x564201c330d0 2024-03-27T07:26:53.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5faffff640 1 -- 172.21.15.82:0/1839793865 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb4047d10 con 0x564201c330d0 2024-03-27T07:26:53.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.435+0000 7f5faffff640 1 -- 172.21.15.82:0/1839793865 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4047750 con 0x564201c330d0 2024-03-27T07:26:53.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:53 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3724729131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:26:53.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 -- 172.21.15.82:0/1839793865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 msgr2=0x564201c516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c516a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4005ab0 tx=0x7f5fb4005fd0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 -- 172.21.15.82:0/1839793865 shutdown_connections 2024-03-27T07:26:53.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c516a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201c395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1839793865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 0x564201c3b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 -- 172.21.15.82:0/1839793865 >> 172.21.15.82:0/1839793865 conn(0x564201c2cee0 msgr2=0x564201c2ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 -- 172.21.15.82:0/1839793865 shutdown_connections 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 -- 172.21.15.82:0/1839793865 wait complete. 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 -- start start 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.436+0000 7f5fcf237740 1 Processor -- start 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 0x564201c35ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c36530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcf237740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201cab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcf237740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc41aacd0 con 0x564201c330d0 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcf237740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc41ac140 con 0x564201c327b0 2024-03-27T07:26:53.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcf237740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc41ab3a0 con 0x564201c3bcb0 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcf237740 10 client.0 _ll_register_callbacks cb 0x7f5fc00b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fc9b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c36530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fc9b12640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c36530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36296/0 (socket says 172.21.15.82:36296) 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fc9b12640 1 -- 172.21.15.82:0/1341232003 learned_addr learned my addr 172.21.15.82:0/1341232003 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fca313640 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 0x564201c35ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcab14640 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201cab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fc9b12640 1 -- 172.21.15.82:0/1341232003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 msgr2=0x564201cab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201cab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fc9b12640 1 -- 172.21.15.82:0/1341232003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 msgr2=0x564201c35ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 0x564201c35ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fc9b12640 1 -- 172.21.15.82:0/1341232003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564201cabc40 con 0x564201c330d0 2024-03-27T07:26:53.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fc9b12640 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c36530 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5fb402c170 tx=0x7f5fb402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f52a9221a735652 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fadffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fadffb640 1 -- 172.21.15.82:0/1341232003 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4056070 con 0x564201c330d0 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fadffb640 1 -- 172.21.15.82:0/1341232003 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f5fb4004240 con 0x564201c330d0 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcf237740 1 -- 172.21.15.82:0/1341232003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fb4047d10 con 0x564201c330d0 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fadffb640 1 -- 172.21.15.82:0/1341232003 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5fb405f050 con 0x564201c330d0 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcf237740 10 client.16350 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.437+0000 7f5fcf237740 1 -- 172.21.15.82:0/1341232003 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564201cb41e0 con 0x564201c330d0 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fadffb640 1 -- 172.21.15.82:0/1341232003 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fb4047d10 con 0x564201c330d0 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fadffb640 1 -- 172.21.15.82:0/1341232003 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5fb4059030 con 0x564201c330d0 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fcf237740 10 client.16350 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fcf237740 10 client.16350 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fcf237740 20 client.16350 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:53.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x564201cb4900 0x564201cb6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fcf237740 4 client.16350 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fcf237740 1 -- 172.21.15.82:0/1341232003 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564201b9dfa0 con 0x564201cb4900 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fca313640 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x564201cb4900 0x564201cb6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fca313640 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x564201cb4900 0x564201cb6d20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=520051bfddee3c36 server_cookie=7cd9ad8afabc137d in_seq=0 out_seq=0 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.438+0000 7f5fadffb640 10 client.16350 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fadffb640 1 -- 172.21.15.82:0/1341232003 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564201b9dfa0 con 0x564201cb4900 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fadffb640 10 client.16350 handle_command_reply: tid=0 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 client.16350 shutdown 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 -- 172.21.15.82:0/1341232003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 msgr2=0x564201c36530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c36530 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f5fb402c170 tx=0x7f5fb402bc30 comp rx=0 tx=0).stop 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 -- 172.21.15.82:0/1341232003 shutdown_connections 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x564201cb4900 0x564201cb6d20 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564201c330d0 0x564201c36530 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x564201c3bcb0 0x564201cab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 --2- 172.21.15.82:0/1341232003 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x564201c327b0 0x564201c35ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 -- 172.21.15.82:0/1341232003 >> 172.21.15.82:0/1341232003 conn(0x564201c2cee0 msgr2=0x564201c2b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fadffb640 0 client.16350 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:26:53.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 -- 172.21.15.82:0/1341232003 shutdown_connections 2024-03-27T07:26:53.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 1 -- 172.21.15.82:0/1341232003 wait complete. 2024-03-27T07:26:53.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.439+0000 7f5fcf237740 20 client.16350 trim_cache size 0 max 16384 2024-03-27T07:26:53.449 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:26:53.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 -- 172.21.15.82:0/117942806 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5fb00a3780 msgr2=0x7f5fb00a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5fb00a3780 0x7f5fb00a5c40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009fd0 tx=0x7f5fbc014cb0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 -- 172.21.15.82:0/117942806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fc4100a00 msgr2=0x7f5fc4197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fc4100a00 0x7f5fc4197320 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000e9f0 tx=0x7f5fc000edf0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 -- 172.21.15.82:0/117942806 shutdown_connections 2024-03-27T07:26:53.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5fb00a3780 0x7f5fb00a5c40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4106a10 0x7f5fc419bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5fc41013c0 0x7f5fc4197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 --2- 172.21.15.82:0/117942806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5fc4100a00 0x7f5fc4197320 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 -- 172.21.15.82:0/117942806 >> 172.21.15.82:0/117942806 conn(0x7f5fc4076dd0 msgr2=0x7f5fc40fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 -- 172.21.15.82:0/117942806 shutdown_connections 2024-03-27T07:26:53.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.440+0000 7f5fcc577640 1 -- 172.21.15.82:0/117942806 wait complete. 2024-03-27T07:26:53.452 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T07:26:53.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:53 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3724729131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:26:53.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.568+0000 7fdab7283640 1 -- 172.21.15.82:0/2177028622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0103670 msgr2=0x7fdab010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.568+0000 7fdab7283640 1 --2- 172.21.15.82:0/2177028622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0103670 0x7fdab010bb50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009860 tx=0x7fdaa002bc00 comp rx=0 tx=0).stop 2024-03-27T07:26:53.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.568+0000 7fdab7283640 1 -- 172.21.15.82:0/2177028622 shutdown_connections 2024-03-27T07:26:53.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.568+0000 7fdab7283640 1 --2- 172.21.15.82:0/2177028622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab010c120 0x7fdab010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.568+0000 7fdab7283640 1 --2- 172.21.15.82:0/2177028622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0103670 0x7fdab010bb50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.568+0000 7fdab7283640 1 --2- 172.21.15.82:0/2177028622 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab0102d50 0x7fdab0103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.568+0000 7fdab7283640 1 -- 172.21.15.82:0/2177028622 >> 172.21.15.82:0/2177028622 conn(0x7fdab0077800 msgr2=0x7fdab00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.568+0000 7fdab7283640 1 -- 172.21.15.82:0/2177028622 shutdown_connections 2024-03-27T07:26:53.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.568+0000 7fdab7283640 1 -- 172.21.15.82:0/2177028622 wait complete. 2024-03-27T07:26:53.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.569+0000 7fdab7283640 1 Processor -- start 2024-03-27T07:26:53.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.569+0000 7fdab7283640 1 -- start start 2024-03-27T07:26:53.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab7283640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab0102d50 0x7fdab0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab7283640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0103670 0x7fdab01989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab7283640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab010c120 0x7fdab019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab7283640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdab0111ec0 con 0x7fdab0102d50 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab7283640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdab0111d40 con 0x7fdab010c120 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab7283640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdab0112040 con 0x7fdab0103670 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab481e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0103670 0x7fdab01989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab481e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0103670 0x7fdab01989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:50852/0 (socket says 172.21.15.82:50852) 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab481e640 1 -- 172.21.15.82:0/4013234061 learned_addr learned my addr 172.21.15.82:0/4013234061 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab501f640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab0102d50 0x7fdab0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab5820640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab010c120 0x7fdab019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab481e640 1 -- 172.21.15.82:0/4013234061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab010c120 msgr2=0x7fdab019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab481e640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab010c120 0x7fdab019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab481e640 1 -- 172.21.15.82:0/4013234061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab0102d50 msgr2=0x7fdab0198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab481e640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab0102d50 0x7fdab0198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab481e640 1 -- 172.21.15.82:0/4013234061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab019d450 con 0x7fdab0103670 2024-03-27T07:26:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.570+0000 7fdab481e640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0103670 0x7fdab01989a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0037040 tx=0x7fdaa00344c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.571+0000 7fdaa67fc640 1 -- 172.21.15.82:0/4013234061 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0041020 con 0x7fdab0103670 2024-03-27T07:26:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.571+0000 7fdaa67fc640 1 -- 172.21.15.82:0/4013234061 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaa002ca80 con 0x7fdab0103670 2024-03-27T07:26:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.571+0000 7fdaa67fc640 1 -- 172.21.15.82:0/4013234061 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0039040 con 0x7fdab0103670 2024-03-27T07:26:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.571+0000 7fdab7283640 1 -- 172.21.15.82:0/4013234061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab019d6e0 con 0x7fdab0103670 2024-03-27T07:26:53.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.571+0000 7fdab7283640 1 -- 172.21.15.82:0/4013234061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab01a4fd0 con 0x7fdab0103670 2024-03-27T07:26:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab9e5f740 1 Processor -- start 2024-03-27T07:26:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab9e5f740 1 -- start start 2024-03-27T07:26:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f853eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f8547770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f854a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab9e5f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d6f84a2710 con 0x55d6f8547cb0 2024-03-27T07:26:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab9e5f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55d6f844aaf0 con 0x55d6f853f0d0 2024-03-27T07:26:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab9e5f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d6f849e6c0 con 0x55d6f853e7b0 2024-03-27T07:26:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab5820640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f853eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab5820640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f853eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:50858/0 (socket says 172.21.15.82:50858) 2024-03-27T07:26:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab501f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f8547770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.574+0000 7fdab5820640 1 -- 172.21.15.82:0/1155555175 learned_addr learned my addr 172.21.15.82:0/1155555175 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fdaa67fc640 1 -- 172.21.15.82:0/4013234061 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fdaa0044020 con 0x7fdab0103670 2024-03-27T07:26:53.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fdab5820640 1 -- 172.21.15.82:0/1155555175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 msgr2=0x55d6f8547770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fdab5820640 1 --2- 172.21.15.82:0/1155555175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f8547770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fdab5820640 1 -- 172.21.15.82:0/1155555175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 msgr2=0x55d6f854a0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:26:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fdab5820640 1 --2- 172.21.15.82:0/1155555175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f854a0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fdab5820640 1 -- 172.21.15.82:0/1155555175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f81b63f0 con 0x55d6f853e7b0 2024-03-27T07:26:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fdab501f640 1 --2- 172.21.15.82:0/1155555175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f8547770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fdab5820640 1 --2- 172.21.15.82:0/1155555175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f853eb90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80099f0 tx=0x7fdaa80095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6d206f0d2461d62 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fda9b7fe640 1 -- 172.21.15.82:0/1155555175 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa801d070 con 0x55d6f853e7b0 2024-03-27T07:26:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fda9b7fe640 1 -- 172.21.15.82:0/1155555175 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaa8003e40 con 0x55d6f853e7b0 2024-03-27T07:26:53.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.575+0000 7fda9b7fe640 1 -- 172.21.15.82:0/1155555175 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800dba0 con 0x55d6f853e7b0 2024-03-27T07:26:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdaa67fc640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fda9c0a3800 0x7fda9c0a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1155555175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 msgr2=0x55d6f853eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/1155555175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f853eb90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80099f0 tx=0x7fdaa80095c0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdaa67fc640 1 -- 172.21.15.82:0/4013234061 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fdaa00f1650 con 0x7fdab0103670 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1155555175 shutdown_connections 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/1155555175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f854a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/1155555175 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f8547770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/1155555175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f853eb90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1155555175 >> 172.21.15.82:0/1155555175 conn(0x55d6f8538ee0 msgr2=0x55d6f85392c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdab501f640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fda9c0a3800 0x7fda9c0a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.576+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1155555175 shutdown_connections 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.577+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1155555175 wait complete. 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.577+0000 7fdab501f640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fda9c0a3800 0x7fda9c0a5cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55d6f853e280 tx=0x7fdaac005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.577+0000 7fdab9e5f740 1 -- start start 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.577+0000 7fdab9e5f740 1 Processor -- start 2024-03-27T07:26:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.577+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f853e7b0 0x55d6f8544da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f85452e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f8547cb0 0x55d6f8545820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab9e5f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d6f854aaa0 con 0x55d6f853e7b0 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab9e5f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55d6f845deb0 con 0x55d6f8547cb0 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab9e5f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d6f854ac20 con 0x55d6f853f0d0 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab9e5f740 10 client.0 _ll_register_callbacks cb 0x55d6f849a6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab5820640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f8547cb0 0x55d6f8545820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab481e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f85452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab501f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f853e7b0 0x55d6f8544da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab5820640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f8547cb0 0x55d6f8545820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42022/0 (socket says 172.21.15.82:42022) 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab5820640 1 -- 172.21.15.82:0/3836224154 learned_addr learned my addr 172.21.15.82:0/3836224154 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab5820640 1 -- 172.21.15.82:0/3836224154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 msgr2=0x55d6f85452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab5820640 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f85452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab5820640 1 -- 172.21.15.82:0/3836224154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f853e7b0 msgr2=0x55d6f8544da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab5820640 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f853e7b0 0x55d6f8544da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab5820640 1 -- 172.21.15.82:0/3836224154 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6f82807d0 con 0x55d6f8547cb0 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab481e640 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f85452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fdab5820640 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f8547cb0 0x55d6f8545820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800ed70 tx=0x7fdaa800db50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc7cd4125c9e586 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.578+0000 7fda98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fda98ff9640 1 -- 172.21.15.82:0/3836224154 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa801d040 con 0x55d6f8547cb0 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fda98ff9640 1 -- 172.21.15.82:0/3836224154 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fdaa800dd40 con 0x55d6f8547cb0 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fdab9e5f740 1 -- 172.21.15.82:0/3836224154 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d6f84afc50 con 0x55d6f8547cb0 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fda98ff9640 1 -- 172.21.15.82:0/3836224154 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdaa8032050 con 0x55d6f8547cb0 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fdab9e5f740 10 client.26189 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fdab9e5f740 1 -- 172.21.15.82:0/3836224154 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d6f8556e00 con 0x55d6f8547cb0 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fda98ff9640 1 -- 172.21.15.82:0/3836224154 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d6f84afc50 con 0x55d6f8547cb0 2024-03-27T07:26:53.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fda98ff9640 1 -- 172.21.15.82:0/3836224154 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdaa8023040 con 0x55d6f8547cb0 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fdab9e5f740 10 client.26189 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fdab9e5f740 10 client.26189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fdab9e5f740 20 client.26189 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d6f8558260 0x55d6f855a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fdab9e5f740 4 client.26189 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.579+0000 7fdab9e5f740 1 -- 172.21.15.82:0/3836224154 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6f84a9fa0 con 0x55d6f8558260 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.580+0000 7fdab501f640 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d6f8558260 0x55d6f855a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.580+0000 7fda98ff9640 10 client.26189 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.580+0000 7fdab501f640 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d6f8558260 0x55d6f855a650 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5503e0648ef3a85a server_cookie=d8a8a14beb4bf2b2 in_seq=0 out_seq=0 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fda98ff9640 1 -- 172.21.15.82:0/3836224154 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d6f84a9fa0 con 0x55d6f8558260 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fda98ff9640 10 client.26189 handle_command_reply: tid=0 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 client.26189 shutdown 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 -- 172.21.15.82:0/3836224154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f8547cb0 msgr2=0x55d6f8545820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f8547cb0 0x55d6f8545820 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800ed70 tx=0x7fdaa800db50 comp rx=0 tx=0).stop 2024-03-27T07:26:53.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 -- 172.21.15.82:0/3836224154 shutdown_connections 2024-03-27T07:26:53.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f8547cb0 0x55d6f8545820 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f85452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d6f8558260 0x55d6f855a650 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/3836224154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f853e7b0 0x55d6f8544da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fda98ff9640 0 client.26189 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:53.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 -- 172.21.15.82:0/3836224154 >> 172.21.15.82:0/3836224154 conn(0x55d6f8538ee0 msgr2=0x55d6f853ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 -- 172.21.15.82:0/3836224154 shutdown_connections 2024-03-27T07:26:53.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 1 -- 172.21.15.82:0/3836224154 wait complete. 2024-03-27T07:26:53.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.581+0000 7fdab9e5f740 20 client.26189 trim_cache size 0 max 16384 2024-03-27T07:26:53.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.633+0000 7fdab9e5f740 1 Processor -- start 2024-03-27T07:26:53.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.633+0000 7fdab9e5f740 1 -- start start 2024-03-27T07:26:53.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.633+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853e7b0 0x55d6f8543f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.633+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f8553840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f8545640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab501f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853e7b0 0x55d6f8543f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab501f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853e7b0 0x55d6f8543f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42024/0 (socket says 172.21.15.82:42024) 2024-03-27T07:26:53.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab481e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f8553840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab481e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f8553840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:50886/0 (socket says 172.21.15.82:50886) 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab5820640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f8545640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab5820640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f8545640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36320/0 (socket says 172.21.15.82:36320) 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab501f640 1 -- 172.21.15.82:0/1205723889 learned_addr learned my addr 172.21.15.82:0/1205723889 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1205723889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdab01b2290 con 0x55d6f8547cb0 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1205723889 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdab01afb00 con 0x55d6f853e7b0 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1205723889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdab01ad950 con 0x55d6f853f0d0 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab481e640 1 -- 172.21.15.82:0/1205723889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853e7b0 msgr2=0x55d6f8543f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab481e640 1 --2- 172.21.15.82:0/1205723889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853e7b0 0x55d6f8543f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.634+0000 7fdab481e640 1 -- 172.21.15.82:0/1205723889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 msgr2=0x55d6f8545640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.635+0000 7fdab481e640 1 --2- 172.21.15.82:0/1205723889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f8545640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.635+0000 7fdab481e640 1 -- 172.21.15.82:0/1205723889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6f8539c70 con 0x55d6f853f0d0 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.635+0000 7fdab501f640 1 --2- 172.21.15.82:0/1205723889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853e7b0 0x55d6f8543f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:53.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.635+0000 7fdab5820640 1 --2- 172.21.15.82:0/1205723889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f8545640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.635+0000 7fdab481e640 1 --2- 172.21.15.82:0/1205723889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f8553840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00eef00 tx=0x7fdaa0003990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fd193b2f12bba38 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.636+0000 7fda9affd640 1 -- 172.21.15.82:0/1205723889 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00be040 con 0x55d6f853f0d0 2024-03-27T07:26:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.637+0000 7fda9affd640 1 -- 172.21.15.82:0/1205723889 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaa00348b0 con 0x55d6f853f0d0 2024-03-27T07:26:53.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.637+0000 7fda9affd640 1 -- 172.21.15.82:0/1205723889 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00a80b0 con 0x55d6f853f0d0 2024-03-27T07:26:53.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.638+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1205723889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 msgr2=0x55d6f8553840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.638+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/1205723889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f8553840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00eef00 tx=0x7fdaa0003990 comp rx=0 tx=0).stop 2024-03-27T07:26:53.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.639+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1205723889 shutdown_connections 2024-03-27T07:26:53.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.639+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/1205723889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f8545640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.639+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/1205723889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853f0d0 0x55d6f8553840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.639+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/1205723889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853e7b0 0x55d6f8543f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.639+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1205723889 >> 172.21.15.82:0/1205723889 conn(0x55d6f8538ee0 msgr2=0x55d6f8537770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.643+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1205723889 shutdown_connections 2024-03-27T07:26:53.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.643+0000 7fdab9e5f740 1 -- 172.21.15.82:0/1205723889 wait complete. 2024-03-27T07:26:53.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.643+0000 7fdab9e5f740 1 -- start start 2024-03-27T07:26:53.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.643+0000 7fdab9e5f740 1 Processor -- start 2024-03-27T07:26:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f854b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f854b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab9e5f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f85bea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab9e5f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdab01adfc0 con 0x55d6f8547cb0 2024-03-27T07:26:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab9e5f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdab01af430 con 0x55d6f853f0d0 2024-03-27T07:26:53.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab9e5f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdab01ae690 con 0x55d6f853e7b0 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab9e5f740 10 client.0 _ll_register_callbacks cb 0x7fdaa801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab481e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f854b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab501f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f854b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab481e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f854b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42034/0 (socket says 172.21.15.82:42034) 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.644+0000 7fdab481e640 1 -- 172.21.15.82:0/102260958 learned_addr learned my addr 172.21.15.82:0/102260958 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.645+0000 7fdab5820640 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f85bea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.645+0000 7fdab481e640 1 -- 172.21.15.82:0/102260958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 msgr2=0x55d6f854b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.645+0000 7fdab481e640 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f854b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.645+0000 7fdab481e640 1 -- 172.21.15.82:0/102260958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 msgr2=0x55d6f85bea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.645+0000 7fdab481e640 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f85bea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.645+0000 7fdab481e640 1 -- 172.21.15.82:0/102260958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6f85bf0f0 con 0x55d6f853f0d0 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.645+0000 7fdab501f640 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f854b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:53.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.645+0000 7fdab5820640 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f85bea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:26:53.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.645+0000 7fdab481e640 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f854b5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00bd640 tx=0x7fdaa0034ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62ca36de88896565 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:53.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.653+0000 7fda98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:26:53.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.653+0000 7fda98ff9640 1 -- 172.21.15.82:0/102260958 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00c1cf0 con 0x55d6f853f0d0 2024-03-27T07:26:53.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.654+0000 7fda98ff9640 1 -- 172.21.15.82:0/102260958 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fdaa00c6330 con 0x55d6f853f0d0 2024-03-27T07:26:53.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.654+0000 7fdab9e5f740 1 -- 172.21.15.82:0/102260958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaa00348b0 con 0x55d6f853f0d0 2024-03-27T07:26:53.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.655+0000 7fda98ff9640 1 -- 172.21.15.82:0/102260958 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdaa00be040 con 0x55d6f853f0d0 2024-03-27T07:26:53.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.655+0000 7fdab9e5f740 10 client.26195 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:53.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.655+0000 7fdab9e5f740 1 -- 172.21.15.82:0/102260958 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d6f85b6bd0 con 0x55d6f853f0d0 2024-03-27T07:26:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.656+0000 7fda98ff9640 1 -- 172.21.15.82:0/102260958 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaa00348b0 con 0x55d6f853f0d0 2024-03-27T07:26:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.656+0000 7fda98ff9640 1 -- 172.21.15.82:0/102260958 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdaa003c030 con 0x55d6f853f0d0 2024-03-27T07:26:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.656+0000 7fdab9e5f740 10 client.26195 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.656+0000 7fdab9e5f740 10 client.26195 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.656+0000 7fdab9e5f740 20 client.26195 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.656+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d6f85b70c0 0x55d6f85b94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.656+0000 7fdab9e5f740 4 client.26195 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:26:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.656+0000 7fdab9e5f740 1 -- 172.21.15.82:0/102260958 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d6f84276a0 con 0x55d6f85b70c0 2024-03-27T07:26:53.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.657+0000 7fdab501f640 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d6f85b70c0 0x55d6f85b94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:53.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.657+0000 7fda98ff9640 10 client.26195 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:53.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.657+0000 7fdab501f640 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d6f85b70c0 0x55d6f85b94e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=322ffa850f1236e server_cookie=c7ef88495dfe1dac in_seq=0 out_seq=0 2024-03-27T07:26:53.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fda98ff9640 1 -- 172.21.15.82:0/102260958 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d6f84276a0 con 0x55d6f85b70c0 2024-03-27T07:26:53.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fda98ff9640 10 client.26195 handle_command_reply: tid=0 2024-03-27T07:26:53.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 client.26195 shutdown 2024-03-27T07:26:53.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 -- 172.21.15.82:0/102260958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 msgr2=0x55d6f854b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f854b5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdaa00bd640 tx=0x7fdaa0034ab0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 -- 172.21.15.82:0/102260958 shutdown_connections 2024-03-27T07:26:53.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d6f85b70c0 0x55d6f85b94e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6f8547cb0 0x55d6f85bea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d6f853f0d0 0x55d6f854b5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 --2- 172.21.15.82:0/102260958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d6f853e7b0 0x55d6f854b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 -- 172.21.15.82:0/102260958 >> 172.21.15.82:0/102260958 conn(0x55d6f8538ee0 msgr2=0x55d6f85456a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fda98ff9640 0 client.26195 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:53.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 -- 172.21.15.82:0/102260958 shutdown_connections 2024-03-27T07:26:53.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 1 -- 172.21.15.82:0/102260958 wait complete. 2024-03-27T07:26:53.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.658+0000 7fdab9e5f740 20 client.26195 trim_cache size 0 max 16384 2024-03-27T07:26:53.662 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:26:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.668+0000 7fdab7283640 1 -- 172.21.15.82:0/4013234061 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fda9c0a3800 msgr2=0x7fda9c0a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.668+0000 7fdab7283640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fda9c0a3800 0x7fda9c0a5cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55d6f853e280 tx=0x7fdaac005f90 comp rx=0 tx=0).stop 2024-03-27T07:26:53.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.669+0000 7fdab7283640 1 -- 172.21.15.82:0/4013234061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0103670 msgr2=0x7fdab01989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.669+0000 7fdab7283640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0103670 0x7fdab01989a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0037040 tx=0x7fdaa00344c0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.669+0000 7fdab7283640 1 -- 172.21.15.82:0/4013234061 shutdown_connections 2024-03-27T07:26:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.669+0000 7fdab7283640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fda9c0a3800 0x7fda9c0a5cc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.669+0000 7fdab7283640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdab010c120 0x7fdab019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.669+0000 7fdab7283640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0103670 0x7fdab01989a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.669+0000 7fdab7283640 1 --2- 172.21.15.82:0/4013234061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdab0102d50 0x7fdab0198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.669+0000 7fdab7283640 1 -- 172.21.15.82:0/4013234061 >> 172.21.15.82:0/4013234061 conn(0x7fdab0077800 msgr2=0x7fdab00fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.669+0000 7fdab7283640 1 -- 172.21.15.82:0/4013234061 shutdown_connections 2024-03-27T07:26:53.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:53.669+0000 7fdab7283640 1 -- 172.21.15.82:0/4013234061 wait complete. 2024-03-27T07:26:53.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:53 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3724729131' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:26:54.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:54 smithi153 ceph-mon[36179]: pgmap v102: 97 pgs: 97 active+clean; 497 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 640 op/s 2024-03-27T07:26:54.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:54 smithi082 ceph-mon[32178]: pgmap v102: 97 pgs: 97 active+clean; 497 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 640 op/s 2024-03-27T07:26:54.696 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T07:26:54.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:26:54.697 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T07:26:54.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:54 smithi149 ceph-mon[36065]: pgmap v102: 97 pgs: 97 active+clean; 497 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 640 op/s 2024-03-27T07:26:54.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.823+0000 7fa6966dc640 1 -- 172.21.15.82:0/1501233846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa690110170 msgr2=0x7fa690110550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:54.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.823+0000 7fa6966dc640 1 --2- 172.21.15.82:0/1501233846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa690110170 0x7fa690110550 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa688009ca0 tx=0x7fa68802c140 comp rx=0 tx=0).stop 2024-03-27T07:26:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.827+0000 7fa6966dc640 1 -- 172.21.15.82:0/1501233846 shutdown_connections 2024-03-27T07:26:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.827+0000 7fa6966dc640 1 --2- 172.21.15.82:0/1501233846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa690108be0 0x7fa690109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.827+0000 7fa6966dc640 1 --2- 172.21.15.82:0/1501233846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa69011b330 0x7fa69011d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.827+0000 7fa6966dc640 1 --2- 172.21.15.82:0/1501233846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa690110170 0x7fa690110550 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.827+0000 7fa6966dc640 1 -- 172.21.15.82:0/1501233846 >> 172.21.15.82:0/1501233846 conn(0x7fa69006caa0 msgr2=0x7fa69006ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.833+0000 7fa6966dc640 1 -- 172.21.15.82:0/1501233846 shutdown_connections 2024-03-27T07:26:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.833+0000 7fa6966dc640 1 -- 172.21.15.82:0/1501233846 wait complete. 2024-03-27T07:26:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.834+0000 7fa6966dc640 1 Processor -- start 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.834+0000 7fa6966dc640 1 -- start start 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.835+0000 7fa6966dc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa690108be0 0x7fa690119850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.835+0000 7fa6966dc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa690110170 0x7fa690119d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.835+0000 7fa6966dc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa69011b330 0x7fa690112b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.835+0000 7fa6966dc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa690120ce0 con 0x7fa69011b330 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.835+0000 7fa6966dc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa690120b60 con 0x7fa690108be0 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.835+0000 7fa6966dc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa690120e60 con 0x7fa690110170 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.835+0000 7fa695edb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa69011b330 0x7fa690112b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.835+0000 7fa695edb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa69011b330 0x7fa690112b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36332/0 (socket says 172.21.15.82:36332) 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.835+0000 7fa695edb640 1 -- 172.21.15.82:0/828302172 learned_addr learned my addr 172.21.15.82:0/828302172 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.835+0000 7fa694ed9640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa690110170 0x7fa690119d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.836+0000 7fa695edb640 1 -- 172.21.15.82:0/828302172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa690110170 msgr2=0x7fa690119d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.836+0000 7fa695edb640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa690110170 0x7fa690119d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.836+0000 7fa695edb640 1 -- 172.21.15.82:0/828302172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa690108be0 msgr2=0x7fa690119850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T07:26:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.836+0000 7fa695edb640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa690108be0 0x7fa690119850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.836+0000 7fa695edb640 1 -- 172.21.15.82:0/828302172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6901133c0 con 0x7fa69011b330 2024-03-27T07:26:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.836+0000 7fa695edb640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa69011b330 0x7fa690112b00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa68000b3f0 tx=0x7fa68000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.838+0000 7fa6867fc640 1 -- 172.21.15.82:0/828302172 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa680015020 con 0x7fa69011b330 2024-03-27T07:26:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.838+0000 7fa6867fc640 1 -- 172.21.15.82:0/828302172 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa680011d10 con 0x7fa69011b330 2024-03-27T07:26:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.838+0000 7fa6867fc640 1 -- 172.21.15.82:0/828302172 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68000f2e0 con 0x7fa69011b330 2024-03-27T07:26:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.838+0000 7fa6966dc640 1 -- 172.21.15.82:0/828302172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa690113650 con 0x7fa69011b330 2024-03-27T07:26:54.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.838+0000 7fa6966dc640 1 -- 172.21.15.82:0/828302172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6901175b0 con 0x7fa69011b330 2024-03-27T07:26:54.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.843+0000 7fa69a602740 1 Processor -- start 2024-03-27T07:26:54.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.845+0000 7fa69a602740 1 -- start start 2024-03-27T07:26:54.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.846+0000 7fa69a602740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 0x556054c24430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.846+0000 7fa69a602740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c24970 0x556054c2d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.846+0000 7fa69a602740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2d550 0x556054c2f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.846+0000 7fa69a602740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556054b2ec20 con 0x556054c2d550 2024-03-27T07:26:54.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.846+0000 7fa69a602740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556054b87430 con 0x556054c24050 2024-03-27T07:26:54.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.846+0000 7fa69a602740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556054b2f900 con 0x556054c24970 2024-03-27T07:26:54.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.846+0000 7fa6867fc640 1 -- 172.21.15.82:0/828302172 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fa680018020 con 0x7fa69011b330 2024-03-27T07:26:54.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.847+0000 7fa6867fc640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa67c0a3980 0x7fa67c0a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.847+0000 7fa6867fc640 1 -- 172.21.15.82:0/828302172 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa6800cf750 con 0x7fa69011b330 2024-03-27T07:26:54.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.850+0000 7fa695edb640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa67c0a3980 0x7fa67c0a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.850+0000 7fa695edb640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa67c0a3980 0x7fa67c0a5e40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa68000bfd0 tx=0x7fa680011f30 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:54.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.851+0000 7fa6956da640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c24970 0x556054c2d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.851+0000 7fa6956da640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c24970 0x556054c2d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:50936/0 (socket says 172.21.15.82:50936) 2024-03-27T07:26:54.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.851+0000 7fa6956da640 1 -- 172.21.15.82:0/1301824062 learned_addr learned my addr 172.21.15.82:0/1301824062 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:54.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.851+0000 7fa694ed9640 1 --2- 172.21.15.82:0/1301824062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 0x556054c24430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.852+0000 7fa694ed9640 1 --2- 172.21.15.82:0/1301824062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2d550 0x556054c2f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.852+0000 7fa6956da640 1 -- 172.21.15.82:0/1301824062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 msgr2=0x556054c24430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:54.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.852+0000 7fa6956da640 1 --2- 172.21.15.82:0/1301824062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 0x556054c24430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.852+0000 7fa6956da640 1 -- 172.21.15.82:0/1301824062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2d550 msgr2=0x556054c2f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:54.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.852+0000 7fa6956da640 1 --2- 172.21.15.82:0/1301824062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2d550 0x556054c2f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.852+0000 7fa6956da640 1 -- 172.21.15.82:0/1301824062 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556054b82180 con 0x556054c24970 2024-03-27T07:26:54.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.852+0000 7fa6956da640 1 --2- 172.21.15.82:0/1301824062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c24970 0x556054c2d010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa688000f80 tx=0x7fa6880324c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ede832ca9720144 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:54.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.852+0000 7fa67b7fe640 1 -- 172.21.15.82:0/1301824062 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688041020 con 0x556054c24970 2024-03-27T07:26:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.853+0000 7fa67b7fe640 1 -- 172.21.15.82:0/1301824062 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa688003970 con 0x556054c24970 2024-03-27T07:26:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.854+0000 7fa69a602740 1 -- 172.21.15.82:0/1301824062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c24970 msgr2=0x556054c2d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.854+0000 7fa69a602740 1 --2- 172.21.15.82:0/1301824062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c24970 0x556054c2d010 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa688000f80 tx=0x7fa6880324c0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.854+0000 7fa69a602740 1 -- 172.21.15.82:0/1301824062 shutdown_connections 2024-03-27T07:26:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.854+0000 7fa69a602740 1 --2- 172.21.15.82:0/1301824062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2d550 0x556054c2f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.854+0000 7fa69a602740 1 --2- 172.21.15.82:0/1301824062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c24970 0x556054c2d010 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa688000f80 tx=0x7fa6880324c0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.854+0000 7fa69a602740 1 --2- 172.21.15.82:0/1301824062 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 0x556054c24430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.854+0000 7fa69a602740 1 -- 172.21.15.82:0/1301824062 >> 172.21.15.82:0/1301824062 conn(0x556054c1e780 msgr2=0x556054c1eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:54.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.855+0000 7fa69a602740 1 -- 172.21.15.82:0/1301824062 shutdown_connections 2024-03-27T07:26:54.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.856+0000 7fa69a602740 1 -- 172.21.15.82:0/1301824062 wait complete. 2024-03-27T07:26:54.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.856+0000 7fa69a602740 1 -- start start 2024-03-27T07:26:54.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.856+0000 7fa69a602740 1 Processor -- start 2024-03-27T07:26:54.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.857+0000 7fa69a602740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c24050 0x556054c2ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.857+0000 7fa69a602740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2d550 0x556054c2a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.857+0000 7fa69a602740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c2a700 0x556054c2ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.857+0000 7fa69a602740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556054b42cc0 con 0x556054c24050 2024-03-27T07:26:54.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.857+0000 7fa69a602740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556054b833e0 con 0x556054c2a700 2024-03-27T07:26:54.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.857+0000 7fa69a602740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556054c30330 con 0x556054c2d550 2024-03-27T07:26:54.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.857+0000 7fa69a602740 10 client.0 _ll_register_callbacks cb 0x556054b7df30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:54.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.858+0000 7fa694ed9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c2a700 0x556054c2ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.858+0000 7fa694ed9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c24050 0x556054c2ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.858+0000 7fa694ed9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c24050 0x556054c2ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36362/0 (socket says 172.21.15.82:36362) 2024-03-27T07:26:54.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.858+0000 7fa694ed9640 1 -- 172.21.15.82:0/2738310050 learned_addr learned my addr 172.21.15.82:0/2738310050 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:54.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.859+0000 7fa694ed9640 1 -- 172.21.15.82:0/2738310050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2d550 msgr2=0x556054c2a1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T07:26:54.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.859+0000 7fa694ed9640 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2d550 0x556054c2a1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.859+0000 7fa694ed9640 1 -- 172.21.15.82:0/2738310050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c24050 msgr2=0x556054c2ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:54.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.859+0000 7fa694ed9640 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c24050 0x556054c2ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.859+0000 7fa694ed9640 1 -- 172.21.15.82:0/2738310050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556054b49ef0 con 0x556054c2a700 2024-03-27T07:26:54.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.861+0000 7fa694ed9640 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c2a700 0x556054c2ab60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa68c019f10 tx=0x7fa68c00d8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c403d6921fec15c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:54.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.861+0000 7fa678ff9640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:26:54.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.862+0000 7fa678ff9640 1 -- 172.21.15.82:0/2738310050 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c017e20 con 0x556054c2a700 2024-03-27T07:26:54.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.862+0000 7fa678ff9640 1 -- 172.21.15.82:0/2738310050 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa68c022360 con 0x556054c2a700 2024-03-27T07:26:54.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.862+0000 7fa69a602740 1 -- 172.21.15.82:0/2738310050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa688003970 con 0x556054c2a700 2024-03-27T07:26:54.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.863+0000 7fa678ff9640 1 -- 172.21.15.82:0/2738310050 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa68c028050 con 0x556054c2a700 2024-03-27T07:26:54.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.863+0000 7fa69a602740 10 client.26204 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:54.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.863+0000 7fa69a602740 1 -- 172.21.15.82:0/2738310050 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5560549637e0 con 0x556054c2a700 2024-03-27T07:26:54.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.865+0000 7fa678ff9640 1 -- 172.21.15.82:0/2738310050 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa688003970 con 0x556054c2a700 2024-03-27T07:26:54.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.865+0000 7fa678ff9640 1 -- 172.21.15.82:0/2738310050 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fa68c015040 con 0x556054c2a700 2024-03-27T07:26:54.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.866+0000 7fa69a602740 10 client.26204 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:54.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.866+0000 7fa69a602740 10 client.26204 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:54.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.866+0000 7fa69a602740 20 client.26204 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:54.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.866+0000 7fa69a602740 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556054c3d970 0x556054c3fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.866+0000 7fa69a602740 4 client.26204 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:54.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.866+0000 7fa69a602740 1 -- 172.21.15.82:0/2738310050 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556054b94970 con 0x556054c3d970 2024-03-27T07:26:54.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.870+0000 7fa6956da640 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556054c3d970 0x556054c3fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.873+0000 7fa6956da640 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556054c3d970 0x556054c3fdd0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b26a5b5fffa62e3 server_cookie=f0737ec41b44b96f in_seq=0 out_seq=0 2024-03-27T07:26:54.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.873+0000 7fa678ff9640 10 client.26204 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:54.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.880+0000 7fa678ff9640 1 -- 172.21.15.82:0/2738310050 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556054b94970 con 0x556054c3d970 2024-03-27T07:26:54.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.880+0000 7fa678ff9640 10 client.26204 handle_command_reply: tid=0 2024-03-27T07:26:54.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.880+0000 7fa69a602740 1 client.26204 shutdown 2024-03-27T07:26:54.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.884+0000 7fa69a602740 1 -- 172.21.15.82:0/2738310050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c2a700 msgr2=0x556054c2ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:54.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.884+0000 7fa69a602740 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c2a700 0x556054c2ab60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa68c019f10 tx=0x7fa68c00d8b0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.884+0000 7fa69a602740 1 -- 172.21.15.82:0/2738310050 shutdown_connections 2024-03-27T07:26:54.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.884+0000 7fa69a602740 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c2a700 0x556054c2ab60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.884+0000 7fa69a602740 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2d550 0x556054c2a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.884+0000 7fa69a602740 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556054c3d970 0x556054c3fdd0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.884+0000 7fa69a602740 1 --2- 172.21.15.82:0/2738310050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c24050 0x556054c2ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.884+0000 7fa69a602740 1 -- 172.21.15.82:0/2738310050 >> 172.21.15.82:0/2738310050 conn(0x556054c1e780 msgr2=0x556054c204d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:54.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.884+0000 7fa678ff9640 0 client.26204 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:54.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.884+0000 7fa69a602740 1 -- 172.21.15.82:0/2738310050 shutdown_connections 2024-03-27T07:26:54.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.887+0000 7fa69a602740 1 -- 172.21.15.82:0/2738310050 wait complete. 2024-03-27T07:26:54.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.888+0000 7fa69a602740 20 client.26204 trim_cache size 0 max 16384 2024-03-27T07:26:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.928+0000 7fa69a602740 1 Processor -- start 2024-03-27T07:26:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.928+0000 7fa69a602740 1 -- start start 2024-03-27T07:26:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.928+0000 7fa69a602740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 0x556054c39030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.928+0000 7fa69a602740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2a700 0x556054c29e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.928+0000 7fa69a602740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2d550 0x556054c456a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.928+0000 7fa69a602740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa6740110d0 con 0x556054c2a700 2024-03-27T07:26:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.928+0000 7fa69a602740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa67400e940 con 0x556054c24050 2024-03-27T07:26:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.928+0000 7fa69a602740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa67400c790 con 0x556054c2d550 2024-03-27T07:26:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.929+0000 7fa694ed9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 0x556054c39030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.929+0000 7fa694ed9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 0x556054c39030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42088/0 (socket says 172.21.15.82:42088) 2024-03-27T07:26:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.929+0000 7fa694ed9640 1 -- 172.21.15.82:0/94691853 learned_addr learned my addr 172.21.15.82:0/94691853 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.929+0000 7fa6956da640 1 --2- 172.21.15.82:0/94691853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2a700 0x556054c29e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.929+0000 7fa694ed9640 1 --2- 172.21.15.82:0/94691853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2d550 0x556054c456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.929+0000 7fa6956da640 1 -- 172.21.15.82:0/94691853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2d550 msgr2=0x556054c456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.929+0000 7fa6956da640 1 --2- 172.21.15.82:0/94691853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2d550 0x556054c456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.929+0000 7fa6956da640 1 -- 172.21.15.82:0/94691853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 msgr2=0x556054c39030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.929+0000 7fa6956da640 1 --2- 172.21.15.82:0/94691853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 0x556054c39030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.929+0000 7fa6956da640 1 -- 172.21.15.82:0/94691853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560549c3f70 con 0x556054c2a700 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.930+0000 7fa6956da640 1 --2- 172.21.15.82:0/94691853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2a700 0x556054c29e10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x556054c1f680 tx=0x7fa6880099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9cfb0f19d9dffc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.931+0000 7fa67affd640 1 -- 172.21.15.82:0/94691853 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688041040 con 0x556054c2a700 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.931+0000 7fa67affd640 1 -- 172.21.15.82:0/94691853 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa68804a070 con 0x556054c2a700 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.931+0000 7fa67affd640 1 -- 172.21.15.82:0/94691853 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688003d30 con 0x556054c2a700 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.932+0000 7fa69a602740 1 -- 172.21.15.82:0/94691853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2a700 msgr2=0x556054c29e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.932+0000 7fa69a602740 1 --2- 172.21.15.82:0/94691853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2a700 0x556054c29e10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x556054c1f680 tx=0x7fa6880099a0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.932+0000 7fa69a602740 1 -- 172.21.15.82:0/94691853 shutdown_connections 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.932+0000 7fa69a602740 1 --2- 172.21.15.82:0/94691853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c2a700 0x556054c29e10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.932+0000 7fa69a602740 1 --2- 172.21.15.82:0/94691853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2d550 0x556054c456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.932+0000 7fa69a602740 1 --2- 172.21.15.82:0/94691853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c24050 0x556054c39030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.932+0000 7fa69a602740 1 -- 172.21.15.82:0/94691853 >> 172.21.15.82:0/94691853 conn(0x556054c1e780 msgr2=0x556054c29700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.933+0000 7fa69a602740 1 -- 172.21.15.82:0/94691853 shutdown_connections 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.933+0000 7fa69a602740 1 -- 172.21.15.82:0/94691853 wait complete. 2024-03-27T07:26:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.933+0000 7fa69a602740 1 -- start start 2024-03-27T07:26:54.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.933+0000 7fa69a602740 1 Processor -- start 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.934+0000 7fa69a602740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c24050 0x556054c316d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.934+0000 7fa69a602740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2a700 0x556054c31c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.934+0000 7fa69a602740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c2d550 0x556054ca2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.934+0000 7fa69a602740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa67400ce00 con 0x556054c24050 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.934+0000 7fa69a602740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa67400e270 con 0x556054c2d550 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.934+0000 7fa69a602740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa67400d4d0 con 0x556054c2a700 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.934+0000 7fa69a602740 10 client.0 _ll_register_callbacks cb 0x7fa68c00dc90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.934+0000 7fa6956da640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2a700 0x556054c31c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.934+0000 7fa6956da640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2a700 0x556054c31c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:50974/0 (socket says 172.21.15.82:50974) 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.934+0000 7fa6956da640 1 -- 172.21.15.82:0/585061595 learned_addr learned my addr 172.21.15.82:0/585061595 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:54.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.935+0000 7fa6956da640 1 -- 172.21.15.82:0/585061595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c2d550 msgr2=0x556054ca2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.935+0000 7fa6956da640 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c2d550 0x556054ca2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.935+0000 7fa6956da640 1 -- 172.21.15.82:0/585061595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c24050 msgr2=0x556054c316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.935+0000 7fa6956da640 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c24050 0x556054c316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.935+0000 7fa6956da640 1 -- 172.21.15.82:0/585061595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55605485b170 con 0x556054c2a700 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.935+0000 7fa6956da640 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2a700 0x556054c31c10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa688005e30 tx=0x7fa688005fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b113a3a9bc700ff8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.936+0000 7fa678ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.936+0000 7fa678ff9640 1 -- 172.21.15.82:0/585061595 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa688041030 con 0x556054c2a700 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.936+0000 7fa678ff9640 1 -- 172.21.15.82:0/585061595 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa6880042d0 con 0x556054c2a700 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.936+0000 7fa69a602740 1 -- 172.21.15.82:0/585061595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa68804a070 con 0x556054c2a700 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.936+0000 7fa678ff9640 1 -- 172.21.15.82:0/585061595 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa6880325d0 con 0x556054c2a700 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.937+0000 7fa69a602740 10 client.26203 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:54.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.937+0000 7fa69a602740 1 -- 172.21.15.82:0/585061595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556054b524e0 con 0x556054c2a700 2024-03-27T07:26:54.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.938+0000 7fa678ff9640 1 -- 172.21.15.82:0/585061595 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa688003970 con 0x556054c2a700 2024-03-27T07:26:54.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.938+0000 7fa678ff9640 1 -- 172.21.15.82:0/585061595 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fa68805d030 con 0x556054c2a700 2024-03-27T07:26:54.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.938+0000 7fa69a602740 10 client.26203 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:54.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.938+0000 7fa69a602740 10 client.26203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:54.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.938+0000 7fa69a602740 20 client.26203 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:54.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.938+0000 7fa69a602740 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556054ca43d0 0x556054ca67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:54.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.938+0000 7fa69a602740 4 client.26203 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T07:26:54.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.938+0000 7fa69a602740 1 -- 172.21.15.82:0/585061595 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7fa68804a070 con 0x556054ca43d0 2024-03-27T07:26:54.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.939+0000 7fa694ed9640 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556054ca43d0 0x556054ca67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:54.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.948+0000 7fa694ed9640 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556054ca43d0 0x556054ca67f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=557b811ce8c687aa server_cookie=74f4ad1b8350dca9 in_seq=0 out_seq=0 2024-03-27T07:26:54.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:54.950+0000 7fa678ff9640 10 client.26203 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:55.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.026+0000 7fa678ff9640 1 -- 172.21.15.82:0/585061595 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7fa68804a070 con 0x556054ca43d0 2024-03-27T07:26:55.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.026+0000 7fa678ff9640 10 client.26203 handle_command_reply: tid=0 2024-03-27T07:26:55.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.026+0000 7fa69a602740 1 client.26203 shutdown 2024-03-27T07:26:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 1 -- 172.21.15.82:0/585061595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2a700 msgr2=0x556054c31c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2a700 0x556054c31c10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa688005e30 tx=0x7fa688005fc0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 1 -- 172.21.15.82:0/585061595 shutdown_connections 2024-03-27T07:26:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556054c2d550 0x556054ca2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556054c2a700 0x556054c31c10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556054ca43d0 0x556054ca67f0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 1 --2- 172.21.15.82:0/585061595 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556054c24050 0x556054c316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 1 -- 172.21.15.82:0/585061595 >> 172.21.15.82:0/585061595 conn(0x556054c1e780 msgr2=0x556054c29f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa678ff9640 0 client.26203 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:55.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 1 -- 172.21.15.82:0/585061595 shutdown_connections 2024-03-27T07:26:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 1 -- 172.21.15.82:0/585061595 wait complete. 2024-03-27T07:26:55.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.027+0000 7fa69a602740 20 client.26203 trim_cache size 0 max 16384 2024-03-27T07:26:55.031 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:26:55.031 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-03-27T07:26:55.031 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "1cf0cd2a-b628-4436-a344-4b1222519eef", 2024-03-27T07:26:55.031 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-03-27T07:26:55.031 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:26:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 -- 172.21.15.82:0/828302172 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa67c0a3980 msgr2=0x7fa67c0a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa67c0a3980 0x7fa67c0a5e40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa68000bfd0 tx=0x7fa680011f30 comp rx=0 tx=0).stop 2024-03-27T07:26:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 -- 172.21.15.82:0/828302172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa69011b330 msgr2=0x7fa690112b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa69011b330 0x7fa690112b00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa68000b3f0 tx=0x7fa68000b8b0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 -- 172.21.15.82:0/828302172 shutdown_connections 2024-03-27T07:26:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa67c0a3980 0x7fa67c0a5e40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa69011b330 0x7fa690112b00 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa690110170 0x7fa690119d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 --2- 172.21.15.82:0/828302172 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa690108be0 0x7fa690119850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 -- 172.21.15.82:0/828302172 >> 172.21.15.82:0/828302172 conn(0x7fa69006caa0 msgr2=0x7fa6900704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 -- 172.21.15.82:0/828302172 shutdown_connections 2024-03-27T07:26:55.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.028+0000 7fa6966dc640 1 -- 172.21.15.82:0/828302172 wait complete. 2024-03-27T07:26:55.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:26:55.048 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.193+0000 7f58c24c9640 1 -- 172.21.15.82:0/3592270117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc100a00 msgr2=0x7f58bc100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.193+0000 7f58c24c9640 1 --2- 172.21.15.82:0/3592270117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc100a00 0x7f58bc100e80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f58b0009930 tx=0x7f58b002bc30 comp rx=0 tx=0).stop 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.193+0000 7f58c24c9640 1 -- 172.21.15.82:0/3592270117 shutdown_connections 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.193+0000 7f58c24c9640 1 --2- 172.21.15.82:0/3592270117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc100a00 0x7f58bc100e80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.193+0000 7f58c24c9640 1 --2- 172.21.15.82:0/3592270117 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58bc1013c0 0x7f58bc10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.193+0000 7f58c24c9640 1 --2- 172.21.15.82:0/3592270117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58bc106a10 0x7f58bc106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.193+0000 7f58c24c9640 1 -- 172.21.15.82:0/3592270117 >> 172.21.15.82:0/3592270117 conn(0x7f58bc076dd0 msgr2=0x7f58bc0771e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.193+0000 7f58c24c9640 1 -- 172.21.15.82:0/3592270117 shutdown_connections 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.193+0000 7f58c24c9640 1 -- 172.21.15.82:0/3592270117 wait complete. 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58c24c9640 1 Processor -- start 2024-03-27T07:26:55.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58c24c9640 1 -- start start 2024-03-27T07:26:55.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58c24c9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58bc100a00 0x7f58bc198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58c24c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc1013c0 0x7f58bc1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58c24c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58bc106a10 0x7f58bc19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58c24c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc110e20 con 0x7f58bc1013c0 2024-03-27T07:26:55.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58c24c9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc110ca0 con 0x7f58bc100a00 2024-03-27T07:26:55.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58c24c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc110fa0 con 0x7f58bc106a10 2024-03-27T07:26:55.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58bb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc1013c0 0x7f58bc1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58bb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc1013c0 0x7f58bc1989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36388/0 (socket says 172.21.15.82:36388) 2024-03-27T07:26:55.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58bb7fe640 1 -- 172.21.15.82:0/2362470053 learned_addr learned my addr 172.21.15.82:0/2362470053 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:55.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58c0a66640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58bc106a10 0x7f58bc19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58bbfff640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58bc100a00 0x7f58bc198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58bb7fe640 1 -- 172.21.15.82:0/2362470053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58bc106a10 msgr2=0x7f58bc19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58bb7fe640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58bc106a10 0x7f58bc19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58bb7fe640 1 -- 172.21.15.82:0/2362470053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58bc100a00 msgr2=0x7f58bc198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58bb7fe640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58bc100a00 0x7f58bc198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.194+0000 7f58bb7fe640 1 -- 172.21.15.82:0/2362470053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc19d480 con 0x7f58bc1013c0 2024-03-27T07:26:55.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.195+0000 7f58bb7fe640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc1013c0 0x7f58bc1989d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f58b0009230 tx=0x7f58b002cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.195+0000 7f58b97fa640 1 -- 172.21.15.82:0/2362470053 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b0041070 con 0x7f58bc1013c0 2024-03-27T07:26:55.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.195+0000 7f58c24c9640 1 -- 172.21.15.82:0/2362470053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58bc19d710 con 0x7f58bc1013c0 2024-03-27T07:26:55.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.195+0000 7f58b97fa640 1 -- 172.21.15.82:0/2362470053 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58b0004450 con 0x7f58bc1013c0 2024-03-27T07:26:55.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.195+0000 7f58c24c9640 1 -- 172.21.15.82:0/2362470053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58bc1a5000 con 0x7f58bc1013c0 2024-03-27T07:26:55.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.195+0000 7f58b97fa640 1 -- 172.21.15.82:0/2362470053 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b004b060 con 0x7f58bc1013c0 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.197+0000 7f58b97fa640 1 -- 172.21.15.82:0/2362470053 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f58b0044070 con 0x7f58bc1013c0 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58c5190740 1 Processor -- start 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58c5190740 1 -- start start 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58c5190740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc03d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58c5190740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc046210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58c5190740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc046750 0x55e8cc048b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58c5190740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e8cbfa1860 con 0x55e8cc03db70 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58c5190740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e8cbf498d0 con 0x55e8cc046750 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58c5190740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e8cbf9d810 con 0x55e8cc03d250 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58b97fa640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f58a40a3780 0x7f58a40a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58bbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc046210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58c0a66640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc03d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58bbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc046210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36402/0 (socket says 172.21.15.82:36402) 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58bbfff640 1 -- 172.21.15.82:0/3227365552 learned_addr learned my addr 172.21.15.82:0/3227365552 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58c0a66640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f58a40a3780 0x7f58a40a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58bb7fe640 1 --2- 172.21.15.82:0/3227365552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc046750 0x55e8cc048b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58b97fa640 1 -- 172.21.15.82:0/2362470053 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f58b00f1920 con 0x7f58bc1013c0 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58bbfff640 1 -- 172.21.15.82:0/3227365552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 msgr2=0x55e8cc03d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58bbfff640 1 --2- 172.21.15.82:0/3227365552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc03d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58bbfff640 1 -- 172.21.15.82:0/3227365552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc046750 msgr2=0x55e8cc048b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58bbfff640 1 --2- 172.21.15.82:0/3227365552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc046750 0x55e8cc048b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58bbfff640 1 -- 172.21.15.82:0/3227365552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8cbf54120 con 0x55e8cc03db70 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.198+0000 7f58bbfff640 1 --2- 172.21.15.82:0/3227365552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc046210 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009c70 tx=0x7f58ac011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bcc8e6776373e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58c0a66640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f58a40a3780 0x7f58a40a5c40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f58b4005fd0 tx=0x7f58b4009600 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58a27fc640 1 -- 172.21.15.82:0/3227365552 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac004230 con 0x55e8cc03db70 2024-03-27T07:26:55.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58a27fc640 1 -- 172.21.15.82:0/3227365552 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58ac0043d0 con 0x55e8cc03db70 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58a27fc640 1 -- 172.21.15.82:0/3227365552 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac019800 con 0x55e8cc03db70 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58c5190740 1 -- 172.21.15.82:0/3227365552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 msgr2=0x55e8cc046210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58c5190740 1 --2- 172.21.15.82:0/3227365552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc046210 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009c70 tx=0x7f58ac011810 comp rx=0 tx=0).stop 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58c5190740 1 -- 172.21.15.82:0/3227365552 shutdown_connections 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58c5190740 1 --2- 172.21.15.82:0/3227365552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc046210 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58c5190740 1 --2- 172.21.15.82:0/3227365552 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc046750 0x55e8cc048b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58c5190740 1 --2- 172.21.15.82:0/3227365552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc03d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.199+0000 7f58c5190740 1 -- 172.21.15.82:0/3227365552 >> 172.21.15.82:0/3227365552 conn(0x55e8cc037980 msgr2=0x55e8cc037d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 1 -- 172.21.15.82:0/3227365552 shutdown_connections 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 1 -- 172.21.15.82:0/3227365552 wait complete. 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 1 -- start start 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 1 Processor -- start 2024-03-27T07:26:55.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc0436f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 0x55e8cc043c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc044170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e8cc049540 con 0x55e8cc046750 2024-03-27T07:26:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e8cbf5ccd0 con 0x55e8cc03db70 2024-03-27T07:26:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e8cc0496c0 con 0x55e8cc03d250 2024-03-27T07:26:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c5190740 10 client.0 _ll_register_callbacks cb 0x55e8cbf4eee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c0a66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc044170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58bbfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc0436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c0a66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc044170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36412/0 (socket says 172.21.15.82:36412) 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58c0a66640 1 -- 172.21.15.82:0/1998379985 learned_addr learned my addr 172.21.15.82:0/1998379985 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.200+0000 7f58bb7fe640 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 0x55e8cc043c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f58c0a66640 1 -- 172.21.15.82:0/1998379985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 msgr2=0x55e8cc0436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f58c0a66640 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc0436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f58c0a66640 1 -- 172.21.15.82:0/1998379985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 msgr2=0x55e8cc043c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f58c0a66640 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 0x55e8cc043c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f58c0a66640 1 -- 172.21.15.82:0/1998379985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8cbd7f7d0 con 0x55e8cc046750 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f58bb7fe640 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 0x55e8cc043c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f58c0a66640 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc044170 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f58b400ae80 tx=0x7f58b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cec231d323ba50 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f589b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f589b7fe640 1 -- 172.21.15.82:0/1998379985 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b40148a0 con 0x55e8cc046750 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f589b7fe640 1 -- 172.21.15.82:0/1998379985 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f58b4020610 con 0x55e8cc046750 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f58c5190740 1 -- 172.21.15.82:0/1998379985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58ac0043d0 con 0x55e8cc046750 2024-03-27T07:26:55.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f589b7fe640 1 -- 172.21.15.82:0/1998379985 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f58b4022e20 con 0x55e8cc046750 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f58c5190740 10 client.16386 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f58c5190740 1 -- 172.21.15.82:0/1998379985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e8cbcb53f0 con 0x55e8cc046750 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.201+0000 7f589b7fe640 1 -- 172.21.15.82:0/1998379985 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58ac0043d0 con 0x55e8cc046750 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.202+0000 7f589b7fe640 1 -- 172.21.15.82:0/1998379985 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f58b400f040 con 0x55e8cc046750 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.202+0000 7f58c5190740 10 client.16386 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.202+0000 7f58c5190740 10 client.16386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.202+0000 7f58c5190740 20 client.16386 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.202+0000 7f58c5190740 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e8cc056de0 0x55e8cc0591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.202+0000 7f58c5190740 4 client.16386 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.202+0000 7f58c5190740 1 -- 172.21.15.82:0/1998379985 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8cbfaeda0 con 0x55e8cc056de0 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.202+0000 7f58bbfff640 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e8cc056de0 0x55e8cc0591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.203+0000 7f58bbfff640 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e8cc056de0 0x55e8cc0591d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff010c273f8b1b9 server_cookie=e0883bfc9e1744f0 in_seq=0 out_seq=0 2024-03-27T07:26:55.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.203+0000 7f589b7fe640 10 client.16386 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.205+0000 7f589b7fe640 1 -- 172.21.15.82:0/1998379985 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e8cbfaeda0 con 0x55e8cc056de0 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.205+0000 7f589b7fe640 10 client.16386 handle_command_reply: tid=0 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.205+0000 7f58c5190740 1 client.16386 shutdown 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.205+0000 7f58c5190740 1 -- 172.21.15.82:0/1998379985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 msgr2=0x55e8cc044170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.205+0000 7f58c5190740 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc044170 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f58b400ae80 tx=0x7f58b4004a40 comp rx=0 tx=0).stop 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.205+0000 7f58c5190740 1 -- 172.21.15.82:0/1998379985 shutdown_connections 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.206+0000 7f58c5190740 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e8cc056de0 0x55e8cc0591d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.206+0000 7f58c5190740 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc044170 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.206+0000 7f58c5190740 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 0x55e8cc043c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.206+0000 7f58c5190740 1 --2- 172.21.15.82:0/1998379985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc0436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.206+0000 7f589b7fe640 0 client.16386 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.206+0000 7f58c5190740 1 -- 172.21.15.82:0/1998379985 >> 172.21.15.82:0/1998379985 conn(0x55e8cc037980 msgr2=0x55e8cc0396d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.206+0000 7f58c5190740 1 -- 172.21.15.82:0/1998379985 shutdown_connections 2024-03-27T07:26:55.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.206+0000 7f58c5190740 1 -- 172.21.15.82:0/1998379985 wait complete. 2024-03-27T07:26:55.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.206+0000 7f58c5190740 20 client.16386 trim_cache size 0 max 16384 2024-03-27T07:26:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c5190740 1 Processor -- start 2024-03-27T07:26:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c5190740 1 -- start start 2024-03-27T07:26:55.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c5190740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc045e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c5190740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 0x55e8cc042630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c5190740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc0522e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c5190740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1adee0 con 0x55e8cc046750 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c5190740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1ab750 con 0x55e8cc03db70 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c5190740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1a95a0 con 0x55e8cc03d250 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c0a66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc0522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58bbfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc045e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c0a66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc0522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36418/0 (socket says 172.21.15.82:36418) 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58bbfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc045e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:51024/0 (socket says 172.21.15.82:51024) 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.224+0000 7f58c0a66640 1 -- 172.21.15.82:0/1933591568 learned_addr learned my addr 172.21.15.82:0/1933591568 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.225+0000 7f58bb7fe640 1 --2- 172.21.15.82:0/1933591568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 0x55e8cc042630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.225+0000 7f58c0a66640 1 -- 172.21.15.82:0/1933591568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 msgr2=0x55e8cc045e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.225+0000 7f58c0a66640 1 --2- 172.21.15.82:0/1933591568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc045e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.225+0000 7f58c0a66640 1 -- 172.21.15.82:0/1933591568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 msgr2=0x55e8cc042630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.225+0000 7f58c0a66640 1 --2- 172.21.15.82:0/1933591568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 0x55e8cc042630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.225+0000 7f58c0a66640 1 -- 172.21.15.82:0/1933591568 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8cbc750f0 con 0x55e8cc046750 2024-03-27T07:26:55.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.225+0000 7f58c0a66640 1 --2- 172.21.15.82:0/1933591568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc0522e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f58b40051b0 tx=0x7f58b4014d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0779e4cd8983d86 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.225+0000 7f58a1ffb640 1 -- 172.21.15.82:0/1933591568 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b40148a0 con 0x55e8cc046750 2024-03-27T07:26:55.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.225+0000 7f58a1ffb640 1 -- 172.21.15.82:0/1933591568 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58b4004f90 con 0x55e8cc046750 2024-03-27T07:26:55.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.225+0000 7f58a1ffb640 1 -- 172.21.15.82:0/1933591568 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4020870 con 0x55e8cc046750 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.226+0000 7f58c5190740 1 -- 172.21.15.82:0/1933591568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 msgr2=0x55e8cc0522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.226+0000 7f58c5190740 1 --2- 172.21.15.82:0/1933591568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc0522e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f58b40051b0 tx=0x7f58b4014d00 comp rx=0 tx=0).stop 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.226+0000 7f58c5190740 1 -- 172.21.15.82:0/1933591568 shutdown_connections 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.226+0000 7f58c5190740 1 --2- 172.21.15.82:0/1933591568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc046750 0x55e8cc0522e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.226+0000 7f58c5190740 1 --2- 172.21.15.82:0/1933591568 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc03db70 0x55e8cc042630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.226+0000 7f58c5190740 1 --2- 172.21.15.82:0/1933591568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc045e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.226+0000 7f58c5190740 1 -- 172.21.15.82:0/1933591568 >> 172.21.15.82:0/1933591568 conn(0x55e8cc037980 msgr2=0x55e8cc036920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.226+0000 7f58c5190740 1 -- 172.21.15.82:0/1933591568 shutdown_connections 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.226+0000 7f58c5190740 1 -- 172.21.15.82:0/1933591568 wait complete. 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.226+0000 7f58c5190740 1 -- start start 2024-03-27T07:26:55.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58c5190740 1 Processor -- start 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58c5190740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc04ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58c5190740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc04a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58c5190740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc046750 0x55e8cc04a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58c5190740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1a9c10 con 0x55e8cc03db70 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58c5190740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1ab080 con 0x55e8cc046750 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58c5190740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc1aa2e0 con 0x55e8cc03d250 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58c5190740 10 client.0 _ll_register_callbacks cb 0x7f58b4014d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58bb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc04a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58bb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc04a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36430/0 (socket says 172.21.15.82:36430) 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58bb7fe640 1 -- 172.21.15.82:0/2525840808 learned_addr learned my addr 172.21.15.82:0/2525840808 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58bbfff640 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc04ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58c0a66640 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc046750 0x55e8cc04a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58bb7fe640 1 -- 172.21.15.82:0/2525840808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 msgr2=0x55e8cc04ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58bb7fe640 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc04ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58bb7fe640 1 -- 172.21.15.82:0/2525840808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc046750 msgr2=0x55e8cc04a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58bb7fe640 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc046750 0x55e8cc04a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58bb7fe640 1 -- 172.21.15.82:0/2525840808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8cc0bbf00 con 0x55e8cc03db70 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f58bb7fe640 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc04a0a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f58b00ef230 tx=0x7f58b004ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c76f65b5a75d0dd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.227+0000 7f589b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f589b7fe640 1 -- 172.21.15.82:0/2525840808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b00bd800 con 0x55e8cc03db70 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f589b7fe640 1 -- 172.21.15.82:0/2525840808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f58b00bdf20 con 0x55e8cc03db70 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f58c5190740 1 -- 172.21.15.82:0/2525840808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b4004f90 con 0x55e8cc03db70 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f589b7fe640 1 -- 172.21.15.82:0/2525840808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f58b0003e60 con 0x55e8cc03db70 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f58c5190740 10 client.16392 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f58c5190740 1 -- 172.21.15.82:0/2525840808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e8cc0bd110 con 0x55e8cc03db70 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f589b7fe640 1 -- 172.21.15.82:0/2525840808 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f58b4004f90 con 0x55e8cc03db70 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f589b7fe640 1 -- 172.21.15.82:0/2525840808 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f58b00dcbe0 con 0x55e8cc03db70 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f58c5190740 10 client.16392 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:55.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f58c5190740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f58c5190740 20 client.16392 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f58c5190740 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e8cc0bd9c0 0x55e8cc0bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f58c5190740 4 client.16392 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:26:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.228+0000 7f58c5190740 1 -- 172.21.15.82:0/2525840808 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e8cbfa90f0 con 0x55e8cc0bd9c0 2024-03-27T07:26:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.229+0000 7f58bbfff640 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e8cc0bd9c0 0x55e8cc0bfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.230+0000 7f589b7fe640 10 client.16392 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:55.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.230+0000 7f58bbfff640 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e8cc0bd9c0 0x55e8cc0bfdb0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=595c54d7941c2f0d server_cookie=aae294a8d7943054 in_seq=0 out_seq=0 2024-03-27T07:26:55.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f589b7fe640 1 -- 172.21.15.82:0/2525840808 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x55e8cbfa90f0 con 0x55e8cc0bd9c0 2024-03-27T07:26:55.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f589b7fe640 10 client.16392 handle_command_reply: tid=0 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 client.16392 shutdown 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 -- 172.21.15.82:0/2525840808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 msgr2=0x55e8cc04a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc04a0a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f58b00ef230 tx=0x7f58b004ef90 comp rx=0 tx=0).stop 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 -- 172.21.15.82:0/2525840808 shutdown_connections 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e8cc0bd9c0 0x55e8cc0bfdb0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e8cc03db70 0x55e8cc04a0a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e8cc046750 0x55e8cc04a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 --2- 172.21.15.82:0/2525840808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e8cc03d250 0x55e8cc04ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f589b7fe640 0 client.16392 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 -- 172.21.15.82:0/2525840808 >> 172.21.15.82:0/2525840808 conn(0x55e8cc037980 msgr2=0x55e8cc036090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 -- 172.21.15.82:0/2525840808 shutdown_connections 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 1 -- 172.21.15.82:0/2525840808 wait complete. 2024-03-27T07:26:55.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c5190740 20 client.16392 trim_cache size 0 max 16384 2024-03-27T07:26:55.239 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:26:55.239 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (0 inodes in the stack)", 2024-03-27T07:26:55.239 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-03-27T07:26:55.239 INFO:teuthology.orchestra.run.smithi082.stdout: "1cf0cd2a-b628-4436-a344-4b1222519eef": { 2024-03-27T07:26:55.239 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-03-27T07:26:55.239 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "1cf0cd2a-b628-4436-a344-4b1222519eef", 2024-03-27T07:26:55.239 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-03-27T07:26:55.239 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:26:55.239 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:26:55.239 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:26:55.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c24c9640 1 -- 172.21.15.82:0/2362470053 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f58a40a3780 msgr2=0x7f58a40a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c24c9640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f58a40a3780 0x7f58a40a5c40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f58b4005fd0 tx=0x7f58b4009600 comp rx=0 tx=0).stop 2024-03-27T07:26:55.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c24c9640 1 -- 172.21.15.82:0/2362470053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc1013c0 msgr2=0x7f58bc1989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.233+0000 7f58c24c9640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc1013c0 0x7f58bc1989d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f58b0009230 tx=0x7f58b002cba0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.234+0000 7f58c24c9640 1 -- 172.21.15.82:0/2362470053 shutdown_connections 2024-03-27T07:26:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.234+0000 7f58c24c9640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f58a40a3780 0x7f58a40a5c40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.234+0000 7f58c24c9640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58bc1013c0 0x7f58bc1989d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.234+0000 7f58c24c9640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58bc106a10 0x7f58bc19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.234+0000 7f58c24c9640 1 --2- 172.21.15.82:0/2362470053 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f58bc100a00 0x7f58bc198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.234+0000 7f58c24c9640 1 -- 172.21.15.82:0/2362470053 >> 172.21.15.82:0/2362470053 conn(0x7f58bc076dd0 msgr2=0x7f58bc06a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.234+0000 7f58c24c9640 1 -- 172.21.15.82:0/2362470053 shutdown_connections 2024-03-27T07:26:55.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:26:55.234+0000 7f58c24c9640 1 -- 172.21.15.82:0/2362470053 wait complete. 2024-03-27T07:26:55.247 INFO:tasks.cephfs.filesystem:scrub status for tag:1cf0cd2a-b628-4436-a344-4b1222519eef - {'path': '/', 'tag': '1cf0cd2a-b628-4436-a344-4b1222519eef', 'options': 'recursive,force'} 2024-03-27T07:26:55.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:55 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:55.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.498+0000 7f19f9433640 1 -- 172.21.15.82:0/3468708772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f4102a30 msgr2=0x7f19f40691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.498+0000 7f19f9433640 1 --2- 172.21.15.82:0/3468708772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f4102a30 0x7f19f40691d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009900 tx=0x7f19e402bcd0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.498+0000 7f19f9433640 1 -- 172.21.15.82:0/3468708772 shutdown_connections 2024-03-27T07:26:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.498+0000 7f19f9433640 1 --2- 172.21.15.82:0/3468708772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f410e3a0 0x7f19f41107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.498+0000 7f19f9433640 1 --2- 172.21.15.82:0/3468708772 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f4069710 0x7f19f4069b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.498+0000 7f19f9433640 1 --2- 172.21.15.82:0/3468708772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f4102a30 0x7f19f40691d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.498+0000 7f19f9433640 1 -- 172.21.15.82:0/3468708772 >> 172.21.15.82:0/3468708772 conn(0x7f19f40778a0 msgr2=0x7f19f4077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.498+0000 7f19f9433640 1 -- 172.21.15.82:0/3468708772 shutdown_connections 2024-03-27T07:26:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.498+0000 7f19f9433640 1 -- 172.21.15.82:0/3468708772 wait complete. 2024-03-27T07:26:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19f9433640 1 Processor -- start 2024-03-27T07:26:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19f9433640 1 -- start start 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19f9433640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f4069710 0x7f19f419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19f9433640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f4102a30 0x7f19f419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19f9433640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f410e3a0 0x7f19f419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19f9433640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4114100 con 0x7f19f4102a30 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19f9433640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4113f80 con 0x7f19f4069710 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19f9433640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4114280 con 0x7f19f410e3a0 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19ebfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f4102a30 0x7f19f419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19f2ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f4069710 0x7f19f419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19ebfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f4102a30 0x7f19f419aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36450/0 (socket says 172.21.15.82:36450) 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19ebfff640 1 -- 172.21.15.82:0/2626276889 learned_addr learned my addr 172.21.15.82:0/2626276889 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.499+0000 7f19f37fe640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f410e3a0 0x7f19f419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19ebfff640 1 -- 172.21.15.82:0/2626276889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f410e3a0 msgr2=0x7f19f419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19ebfff640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f410e3a0 0x7f19f419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19ebfff640 1 -- 172.21.15.82:0/2626276889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f4069710 msgr2=0x7f19f419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19ebfff640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f4069710 0x7f19f419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19ebfff640 1 -- 172.21.15.82:0/2626276889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f419f570 con 0x7f19f4102a30 2024-03-27T07:26:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19f2ffd640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f4069710 0x7f19f419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19ebfff640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f4102a30 0x7f19f419aac0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00e9f0 tx=0x7f19dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19f0ff9640 1 -- 172.21.15.82:0/2626276889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00cd80 con 0x7f19f4102a30 2024-03-27T07:26:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19f9433640 1 -- 172.21.15.82:0/2626276889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f419f860 con 0x7f19f4102a30 2024-03-27T07:26:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19f0ff9640 1 -- 172.21.15.82:0/2626276889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19dc010910 con 0x7f19f4102a30 2024-03-27T07:26:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19f0ff9640 1 -- 172.21.15.82:0/2626276889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0188f0 con 0x7f19f4102a30 2024-03-27T07:26:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.500+0000 7f19f9433640 1 -- 172.21.15.82:0/2626276889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41a70f0 con 0x7f19f4102a30 2024-03-27T07:26:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.502+0000 7f19f0ff9640 1 -- 172.21.15.82:0/2626276889 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f19dc010ac0 con 0x7f19f4102a30 2024-03-27T07:26:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19fc01b740 1 Processor -- start 2024-03-27T07:26:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19fc01b740 1 -- start start 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19f0ff9640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f19e00a3820 0x7f19e00a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19f37fe640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f19e00a3820 0x7f19e00a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19f0ff9640 1 -- 172.21.15.82:0/2626276889 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f19dc0d0490 con 0x7f19f4102a30 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 0x5653098d44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098dd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098dfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19fc01b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56530989acd0 con 0x5653098d4a10 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19fc01b740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5653097df950 con 0x5653098d40f0 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19fc01b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565309837e50 con 0x5653098dd7e0 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19f2ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 0x5653098d44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19ebfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098dd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19f2ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 0x5653098d44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42168/0 (socket says 172.21.15.82:42168) 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19f2ffd640 1 -- 172.21.15.82:0/2525197800 learned_addr learned my addr 172.21.15.82:0/2525197800 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19f37fe640 1 --2- 172.21.15.82:0/2525197800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098dfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.503+0000 7f19f37fe640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f19e00a3820 0x7f19e00a5ce0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f19f406b070 tx=0x7f19ec009550 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.504+0000 7f19f2ffd640 1 -- 172.21.15.82:0/2525197800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 msgr2=0x5653098dfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.504+0000 7f19f2ffd640 1 --2- 172.21.15.82:0/2525197800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098dfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.504+0000 7f19f2ffd640 1 -- 172.21.15.82:0/2525197800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 msgr2=0x5653098dd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.504+0000 7f19f2ffd640 1 --2- 172.21.15.82:0/2525197800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098dd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.504+0000 7f19f2ffd640 1 -- 172.21.15.82:0/2525197800 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56530954c210 con 0x5653098d40f0 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.504+0000 7f19ebfff640 1 --2- 172.21.15.82:0/2525197800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098dd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.504+0000 7f19f2ffd640 1 --2- 172.21.15.82:0/2525197800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 0x5653098d44d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f19e402c210 tx=0x7f19e4005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8208cb06167112a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.504+0000 7f19e97fa640 1 -- 172.21.15.82:0/2525197800 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4042070 con 0x5653098d40f0 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.504+0000 7f19e97fa640 1 -- 172.21.15.82:0/2525197800 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e4004a70 con 0x5653098d40f0 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.504+0000 7f19e97fa640 1 -- 172.21.15.82:0/2525197800 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4005190 con 0x5653098d40f0 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 -- 172.21.15.82:0/2525197800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 msgr2=0x5653098d44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 --2- 172.21.15.82:0/2525197800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 0x5653098d44d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f19e402c210 tx=0x7f19e4005e00 comp rx=0 tx=0).stop 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 -- 172.21.15.82:0/2525197800 shutdown_connections 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 --2- 172.21.15.82:0/2525197800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098dd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 --2- 172.21.15.82:0/2525197800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098dfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 --2- 172.21.15.82:0/2525197800 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 0x5653098d44d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 -- 172.21.15.82:0/2525197800 >> 172.21.15.82:0/2525197800 conn(0x5653098cea10 msgr2=0x5653098cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 -- 172.21.15.82:0/2525197800 shutdown_connections 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 -- 172.21.15.82:0/2525197800 wait complete. 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 -- start start 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 Processor -- start 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d40f0 0x5653098da800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 0x5653098dad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098db280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565309833e00 con 0x5653098d40f0 2024-03-27T07:26:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5653097e0520 con 0x5653098d4a10 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.505+0000 7f19fc01b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5653097f38e0 con 0x5653098dd7e0 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d40f0 0x5653098da800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19fc01b740 10 client.0 _ll_register_callbacks cb 0x56530982ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19f2ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d40f0 0x5653098da800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36466/0 (socket says 172.21.15.82:36466) 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19f2ffd640 1 -- 172.21.15.82:0/1592481853 learned_addr learned my addr 172.21.15.82:0/1592481853 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19f37fe640 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098db280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19ebfff640 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 0x5653098dad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19f2ffd640 1 -- 172.21.15.82:0/1592481853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 msgr2=0x5653098db280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19f2ffd640 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098db280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19f2ffd640 1 -- 172.21.15.82:0/1592481853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 msgr2=0x5653098dad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19f2ffd640 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 0x5653098dad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19f2ffd640 1 -- 172.21.15.82:0/1592481853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565309618620 con 0x5653098d40f0 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19ebfff640 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 0x5653098dad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19f2ffd640 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d40f0 0x5653098da800 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f19e4004650 tx=0x7f19e402bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca2df365f4f3158 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19da7fc640 1 -- 172.21.15.82:0/1592481853 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4042070 con 0x5653098d40f0 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19da7fc640 1 -- 172.21.15.82:0/1592481853 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f19e4005130 con 0x5653098d40f0 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19fc01b740 1 -- 172.21.15.82:0/1592481853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19e4004a70 con 0x5653098d40f0 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19da7fc640 1 -- 172.21.15.82:0/1592481853 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f19e4058050 con 0x5653098d40f0 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19fc01b740 10 client.16404 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19fc01b740 1 -- 172.21.15.82:0/1592481853 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5653098ec2f0 con 0x5653098d40f0 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.506+0000 7f19da7fc640 1 -- 172.21.15.82:0/1592481853 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e4004a70 con 0x5653098d40f0 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.507+0000 7f19da7fc640 1 -- 172.21.15.82:0/1592481853 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f19e4034440 con 0x5653098d40f0 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.507+0000 7f19fc01b740 10 client.16404 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.507+0000 7f19fc01b740 10 client.16404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.507+0000 7f19fc01b740 20 client.16404 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.507+0000 7f19fc01b740 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5653098ed640 0x5653098efa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.507+0000 7f19fc01b740 4 client.16404 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:26:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.507+0000 7f19fc01b740 1 -- 172.21.15.82:0/1592481853 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565309845390 con 0x5653098ed640 2024-03-27T07:26:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.507+0000 7f19ebfff640 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5653098ed640 0x5653098efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.507+0000 7f19ebfff640 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5653098ed640 0x5653098efa30 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14c7b078310a9a7 server_cookie=bebe68d492b21d6b in_seq=0 out_seq=0 2024-03-27T07:26:55.518 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.507+0000 7f19da7fc640 10 client.16404 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19da7fc640 1 -- 172.21.15.82:0/1592481853 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x565309845390 con 0x5653098ed640 2024-03-27T07:26:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19da7fc640 10 client.16404 handle_command_reply: tid=0 2024-03-27T07:26:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 client.16404 shutdown 2024-03-27T07:26:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 -- 172.21.15.82:0/1592481853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d40f0 msgr2=0x5653098da800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d40f0 0x5653098da800 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f19e4004650 tx=0x7f19e402bcd0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 -- 172.21.15.82:0/1592481853 shutdown_connections 2024-03-27T07:26:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098db280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 0x5653098dad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5653098ed640 0x5653098efa30 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 --2- 172.21.15.82:0/1592481853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d40f0 0x5653098da800 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 -- 172.21.15.82:0/1592481853 >> 172.21.15.82:0/1592481853 conn(0x5653098cea10 msgr2=0x5653098d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19da7fc640 0 client.16404 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 -- 172.21.15.82:0/1592481853 shutdown_connections 2024-03-27T07:26:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 1 -- 172.21.15.82:0/1592481853 wait complete. 2024-03-27T07:26:55.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.511+0000 7f19fc01b740 20 client.16404 trim_cache size 0 max 16384 2024-03-27T07:26:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.526+0000 7f19fc01b740 1 Processor -- start 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.526+0000 7f19fc01b740 1 -- start start 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.526+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 0x5653098dcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.526+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098d9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.526+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098e8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19fc01b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b2130 con 0x5653098d4a10 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19fc01b740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41af9a0 con 0x5653098d40f0 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19fc01b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41ad7f0 con 0x5653098dd7e0 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19ebfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098d9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19ebfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098d9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36482/0 (socket says 172.21.15.82:36482) 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19ebfff640 1 -- 172.21.15.82:0/626482635 learned_addr learned my addr 172.21.15.82:0/626482635 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19f2ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 0x5653098dcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19f37fe640 1 --2- 172.21.15.82:0/626482635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098e8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19ebfff640 1 -- 172.21.15.82:0/626482635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 msgr2=0x5653098e8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19ebfff640 1 --2- 172.21.15.82:0/626482635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098e8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19ebfff640 1 -- 172.21.15.82:0/626482635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 msgr2=0x5653098dcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19ebfff640 1 --2- 172.21.15.82:0/626482635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 0x5653098dcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19ebfff640 1 -- 172.21.15.82:0/626482635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653098d63d0 con 0x5653098d4a10 2024-03-27T07:26:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19f37fe640 1 --2- 172.21.15.82:0/626482635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:26:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19ebfff640 1 --2- 172.21.15.82:0/626482635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098d9960 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0cdce0 tx=0x7f19dc098a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fdbaf69c04da0c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19e8ff9640 1 -- 172.21.15.82:0/626482635 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc0b5070 con 0x5653098d4a10 2024-03-27T07:26:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19e8ff9640 1 -- 172.21.15.82:0/626482635 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19dc09aa20 con 0x5653098d4a10 2024-03-27T07:26:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.527+0000 7f19e8ff9640 1 -- 172.21.15.82:0/626482635 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc09bb70 con 0x5653098d4a10 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 -- 172.21.15.82:0/626482635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 msgr2=0x5653098d9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 --2- 172.21.15.82:0/626482635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098d9960 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0cdce0 tx=0x7f19dc098a70 comp rx=0 tx=0).stop 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 -- 172.21.15.82:0/626482635 shutdown_connections 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 --2- 172.21.15.82:0/626482635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098d4a10 0x5653098d9960 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 --2- 172.21.15.82:0/626482635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098dd7e0 0x5653098e8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 --2- 172.21.15.82:0/626482635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d40f0 0x5653098dcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 -- 172.21.15.82:0/626482635 >> 172.21.15.82:0/626482635 conn(0x5653098cea10 msgr2=0x5653098cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 -- 172.21.15.82:0/626482635 shutdown_connections 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 -- 172.21.15.82:0/626482635 wait complete. 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 -- start start 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 Processor -- start 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098d40f0 0x5653098e5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.535 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.528+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 0x5653098e5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19fc01b740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098dd7e0 0x5653098e1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19fc01b740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41ade60 con 0x5653098dd7e0 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19fc01b740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41af2d0 con 0x5653098d4a10 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19fc01b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41ae530 con 0x5653098d40f0 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19fc01b740 10 client.0 _ll_register_callbacks cb 0x7f19dc0989c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19f37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098dd7e0 0x5653098e1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19f37fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098dd7e0 0x5653098e1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36490/0 (socket says 172.21.15.82:36490) 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19f2ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098d40f0 0x5653098e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19f37fe640 1 -- 172.21.15.82:0/2301694811 learned_addr learned my addr 172.21.15.82:0/2301694811 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19ebfff640 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 0x5653098e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19f37fe640 1 -- 172.21.15.82:0/2301694811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098d40f0 msgr2=0x5653098e5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19f37fe640 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098d40f0 0x5653098e5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19f37fe640 1 -- 172.21.15.82:0/2301694811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 msgr2=0x5653098e5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:26:55.536 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19f37fe640 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 0x5653098e5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19f37fe640 1 -- 172.21.15.82:0/2301694811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653098e1d30 con 0x5653098dd7e0 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19f37fe640 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098dd7e0 0x5653098e1530 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f19ec012ca0 tx=0x7f19ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71e4b854f6aa2a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19da7fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19da7fc640 1 -- 172.21.15.82:0/2301694811 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec003b70 con 0x5653098dd7e0 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19da7fc640 1 -- 172.21.15.82:0/2301694811 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f19ec003d10 con 0x5653098dd7e0 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19fc01b740 1 -- 172.21.15.82:0/2301694811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19dc09aa20 con 0x5653098dd7e0 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19da7fc640 1 -- 172.21.15.82:0/2301694811 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f19ec004020 con 0x5653098dd7e0 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19fc01b740 10 client.16410 fetch_fsmap learned FSMap version 26 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.529+0000 7f19fc01b740 1 -- 172.21.15.82:0/2301694811 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5653099542a0 con 0x5653098dd7e0 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19da7fc640 1 -- 172.21.15.82:0/2301694811 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19dc09aa20 con 0x5653098dd7e0 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19da7fc640 1 -- 172.21.15.82:0/2301694811 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f19ec027070 con 0x5653098dd7e0 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19fc01b740 10 client.16410 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19fc01b740 10 client.16410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:26:55.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19fc01b740 20 client.16410 populate_metadata read hostname 'smithi082' 2024-03-27T07:26:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19fc01b740 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565309954ad0 0x565309956ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:26:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19fc01b740 4 client.16410 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:26:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19fc01b740 1 -- 172.21.15.82:0/2301694811 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56530983f6e0 con 0x565309954ad0 2024-03-27T07:26:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19f2ffd640 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565309954ad0 0x565309956ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:26:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19da7fc640 10 client.16410 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:55.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:55.530+0000 7f19f2ffd640 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565309954ad0 0x565309956ef0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60a96680a0979fb server_cookie=1183061b1c02375 in_seq=0 out_seq=0 2024-03-27T07:26:55.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:55 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:55.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:55 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:56 smithi082 ceph-mon[32178]: pgmap v103: 97 pgs: 97 active+clean; 497 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 640 op/s 2024-03-27T07:26:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:56 smithi082 ceph-mon[32178]: scrub queued for path: / 2024-03-27T07:26:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:56 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:56.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:56 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:56.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:56 smithi149 ceph-mon[36065]: pgmap v103: 97 pgs: 97 active+clean; 497 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 640 op/s 2024-03-27T07:26:56.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:56 smithi149 ceph-mon[36065]: scrub queued for path: / 2024-03-27T07:26:56.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:56 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:56.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:56 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:56 smithi153 ceph-mon[36179]: pgmap v103: 97 pgs: 97 active+clean; 497 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 12 MiB/s wr, 640 op/s 2024-03-27T07:26:56.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:56 smithi153 ceph-mon[36179]: scrub queued for path: / 2024-03-27T07:26:56.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:56 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:56.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:56 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19da7fc640 1 -- 172.21.15.82:0/2301694811 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56530983f6e0 con 0x565309954ad0 2024-03-27T07:26:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19da7fc640 10 client.16410 handle_command_reply: tid=0 2024-03-27T07:26:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 client.16410 shutdown 2024-03-27T07:26:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 -- 172.21.15.82:0/2301694811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098dd7e0 msgr2=0x5653098e1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098dd7e0 0x5653098e1530 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f19ec012ca0 tx=0x7f19ec004a40 comp rx=0 tx=0).stop 2024-03-27T07:26:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 -- 172.21.15.82:0/2301694811 shutdown_connections 2024-03-27T07:26:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565309954ad0 0x565309956ef0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5653098dd7e0 0x5653098e1530 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5653098d4a10 0x5653098e5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 --2- 172.21.15.82:0/2301694811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5653098d40f0 0x5653098e5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19da7fc640 0 client.16410 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:26:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 -- 172.21.15.82:0/2301694811 >> 172.21.15.82:0/2301694811 conn(0x5653098cea10 msgr2=0x5653098da7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 -- 172.21.15.82:0/2301694811 shutdown_connections 2024-03-27T07:26:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 1 -- 172.21.15.82:0/2301694811 wait complete. 2024-03-27T07:26:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.988+0000 7f19fc01b740 20 client.16410 trim_cache size 0 max 16384 2024-03-27T07:26:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:26:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:26:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:26:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:26:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 -- 172.21.15.82:0/2626276889 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f19e00a3820 msgr2=0x7f19e00a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f19e00a3820 0x7f19e00a5ce0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f19f406b070 tx=0x7f19ec009550 comp rx=0 tx=0).stop 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 -- 172.21.15.82:0/2626276889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f4102a30 msgr2=0x7f19f419aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f4102a30 0x7f19f419aac0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00e9f0 tx=0x7f19dc00eeb0 comp rx=0 tx=0).stop 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 -- 172.21.15.82:0/2626276889 shutdown_connections 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f19e00a3820 0x7f19e00a5ce0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f19f4102a30 0x7f19f419aac0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f410e3a0 0x7f19f419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 --2- 172.21.15.82:0/2626276889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f19f4069710 0x7f19f419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 -- 172.21.15.82:0/2626276889 >> 172.21.15.82:0/2626276889 conn(0x7f19f40778a0 msgr2=0x7f19f40ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 -- 172.21.15.82:0/2626276889 shutdown_connections 2024-03-27T07:26:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:26:56.989+0000 7f19f9433640 1 -- 172.21.15.82:0/2626276889 wait complete. 2024-03-27T07:26:57.157 INFO:tasks.workunit.client.0.smithi082.stdout: 133 503103 298 358000 282 157060 704 2024-03-27T07:26:57.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:57 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:57 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:57.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:57 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:57.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:57 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:57 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:57.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:57 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:57 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:57 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:57.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:57 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:57 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:57 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:57.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:57 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:57.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:57 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:57 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:57.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:57 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:57 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:57 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:57.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:57 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:57 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:57 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:57.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:57 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:57.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:57 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:57 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:57.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:57 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:57 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:57.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:57 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:57.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:57 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.038 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:26:57 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:26:57.691+0000 7f112ebbc700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e50 [...5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/ auth{0=1,2=1} fragtree_t(*^3) v101785 ap=2 DIRTYPARENT f(v2 m2024-03-27T07:26:16.466035+0000 238=238+0) n(v3 rc2024-03-27T07:26:16.466035+0000 b4998342 239=238+1) old_inodes=1 (inest sync->mix g=0,2) caps={15291=pAsLsXsFs/pAsLsXsFsxcral@92} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyparent=1 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5607a759e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(2)0x20000001e50:[<0x10000000399/blog-53 v101785>,<0x10000000208/blogtest_in v1596>,<0x10000000201/src v2021>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T07:26:05.981241+0000 147=147+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T07:26:16.466035+0000 b4998342 239=238+1)","memory_value.dirstat":"f(v2 m2024-03-27T07:26:16.466035+0000 238=238+0)","memory_value.rstat":"n(v3 rc2024-03-27T07:26:16.466035+0000 b4998342 239=238+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-61} 2024-03-27T07:26:58.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:58.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:58.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: pgmap v104: 97 pgs: 97 active+clean; 539 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 16 MiB/s wr, 1.11k op/s 2024-03-27T07:26:58.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:58.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:58.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:58.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:58.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53) see mds.i log and `damage ls` output for details 2024-03-27T07:26:58.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:26:58.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:26:58 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: pgmap v104: 97 pgs: 97 active+clean; 539 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 16 MiB/s wr, 1.11k op/s 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53) see mds.i log and `damage ls` output for details 2024-03-27T07:26:58.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:26:58.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:26:58 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: pgmap v104: 97 pgs: 97 active+clean; 539 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 16 MiB/s wr, 1.11k op/s 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:58.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53) see mds.i log and `damage ls` output for details 2024-03-27T07:26:58.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:26:58.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:26:58.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:26:58 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:00.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:00 smithi082 ceph-mon[32178]: pgmap v105: 97 pgs: 97 active+clean; 539 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 15 MiB/s wr, 983 op/s 2024-03-27T07:27:00.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:00 smithi149 ceph-mon[36065]: pgmap v105: 97 pgs: 97 active+clean; 539 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 15 MiB/s wr, 983 op/s 2024-03-27T07:27:00.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:00 smithi153 ceph-mon[36179]: pgmap v105: 97 pgs: 97 active+clean; 539 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 15 MiB/s wr, 983 op/s 2024-03-27T07:27:01.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:01 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:01.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:01 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:01.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:01 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:02.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:02 smithi082 ceph-mon[32178]: pgmap v106: 97 pgs: 97 active+clean; 543 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.49k op/s 2024-03-27T07:27:02.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:02 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:02.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:02 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:02.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:02 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:02.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:02 smithi149 ceph-mon[36065]: pgmap v106: 97 pgs: 97 active+clean; 543 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.49k op/s 2024-03-27T07:27:02.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:02 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:02.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:02 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:02.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:02 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:02.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:02 smithi153 ceph-mon[36179]: pgmap v106: 97 pgs: 97 active+clean; 543 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 1.49k op/s 2024-03-27T07:27:02.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:02 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:02.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:02 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:02.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:02 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:04 smithi082 ceph-mon[32178]: pgmap v107: 97 pgs: 97 active+clean; 543 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 978 op/s 2024-03-27T07:27:04.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:04 smithi149 ceph-mon[36065]: pgmap v107: 97 pgs: 97 active+clean; 543 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 978 op/s 2024-03-27T07:27:04.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:04 smithi153 ceph-mon[36179]: pgmap v107: 97 pgs: 97 active+clean; 543 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 978 op/s 2024-03-27T07:27:06.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:06 smithi082 ceph-mon[32178]: pgmap v108: 97 pgs: 97 active+clean; 543 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 978 op/s 2024-03-27T07:27:06.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:06 smithi149 ceph-mon[36065]: pgmap v108: 97 pgs: 97 active+clean; 543 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 978 op/s 2024-03-27T07:27:06.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:06 smithi153 ceph-mon[36179]: pgmap v108: 97 pgs: 97 active+clean; 543 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.7 MiB/s wr, 978 op/s 2024-03-27T07:27:07.157 INFO:tasks.workunit.client.0.smithi082.stdout: 149 97914 907 67861 714 39992 1077 2024-03-27T07:27:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:08 smithi082 ceph-mon[32178]: pgmap v109: 97 pgs: 97 active+clean; 550 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 1.03k op/s 2024-03-27T07:27:08.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:08 smithi149 ceph-mon[36065]: pgmap v109: 97 pgs: 97 active+clean; 550 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 1.03k op/s 2024-03-27T07:27:08.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:08 smithi153 ceph-mon[36179]: pgmap v109: 97 pgs: 97 active+clean; 550 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 1.03k op/s 2024-03-27T07:27:10.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:10 smithi082 ceph-mon[32178]: pgmap v110: 97 pgs: 97 active+clean; 550 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 562 op/s 2024-03-27T07:27:10.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:10 smithi149 ceph-mon[36065]: pgmap v110: 97 pgs: 97 active+clean; 550 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 562 op/s 2024-03-27T07:27:10.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:10 smithi153 ceph-mon[36179]: pgmap v110: 97 pgs: 97 active+clean; 550 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.6 MiB/s wr, 562 op/s 2024-03-27T07:27:11.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.624+0000 7fd0adc34640 1 -- 172.21.15.82:0/1609122781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a8110150 msgr2=0x7fd0a8110530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:11.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.624+0000 7fd0adc34640 1 --2- 172.21.15.82:0/1609122781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a8110150 0x7fd0a8110530 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd098009860 tx=0x7fd09802bc50 comp rx=0 tx=0).stop 2024-03-27T07:27:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.632+0000 7fd0adc34640 1 -- 172.21.15.82:0/1609122781 shutdown_connections 2024-03-27T07:27:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.632+0000 7fd0adc34640 1 --2- 172.21.15.82:0/1609122781 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a810e740 0x7fd0a811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.632+0000 7fd0adc34640 1 --2- 172.21.15.82:0/1609122781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0a810dcc0 0x7fd0a810e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.632+0000 7fd0adc34640 1 --2- 172.21.15.82:0/1609122781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a8110150 0x7fd0a8110530 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.632+0000 7fd0adc34640 1 -- 172.21.15.82:0/1609122781 >> 172.21.15.82:0/1609122781 conn(0x7fd0a806cad0 msgr2=0x7fd0a806cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.635+0000 7fd0adc34640 1 -- 172.21.15.82:0/1609122781 shutdown_connections 2024-03-27T07:27:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.635+0000 7fd0adc34640 1 -- 172.21.15.82:0/1609122781 wait complete. 2024-03-27T07:27:11.638 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.636+0000 7fd0adc34640 1 Processor -- start 2024-03-27T07:27:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.637+0000 7fd0adc34640 1 -- start start 2024-03-27T07:27:11.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.637+0000 7fd0adc34640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a810dcc0 0x7fd0a811c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.637+0000 7fd0adc34640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a810e740 0x7fd0a81159e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.637+0000 7fd0adc34640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0a8110150 0x7fd0a8115f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.637+0000 7fd0adc34640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a8120b40 con 0x7fd0a810e740 2024-03-27T07:27:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.637+0000 7fd0adc34640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a81209c0 con 0x7fd0a810dcc0 2024-03-27T07:27:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.637+0000 7fd0adc34640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a8120cc0 con 0x7fd0a8110150 2024-03-27T07:27:11.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.637+0000 7fd0a7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0a8110150 0x7fd0a8115f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.637+0000 7fd0a7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0a8110150 0x7fd0a8115f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:38398/0 (socket says 172.21.15.82:38398) 2024-03-27T07:27:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.637+0000 7fd0a7fff640 1 -- 172.21.15.82:0/2361449560 learned_addr learned my addr 172.21.15.82:0/2361449560 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.638+0000 7fd0a7fff640 1 -- 172.21.15.82:0/2361449560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a810dcc0 msgr2=0x7fd0a811c960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T07:27:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.638+0000 7fd0a7fff640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a810dcc0 0x7fd0a811c960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.638+0000 7fd0a7fff640 1 -- 172.21.15.82:0/2361449560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a810e740 msgr2=0x7fd0a81159e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:11.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.638+0000 7fd0a7fff640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a810e740 0x7fd0a81159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.638+0000 7fd0a7fff640 1 -- 172.21.15.82:0/2361449560 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a8116490 con 0x7fd0a8110150 2024-03-27T07:27:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.638+0000 7fd0a7fff640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0a8110150 0x7fd0a8115f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000cad0 tx=0x7fd0a000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:11.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.673+0000 7fd0a4ff9640 1 -- 172.21.15.82:0/2361449560 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000ae20 con 0x7fd0a8110150 2024-03-27T07:27:11.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.673+0000 7fd0adc34640 1 -- 172.21.15.82:0/2361449560 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a8116780 con 0x7fd0a8110150 2024-03-27T07:27:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.673+0000 7fd0adc34640 1 -- 172.21.15.82:0/2361449560 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a811a770 con 0x7fd0a8110150 2024-03-27T07:27:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.674+0000 7fd0a4ff9640 1 -- 172.21.15.82:0/2361449560 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0a0005020 con 0x7fd0a8110150 2024-03-27T07:27:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.674+0000 7fd0a4ff9640 1 -- 172.21.15.82:0/2361449560 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a000f6f0 con 0x7fd0a8110150 2024-03-27T07:27:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.677+0000 7fd0b0818740 1 Processor -- start 2024-03-27T07:27:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.679+0000 7fd0b0818740 1 -- start start 2024-03-27T07:27:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.679+0000 7fd0b0818740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5290 0x55ffc63c5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.679+0000 7fd0b0818740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 0x55ffc63ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.679+0000 7fd0b0818740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63ce980 0x55ffc63d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.679+0000 7fd0b0818740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ffc638bcd0 con 0x55ffc63c5bb0 2024-03-27T07:27:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.679+0000 7fd0b0818740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ffc62d0950 con 0x55ffc63c5290 2024-03-27T07:27:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.679+0000 7fd0b0818740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ffc6328e50 con 0x55ffc63ce980 2024-03-27T07:27:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.680+0000 7fd0a6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63ce980 0x55ffc63d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.680+0000 7fd0a6ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63ce980 0x55ffc63d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:38414/0 (socket says 172.21.15.82:38414) 2024-03-27T07:27:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.680+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/2721386611 learned_addr learned my addr 172.21.15.82:0/2721386611 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.680+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/2721386611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5290 0x55ffc63c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.680+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/2721386611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5290 msgr2=0x55ffc63c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.680+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/2721386611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5290 0x55ffc63c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.680+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/2721386611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 msgr2=0x55ffc63ce440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:27:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.680+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/2721386611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 0x55ffc63ce440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.680+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/2721386611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc603d210 con 0x55ffc63ce980 2024-03-27T07:27:11.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.680+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/2721386611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63ce980 0x55ffc63d0d70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0137f0 tx=0x7fd09c009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed7a8e855c5f48d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:11.696 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.694+0000 7fd0a4ff9640 1 -- 172.21.15.82:0/2361449560 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fd0a000f9b0 con 0x7fd0a8110150 2024-03-27T07:27:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.695+0000 7fd0a4ff9640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd0900a3980 0x7fd0900a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.695+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd0900a3980 0x7fd0900a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.695+0000 7fd0a4ff9640 1 -- 172.21.15.82:0/2361449560 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fd0a00d1110 con 0x7fd0a8110150 2024-03-27T07:27:11.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.696+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd0900a3980 0x7fd0900a5e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd098009780 tx=0x7fd098032340 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.709+0000 7fd08dffb640 1 -- 172.21.15.82:0/2721386611 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c013e30 con 0x55ffc63ce980 2024-03-27T07:27:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.709+0000 7fd08dffb640 1 -- 172.21.15.82:0/2721386611 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd09c00e750 con 0x55ffc63ce980 2024-03-27T07:27:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.710+0000 7fd0b0818740 1 -- 172.21.15.82:0/2721386611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63ce980 msgr2=0x55ffc63d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.710+0000 7fd0b0818740 1 --2- 172.21.15.82:0/2721386611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63ce980 0x55ffc63d0d70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0137f0 tx=0x7fd09c009620 comp rx=0 tx=0).stop 2024-03-27T07:27:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.710+0000 7fd0b0818740 1 -- 172.21.15.82:0/2721386611 shutdown_connections 2024-03-27T07:27:11.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.710+0000 7fd0b0818740 1 --2- 172.21.15.82:0/2721386611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 0x55ffc63ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.710+0000 7fd0b0818740 1 --2- 172.21.15.82:0/2721386611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63ce980 0x55ffc63d0d70 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0137f0 tx=0x7fd09c009620 comp rx=0 tx=0).stop 2024-03-27T07:27:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.710+0000 7fd0b0818740 1 --2- 172.21.15.82:0/2721386611 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5290 0x55ffc63c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.710+0000 7fd0b0818740 1 -- 172.21.15.82:0/2721386611 >> 172.21.15.82:0/2721386611 conn(0x55ffc63bfbb0 msgr2=0x55ffc63bff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:11.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.734+0000 7fd0b0818740 1 -- 172.21.15.82:0/2721386611 shutdown_connections 2024-03-27T07:27:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.734+0000 7fd0b0818740 1 -- 172.21.15.82:0/2721386611 wait complete. 2024-03-27T07:27:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.734+0000 7fd0b0818740 1 -- start start 2024-03-27T07:27:11.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.734+0000 7fd0b0818740 1 Processor -- start 2024-03-27T07:27:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0b0818740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0b0818740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0b0818740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 0x55ffc63da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0b0818740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ffc6324e00 con 0x55ffc63cc460 2024-03-27T07:27:11.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0b0818740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ffc62d1520 con 0x55ffc63c5bb0 2024-03-27T07:27:11.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0b0818740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ffc62e48e0 con 0x55ffc63c5290 2024-03-27T07:27:11.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0b0818740 10 client.0 _ll_register_callbacks cb 0x55ffc631fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:11.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0a6ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0a6ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:35258/0 (socket says 172.21.15.82:35258) 2024-03-27T07:27:11.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/3147891770 learned_addr learned my addr 172.21.15.82:0/3147891770 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:11.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.735+0000 7fd0a7fff640 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 0x55ffc63da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.736+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/3147891770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 msgr2=0x55ffc63cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.736+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.736+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/3147891770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 msgr2=0x55ffc63da7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.736+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 0x55ffc63da7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.736+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/3147891770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffc6109620 con 0x55ffc63c5bb0 2024-03-27T07:27:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.736+0000 7fd0a7fff640 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 0x55ffc63da7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:27:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.736+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:27:11.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.736+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63cbf20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009ca0 tx=0x7fd09c013300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e46341664f2bd5e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:11.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.760+0000 7fd08b7f6640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:27:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.760+0000 7fd08b7f6640 1 -- 172.21.15.82:0/3147891770 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c02c060 con 0x55ffc63c5bb0 2024-03-27T07:27:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.760+0000 7fd0b0818740 1 -- 172.21.15.82:0/3147891770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd09c00e750 con 0x55ffc63c5bb0 2024-03-27T07:27:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.760+0000 7fd08b7f6640 1 -- 172.21.15.82:0/3147891770 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fd09c009a70 con 0x55ffc63c5bb0 2024-03-27T07:27:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.760+0000 7fd08b7f6640 1 -- 172.21.15.82:0/3147891770 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd09c013e30 con 0x55ffc63c5bb0 2024-03-27T07:27:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.761+0000 7fd0b0818740 10 client.26249 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:11.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.761+0000 7fd0b0818740 1 -- 172.21.15.82:0/3147891770 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ffc63dda70 con 0x55ffc63c5bb0 2024-03-27T07:27:11.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.769+0000 7fd08b7f6640 1 -- 172.21.15.82:0/3147891770 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd09c00e750 con 0x55ffc63c5bb0 2024-03-27T07:27:11.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.770+0000 7fd08b7f6640 1 -- 172.21.15.82:0/3147891770 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd09c00ea60 con 0x55ffc63c5bb0 2024-03-27T07:27:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.770+0000 7fd0b0818740 10 client.26249 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.770+0000 7fd0b0818740 10 client.26249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.770+0000 7fd0b0818740 20 client.26249 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.771+0000 7fd0b0818740 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ffc63df130 0x55ffc63e15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.771+0000 7fd0b0818740 4 client.26249 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:27:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.771+0000 7fd0b0818740 1 -- 172.21.15.82:0/3147891770 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffc6336390 con 0x55ffc63df130 2024-03-27T07:27:11.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.771+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ffc63df130 0x55ffc63e15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.772+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ffc63df130 0x55ffc63e15b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa4c6b5955084e99 server_cookie=44e49168e07bcef8 in_seq=0 out_seq=0 2024-03-27T07:27:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.775+0000 7fd08b7f6640 10 client.26249 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.775+0000 7fd08b7f6640 1 -- 172.21.15.82:0/3147891770 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ffc6336390 con 0x55ffc63df130 2024-03-27T07:27:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.775+0000 7fd08b7f6640 10 client.26249 handle_command_reply: tid=0 2024-03-27T07:27:11.778 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.776+0000 7fd0b0818740 1 client.26249 shutdown 2024-03-27T07:27:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.777+0000 7fd0b0818740 1 -- 172.21.15.82:0/3147891770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 msgr2=0x55ffc63cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.777+0000 7fd0b0818740 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63cbf20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009ca0 tx=0x7fd09c013300 comp rx=0 tx=0).stop 2024-03-27T07:27:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.778+0000 7fd0b0818740 1 -- 172.21.15.82:0/3147891770 shutdown_connections 2024-03-27T07:27:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.778+0000 7fd0b0818740 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ffc63df130 0x55ffc63e15b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.778+0000 7fd0b0818740 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 0x55ffc63da7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.778+0000 7fd0b0818740 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63cbf20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.778+0000 7fd0b0818740 1 --2- 172.21.15.82:0/3147891770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.778+0000 7fd0b0818740 1 -- 172.21.15.82:0/3147891770 >> 172.21.15.82:0/3147891770 conn(0x55ffc63bfbb0 msgr2=0x55ffc63c1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.778+0000 7fd08b7f6640 0 client.26249 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.779+0000 7fd0b0818740 1 -- 172.21.15.82:0/3147891770 shutdown_connections 2024-03-27T07:27:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.779+0000 7fd0b0818740 1 -- 172.21.15.82:0/3147891770 wait complete. 2024-03-27T07:27:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.779+0000 7fd0b0818740 20 client.26249 trim_cache size 0 max 16384 2024-03-27T07:27:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.981+0000 7fd0b0818740 1 Processor -- start 2024-03-27T07:27:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.981+0000 7fd0b0818740 1 -- start start 2024-03-27T07:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.988+0000 7fd0b0818740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.989+0000 7fd0b0818740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 0x55ffc63da0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.989+0000 7fd0a77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.989+0000 7fd0a77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63e6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:38430/0 (socket says 172.21.15.82:38430) 2024-03-27T07:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.989+0000 7fd0a6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 0x55ffc63da0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.989+0000 7fd0a6ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 0x55ffc63da0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52918/0 (socket says 172.21.15.82:52918) 2024-03-27T07:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.989+0000 7fd0a77fe640 1 -- 172.21.15.82:0/1802012514 learned_addr learned my addr 172.21.15.82:0/1802012514 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.989+0000 7fd0b0818740 1 --2- 172.21.15.82:0/1802012514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63cc460 0x55ffc63da610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.989+0000 7fd0b0818740 1 -- 172.21.15.82:0/1802012514 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd094010f00 con 0x55ffc63c5bb0 2024-03-27T07:27:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.989+0000 7fd0b0818740 1 -- 172.21.15.82:0/1802012514 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd09400e770 con 0x55ffc63cc460 2024-03-27T07:27:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.989+0000 7fd0b0818740 1 -- 172.21.15.82:0/1802012514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd09400c670 con 0x55ffc63c5290 2024-03-27T07:27:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.990+0000 7fd0a7fff640 1 --2- 172.21.15.82:0/1802012514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63cc460 0x55ffc63da610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.990+0000 7fd0a77fe640 1 -- 172.21.15.82:0/1802012514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63cc460 msgr2=0x55ffc63da610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.990+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/1802012514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63cc460 0x55ffc63da610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.990+0000 7fd0a77fe640 1 -- 172.21.15.82:0/1802012514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 msgr2=0x55ffc63da0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.990+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/1802012514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 0x55ffc63da0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.990+0000 7fd0a77fe640 1 -- 172.21.15.82:0/1802012514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffc63c59e0 con 0x55ffc63c5290 2024-03-27T07:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.990+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/1802012514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 0x55ffc63da0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:27:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:11.990+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/1802012514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63e6ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd098009860 tx=0x7fd09803b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a365dd67dbc0ab36 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.002+0000 7fd08d7fa640 1 -- 172.21.15.82:0/1802012514 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098056070 con 0x55ffc63c5290 2024-03-27T07:27:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.002+0000 7fd08d7fa640 1 -- 172.21.15.82:0/1802012514 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd098044040 con 0x55ffc63c5290 2024-03-27T07:27:12.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.002+0000 7fd08d7fa640 1 -- 172.21.15.82:0/1802012514 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd098043040 con 0x55ffc63c5290 2024-03-27T07:27:12.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.003+0000 7fd0b0818740 1 -- 172.21.15.82:0/1802012514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 msgr2=0x55ffc63e6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:12.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.003+0000 7fd0b0818740 1 --2- 172.21.15.82:0/1802012514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63e6ec0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd098009860 tx=0x7fd09803b000 comp rx=0 tx=0).stop 2024-03-27T07:27:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.020+0000 7fd0b0818740 1 -- 172.21.15.82:0/1802012514 shutdown_connections 2024-03-27T07:27:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.020+0000 7fd0b0818740 1 --2- 172.21.15.82:0/1802012514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63c5bb0 0x55ffc63da0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.020+0000 7fd0b0818740 1 --2- 172.21.15.82:0/1802012514 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63cc460 0x55ffc63da610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.020+0000 7fd0b0818740 1 --2- 172.21.15.82:0/1802012514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63e6ec0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.020+0000 7fd0b0818740 1 -- 172.21.15.82:0/1802012514 >> 172.21.15.82:0/1802012514 conn(0x55ffc63bfbb0 msgr2=0x55ffc63ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.022+0000 7fd0b0818740 1 -- 172.21.15.82:0/1802012514 shutdown_connections 2024-03-27T07:27:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.022+0000 7fd0b0818740 1 -- 172.21.15.82:0/1802012514 wait complete. 2024-03-27T07:27:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.023+0000 7fd0b0818740 1 -- start start 2024-03-27T07:27:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.023+0000 7fd0b0818740 1 Processor -- start 2024-03-27T07:27:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.024+0000 7fd0b0818740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.024+0000 7fd0b0818740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.024+0000 7fd0a77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.024+0000 7fd0a77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63d16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:38440/0 (socket says 172.21.15.82:38440) 2024-03-27T07:27:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.024+0000 7fd0a77fe640 1 -- 172.21.15.82:0/4190201386 learned_addr learned my addr 172.21.15.82:0/4190201386 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.024+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.025+0000 7fd0b0818740 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 0x55ffc63d2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.025+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd09400cc30 con 0x55ffc63cc460 2024-03-27T07:27:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.025+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd09400e0a0 con 0x55ffc63c5bb0 2024-03-27T07:27:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.025+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd09400d300 con 0x55ffc63c5290 2024-03-27T07:27:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.025+0000 7fd0a7fff640 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 0x55ffc63d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.025+0000 7fd0b0818740 10 client.0 _ll_register_callbacks cb 0x7fd09c009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.026+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/4190201386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 msgr2=0x55ffc63d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.026+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.026+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/4190201386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 msgr2=0x55ffc63d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.026+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 0x55ffc63d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.026+0000 7fd0a6ffd640 1 -- 172.21.15.82:0/4190201386 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffc64434e0 con 0x55ffc63c5bb0 2024-03-27T07:27:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.026+0000 7fd0a7fff640 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 0x55ffc63d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:27:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.026+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:27:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.026+0000 7fd0a6ffd640 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63d1c00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00a010 tx=0x7fd09c031580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=661205743a01a079 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.050+0000 7fd08b7f6640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:27:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.050+0000 7fd08b7f6640 1 -- 172.21.15.82:0/4190201386 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c02c040 con 0x55ffc63c5bb0 2024-03-27T07:27:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.051+0000 7fd08b7f6640 1 -- 172.21.15.82:0/4190201386 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fd09c004260 con 0x55ffc63c5bb0 2024-03-27T07:27:12.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.051+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd098044040 con 0x55ffc63c5bb0 2024-03-27T07:27:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.051+0000 7fd08b7f6640 1 -- 172.21.15.82:0/4190201386 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd09c004460 con 0x55ffc63c5bb0 2024-03-27T07:27:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.052+0000 7fd0b0818740 10 client.26255 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:12.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.052+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ffc64446f0 con 0x55ffc63c5bb0 2024-03-27T07:27:12.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.056+0000 7fd08b7f6640 1 -- 172.21.15.82:0/4190201386 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd09c0039f0 con 0x55ffc63c5bb0 2024-03-27T07:27:12.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.056+0000 7fd08b7f6640 1 -- 172.21.15.82:0/4190201386 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd09c00e720 con 0x55ffc63c5bb0 2024-03-27T07:27:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.057+0000 7fd0b0818740 10 client.26255 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.057+0000 7fd0b0818740 10 client.26255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.057+0000 7fd0b0818740 20 client.26255 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.058+0000 7fd0b0818740 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ffc6444e40 0x55ffc6447260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.058+0000 7fd0b0818740 4 client.26255 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:27:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.058+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fd098044040 con 0x55ffc6444e40 2024-03-27T07:27:12.060 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.058+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ffc6444e40 0x55ffc6447260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:12.061 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.059+0000 7fd0a77fe640 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ffc6444e40 0x55ffc6447260 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56c4878fa632531 server_cookie=8ea29a21efe251ae in_seq=0 out_seq=0 2024-03-27T07:27:12.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:12.063+0000 7fd08b7f6640 10 client.26255 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:12.590 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:12 smithi153 ceph-mon[36179]: pgmap v111: 97 pgs: 97 active+clean; 566 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 645 op/s 2024-03-27T07:27:12.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:12 smithi082 ceph-mon[32178]: pgmap v111: 97 pgs: 97 active+clean; 566 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 645 op/s 2024-03-27T07:27:12.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:12 smithi149 ceph-mon[36065]: pgmap v111: 97 pgs: 97 active+clean; 566 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 645 op/s 2024-03-27T07:27:14.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.106+0000 7fd08b7f6640 1 -- 172.21.15.82:0/4190201386 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fd098044040 con 0x55ffc6444e40 2024-03-27T07:27:14.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.106+0000 7fd08b7f6640 10 client.26255 handle_command_reply: tid=0 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.106+0000 7fd0b0818740 1 client.26255 shutdown 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.106+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 msgr2=0x55ffc63d1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.106+0000 7fd0b0818740 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63d1c00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00a010 tx=0x7fd09c031580 comp rx=0 tx=0).stop 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.106+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 shutdown_connections 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.106+0000 7fd0b0818740 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ffc6444e40 0x55ffc6447260 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.106+0000 7fd0b0818740 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ffc63cc460 0x55ffc63d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.106+0000 7fd0b0818740 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ffc63c5bb0 0x55ffc63d1c00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.106+0000 7fd0b0818740 1 --2- 172.21.15.82:0/4190201386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ffc63c5290 0x55ffc63d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.107+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 >> 172.21.15.82:0/4190201386 conn(0x55ffc63bfbb0 msgr2=0x55ffc63bec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.107+0000 7fd08b7f6640 0 client.26255 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.107+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 shutdown_connections 2024-03-27T07:27:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.107+0000 7fd0b0818740 1 -- 172.21.15.82:0/4190201386 wait complete. 2024-03-27T07:27:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.107+0000 7fd0b0818740 20 client.26255 trim_cache size 0 max 16384 2024-03-27T07:27:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:27:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:27:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:27:14.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:27:14.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 -- 172.21.15.82:0/2361449560 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd0900a3980 msgr2=0x7fd0900a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd0900a3980 0x7fd0900a5e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd098009780 tx=0x7fd098032340 comp rx=0 tx=0).stop 2024-03-27T07:27:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 -- 172.21.15.82:0/2361449560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0a8110150 msgr2=0x7fd0a8115f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0a8110150 0x7fd0a8115f20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd0a000cad0 tx=0x7fd0a000cf90 comp rx=0 tx=0).stop 2024-03-27T07:27:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 -- 172.21.15.82:0/2361449560 shutdown_connections 2024-03-27T07:27:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd0900a3980 0x7fd0900a5e40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0a810e740 0x7fd0a81159e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0a8110150 0x7fd0a8115f20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:14.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 --2- 172.21.15.82:0/2361449560 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd0a810dcc0 0x7fd0a811c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 -- 172.21.15.82:0/2361449560 >> 172.21.15.82:0/2361449560 conn(0x7fd0a806cad0 msgr2=0x7fd0a8070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 -- 172.21.15.82:0/2361449560 shutdown_connections 2024-03-27T07:27:14.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:14.108+0000 7fd0adc34640 1 -- 172.21.15.82:0/2361449560 wait complete. 2024-03-27T07:27:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:14 smithi082 ceph-mon[32178]: pgmap v112: 97 pgs: 97 active+clean; 566 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 137 op/s 2024-03-27T07:27:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:14 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:27:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:14 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:27:14.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:14 smithi149 ceph-mon[36065]: pgmap v112: 97 pgs: 97 active+clean; 566 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 137 op/s 2024-03-27T07:27:14.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:14 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:27:14.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:14 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:27:14.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:14 smithi153 ceph-mon[36179]: pgmap v112: 97 pgs: 97 active+clean; 566 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 137 op/s 2024-03-27T07:27:14.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:14 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:27:14.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:14 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:27:15.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:15 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:27:15.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:15 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:27:15.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:15 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:27:16.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:16 smithi082 ceph-mon[32178]: pgmap v113: 97 pgs: 97 active+clean; 566 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 137 op/s 2024-03-27T07:27:16.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:16 smithi149 ceph-mon[36065]: pgmap v113: 97 pgs: 97 active+clean; 566 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 137 op/s 2024-03-27T07:27:16.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:16 smithi153 ceph-mon[36179]: pgmap v113: 97 pgs: 97 active+clean; 566 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 137 op/s 2024-03-27T07:27:17.157 INFO:tasks.workunit.client.0.smithi082.stdout: 167 1713372 1296 1174680 898 608484 1996 2024-03-27T07:27:18.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:18 smithi082 ceph-mon[32178]: pgmap v114: 97 pgs: 97 active+clean; 567 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 884 op/s 2024-03-27T07:27:18.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:18 smithi149 ceph-mon[36065]: pgmap v114: 97 pgs: 97 active+clean; 567 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 884 op/s 2024-03-27T07:27:18.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:18 smithi153 ceph-mon[36179]: pgmap v114: 97 pgs: 97 active+clean; 567 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 884 op/s 2024-03-27T07:27:20.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:20 smithi082 ceph-mon[32178]: pgmap v115: 97 pgs: 97 active+clean; 567 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 829 op/s 2024-03-27T07:27:20.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:20 smithi149 ceph-mon[36065]: pgmap v115: 97 pgs: 97 active+clean; 567 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 829 op/s 2024-03-27T07:27:20.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:20 smithi153 ceph-mon[36179]: pgmap v115: 97 pgs: 97 active+clean; 567 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.8 MiB/s wr, 829 op/s 2024-03-27T07:27:22.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:22 smithi082 ceph-mon[32178]: pgmap v116: 97 pgs: 97 active+clean; 583 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 926 op/s 2024-03-27T07:27:22.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:22 smithi149 ceph-mon[36065]: pgmap v116: 97 pgs: 97 active+clean; 583 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 926 op/s 2024-03-27T07:27:22.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:22 smithi153 ceph-mon[36179]: pgmap v116: 97 pgs: 97 active+clean; 583 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.3 MiB/s wr, 926 op/s 2024-03-27T07:27:24.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:24 smithi082 ceph-mon[32178]: pgmap v117: 97 pgs: 97 active+clean; 583 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 843 op/s 2024-03-27T07:27:24.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:24 smithi149 ceph-mon[36065]: pgmap v117: 97 pgs: 97 active+clean; 583 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 843 op/s 2024-03-27T07:27:24.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:24 smithi153 ceph-mon[36179]: pgmap v117: 97 pgs: 97 active+clean; 583 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 843 op/s 2024-03-27T07:27:25.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:27:25.249 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:27:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:26 smithi082 ceph-mon[32178]: pgmap v118: 97 pgs: 97 active+clean; 583 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 843 op/s 2024-03-27T07:27:26.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:26 smithi149 ceph-mon[36065]: pgmap v118: 97 pgs: 97 active+clean; 583 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 843 op/s 2024-03-27T07:27:26.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:26 smithi153 ceph-mon[36179]: pgmap v118: 97 pgs: 97 active+clean; 583 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.8 MiB/s wr, 843 op/s 2024-03-27T07:27:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.065+0000 7f25a6867640 1 -- 172.21.15.82:0/3728495522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a010a4f0 msgr2=0x7f25a010a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.065+0000 7f25a6867640 1 --2- 172.21.15.82:0/3728495522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a010a4f0 0x7f25a010a8d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2598009ca0 tx=0x7f259802c1c0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.099+0000 7f25a6867640 1 -- 172.21.15.82:0/3728495522 shutdown_connections 2024-03-27T07:27:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.099+0000 7f25a6867640 1 --2- 172.21.15.82:0/3728495522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a010ae10 0x7f25a0113560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.099+0000 7f25a6867640 1 --2- 172.21.15.82:0/3728495522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a0113aa0 0x7f25a0115e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.099+0000 7f25a6867640 1 --2- 172.21.15.82:0/3728495522 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a010a4f0 0x7f25a010a8d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.099+0000 7f25a6867640 1 -- 172.21.15.82:0/3728495522 >> 172.21.15.82:0/3728495522 conn(0x7f25a006ca00 msgr2=0x7f25a006ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.099+0000 7f25a6867640 1 -- 172.21.15.82:0/3728495522 shutdown_connections 2024-03-27T07:27:27.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.099+0000 7f25a6867640 1 -- 172.21.15.82:0/3728495522 wait complete. 2024-03-27T07:27:27.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.101+0000 7f25a6867640 1 Processor -- start 2024-03-27T07:27:27.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.101+0000 7f25a6867640 1 -- start start 2024-03-27T07:27:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.101+0000 7f25a6867640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a010a4f0 0x7f25a01a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.101+0000 7f25a6867640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a010ae10 0x7f25a01a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.101+0000 7f25a6867640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a0113aa0 0x7f25a019e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.101+0000 7f25a6867640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0119470 con 0x7f25a0113aa0 2024-03-27T07:27:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.101+0000 7f25a6867640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01192f0 con 0x7f25a010a4f0 2024-03-27T07:27:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.101+0000 7f25a6867640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01195f0 con 0x7f25a010ae10 2024-03-27T07:27:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.102+0000 7f25a5064640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a010ae10 0x7f25a01a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.102+0000 7f25a5064640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a010ae10 0x7f25a01a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:49564/0 (socket says 172.21.15.82:49564) 2024-03-27T07:27:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.102+0000 7f25a5064640 1 -- 172.21.15.82:0/292669238 learned_addr learned my addr 172.21.15.82:0/292669238 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.102+0000 7f25a5865640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a010a4f0 0x7f25a01a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.102+0000 7f25a5064640 1 -- 172.21.15.82:0/292669238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a010a4f0 msgr2=0x7f25a01a66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.102+0000 7f25a5064640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a010a4f0 0x7f25a01a66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.102+0000 7f25a5064640 1 -- 172.21.15.82:0/292669238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a0113aa0 msgr2=0x7f25a019e9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:27:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.102+0000 7f25a5064640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a0113aa0 0x7f25a019e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.102+0000 7f25a5064640 1 -- 172.21.15.82:0/292669238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a019f290 con 0x7f25a010ae10 2024-03-27T07:27:27.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.103+0000 7f25a5064640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a010ae10 0x7f25a01a6c00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f259c00d950 tx=0x7f259c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.110+0000 7f2596ffd640 1 -- 172.21.15.82:0/292669238 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c017070 con 0x7f25a010ae10 2024-03-27T07:27:27.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.110+0000 7f25a6867640 1 -- 172.21.15.82:0/292669238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a019f580 con 0x7f25a010ae10 2024-03-27T07:27:27.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.111+0000 7f25a6867640 1 -- 172.21.15.82:0/292669238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a01bc360 con 0x7f25a010ae10 2024-03-27T07:27:27.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.111+0000 7f2596ffd640 1 -- 172.21.15.82:0/292669238 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f259c009c30 con 0x7f25a010ae10 2024-03-27T07:27:27.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.111+0000 7f2596ffd640 1 -- 172.21.15.82:0/292669238 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c00f6b0 con 0x7f25a010ae10 2024-03-27T07:27:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.119+0000 7f25aa78c740 1 Processor -- start 2024-03-27T07:27:27.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.119+0000 7f2596ffd640 1 -- 172.21.15.82:0/292669238 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f259c00f850 con 0x7f25a010ae10 2024-03-27T07:27:27.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.119+0000 7f25aa78c740 1 -- start start 2024-03-27T07:27:27.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.120+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d58322b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.120+0000 7f25a6066640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d58322b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.120+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322bd90 0x55d583234430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.120+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d583234970 0x55d583236d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.120+0000 7f25aa78c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d58318f860 con 0x55d58322b470 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.120+0000 7f25aa78c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55d5831378d0 con 0x55d583234970 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.120+0000 7f25aa78c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d58318b810 con 0x55d58322bd90 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.120+0000 7f25a5865640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322bd90 0x55d583234430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.120+0000 7f25a5865640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322bd90 0x55d583234430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:49580/0 (socket says 172.21.15.82:49580) 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.120+0000 7f25a5865640 1 -- 172.21.15.82:0/157954426 learned_addr learned my addr 172.21.15.82:0/157954426 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.121+0000 7f25a5064640 1 --2- 172.21.15.82:0/157954426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d583234970 0x55d583236d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.121+0000 7f25a5865640 1 -- 172.21.15.82:0/157954426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d583234970 msgr2=0x55d583236d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.121+0000 7f25a5865640 1 --2- 172.21.15.82:0/157954426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d583234970 0x55d583236d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.121+0000 7f25a5865640 1 -- 172.21.15.82:0/157954426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 msgr2=0x55d58322b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.121+0000 7f25a5865640 1 --2- 172.21.15.82:0/157954426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d58322b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.121+0000 7f25a5865640 1 -- 172.21.15.82:0/157954426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d583142120 con 0x55d58322bd90 2024-03-27T07:27:27.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.122+0000 7f25a5865640 1 --2- 172.21.15.82:0/157954426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322bd90 0x55d583234430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2598009ca0 tx=0x7f2598000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b37e659f90b0ec6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.123+0000 7f2596ffd640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f258c0a3990 0x7f258c0a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.124+0000 7f2596ffd640 1 -- 172.21.15.82:0/292669238 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f259c0d0070 con 0x7f25a010ae10 2024-03-27T07:27:27.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.128+0000 7f25a6066640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f258c0a3990 0x7f258c0a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.133+0000 7f258bfff640 1 -- 172.21.15.82:0/157954426 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598044030 con 0x55d58322bd90 2024-03-27T07:27:27.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.133+0000 7f258bfff640 1 -- 172.21.15.82:0/157954426 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2598032c60 con 0x55d58322bd90 2024-03-27T07:27:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.134+0000 7f25aa78c740 1 -- 172.21.15.82:0/157954426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322bd90 msgr2=0x55d583234430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.135+0000 7f25aa78c740 1 --2- 172.21.15.82:0/157954426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322bd90 0x55d583234430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2598009ca0 tx=0x7f2598000f40 comp rx=0 tx=0).stop 2024-03-27T07:27:27.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.141+0000 7f25aa78c740 1 -- 172.21.15.82:0/157954426 shutdown_connections 2024-03-27T07:27:27.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.141+0000 7f25aa78c740 1 --2- 172.21.15.82:0/157954426 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d583234970 0x55d583236d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.141+0000 7f25aa78c740 1 --2- 172.21.15.82:0/157954426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322bd90 0x55d583234430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.141+0000 7f25aa78c740 1 --2- 172.21.15.82:0/157954426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d58322b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.141+0000 7f25aa78c740 1 -- 172.21.15.82:0/157954426 >> 172.21.15.82:0/157954426 conn(0x55d583225ba0 msgr2=0x55d583225f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.141+0000 7f25aa78c740 1 -- 172.21.15.82:0/157954426 shutdown_connections 2024-03-27T07:27:27.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.141+0000 7f25aa78c740 1 -- 172.21.15.82:0/157954426 wait complete. 2024-03-27T07:27:27.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.142+0000 7f25aa78c740 1 -- start start 2024-03-27T07:27:27.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.142+0000 7f25aa78c740 1 Processor -- start 2024-03-27T07:27:27.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.142+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322b470 0x55d583231810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.143+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d583231d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.143+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d583234970 0x55d583232290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.143+0000 7f25aa78c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d583237750 con 0x55d583234970 2024-03-27T07:27:27.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.143+0000 7f25aa78c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55d58314acd0 con 0x55d58322bd90 2024-03-27T07:27:27.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.143+0000 7f25aa78c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d5832378d0 con 0x55d58322b470 2024-03-27T07:27:27.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.143+0000 7f25aa78c740 10 client.0 _ll_register_callbacks cb 0x55d58313cee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:27.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.143+0000 7f25a5865640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322b470 0x55d583231810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.143+0000 7f25a5865640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322b470 0x55d583231810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:49594/0 (socket says 172.21.15.82:49594) 2024-03-27T07:27:27.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.143+0000 7f25a5865640 1 -- 172.21.15.82:0/2945031220 learned_addr learned my addr 172.21.15.82:0/2945031220 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.144+0000 7f25a6066640 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d583234970 0x55d583232290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.144+0000 7f25a5865640 1 -- 172.21.15.82:0/2945031220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 msgr2=0x55d583231d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:27:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.144+0000 7f25a5865640 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d583231d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.144+0000 7f25a5865640 1 -- 172.21.15.82:0/2945031220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d583234970 msgr2=0x55d583232290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.144+0000 7f25a5865640 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d583234970 0x55d583232290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.144+0000 7f25a5865640 1 -- 172.21.15.82:0/2945031220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d582f6d7d0 con 0x55d58322b470 2024-03-27T07:27:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.145+0000 7f25a6066640 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d583234970 0x55d583232290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:27:27.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.145+0000 7f25a5865640 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322b470 0x55d583231810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f25980325a0 tx=0x7f25980099a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2005225c6211a6bc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.149+0000 7f25897fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:27:27.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.150+0000 7f25897fa640 1 -- 172.21.15.82:0/2945031220 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598004540 con 0x55d58322b470 2024-03-27T07:27:27.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.150+0000 7f25aa78c740 1 -- 172.21.15.82:0/2945031220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2598032c60 con 0x55d58322b470 2024-03-27T07:27:27.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.151+0000 7f25897fa640 1 -- 172.21.15.82:0/2945031220 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f25980046e0 con 0x55d58322b470 2024-03-27T07:27:27.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.151+0000 7f25897fa640 1 -- 172.21.15.82:0/2945031220 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2598034440 con 0x55d58322b470 2024-03-27T07:27:27.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.151+0000 7f25aa78c740 10 client.26266 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:27.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.151+0000 7f25aa78c740 1 -- 172.21.15.82:0/2945031220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d582ea33f0 con 0x55d58322b470 2024-03-27T07:27:27.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.152+0000 7f25897fa640 1 -- 172.21.15.82:0/2945031220 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2598032c60 con 0x55d58322b470 2024-03-27T07:27:27.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.153+0000 7f25897fa640 1 -- 172.21.15.82:0/2945031220 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2598049590 con 0x55d58322b470 2024-03-27T07:27:27.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.153+0000 7f25aa78c740 10 client.26266 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:27.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.153+0000 7f25aa78c740 10 client.26266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:27.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.153+0000 7f25aa78c740 20 client.26266 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:27.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.153+0000 7f25aa78c740 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d583244bd0 0x55d583247050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.153+0000 7f25aa78c740 4 client.26266 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:27:27.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.153+0000 7f25aa78c740 1 -- 172.21.15.82:0/2945031220 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d58319cda0 con 0x55d583244bd0 2024-03-27T07:27:27.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.154+0000 7f25a5064640 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d583244bd0 0x55d583247050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.157 INFO:tasks.workunit.client.0.smithi082.stdout: 176 2450542 726 1640144 544 923306 1833 2024-03-27T07:27:27.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.158+0000 7f25a5064640 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d583244bd0 0x55d583247050 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c815d0e7003b095 server_cookie=93fafc7635c00117 in_seq=0 out_seq=0 2024-03-27T07:27:27.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.159+0000 7f25897fa640 10 client.26266 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:27.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.163+0000 7f25897fa640 1 -- 172.21.15.82:0/2945031220 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d58319cda0 con 0x55d583244bd0 2024-03-27T07:27:27.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.163+0000 7f25897fa640 10 client.26266 handle_command_reply: tid=0 2024-03-27T07:27:27.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.164+0000 7f25aa78c740 1 client.26266 shutdown 2024-03-27T07:27:27.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.177+0000 7f25aa78c740 1 -- 172.21.15.82:0/2945031220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322b470 msgr2=0x55d583231810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.177+0000 7f25aa78c740 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322b470 0x55d583231810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f25980325a0 tx=0x7f25980099a0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.179+0000 7f25a6066640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f258c0a3990 0x7f258c0a5e50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25a006afd0 tx=0x7f259000b670 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.191+0000 7f25aa78c740 1 -- 172.21.15.82:0/2945031220 shutdown_connections 2024-03-27T07:27:27.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.191+0000 7f25aa78c740 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d583244bd0 0x55d583247050 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.191+0000 7f25aa78c740 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d583234970 0x55d583232290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.191+0000 7f25aa78c740 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d583231d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.191+0000 7f25aa78c740 1 --2- 172.21.15.82:0/2945031220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d58322b470 0x55d583231810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.191+0000 7f25aa78c740 1 -- 172.21.15.82:0/2945031220 >> 172.21.15.82:0/2945031220 conn(0x55d583225ba0 msgr2=0x55d5832278f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.191+0000 7f25897fa640 0 client.26266 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:27.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.196+0000 7f25aa78c740 1 -- 172.21.15.82:0/2945031220 shutdown_connections 2024-03-27T07:27:27.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.199+0000 7f25aa78c740 1 -- 172.21.15.82:0/2945031220 wait complete. 2024-03-27T07:27:27.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.201+0000 7f25aa78c740 20 client.26266 trim_cache size 0 max 16384 2024-03-27T07:27:27.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.357+0000 7f25aa78c740 1 Processor -- start 2024-03-27T07:27:27.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.357+0000 7f25aa78c740 1 -- start start 2024-03-27T07:27:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.358+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d583233f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.358+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d583246be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.358+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d583234970 0x55d5832405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.358+0000 7f25aa78c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2584010f00 con 0x55d58322b470 2024-03-27T07:27:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.358+0000 7f25aa78c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f258400e770 con 0x55d58322bd90 2024-03-27T07:27:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.358+0000 7f25aa78c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f258400c670 con 0x55d583234970 2024-03-27T07:27:27.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.358+0000 7f25a5865640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d583233f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.358+0000 7f25a5865640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d583233f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37986/0 (socket says 172.21.15.82:37986) 2024-03-27T07:27:27.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.358+0000 7f25a5865640 1 -- 172.21.15.82:0/3282325570 learned_addr learned my addr 172.21.15.82:0/3282325570 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.358+0000 7f25a5064640 1 --2- 172.21.15.82:0/3282325570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d583246be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.359+0000 7f25a5064640 1 -- 172.21.15.82:0/3282325570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d583234970 msgr2=0x55d5832405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.359+0000 7f25a5064640 1 --2- 172.21.15.82:0/3282325570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d583234970 0x55d5832405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.359+0000 7f25a5064640 1 -- 172.21.15.82:0/3282325570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 msgr2=0x55d583233f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.362+0000 7f25a5064640 1 --2- 172.21.15.82:0/3282325570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d583233f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.362+0000 7f25a5064640 1 -- 172.21.15.82:0/3282325570 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d582e630f0 con 0x55d58322bd90 2024-03-27T07:27:27.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.362+0000 7f25a5865640 1 --2- 172.21.15.82:0/3282325570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d583233f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:27:27.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.365+0000 7f25a5064640 1 --2- 172.21.15.82:0/3282325570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d583246be0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f259c0cd7b0 tx=0x7f259c010570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46e74cda5b311457 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.380+0000 7f258b7fe640 1 -- 172.21.15.82:0/3282325570 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c020040 con 0x55d58322bd90 2024-03-27T07:27:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.380+0000 7f258b7fe640 1 -- 172.21.15.82:0/3282325570 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f259c09ce70 con 0x55d58322bd90 2024-03-27T07:27:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.384+0000 7f258b7fe640 1 -- 172.21.15.82:0/3282325570 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c09c2c0 con 0x55d58322bd90 2024-03-27T07:27:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.385+0000 7f25aa78c740 1 -- 172.21.15.82:0/3282325570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 msgr2=0x55d583246be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.385+0000 7f25aa78c740 1 --2- 172.21.15.82:0/3282325570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d583246be0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f259c0cd7b0 tx=0x7f259c010570 comp rx=0 tx=0).stop 2024-03-27T07:27:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.386+0000 7f25aa78c740 1 -- 172.21.15.82:0/3282325570 shutdown_connections 2024-03-27T07:27:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.386+0000 7f25aa78c740 1 --2- 172.21.15.82:0/3282325570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d583234970 0x55d5832405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.386+0000 7f25aa78c740 1 --2- 172.21.15.82:0/3282325570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d583246be0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.386+0000 7f25aa78c740 1 --2- 172.21.15.82:0/3282325570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d583233f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.386+0000 7f25aa78c740 1 -- 172.21.15.82:0/3282325570 >> 172.21.15.82:0/3282325570 conn(0x55d583225ba0 msgr2=0x55d583224390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.394+0000 7f25aa78c740 1 -- 172.21.15.82:0/3282325570 shutdown_connections 2024-03-27T07:27:27.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.398+0000 7f25aa78c740 1 -- 172.21.15.82:0/3282325570 wait complete. 2024-03-27T07:27:27.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.398+0000 7f25aa78c740 1 -- start start 2024-03-27T07:27:27.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.398+0000 7f25aa78c740 1 Processor -- start 2024-03-27T07:27:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d58322ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d58322f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25aa78c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d583234970 0x55d58322da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25aa78c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f258400cc30 con 0x55d58322b470 2024-03-27T07:27:27.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25aa78c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f258400e0a0 con 0x55d58322bd90 2024-03-27T07:27:27.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25aa78c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f258400d300 con 0x55d583234970 2024-03-27T07:27:27.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25aa78c740 10 client.0 _ll_register_callbacks cb 0x7f2598032450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25a5865640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d58322ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25a6066640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d583234970 0x55d58322da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25a5865640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d58322ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37996/0 (socket says 172.21.15.82:37996) 2024-03-27T07:27:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.399+0000 7f25a5865640 1 -- 172.21.15.82:0/323602567 learned_addr learned my addr 172.21.15.82:0/323602567 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.400+0000 7f25a6066640 1 -- 172.21.15.82:0/323602567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 msgr2=0x55d58322f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.400+0000 7f25a6066640 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d58322f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.400+0000 7f25a6066640 1 -- 172.21.15.82:0/323602567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 msgr2=0x55d58322ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.400+0000 7f25a6066640 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d58322ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.400+0000 7f25a6066640 1 -- 172.21.15.82:0/323602567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58322dfc0 con 0x55d583234970 2024-03-27T07:27:27.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.400+0000 7f25a6066640 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d583234970 0x55d58322da80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55d583237200 tx=0x7f2590008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cc1f76911ade6be server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.411+0000 7f25897fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:27:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.420+0000 7f25897fa640 1 -- 172.21.15.82:0/323602567 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2590027060 con 0x55d583234970 2024-03-27T07:27:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.420+0000 7f25aa78c740 1 -- 172.21.15.82:0/323602567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f259c09ce70 con 0x55d583234970 2024-03-27T07:27:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.420+0000 7f25897fa640 1 -- 172.21.15.82:0/323602567 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f259000f030 con 0x55d583234970 2024-03-27T07:27:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.420+0000 7f25897fa640 1 -- 172.21.15.82:0/323602567 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f25900059e0 con 0x55d583234970 2024-03-27T07:27:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.420+0000 7f25aa78c740 10 client.26269 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.420+0000 7f25aa78c740 1 -- 172.21.15.82:0/323602567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d5832aa6c0 con 0x55d583234970 2024-03-27T07:27:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.421+0000 7f25897fa640 1 -- 172.21.15.82:0/323602567 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f259c09ce70 con 0x55d583234970 2024-03-27T07:27:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.421+0000 7f25897fa640 1 -- 172.21.15.82:0/323602567 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2590006020 con 0x55d583234970 2024-03-27T07:27:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.421+0000 7f25aa78c740 10 client.26269 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.421+0000 7f25aa78c740 10 client.26269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.421+0000 7f25aa78c740 20 client.26269 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.421+0000 7f25aa78c740 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d5832aaea0 0x55d5832ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.421+0000 7f25aa78c740 4 client.26269 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:27:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.421+0000 7f25aa78c740 1 -- 172.21.15.82:0/323602567 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d5831970f0 con 0x55d5832aaea0 2024-03-27T07:27:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.421+0000 7f25a5865640 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d5832aaea0 0x55d5832ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.422+0000 7f25897fa640 10 client.26269 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:27.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.425+0000 7f25a5865640 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d5832aaea0 0x55d5832ad2c0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a01d692a55539591 server_cookie=fc689167f8a6151b in_seq=0 out_seq=0 2024-03-27T07:27:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.429+0000 7f25897fa640 1 -- 172.21.15.82:0/323602567 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d5831970f0 con 0x55d5832aaea0 2024-03-27T07:27:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.429+0000 7f25897fa640 10 client.26269 handle_command_reply: tid=0 2024-03-27T07:27:27.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.429+0000 7f25aa78c740 1 client.26269 shutdown 2024-03-27T07:27:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.448+0000 7f25aa78c740 1 -- 172.21.15.82:0/323602567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d583234970 msgr2=0x55d58322da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.448+0000 7f25aa78c740 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d583234970 0x55d58322da80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55d583237200 tx=0x7f2590008040 comp rx=0 tx=0).stop 2024-03-27T07:27:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.450+0000 7f25aa78c740 1 -- 172.21.15.82:0/323602567 shutdown_connections 2024-03-27T07:27:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.450+0000 7f25aa78c740 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d583234970 0x55d58322da80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.450+0000 7f25aa78c740 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d58322bd90 0x55d58322f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.450+0000 7f25aa78c740 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d5832aaea0 0x55d5832ad2c0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.450+0000 7f25aa78c740 1 --2- 172.21.15.82:0/323602567 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d58322b470 0x55d58322ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.450+0000 7f25aa78c740 1 -- 172.21.15.82:0/323602567 >> 172.21.15.82:0/323602567 conn(0x55d583225ba0 msgr2=0x55d583224390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.451+0000 7f25897fa640 0 client.26269 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:27.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.452+0000 7f25aa78c740 1 -- 172.21.15.82:0/323602567 shutdown_connections 2024-03-27T07:27:27.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.452+0000 7f25aa78c740 1 -- 172.21.15.82:0/323602567 wait complete. 2024-03-27T07:27:27.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.469+0000 7f25aa78c740 20 client.26269 trim_cache size 0 max 16384 2024-03-27T07:27:27.472 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:27:27.472 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-03-27T07:27:27.472 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-03-27T07:27:27.472 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:27:27.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.481+0000 7f25a6867640 1 -- 172.21.15.82:0/292669238 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f258c0a3990 msgr2=0x7f258c0a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.481+0000 7f25a6867640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f258c0a3990 0x7f258c0a5e50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25a006afd0 tx=0x7f259000b670 comp rx=0 tx=0).stop 2024-03-27T07:27:27.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.481+0000 7f25a6867640 1 -- 172.21.15.82:0/292669238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a010ae10 msgr2=0x7f25a01a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.481+0000 7f25a6867640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a010ae10 0x7f25a01a6c00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f259c00d950 tx=0x7f259c00de10 comp rx=0 tx=0).stop 2024-03-27T07:27:27.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.484+0000 7f25a6867640 1 -- 172.21.15.82:0/292669238 shutdown_connections 2024-03-27T07:27:27.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.484+0000 7f25a6867640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f258c0a3990 0x7f258c0a5e50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.484+0000 7f25a6867640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f25a0113aa0 0x7f25a019e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.484+0000 7f25a6867640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25a010ae10 0x7f25a01a6c00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.484+0000 7f25a6867640 1 --2- 172.21.15.82:0/292669238 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f25a010a4f0 0x7f25a01a66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.484+0000 7f25a6867640 1 -- 172.21.15.82:0/292669238 >> 172.21.15.82:0/292669238 conn(0x7f25a006ca00 msgr2=0x7f25a01094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.489+0000 7f25a6867640 1 -- 172.21.15.82:0/292669238 shutdown_connections 2024-03-27T07:27:27.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.489+0000 7f25a6867640 1 -- 172.21.15.82:0/292669238 wait complete. 2024-03-27T07:27:27.539 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T07:27:27.539 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:27:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.665+0000 7f903a68b640 1 -- 172.21.15.82:0/959201877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f902c0a4de0 msgr2=0x7f902c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.665+0000 7f903a68b640 1 --2- 172.21.15.82:0/959201877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f902c0a4de0 0x7f902c0a51c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f903001a910 tx=0x7f903003cd00 comp rx=0 tx=0).stop 2024-03-27T07:27:27.668 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.665+0000 7f903a68b640 1 -- 172.21.15.82:0/959201877 shutdown_connections 2024-03-27T07:27:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.665+0000 7f903a68b640 1 --2- 172.21.15.82:0/959201877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f902c0b7a70 0x7f902c0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.665+0000 7f903a68b640 1 --2- 172.21.15.82:0/959201877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c0a5700 0x7f902c0b7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.665+0000 7f903a68b640 1 --2- 172.21.15.82:0/959201877 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f902c0a4de0 0x7f902c0a51c0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f903001a910 tx=0x7f903003cd00 comp rx=0 tx=0).stop 2024-03-27T07:27:27.669 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.665+0000 7f903a68b640 1 -- 172.21.15.82:0/959201877 >> 172.21.15.82:0/959201877 conn(0x7f902c01a640 msgr2=0x7f902c01aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.668+0000 7f903a68b640 1 -- 172.21.15.82:0/959201877 shutdown_connections 2024-03-27T07:27:27.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.668+0000 7f903a68b640 1 -- 172.21.15.82:0/959201877 wait complete. 2024-03-27T07:27:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.669+0000 7f903a68b640 1 Processor -- start 2024-03-27T07:27:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.670+0000 7f903a68b640 1 -- start start 2024-03-27T07:27:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.671+0000 7f903a68b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f902c0a5700 0x7f902c0b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.671+0000 7f903a68b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f902c0b7a70 0x7f902c0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.671+0000 7f903a68b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c0b3910 0x7f902c0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.671+0000 7f903a68b640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f902c0af6a0 con 0x7f902c0a5700 2024-03-27T07:27:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.671+0000 7f903a68b640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f902c0af520 con 0x7f902c0b7a70 2024-03-27T07:27:27.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.671+0000 7f903a68b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f902c0af820 con 0x7f902c0b3910 2024-03-27T07:27:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.672+0000 7f9039689640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f902c0a5700 0x7f902c0b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.672+0000 7f9039689640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f902c0a5700 0x7f902c0b72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48082/0 (socket says 172.21.15.82:48082) 2024-03-27T07:27:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.672+0000 7f9039689640 1 -- 172.21.15.82:0/3588694322 learned_addr learned my addr 172.21.15.82:0/3588694322 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.672+0000 7f9039e8a640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c0b3910 0x7f902c0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.679 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.673+0000 7f9038e88640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f902c0b7a70 0x7f902c0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.674+0000 7f9039e8a640 1 -- 172.21.15.82:0/3588694322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f902c0b7a70 msgr2=0x7f902c0b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.674+0000 7f9039e8a640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f902c0b7a70 0x7f902c0b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.674+0000 7f9039e8a640 1 -- 172.21.15.82:0/3588694322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f902c0a5700 msgr2=0x7f902c0b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.674+0000 7f9039e8a640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f902c0a5700 0x7f902c0b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.674+0000 7f9039e8a640 1 -- 172.21.15.82:0/3588694322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c147c20 con 0x7f902c0b3910 2024-03-27T07:27:27.680 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.675+0000 7f9039e8a640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c0b3910 0x7f902c0b3dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f902400d6b0 tx=0x7f902400db70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.676+0000 7f902a7fc640 1 -- 172.21.15.82:0/3588694322 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024017070 con 0x7f902c0b3910 2024-03-27T07:27:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.676+0000 7f902a7fc640 1 -- 172.21.15.82:0/3588694322 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9024009d00 con 0x7f902c0b3910 2024-03-27T07:27:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.677+0000 7f902a7fc640 1 -- 172.21.15.82:0/3588694322 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024003cf0 con 0x7f902c0b3910 2024-03-27T07:27:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.678+0000 7f903a68b640 1 -- 172.21.15.82:0/3588694322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902c147f10 con 0x7f902c0b3910 2024-03-27T07:27:27.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.680+0000 7f903a68b640 1 -- 172.21.15.82:0/3588694322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902c1482c0 con 0x7f902c0b3910 2024-03-27T07:27:27.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.684+0000 7f903e5b4740 1 Processor -- start 2024-03-27T07:27:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.685+0000 7f903e5b4740 1 -- start start 2024-03-27T07:27:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.686+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345290 0x558ea7345670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.686+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7345bb0 0x558ea734e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.686+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 0x558ea7350d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.686+0000 7f903e5b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558ea730bcd0 con 0x558ea734e980 2024-03-27T07:27:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.686+0000 7f903e5b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x558ea7250950 con 0x558ea7345bb0 2024-03-27T07:27:27.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.686+0000 7f903e5b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558ea72a8e50 con 0x558ea7345290 2024-03-27T07:27:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.687+0000 7f9038e88640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345290 0x558ea7345670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.687+0000 7f9038e88640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345290 0x558ea7345670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36488/0 (socket says 172.21.15.82:36488) 2024-03-27T07:27:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.687+0000 7f9038e88640 1 -- 172.21.15.82:0/2493220986 learned_addr learned my addr 172.21.15.82:0/2493220986 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.688+0000 7f902a7fc640 1 -- 172.21.15.82:0/3588694322 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f9024004220 con 0x7f902c0b3910 2024-03-27T07:27:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.688+0000 7f9038e88640 1 -- 172.21.15.82:0/2493220986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7345bb0 msgr2=0x558ea734e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.688+0000 7f9038e88640 1 --2- 172.21.15.82:0/2493220986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7345bb0 0x558ea734e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.688+0000 7f9038e88640 1 -- 172.21.15.82:0/2493220986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 msgr2=0x558ea7350d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.688+0000 7f9038e88640 1 --2- 172.21.15.82:0/2493220986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 0x558ea7350d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.688+0000 7f9038e88640 1 -- 172.21.15.82:0/2493220986 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ea6fbd210 con 0x558ea7345290 2024-03-27T07:27:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.689+0000 7f9038e88640 1 --2- 172.21.15.82:0/2493220986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345290 0x558ea7345670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f903404fb80 tx=0x7f903406aa50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d3464d240bd3bf5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.689+0000 7f902a7fc640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f90200a37e0 0x7f90200a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.690+0000 7f902a7fc640 1 -- 172.21.15.82:0/3588694322 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f90240cf850 con 0x7f902c0b3910 2024-03-27T07:27:27.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.690+0000 7f9039689640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f90200a37e0 0x7f90200a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.694 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.692+0000 7f9039689640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f90200a37e0 0x7f90200a5ca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9030005ab0 tx=0x7f9030005fd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.695+0000 7f901f7fe640 1 -- 172.21.15.82:0/2493220986 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034069220 con 0x558ea7345290 2024-03-27T07:27:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.695+0000 7f901f7fe640 1 -- 172.21.15.82:0/2493220986 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9034068950 con 0x558ea7345290 2024-03-27T07:27:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.695+0000 7f901f7fe640 1 -- 172.21.15.82:0/2493220986 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9034075a50 con 0x558ea7345290 2024-03-27T07:27:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.696+0000 7f903e5b4740 1 -- 172.21.15.82:0/2493220986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345290 msgr2=0x558ea7345670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.696+0000 7f903e5b4740 1 --2- 172.21.15.82:0/2493220986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345290 0x558ea7345670 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f903404fb80 tx=0x7f903406aa50 comp rx=0 tx=0).stop 2024-03-27T07:27:27.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.696+0000 7f903e5b4740 1 -- 172.21.15.82:0/2493220986 shutdown_connections 2024-03-27T07:27:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.696+0000 7f903e5b4740 1 --2- 172.21.15.82:0/2493220986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 0x558ea7350d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.696+0000 7f903e5b4740 1 --2- 172.21.15.82:0/2493220986 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7345bb0 0x558ea734e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.696+0000 7f903e5b4740 1 --2- 172.21.15.82:0/2493220986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345290 0x558ea7345670 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f903404fb80 tx=0x7f903406aa50 comp rx=0 tx=0).stop 2024-03-27T07:27:27.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.696+0000 7f903e5b4740 1 -- 172.21.15.82:0/2493220986 >> 172.21.15.82:0/2493220986 conn(0x558ea733fbb0 msgr2=0x558ea733ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.701+0000 7f903e5b4740 1 -- 172.21.15.82:0/2493220986 shutdown_connections 2024-03-27T07:27:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.703+0000 7f903e5b4740 1 -- 172.21.15.82:0/2493220986 wait complete. 2024-03-27T07:27:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.703+0000 7f903e5b4740 1 -- start start 2024-03-27T07:27:27.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.703+0000 7f903e5b4740 1 Processor -- start 2024-03-27T07:27:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.704+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7345bb0 0x558ea734bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.704+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 0x558ea734c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.704+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 0x558ea735a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.704+0000 7f903e5b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558ea72a4e00 con 0x558ea734e980 2024-03-27T07:27:27.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.704+0000 7f903e5b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x558ea7251520 con 0x558ea7345bb0 2024-03-27T07:27:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.704+0000 7f903e5b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x558ea72648e0 con 0x558ea734c5c0 2024-03-27T07:27:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.704+0000 7f903e5b4740 10 client.0 _ll_register_callbacks cb 0x558ea729fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:27.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.705+0000 7f9038e88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 0x558ea734c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.705+0000 7f9038e88640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 0x558ea734c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48102/0 (socket says 172.21.15.82:48102) 2024-03-27T07:27:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.705+0000 7f9038e88640 1 -- 172.21.15.82:0/3976009973 learned_addr learned my addr 172.21.15.82:0/3976009973 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.706+0000 7f9039e8a640 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 0x558ea735a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.706+0000 7f9039689640 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7345bb0 0x558ea734bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.706+0000 7f9038e88640 1 -- 172.21.15.82:0/3976009973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 msgr2=0x558ea735a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.706+0000 7f9038e88640 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 0x558ea735a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.707+0000 7f9038e88640 1 -- 172.21.15.82:0/3976009973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7345bb0 msgr2=0x558ea734bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.707+0000 7f9038e88640 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7345bb0 0x558ea734bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.707+0000 7f9038e88640 1 -- 172.21.15.82:0/3976009973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ea7089620 con 0x558ea734e980 2024-03-27T07:27:27.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.707+0000 7f9039689640 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7345bb0 0x558ea734bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:27:27.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.710+0000 7f9038e88640 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 0x558ea734c080 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9034067830 tx=0x7f9034075690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e621793ea6bbc5c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.712+0000 7f901cff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:27:27.714 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.712+0000 7f901cff9640 1 -- 172.21.15.82:0/3976009973 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903407e040 con 0x558ea734e980 2024-03-27T07:27:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.712+0000 7f903e5b4740 1 -- 172.21.15.82:0/3976009973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9034068950 con 0x558ea734e980 2024-03-27T07:27:27.715 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.712+0000 7f901cff9640 1 -- 172.21.15.82:0/3976009973 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9034068670 con 0x558ea734e980 2024-03-27T07:27:27.716 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.714+0000 7f901cff9640 1 -- 172.21.15.82:0/3976009973 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9034068b00 con 0x558ea734e980 2024-03-27T07:27:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.717+0000 7f903e5b4740 10 client.16446 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:27.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.717+0000 7f903e5b4740 1 -- 172.21.15.82:0/3976009973 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558ea735db20 con 0x558ea734e980 2024-03-27T07:27:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.718+0000 7f901cff9640 1 -- 172.21.15.82:0/3976009973 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9034068950 con 0x558ea734e980 2024-03-27T07:27:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.718+0000 7f901cff9640 1 -- 172.21.15.82:0/3976009973 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9034079650 con 0x558ea734e980 2024-03-27T07:27:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.718+0000 7f903e5b4740 10 client.16446 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.718+0000 7f903e5b4740 10 client.16446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.718+0000 7f903e5b4740 20 client.16446 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.718+0000 7f903e5b4740 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558ea735f410 0x558ea7361870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.718+0000 7f903e5b4740 4 client.16446 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:27:27.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.718+0000 7f903e5b4740 1 -- 172.21.15.82:0/3976009973 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ea72b6390 con 0x558ea735f410 2024-03-27T07:27:27.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.726+0000 7f9039689640 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558ea735f410 0x558ea7361870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.736+0000 7f9039689640 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558ea735f410 0x558ea7361870 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40fdc4d925173afd server_cookie=ba57f737e0f1ea85 in_seq=0 out_seq=0 2024-03-27T07:27:27.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.737+0000 7f901cff9640 10 client.16446 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.745+0000 7f901cff9640 1 -- 172.21.15.82:0/3976009973 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x558ea72b6390 con 0x558ea735f410 2024-03-27T07:27:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.745+0000 7f901cff9640 10 client.16446 handle_command_reply: tid=0 2024-03-27T07:27:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.745+0000 7f903e5b4740 1 client.16446 shutdown 2024-03-27T07:27:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.760+0000 7f903e5b4740 1 -- 172.21.15.82:0/3976009973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 msgr2=0x558ea734c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.760+0000 7f903e5b4740 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 0x558ea734c080 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9034067830 tx=0x7f9034075690 comp rx=0 tx=0).stop 2024-03-27T07:27:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.760+0000 7f903e5b4740 1 -- 172.21.15.82:0/3976009973 shutdown_connections 2024-03-27T07:27:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.760+0000 7f903e5b4740 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558ea735f410 0x558ea7361870 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.760+0000 7f903e5b4740 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea734e980 0x558ea734c080 secure :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9034067830 tx=0x7f9034075690 comp rx=0 tx=0).stop 2024-03-27T07:27:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.760+0000 7f903e5b4740 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 0x558ea735a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.760+0000 7f903e5b4740 1 --2- 172.21.15.82:0/3976009973 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7345bb0 0x558ea734bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.760+0000 7f903e5b4740 1 -- 172.21.15.82:0/3976009973 >> 172.21.15.82:0/3976009973 conn(0x558ea733fbb0 msgr2=0x558ea7341900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.764 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.760+0000 7f901cff9640 0 client.16446 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:27.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.763+0000 7f903e5b4740 1 -- 172.21.15.82:0/3976009973 shutdown_connections 2024-03-27T07:27:27.765 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.763+0000 7f903e5b4740 1 -- 172.21.15.82:0/3976009973 wait complete. 2024-03-27T07:27:27.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.763+0000 7f903e5b4740 20 client.16446 trim_cache size 0 max 16384 2024-03-27T07:27:27.832 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.830+0000 7f903e5b4740 1 Processor -- start 2024-03-27T07:27:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.831+0000 7f903e5b4740 1 -- start start 2024-03-27T07:27:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.832+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345bb0 0x558ea7367140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.832+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea734c5c0 0x558ea7346e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.832+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7367680 0x558ea7347380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.832+0000 7f903e5b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f902c153380 con 0x558ea7367680 2024-03-27T07:27:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.832+0000 7f903e5b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f902c150bf0 con 0x558ea734c5c0 2024-03-27T07:27:27.841 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.832+0000 7f903e5b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f902c14ea40 con 0x558ea7345bb0 2024-03-27T07:27:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.832+0000 7f9039689640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345bb0 0x558ea7367140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.832+0000 7f9039689640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345bb0 0x558ea7367140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36506/0 (socket says 172.21.15.82:36506) 2024-03-27T07:27:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.832+0000 7f9039689640 1 -- 172.21.15.82:0/530288826 learned_addr learned my addr 172.21.15.82:0/530288826 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.832+0000 7f9039e8a640 1 --2- 172.21.15.82:0/530288826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7367680 0x558ea7347380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.833+0000 7f9039689640 1 -- 172.21.15.82:0/530288826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea734c5c0 msgr2=0x558ea7346e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:27:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.833+0000 7f9039689640 1 --2- 172.21.15.82:0/530288826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea734c5c0 0x558ea7346e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.833+0000 7f9039689640 1 -- 172.21.15.82:0/530288826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7367680 msgr2=0x558ea7347380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.833+0000 7f9039689640 1 --2- 172.21.15.82:0/530288826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7367680 0x558ea7347380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.833+0000 7f9039689640 1 -- 172.21.15.82:0/530288826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ea733e030 con 0x558ea7345bb0 2024-03-27T07:27:27.842 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.833+0000 7f9039689640 1 --2- 172.21.15.82:0/530288826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345bb0 0x558ea7367140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9030047040 tx=0x7f9030050000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3212563e5b6fa03a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.840+0000 7f901effd640 1 -- 172.21.15.82:0/530288826 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903006c070 con 0x558ea7345bb0 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.840+0000 7f901effd640 1 -- 172.21.15.82:0/530288826 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9030056050 con 0x558ea7345bb0 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.840+0000 7f901effd640 1 -- 172.21.15.82:0/530288826 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9030003b20 con 0x558ea7345bb0 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.842+0000 7f903e5b4740 1 -- 172.21.15.82:0/530288826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345bb0 msgr2=0x558ea7367140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.842+0000 7f903e5b4740 1 --2- 172.21.15.82:0/530288826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345bb0 0x558ea7367140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9030047040 tx=0x7f9030050000 comp rx=0 tx=0).stop 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.842+0000 7f903e5b4740 1 -- 172.21.15.82:0/530288826 shutdown_connections 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.842+0000 7f903e5b4740 1 --2- 172.21.15.82:0/530288826 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7367680 0x558ea7347380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.842+0000 7f903e5b4740 1 --2- 172.21.15.82:0/530288826 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea734c5c0 0x558ea7346e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.842+0000 7f903e5b4740 1 --2- 172.21.15.82:0/530288826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea7345bb0 0x558ea7367140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.842+0000 7f903e5b4740 1 -- 172.21.15.82:0/530288826 >> 172.21.15.82:0/530288826 conn(0x558ea733fbb0 msgr2=0x558ea734bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.844+0000 7f903e5b4740 1 -- 172.21.15.82:0/530288826 shutdown_connections 2024-03-27T07:27:27.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.844+0000 7f903e5b4740 1 -- 172.21.15.82:0/530288826 wait complete. 2024-03-27T07:27:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.845+0000 7f903e5b4740 1 -- start start 2024-03-27T07:27:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.845+0000 7f903e5b4740 1 Processor -- start 2024-03-27T07:27:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.846+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7345bb0 0x558ea7356680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.846+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 0x558ea7347f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.846+0000 7f903e5b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7367680 0x558ea7348450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.847+0000 7f903e5b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f902c14f0b0 con 0x558ea7345bb0 2024-03-27T07:27:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.847+0000 7f903e5b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f902c150520 con 0x558ea7367680 2024-03-27T07:27:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.847+0000 7f903e5b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f902c14f780 con 0x558ea734c5c0 2024-03-27T07:27:27.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.847+0000 7f903e5b4740 10 client.0 _ll_register_callbacks cb 0x7f9034050100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.848+0000 7f9039e8a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7367680 0x558ea7348450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.848+0000 7f9039689640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7345bb0 0x558ea7356680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.848+0000 7f9039689640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7345bb0 0x558ea7356680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48112/0 (socket says 172.21.15.82:48112) 2024-03-27T07:27:27.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.848+0000 7f9039689640 1 -- 172.21.15.82:0/4150202014 learned_addr learned my addr 172.21.15.82:0/4150202014 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.848+0000 7f9038e88640 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 0x558ea7347f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.852+0000 7f9039689640 1 -- 172.21.15.82:0/4150202014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 msgr2=0x558ea7347f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.852+0000 7f9039689640 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 0x558ea7347f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.852+0000 7f9039689640 1 -- 172.21.15.82:0/4150202014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7367680 msgr2=0x558ea7348450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.852+0000 7f9039689640 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7367680 0x558ea7348450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.852+0000 7f9039689640 1 -- 172.21.15.82:0/4150202014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ea7348990 con 0x558ea7345bb0 2024-03-27T07:27:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.853+0000 7f9038e88640 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 0x558ea7347f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:27:27.866 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.858+0000 7f9039689640 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7345bb0 0x558ea7356680 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9030003850 tx=0x7f9030004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3925e9baec76c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.875+0000 7f901cff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:27:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.875+0000 7f901cff9640 1 -- 172.21.15.82:0/4150202014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903006c030 con 0x558ea7345bb0 2024-03-27T07:27:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.875+0000 7f901cff9640 1 -- 172.21.15.82:0/4150202014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9030064070 con 0x558ea7345bb0 2024-03-27T07:27:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.877+0000 7f903e5b4740 1 -- 172.21.15.82:0/4150202014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9030056050 con 0x558ea7345bb0 2024-03-27T07:27:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.879+0000 7f901cff9640 1 -- 172.21.15.82:0/4150202014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9030077050 con 0x558ea7345bb0 2024-03-27T07:27:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.879+0000 7f903e5b4740 10 client.16452 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.879+0000 7f903e5b4740 1 -- 172.21.15.82:0/4150202014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558ea73c5300 con 0x558ea7345bb0 2024-03-27T07:27:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.881+0000 7f901cff9640 1 -- 172.21.15.82:0/4150202014 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9030056050 con 0x558ea7345bb0 2024-03-27T07:27:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.881+0000 7f901cff9640 1 -- 172.21.15.82:0/4150202014 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f90300507c0 con 0x558ea7345bb0 2024-03-27T07:27:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.881+0000 7f903e5b4740 10 client.16452 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.881+0000 7f903e5b4740 10 client.16452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.881+0000 7f903e5b4740 20 client.16452 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.881+0000 7f903e5b4740 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558ea73c59d0 0x558ea73c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.881+0000 7f903e5b4740 4 client.16452 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:27:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.881+0000 7f903e5b4740 1 -- 172.21.15.82:0/4150202014 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ea72b06e0 con 0x558ea73c59d0 2024-03-27T07:27:27.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.883+0000 7f9038e88640 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558ea73c59d0 0x558ea73c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.885+0000 7f9038e88640 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558ea73c59d0 0x558ea73c7df0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b4e5bae5d932661 server_cookie=975e40aafc58993d in_seq=0 out_seq=0 2024-03-27T07:27:27.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:27.885+0000 7f901cff9640 10 client.16452 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:27.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.907+0000 7f919c9d5640 1 -- 172.21.15.82:0/1619306129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9190099bc0 msgr2=0x7f9190099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.907+0000 7f919c9d5640 1 --2- 172.21.15.82:0/1619306129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9190099bc0 0x7f9190099fa0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9188009900 tx=0x7f918802bc80 comp rx=0 tx=0).stop 2024-03-27T07:27:27.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.920+0000 7f919c9d5640 1 -- 172.21.15.82:0/1619306129 shutdown_connections 2024-03-27T07:27:27.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.920+0000 7f919c9d5640 1 --2- 172.21.15.82:0/1619306129 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91900957f0 0x7f91900a1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.920+0000 7f919c9d5640 1 --2- 172.21.15.82:0/1619306129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9190094e50 0x7f91900952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.920+0000 7f919c9d5640 1 --2- 172.21.15.82:0/1619306129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9190099bc0 0x7f9190099fa0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.920+0000 7f919c9d5640 1 -- 172.21.15.82:0/1619306129 >> 172.21.15.82:0/1619306129 conn(0x7f919000a740 msgr2=0x7f919000ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:27.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.924+0000 7f919c9d5640 1 -- 172.21.15.82:0/1619306129 shutdown_connections 2024-03-27T07:27:27.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.924+0000 7f919c9d5640 1 -- 172.21.15.82:0/1619306129 wait complete. 2024-03-27T07:27:27.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.926+0000 7f919c9d5640 1 Processor -- start 2024-03-27T07:27:27.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.931+0000 7f919c9d5640 1 -- start start 2024-03-27T07:27:27.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.932+0000 7f919c9d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9190094e50 0x7f91900a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.932+0000 7f919c9d5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91900957f0 0x7f919009db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.932+0000 7f919c9d5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9190099bc0 0x7f9190136750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.932+0000 7f919c9d5640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91900a3f70 con 0x7f9190094e50 2024-03-27T07:27:27.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.932+0000 7f919c9d5640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91900a3df0 con 0x7f91900957f0 2024-03-27T07:27:27.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.932+0000 7f919c9d5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91900a40f0 con 0x7f9190099bc0 2024-03-27T07:27:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.933+0000 7f919759e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9190099bc0 0x7f9190136750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.933+0000 7f919659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91900957f0 0x7f919009db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.933+0000 7f919659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91900957f0 0x7f919009db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:57724/0 (socket says 172.21.15.82:57724) 2024-03-27T07:27:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.933+0000 7f9196d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9190094e50 0x7f91900a1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.933+0000 7f919659c640 1 -- 172.21.15.82:0/3879191367 learned_addr learned my addr 172.21.15.82:0/3879191367 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:27.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.933+0000 7f919759e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9190099bc0 0x7f9190136750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36528/0 (socket says 172.21.15.82:36528) 2024-03-27T07:27:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.934+0000 7f9196d9d640 1 -- 172.21.15.82:0/3879191367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9190099bc0 msgr2=0x7f9190136750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.934+0000 7f9196d9d640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9190099bc0 0x7f9190136750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.934+0000 7f9196d9d640 1 -- 172.21.15.82:0/3879191367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91900957f0 msgr2=0x7f919009db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.934+0000 7f9196d9d640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91900957f0 0x7f919009db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.934+0000 7f9196d9d640 1 -- 172.21.15.82:0/3879191367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919009e2e0 con 0x7f9190094e50 2024-03-27T07:27:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.934+0000 7f919759e640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9190099bc0 0x7f9190136750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:27:27.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.935+0000 7f9196d9d640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9190094e50 0x7f91900a1a90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f918802c290 tx=0x7f918802ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.936+0000 7f917ffff640 1 -- 172.21.15.82:0/3879191367 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188041020 con 0x7f9190094e50 2024-03-27T07:27:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.936+0000 7f919c9d5640 1 -- 172.21.15.82:0/3879191367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919009e570 con 0x7f9190094e50 2024-03-27T07:27:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.936+0000 7f919c9d5640 1 -- 172.21.15.82:0/3879191367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9190147f20 con 0x7f9190094e50 2024-03-27T07:27:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.937+0000 7f917ffff640 1 -- 172.21.15.82:0/3879191367 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f918802edc0 con 0x7f9190094e50 2024-03-27T07:27:27.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.937+0000 7f917ffff640 1 -- 172.21.15.82:0/3879191367 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9188004cb0 con 0x7f9190094e50 2024-03-27T07:27:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.939+0000 7f919c9d5640 1 -- 172.21.15.82:0/3879191367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9184005290 con 0x7f9190094e50 2024-03-27T07:27:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.940+0000 7f917ffff640 1 -- 172.21.15.82:0/3879191367 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f9188044020 con 0x7f9190094e50 2024-03-27T07:27:27.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.941+0000 7f917ffff640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91800a3980 0x7f91800a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.942+0000 7f917ffff640 1 -- 172.21.15.82:0/3879191367 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f91880f1500 con 0x7f9190094e50 2024-03-27T07:27:27.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.942+0000 7f919659c640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91800a3980 0x7f91800a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:27.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.943+0000 7f919659c640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91800a3980 0x7f91800a5e40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f918c0095f0 tx=0x7f918c005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:27.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:27.952+0000 7f917ffff640 1 -- 172.21.15.82:0/3879191367 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f918804b020 con 0x7f9190094e50 2024-03-27T07:27:28.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.440+0000 7f919c9d5640 1 -- 172.21.15.82:0/3879191367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9184005850 con 0x7f9190094e50 2024-03-27T07:27:28.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.441+0000 7f917ffff640 1 -- 172.21.15.82:0/3879191367 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11866 (secure 0 0 0) 0x7f91880bde90 con 0x7f9190094e50 2024-03-27T07:27:28.445 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:27:28.445 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:25:25.065944+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:27:28.446 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 26 2024-03-27T07:27:28.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.446+0000 7f919c9d5640 1 -- 172.21.15.82:0/3879191367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91800a3980 msgr2=0x7f91800a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:28.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.446+0000 7f919c9d5640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91800a3980 0x7f91800a5e40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f918c0095f0 tx=0x7f918c005f90 comp rx=0 tx=0).stop 2024-03-27T07:27:28.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.446+0000 7f919c9d5640 1 -- 172.21.15.82:0/3879191367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9190094e50 msgr2=0x7f91900a1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:28.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.446+0000 7f919c9d5640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9190094e50 0x7f91900a1a90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f918802c290 tx=0x7f918802ea40 comp rx=0 tx=0).stop 2024-03-27T07:27:28.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.448+0000 7f919c9d5640 1 -- 172.21.15.82:0/3879191367 shutdown_connections 2024-03-27T07:27:28.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.448+0000 7f919c9d5640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91800a3980 0x7f91800a5e40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.448+0000 7f919c9d5640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9190099bc0 0x7f9190136750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.448+0000 7f919c9d5640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91900957f0 0x7f919009db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.448+0000 7f919c9d5640 1 --2- 172.21.15.82:0/3879191367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9190094e50 0x7f91900a1a90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.448+0000 7f919c9d5640 1 -- 172.21.15.82:0/3879191367 >> 172.21.15.82:0/3879191367 conn(0x7f919000a740 msgr2=0x7f91900936c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:28.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.448+0000 7f919c9d5640 1 -- 172.21.15.82:0/3879191367 shutdown_connections 2024-03-27T07:27:28.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.448+0000 7f919c9d5640 1 -- 172.21.15.82:0/3879191367 wait complete. 2024-03-27T07:27:28.477 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T07:27:28.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:28 smithi082 ceph-mon[32178]: pgmap v119: 97 pgs: 97 active+clean; 640 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.8 MiB/s wr, 1.12k op/s 2024-03-27T07:27:28.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.690+0000 7efd2d85c640 1 -- 172.21.15.82:0/1485531499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd28108350 msgr2=0x7efd28108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:28.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.690+0000 7efd2d85c640 1 --2- 172.21.15.82:0/1485531499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd28108350 0x7efd28108730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efd18009860 tx=0x7efd1802bb90 comp rx=0 tx=0).stop 2024-03-27T07:27:28.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.692+0000 7efd2d85c640 1 -- 172.21.15.82:0/1485531499 shutdown_connections 2024-03-27T07:27:28.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.692+0000 7efd2d85c640 1 --2- 172.21.15.82:0/1485531499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd28108d00 0x7efd2810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.692+0000 7efd2d85c640 1 --2- 172.21.15.82:0/1485531499 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd2810d420 0x7efd28114ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.692+0000 7efd2d85c640 1 --2- 172.21.15.82:0/1485531499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd28108350 0x7efd28108730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.692+0000 7efd2d85c640 1 -- 172.21.15.82:0/1485531499 >> 172.21.15.82:0/1485531499 conn(0x7efd28076060 msgr2=0x7efd28078480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:28.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.695+0000 7efd2d85c640 1 -- 172.21.15.82:0/1485531499 shutdown_connections 2024-03-27T07:27:28.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.695+0000 7efd2d85c640 1 -- 172.21.15.82:0/1485531499 wait complete. 2024-03-27T07:27:28.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.696+0000 7efd2d85c640 1 Processor -- start 2024-03-27T07:27:28.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.699+0000 7efd2d85c640 1 -- start start 2024-03-27T07:27:28.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.699+0000 7efd2d85c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd28108350 0x7efd281a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.699+0000 7efd2d85c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2810d420 0x7efd281a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.699+0000 7efd2d85c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2819e840 0x7efd2819ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.699+0000 7efd2d85c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd28118500 con 0x7efd2810d420 2024-03-27T07:27:28.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.699+0000 7efd2d85c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd28118380 con 0x7efd28108350 2024-03-27T07:27:28.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.699+0000 7efd2d85c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd28118680 con 0x7efd2819e840 2024-03-27T07:27:28.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.700+0000 7efd26ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd28108350 0x7efd281a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:28.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.700+0000 7efd26ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd28108350 0x7efd281a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:57750/0 (socket says 172.21.15.82:57750) 2024-03-27T07:27:28.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.700+0000 7efd26ffd640 1 -- 172.21.15.82:0/2956467501 learned_addr learned my addr 172.21.15.82:0/2956467501 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.700+0000 7efd1ffff640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2810d420 0x7efd281a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.700+0000 7efd26ffd640 1 -- 172.21.15.82:0/2956467501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2819e840 msgr2=0x7efd2819ecf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.700+0000 7efd26ffd640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2819e840 0x7efd2819ecf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.700+0000 7efd26ffd640 1 -- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2810d420 msgr2=0x7efd281a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.700+0000 7efd26ffd640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2810d420 0x7efd281a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.700+0000 7efd26ffd640 1 -- 172.21.15.82:0/2956467501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2819f3f0 con 0x7efd28108350 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.701+0000 7efd1ffff640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2810d420 0x7efd281a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.701+0000 7efd26ffd640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd28108350 0x7efd281a4680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd18009460 tx=0x7efd18034970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.702+0000 7efd2c85a640 1 -- 172.21.15.82:0/2956467501 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18039040 con 0x7efd28108350 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.702+0000 7efd2c85a640 1 -- 172.21.15.82:0/2956467501 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd18064070 con 0x7efd28108350 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.702+0000 7efd2c85a640 1 -- 172.21.15.82:0/2956467501 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd180038e0 con 0x7efd28108350 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.702+0000 7efd2d85c640 1 -- 172.21.15.82:0/2956467501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd2819f680 con 0x7efd28108350 2024-03-27T07:27:28.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.702+0000 7efd2d85c640 1 -- 172.21.15.82:0/2956467501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd2806b810 con 0x7efd28108350 2024-03-27T07:27:28.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.706+0000 7efd2c85a640 1 -- 172.21.15.82:0/2956467501 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7efd1802c7f0 con 0x7efd28108350 2024-03-27T07:27:28.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.707+0000 7efd2c85a640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efd140a3990 0x7efd140a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.708+0000 7efd2c85a640 1 -- 172.21.15.82:0/2956467501 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7efd18113850 con 0x7efd28108350 2024-03-27T07:27:28.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.710+0000 7efd30449740 1 Processor -- start 2024-03-27T07:27:28.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.711+0000 7efd1ffff640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efd140a3990 0x7efd140a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:28.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.711+0000 7efd30449740 1 -- start start 2024-03-27T07:27:28.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.711+0000 7efd30449740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a3c4a0 0x55fb28a3c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.711+0000 7efd30449740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 0x55fb28a56780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.711+0000 7efd30449740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a56cc0 0x55fb28a590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.711+0000 7efd30449740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fb289a0710 con 0x55fb28a56cc0 2024-03-27T07:27:28.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.711+0000 7efd30449740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55fb28948af0 con 0x55fb28a3c4a0 2024-03-27T07:27:28.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.711+0000 7efd30449740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fb2899c6c0 con 0x55fb28a3cdc0 2024-03-27T07:27:28.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.712+0000 7efd277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a56cc0 0x55fb28a590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:28.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.712+0000 7efd277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a56cc0 0x55fb28a590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48166/0 (socket says 172.21.15.82:48166) 2024-03-27T07:27:28.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.712+0000 7efd277fe640 1 -- 172.21.15.82:0/241208203 learned_addr learned my addr 172.21.15.82:0/241208203 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:28.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.712+0000 7efd277fe640 1 -- 172.21.15.82:0/241208203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 msgr2=0x55fb28a56780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T07:27:28.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.712+0000 7efd277fe640 1 --2- 172.21.15.82:0/241208203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 0x55fb28a56780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.712+0000 7efd277fe640 1 -- 172.21.15.82:0/241208203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a3c4a0 msgr2=0x55fb28a3c880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:27:28.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.712+0000 7efd277fe640 1 --2- 172.21.15.82:0/241208203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a3c4a0 0x55fb28a3c880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.712+0000 7efd277fe640 1 -- 172.21.15.82:0/241208203 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb286b43f0 con 0x55fb28a56cc0 2024-03-27T07:27:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.713+0000 7efd277fe640 1 --2- 172.21.15.82:0/241208203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a56cc0 0x55fb28a590b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efd20009f80 tx=0x7efd2000e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c277a2156e88f108 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.713+0000 7efd1dffb640 1 -- 172.21.15.82:0/241208203 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20004d20 con 0x55fb28a56cc0 2024-03-27T07:27:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.714+0000 7efd1dffb640 1 -- 172.21.15.82:0/241208203 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd20003e50 con 0x55fb28a56cc0 2024-03-27T07:27:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.715+0000 7efd30449740 1 -- 172.21.15.82:0/241208203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a56cc0 msgr2=0x55fb28a590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:28.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.715+0000 7efd30449740 1 --2- 172.21.15.82:0/241208203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a56cc0 0x55fb28a590b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efd20009f80 tx=0x7efd2000e880 comp rx=0 tx=0).stop 2024-03-27T07:27:28.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.716+0000 7efd1ffff640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efd140a3990 0x7efd140a5e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efd100058c0 tx=0x7efd10005850 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:28.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.723+0000 7efd30449740 1 -- 172.21.15.82:0/241208203 shutdown_connections 2024-03-27T07:27:28.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.723+0000 7efd30449740 1 --2- 172.21.15.82:0/241208203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a56cc0 0x55fb28a590b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.723+0000 7efd30449740 1 --2- 172.21.15.82:0/241208203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 0x55fb28a56780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.723+0000 7efd30449740 1 --2- 172.21.15.82:0/241208203 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a3c4a0 0x55fb28a3c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.723+0000 7efd30449740 1 -- 172.21.15.82:0/241208203 >> 172.21.15.82:0/241208203 conn(0x55fb28a36ee0 msgr2=0x55fb28a372c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:28.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.725+0000 7efd30449740 1 -- 172.21.15.82:0/241208203 shutdown_connections 2024-03-27T07:27:28.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.727+0000 7efd30449740 1 -- 172.21.15.82:0/241208203 wait complete. 2024-03-27T07:27:28.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.727+0000 7efd30449740 1 -- start start 2024-03-27T07:27:28.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.728+0000 7efd30449740 1 Processor -- start 2024-03-27T07:27:28.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.728+0000 7efd30449740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a3c4a0 0x55fb28a56770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.728+0000 7efd30449740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3cdc0 0x55fb28a53b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.728+0000 7efd30449740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a56cc0 0x55fb28a54240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.728+0000 7efd30449740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fb28a59b50 con 0x55fb28a3cdc0 2024-03-27T07:27:28.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.728+0000 7efd30449740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55fb2895beb0 con 0x55fb28a3c4a0 2024-03-27T07:27:28.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.728+0000 7efd30449740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fb28a59cd0 con 0x55fb28a56cc0 2024-03-27T07:27:28.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.728+0000 7efd30449740 10 client.0 _ll_register_callbacks cb 0x55fb289986a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.729+0000 7efd26ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a3c4a0 0x55fb28a56770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.730+0000 7efd277fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a56cc0 0x55fb28a54240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.730+0000 7efd26ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a3c4a0 0x55fb28a56770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:57758/0 (socket says 172.21.15.82:57758) 2024-03-27T07:27:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.730+0000 7efd26ffd640 1 -- 172.21.15.82:0/3772828745 learned_addr learned my addr 172.21.15.82:0/3772828745 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.734+0000 7efd277fe640 1 -- 172.21.15.82:0/3772828745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a3c4a0 msgr2=0x55fb28a56770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:28.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.734+0000 7efd277fe640 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a3c4a0 0x55fb28a56770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.734+0000 7efd277fe640 1 -- 172.21.15.82:0/3772828745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3cdc0 msgr2=0x55fb28a53b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:28.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.734+0000 7efd277fe640 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3cdc0 0x55fb28a53b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.734+0000 7efd277fe640 1 -- 172.21.15.82:0/3772828745 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb2877e7d0 con 0x55fb28a56cc0 2024-03-27T07:27:28.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.736+0000 7efd277fe640 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a56cc0 0x55fb28a54240 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd2000ed80 tx=0x7efd20003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cb15dc00e41076b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:28.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.737+0000 7efd0effd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:27:28.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.739+0000 7efd0effd640 1 -- 172.21.15.82:0/3772828745 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20025070 con 0x55fb28a56cc0 2024-03-27T07:27:28.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.739+0000 7efd0effd640 1 -- 172.21.15.82:0/3772828745 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7efd2000cd10 con 0x55fb28a56cc0 2024-03-27T07:27:28.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.739+0000 7efd30449740 1 -- 172.21.15.82:0/3772828745 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd20003e50 con 0x55fb28a56cc0 2024-03-27T07:27:28.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.740+0000 7efd0effd640 1 -- 172.21.15.82:0/3772828745 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efd2002e050 con 0x55fb28a56cc0 2024-03-27T07:27:28.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.740+0000 7efd30449740 10 client.26296 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:28.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.740+0000 7efd30449740 1 -- 172.21.15.82:0/3772828745 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fb28a65d50 con 0x55fb28a56cc0 2024-03-27T07:27:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.744+0000 7efd0effd640 1 -- 172.21.15.82:0/3772828745 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd20003e50 con 0x55fb28a56cc0 2024-03-27T07:27:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.744+0000 7efd0effd640 1 -- 172.21.15.82:0/3772828745 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7efd20028020 con 0x55fb28a56cc0 2024-03-27T07:27:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.744+0000 7efd30449740 10 client.26296 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.744+0000 7efd30449740 10 client.26296 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:27:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.744+0000 7efd30449740 20 client.26296 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.744+0000 7efd30449740 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55fb28a67210 0x55fb28a69600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.744+0000 7efd30449740 4 client.26296 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:27:28.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.744+0000 7efd30449740 1 -- 172.21.15.82:0/3772828745 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb289adc50 con 0x55fb28a67210 2024-03-27T07:27:28.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.746+0000 7efd26ffd640 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55fb28a67210 0x55fb28a69600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:28.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.747+0000 7efd0effd640 10 client.26296 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:27:28.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.747+0000 7efd26ffd640 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55fb28a67210 0x55fb28a69600 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4797675a2ba83e0c server_cookie=530dc1a80c144e5a in_seq=0 out_seq=0 2024-03-27T07:27:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.751+0000 7efd0effd640 1 -- 172.21.15.82:0/3772828745 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55fb289adc50 con 0x55fb28a67210 2024-03-27T07:27:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.751+0000 7efd0effd640 10 client.26296 handle_command_reply: tid=0 2024-03-27T07:27:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.751+0000 7efd30449740 1 client.26296 shutdown 2024-03-27T07:27:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.753+0000 7efd30449740 1 -- 172.21.15.82:0/3772828745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a56cc0 msgr2=0x55fb28a54240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:28.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.753+0000 7efd30449740 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a56cc0 0x55fb28a54240 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd2000ed80 tx=0x7efd20003ba0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:28 smithi149 ceph-mon[36065]: pgmap v119: 97 pgs: 97 active+clean; 640 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.8 MiB/s wr, 1.12k op/s 2024-03-27T07:27:28.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.754+0000 7efd30449740 1 -- 172.21.15.82:0/3772828745 shutdown_connections 2024-03-27T07:27:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.754+0000 7efd30449740 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55fb28a67210 0x55fb28a69600 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.754+0000 7efd30449740 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3cdc0 0x55fb28a53b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.754+0000 7efd30449740 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a56cc0 0x55fb28a54240 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.754+0000 7efd30449740 1 --2- 172.21.15.82:0/3772828745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a3c4a0 0x55fb28a56770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.754+0000 7efd0effd640 0 client.26296 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:27:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.754+0000 7efd30449740 1 -- 172.21.15.82:0/3772828745 >> 172.21.15.82:0/3772828745 conn(0x55fb28a36ee0 msgr2=0x55fb28a38c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.754+0000 7efd30449740 1 -- 172.21.15.82:0/3772828745 shutdown_connections 2024-03-27T07:27:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.754+0000 7efd30449740 1 -- 172.21.15.82:0/3772828745 wait complete. 2024-03-27T07:27:28.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.754+0000 7efd30449740 20 client.26296 trim_cache size 0 max 16384 2024-03-27T07:27:28.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.782+0000 7efd30449740 1 Processor -- start 2024-03-27T07:27:28.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.782+0000 7efd30449740 1 -- start start 2024-03-27T07:27:28.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.783+0000 7efd30449740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3c4a0 0x55fb28a53aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.783+0000 7efd30449740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 0x55fb28a62a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.783+0000 7efd30449740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 0x55fb28a6ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.783+0000 7efd30449740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd08011090 con 0x55fb28a3c4a0 2024-03-27T07:27:28.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.783+0000 7efd30449740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd0800e900 con 0x55fb28a56cc0 2024-03-27T07:27:28.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.783+0000 7efd30449740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd0800c750 con 0x55fb28a3cdc0 2024-03-27T07:27:28.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.784+0000 7efd1ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 0x55fb28a62a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.784+0000 7efd1ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 0x55fb28a62a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36554/0 (socket says 172.21.15.82:36554) 2024-03-27T07:27:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.784+0000 7efd1ffff640 1 -- 172.21.15.82:0/778941082 learned_addr learned my addr 172.21.15.82:0/778941082 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.784+0000 7efd1ffff640 1 -- 172.21.15.82:0/778941082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 msgr2=0x55fb28a6ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.784+0000 7efd1ffff640 1 --2- 172.21.15.82:0/778941082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 0x55fb28a6ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.784+0000 7efd1ffff640 1 -- 172.21.15.82:0/778941082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3c4a0 msgr2=0x55fb28a53aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.784+0000 7efd1ffff640 1 --2- 172.21.15.82:0/778941082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3c4a0 0x55fb28a53aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.784+0000 7efd1ffff640 1 -- 172.21.15.82:0/778941082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb28a3cbf0 con 0x55fb28a3cdc0 2024-03-27T07:27:28.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.785+0000 7efd1ffff640 1 --2- 172.21.15.82:0/778941082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 0x55fb28a62a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efd1000bfc0 tx=0x7efd10004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a499bbd7bf9248d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:28.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:28 smithi153 ceph-mon[36179]: pgmap v119: 97 pgs: 97 active+clean; 640 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 7.8 MiB/s wr, 1.12k op/s 2024-03-27T07:27:28.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.786+0000 7efd1d7fa640 1 -- 172.21.15.82:0/778941082 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10022070 con 0x55fb28a3cdc0 2024-03-27T07:27:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.786+0000 7efd1d7fa640 1 -- 172.21.15.82:0/778941082 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd1001e930 con 0x55fb28a3cdc0 2024-03-27T07:27:28.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.787+0000 7efd30449740 1 -- 172.21.15.82:0/778941082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 msgr2=0x55fb28a62a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:28.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.787+0000 7efd30449740 1 --2- 172.21.15.82:0/778941082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 0x55fb28a62a10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efd1000bfc0 tx=0x7efd10004730 comp rx=0 tx=0).stop 2024-03-27T07:27:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.791+0000 7efd30449740 1 -- 172.21.15.82:0/778941082 shutdown_connections 2024-03-27T07:27:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.791+0000 7efd30449740 1 --2- 172.21.15.82:0/778941082 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 0x55fb28a6ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.791+0000 7efd30449740 1 --2- 172.21.15.82:0/778941082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3cdc0 0x55fb28a62a10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.791+0000 7efd30449740 1 --2- 172.21.15.82:0/778941082 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3c4a0 0x55fb28a53aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.791+0000 7efd30449740 1 -- 172.21.15.82:0/778941082 >> 172.21.15.82:0/778941082 conn(0x55fb28a36ee0 msgr2=0x55fb28a53390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:28.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.791+0000 7efd30449740 1 -- 172.21.15.82:0/778941082 shutdown_connections 2024-03-27T07:27:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.791+0000 7efd30449740 1 -- 172.21.15.82:0/778941082 wait complete. 2024-03-27T07:27:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.791+0000 7efd30449740 1 -- start start 2024-03-27T07:27:28.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.792+0000 7efd30449740 1 Processor -- start 2024-03-27T07:27:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.792+0000 7efd30449740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3c4a0 0x55fb28a57ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.792+0000 7efd30449740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3cdc0 0x55fb28a58220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.792+0000 7efd30449740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 0x55fb28a5d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.792+0000 7efd30449740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd0800cdc0 con 0x55fb28a3cdc0 2024-03-27T07:27:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.792+0000 7efd30449740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7efd0800e230 con 0x55fb28a56cc0 2024-03-27T07:27:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.792+0000 7efd30449740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7efd0800d490 con 0x55fb28a3c4a0 2024-03-27T07:27:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.792+0000 7efd30449740 10 client.0 _ll_register_callbacks cb 0x7efd20009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:28.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.793+0000 7efd277fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 0x55fb28a5d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:28.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.793+0000 7efd277fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 0x55fb28a5d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:57770/0 (socket says 172.21.15.82:57770) 2024-03-27T07:27:28.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.793+0000 7efd277fe640 1 -- 172.21.15.82:0/1411075619 learned_addr learned my addr 172.21.15.82:0/1411075619 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:28.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.794+0000 7efd277fe640 1 -- 172.21.15.82:0/1411075619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3c4a0 msgr2=0x55fb28a57ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:27:28.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.794+0000 7efd277fe640 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3c4a0 0x55fb28a57ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.794+0000 7efd277fe640 1 -- 172.21.15.82:0/1411075619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3cdc0 msgr2=0x55fb28a58220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.794+0000 7efd277fe640 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3cdc0 0x55fb28a58220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.794+0000 7efd277fe640 1 -- 172.21.15.82:0/1411075619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb28a58ad0 con 0x55fb28a56cc0 2024-03-27T07:27:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.796+0000 7efd277fe640 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 0x55fb28a5d3a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd20023030 tx=0x7efd20009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f95159beb2748016 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:28.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.796+0000 7efd0effd640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:27:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.797+0000 7efd0effd640 1 -- 172.21.15.82:0/1411075619 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20025070 con 0x55fb28a56cc0 2024-03-27T07:27:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.797+0000 7efd0effd640 1 -- 172.21.15.82:0/1411075619 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7efd20021920 con 0x55fb28a56cc0 2024-03-27T07:27:28.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.798+0000 7efd30449740 1 -- 172.21.15.82:0/1411075619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd1001e930 con 0x55fb28a56cc0 2024-03-27T07:27:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.798+0000 7efd0effd640 1 -- 172.21.15.82:0/1411075619 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efd2001a030 con 0x55fb28a56cc0 2024-03-27T07:27:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.799+0000 7efd30449740 10 client.26294 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:28.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.799+0000 7efd30449740 1 -- 172.21.15.82:0/1411075619 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fb28acd9b0 con 0x55fb28a56cc0 2024-03-27T07:27:28.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.801+0000 7efd0effd640 1 -- 172.21.15.82:0/1411075619 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd1001e930 con 0x55fb28a56cc0 2024-03-27T07:27:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.802+0000 7efd0effd640 1 -- 172.21.15.82:0/1411075619 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7efd20028040 con 0x55fb28a56cc0 2024-03-27T07:27:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.802+0000 7efd30449740 10 client.26294 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.802+0000 7efd30449740 10 client.26294 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:27:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.802+0000 7efd30449740 20 client.26294 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.802+0000 7efd30449740 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55fb28ace0a0 0x55fb28ad04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.802+0000 7efd30449740 4 client.26294 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:27:28.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.802+0000 7efd30449740 1 -- 172.21.15.82:0/1411075619 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb289a7fa0 con 0x55fb28ace0a0 2024-03-27T07:27:28.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.804+0000 7efd26ffd640 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55fb28ace0a0 0x55fb28ad04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:28.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.809+0000 7efd26ffd640 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55fb28ace0a0 0x55fb28ad04c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=81a4b59fc28f6f21 server_cookie=940ee02769036555 in_seq=0 out_seq=0 2024-03-27T07:27:28.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.809+0000 7efd0effd640 10 client.26294 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:27:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.812+0000 7efd0effd640 1 -- 172.21.15.82:0/1411075619 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb289a7fa0 con 0x55fb28ace0a0 2024-03-27T07:27:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.812+0000 7efd0effd640 10 client.26294 handle_command_reply: tid=0 2024-03-27T07:27:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.812+0000 7efd30449740 1 client.26294 shutdown 2024-03-27T07:27:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.813+0000 7efd30449740 1 -- 172.21.15.82:0/1411075619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 msgr2=0x55fb28a5d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.813+0000 7efd30449740 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 0x55fb28a5d3a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd20023030 tx=0x7efd20009680 comp rx=0 tx=0).stop 2024-03-27T07:27:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.814+0000 7efd30449740 1 -- 172.21.15.82:0/1411075619 shutdown_connections 2024-03-27T07:27:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.814+0000 7efd30449740 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55fb28ace0a0 0x55fb28ad04c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.814+0000 7efd30449740 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb28a3cdc0 0x55fb28a58220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.814+0000 7efd30449740 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb28a56cc0 0x55fb28a5d3a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.814+0000 7efd30449740 1 --2- 172.21.15.82:0/1411075619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb28a3c4a0 0x55fb28a57ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.814+0000 7efd30449740 1 -- 172.21.15.82:0/1411075619 >> 172.21.15.82:0/1411075619 conn(0x55fb28a36ee0 msgr2=0x55fb28a35770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:28.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.814+0000 7efd0effd640 0 client.26294 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:27:28.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.814+0000 7efd30449740 1 -- 172.21.15.82:0/1411075619 shutdown_connections 2024-03-27T07:27:28.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.815+0000 7efd30449740 1 -- 172.21.15.82:0/1411075619 wait complete. 2024-03-27T07:27:28.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.815+0000 7efd30449740 20 client.26294 trim_cache size 0 max 16384 2024-03-27T07:27:28.818 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:27:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.816+0000 7efd2d85c640 1 -- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efd140a3990 msgr2=0x7efd140a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.816+0000 7efd2d85c640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efd140a3990 0x7efd140a5e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efd100058c0 tx=0x7efd10005850 comp rx=0 tx=0).stop 2024-03-27T07:27:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.817+0000 7efd2d85c640 1 -- 172.21.15.82:0/2956467501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd28108350 msgr2=0x7efd281a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.817+0000 7efd2d85c640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd28108350 0x7efd281a4680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efd18009460 tx=0x7efd18034970 comp rx=0 tx=0).stop 2024-03-27T07:27:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.817+0000 7efd2d85c640 1 -- 172.21.15.82:0/2956467501 shutdown_connections 2024-03-27T07:27:28.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.817+0000 7efd2d85c640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7efd140a3990 0x7efd140a5e50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.817+0000 7efd2d85c640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd2810d420 0x7efd281a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.817+0000 7efd2d85c640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd2819e840 0x7efd2819ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.817+0000 7efd2d85c640 1 --2- 172.21.15.82:0/2956467501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7efd28108350 0x7efd281a4680 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.817+0000 7efd2d85c640 1 -- 172.21.15.82:0/2956467501 >> 172.21.15.82:0/2956467501 conn(0x7efd28076060 msgr2=0x7efd28077440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.817+0000 7efd2d85c640 1 -- 172.21.15.82:0/2956467501 shutdown_connections 2024-03-27T07:27:28.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:28.817+0000 7efd2d85c640 1 -- 172.21.15.82:0/2956467501 wait complete. 2024-03-27T07:27:28.838 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T07:27:29.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.022+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/2203904878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8107ba0 msgr2=0x7fb3e8107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.022+0000 7fb3ee6c9640 1 --2- 172.21.15.82:0/2203904878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8107ba0 0x7fb3e8107f80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009890 tx=0x7fb3dc02bb90 comp rx=0 tx=0).stop 2024-03-27T07:27:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.023+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/2203904878 shutdown_connections 2024-03-27T07:27:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.023+0000 7fb3ee6c9640 1 --2- 172.21.15.82:0/2203904878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e806a890 0x7fb3e810e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.023+0000 7fb3ee6c9640 1 --2- 172.21.15.82:0/2203904878 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3e8069ed0 0x7fb3e806a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.023+0000 7fb3ee6c9640 1 --2- 172.21.15.82:0/2203904878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8107ba0 0x7fb3e8107f80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.023+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/2203904878 >> 172.21.15.82:0/2203904878 conn(0x7fb3e8077ae0 msgr2=0x7fb3e8077ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:29.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.025+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/2203904878 shutdown_connections 2024-03-27T07:27:29.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.025+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/2203904878 wait complete. 2024-03-27T07:27:29.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.026+0000 7fb3ee6c9640 1 Processor -- start 2024-03-27T07:27:29.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.026+0000 7fb3ee6c9640 1 -- start start 2024-03-27T07:27:29.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.026+0000 7fb3ee6c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e8069ed0 0x7fb3e81160c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.026+0000 7fb3ee6c9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3e806a890 0x7fb3e8116600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.026+0000 7fb3ee6c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8107ba0 0x7fb3e8111220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.027+0000 7fb3ecc66640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8107ba0 0x7fb3e8111220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.027+0000 7fb3ecc66640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8107ba0 0x7fb3e8111220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36572/0 (socket says 172.21.15.82:36572) 2024-03-27T07:27:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.027+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1969639268 learned_addr learned my addr 172.21.15.82:0/1969639268 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.027+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e8069ed0 0x7fb3e81160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.026+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8102550 con 0x7fb3e8069ed0 2024-03-27T07:27:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.027+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81023d0 con 0x7fb3e806a890 2024-03-27T07:27:29.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.027+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e81026d0 con 0x7fb3e8107ba0 2024-03-27T07:27:29.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.028+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1969639268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3e806a890 msgr2=0x7fb3e8116600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.028+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3e806a890 0x7fb3e8116600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.028+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1969639268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e8069ed0 msgr2=0x7fb3e81160c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.028+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e8069ed0 0x7fb3e81160c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.028+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1969639268 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e8111ae0 con 0x7fb3e8107ba0 2024-03-27T07:27:29.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.028+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8107ba0 0x7fb3e8111220 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009fd0 tx=0x7fb3e000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:29.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.029+0000 7fb3e57fa640 1 -- 172.21.15.82:0/1969639268 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0004b20 con 0x7fb3e8107ba0 2024-03-27T07:27:29.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.029+0000 7fb3e57fa640 1 -- 172.21.15.82:0/1969639268 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3e0003e50 con 0x7fb3e8107ba0 2024-03-27T07:27:29.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.029+0000 7fb3e57fa640 1 -- 172.21.15.82:0/1969639268 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000b630 con 0x7fb3e8107ba0 2024-03-27T07:27:29.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.029+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e8111dd0 con 0x7fb3e8107ba0 2024-03-27T07:27:29.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.029+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e811bfb0 con 0x7fb3e8107ba0 2024-03-27T07:27:29.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.032+0000 7fb3e57fa640 1 -- 172.21.15.82:0/1969639268 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fb3e001d020 con 0x7fb3e8107ba0 2024-03-27T07:27:29.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.035+0000 7fb3e57fa640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb3d00a3900 0x7fb3d00a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.036+0000 7fb3e57fa640 1 -- 172.21.15.82:0/1969639268 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fb3e00d1090 con 0x7fb3e8107ba0 2024-03-27T07:27:29.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.036+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb3d00a3900 0x7fb3d00a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.037+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb3d00a3900 0x7fb3d00a5dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc000c00 tx=0x7fb3dc032340 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:29.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.039+0000 7fb3f138c740 1 Processor -- start 2024-03-27T07:27:29.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.039+0000 7fb3f138c740 1 -- start start 2024-03-27T07:27:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.040+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e61b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.040+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e620d0 0x563c32e6a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.040+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 0x563c32e6d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.040+0000 7fb3f138c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563c32dc5710 con 0x563c32e617b0 2024-03-27T07:27:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.040+0000 7fb3f138c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563c32d6daf0 con 0x563c32e6acb0 2024-03-27T07:27:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.040+0000 7fb3ecc66640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 0x563c32e6d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.040+0000 7fb3ecc66640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 0x563c32e6d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:57798/0 (socket says 172.21.15.82:57798) 2024-03-27T07:27:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.040+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1465087688 learned_addr learned my addr 172.21.15.82:0/1465087688 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:29.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.040+0000 7fb3f138c740 1 -- 172.21.15.82:0/1465087688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c32dc16c0 con 0x563c32e620d0 2024-03-27T07:27:29.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.042+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e61b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.042+0000 7fb3e77fe640 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e620d0 0x563c32e6a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.042+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1465087688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e620d0 msgr2=0x563c32e6a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.042+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e620d0 0x563c32e6a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.042+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1465087688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 msgr2=0x563c32e61b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.042+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e61b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.042+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1465087688 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c32ad93f0 con 0x563c32e6acb0 2024-03-27T07:27:29.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.042+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e61b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:27:29.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.042+0000 7fb3e77fe640 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e620d0 0x563c32e6a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:27:29.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.043+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 0x563c32e6d0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb3e009cf10 tx=0x7fb3e009d910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db59b5a0cfe35507 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:29.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.044+0000 7fb3ce7fc640 1 -- 172.21.15.82:0/1465087688 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e001a050 con 0x563c32e6acb0 2024-03-27T07:27:29.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.044+0000 7fb3ce7fc640 1 -- 172.21.15.82:0/1465087688 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3e00a5e80 con 0x563c32e6acb0 2024-03-27T07:27:29.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.044+0000 7fb3ce7fc640 1 -- 172.21.15.82:0/1465087688 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0099880 con 0x563c32e6acb0 2024-03-27T07:27:29.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.045+0000 7fb3f138c740 1 -- 172.21.15.82:0/1465087688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 msgr2=0x563c32e6d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.045+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 0x563c32e6d0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb3e009cf10 tx=0x7fb3e009d910 comp rx=0 tx=0).stop 2024-03-27T07:27:29.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.045+0000 7fb3f138c740 1 -- 172.21.15.82:0/1465087688 shutdown_connections 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.045+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 0x563c32e6d0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.045+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e620d0 0x563c32e6a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.045+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1465087688 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e61b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.045+0000 7fb3f138c740 1 -- 172.21.15.82:0/1465087688 >> 172.21.15.82:0/1465087688 conn(0x563c32e5bee0 msgr2=0x563c32e5c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.045+0000 7fb3f138c740 1 -- 172.21.15.82:0/1465087688 shutdown_connections 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.046+0000 7fb3f138c740 1 -- 172.21.15.82:0/1465087688 wait complete. 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.047+0000 7fb3f138c740 1 -- start start 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.048+0000 7fb3f138c740 1 Processor -- start 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.048+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e67da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.048+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e620d0 0x563c32e682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.048+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 0x563c32e68820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.048+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e67da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e67da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48244/0 (socket says 172.21.15.82:48244) 2024-03-27T07:27:29.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e620d0 0x563c32e682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3e77fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e620d0 0x563c32e682e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:57802/0 (socket says 172.21.15.82:57802) 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3ecc66640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 0x563c32e68820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3ecc66640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 0x563c32e68820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36590/0 (socket says 172.21.15.82:36590) 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3e7fff640 1 -- 172.21.15.82:0/3725386820 learned_addr learned my addr 172.21.15.82:0/3725386820 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563c32e6daa0 con 0x563c32e617b0 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563c32d80eb0 con 0x563c32e620d0 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563c32e6dc20 con 0x563c32e6acb0 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3e7fff640 1 -- 172.21.15.82:0/3725386820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 msgr2=0x563c32e68820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 0x563c32e68820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3e7fff640 1 -- 172.21.15.82:0/3725386820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e620d0 msgr2=0x563c32e682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e620d0 0x563c32e682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.049+0000 7fb3e7fff640 1 -- 172.21.15.82:0/3725386820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c32ba37d0 con 0x563c32e617b0 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.050+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e67da0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc036000 tx=0x7fb3dc005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05f7c3a382f4f0d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:29.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.050+0000 7fb3c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:27:29.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.050+0000 7fb3f138c740 10 client.0 _ll_register_callbacks cb 0x563c32dbd6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:29.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.050+0000 7fb3c77fe640 1 -- 172.21.15.82:0/3725386820 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc039040 con 0x563c32e617b0 2024-03-27T07:27:29.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.050+0000 7fb3c77fe640 1 -- 172.21.15.82:0/3725386820 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fb3dc005250 con 0x563c32e617b0 2024-03-27T07:27:29.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.051+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3e00a5e80 con 0x563c32e617b0 2024-03-27T07:27:29.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.051+0000 7fb3c77fe640 1 -- 172.21.15.82:0/3725386820 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb3dc005450 con 0x563c32e617b0 2024-03-27T07:27:29.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.051+0000 7fb3f138c740 10 client.16479 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:29.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.051+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=26}) -- 0x563c32e799f0 con 0x563c32e617b0 2024-03-27T07:27:29.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.052+0000 7fb3c77fe640 1 -- 172.21.15.82:0/3725386820 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb3dc02c530 con 0x563c32e617b0 2024-03-27T07:27:29.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.052+0000 7fb3f138c740 10 client.16479 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:29.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.052+0000 7fb3f138c740 10 client.16479 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:27:29.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.052+0000 7fb3f138c740 20 client.16479 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:29.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.052+0000 7fb3f138c740 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x563c32e7ae60 0x563c32e7d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.052+0000 7fb3f138c740 4 client.16479 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:27:29.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.052+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb3e00a5e80 con 0x563c32e7ae60 2024-03-27T07:27:29.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.053+0000 7fb3e77fe640 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x563c32e7ae60 0x563c32e7d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.055+0000 7fb3e77fe640 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x563c32e7ae60 0x563c32e7d320 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7d6d220319f66f1 server_cookie=539c18e80bdf476c in_seq=0 out_seq=0 2024-03-27T07:27:29.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.055+0000 7fb3c77fe640 10 client.16479 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:27:29.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.059+0000 7fb3c77fe640 1 -- 172.21.15.82:0/3725386820 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7fb3e00a5e80 con 0x563c32e7ae60 2024-03-27T07:27:29.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.059+0000 7fb3c77fe640 10 client.16479 handle_command_reply: tid=0 2024-03-27T07:27:29.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.059+0000 7fb3f138c740 1 client.16479 shutdown 2024-03-27T07:27:29.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.060+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 msgr2=0x563c32e67da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.060+0000 7fb3f138c740 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e67da0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc036000 tx=0x7fb3dc005f90 comp rx=0 tx=0).stop 2024-03-27T07:27:29.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.060+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 shutdown_connections 2024-03-27T07:27:29.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.061+0000 7fb3f138c740 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x563c32e7ae60 0x563c32e7d320 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.061+0000 7fb3c77fe640 0 client.16479 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:27:29.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.061+0000 7fb3f138c740 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 0x563c32e68820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.061+0000 7fb3f138c740 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e620d0 0x563c32e682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.061+0000 7fb3f138c740 1 --2- 172.21.15.82:0/3725386820 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e617b0 0x563c32e67da0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.061+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 >> 172.21.15.82:0/3725386820 conn(0x563c32e5bee0 msgr2=0x563c32e5dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:29.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.062+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 shutdown_connections 2024-03-27T07:27:29.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.063+0000 7fb3f138c740 1 -- 172.21.15.82:0/3725386820 wait complete. 2024-03-27T07:27:29.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.063+0000 7fb3f138c740 20 client.16479 trim_cache size 0 max 16384 2024-03-27T07:27:29.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3f138c740 1 Processor -- start 2024-03-27T07:27:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3f138c740 1 -- start start 2024-03-27T07:27:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e617b0 0x563c32e6a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e620d0 0x563c32e5de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 0x563c32e68640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3f138c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d4010ee0 con 0x563c32e620d0 2024-03-27T07:27:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e617b0 0x563c32e6a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3f138c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d400e750 con 0x563c32e6acb0 2024-03-27T07:27:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3f138c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d400c5a0 con 0x563c32e617b0 2024-03-27T07:27:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e617b0 0x563c32e6a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36604/0 (socket says 172.21.15.82:36604) 2024-03-27T07:27:29.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.091+0000 7fb3e7fff640 1 -- 172.21.15.82:0/200039020 learned_addr learned my addr 172.21.15.82:0/200039020 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:29.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.092+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/200039020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 0x563c32e68640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.092+0000 7fb3e77fe640 1 --2- 172.21.15.82:0/200039020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e620d0 0x563c32e5de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.092+0000 7fb3e7fff640 1 -- 172.21.15.82:0/200039020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 msgr2=0x563c32e68640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.092+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/200039020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 0x563c32e68640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.092+0000 7fb3e7fff640 1 -- 172.21.15.82:0/200039020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e620d0 msgr2=0x563c32e5de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.092+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/200039020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e620d0 0x563c32e5de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.092+0000 7fb3e7fff640 1 -- 172.21.15.82:0/200039020 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c32e6d410 con 0x563c32e617b0 2024-03-27T07:27:29.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.092+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/200039020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e617b0 0x563c32e6a4d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc037040 tx=0x7fb3dc030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67050bc25c7b5dfe server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:29.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.093+0000 7fb3cdffb640 1 -- 172.21.15.82:0/200039020 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc063070 con 0x563c32e617b0 2024-03-27T07:27:29.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.093+0000 7fb3cdffb640 1 -- 172.21.15.82:0/200039020 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3dc050070 con 0x563c32e617b0 2024-03-27T07:27:29.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.093+0000 7fb3cdffb640 1 -- 172.21.15.82:0/200039020 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc039040 con 0x563c32e617b0 2024-03-27T07:27:29.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.094+0000 7fb3f138c740 1 -- 172.21.15.82:0/200039020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e617b0 msgr2=0x563c32e6a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.094+0000 7fb3f138c740 1 --2- 172.21.15.82:0/200039020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e617b0 0x563c32e6a4d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc037040 tx=0x7fb3dc030000 comp rx=0 tx=0).stop 2024-03-27T07:27:29.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.094+0000 7fb3f138c740 1 -- 172.21.15.82:0/200039020 shutdown_connections 2024-03-27T07:27:29.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.094+0000 7fb3f138c740 1 --2- 172.21.15.82:0/200039020 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e620d0 0x563c32e5de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.094+0000 7fb3f138c740 1 --2- 172.21.15.82:0/200039020 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e6acb0 0x563c32e68640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.094+0000 7fb3f138c740 1 --2- 172.21.15.82:0/200039020 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e617b0 0x563c32e6a4d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.094+0000 7fb3f138c740 1 -- 172.21.15.82:0/200039020 >> 172.21.15.82:0/200039020 conn(0x563c32e5bee0 msgr2=0x563c32e5b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:29.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.095+0000 7fb3f138c740 1 -- 172.21.15.82:0/200039020 shutdown_connections 2024-03-27T07:27:29.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.095+0000 7fb3f138c740 1 -- 172.21.15.82:0/200039020 wait complete. 2024-03-27T07:27:29.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.095+0000 7fb3f138c740 1 -- start start 2024-03-27T07:27:29.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.096+0000 7fb3f138c740 1 Processor -- start 2024-03-27T07:27:29.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.096+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e617b0 0x563c32e651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.096+0000 7fb3f138c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e620d0 0x563c32e65710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.097+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e617b0 0x563c32e651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.097+0000 7fb3e7fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e617b0 0x563c32e651d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:57820/0 (socket says 172.21.15.82:57820) 2024-03-27T07:27:29.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.097+0000 7fb3e7fff640 1 -- 172.21.15.82:0/1245979014 learned_addr learned my addr 172.21.15.82:0/1245979014 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:29.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.097+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 0x563c32eda2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.097+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d400cc10 con 0x563c32e620d0 2024-03-27T07:27:29.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.097+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 0x563c32eda2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.097+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d400e080 con 0x563c32e617b0 2024-03-27T07:27:29.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.097+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d400d2e0 con 0x563c32e6acb0 2024-03-27T07:27:29.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.097+0000 7fb3f138c740 10 client.0 _ll_register_callbacks cb 0x7fb3dc042040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:29.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.098+0000 7fb3e77fe640 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e620d0 0x563c32e65710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.098+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1245979014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e617b0 msgr2=0x563c32e651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.098+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e617b0 0x563c32e651d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.098+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1245979014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e620d0 msgr2=0x563c32e65710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.098+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e620d0 0x563c32e65710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.098+0000 7fb3ecc66640 1 -- 172.21.15.82:0/1245979014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c32eda8e0 con 0x563c32e6acb0 2024-03-27T07:27:29.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.099+0000 7fb3ecc66640 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 0x563c32eda2a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3e009d1a0 tx=0x7fb3e0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f806ac7f9c36ebe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:29.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.099+0000 7fb3c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:27:29.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.099+0000 7fb3c77fe640 1 -- 172.21.15.82:0/1245979014 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e00a8070 con 0x563c32e6acb0 2024-03-27T07:27:29.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.099+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3dc050070 con 0x563c32e6acb0 2024-03-27T07:27:29.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.099+0000 7fb3c77fe640 1 -- 172.21.15.82:0/1245979014 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fb3e009b510 con 0x563c32e6acb0 2024-03-27T07:27:29.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.100+0000 7fb3c77fe640 1 -- 172.21.15.82:0/1245979014 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb3e00a5e80 con 0x563c32e6acb0 2024-03-27T07:27:29.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.102+0000 7fb3f138c740 10 client.26314 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:29.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.102+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563c32ee1c50 con 0x563c32e6acb0 2024-03-27T07:27:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.104+0000 7fb3c77fe640 1 -- 172.21.15.82:0/1245979014 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3dc050070 con 0x563c32e6acb0 2024-03-27T07:27:29.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.104+0000 7fb3c77fe640 1 -- 172.21.15.82:0/1245979014 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb3e000b040 con 0x563c32e6acb0 2024-03-27T07:27:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.105+0000 7fb3f138c740 10 client.26314 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.105+0000 7fb3f138c740 10 client.26314 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:27:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.105+0000 7fb3f138c740 20 client.26314 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.105+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x563c32e7ae60 0x563c32ee3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.105+0000 7fb3f138c740 4 client.26314 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:27:29.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.105+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c32dd2c50 con 0x563c32e7ae60 2024-03-27T07:27:29.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.106+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x563c32e7ae60 0x563c32ee3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.109+0000 7fb3e7fff640 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x563c32e7ae60 0x563c32ee3ef0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=632025661a6faf68 server_cookie=4e81631a671e8c49 in_seq=0 out_seq=0 2024-03-27T07:27:29.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.109+0000 7fb3c77fe640 10 client.26314 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:27:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.115+0000 7fb3c77fe640 1 -- 172.21.15.82:0/1245979014 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c32dd2c50 con 0x563c32e7ae60 2024-03-27T07:27:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.115+0000 7fb3c77fe640 10 client.26314 handle_command_reply: tid=0 2024-03-27T07:27:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.115+0000 7fb3f138c740 1 client.26314 shutdown 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.117+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 msgr2=0x563c32eda2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.117+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 0x563c32eda2a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb3e009d1a0 tx=0x7fb3e0009780 comp rx=0 tx=0).stop 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.118+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 shutdown_connections 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.118+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x563c32e7ae60 0x563c32ee3ef0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.118+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c32e620d0 0x563c32e65710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.118+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x563c32e6acb0 0x563c32eda2a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.118+0000 7fb3f138c740 1 --2- 172.21.15.82:0/1245979014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x563c32e617b0 0x563c32e651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.118+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 >> 172.21.15.82:0/1245979014 conn(0x563c32e5bee0 msgr2=0x563c32e69450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.118+0000 7fb3c77fe640 0 client.26314 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.119+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 shutdown_connections 2024-03-27T07:27:29.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.119+0000 7fb3f138c740 1 -- 172.21.15.82:0/1245979014 wait complete. 2024-03-27T07:27:29.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.119+0000 7fb3f138c740 20 client.26314 trim_cache size 0 max 16384 2024-03-27T07:27:29.122 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:27:29.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.121+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb3d00a3900 msgr2=0x7fb3d00a5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.122+0000 7fb3ee6c9640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb3d00a3900 0x7fb3d00a5dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc000c00 tx=0x7fb3dc032340 comp rx=0 tx=0).stop 2024-03-27T07:27:29.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.122+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8107ba0 msgr2=0x7fb3e8111220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.122+0000 7fb3ee6c9640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8107ba0 0x7fb3e8111220 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009fd0 tx=0x7fb3e000c800 comp rx=0 tx=0).stop 2024-03-27T07:27:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.123+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 shutdown_connections 2024-03-27T07:27:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.123+0000 7fb3ee6c9640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb3d00a3900 0x7fb3d00a5dc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.123+0000 7fb3ee6c9640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8107ba0 0x7fb3e8111220 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.123+0000 7fb3ee6c9640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb3e806a890 0x7fb3e8116600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.123+0000 7fb3ee6c9640 1 --2- 172.21.15.82:0/1969639268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb3e8069ed0 0x7fb3e81160c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.123+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 >> 172.21.15.82:0/1969639268 conn(0x7fb3e8077ae0 msgr2=0x7fb3e80ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:29.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.123+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 shutdown_connections 2024-03-27T07:27:29.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.123+0000 7fb3ee6c9640 1 -- 172.21.15.82:0/1969639268 wait complete. 2024-03-27T07:27:29.147 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T07:27:29.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.331+0000 7f33beffd640 1 -- 172.21.15.82:0/2275831937 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b002cc80 con 0x7f33c010e370 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.331+0000 7f33c6807640 1 -- 172.21.15.82:0/2275831937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c010e370 msgr2=0x7f33c010e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.331+0000 7f33c6807640 1 --2- 172.21.15.82:0/2275831937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c010e370 0x7f33c010e750 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009900 tx=0x7f33b002bc30 comp rx=0 tx=0).stop 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.331+0000 7f33c6807640 1 -- 172.21.15.82:0/2275831937 shutdown_connections 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.331+0000 7f33c6807640 1 --2- 172.21.15.82:0/2275831937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33c0109090 0x7f33c0109510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.331+0000 7f33c6807640 1 --2- 172.21.15.82:0/2275831937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c010ec90 0x7f33c0108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.331+0000 7f33c6807640 1 --2- 172.21.15.82:0/2275831937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c010e370 0x7f33c010e750 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.331+0000 7f33c6807640 1 -- 172.21.15.82:0/2275831937 >> 172.21.15.82:0/2275831937 conn(0x7f33c006d090 msgr2=0x7f33c006d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.331+0000 7f33c6807640 1 -- 172.21.15.82:0/2275831937 shutdown_connections 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.331+0000 7f33c6807640 1 -- 172.21.15.82:0/2275831937 wait complete. 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.332+0000 7f33c6807640 1 Processor -- start 2024-03-27T07:27:29.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.332+0000 7f33c6807640 1 -- start start 2024-03-27T07:27:29.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33c6807640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c0109090 0x7f33c011e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33c6807640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33c010e370 0x7f33c011eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33c6807640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c010ec90 0x7f33c01246a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33c6807640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01124c0 con 0x7f33c010ec90 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33c6807640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f33c0112340 con 0x7f33c010e370 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33c6807640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01186c0 con 0x7f33c0109090 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33bffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c0109090 0x7f33c011e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33bffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c0109090 0x7f33c011e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36618/0 (socket says 172.21.15.82:36618) 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33bffff640 1 -- 172.21.15.82:0/3478955144 learned_addr learned my addr 172.21.15.82:0/3478955144 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33c4da4640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c010ec90 0x7f33c01246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33c010e370 0x7f33c011eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.333+0000 7f33bffff640 1 -- 172.21.15.82:0/3478955144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33c010e370 msgr2=0x7f33c011eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.334+0000 7f33bffff640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33c010e370 0x7f33c011eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.334+0000 7f33bffff640 1 -- 172.21.15.82:0/3478955144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c010ec90 msgr2=0x7f33c01246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.334+0000 7f33bffff640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c010ec90 0x7f33c01246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.334+0000 7f33bffff640 1 -- 172.21.15.82:0/3478955144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c0124f60 con 0x7f33c0109090 2024-03-27T07:27:29.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.334+0000 7f33bffff640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c0109090 0x7f33c011e990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33b002c240 tx=0x7f33b00042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.335+0000 7f33bd7fa640 1 -- 172.21.15.82:0/3478955144 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0043020 con 0x7f33c0109090 2024-03-27T07:27:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.335+0000 7f33bd7fa640 1 -- 172.21.15.82:0/3478955144 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33b00054e0 con 0x7f33c0109090 2024-03-27T07:27:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.335+0000 7f33bd7fa640 1 -- 172.21.15.82:0/3478955144 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0003b50 con 0x7f33c0109090 2024-03-27T07:27:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.335+0000 7f33c6807640 1 -- 172.21.15.82:0/3478955144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c0119b40 con 0x7f33c0109090 2024-03-27T07:27:29.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.335+0000 7f33c6807640 1 -- 172.21.15.82:0/3478955144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c011a040 con 0x7f33c0109090 2024-03-27T07:27:29.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.338+0000 7f33c93f3740 1 Processor -- start 2024-03-27T07:27:29.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.338+0000 7f33c93f3740 1 -- start start 2024-03-27T07:27:29.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33bd7fa640 1 -- 172.21.15.82:0/3478955144 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f33b0046020 con 0x7f33c0109090 2024-03-27T07:27:29.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b657b0 0x557bd6b65b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b660d0 0x557bd6b6e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b710a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33c4da4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b657b0 0x557bd6b65b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33c4da4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b657b0 0x557bd6b65b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48276/0 (socket says 172.21.15.82:48276) 2024-03-27T07:27:29.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33c4da4640 1 -- 172.21.15.82:0/1207373428 learned_addr learned my addr 172.21.15.82:0/1207373428 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:29.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33bffff640 1 --2- 172.21.15.82:0/1207373428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b660d0 0x557bd6b6e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33c93f3740 1 -- 172.21.15.82:0/1207373428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557bd6ac9710 con 0x557bd6b657b0 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33c93f3740 1 -- 172.21.15.82:0/1207373428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x557bd6a71af0 con 0x557bd6b6ecb0 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33c93f3740 1 -- 172.21.15.82:0/1207373428 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557bd6ac56c0 con 0x557bd6b660d0 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.339+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/1207373428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33bf7fe640 1 -- 172.21.15.82:0/1207373428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b660d0 msgr2=0x557bd6b6e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/1207373428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b660d0 0x557bd6b6e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33bd7fa640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33a80a38d0 0x7f33a80a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33bf7fe640 1 -- 172.21.15.82:0/1207373428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b657b0 msgr2=0x557bd6b65b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/1207373428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b657b0 0x557bd6b65b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33bf7fe640 1 -- 172.21.15.82:0/1207373428 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd67dd3f0 con 0x557bd6b6ecb0 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33bd7fa640 1 -- 172.21.15.82:0/3478955144 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f33b00f1ed0 con 0x7f33c0109090 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/1207373428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b710a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f33c011b2f0 tx=0x7f33b40103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a0b5019314344c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33c4da4640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33a80a38d0 0x7f33a80a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33a67fc640 1 -- 172.21.15.82:0/1207373428 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4010e90 con 0x557bd6b6ecb0 2024-03-27T07:27:29.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33a67fc640 1 -- 172.21.15.82:0/1207373428 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33b40035f0 con 0x557bd6b6ecb0 2024-03-27T07:27:29.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.340+0000 7f33a67fc640 1 -- 172.21.15.82:0/1207373428 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b40116a0 con 0x557bd6b6ecb0 2024-03-27T07:27:29.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.341+0000 7f33c93f3740 1 -- 172.21.15.82:0/1207373428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 msgr2=0x557bd6b710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:29.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.341+0000 7f33c4da4640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33a80a38d0 0x7f33a80a5d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f33b8003bb0 tx=0x7f33b8004a40 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:29.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.341+0000 7f33c93f3740 1 --2- 172.21.15.82:0/1207373428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b710a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f33c011b2f0 tx=0x7f33b40103d0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.341+0000 7f33c93f3740 1 -- 172.21.15.82:0/1207373428 shutdown_connections 2024-03-27T07:27:29.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.341+0000 7f33c93f3740 1 --2- 172.21.15.82:0/1207373428 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b710a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.341+0000 7f33c93f3740 1 --2- 172.21.15.82:0/1207373428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b660d0 0x557bd6b6e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.341+0000 7f33c93f3740 1 --2- 172.21.15.82:0/1207373428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b657b0 0x557bd6b65b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.341+0000 7f33c93f3740 1 -- 172.21.15.82:0/1207373428 >> 172.21.15.82:0/1207373428 conn(0x557bd6b5fee0 msgr2=0x557bd6b602c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.342+0000 7f33c93f3740 1 -- 172.21.15.82:0/1207373428 shutdown_connections 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.342+0000 7f33c93f3740 1 -- 172.21.15.82:0/1207373428 wait complete. 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.342+0000 7f33c93f3740 1 -- start start 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33c93f3740 1 Processor -- start 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 0x557bd6b6bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b6c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b6c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33c93f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557bd6b71aa0 con 0x557bd6b660d0 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33c93f3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x557bd6a84eb0 con 0x557bd6b6ecb0 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33c93f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557bd6b71c20 con 0x557bd6b657b0 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33c93f3740 10 client.0 _ll_register_callbacks cb 0x557bd6ac16a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:29.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33bffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 0x557bd6b6bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33bffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 0x557bd6b6bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36636/0 (socket says 172.21.15.82:36636) 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33bffff640 1 -- 172.21.15.82:0/586722282 learned_addr learned my addr 172.21.15.82:0/586722282 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b6c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.343+0000 7f33c4da4640 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b6c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f33bffff640 1 -- 172.21.15.82:0/586722282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 msgr2=0x557bd6b6c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f33bffff640 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b6c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f33bffff640 1 -- 172.21.15.82:0/586722282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 msgr2=0x557bd6b6c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f33bffff640 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b6c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f33bffff640 1 -- 172.21.15.82:0/586722282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd68a77d0 con 0x557bd6b657b0 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f33bffff640 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 0x557bd6b6bd50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33b0000c00 tx=0x7f33b0009620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=708e1ac040c5f8d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f339f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f339f7fe640 1 -- 172.21.15.82:0/586722282 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b00bdb20 con 0x557bd6b657b0 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f339f7fe640 1 -- 172.21.15.82:0/586722282 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f33b00ba830 con 0x557bd6b657b0 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f33c93f3740 1 -- 172.21.15.82:0/586722282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33b40035f0 con 0x557bd6b657b0 2024-03-27T07:27:29.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.344+0000 7f339f7fe640 1 -- 172.21.15.82:0/586722282 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f33b00044e0 con 0x557bd6b657b0 2024-03-27T07:27:29.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f33c93f3740 10 client.26326 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:29.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f33c93f3740 1 -- 172.21.15.82:0/586722282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557bd6b71b50 con 0x557bd6b657b0 2024-03-27T07:27:29.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f339f7fe640 1 -- 172.21.15.82:0/586722282 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33b40035f0 con 0x557bd6b657b0 2024-03-27T07:27:29.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f339f7fe640 1 -- 172.21.15.82:0/586722282 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f33b00c2120 con 0x557bd6b657b0 2024-03-27T07:27:29.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f33c93f3740 10 client.26326 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:29.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f33c93f3740 10 client.26326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:29.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f33c93f3740 20 client.26326 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:29.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f33c93f3740 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557bd6b7f380 0x557bd6b817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:29.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f33c93f3740 4 client.26326 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:27:29.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f33c93f3740 1 -- 172.21.15.82:0/586722282 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557bd6ad6c50 con 0x557bd6b7f380 2024-03-27T07:27:29.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.345+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557bd6b7f380 0x557bd6b817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:29.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.346+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557bd6b7f380 0x557bd6b817c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1628e993575a5785 server_cookie=4a8943a9c950ed7 in_seq=0 out_seq=0 2024-03-27T07:27:29.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:29.346+0000 7f339f7fe640 10 client.26326 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:29.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:29 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3879191367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:27:29.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:29 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3879191367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:27:29.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:29 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3879191367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:27:30.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:30 smithi082 ceph-mon[32178]: pgmap v120: 97 pgs: 97 active+clean; 640 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2024-03-27T07:27:30.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:30 smithi149 ceph-mon[36065]: pgmap v120: 97 pgs: 97 active+clean; 640 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2024-03-27T07:27:30.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:30 smithi153 ceph-mon[36179]: pgmap v120: 97 pgs: 97 active+clean; 640 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.5 MiB/s wr, 378 op/s 2024-03-27T07:27:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f901cff9640 1 -- 172.21.15.82:0/4150202014 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ea72b06e0 con 0x558ea73c59d0 2024-03-27T07:27:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f901cff9640 10 client.16452 handle_command_reply: tid=0 2024-03-27T07:27:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 client.16452 shutdown 2024-03-27T07:27:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 -- 172.21.15.82:0/4150202014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7345bb0 msgr2=0x558ea7356680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7345bb0 0x558ea7356680 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9030003850 tx=0x7f9030004480 comp rx=0 tx=0).stop 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 -- 172.21.15.82:0/4150202014 shutdown_connections 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x558ea7367680 0x558ea7348450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558ea734c5c0 0x558ea7347f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x558ea73c59d0 0x558ea73c7df0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 --2- 172.21.15.82:0/4150202014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ea7345bb0 0x558ea7356680 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f901cff9640 0 client.16452 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 -- 172.21.15.82:0/4150202014 >> 172.21.15.82:0/4150202014 conn(0x558ea733fbb0 msgr2=0x558ea734ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 -- 172.21.15.82:0/4150202014 shutdown_connections 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 1 -- 172.21.15.82:0/4150202014 wait complete. 2024-03-27T07:27:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.183+0000 7f903e5b4740 20 client.16452 trim_cache size 0 max 16384 2024-03-27T07:27:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:27:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:27:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:27:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 -- 172.21.15.82:0/3588694322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f90200a37e0 msgr2=0x7f90200a5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f90200a37e0 0x7f90200a5ca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9030005ab0 tx=0x7f9030005fd0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 -- 172.21.15.82:0/3588694322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c0b3910 msgr2=0x7f902c0b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c0b3910 0x7f902c0b3dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f902400d6b0 tx=0x7f902400db70 comp rx=0 tx=0).stop 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 -- 172.21.15.82:0/3588694322 shutdown_connections 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f90200a37e0 0x7f90200a5ca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f902c0b3910 0x7f902c0b3dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f902c0b7a70 0x7f902c0b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 --2- 172.21.15.82:0/3588694322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f902c0a5700 0x7f902c0b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 -- 172.21.15.82:0/3588694322 >> 172.21.15.82:0/3588694322 conn(0x7f902c01a640 msgr2=0x7f902c0b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 -- 172.21.15.82:0/3588694322 shutdown_connections 2024-03-27T07:27:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:31.184+0000 7f903a68b640 1 -- 172.21.15.82:0/3588694322 wait complete. 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f339f7fe640 1 -- 172.21.15.82:0/586722282 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557bd6ad6c50 con 0x557bd6b7f380 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f339f7fe640 10 client.26326 handle_command_reply: tid=0 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 client.26326 shutdown 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 -- 172.21.15.82:0/586722282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 msgr2=0x557bd6b6bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 0x557bd6b6bd50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33b0000c00 tx=0x7f33b0009620 comp rx=0 tx=0).stop 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 -- 172.21.15.82:0/586722282 shutdown_connections 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557bd6b7f380 0x557bd6b817c0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b6c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b6c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 --2- 172.21.15.82:0/586722282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 0x557bd6b6bd50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f339f7fe640 0 client.26326 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 -- 172.21.15.82:0/586722282 >> 172.21.15.82:0/586722282 conn(0x557bd6b5fee0 msgr2=0x557bd6b61c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:31.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 -- 172.21.15.82:0/586722282 shutdown_connections 2024-03-27T07:27:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 1 -- 172.21.15.82:0/586722282 wait complete. 2024-03-27T07:27:31.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.185+0000 7f33c93f3740 20 client.26326 trim_cache size 0 max 16384 2024-03-27T07:27:31.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.199+0000 7f33c93f3740 1 Processor -- start 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.199+0000 7f33c93f3740 1 -- start start 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.199+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 0x557bd6b7a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b870d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b6c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33c93f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c76b0 con 0x557bd6b660d0 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33c93f3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c4f20 con 0x557bd6b6ecb0 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33c93f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c2d70 con 0x557bd6b657b0 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33bf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33bffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 0x557bd6b7a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33bf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b870d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48296/0 (socket says 172.21.15.82:48296) 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33c4da4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b6c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33bf7fe640 1 -- 172.21.15.82:0/2670974078 learned_addr learned my addr 172.21.15.82:0/2670974078 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:31.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33bf7fe640 1 -- 172.21.15.82:0/2670974078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 msgr2=0x557bd6b7a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/2670974078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 0x557bd6b7a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33bf7fe640 1 -- 172.21.15.82:0/2670974078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 msgr2=0x557bd6b6c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/2670974078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b6c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33bf7fe640 1 -- 172.21.15.82:0/2670974078 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bd6b6ad00 con 0x557bd6b660d0 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/2670974078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b870d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x557bd6b61070 tx=0x7f33b4010fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5530a68105458245 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33a5ffb640 1 -- 172.21.15.82:0/2670974078 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4030070 con 0x557bd6b660d0 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33a5ffb640 1 -- 172.21.15.82:0/2670974078 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33b4005520 con 0x557bd6b660d0 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.200+0000 7f33a5ffb640 1 -- 172.21.15.82:0/2670974078 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b40035f0 con 0x557bd6b660d0 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.201+0000 7f33c93f3740 1 -- 172.21.15.82:0/2670974078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 msgr2=0x557bd6b870d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.201+0000 7f33c93f3740 1 --2- 172.21.15.82:0/2670974078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b870d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x557bd6b61070 tx=0x7f33b4010fc0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.201+0000 7f33c93f3740 1 -- 172.21.15.82:0/2670974078 shutdown_connections 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.201+0000 7f33c93f3740 1 --2- 172.21.15.82:0/2670974078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b870d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.201+0000 7f33c93f3740 1 --2- 172.21.15.82:0/2670974078 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b6ecb0 0x557bd6b6c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.201+0000 7f33c93f3740 1 --2- 172.21.15.82:0/2670974078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b657b0 0x557bd6b7a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.201+0000 7f33c93f3740 1 -- 172.21.15.82:0/2670974078 >> 172.21.15.82:0/2670974078 conn(0x557bd6b5fee0 msgr2=0x557bd6b5f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.201+0000 7f33c93f3740 1 -- 172.21.15.82:0/2670974078 shutdown_connections 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.201+0000 7f33c93f3740 1 -- 172.21.15.82:0/2670974078 wait complete. 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.201+0000 7f33c93f3740 1 -- start start 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33c93f3740 1 Processor -- start 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b657b0 0x557bd6b72a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b72fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33c93f3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b6ecb0 0x557bd6b734e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33c93f3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c33e0 con 0x557bd6b660d0 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33c93f3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c4850 con 0x557bd6b657b0 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33c93f3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01c3ab0 con 0x557bd6b6ecb0 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33c93f3740 10 client.0 _ll_register_callbacks cb 0x7f33b0009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b72fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:31.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b657b0 0x557bd6b72a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bf7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b72fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48298/0 (socket says 172.21.15.82:48298) 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bf7fe640 1 -- 172.21.15.82:0/191208988 learned_addr learned my addr 172.21.15.82:0/191208988 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33c4da4640 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b6ecb0 0x557bd6b734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bf7fe640 1 -- 172.21.15.82:0/191208988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b6ecb0 msgr2=0x557bd6b734e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b6ecb0 0x557bd6b734e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bf7fe640 1 -- 172.21.15.82:0/191208988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b657b0 msgr2=0x557bd6b72a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b657b0 0x557bd6b72a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bf7fe640 1 -- 172.21.15.82:0/191208988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bd6be49a0 con 0x557bd6b660d0 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bffff640 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b657b0 0x557bd6b72a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f33bf7fe640 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b72fa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f33b402a530 tx=0x7f33b400b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8986d8a441d8e404 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.202+0000 7f339f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f339f7fe640 1 -- 172.21.15.82:0/191208988 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4030070 con 0x557bd6b660d0 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f339f7fe640 1 -- 172.21.15.82:0/191208988 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f33b40050b0 con 0x557bd6b660d0 2024-03-27T07:27:31.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f33c93f3740 1 -- 172.21.15.82:0/191208988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33b4005520 con 0x557bd6b660d0 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f339f7fe640 1 -- 172.21.15.82:0/191208988 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f33b402a7d0 con 0x557bd6b660d0 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f33c93f3740 10 client.16503 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f33c93f3740 1 -- 172.21.15.82:0/191208988 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557bd6be5ca0 con 0x557bd6b660d0 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f339f7fe640 1 -- 172.21.15.82:0/191208988 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33b4005520 con 0x557bd6b660d0 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f339f7fe640 1 -- 172.21.15.82:0/191208988 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f33b4011440 con 0x557bd6b660d0 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f33c93f3740 10 client.16503 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f33c93f3740 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f33c93f3740 20 client.16503 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f33c93f3740 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557bd6be6280 0x557bd6be86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f33c93f3740 4 client.16503 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f33c93f3740 1 -- 172.21.15.82:0/191208988 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557bd6ad0fa0 con 0x557bd6be6280 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.203+0000 7f33bffff640 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557bd6be6280 0x557bd6be86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33bffff640 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557bd6be6280 0x557bd6be86a0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1a91f5405ee616b server_cookie=c177778f8eba54eb in_seq=0 out_seq=0 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f339f7fe640 10 client.16503 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:31.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f339f7fe640 1 -- 172.21.15.82:0/191208988 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557bd6ad0fa0 con 0x557bd6be6280 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f339f7fe640 10 client.16503 handle_command_reply: tid=0 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 client.16503 shutdown 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 -- 172.21.15.82:0/191208988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 msgr2=0x557bd6b72fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b72fa0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f33b402a530 tx=0x7f33b400b5e0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 -- 172.21.15.82:0/191208988 shutdown_connections 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557bd6be6280 0x557bd6be86a0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557bd6b660d0 0x557bd6b72fa0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557bd6b6ecb0 0x557bd6b734e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 --2- 172.21.15.82:0/191208988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557bd6b657b0 0x557bd6b72a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f339f7fe640 0 client.16503 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 -- 172.21.15.82:0/191208988 >> 172.21.15.82:0/191208988 conn(0x557bd6b5fee0 msgr2=0x557bd6b610a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 -- 172.21.15.82:0/191208988 shutdown_connections 2024-03-27T07:27:31.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 1 -- 172.21.15.82:0/191208988 wait complete. 2024-03-27T07:27:31.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.204+0000 7f33c93f3740 20 client.16503 trim_cache size 0 max 16384 2024-03-27T07:27:31.214 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 -- 172.21.15.82:0/3478955144 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33a80a38d0 msgr2=0x7f33a80a5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33a80a38d0 0x7f33a80a5d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f33b8003bb0 tx=0x7f33b8004a40 comp rx=0 tx=0).stop 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 -- 172.21.15.82:0/3478955144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c0109090 msgr2=0x7f33c011e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c0109090 0x7f33c011e990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33b002c240 tx=0x7f33b00042f0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 -- 172.21.15.82:0/3478955144 shutdown_connections 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33a80a38d0 0x7f33a80a5d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33c010ec90 0x7f33c01246a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33c010e370 0x7f33c011eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 --2- 172.21.15.82:0/3478955144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33c0109090 0x7f33c011e990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 -- 172.21.15.82:0/3478955144 >> 172.21.15.82:0/3478955144 conn(0x7f33c006d090 msgr2=0x7f33c010c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:31.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 -- 172.21.15.82:0/3478955144 shutdown_connections 2024-03-27T07:27:31.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:31.205+0000 7f33c6807640 1 -- 172.21.15.82:0/3478955144 wait complete. 2024-03-27T07:27:32.218 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T07:27:32.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:27:32.219 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T07:27:32.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 -- 172.21.15.82:0/1646653604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a01024a0 msgr2=0x7f16a010e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 --2- 172.21.15.82:0/1646653604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a01024a0 0x7f16a010e9b0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f1690009930 tx=0x7f169002bc30 comp rx=0 tx=0).stop 2024-03-27T07:27:32.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 -- 172.21.15.82:0/1646653604 shutdown_connections 2024-03-27T07:27:32.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 --2- 172.21.15.82:0/1646653604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a01024a0 0x7f16a010e9b0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 --2- 172.21.15.82:0/1646653604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16a0101ae0 0x7f16a0101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 --2- 172.21.15.82:0/1646653604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a0107b80 0x7f16a0107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 -- 172.21.15.82:0/1646653604 >> 172.21.15.82:0/1646653604 conn(0x7f16a00fd5f0 msgr2=0x7f16a00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 -- 172.21.15.82:0/1646653604 shutdown_connections 2024-03-27T07:27:32.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 -- 172.21.15.82:0/1646653604 wait complete. 2024-03-27T07:27:32.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 Processor -- start 2024-03-27T07:27:32.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.324+0000 7f16a79ac640 1 -- start start 2024-03-27T07:27:32.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a79ac640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a0101ae0 0x7f16a0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a79ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a01024a0 0x7f16a01988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a79ac640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16a0107b80 0x7f16a019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a79ac640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0111f00 con 0x7f16a01024a0 2024-03-27T07:27:32.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a79ac640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0111d80 con 0x7f16a0107b80 2024-03-27T07:27:32.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a79ac640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f16a0112080 con 0x7f16a0101ae0 2024-03-27T07:27:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a4f47640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a01024a0 0x7f16a01988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a4f47640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a01024a0 0x7f16a01988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48310/0 (socket says 172.21.15.82:48310) 2024-03-27T07:27:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a4f47640 1 -- 172.21.15.82:0/2533506276 learned_addr learned my addr 172.21.15.82:0/2533506276 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a5748640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a0101ae0 0x7f16a0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a5f49640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16a0107b80 0x7f16a019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a4f47640 1 -- 172.21.15.82:0/2533506276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a0101ae0 msgr2=0x7f16a0198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a4f47640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a0101ae0 0x7f16a0198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a4f47640 1 -- 172.21.15.82:0/2533506276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16a0107b80 msgr2=0x7f16a019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a4f47640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16a0107b80 0x7f16a019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a4f47640 1 -- 172.21.15.82:0/2533506276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a019d370 con 0x7f16a01024a0 2024-03-27T07:27:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a4f47640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a01024a0 0x7f16a01988c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f169400e9f0 tx=0x7f169400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f169e7fc640 1 -- 172.21.15.82:0/2533506276 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169400cd80 con 0x7f16a01024a0 2024-03-27T07:27:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f169e7fc640 1 -- 172.21.15.82:0/2533506276 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1694010910 con 0x7f16a01024a0 2024-03-27T07:27:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a79ac640 1 -- 172.21.15.82:0/2533506276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a019d660 con 0x7f16a01024a0 2024-03-27T07:27:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f169e7fc640 1 -- 172.21.15.82:0/2533506276 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694018990 con 0x7f16a01024a0 2024-03-27T07:27:32.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.325+0000 7f16a79ac640 1 -- 172.21.15.82:0/2533506276 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a01a4ef0 con 0x7f16a01024a0 2024-03-27T07:27:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.327+0000 7f169e7fc640 1 -- 172.21.15.82:0/2533506276 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f1694010ac0 con 0x7f16a01024a0 2024-03-27T07:27:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16aa590740 1 Processor -- start 2024-03-27T07:27:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16aa590740 1 -- start start 2024-03-27T07:27:32.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16aa590740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b2e50 0x5579034b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16aa590740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b3770 0x5579034bbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16aa590740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034bc350 0x5579034be740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16aa590740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5579033bdc20 con 0x5579034b2e50 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f169e7fc640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f16880a3800 0x7f16880a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16aa590740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x557903416430 con 0x5579034b3770 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16aa590740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5579033be900 con 0x5579034bc350 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16a5f49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b2e50 0x5579034b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16a5f49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b2e50 0x5579034b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48324/0 (socket says 172.21.15.82:48324) 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16a5f49640 1 -- 172.21.15.82:0/1888081703 learned_addr learned my addr 172.21.15.82:0/1888081703 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16a5748640 1 --2- 172.21.15.82:0/1888081703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b3770 0x5579034bbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16a5f49640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f16880a3800 0x7f16880a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f169e7fc640 1 -- 172.21.15.82:0/2533506276 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f16940d0370 con 0x7f16a01024a0 2024-03-27T07:27:32.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.328+0000 7f16a4f47640 1 --2- 172.21.15.82:0/1888081703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034bc350 0x5579034be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.329+0000 7f16a5748640 1 -- 172.21.15.82:0/1888081703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034bc350 msgr2=0x5579034be740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.329+0000 7f16a5748640 1 --2- 172.21.15.82:0/1888081703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034bc350 0x5579034be740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.329+0000 7f16a5748640 1 -- 172.21.15.82:0/1888081703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b2e50 msgr2=0x5579034b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.329+0000 7f16a5748640 1 --2- 172.21.15.82:0/1888081703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b2e50 0x5579034b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.329+0000 7f16a5748640 1 -- 172.21.15.82:0/1888081703 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557903411180 con 0x5579034b3770 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.329+0000 7f16a5748640 1 --2- 172.21.15.82:0/1888081703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b3770 0x5579034bbe10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1698009f80 tx=0x7f16980118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f870681b55cc992 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.329+0000 7f16a5f49640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f16880a3800 0x7f16880a5cc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1690006010 tx=0x7f1690005bb0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.329+0000 7f16877fe640 1 -- 172.21.15.82:0/1888081703 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698004d20 con 0x5579034b3770 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.329+0000 7f16877fe640 1 -- 172.21.15.82:0/1888081703 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1698004050 con 0x5579034b3770 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.329+0000 7f16877fe640 1 -- 172.21.15.82:0/1888081703 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1698005240 con 0x5579034b3770 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 -- 172.21.15.82:0/1888081703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b3770 msgr2=0x5579034bbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 --2- 172.21.15.82:0/1888081703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b3770 0x5579034bbe10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1698009f80 tx=0x7f16980118d0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 -- 172.21.15.82:0/1888081703 shutdown_connections 2024-03-27T07:27:32.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 --2- 172.21.15.82:0/1888081703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034bc350 0x5579034be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 --2- 172.21.15.82:0/1888081703 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b3770 0x5579034bbe10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 --2- 172.21.15.82:0/1888081703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b2e50 0x5579034b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 -- 172.21.15.82:0/1888081703 >> 172.21.15.82:0/1888081703 conn(0x5579034ad580 msgr2=0x5579034ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 -- 172.21.15.82:0/1888081703 shutdown_connections 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 -- 172.21.15.82:0/1888081703 wait complete. 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 -- start start 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.330+0000 7f16aa590740 1 Processor -- start 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16aa590740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b2e50 0x5579034bbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16aa590740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16aa590740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034bc350 0x5579034b9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16aa590740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5579033d1cc0 con 0x5579034b3770 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16aa590740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5579034123e0 con 0x5579034b2e50 2024-03-27T07:27:32.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16aa590740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5579034bf140 con 0x5579034bc350 2024-03-27T07:27:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16aa590740 10 client.0 _ll_register_callbacks cb 0x55790340cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a4f47640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a4f47640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034b8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48340/0 (socket says 172.21.15.82:48340) 2024-03-27T07:27:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a4f47640 1 -- 172.21.15.82:0/411849154 learned_addr learned my addr 172.21.15.82:0/411849154 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a5748640 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b2e50 0x5579034bbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a5f49640 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034bc350 0x5579034b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a4f47640 1 -- 172.21.15.82:0/411849154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034bc350 msgr2=0x5579034b9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a4f47640 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034bc350 0x5579034b9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a4f47640 1 -- 172.21.15.82:0/411849154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b2e50 msgr2=0x5579034bbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a4f47640 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b2e50 0x5579034bbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a4f47640 1 -- 172.21.15.82:0/411849154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579033d8ef0 con 0x5579034b3770 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16a4f47640 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034b8fc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f16940cdb70 tx=0x7f169406b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b0614430c338c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f1684ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f1684ff9640 1 -- 172.21.15.82:0/411849154 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694098040 con 0x5579034b3770 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f1684ff9640 1 -- 172.21.15.82:0/411849154 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f16940a4d30 con 0x5579034b3770 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.331+0000 7f16aa590740 1 -- 172.21.15.82:0/411849154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1698004050 con 0x5579034b3770 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f1684ff9640 1 -- 172.21.15.82:0/411849154 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f16940ac950 con 0x5579034b3770 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f16aa590740 10 client.16515 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f16aa590740 1 -- 172.21.15.82:0/411849154 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5579031f27e0 con 0x5579034b3770 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f1684ff9640 1 -- 172.21.15.82:0/411849154 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1698004050 con 0x5579034b3770 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f1684ff9640 1 -- 172.21.15.82:0/411849154 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f16940ac0e0 con 0x5579034b3770 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f16aa590740 10 client.16515 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:32.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f16aa590740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f16aa590740 20 client.16515 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f16aa590740 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579034cc220 0x5579034ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f16aa590740 4 client.16515 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f16aa590740 1 -- 172.21.15.82:0/411849154 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557903423970 con 0x5579034cc220 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.332+0000 7f16a5748640 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579034cc220 0x5579034ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f1684ff9640 10 client.16515 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f16a5748640 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579034cc220 0x5579034ce6c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10fe70979d2a6560 server_cookie=3ff2da9cc2124d47 in_seq=0 out_seq=0 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f1684ff9640 1 -- 172.21.15.82:0/411849154 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557903423970 con 0x5579034cc220 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f1684ff9640 10 client.16515 handle_command_reply: tid=0 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f16aa590740 1 client.16515 shutdown 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f16aa590740 1 -- 172.21.15.82:0/411849154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 msgr2=0x5579034b8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f16aa590740 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034b8fc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f16940cdb70 tx=0x7f169406b260 comp rx=0 tx=0).stop 2024-03-27T07:27:32.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f16aa590740 1 -- 172.21.15.82:0/411849154 shutdown_connections 2024-03-27T07:27:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f16aa590740 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579034cc220 0x5579034ce6c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f16aa590740 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034b8fc0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f16aa590740 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034bc350 0x5579034b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f16aa590740 1 --2- 172.21.15.82:0/411849154 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b2e50 0x5579034bbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f1684ff9640 0 client.16515 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.333+0000 7f16aa590740 1 -- 172.21.15.82:0/411849154 >> 172.21.15.82:0/411849154 conn(0x5579034ad580 msgr2=0x5579034af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.334+0000 7f16aa590740 1 -- 172.21.15.82:0/411849154 shutdown_connections 2024-03-27T07:27:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.334+0000 7f16aa590740 1 -- 172.21.15.82:0/411849154 wait complete. 2024-03-27T07:27:32.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.334+0000 7f16aa590740 20 client.16515 trim_cache size 0 max 16384 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16aa590740 1 Processor -- start 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16aa590740 1 -- start start 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16aa590740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034ad580 0x5579034ac370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16aa590740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b2e50 0x5579034b88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16aa590740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16aa590740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16a01afed0 con 0x5579034b3770 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16aa590740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16a01ad740 con 0x5579034ad580 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16aa590740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f16a01ab590 con 0x5579034b2e50 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16a5f49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16a5f49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48348/0 (socket says 172.21.15.82:48348) 2024-03-27T07:27:32.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16a5f49640 1 -- 172.21.15.82:0/2416879783 learned_addr learned my addr 172.21.15.82:0/2416879783 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16a4f47640 1 --2- 172.21.15.82:0/2416879783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b2e50 0x5579034b88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16a5748640 1 --2- 172.21.15.82:0/2416879783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034ad580 0x5579034ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16a5f49640 1 -- 172.21.15.82:0/2416879783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b2e50 msgr2=0x5579034b88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16a5f49640 1 --2- 172.21.15.82:0/2416879783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b2e50 0x5579034b88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16a5f49640 1 -- 172.21.15.82:0/2416879783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034ad580 msgr2=0x5579034ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.351+0000 7f16a5f49640 1 --2- 172.21.15.82:0/2416879783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034ad580 0x5579034ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16a5f49640 1 -- 172.21.15.82:0/2416879783 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557903252f70 con 0x5579034b3770 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16a4f47640 1 --2- 172.21.15.82:0/2416879783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b2e50 0x5579034b88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16a5f49640 1 --2- 172.21.15.82:0/2416879783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034c7dc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f169002ce70 tx=0x7f169003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d268d5bcf7b0e7f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f1686ffd640 1 -- 172.21.15.82:0/2416879783 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900046c0 con 0x5579034b3770 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f1686ffd640 1 -- 172.21.15.82:0/2416879783 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1690051070 con 0x5579034b3770 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f1686ffd640 1 -- 172.21.15.82:0/2416879783 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900035f0 con 0x5579034b3770 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16aa590740 1 -- 172.21.15.82:0/2416879783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 msgr2=0x5579034c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16aa590740 1 --2- 172.21.15.82:0/2416879783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034c7dc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f169002ce70 tx=0x7f169003e000 comp rx=0 tx=0).stop 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16aa590740 1 -- 172.21.15.82:0/2416879783 shutdown_connections 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16aa590740 1 --2- 172.21.15.82:0/2416879783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034b3770 0x5579034c7dc0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16aa590740 1 --2- 172.21.15.82:0/2416879783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b2e50 0x5579034b88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16aa590740 1 --2- 172.21.15.82:0/2416879783 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034ad580 0x5579034ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16aa590740 1 -- 172.21.15.82:0/2416879783 >> 172.21.15.82:0/2416879783 conn(0x5579034b9660 msgr2=0x5579034af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16aa590740 1 -- 172.21.15.82:0/2416879783 shutdown_connections 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.352+0000 7f16aa590740 1 -- 172.21.15.82:0/2416879783 wait complete. 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16aa590740 1 -- start start 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16aa590740 1 Processor -- start 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16aa590740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034ad580 0x5579034c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16aa590740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b2e50 0x5579034c13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16aa590740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b3770 0x5579034c1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16aa590740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f16a01abc00 con 0x5579034ad580 2024-03-27T07:27:32.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16aa590740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f16a01ad070 con 0x5579034b2e50 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16aa590740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f16a01ac2d0 con 0x5579034b3770 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16aa590740 10 client.0 _ll_register_callbacks cb 0x7f169400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16a5748640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034ad580 0x5579034c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16a4f47640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b2e50 0x5579034c13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16a5748640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034ad580 0x5579034c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48362/0 (socket says 172.21.15.82:48362) 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16a5748640 1 -- 172.21.15.82:0/1254825738 learned_addr learned my addr 172.21.15.82:0/1254825738 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.353+0000 7f16a5f49640 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b3770 0x5579034c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16a5748640 1 -- 172.21.15.82:0/1254825738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b3770 msgr2=0x5579034c1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16a5748640 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b3770 0x5579034c1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16a5748640 1 -- 172.21.15.82:0/1254825738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b2e50 msgr2=0x5579034c13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16a5748640 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b2e50 0x5579034c13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16a5748640 1 -- 172.21.15.82:0/1254825738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579030ea170 con 0x5579034ad580 2024-03-27T07:27:32.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16a5748640 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034ad580 0x5579034c43f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1698006010 tx=0x7f1698009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146753b145b25c64 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f1684ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f1684ff9640 1 -- 172.21.15.82:0/1254825738 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169802ccb0 con 0x5579034ad580 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f1684ff9640 1 -- 172.21.15.82:0/1254825738 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f169802c3a0 con 0x5579034ad580 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16aa590740 1 -- 172.21.15.82:0/1254825738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1690051070 con 0x5579034ad580 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f1684ff9640 1 -- 172.21.15.82:0/1254825738 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f169802ce50 con 0x5579034ad580 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16aa590740 10 client.16521 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16aa590740 1 -- 172.21.15.82:0/1254825738 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5579033e14e0 con 0x5579034ad580 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f1684ff9640 1 -- 172.21.15.82:0/1254825738 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1690051070 con 0x5579034ad580 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f1684ff9640 1 -- 172.21.15.82:0/1254825738 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f16980042b0 con 0x5579034ad580 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16aa590740 10 client.16521 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16aa590740 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16aa590740 20 client.16521 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16aa590740 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579034bc350 0x5579035356e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.354+0000 7f16aa590740 4 client.16521 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.355+0000 7f16aa590740 1 -- 172.21.15.82:0/1254825738 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55790341dcc0 con 0x5579034bc350 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.355+0000 7f16a4f47640 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579034bc350 0x5579035356e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.355+0000 7f16a4f47640 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579034bc350 0x5579035356e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e06f7e19edc5bb9 server_cookie=97015f6f5a3e0b2b in_seq=0 out_seq=0 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.355+0000 7f1684ff9640 10 client.16521 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f1684ff9640 1 -- 172.21.15.82:0/1254825738 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55790341dcc0 con 0x5579034bc350 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f1684ff9640 10 client.16521 handle_command_reply: tid=0 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 client.16521 shutdown 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 -- 172.21.15.82:0/1254825738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034ad580 msgr2=0x5579034c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034ad580 0x5579034c43f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1698006010 tx=0x7f1698009f10 comp rx=0 tx=0).stop 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 -- 172.21.15.82:0/1254825738 shutdown_connections 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579034b3770 0x5579034c1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579034b2e50 0x5579034c13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579034bc350 0x5579035356e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 --2- 172.21.15.82:0/1254825738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579034ad580 0x5579034c43f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 -- 172.21.15.82:0/1254825738 >> 172.21.15.82:0/1254825738 conn(0x5579034b9660 msgr2=0x5579034ba600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f1684ff9640 0 client.16521 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:32.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 -- 172.21.15.82:0/1254825738 shutdown_connections 2024-03-27T07:27:32.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.356+0000 7f16aa590740 1 -- 172.21.15.82:0/1254825738 wait complete. 2024-03-27T07:27:32.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16aa590740 20 client.16521 trim_cache size 0 max 16384 2024-03-27T07:27:32.365 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:27:32.365 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-03-27T07:27:32.365 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "8e8de5da-ba8f-4da6-8d6f-afc1279fb89f", 2024-03-27T07:27:32.365 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-03-27T07:27:32.365 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:27:32.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 -- 172.21.15.82:0/2533506276 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f16880a3800 msgr2=0x7f16880a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f16880a3800 0x7f16880a5cc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1690006010 tx=0x7f1690005bb0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 -- 172.21.15.82:0/2533506276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a01024a0 msgr2=0x7f16a01988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a01024a0 0x7f16a01988c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f169400e9f0 tx=0x7f169400eeb0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 -- 172.21.15.82:0/2533506276 shutdown_connections 2024-03-27T07:27:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f16880a3800 0x7f16880a5cc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a01024a0 0x7f16a01988c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f16a0107b80 0x7f16a019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 --2- 172.21.15.82:0/2533506276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16a0101ae0 0x7f16a0198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 -- 172.21.15.82:0/2533506276 >> 172.21.15.82:0/2533506276 conn(0x7f16a00fd5f0 msgr2=0x7f16a00fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 -- 172.21.15.82:0/2533506276 shutdown_connections 2024-03-27T07:27:32.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.357+0000 7f16a79ac640 1 -- 172.21.15.82:0/2533506276 wait complete. 2024-03-27T07:27:32.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:27:32.371 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:27:32.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.474+0000 7f517eadf640 1 -- 172.21.15.82:0/1670680618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51781006c0 msgr2=0x7f5178100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.474+0000 7f517eadf640 1 --2- 172.21.15.82:0/1670680618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51781006c0 0x7f5178100aa0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f517000adb0 tx=0x7f517002cff0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.474+0000 7f517eadf640 1 -- 172.21.15.82:0/1670680618 shutdown_connections 2024-03-27T07:27:32.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.474+0000 7f517eadf640 1 --2- 172.21.15.82:0/1670680618 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5178105540 0x7f517810d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.474+0000 7f517eadf640 1 --2- 172.21.15.82:0/1670680618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5178101070 0x7f5178104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.474+0000 7f517eadf640 1 --2- 172.21.15.82:0/1670680618 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51781006c0 0x7f5178100aa0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.474+0000 7f517eadf640 1 -- 172.21.15.82:0/1670680618 >> 172.21.15.82:0/1670680618 conn(0x7f5178075cb0 msgr2=0x7f51780760c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.474+0000 7f517eadf640 1 -- 172.21.15.82:0/1670680618 shutdown_connections 2024-03-27T07:27:32.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.474+0000 7f517eadf640 1 -- 172.21.15.82:0/1670680618 wait complete. 2024-03-27T07:27:32.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517eadf640 1 Processor -- start 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517eadf640 1 -- start start 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517eadf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51781006c0 0x7f5178196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517eadf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5178105540 0x7f51781967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517eadf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517819ab20 0x7f517819afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517eadf640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f517810fd40 con 0x7f5178105540 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517eadf640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f517810fbc0 con 0x7f51781006c0 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517eadf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f517810fec0 con 0x7f517819ab20 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5177fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5178105540 0x7f51781967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5177fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5178105540 0x7f51781967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48382/0 (socket says 172.21.15.82:48382) 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5177fff640 1 -- 172.21.15.82:0/199359517 learned_addr learned my addr 172.21.15.82:0/199359517 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517d07c640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517819ab20 0x7f517819afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517c87b640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51781006c0 0x7f5178196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5177fff640 1 -- 172.21.15.82:0/199359517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517819ab20 msgr2=0x7f517819afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5177fff640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517819ab20 0x7f517819afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5177fff640 1 -- 172.21.15.82:0/199359517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51781006c0 msgr2=0x7f5178196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5177fff640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51781006c0 0x7f5178196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5177fff640 1 -- 172.21.15.82:0/199359517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f517819b610 con 0x7f5178105540 2024-03-27T07:27:32.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517d07c640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517819ab20 0x7f517819afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:27:32.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5177fff640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5178105540 0x7f51781967a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f516800eb00 tx=0x7f5168009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5175ffb640 1 -- 172.21.15.82:0/199359517 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516800bbd0 con 0x7f5178105540 2024-03-27T07:27:32.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f5175ffb640 1 -- 172.21.15.82:0/199359517 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f516800bd70 con 0x7f5178105540 2024-03-27T07:27:32.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.475+0000 7f517eadf640 1 -- 172.21.15.82:0/199359517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f517819b900 con 0x7f5178105540 2024-03-27T07:27:32.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.476+0000 7f5175ffb640 1 -- 172.21.15.82:0/199359517 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168017410 con 0x7f5178105540 2024-03-27T07:27:32.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.476+0000 7f517eadf640 1 -- 172.21.15.82:0/199359517 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51781a30a0 con 0x7f5178105540 2024-03-27T07:27:32.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f5175ffb640 1 -- 172.21.15.82:0/199359517 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f5168004fb0 con 0x7f5178105540 2024-03-27T07:27:32.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f5175ffb640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f51640a3780 0x7f51640a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f51817a5740 1 Processor -- start 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f51817a5740 1 -- start start 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f517c87b640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f51640a3780 0x7f51640a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f51817a5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e7109630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f5175ffb640 1 -- 172.21.15.82:0/199359517 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f51680d1900 con 0x7f5178105540 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f51817a5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7109b70 0x5636e7112210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f51817a5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7112750 0x5636e7114b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f51817a5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5636e706d860 con 0x5636e7112750 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f51817a5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5636e70158d0 con 0x5636e7109250 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f51817a5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5636e7069810 con 0x5636e7109b70 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f517d07c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7112750 0x5636e7114b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f5177fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7109b70 0x5636e7112210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f517c87b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e7109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.478+0000 7f517d07c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7112750 0x5636e7114b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48390/0 (socket says 172.21.15.82:48390) 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f517d07c640 1 -- 172.21.15.82:0/1505877592 learned_addr learned my addr 172.21.15.82:0/1505877592 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f5177fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7109b70 0x5636e7112210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36734/0 (socket says 172.21.15.82:36734) 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f517d07c640 1 -- 172.21.15.82:0/1505877592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7109b70 msgr2=0x5636e7112210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f517d07c640 1 --2- 172.21.15.82:0/1505877592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7109b70 0x5636e7112210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f517d07c640 1 -- 172.21.15.82:0/1505877592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 msgr2=0x5636e7109630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f517d07c640 1 --2- 172.21.15.82:0/1505877592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e7109630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f517d07c640 1 -- 172.21.15.82:0/1505877592 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636e7020120 con 0x5636e7112750 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f5177fff640 1 --2- 172.21.15.82:0/1505877592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7109b70 0x5636e7112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f517c87b640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f51640a3780 0x7f51640a5c40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5170005e30 tx=0x7f517002ed70 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f517d07c640 1 --2- 172.21.15.82:0/1505877592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7112750 0x5636e7114b40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5160011540 tx=0x7f5160011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d114fcd8ad774709 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f516effd640 1 -- 172.21.15.82:0/1505877592 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516000f540 con 0x5636e7112750 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f516effd640 1 -- 172.21.15.82:0/1505877592 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f516000fbc0 con 0x5636e7112750 2024-03-27T07:27:32.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.479+0000 7f516effd640 1 -- 172.21.15.82:0/1505877592 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160019c30 con 0x5636e7112750 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 -- 172.21.15.82:0/1505877592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7112750 msgr2=0x5636e7114b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 --2- 172.21.15.82:0/1505877592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7112750 0x5636e7114b40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5160011540 tx=0x7f5160011a00 comp rx=0 tx=0).stop 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 -- 172.21.15.82:0/1505877592 shutdown_connections 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 --2- 172.21.15.82:0/1505877592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7112750 0x5636e7114b40 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 --2- 172.21.15.82:0/1505877592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7109b70 0x5636e7112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 --2- 172.21.15.82:0/1505877592 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e7109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 -- 172.21.15.82:0/1505877592 >> 172.21.15.82:0/1505877592 conn(0x5636e7103980 msgr2=0x5636e7103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 -- 172.21.15.82:0/1505877592 shutdown_connections 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 -- 172.21.15.82:0/1505877592 wait complete. 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 -- start start 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.480+0000 7f51817a5740 1 Processor -- start 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f51817a5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e710f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f51817a5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e710fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f51817a5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e71101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f51817a5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5636e7115540 con 0x5636e7109b70 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f51817a5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5636e7028cd0 con 0x5636e7109250 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f51817a5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5636e71156c0 con 0x5636e7112750 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f51817a5740 10 client.0 _ll_register_callbacks cb 0x5636e701aee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5177fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e710fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5177fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e710fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48398/0 (socket says 172.21.15.82:48398) 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5177fff640 1 -- 172.21.15.82:0/3865907655 learned_addr learned my addr 172.21.15.82:0/3865907655 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f517c87b640 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e710f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f517d07c640 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e71101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5177fff640 1 -- 172.21.15.82:0/3865907655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 msgr2=0x5636e71101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5177fff640 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e71101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5177fff640 1 -- 172.21.15.82:0/3865907655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 msgr2=0x5636e710f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5177fff640 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e710f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5177fff640 1 -- 172.21.15.82:0/3865907655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636e6e4b7d0 con 0x5636e7109b70 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f517c87b640 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e710f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5177fff640 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e710fc90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f51680cf100 tx=0x7f516809dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01ca27c0f6f2dae server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5157fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5157fff640 1 -- 172.21.15.82:0/3865907655 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51680a64c0 con 0x5636e7109b70 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5157fff640 1 -- 172.21.15.82:0/3865907655 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f516809cfe0 con 0x5636e7109b70 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f51817a5740 1 -- 172.21.15.82:0/3865907655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f516000fbc0 con 0x5636e7109b70 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f5157fff640 1 -- 172.21.15.82:0/3865907655 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f516809d1e0 con 0x5636e7109b70 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f51817a5740 10 client.16533 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.481+0000 7f51817a5740 1 -- 172.21.15.82:0/3865907655 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5636e6d813f0 con 0x5636e7109b70 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f5157fff640 1 -- 172.21.15.82:0/3865907655 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f516000fbc0 con 0x5636e7109b70 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f5157fff640 1 -- 172.21.15.82:0/3865907655 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f516809ca50 con 0x5636e7109b70 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f51817a5740 10 client.16533 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:32.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f51817a5740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f51817a5740 20 client.16533 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f51817a5740 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5636e7122a90 0x5636e7124ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f51817a5740 4 client.16533 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f51817a5740 1 -- 172.21.15.82:0/3865907655 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636e707ada0 con 0x5636e7122a90 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f517c87b640 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5636e7122a90 0x5636e7124ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f5157fff640 10 client.16533 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.482+0000 7f517c87b640 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5636e7122a90 0x5636e7124ec0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36e5461ab126d06a server_cookie=3999e3f0e620f50c in_seq=0 out_seq=0 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f5157fff640 1 -- 172.21.15.82:0/3865907655 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5636e707ada0 con 0x5636e7122a90 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f5157fff640 10 client.16533 handle_command_reply: tid=0 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f51817a5740 1 client.16533 shutdown 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f51817a5740 1 -- 172.21.15.82:0/3865907655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 msgr2=0x5636e710fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f51817a5740 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e710fc90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f51680cf100 tx=0x7f516809dc50 comp rx=0 tx=0).stop 2024-03-27T07:27:32.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f51817a5740 1 -- 172.21.15.82:0/3865907655 shutdown_connections 2024-03-27T07:27:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f51817a5740 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5636e7122a90 0x5636e7124ec0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f51817a5740 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e710fc90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f51817a5740 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e71101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f5157fff640 0 client.16533 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f51817a5740 1 --2- 172.21.15.82:0/3865907655 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e710f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.483+0000 7f51817a5740 1 -- 172.21.15.82:0/3865907655 >> 172.21.15.82:0/3865907655 conn(0x5636e7103980 msgr2=0x5636e71056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.484+0000 7f51817a5740 1 -- 172.21.15.82:0/3865907655 shutdown_connections 2024-03-27T07:27:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.484+0000 7f51817a5740 1 -- 172.21.15.82:0/3865907655 wait complete. 2024-03-27T07:27:32.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.484+0000 7f51817a5740 20 client.16533 trim_cache size 0 max 16384 2024-03-27T07:27:32.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f51817a5740 1 Processor -- start 2024-03-27T07:27:32.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f51817a5740 1 -- start start 2024-03-27T07:27:32.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f51817a5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109250 0x5636e7111e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f51817a5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109b70 0x5636e711e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f51817a5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e712a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f51817a5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51781adf10 con 0x5636e7109250 2024-03-27T07:27:32.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f51817a5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f51781ab780 con 0x5636e7109b70 2024-03-27T07:27:32.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f51817a5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51781a95d0 con 0x5636e7112750 2024-03-27T07:27:32.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f517c87b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109250 0x5636e7111e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f517c87b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109250 0x5636e7111e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48402/0 (socket says 172.21.15.82:48402) 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f517c87b640 1 -- 172.21.15.82:0/814697124 learned_addr learned my addr 172.21.15.82:0/814697124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f5177fff640 1 --2- 172.21.15.82:0/814697124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109b70 0x5636e711e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f517d07c640 1 --2- 172.21.15.82:0/814697124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e712a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f517c87b640 1 -- 172.21.15.82:0/814697124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 msgr2=0x5636e712a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f517c87b640 1 --2- 172.21.15.82:0/814697124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e712a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f517c87b640 1 -- 172.21.15.82:0/814697124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109b70 msgr2=0x5636e711e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f517c87b640 1 --2- 172.21.15.82:0/814697124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109b70 0x5636e711e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f517c87b640 1 -- 172.21.15.82:0/814697124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636e6d410f0 con 0x5636e7109250 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.501+0000 7f517c87b640 1 --2- 172.21.15.82:0/814697124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109250 0x5636e7111e80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f517000adb0 tx=0x7f517004a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42d15af2726282 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f516e7fc640 1 -- 172.21.15.82:0/814697124 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517005b070 con 0x5636e7109250 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f516e7fc640 1 -- 172.21.15.82:0/814697124 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5170033e80 con 0x5636e7109250 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f516e7fc640 1 -- 172.21.15.82:0/814697124 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517003a040 con 0x5636e7109250 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f51817a5740 1 -- 172.21.15.82:0/814697124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109250 msgr2=0x5636e7111e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f51817a5740 1 --2- 172.21.15.82:0/814697124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109250 0x5636e7111e80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f517000adb0 tx=0x7f517004a000 comp rx=0 tx=0).stop 2024-03-27T07:27:32.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f51817a5740 1 -- 172.21.15.82:0/814697124 shutdown_connections 2024-03-27T07:27:32.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f51817a5740 1 --2- 172.21.15.82:0/814697124 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e712a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f51817a5740 1 --2- 172.21.15.82:0/814697124 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109b70 0x5636e711e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f51817a5740 1 --2- 172.21.15.82:0/814697124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109250 0x5636e7111e80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f51817a5740 1 -- 172.21.15.82:0/814697124 >> 172.21.15.82:0/814697124 conn(0x5636e7103980 msgr2=0x5636e7102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f51817a5740 1 -- 172.21.15.82:0/814697124 shutdown_connections 2024-03-27T07:27:32.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.502+0000 7f51817a5740 1 -- 172.21.15.82:0/814697124 wait complete. 2024-03-27T07:27:32.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f51817a5740 1 -- start start 2024-03-27T07:27:32.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f51817a5740 1 Processor -- start 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f51817a5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e711abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f51817a5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e7115f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f51817a5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e7116470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f51817a5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51781a9c40 con 0x5636e7109b70 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f51817a5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f51781ab0b0 con 0x5636e7109250 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f51817a5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f51781aa310 con 0x5636e7112750 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f51817a5740 10 client.0 _ll_register_callbacks cb 0x7f516809d6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f5177fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e7115f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f5177fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e7115f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48416/0 (socket says 172.21.15.82:48416) 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f517c87b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e711abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f5177fff640 1 -- 172.21.15.82:0/629024656 learned_addr learned my addr 172.21.15.82:0/629024656 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:32.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f517d07c640 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e7116470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f5177fff640 1 -- 172.21.15.82:0/629024656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 msgr2=0x5636e7116470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f5177fff640 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e7116470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f5177fff640 1 -- 172.21.15.82:0/629024656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 msgr2=0x5636e711abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f5177fff640 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e711abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.503+0000 7f5177fff640 1 -- 172.21.15.82:0/629024656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636e7116c50 con 0x5636e7109b70 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f5177fff640 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e7115f30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f516809db20 tx=0x7f516809cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc06890dd20929d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f5157fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f5157fff640 1 -- 172.21.15.82:0/629024656 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5168080070 con 0x5636e7109b70 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f5157fff640 1 -- 172.21.15.82:0/629024656 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f51680a3020 con 0x5636e7109b70 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f51817a5740 1 -- 172.21.15.82:0/629024656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5170033e80 con 0x5636e7109b70 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f5157fff640 1 -- 172.21.15.82:0/629024656 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5168005690 con 0x5636e7109b70 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f51817a5740 10 client.16539 fetch_fsmap learned FSMap version 26 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f51817a5740 1 -- 172.21.15.82:0/629024656 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5636e7188de0 con 0x5636e7109b70 2024-03-27T07:27:32.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f5157fff640 1 -- 172.21.15.82:0/629024656 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5170033e80 con 0x5636e7109b70 2024-03-27T07:27:32.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f5157fff640 1 -- 172.21.15.82:0/629024656 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5168083030 con 0x5636e7109b70 2024-03-27T07:27:32.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f51817a5740 10 client.16539 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T07:27:32.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f51817a5740 10 client.16539 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:32.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f51817a5740 20 client.16539 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:32.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f51817a5740 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5636e7189550 0x5636e718b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:32.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f51817a5740 4 client.16539 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:27:32.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f51817a5740 1 -- 172.21.15.82:0/629024656 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5636e70750f0 con 0x5636e7189550 2024-03-27T07:27:32.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.504+0000 7f517c87b640 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5636e7189550 0x5636e718b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:32.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f5157fff640 10 client.16539 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:32.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f517c87b640 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5636e7189550 0x5636e718b970 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51267b5ba640d4c9 server_cookie=161ce2e32c745899 in_seq=0 out_seq=0 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f5157fff640 1 -- 172.21.15.82:0/629024656 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+265 (crc 0 0 0) 0x5636e70750f0 con 0x5636e7189550 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f5157fff640 10 client.16539 handle_command_reply: tid=0 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 client.16539 shutdown 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 -- 172.21.15.82:0/629024656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 msgr2=0x5636e7115f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e7115f30 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f516809db20 tx=0x7f516809cc80 comp rx=0 tx=0).stop 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 -- 172.21.15.82:0/629024656 shutdown_connections 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5636e7189550 0x5636e718b970 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5636e7109b70 0x5636e7115f30 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5636e7112750 0x5636e7116470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f5157fff640 0 client.16539 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 --2- 172.21.15.82:0/629024656 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5636e7109250 0x5636e711abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 -- 172.21.15.82:0/629024656 >> 172.21.15.82:0/629024656 conn(0x5636e7103980 msgr2=0x5636e710ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 -- 172.21.15.82:0/629024656 shutdown_connections 2024-03-27T07:27:32.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 1 -- 172.21.15.82:0/629024656 wait complete. 2024-03-27T07:27:32.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.505+0000 7f51817a5740 20 client.16539 trim_cache size 0 max 16384 2024-03-27T07:27:32.515 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:27:32.515 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (0 inodes in the stack)", 2024-03-27T07:27:32.515 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-03-27T07:27:32.515 INFO:teuthology.orchestra.run.smithi082.stdout: "8e8de5da-ba8f-4da6-8d6f-afc1279fb89f": { 2024-03-27T07:27:32.515 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-03-27T07:27:32.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "8e8de5da-ba8f-4da6-8d6f-afc1279fb89f", 2024-03-27T07:27:32.515 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-03-27T07:27:32.515 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:27:32.515 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:27:32.516 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:27:32.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 -- 172.21.15.82:0/199359517 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f51640a3780 msgr2=0x7f51640a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f51640a3780 0x7f51640a5c40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5170005e30 tx=0x7f517002ed70 comp rx=0 tx=0).stop 2024-03-27T07:27:32.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 -- 172.21.15.82:0/199359517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5178105540 msgr2=0x7f51781967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:32.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5178105540 0x7f51781967a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f516800eb00 tx=0x7f5168009e80 comp rx=0 tx=0).stop 2024-03-27T07:27:32.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 -- 172.21.15.82:0/199359517 shutdown_connections 2024-03-27T07:27:32.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f51640a3780 0x7f51640a5c40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5178105540 0x7f51781967a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f517819ab20 0x7f517819afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 --2- 172.21.15.82:0/199359517 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f51781006c0 0x7f5178196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:32.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 -- 172.21.15.82:0/199359517 >> 172.21.15.82:0/199359517 conn(0x7f5178075cb0 msgr2=0x7f51780fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:32.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 -- 172.21.15.82:0/199359517 shutdown_connections 2024-03-27T07:27:32.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:27:32.506+0000 7f517eadf640 1 -- 172.21.15.82:0/199359517 wait complete. 2024-03-27T07:27:32.518 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:32 smithi082 ceph-mon[32178]: pgmap v121: 97 pgs: 97 active+clean; 653 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.6 MiB/s wr, 460 op/s 2024-03-27T07:27:32.519 INFO:tasks.cephfs.filesystem:scrub status for tag:8e8de5da-ba8f-4da6-8d6f-afc1279fb89f - {'path': '/', 'tag': '8e8de5da-ba8f-4da6-8d6f-afc1279fb89f', 'options': 'recursive,force'} 2024-03-27T07:27:32.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:32 smithi149 ceph-mon[36065]: pgmap v121: 97 pgs: 97 active+clean; 653 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.6 MiB/s wr, 460 op/s 2024-03-27T07:27:32.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:32 smithi153 ceph-mon[36179]: pgmap v121: 97 pgs: 97 active+clean; 653 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.6 MiB/s wr, 460 op/s 2024-03-27T07:27:33.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:33 smithi149 ceph-mon[36065]: scrub queued for path: / 2024-03-27T07:27:33.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:33 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:33.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:33 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:33.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:33 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:33.507 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:33 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:33.507 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:27:33 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: 2024-03-27T07:27:33.173+0000 7f077f72f700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000189b [...5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/ auth{1=1,2=1} fragtree_t(*^3) v115976 ap=2 f(v3 m2024-03-27T07:26:33.239704+0000 185=185+0) n(v7 rc2024-03-27T07:26:33.239704+0000 b3632632 186=185+1) old_inodes=1 (inest sync->mix g=1,2) caps={15291=pAsLsXsFs/pAsLsXsFsxcral@1} | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=8 caps=1 stickydirs=0 dirtyparent=0 dirwaiter=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x559954e30000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x2000000189b:[<0x10000000399/blog-41 v113318>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x2000000189b:[<0x10000000399/blog-41 v115976>,<0x10000000208/blogtest_in v1943>,<0x10000000201/src v2029>,<0x10000000006/blogbench-1.0 v1790>,<0x10000000005/tmp v69>,<0x100000001fb/client.0 v68>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v82>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v96>,<0x1/volumes v88>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T07:26:26.499837+0000 184=184+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T07:26:33.239704+0000 b3632632 186=185+1)","memory_value.dirstat":"f(v3 m2024-03-27T07:26:33.239704+0000 185=185+0)","memory_value.rstat":"n(v7 rc2024-03-27T07:26:33.239704+0000 b3632632 186=185+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-03-27T07:27:33.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:33 smithi082 ceph-mon[32178]: scrub queued for path: / 2024-03-27T07:27:33.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:33 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:33.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:33 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:33.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:33 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:33.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:33 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:33.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:33 smithi153 ceph-mon[36179]: scrub queued for path: / 2024-03-27T07:27:33.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:33 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:33.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:33 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:33.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:33 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:33.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:33 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:34.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:34 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:34.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:34 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:34.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:34 smithi082 ceph-mon[32178]: pgmap v122: 97 pgs: 97 active+clean; 764 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.35k op/s 2024-03-27T07:27:34.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:34 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000189b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41) see mds.b log and `damage ls` output for details 2024-03-27T07:27:34.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:34 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:34.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:34 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:34.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:34 smithi149 ceph-mon[36065]: pgmap v122: 97 pgs: 97 active+clean; 764 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.35k op/s 2024-03-27T07:27:34.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:34 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000189b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41) see mds.b log and `damage ls` output for details 2024-03-27T07:27:34.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:34 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:34.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:34 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:34.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:34 smithi153 ceph-mon[36179]: pgmap v122: 97 pgs: 97 active+clean; 764 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.35k op/s 2024-03-27T07:27:34.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:34 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000189b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41) see mds.b log and `damage ls` output for details 2024-03-27T07:27:35.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:35 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:27:35.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:35 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:27:35.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:35 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:27:36.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:36 smithi082 ceph-mon[32178]: pgmap v123: 97 pgs: 97 active+clean; 764 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.35k op/s 2024-03-27T07:27:36.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:36 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:36.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:36 smithi149 ceph-mon[36065]: pgmap v123: 97 pgs: 97 active+clean; 764 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.35k op/s 2024-03-27T07:27:36.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:36 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:36.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:36 smithi153 ceph-mon[36179]: pgmap v123: 97 pgs: 97 active+clean; 764 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 1.35k op/s 2024-03-27T07:27:36.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:36 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:37.158 INFO:tasks.workunit.client.0.smithi082.stdout: 181 919169 230 620195 243 361621 456 2024-03-27T07:27:38.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:38 smithi082 ceph-mon[32178]: pgmap v124: 97 pgs: 97 active+clean; 768 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 18 MiB/s wr, 1.82k op/s 2024-03-27T07:27:38.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:38 smithi149 ceph-mon[36065]: pgmap v124: 97 pgs: 97 active+clean; 768 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 18 MiB/s wr, 1.82k op/s 2024-03-27T07:27:38.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:38 smithi153 ceph-mon[36179]: pgmap v124: 97 pgs: 97 active+clean; 768 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 18 MiB/s wr, 1.82k op/s 2024-03-27T07:27:39.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:39 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:39.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:39 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:39.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:39 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: pgmap v125: 97 pgs: 97 active+clean; 768 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.54k op/s 2024-03-27T07:27:40.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:27:40.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:40 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: pgmap v125: 97 pgs: 97 active+clean; 768 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.54k op/s 2024-03-27T07:27:40.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:27:40.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:40 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: pgmap v125: 97 pgs: 97 active+clean; 768 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.54k op/s 2024-03-27T07:27:40.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.791 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.792 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.793 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.794 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.794 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.794 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.794 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.795 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.796 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.797 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.798 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.799 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.800 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.801 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.802 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.803 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.804 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.805 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.806 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.807 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.808 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.809 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.810 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:40.811 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:27:40.811 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:40 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:41.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:41 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:41.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:41 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:41.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:41 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:42.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:42 smithi082 ceph-mon[32178]: pgmap v126: 97 pgs: 97 active+clean; 768 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.55k op/s 2024-03-27T07:27:42.689 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:42 smithi153 ceph-mon[36179]: pgmap v126: 97 pgs: 97 active+clean; 768 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.55k op/s 2024-03-27T07:27:42.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:42 smithi149 ceph-mon[36065]: pgmap v126: 97 pgs: 97 active+clean; 768 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 1.55k op/s 2024-03-27T07:27:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.278+0000 7f8e2d772640 1 -- 172.21.15.82:0/1964030401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e28100ca0 msgr2=0x7f8e28101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.278+0000 7f8e2d772640 1 --2- 172.21.15.82:0/1964030401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e28100ca0 0x7f8e28101120 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009900 tx=0x7f8e1c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:27:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.278+0000 7f8e2d772640 1 -- 172.21.15.82:0/1964030401 shutdown_connections 2024-03-27T07:27:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.278+0000 7f8e2d772640 1 --2- 172.21.15.82:0/1964030401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e28100ca0 0x7f8e28101120 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.278+0000 7f8e2d772640 1 --2- 172.21.15.82:0/1964030401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28101660 0x7f8e2810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.278+0000 7f8e2d772640 1 --2- 172.21.15.82:0/1964030401 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e281059f0 0x7f8e28105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.278+0000 7f8e2d772640 1 -- 172.21.15.82:0/1964030401 >> 172.21.15.82:0/1964030401 conn(0x7f8e280778b0 msgr2=0x7f8e28077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.278+0000 7f8e2d772640 1 -- 172.21.15.82:0/1964030401 shutdown_connections 2024-03-27T07:27:44.281 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.278+0000 7f8e2d772640 1 -- 172.21.15.82:0/1964030401 wait complete. 2024-03-27T07:27:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.278+0000 7f8e2d772640 1 Processor -- start 2024-03-27T07:27:44.282 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e2d772640 1 -- start start 2024-03-27T07:27:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e2d772640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e28100ca0 0x7f8e28198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e2d772640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28101660 0x7f8e28198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e2d772640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e281059f0 0x7f8e2819cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e2d772640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e28110e00 con 0x7f8e281059f0 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e2d772640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e28110c80 con 0x7f8e28100ca0 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e2d772640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e28110f80 con 0x7f8e28101660 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e281059f0 0x7f8e2819cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e267fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28101660 0x7f8e28198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e28100ca0 0x7f8e28198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e277fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e281059f0 0x7f8e2819cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57674/0 (socket says 172.21.15.82:57674) 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e277fe640 1 -- 172.21.15.82:0/3611271525 learned_addr learned my addr 172.21.15.82:0/3611271525 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e277fe640 1 -- 172.21.15.82:0/3611271525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28101660 msgr2=0x7f8e28198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e277fe640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28101660 0x7f8e28198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e277fe640 1 -- 172.21.15.82:0/3611271525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e28100ca0 msgr2=0x7f8e28198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e277fe640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e28100ca0 0x7f8e28198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e277fe640 1 -- 172.21.15.82:0/3611271525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2819d240 con 0x7f8e281059f0 2024-03-27T07:27:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.279+0000 7f8e277fe640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e281059f0 0x7f8e2819cb10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000ec70 tx=0x7f8e2000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.280+0000 7f8e0ffff640 1 -- 172.21.15.82:0/3611271525 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20003b70 con 0x7f8e281059f0 2024-03-27T07:27:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.280+0000 7f8e2d772640 1 -- 172.21.15.82:0/3611271525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2819d530 con 0x7f8e281059f0 2024-03-27T07:27:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.280+0000 7f8e0ffff640 1 -- 172.21.15.82:0/3611271525 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e2000ee80 con 0x7f8e281059f0 2024-03-27T07:27:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.280+0000 7f8e0ffff640 1 -- 172.21.15.82:0/3611271525 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e200108a0 con 0x7f8e281059f0 2024-03-27T07:27:44.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.280+0000 7f8e2d772640 1 -- 172.21.15.82:0/3611271525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e281a4dc0 con 0x7f8e281059f0 2024-03-27T07:27:44.291 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.282+0000 7f8e0ffff640 1 -- 172.21.15.82:0/3611271525 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f8e20004020 con 0x7f8e281059f0 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.282+0000 7f8e30430740 1 Processor -- start 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.282+0000 7f8e30430740 1 -- start start 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e30430740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 0x5561762144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e30430740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x55617621d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e30430740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55617621d7e0 0x55617621fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e30430740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5561761dacd0 con 0x5561762140f0 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e30430740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55617611f950 con 0x55617621d7e0 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e30430740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556176177e50 con 0x556176214a10 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x55617621d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e267fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 0x5561762144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e0ffff640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8e100a3820 0x7f8e100a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.292 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x55617621d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42248/0 (socket says 172.21.15.82:42248) 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e26ffd640 1 -- 172.21.15.82:0/110045786 learned_addr learned my addr 172.21.15.82:0/110045786 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e267fc640 1 --2- 172.21.15.82:0/110045786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55617621d7e0 0x55617621fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e277fe640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8e100a3820 0x7f8e100a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e26ffd640 1 -- 172.21.15.82:0/110045786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55617621d7e0 msgr2=0x55617621fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e26ffd640 1 --2- 172.21.15.82:0/110045786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55617621d7e0 0x55617621fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e26ffd640 1 -- 172.21.15.82:0/110045786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 msgr2=0x5561762144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e26ffd640 1 --2- 172.21.15.82:0/110045786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 0x5561762144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e26ffd640 1 -- 172.21.15.82:0/110045786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556175e8c210 con 0x556176214a10 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e0ffff640 1 -- 172.21.15.82:0/3611271525 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f8e200d0490 con 0x7f8e281059f0 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.283+0000 7f8e26ffd640 1 --2- 172.21.15.82:0/110045786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x55617621d2a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009cf0 tx=0x7f8e18011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42c937f145cbc9c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.284+0000 7f8e277fe640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8e100a3820 0x7f8e100a5ce0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e200cdce0 tx=0x7f8e2006f350 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.284+0000 7f8e0d7fa640 1 -- 172.21.15.82:0/110045786 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18004230 con 0x556176214a10 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.284+0000 7f8e0d7fa640 1 -- 172.21.15.82:0/110045786 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e180043d0 con 0x556176214a10 2024-03-27T07:27:44.293 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.284+0000 7f8e0d7fa640 1 -- 172.21.15.82:0/110045786 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18019960 con 0x556176214a10 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 -- 172.21.15.82:0/110045786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 msgr2=0x55617621d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 --2- 172.21.15.82:0/110045786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x55617621d2a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009cf0 tx=0x7f8e18011810 comp rx=0 tx=0).stop 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 -- 172.21.15.82:0/110045786 shutdown_connections 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 --2- 172.21.15.82:0/110045786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55617621d7e0 0x55617621fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 --2- 172.21.15.82:0/110045786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x55617621d2a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 --2- 172.21.15.82:0/110045786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 0x5561762144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 -- 172.21.15.82:0/110045786 >> 172.21.15.82:0/110045786 conn(0x55617620ea10 msgr2=0x55617620edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 -- 172.21.15.82:0/110045786 shutdown_connections 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 -- 172.21.15.82:0/110045786 wait complete. 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 -- start start 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 Processor -- start 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 0x55617621a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556176214a10 0x55617621ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.294 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55617621d7e0 0x55617621b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556176173e00 con 0x556176214a10 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556176120520 con 0x5561762140f0 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5561761338e0 con 0x55617621d7e0 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e30430740 10 client.0 _ll_register_callbacks cb 0x55617616ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556176214a10 0x55617621ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556176214a10 0x55617621ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57698/0 (socket says 172.21.15.82:57698) 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e26ffd640 1 -- 172.21.15.82:0/2261523079 learned_addr learned my addr 172.21.15.82:0/2261523079 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.285+0000 7f8e267fc640 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55617621d7e0 0x55617621b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e267fc640 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 0x55617621a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e26ffd640 1 -- 172.21.15.82:0/2261523079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55617621d7e0 msgr2=0x55617621b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e26ffd640 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55617621d7e0 0x55617621b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e26ffd640 1 -- 172.21.15.82:0/2261523079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 msgr2=0x55617621a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e26ffd640 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 0x55617621a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e26ffd640 1 -- 172.21.15.82:0/2261523079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556175f58620 con 0x556176214a10 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e267fc640 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 0x55617621a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e26ffd640 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556176214a10 0x55617621ad70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8e18004630 tx=0x7f8e18003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3252c0e4e4a1a81d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e0aff5640 1 -- 172.21.15.82:0/2261523079 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18027070 con 0x556176214a10 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e0aff5640 1 -- 172.21.15.82:0/2261523079 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f8e18005240 con 0x556176214a10 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e30430740 1 -- 172.21.15.82:0/2261523079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e180043d0 con 0x556176214a10 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e0aff5640 1 -- 172.21.15.82:0/2261523079 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8e18033050 con 0x556176214a10 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e30430740 10 client.16551 fetch_fsmap learned FSMap version 27 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.286+0000 7f8e30430740 1 -- 172.21.15.82:0/2261523079 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55617622c390 con 0x556176214a10 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.287+0000 7f8e0aff5640 1 -- 172.21.15.82:0/2261523079 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e180043d0 con 0x556176214a10 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.287+0000 7f8e0aff5640 1 -- 172.21.15.82:0/2261523079 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f8e18004ba0 con 0x556176214a10 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.287+0000 7f8e30430740 10 client.16551 fetch_fsmap finished waiting for FSMap version 27 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.287+0000 7f8e30430740 10 client.16551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:44.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.287+0000 7f8e30430740 20 client.16551 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.287+0000 7f8e30430740 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55617622d7a0 0x55617622fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.287+0000 7f8e30430740 4 client.16551 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:27:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.287+0000 7f8e30430740 1 -- 172.21.15.82:0/2261523079 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556176185390 con 0x55617622d7a0 2024-03-27T07:27:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.287+0000 7f8e267fc640 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55617622d7a0 0x55617622fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.288+0000 7f8e0aff5640 10 client.16551 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:44.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.288+0000 7f8e267fc640 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55617622d7a0 0x55617622fb90 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28781339248f7a2 server_cookie=289ee8968ef4ebf8 in_seq=0 out_seq=0 2024-03-27T07:27:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e0aff5640 1 -- 172.21.15.82:0/2261523079 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556176185390 con 0x55617622d7a0 2024-03-27T07:27:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e0aff5640 10 client.16551 handle_command_reply: tid=0 2024-03-27T07:27:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 client.16551 shutdown 2024-03-27T07:27:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 -- 172.21.15.82:0/2261523079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556176214a10 msgr2=0x55617621ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556176214a10 0x55617621ad70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8e18004630 tx=0x7f8e18003820 comp rx=0 tx=0).stop 2024-03-27T07:27:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 -- 172.21.15.82:0/2261523079 shutdown_connections 2024-03-27T07:27:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55617622d7a0 0x55617622fb90 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556176214a10 0x55617621ad70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55617621d7e0 0x55617621b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e0aff5640 0 client.16551 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 --2- 172.21.15.82:0/2261523079 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 0x55617621a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 -- 172.21.15.82:0/2261523079 >> 172.21.15.82:0/2261523079 conn(0x55617620ea10 msgr2=0x556176210760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 -- 172.21.15.82:0/2261523079 shutdown_connections 2024-03-27T07:27:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 1 -- 172.21.15.82:0/2261523079 wait complete. 2024-03-27T07:27:44.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.291+0000 7f8e30430740 20 client.16551 trim_cache size 0 max 16384 2024-03-27T07:27:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.306+0000 7f8e30430740 1 Processor -- start 2024-03-27T07:27:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.306+0000 7f8e30430740 1 -- start start 2024-03-27T07:27:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e30430740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55617620ea10 0x55617621cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e30430740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 0x556176228eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e30430740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x556176235340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e30430740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281aff50 con 0x55617620ea10 2024-03-27T07:27:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e30430740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281ad7c0 con 0x5561762140f0 2024-03-27T07:27:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e30430740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281ab610 con 0x556176214a10 2024-03-27T07:27:44.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e267fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55617620ea10 0x55617621cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e267fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55617620ea10 0x55617621cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57706/0 (socket says 172.21.15.82:57706) 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e267fc640 1 -- 172.21.15.82:0/961299664 learned_addr learned my addr 172.21.15.82:0/961299664 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e26ffd640 1 --2- 172.21.15.82:0/961299664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 0x556176228eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e267fc640 1 --2- 172.21.15.82:0/961299664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x556176235340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e267fc640 1 -- 172.21.15.82:0/961299664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 msgr2=0x556176235340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e267fc640 1 --2- 172.21.15.82:0/961299664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x556176235340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e267fc640 1 -- 172.21.15.82:0/961299664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 msgr2=0x556176228eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e267fc640 1 --2- 172.21.15.82:0/961299664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 0x556176228eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e267fc640 1 -- 172.21.15.82:0/961299664 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55617621ff00 con 0x55617620ea10 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e267fc640 1 --2- 172.21.15.82:0/961299664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55617620ea10 0x55617621cf60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009230 tx=0x7f8e1c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a8ff893da0a5e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e0cff9640 1 -- 172.21.15.82:0/961299664 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c04c040 con 0x55617620ea10 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e0cff9640 1 -- 172.21.15.82:0/961299664 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e1c04ed30 con 0x55617620ea10 2024-03-27T07:27:44.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.307+0000 7f8e0cff9640 1 -- 172.21.15.82:0/961299664 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0046c0 con 0x55617620ea10 2024-03-27T07:27:44.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.308+0000 7f8e30430740 1 -- 172.21.15.82:0/961299664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55617620ea10 msgr2=0x55617621cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.308+0000 7f8e30430740 1 --2- 172.21.15.82:0/961299664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55617620ea10 0x55617621cf60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009230 tx=0x7f8e1c005fd0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.308+0000 7f8e30430740 1 -- 172.21.15.82:0/961299664 shutdown_connections 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.308+0000 7f8e30430740 1 --2- 172.21.15.82:0/961299664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x556176235340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.308+0000 7f8e30430740 1 --2- 172.21.15.82:0/961299664 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5561762140f0 0x556176228eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.308+0000 7f8e30430740 1 --2- 172.21.15.82:0/961299664 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55617620ea10 0x55617621cf60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.308+0000 7f8e30430740 1 -- 172.21.15.82:0/961299664 >> 172.21.15.82:0/961299664 conn(0x55617622ff00 msgr2=0x55617621a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.308+0000 7f8e30430740 1 -- 172.21.15.82:0/961299664 shutdown_connections 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.308+0000 7f8e30430740 1 -- 172.21.15.82:0/961299664 wait complete. 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e30430740 1 -- start start 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e30430740 1 Processor -- start 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e30430740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55617620ea10 0x556176217530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e30430740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 0x556176217a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e30430740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x556176217fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e30430740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281abc80 con 0x5561762140f0 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e30430740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281ad0f0 con 0x55617620ea10 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e30430740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281ac350 con 0x556176214a10 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e30430740 10 client.0 _ll_register_callbacks cb 0x7f8e200093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 0x556176217a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e26ffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 0x556176217a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57710/0 (socket says 172.21.15.82:57710) 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e26ffd640 1 -- 172.21.15.82:0/1785603749 learned_addr learned my addr 172.21.15.82:0/1785603749 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e267fc640 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55617620ea10 0x556176217530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e267fc640 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x556176217fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e26ffd640 1 -- 172.21.15.82:0/1785603749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 msgr2=0x556176217fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e26ffd640 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x556176217fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e26ffd640 1 -- 172.21.15.82:0/1785603749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55617620ea10 msgr2=0x556176217530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e26ffd640 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55617620ea10 0x556176217530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.309+0000 7f8e26ffd640 1 -- 172.21.15.82:0/1785603749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556176292ad0 con 0x5561762140f0 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e26ffd640 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 0x556176217a70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009cf0 tx=0x7f8e18005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d93eb7abe42628c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e0aff5640 1 -- 172.21.15.82:0/1785603749 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1803c060 con 0x5561762140f0 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e0aff5640 1 -- 172.21.15.82:0/1785603749 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f8e180097a0 con 0x5561762140f0 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e30430740 1 -- 172.21.15.82:0/1785603749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e1c04ed30 con 0x5561762140f0 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e0aff5640 1 -- 172.21.15.82:0/1785603749 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8e18027070 con 0x5561762140f0 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e30430740 10 client.16557 fetch_fsmap learned FSMap version 27 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e30430740 1 -- 172.21.15.82:0/1785603749 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556176293d60 con 0x5561762140f0 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e0aff5640 1 -- 172.21.15.82:0/1785603749 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e1c04ed30 con 0x5561762140f0 2024-03-27T07:27:44.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e0aff5640 1 -- 172.21.15.82:0/1785603749 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f8e18004fd0 con 0x5561762140f0 2024-03-27T07:27:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e30430740 10 client.16557 fetch_fsmap finished waiting for FSMap version 27 2024-03-27T07:27:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e30430740 10 client.16557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e30430740 20 client.16557 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e30430740 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55617621d7e0 0x556176296520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e30430740 4 client.16557 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:27:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e30430740 1 -- 172.21.15.82:0/1785603749 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55617617f6e0 con 0x55617621d7e0 2024-03-27T07:27:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.310+0000 7f8e267fc640 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55617621d7e0 0x556176296520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.311+0000 7f8e0aff5640 10 client.16557 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:44.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:44.311+0000 7f8e267fc640 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55617621d7e0 0x556176296520 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c669586743171f server_cookie=e5f6eae15394c60f in_seq=0 out_seq=0 2024-03-27T07:27:44.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:44 smithi082 ceph-mon[32178]: pgmap v127: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 1.63k op/s 2024-03-27T07:27:44.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:44 smithi149 ceph-mon[36065]: pgmap v127: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 1.63k op/s 2024-03-27T07:27:44.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:44 smithi153 ceph-mon[36179]: pgmap v127: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 1.63k op/s 2024-03-27T07:27:45.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:45 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:27:45.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:45 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:27:45.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:45 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:27:46.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e0aff5640 1 -- 172.21.15.82:0/1785603749 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55617617f6e0 con 0x55617621d7e0 2024-03-27T07:27:46.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e0aff5640 10 client.16557 handle_command_reply: tid=0 2024-03-27T07:27:46.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e30430740 1 client.16557 shutdown 2024-03-27T07:27:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e30430740 1 -- 172.21.15.82:0/1785603749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 msgr2=0x556176217a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:46.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e30430740 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 0x556176217a70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009cf0 tx=0x7f8e18005dc0 comp rx=0 tx=0).stop 2024-03-27T07:27:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e30430740 1 -- 172.21.15.82:0/1785603749 shutdown_connections 2024-03-27T07:27:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e30430740 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55617621d7e0 0x556176296520 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e30430740 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5561762140f0 0x556176217a70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e30430740 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556176214a10 0x556176217fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e30430740 1 --2- 172.21.15.82:0/1785603749 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55617620ea10 0x556176217530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:46.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.141+0000 7f8e30430740 1 -- 172.21.15.82:0/1785603749 >> 172.21.15.82:0/1785603749 conn(0x55617622ff00 msgr2=0x55617620da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.140+0000 7f8e0aff5640 0 client.16557 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.141+0000 7f8e30430740 1 -- 172.21.15.82:0/1785603749 shutdown_connections 2024-03-27T07:27:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.141+0000 7f8e30430740 1 -- 172.21.15.82:0/1785603749 wait complete. 2024-03-27T07:27:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.141+0000 7f8e30430740 20 client.16557 trim_cache size 0 max 16384 2024-03-27T07:27:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:27:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:27:46.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:27:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:27:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.144+0000 7f8e2d772640 1 -- 172.21.15.82:0/3611271525 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8e100a3820 msgr2=0x7f8e100a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.144+0000 7f8e2d772640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8e100a3820 0x7f8e100a5ce0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e200cdce0 tx=0x7f8e2006f350 comp rx=0 tx=0).stop 2024-03-27T07:27:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.144+0000 7f8e2d772640 1 -- 172.21.15.82:0/3611271525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e281059f0 msgr2=0x7f8e2819cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.144+0000 7f8e2d772640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e281059f0 0x7f8e2819cb10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000ec70 tx=0x7f8e2000c6a0 comp rx=0 tx=0).stop 2024-03-27T07:27:46.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.144+0000 7f8e2d772640 1 -- 172.21.15.82:0/3611271525 shutdown_connections 2024-03-27T07:27:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.144+0000 7f8e2d772640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8e100a3820 0x7f8e100a5ce0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.144+0000 7f8e2d772640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8e281059f0 0x7f8e2819cb10 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.144+0000 7f8e2d772640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28101660 0x7f8e28198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.144+0000 7f8e2d772640 1 --2- 172.21.15.82:0/3611271525 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8e28100ca0 0x7f8e28198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.145+0000 7f8e2d772640 1 -- 172.21.15.82:0/3611271525 >> 172.21.15.82:0/3611271525 conn(0x7f8e280778b0 msgr2=0x7f8e2806a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.145+0000 7f8e2d772640 1 -- 172.21.15.82:0/3611271525 shutdown_connections 2024-03-27T07:27:46.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:46.146+0000 7f8e2d772640 1 -- 172.21.15.82:0/3611271525 wait complete. 2024-03-27T07:27:46.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:46 smithi149 ceph-mon[36065]: pgmap v128: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 641 op/s 2024-03-27T07:27:46.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:46 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:27:46.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:46 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:27:46.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:46 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:27:46.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:46 smithi153 ceph-mon[36179]: pgmap v128: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 641 op/s 2024-03-27T07:27:46.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:46 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:27:46.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:46 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:27:46.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:46 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:27:46.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:46 smithi082 ceph-mon[32178]: pgmap v128: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 641 op/s 2024-03-27T07:27:46.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:46 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:27:46.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:46 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:27:46.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:46 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:27:47.158 INFO:tasks.workunit.client.0.smithi082.stdout: 194 1703362 747 1155213 767 680888 1019 2024-03-27T07:27:47.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:47 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:47.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:47 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:47.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:47 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:27:48.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:48 smithi149 ceph-mon[36065]: pgmap v129: 97 pgs: 97 active+clean; 779 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.8 MiB/s wr, 1.68k op/s 2024-03-27T07:27:48.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:48 smithi153 ceph-mon[36179]: pgmap v129: 97 pgs: 97 active+clean; 779 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.8 MiB/s wr, 1.68k op/s 2024-03-27T07:27:48.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:48 smithi082 ceph-mon[32178]: pgmap v129: 97 pgs: 97 active+clean; 779 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.8 MiB/s wr, 1.68k op/s 2024-03-27T07:27:50.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:50 smithi149 ceph-mon[36065]: pgmap v130: 97 pgs: 97 active+clean; 779 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 1.21k op/s 2024-03-27T07:27:50.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:50 smithi153 ceph-mon[36179]: pgmap v130: 97 pgs: 97 active+clean; 779 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 1.21k op/s 2024-03-27T07:27:50.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:50 smithi082 ceph-mon[32178]: pgmap v130: 97 pgs: 97 active+clean; 779 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 1.21k op/s 2024-03-27T07:27:52.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:52 smithi149 ceph-mon[36065]: pgmap v131: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 1.22k op/s 2024-03-27T07:27:52.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:52 smithi153 ceph-mon[36179]: pgmap v131: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 1.22k op/s 2024-03-27T07:27:52.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:52 smithi082 ceph-mon[32178]: pgmap v131: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 1.22k op/s 2024-03-27T07:27:54.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:54 smithi149 ceph-mon[36065]: pgmap v132: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 1.29k op/s 2024-03-27T07:27:54.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:54 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:27:54.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:54 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:27:54.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:54 smithi153 ceph-mon[36179]: pgmap v132: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 1.29k op/s 2024-03-27T07:27:54.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:54 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:27:54.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:54 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:27:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:54 smithi082 ceph-mon[32178]: pgmap v132: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 1.29k op/s 2024-03-27T07:27:54.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:54 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:27:54.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:54 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:27:55.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:55 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:27:55.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:55 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:27:55.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:55 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:27:56.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:56 smithi149 ceph-mon[36065]: pgmap v133: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 1.13k op/s 2024-03-27T07:27:56.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:56 smithi153 ceph-mon[36179]: pgmap v133: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 1.13k op/s 2024-03-27T07:27:56.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:56 smithi082 ceph-mon[32178]: pgmap v133: 97 pgs: 97 active+clean; 775 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 1.13k op/s 2024-03-27T07:27:57.162 INFO:tasks.workunit.client.0.smithi082.stdout: 209 2448557 1122 1702720 1156 951216 999 2024-03-27T07:27:58.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:27:58 smithi149 ceph-mon[36065]: pgmap v134: 97 pgs: 97 active+clean; 789 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 1.25k op/s 2024-03-27T07:27:58.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:27:58 smithi153 ceph-mon[36179]: pgmap v134: 97 pgs: 97 active+clean; 789 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 1.25k op/s 2024-03-27T07:27:58.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:27:58 smithi082 ceph-mon[32178]: pgmap v134: 97 pgs: 97 active+clean; 789 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.2 MiB/s wr, 1.25k op/s 2024-03-27T07:27:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.309+0000 7f5259442640 1 -- 172.21.15.82:0/1806860005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52541083b0 msgr2=0x7f5254108790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.309+0000 7f5259442640 1 --2- 172.21.15.82:0/1806860005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52541083b0 0x7f5254108790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f524c009ca0 tx=0x7f524c02c120 comp rx=0 tx=0).stop 2024-03-27T07:27:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.310+0000 7f5259442640 1 -- 172.21.15.82:0/1806860005 shutdown_connections 2024-03-27T07:27:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.310+0000 7f5259442640 1 --2- 172.21.15.82:0/1806860005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f525410d480 0x7f5254115050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.310+0000 7f5259442640 1 --2- 172.21.15.82:0/1806860005 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5254108d60 0x7f525410cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.310+0000 7f5259442640 1 --2- 172.21.15.82:0/1806860005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52541083b0 0x7f5254108790 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.310+0000 7f5259442640 1 -- 172.21.15.82:0/1806860005 >> 172.21.15.82:0/1806860005 conn(0x7f52540760c0 msgr2=0x7f52540784e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.310+0000 7f5259442640 1 -- 172.21.15.82:0/1806860005 shutdown_connections 2024-03-27T07:27:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.310+0000 7f5259442640 1 -- 172.21.15.82:0/1806860005 wait complete. 2024-03-27T07:27:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.311+0000 7f5259442640 1 Processor -- start 2024-03-27T07:27:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.311+0000 7f5259442640 1 -- start start 2024-03-27T07:27:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.311+0000 7f5259442640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52541083b0 0x7f52541a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.312+0000 7f5259442640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f525410d480 0x7f52541a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.312+0000 7f5259442640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f525419e7e0 0x7f525419ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.312+0000 7f5259442640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5254118560 con 0x7f525410d480 2024-03-27T07:27:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.312+0000 7f5259442640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f52541183e0 con 0x7f52541083b0 2024-03-27T07:27:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.312+0000 7f5259442640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f52541186e0 con 0x7f525419e7e0 2024-03-27T07:27:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.313+0000 7f52527fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f525410d480 0x7f52541a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.313+0000 7f52527fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f525410d480 0x7f52541a4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45804/0 (socket says 172.21.15.82:45804) 2024-03-27T07:27:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.313+0000 7f52527fc640 1 -- 172.21.15.82:0/2489399928 learned_addr learned my addr 172.21.15.82:0/2489399928 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.313+0000 7f5252ffd640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52541083b0 0x7f52541a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.313+0000 7f52537fe640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f525419e7e0 0x7f525419ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.313+0000 7f5252ffd640 1 -- 172.21.15.82:0/2489399928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f525419e7e0 msgr2=0x7f525419ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.313+0000 7f5252ffd640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f525419e7e0 0x7f525419ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.313+0000 7f5252ffd640 1 -- 172.21.15.82:0/2489399928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f525410d480 msgr2=0x7f52541a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.314+0000 7f5252ffd640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f525410d480 0x7f52541a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.314+0000 7f5252ffd640 1 -- 172.21.15.82:0/2489399928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525419f370 con 0x7f52541083b0 2024-03-27T07:27:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.314+0000 7f5252ffd640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52541083b0 0x7f52541a4670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f524c02c730 tx=0x7f524c035ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.314+0000 7f5243fff640 1 -- 172.21.15.82:0/2489399928 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c039040 con 0x7f52541083b0 2024-03-27T07:27:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.314+0000 7f5259442640 1 -- 172.21.15.82:0/2489399928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525419f600 con 0x7f52541083b0 2024-03-27T07:27:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.314+0000 7f5259442640 1 -- 172.21.15.82:0/2489399928 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52541ab750 con 0x7f52541083b0 2024-03-27T07:27:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.318+0000 7f525c01f740 1 Processor -- start 2024-03-27T07:27:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.318+0000 7f5243fff640 1 -- 172.21.15.82:0/2489399928 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f524c035c50 con 0x7f52541083b0 2024-03-27T07:27:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.318+0000 7f5243fff640 1 -- 172.21.15.82:0/2489399928 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c004280 con 0x7f52541083b0 2024-03-27T07:27:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.320+0000 7f5243fff640 1 -- 172.21.15.82:0/2489399928 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f524c046030 con 0x7f52541083b0 2024-03-27T07:27:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.321+0000 7f5243fff640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f523c0a3a50 0x7f523c0a5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.321+0000 7f5243fff640 1 -- 172.21.15.82:0/2489399928 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f524c0f1b10 con 0x7f52541083b0 2024-03-27T07:27:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.324+0000 7f525c01f740 1 -- start start 2024-03-27T07:27:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.324+0000 7f525c01f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcfa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.324+0000 7f525c01f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcfad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.324+0000 7f525c01f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfd03560 0x55b3cfd05950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.324+0000 7f525c01f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b3cfcc0cd0 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.324+0000 7f525c01f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b3cfc05950 con 0x55b3cfcf9e50 2024-03-27T07:27:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.324+0000 7f525c01f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b3cfc5de50 con 0x55b3cfd03560 2024-03-27T07:27:59.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.325+0000 7f52527fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcfad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.325+0000 7f5252ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcfa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.326+0000 7f5252ffd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcfa3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:48178/0 (socket says 172.21.15.82:48178) 2024-03-27T07:27:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.326+0000 7f5252ffd640 1 -- 172.21.15.82:0/3888612645 learned_addr learned my addr 172.21.15.82:0/3888612645 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.326+0000 7f52537fe640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f523c0a3a50 0x7f523c0a5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.327+0000 7f52537fe640 1 --2- 172.21.15.82:0/3888612645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfd03560 0x55b3cfd05950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.327+0000 7f52537fe640 1 -- 172.21.15.82:0/3888612645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcf9e50 msgr2=0x55b3cfcfa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.327+0000 7f52537fe640 1 --2- 172.21.15.82:0/3888612645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcfa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.327+0000 7f52537fe640 1 -- 172.21.15.82:0/3888612645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcfa8f0 msgr2=0x55b3cfcfad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.327+0000 7f52537fe640 1 --2- 172.21.15.82:0/3888612645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcfad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.327+0000 7f52537fe640 1 -- 172.21.15.82:0/3888612645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3cf972210 con 0x55b3cfd03560 2024-03-27T07:27:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.327+0000 7f52537fe640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f523c0a3a50 0x7f523c0a5f10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5248005fd0 tx=0x7f52480137d0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.328+0000 7f52537fe640 1 --2- 172.21.15.82:0/3888612645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfd03560 0x55b3cfd05950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f524800d9b0 tx=0x7f524801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea7a07fa395efeea server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.331+0000 7f5259442640 1 -- 172.21.15.82:0/3888612645 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524801f6e0 con 0x55b3cfd03560 2024-03-27T07:27:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.331+0000 7f5259442640 1 -- 172.21.15.82:0/3888612645 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f524801fd60 con 0x55b3cfd03560 2024-03-27T07:27:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.331+0000 7f5259442640 1 -- 172.21.15.82:0/3888612645 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524801ed80 con 0x55b3cfd03560 2024-03-27T07:27:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.333+0000 7f525c01f740 1 -- 172.21.15.82:0/3888612645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfd03560 msgr2=0x55b3cfd05950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.333+0000 7f525c01f740 1 --2- 172.21.15.82:0/3888612645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfd03560 0x55b3cfd05950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f524800d9b0 tx=0x7f524801b000 comp rx=0 tx=0).stop 2024-03-27T07:27:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.334+0000 7f525c01f740 1 -- 172.21.15.82:0/3888612645 shutdown_connections 2024-03-27T07:27:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.334+0000 7f525c01f740 1 --2- 172.21.15.82:0/3888612645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcfad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.334+0000 7f525c01f740 1 --2- 172.21.15.82:0/3888612645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfd03560 0x55b3cfd05950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.334+0000 7f525c01f740 1 --2- 172.21.15.82:0/3888612645 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcfa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.334+0000 7f525c01f740 1 -- 172.21.15.82:0/3888612645 >> 172.21.15.82:0/3888612645 conn(0x55b3cfcf4cd0 msgr2=0x55b3cfcf50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.336+0000 7f525c01f740 1 -- 172.21.15.82:0/3888612645 shutdown_connections 2024-03-27T07:27:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.336+0000 7f525c01f740 1 -- 172.21.15.82:0/3888612645 wait complete. 2024-03-27T07:27:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.336+0000 7f525c01f740 1 -- start start 2024-03-27T07:27:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.336+0000 7f525c01f740 1 Processor -- start 2024-03-27T07:27:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.337+0000 7f525c01f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcf9e50 0x55b3cfd005f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.337+0000 7f525c01f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfd00b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.337+0000 7f525c01f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfd03560 0x55b3cfd01070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.337+0000 7f525c01f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b3cfc59e00 con 0x55b3cfd03560 2024-03-27T07:27:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.337+0000 7f525c01f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b3cfc06520 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.337+0000 7f525c01f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b3cfc198e0 con 0x55b3cfcf9e50 2024-03-27T07:27:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.337+0000 7f525c01f740 10 client.0 _ll_register_callbacks cb 0x55b3cfc54a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.338+0000 7f5252ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcf9e50 0x55b3cfd005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.338+0000 7f5252ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcf9e50 0x55b3cfd005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42938/0 (socket says 172.21.15.82:42938) 2024-03-27T07:27:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.338+0000 7f5252ffd640 1 -- 172.21.15.82:0/3209380115 learned_addr learned my addr 172.21.15.82:0/3209380115 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.338+0000 7f52527fc640 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfd00b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.338+0000 7f5252ffd640 1 -- 172.21.15.82:0/3209380115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcfa8f0 msgr2=0x55b3cfd00b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.338+0000 7f5252ffd640 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfd00b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.338+0000 7f5252ffd640 1 -- 172.21.15.82:0/3209380115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfd03560 msgr2=0x55b3cfd01070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.338+0000 7f5252ffd640 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfd03560 0x55b3cfd01070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.338+0000 7f5252ffd640 1 -- 172.21.15.82:0/3209380115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3cfa3e620 con 0x55b3cfcf9e50 2024-03-27T07:27:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.339+0000 7f5252ffd640 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcf9e50 0x55b3cfd005f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f524c009ca0 tx=0x7f524c0be9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=717493c0f3503569 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.339+0000 7f523a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:27:59.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.339+0000 7f523a7fc640 1 -- 172.21.15.82:0/3209380115 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c0bf4e0 con 0x55b3cfcf9e50 2024-03-27T07:27:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.340+0000 7f523a7fc640 1 -- 172.21.15.82:0/3209380115 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f524c0ef4d0 con 0x55b3cfcf9e50 2024-03-27T07:27:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.340+0000 7f525c01f740 1 -- 172.21.15.82:0/3209380115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f524801fd60 con 0x55b3cfcf9e50 2024-03-27T07:27:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.340+0000 7f523a7fc640 1 -- 172.21.15.82:0/3209380115 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f524c0ef6d0 con 0x55b3cfcf9e50 2024-03-27T07:27:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.341+0000 7f525c01f740 10 client.26398 fetch_fsmap learned FSMap version 27 2024-03-27T07:27:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.341+0000 7f525c01f740 1 -- 172.21.15.82:0/3209380115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b3cfd343e0 con 0x55b3cfcf9e50 2024-03-27T07:27:59.343 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.341+0000 7f523a7fc640 1 -- 172.21.15.82:0/3209380115 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f524801fd60 con 0x55b3cfcf9e50 2024-03-27T07:27:59.344 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.342+0000 7f523a7fc640 1 -- 172.21.15.82:0/3209380115 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f524c03c030 con 0x55b3cfcf9e50 2024-03-27T07:27:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.343+0000 7f525c01f740 10 client.26398 fetch_fsmap finished waiting for FSMap version 27 2024-03-27T07:27:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.343+0000 7f525c01f740 10 client.26398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.343+0000 7f525c01f740 20 client.26398 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.343+0000 7f525c01f740 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b3cfd35970 0x55b3cfd37e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.343+0000 7f525c01f740 4 client.26398 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:27:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.343+0000 7f525c01f740 1 -- 172.21.15.82:0/3209380115 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3cfc6b390 con 0x55b3cfd35970 2024-03-27T07:27:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.343+0000 7f52527fc640 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b3cfd35970 0x55b3cfd37e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.344+0000 7f52527fc640 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b3cfd35970 0x55b3cfd37e10 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55ca0e3431ae5746 server_cookie=5ca8a91b174b5a18 in_seq=0 out_seq=0 2024-03-27T07:27:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.344+0000 7f523a7fc640 10 client.26398 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:59.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.348+0000 7f523a7fc640 1 -- 172.21.15.82:0/3209380115 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b3cfc6b390 con 0x55b3cfd35970 2024-03-27T07:27:59.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.348+0000 7f523a7fc640 10 client.26398 handle_command_reply: tid=0 2024-03-27T07:27:59.351 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.348+0000 7f525c01f740 1 client.26398 shutdown 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.349+0000 7f525c01f740 1 -- 172.21.15.82:0/3209380115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcf9e50 msgr2=0x55b3cfd005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.349+0000 7f525c01f740 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcf9e50 0x55b3cfd005f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f524c009ca0 tx=0x7f524c0be9e0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.349+0000 7f525c01f740 1 -- 172.21.15.82:0/3209380115 shutdown_connections 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.349+0000 7f525c01f740 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b3cfd35970 0x55b3cfd37e10 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.349+0000 7f525c01f740 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfd03560 0x55b3cfd01070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.349+0000 7f525c01f740 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfd00b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.349+0000 7f525c01f740 1 --2- 172.21.15.82:0/3209380115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcf9e50 0x55b3cfd005f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.349+0000 7f525c01f740 1 -- 172.21.15.82:0/3209380115 >> 172.21.15.82:0/3209380115 conn(0x55b3cfcf4cd0 msgr2=0x55b3cfcf6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.349+0000 7f523a7fc640 0 client.26398 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.349+0000 7f525c01f740 1 -- 172.21.15.82:0/3209380115 shutdown_connections 2024-03-27T07:27:59.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.350+0000 7f525c01f740 1 -- 172.21.15.82:0/3209380115 wait complete. 2024-03-27T07:27:59.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.350+0000 7f525c01f740 20 client.26398 trim_cache size 0 max 16384 2024-03-27T07:27:59.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.379+0000 7f525c01f740 1 Processor -- start 2024-03-27T07:27:59.382 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.380+0000 7f525c01f740 1 -- start start 2024-03-27T07:27:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.380+0000 7f525c01f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcf4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.380+0000 7f525c01f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcffed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.380+0000 7f525c01f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfd03560 0x55b3cfd1fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.380+0000 7f525c01f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5234010ea0 con 0x55b3cfcf9e50 2024-03-27T07:27:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.380+0000 7f525c01f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f523400e710 con 0x55b3cfd03560 2024-03-27T07:27:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.380+0000 7f525c01f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f523400c610 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.381+0000 7f52527fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.381+0000 7f52527fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcffed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42952/0 (socket says 172.21.15.82:42952) 2024-03-27T07:27:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.381+0000 7f52527fc640 1 -- 172.21.15.82:0/3313633862 learned_addr learned my addr 172.21.15.82:0/3313633862 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:59.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.382+0000 7f52537fe640 1 --2- 172.21.15.82:0/3313633862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfd03560 0x55b3cfd1fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.382+0000 7f52527fc640 1 -- 172.21.15.82:0/3313633862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfd03560 msgr2=0x55b3cfd1fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:59.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.382+0000 7f52527fc640 1 --2- 172.21.15.82:0/3313633862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfd03560 0x55b3cfd1fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.382+0000 7f52527fc640 1 -- 172.21.15.82:0/3313633862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcf9e50 msgr2=0x55b3cfcf4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.382+0000 7f52527fc640 1 --2- 172.21.15.82:0/3313633862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcf4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.382+0000 7f52527fc640 1 -- 172.21.15.82:0/3313633862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3cfcf5650 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.383+0000 7f52527fc640 1 --2- 172.21.15.82:0/3313633862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcffed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5244004700 tx=0x7f5244005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4054ec540da9b70 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.383+0000 7f5240ff9640 1 -- 172.21.15.82:0/3313633862 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244027070 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.383+0000 7f5240ff9640 1 -- 172.21.15.82:0/3313633862 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52440221b0 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.383+0000 7f5240ff9640 1 -- 172.21.15.82:0/3313633862 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244003ab0 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.384+0000 7f525c01f740 1 -- 172.21.15.82:0/3313633862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 msgr2=0x55b3cfcffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:27:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.384+0000 7f525c01f740 1 --2- 172.21.15.82:0/3313633862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcffed0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5244004700 tx=0x7f5244005f90 comp rx=0 tx=0).stop 2024-03-27T07:27:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.384+0000 7f525c01f740 1 -- 172.21.15.82:0/3313633862 shutdown_connections 2024-03-27T07:27:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.384+0000 7f525c01f740 1 --2- 172.21.15.82:0/3313633862 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfd03560 0x55b3cfd1fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.384+0000 7f525c01f740 1 --2- 172.21.15.82:0/3313633862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcffed0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.384+0000 7f525c01f740 1 --2- 172.21.15.82:0/3313633862 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcf4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.385+0000 7f525c01f740 1 -- 172.21.15.82:0/3313633862 >> 172.21.15.82:0/3313633862 conn(0x55b3cfcf4cd0 msgr2=0x55b3cfcf69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:27:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.385+0000 7f525c01f740 1 -- 172.21.15.82:0/3313633862 shutdown_connections 2024-03-27T07:27:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.386+0000 7f525c01f740 1 -- 172.21.15.82:0/3313633862 wait complete. 2024-03-27T07:27:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.386+0000 7f525c01f740 1 -- start start 2024-03-27T07:27:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.386+0000 7f525c01f740 1 Processor -- start 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f525c01f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcfd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f525c01f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcfdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f525c01f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfd03560 0x55b3cfd9ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f525c01f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f523400cbd0 con 0x55b3cfcf9e50 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f525c01f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f523400e040 con 0x55b3cfd03560 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f525c01f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f523400d2a0 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f52527fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcfdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f525c01f740 10 client.0 _ll_register_callbacks cb 0x7f524c0bb130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f52527fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcfdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42962/0 (socket says 172.21.15.82:42962) 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f52527fc640 1 -- 172.21.15.82:0/2956717881 learned_addr learned my addr 172.21.15.82:0/2956717881 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:27:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.387+0000 7f5252ffd640 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcfd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.388+0000 7f52537fe640 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfd03560 0x55b3cfd9ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.388+0000 7f52527fc640 1 -- 172.21.15.82:0/2956717881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfd03560 msgr2=0x55b3cfd9ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.388+0000 7f52527fc640 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfd03560 0x55b3cfd9ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.388+0000 7f52527fc640 1 -- 172.21.15.82:0/2956717881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcf9e50 msgr2=0x55b3cfcfd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:27:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.388+0000 7f52527fc640 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcfd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.388+0000 7f52527fc640 1 -- 172.21.15.82:0/2956717881 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3cfd9b250 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.388+0000 7f52527fc640 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcfdaa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55b3cfd019a0 tx=0x7f5244012340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be55d980f320b2b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.388+0000 7f523a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.389+0000 7f523a7fc640 1 -- 172.21.15.82:0/2956717881 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5244027070 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.389+0000 7f525c01f740 1 -- 172.21.15.82:0/2956717881 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52440221b0 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.389+0000 7f523a7fc640 1 -- 172.21.15.82:0/2956717881 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f5244004440 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.389+0000 7f523a7fc640 1 -- 172.21.15.82:0/2956717881 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5244022360 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.389+0000 7f525c01f740 10 client.26404 fetch_fsmap learned FSMap version 27 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.389+0000 7f525c01f740 1 -- 172.21.15.82:0/2956717881 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b3cfd9c3c0 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.389+0000 7f523a7fc640 1 -- 172.21.15.82:0/2956717881 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52440221b0 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.389+0000 7f523a7fc640 1 -- 172.21.15.82:0/2956717881 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f524402c560 con 0x55b3cfcfa8f0 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.390+0000 7f525c01f740 10 client.26404 fetch_fsmap finished waiting for FSMap version 27 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.390+0000 7f525c01f740 10 client.26404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.390+0000 7f525c01f740 20 client.26404 populate_metadata read hostname 'smithi082' 2024-03-27T07:27:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.390+0000 7f525c01f740 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b3cfd9ca60 0x55b3cfd9ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:27:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.390+0000 7f525c01f740 4 client.26404 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:27:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.390+0000 7f525c01f740 1 -- 172.21.15.82:0/2956717881 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b3cfc656e0 con 0x55b3cfd9ca60 2024-03-27T07:27:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.390+0000 7f5252ffd640 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b3cfd9ca60 0x55b3cfd9ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:27:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.392+0000 7f5252ffd640 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b3cfd9ca60 0x55b3cfd9ee80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a547f6cd9a4065b server_cookie=48d0eba7f4ff7bb in_seq=0 out_seq=0 2024-03-27T07:27:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:27:59.392+0000 7f523a7fc640 10 client.26404 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:00.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:00 smithi149 ceph-mon[36065]: pgmap v135: 97 pgs: 97 active+clean; 792 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 235 op/s 2024-03-27T07:28:00.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:00 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:28:00.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:00 smithi153 ceph-mon[36179]: pgmap v135: 97 pgs: 97 active+clean; 792 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 235 op/s 2024-03-27T07:28:00.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:00 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:28:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:00 smithi082 ceph-mon[32178]: pgmap v135: 97 pgs: 97 active+clean; 792 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 235 op/s 2024-03-27T07:28:00.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:00 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:28:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.979+0000 7f523a7fc640 1 -- 172.21.15.82:0/2956717881 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b3cfc656e0 con 0x55b3cfd9ca60 2024-03-27T07:28:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.979+0000 7f523a7fc640 10 client.26404 handle_command_reply: tid=0 2024-03-27T07:28:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.979+0000 7f525c01f740 1 client.26404 shutdown 2024-03-27T07:28:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.979+0000 7f525c01f740 1 -- 172.21.15.82:0/2956717881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 msgr2=0x55b3cfcfdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.979+0000 7f525c01f740 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcfdaa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55b3cfd019a0 tx=0x7f5244012340 comp rx=0 tx=0).stop 2024-03-27T07:28:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.979+0000 7f525c01f740 1 -- 172.21.15.82:0/2956717881 shutdown_connections 2024-03-27T07:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.979+0000 7f525c01f740 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b3cfd03560 0x55b3cfd9ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.980+0000 7f525c01f740 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b3cfcfa8f0 0x55b3cfcfdaa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.980+0000 7f525c01f740 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b3cfd9ca60 0x55b3cfd9ee80 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.980+0000 7f525c01f740 1 --2- 172.21.15.82:0/2956717881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b3cfcf9e50 0x55b3cfcfd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.980+0000 7f525c01f740 1 -- 172.21.15.82:0/2956717881 >> 172.21.15.82:0/2956717881 conn(0x55b3cfcf4cd0 msgr2=0x55b3cfd005b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.980+0000 7f523a7fc640 0 client.26404 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.980+0000 7f525c01f740 1 -- 172.21.15.82:0/2956717881 shutdown_connections 2024-03-27T07:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.980+0000 7f525c01f740 1 -- 172.21.15.82:0/2956717881 wait complete. 2024-03-27T07:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:00.980+0000 7f525c01f740 20 client.26404 trim_cache size 0 max 16384 2024-03-27T07:28:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:28:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:28:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:28:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:28:01.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.014+0000 7f5241ffb640 1 -- 172.21.15.82:0/2489399928 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f523c0a3a50 msgr2=0x7f523c0a5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.014+0000 7f5241ffb640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f523c0a3a50 0x7f523c0a5f10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5248005fd0 tx=0x7f52480137d0 comp rx=0 tx=0).stop 2024-03-27T07:28:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.014+0000 7f5241ffb640 1 -- 172.21.15.82:0/2489399928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52541083b0 msgr2=0x7f52541a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.014+0000 7f5241ffb640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52541083b0 0x7f52541a4670 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f524c02c730 tx=0x7f524c035ae0 comp rx=0 tx=0).stop 2024-03-27T07:28:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.019+0000 7f5241ffb640 1 -- 172.21.15.82:0/2489399928 shutdown_connections 2024-03-27T07:28:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.019+0000 7f5241ffb640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f523c0a3a50 0x7f523c0a5f10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.019+0000 7f5241ffb640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f525410d480 0x7f52541a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.019+0000 7f5241ffb640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f525419e7e0 0x7f525419ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.019+0000 7f5241ffb640 1 --2- 172.21.15.82:0/2489399928 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f52541083b0 0x7f52541a4670 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.019+0000 7f5241ffb640 1 -- 172.21.15.82:0/2489399928 >> 172.21.15.82:0/2489399928 conn(0x7f52540760c0 msgr2=0x7f5254078380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.019+0000 7f5241ffb640 1 -- 172.21.15.82:0/2489399928 shutdown_connections 2024-03-27T07:28:01.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:01.020+0000 7f5241ffb640 1 -- 172.21.15.82:0/2489399928 wait complete. 2024-03-27T07:28:02.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:28:02.521 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:28:02.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:02 smithi149 ceph-mon[36065]: pgmap v136: 97 pgs: 97 active+clean; 800 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 298 op/s 2024-03-27T07:28:02.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:02 smithi153 ceph-mon[36179]: pgmap v136: 97 pgs: 97 active+clean; 800 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 298 op/s 2024-03-27T07:28:02.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:02 smithi082 ceph-mon[32178]: pgmap v136: 97 pgs: 97 active+clean; 800 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 298 op/s 2024-03-27T07:28:04.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:04 smithi149 ceph-mon[36065]: pgmap v137: 97 pgs: 97 active+clean; 902 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 1.08k op/s 2024-03-27T07:28:04.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:04 smithi153 ceph-mon[36179]: pgmap v137: 97 pgs: 97 active+clean; 902 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 1.08k op/s 2024-03-27T07:28:04.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:04 smithi082 ceph-mon[32178]: pgmap v137: 97 pgs: 97 active+clean; 902 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 1.08k op/s 2024-03-27T07:28:05.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.257+0000 7f455588b640 1 -- 172.21.15.82:0/2585330817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f455010ee60 msgr2=0x7f4550115640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:05.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.257+0000 7f455588b640 1 --2- 172.21.15.82:0/2585330817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f455010ee60 0x7f4550115640 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4540009890 tx=0x7f454002bb70 comp rx=0 tx=0).stop 2024-03-27T07:28:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.259+0000 7f455588b640 1 -- 172.21.15.82:0/2585330817 shutdown_connections 2024-03-27T07:28:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.259+0000 7f455588b640 1 --2- 172.21.15.82:0/2585330817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f455010ee60 0x7f4550115640 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.259+0000 7f455588b640 1 --2- 172.21.15.82:0/2585330817 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f455010e4c0 0x7f455010e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.259+0000 7f455588b640 1 --2- 172.21.15.82:0/2585330817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f455010d700 0x7f455010dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.259+0000 7f455588b640 1 -- 172.21.15.82:0/2585330817 >> 172.21.15.82:0/2585330817 conn(0x7f455006ca00 msgr2=0x7f455006ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.263+0000 7f455588b640 1 -- 172.21.15.82:0/2585330817 shutdown_connections 2024-03-27T07:28:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.263+0000 7f455588b640 1 -- 172.21.15.82:0/2585330817 wait complete. 2024-03-27T07:28:05.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.264+0000 7f455588b640 1 Processor -- start 2024-03-27T07:28:05.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.264+0000 7f455588b640 1 -- start start 2024-03-27T07:28:05.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.265+0000 7f455588b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f455010d700 0x7f45501a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.265+0000 7f455588b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f455010e4c0 0x7f45501a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.265+0000 7f455588b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f455010ee60 0x7f455019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.265+0000 7f454ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f455010e4c0 0x7f45501a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.265+0000 7f454ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f455010e4c0 0x7f45501a4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:48222/0 (socket says 172.21.15.82:48222) 2024-03-27T07:28:05.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.266+0000 7f455508a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f455010ee60 0x7f455019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.266+0000 7f455508a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f455010ee60 0x7f455019e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42974/0 (socket says 172.21.15.82:42974) 2024-03-27T07:28:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.266+0000 7f454ffff640 1 -- 172.21.15.82:0/282731870 learned_addr learned my addr 172.21.15.82:0/282731870 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.266+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4550118350 con 0x7f455010d700 2024-03-27T07:28:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.266+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f45501181d0 con 0x7f455010e4c0 2024-03-27T07:28:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.266+0000 7f4554889640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f455010d700 0x7f45501a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.266+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f45501184d0 con 0x7f455010ee60 2024-03-27T07:28:05.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.267+0000 7f454ffff640 1 -- 172.21.15.82:0/282731870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f455010ee60 msgr2=0x7f455019e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:05.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.267+0000 7f454ffff640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f455010ee60 0x7f455019e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.267+0000 7f454ffff640 1 -- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f455010d700 msgr2=0x7f45501a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:05.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.267+0000 7f454ffff640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f455010d700 0x7f45501a4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.267+0000 7f454ffff640 1 -- 172.21.15.82:0/282731870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455019ed80 con 0x7f455010e4c0 2024-03-27T07:28:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.267+0000 7f4554889640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f455010d700 0x7f45501a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.267+0000 7f454ffff640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f455010e4c0 0x7f45501a4940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f454800af10 tx=0x7f45480095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:05.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.267+0000 7f455508a640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f455010ee60 0x7f455019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:05.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.291+0000 7f454dffb640 1 -- 172.21.15.82:0/282731870 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454801a070 con 0x7f455010e4c0 2024-03-27T07:28:05.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.292+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455019f070 con 0x7f455010e4c0 2024-03-27T07:28:05.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.292+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45501ab2c0 con 0x7f455010e4c0 2024-03-27T07:28:05.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.292+0000 7f454dffb640 1 -- 172.21.15.82:0/282731870 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45480158f0 con 0x7f455010e4c0 2024-03-27T07:28:05.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.292+0000 7f454dffb640 1 -- 172.21.15.82:0/282731870 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480148e0 con 0x7f455010e4c0 2024-03-27T07:28:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.298+0000 7f45597b4740 1 Processor -- start 2024-03-27T07:28:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.298+0000 7f45597b4740 1 -- start start 2024-03-27T07:28:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.298+0000 7f45597b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.298+0000 7f45597b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 0x5607c307a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.298+0000 7f45597b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 0x5607c307cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.298+0000 7f45597b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607c2fd5860 con 0x5607c3071d90 2024-03-27T07:28:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.298+0000 7f45597b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5607c2f7d8d0 con 0x5607c307a970 2024-03-27T07:28:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.298+0000 7f45597b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5607c2fd1810 con 0x5607c3071470 2024-03-27T07:28:05.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f454dffb640 1 -- 172.21.15.82:0/282731870 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f454801d070 con 0x7f455010e4c0 2024-03-27T07:28:05.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f455508a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f455508a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42982/0 (socket says 172.21.15.82:42982) 2024-03-27T07:28:05.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f455508a640 1 -- 172.21.15.82:0/4276061808 learned_addr learned my addr 172.21.15.82:0/4276061808 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:05.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f454ffff640 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 0x5607c307cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f455508a640 1 -- 172.21.15.82:0/4276061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 msgr2=0x5607c307cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:05.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f4554889640 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 0x5607c307a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f455508a640 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 0x5607c307cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f455508a640 1 -- 172.21.15.82:0/4276061808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 msgr2=0x5607c307a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:05.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f455508a640 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 0x5607c307a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.299+0000 7f455508a640 1 -- 172.21.15.82:0/4276061808 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607c2f88120 con 0x5607c3071470 2024-03-27T07:28:05.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.300+0000 7f454ffff640 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 0x5607c307cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:05.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.300+0000 7f455508a640 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3071850 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4540036000 tx=0x7f4540009490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=657763f86cacbfa8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:05.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.300+0000 7f4554889640 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 0x5607c307a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:28:05.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.301+0000 7f454dffb640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f45380a3990 0x7f45380a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.302+0000 7f4554889640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f45380a3990 0x7f45380a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.303+0000 7f4554889640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f45380a3990 0x7f45380a5e50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5607c3070f40 tx=0x7f4544008040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:05.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.305+0000 7f454dffb640 1 -- 172.21.15.82:0/282731870 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f45480cf550 con 0x7f455010e4c0 2024-03-27T07:28:05.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.325+0000 7f4536ffd640 1 -- 172.21.15.82:0/4276061808 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4540032640 con 0x5607c3071470 2024-03-27T07:28:05.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.326+0000 7f4536ffd640 1 -- 172.21.15.82:0/4276061808 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4540032cc0 con 0x5607c3071470 2024-03-27T07:28:05.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.327+0000 7f45597b4740 1 -- 172.21.15.82:0/4276061808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 msgr2=0x5607c3071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:05.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.327+0000 7f45597b4740 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3071850 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4540036000 tx=0x7f4540009490 comp rx=0 tx=0).stop 2024-03-27T07:28:05.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.329+0000 7f45597b4740 1 -- 172.21.15.82:0/4276061808 shutdown_connections 2024-03-27T07:28:05.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.329+0000 7f45597b4740 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 0x5607c307a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.329+0000 7f45597b4740 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 0x5607c307cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.329+0000 7f45597b4740 1 --2- 172.21.15.82:0/4276061808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3071850 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.329+0000 7f45597b4740 1 -- 172.21.15.82:0/4276061808 >> 172.21.15.82:0/4276061808 conn(0x5607c306bba0 msgr2=0x5607c306bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:05.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.341+0000 7f45597b4740 1 -- 172.21.15.82:0/4276061808 shutdown_connections 2024-03-27T07:28:05.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.341+0000 7f45597b4740 1 -- 172.21.15.82:0/4276061808 wait complete. 2024-03-27T07:28:05.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.341+0000 7f45597b4740 1 -- start start 2024-03-27T07:28:05.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.341+0000 7f45597b4740 1 Processor -- start 2024-03-27T07:28:05.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.342+0000 7f45597b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071470 0x5607c3077920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.342+0000 7f45597b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071d90 0x5607c3077e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.342+0000 7f45597b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c307a970 0x5607c30783a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.342+0000 7f45597b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5607c307d750 con 0x5607c3071470 2024-03-27T07:28:05.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.342+0000 7f45597b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5607c2f90cd0 con 0x5607c3071d90 2024-03-27T07:28:05.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.342+0000 7f45597b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5607c307d8d0 con 0x5607c307a970 2024-03-27T07:28:05.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.342+0000 7f45597b4740 10 client.0 _ll_register_callbacks cb 0x5607c2f82ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:05.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f454ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071d90 0x5607c3077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f454ffff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071d90 0x5607c3077e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:48250/0 (socket says 172.21.15.82:48250) 2024-03-27T07:28:05.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f454ffff640 1 -- 172.21.15.82:0/2836346177 learned_addr learned my addr 172.21.15.82:0/2836346177 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:05.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f4554889640 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071470 0x5607c3077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f455508a640 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c307a970 0x5607c30783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f455508a640 1 -- 172.21.15.82:0/2836346177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071d90 msgr2=0x5607c3077e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:05.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f455508a640 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071d90 0x5607c3077e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f455508a640 1 -- 172.21.15.82:0/2836346177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071470 msgr2=0x5607c3077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:05.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f455508a640 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071470 0x5607c3077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f455508a640 1 -- 172.21.15.82:0/2836346177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607c2db37d0 con 0x5607c307a970 2024-03-27T07:28:05.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.343+0000 7f4554889640 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071470 0x5607c3077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:05.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.344+0000 7f455508a640 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c307a970 0x5607c30783a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4540035fd0 tx=0x7f4540003960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=928366f917af90ce server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:05.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.371+0000 7f452ffff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:28:05.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.371+0000 7f452ffff640 1 -- 172.21.15.82:0/2836346177 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454005c060 con 0x5607c307a970 2024-03-27T07:28:05.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.371+0000 7f45597b4740 1 -- 172.21.15.82:0/2836346177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4540032cc0 con 0x5607c307a970 2024-03-27T07:28:05.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.371+0000 7f452ffff640 1 -- 172.21.15.82:0/2836346177 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f454002c710 con 0x5607c307a970 2024-03-27T07:28:05.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.374+0000 7f452ffff640 1 -- 172.21.15.82:0/2836346177 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4540039040 con 0x5607c307a970 2024-03-27T07:28:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.374+0000 7f45597b4740 10 client.26416 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:05.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.374+0000 7f45597b4740 1 -- 172.21.15.82:0/2836346177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5607c2ce93f0 con 0x5607c307a970 2024-03-27T07:28:05.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.377+0000 7f452ffff640 1 -- 172.21.15.82:0/2836346177 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4540032cc0 con 0x5607c307a970 2024-03-27T07:28:05.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.379+0000 7f452ffff640 1 -- 172.21.15.82:0/2836346177 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f454003c070 con 0x5607c307a970 2024-03-27T07:28:05.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.379+0000 7f45597b4740 10 client.26416 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:05.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.379+0000 7f45597b4740 10 client.26416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:05.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.379+0000 7f45597b4740 20 client.26416 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:05.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.379+0000 7f45597b4740 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5607c307edc0 0x5607c3081220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.379+0000 7f45597b4740 4 client.26416 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:05.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.379+0000 7f45597b4740 1 -- 172.21.15.82:0/2836346177 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607c2fe2da0 con 0x5607c307edc0 2024-03-27T07:28:05.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.379+0000 7f4554889640 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5607c307edc0 0x5607c3081220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.380+0000 7f4554889640 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5607c307edc0 0x5607c3081220 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=548b71404b441b77 server_cookie=a560dc4a5ebc4237 in_seq=0 out_seq=0 2024-03-27T07:28:05.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.382+0000 7f452ffff640 10 client.26416 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f452ffff640 1 -- 172.21.15.82:0/2836346177 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5607c2fe2da0 con 0x5607c307edc0 2024-03-27T07:28:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f452ffff640 10 client.26416 handle_command_reply: tid=0 2024-03-27T07:28:05.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f45597b4740 1 client.26416 shutdown 2024-03-27T07:28:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f45597b4740 1 -- 172.21.15.82:0/2836346177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c307a970 msgr2=0x5607c30783a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f45597b4740 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c307a970 0x5607c30783a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4540035fd0 tx=0x7f4540003960 comp rx=0 tx=0).stop 2024-03-27T07:28:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f45597b4740 1 -- 172.21.15.82:0/2836346177 shutdown_connections 2024-03-27T07:28:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f45597b4740 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c307a970 0x5607c30783a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f45597b4740 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071d90 0x5607c3077e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f45597b4740 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5607c307edc0 0x5607c3081220 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f45597b4740 1 --2- 172.21.15.82:0/2836346177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071470 0x5607c3077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f45597b4740 1 -- 172.21.15.82:0/2836346177 >> 172.21.15.82:0/2836346177 conn(0x5607c306bba0 msgr2=0x5607c306d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:05.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.389+0000 7f452ffff640 0 client.26416 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:05.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.391+0000 7f45597b4740 1 -- 172.21.15.82:0/2836346177 shutdown_connections 2024-03-27T07:28:05.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.391+0000 7f45597b4740 1 -- 172.21.15.82:0/2836346177 wait complete. 2024-03-27T07:28:05.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.391+0000 7f45597b4740 20 client.26416 trim_cache size 0 max 16384 2024-03-27T07:28:05.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.623+0000 7f45597b4740 1 Processor -- start 2024-03-27T07:28:05.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.635+0000 7f45597b4740 1 -- start start 2024-03-27T07:28:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.637+0000 7f45597b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071470 0x5607c307a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.637+0000 7f45597b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071d90 0x5607c306d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.637+0000 7f45597b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c307a970 0x5607c3074ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.637+0000 7f45597b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f453c010f00 con 0x5607c307a970 2024-03-27T07:28:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.637+0000 7f45597b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f453c00e770 con 0x5607c3071470 2024-03-27T07:28:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.637+0000 7f45597b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f453c00c670 con 0x5607c3071d90 2024-03-27T07:28:05.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.637+0000 7f454ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071d90 0x5607c306d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.637+0000 7f454ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071d90 0x5607c306d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:43010/0 (socket says 172.21.15.82:43010) 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.637+0000 7f454ffff640 1 -- 172.21.15.82:0/3871310957 learned_addr learned my addr 172.21.15.82:0/3871310957 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.638+0000 7f455508a640 1 --2- 172.21.15.82:0/3871310957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c307a970 0x5607c3074ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.638+0000 7f4554889640 1 --2- 172.21.15.82:0/3871310957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071470 0x5607c307a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.638+0000 7f454ffff640 1 -- 172.21.15.82:0/3871310957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071470 msgr2=0x5607c307a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.638+0000 7f454ffff640 1 --2- 172.21.15.82:0/3871310957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071470 0x5607c307a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.638+0000 7f454ffff640 1 -- 172.21.15.82:0/3871310957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c307a970 msgr2=0x5607c3074ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.638+0000 7f454ffff640 1 --2- 172.21.15.82:0/3871310957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c307a970 0x5607c3074ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.638+0000 7f454ffff640 1 -- 172.21.15.82:0/3871310957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607c2ca90f0 con 0x5607c3071d90 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.638+0000 7f455508a640 1 --2- 172.21.15.82:0/3871310957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c307a970 0x5607c3074ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:05.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.638+0000 7f454ffff640 1 --2- 172.21.15.82:0/3871310957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071d90 0x5607c306d6e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f454809b710 tx=0x7f45480143b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65e770536362a1c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:05.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.642+0000 7f45367fc640 1 -- 172.21.15.82:0/3871310957 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454809b780 con 0x5607c3071d90 2024-03-27T07:28:05.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.642+0000 7f45367fc640 1 -- 172.21.15.82:0/3871310957 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f454809fa80 con 0x5607c3071d90 2024-03-27T07:28:05.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.642+0000 7f45367fc640 1 -- 172.21.15.82:0/3871310957 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480156f0 con 0x5607c3071d90 2024-03-27T07:28:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.643+0000 7f45597b4740 1 -- 172.21.15.82:0/3871310957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071d90 msgr2=0x5607c306d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:05.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.643+0000 7f45597b4740 1 --2- 172.21.15.82:0/3871310957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071d90 0x5607c306d6e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f454809b710 tx=0x7f45480143b0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.659+0000 7f45597b4740 1 -- 172.21.15.82:0/3871310957 shutdown_connections 2024-03-27T07:28:05.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.659+0000 7f45597b4740 1 --2- 172.21.15.82:0/3871310957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c307a970 0x5607c3074ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.659+0000 7f45597b4740 1 --2- 172.21.15.82:0/3871310957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071d90 0x5607c306d6e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.659+0000 7f45597b4740 1 --2- 172.21.15.82:0/3871310957 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c3071470 0x5607c307a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.659+0000 7f45597b4740 1 -- 172.21.15.82:0/3871310957 >> 172.21.15.82:0/3871310957 conn(0x5607c306bba0 msgr2=0x5607c306cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:05.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.659+0000 7f45597b4740 1 -- 172.21.15.82:0/3871310957 shutdown_connections 2024-03-27T07:28:05.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.660+0000 7f45597b4740 1 -- 172.21.15.82:0/3871310957 wait complete. 2024-03-27T07:28:05.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.660+0000 7f45597b4740 1 -- start start 2024-03-27T07:28:05.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.660+0000 7f45597b4740 1 Processor -- start 2024-03-27T07:28:05.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.661+0000 7f45597b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3097330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.661+0000 7f45597b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 0x5607c30956d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.661+0000 7f45597b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 0x5607c3095c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.661+0000 7f45597b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f453c00cc30 con 0x5607c3071d90 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.661+0000 7f45597b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f453c00e0a0 con 0x5607c307a970 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.661+0000 7f45597b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f453c00d300 con 0x5607c3071470 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.661+0000 7f45597b4740 10 client.0 _ll_register_callbacks cb 0x7f45400096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.661+0000 7f4554889640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3097330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.661+0000 7f4554889640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3097330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:43020/0 (socket says 172.21.15.82:43020) 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.661+0000 7f4554889640 1 -- 172.21.15.82:0/4206332350 learned_addr learned my addr 172.21.15.82:0/4206332350 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.662+0000 7f455508a640 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 0x5607c3095c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.662+0000 7f454ffff640 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 0x5607c30956d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.662+0000 7f455508a640 1 -- 172.21.15.82:0/4206332350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 msgr2=0x5607c3097330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:05.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.662+0000 7f455508a640 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3097330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.662+0000 7f455508a640 1 -- 172.21.15.82:0/4206332350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 msgr2=0x5607c30956d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:05.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.662+0000 7f455508a640 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 0x5607c30956d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.663+0000 7f455508a640 1 -- 172.21.15.82:0/4206332350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607c3096300 con 0x5607c307a970 2024-03-27T07:28:05.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.663+0000 7f4554889640 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3097330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:05.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.663+0000 7f454ffff640 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 0x5607c30956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:05.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.663+0000 7f455508a640 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 0x5607c3095c10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4540009780 tx=0x7f4540005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c45b115adc37ad8f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:05.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.689+0000 7f452ffff640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:28:05.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.689+0000 7f452ffff640 1 -- 172.21.15.82:0/4206332350 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454005c070 con 0x5607c307a970 2024-03-27T07:28:05.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.689+0000 7f452ffff640 1 -- 172.21.15.82:0/4206332350 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f45400579f0 con 0x5607c307a970 2024-03-27T07:28:05.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.689+0000 7f45597b4740 1 -- 172.21.15.82:0/4206332350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f454809fa80 con 0x5607c307a970 2024-03-27T07:28:05.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.692+0000 7f452ffff640 1 -- 172.21.15.82:0/4206332350 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f454002c1f0 con 0x5607c307a970 2024-03-27T07:28:05.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.692+0000 7f45597b4740 10 client.26414 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:05.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.692+0000 7f45597b4740 1 -- 172.21.15.82:0/4206332350 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5607c30f0750 con 0x5607c307a970 2024-03-27T07:28:05.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.693+0000 7f452ffff640 1 -- 172.21.15.82:0/4206332350 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f454809fa80 con 0x5607c307a970 2024-03-27T07:28:05.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.693+0000 7f452ffff640 1 -- 172.21.15.82:0/4206332350 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f454003c040 con 0x5607c307a970 2024-03-27T07:28:05.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.693+0000 7f45597b4740 10 client.26414 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:05.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.693+0000 7f45597b4740 10 client.26414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:05.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.693+0000 7f45597b4740 20 client.26414 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:05.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.693+0000 7f45597b4740 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5607c30f0e80 0x5607c30f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:05.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.693+0000 7f45597b4740 4 client.26414 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:28:05.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.693+0000 7f45597b4740 1 -- 172.21.15.82:0/4206332350 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5607c2fdd0f0 con 0x5607c30f0e80 2024-03-27T07:28:05.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.693+0000 7f4554889640 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5607c30f0e80 0x5607c30f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:05.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.694+0000 7f452ffff640 10 client.26414 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:05.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.694+0000 7f4554889640 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5607c30f0e80 0x5607c30f32a0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40b715d56519978c server_cookie=3bd71b255f12ca05 in_seq=0 out_seq=0 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.697+0000 7f452ffff640 1 -- 172.21.15.82:0/4206332350 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5607c2fdd0f0 con 0x5607c30f0e80 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.697+0000 7f452ffff640 10 client.26414 handle_command_reply: tid=0 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.697+0000 7f45597b4740 1 client.26414 shutdown 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 1 -- 172.21.15.82:0/4206332350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 msgr2=0x5607c3095c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 0x5607c3095c10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4540009780 tx=0x7f4540005f90 comp rx=0 tx=0).stop 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 1 -- 172.21.15.82:0/4206332350 shutdown_connections 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5607c30f0e80 0x5607c30f32a0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5607c3071d90 0x5607c30956d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5607c307a970 0x5607c3095c10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f452ffff640 0 client.26414 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 1 --2- 172.21.15.82:0/4206332350 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5607c3071470 0x5607c3097330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 1 -- 172.21.15.82:0/4206332350 >> 172.21.15.82:0/4206332350 conn(0x5607c306bba0 msgr2=0x5607c3078150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:05.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 1 -- 172.21.15.82:0/4206332350 shutdown_connections 2024-03-27T07:28:05.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 1 -- 172.21.15.82:0/4206332350 wait complete. 2024-03-27T07:28:05.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.698+0000 7f45597b4740 20 client.26414 trim_cache size 0 max 16384 2024-03-27T07:28:05.702 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:28:05.702 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-03-27T07:28:05.702 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-03-27T07:28:05.702 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:28:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.717+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f45380a3990 msgr2=0x7f45380a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.717+0000 7f455588b640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f45380a3990 0x7f45380a5e50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x5607c3070f40 tx=0x7f4544008040 comp rx=0 tx=0).stop 2024-03-27T07:28:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.717+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f455010e4c0 msgr2=0x7f45501a4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:05.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.717+0000 7f455588b640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f455010e4c0 0x7f45501a4940 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f454800af10 tx=0x7f45480095b0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.721+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 shutdown_connections 2024-03-27T07:28:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.721+0000 7f455588b640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f45380a3990 0x7f45380a5e50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.721+0000 7f455588b640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f455010ee60 0x7f455019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.721+0000 7f455588b640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f455010e4c0 0x7f45501a4940 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.721+0000 7f455588b640 1 --2- 172.21.15.82:0/282731870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f455010d700 0x7f45501a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:05.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.721+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 >> 172.21.15.82:0/282731870 conn(0x7f455006ca00 msgr2=0x7f45500720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:05.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.725+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 shutdown_connections 2024-03-27T07:28:05.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:05.725+0000 7f455588b640 1 -- 172.21.15.82:0/282731870 wait complete. 2024-03-27T07:28:05.767 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T07:28:05.767 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:28:06.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:06 smithi082 ceph-mon[32178]: pgmap v138: 97 pgs: 97 active+clean; 913 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.08k op/s 2024-03-27T07:28:06.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:06 smithi149 ceph-mon[36065]: pgmap v138: 97 pgs: 97 active+clean; 913 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.08k op/s 2024-03-27T07:28:06.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:06 smithi153 ceph-mon[36179]: pgmap v138: 97 pgs: 97 active+clean; 913 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 1.08k op/s 2024-03-27T07:28:07.162 INFO:tasks.workunit.client.0.smithi082.stdout: 221 2133946 709 1511200 759 814869 958 2024-03-27T07:28:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.297+0000 7f7f31615640 1 -- 172.21.15.82:0/38021410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f2c10dea0 msgr2=0x7f7f2c10e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.297+0000 7f7f31615640 1 --2- 172.21.15.82:0/38021410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f2c10dea0 0x7f7f2c10e280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009900 tx=0x7f7f1c02bc60 comp rx=0 tx=0).stop 2024-03-27T07:28:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.297+0000 7f7f31615640 1 -- 172.21.15.82:0/38021410 shutdown_connections 2024-03-27T07:28:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.297+0000 7f7f31615640 1 --2- 172.21.15.82:0/38021410 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c10d2c0 0x7f7f2c079e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.297+0000 7f7f31615640 1 --2- 172.21.15.82:0/38021410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f2c10e850 0x7f7f2c10cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.297+0000 7f7f31615640 1 --2- 172.21.15.82:0/38021410 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f2c10dea0 0x7f7f2c10e280 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.297+0000 7f7f31615640 1 -- 172.21.15.82:0/38021410 >> 172.21.15.82:0/38021410 conn(0x7f7f2c06ca60 msgr2=0x7f7f2c06ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.297+0000 7f7f31615640 1 -- 172.21.15.82:0/38021410 shutdown_connections 2024-03-27T07:28:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.297+0000 7f7f31615640 1 -- 172.21.15.82:0/38021410 wait complete. 2024-03-27T07:28:08.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.298+0000 7f7f31615640 1 Processor -- start 2024-03-27T07:28:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.298+0000 7f7f31615640 1 -- start start 2024-03-27T07:28:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.298+0000 7f7f31615640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c10d2c0 0x7f7f2c07e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.298+0000 7f7f31615640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f2c10dea0 0x7f7f2c07ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.298+0000 7f7f31615640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f2c080640 0x7f7f2c07f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.298+0000 7f7f31615640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c07d310 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.298+0000 7f7f31615640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c07d190 con 0x7f7f2c080640 2024-03-27T07:28:08.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.298+0000 7f7f31615640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c07d490 con 0x7f7f2c10dea0 2024-03-27T07:28:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.299+0000 7f7f2b7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f2c080640 0x7f7f2c07f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.299+0000 7f7f2b7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f2c080640 0x7f7f2c07f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:55756/0 (socket says 172.21.15.82:55756) 2024-03-27T07:28:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.299+0000 7f7f2b7fe640 1 -- 172.21.15.82:0/798030707 learned_addr learned my addr 172.21.15.82:0/798030707 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.299+0000 7f7f2a7fc640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f2c10dea0 0x7f7f2c07ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.299+0000 7f7f2affd640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c10d2c0 0x7f7f2c07e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.300+0000 7f7f2affd640 1 -- 172.21.15.82:0/798030707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f2c10dea0 msgr2=0x7f7f2c07ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.300+0000 7f7f2affd640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f2c10dea0 0x7f7f2c07ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.300+0000 7f7f2affd640 1 -- 172.21.15.82:0/798030707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f2c080640 msgr2=0x7f7f2c07f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:08.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.300+0000 7f7f2affd640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f2c080640 0x7f7f2c07f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:08.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.300+0000 7f7f2affd640 1 -- 172.21.15.82:0/798030707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c1c4740 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.301+0000 7f7f2affd640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c10d2c0 0x7f7f2c07e940 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c036040 tx=0x7f7f1c0044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:08.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.407+0000 7f7f13fff640 1 -- 172.21.15.82:0/798030707 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c052070 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.407+0000 7f7f31615640 1 -- 172.21.15.82:0/798030707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2c1b9ef0 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.407+0000 7f7f31615640 1 -- 172.21.15.82:0/798030707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f2c1ba3b0 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.413+0000 7f7f13fff640 1 -- 172.21.15.82:0/798030707 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f1c005310 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.413+0000 7f7f13fff640 1 -- 172.21.15.82:0/798030707 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c003ce0 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.413+0000 7f7f13fff640 1 -- 172.21.15.82:0/798030707 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f7f1c055070 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.414+0000 7f7f13fff640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f140a39b0 0x7f7f140a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:08.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.415+0000 7f7f2a7fc640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f140a39b0 0x7f7f140a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:08.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.415+0000 7f7f13fff640 1 -- 172.21.15.82:0/798030707 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f7f1c103a30 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.415+0000 7f7f2a7fc640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f140a39b0 0x7f7f140a5e70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c080100 tx=0x7f7f2000a2d0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:08.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.447+0000 7f7f31615640 1 -- 172.21.15.82:0/798030707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f18005290 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:08.461+0000 7f7f13fff640 1 -- 172.21.15.82:0/798030707 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7f1c0cfdf0 con 0x7f7f2c10d2c0 2024-03-27T07:28:08.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:08 smithi149 ceph-mon[36065]: pgmap v139: 97 pgs: 97 active+clean; 929 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 15 MiB/s wr, 1.17k op/s 2024-03-27T07:28:08.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:08 smithi153 ceph-mon[36179]: pgmap v139: 97 pgs: 97 active+clean; 929 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 15 MiB/s wr, 1.17k op/s 2024-03-27T07:28:08.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:08 smithi082 ceph-mon[32178]: pgmap v139: 97 pgs: 97 active+clean; 929 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 15 MiB/s wr, 1.17k op/s 2024-03-27T07:28:10.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:10 smithi149 ceph-mon[36065]: pgmap v140: 97 pgs: 97 active+clean; 929 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-03-27T07:28:10.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:10 smithi153 ceph-mon[36179]: pgmap v140: 97 pgs: 97 active+clean; 929 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-03-27T07:28:10.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:10 smithi082 ceph-mon[32178]: pgmap v140: 97 pgs: 97 active+clean; 929 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-03-27T07:28:12.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:12 smithi153 ceph-mon[36179]: pgmap v141: 97 pgs: 97 active+clean; 929 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.04k op/s 2024-03-27T07:28:12.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:12 smithi082 ceph-mon[32178]: pgmap v141: 97 pgs: 97 active+clean; 929 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.04k op/s 2024-03-27T07:28:13.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:12 smithi149 ceph-mon[36065]: pgmap v141: 97 pgs: 97 active+clean; 929 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 1.04k op/s 2024-03-27T07:28:13.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.587+0000 7f7f31615640 1 -- 172.21.15.82:0/798030707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f0c005120 con 0x7f7f2c10d2c0 2024-03-27T07:28:13.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.589+0000 7f7f13fff640 1 -- 172.21.15.82:0/798030707 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11866 (secure 0 0 0) 0x7f7f1c0d40f0 con 0x7f7f2c10d2c0 2024-03-27T07:28:13.592 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:28:13.592 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:27:58.714389+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:28:13.593 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-03-27T07:28:13.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.602+0000 7f7f11ffb640 1 -- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f140a39b0 msgr2=0x7f7f140a5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:13.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.602+0000 7f7f11ffb640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f140a39b0 0x7f7f140a5e70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c080100 tx=0x7f7f2000a2d0 comp rx=0 tx=0).stop 2024-03-27T07:28:13.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.603+0000 7f7f11ffb640 1 -- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c10d2c0 msgr2=0x7f7f2c07e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:13.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.603+0000 7f7f11ffb640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c10d2c0 0x7f7f2c07e940 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c036040 tx=0x7f7f1c0044f0 comp rx=0 tx=0).stop 2024-03-27T07:28:13.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.603+0000 7f7f11ffb640 1 -- 172.21.15.82:0/798030707 shutdown_connections 2024-03-27T07:28:13.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.603+0000 7f7f11ffb640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f140a39b0 0x7f7f140a5e70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:13.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.603+0000 7f7f11ffb640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f2c080640 0x7f7f2c07f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:13.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.604+0000 7f7f11ffb640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f2c10dea0 0x7f7f2c07ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:13.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.604+0000 7f7f11ffb640 1 --2- 172.21.15.82:0/798030707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f2c10d2c0 0x7f7f2c07e940 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:13.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.604+0000 7f7f11ffb640 1 -- 172.21.15.82:0/798030707 >> 172.21.15.82:0/798030707 conn(0x7f7f2c06ca60 msgr2=0x7f7f2c10aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:13.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.604+0000 7f7f11ffb640 1 -- 172.21.15.82:0/798030707 shutdown_connections 2024-03-27T07:28:13.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:13.604+0000 7f7f11ffb640 1 -- 172.21.15.82:0/798030707 wait complete. 2024-03-27T07:28:13.658 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T07:28:14.511 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:14 smithi082 ceph-mon[32178]: pgmap v142: 97 pgs: 97 active+clean; 944 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 14 MiB/s wr, 1.13k op/s 2024-03-27T07:28:14.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:14 smithi153 ceph-mon[36179]: pgmap v142: 97 pgs: 97 active+clean; 944 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 14 MiB/s wr, 1.13k op/s 2024-03-27T07:28:14.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:14 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/798030707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:28:14.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:14 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/798030707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:28:15.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:14 smithi149 ceph-mon[36065]: pgmap v142: 97 pgs: 97 active+clean; 944 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 14 MiB/s wr, 1.13k op/s 2024-03-27T07:28:15.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:14 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/798030707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:28:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.821+0000 7f91d3bc9640 1 -- 172.21.15.82:0/3776863792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91cc11b330 msgr2=0x7f91cc11d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.821+0000 7f91d3bc9640 1 --2- 172.21.15.82:0/3776863792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91cc11b330 0x7f91cc11d720 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009cd0 tx=0x7f91c402c100 comp rx=0 tx=0).stop 2024-03-27T07:28:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.821+0000 7f91d3bc9640 1 -- 172.21.15.82:0/3776863792 shutdown_connections 2024-03-27T07:28:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.821+0000 7f91d3bc9640 1 --2- 172.21.15.82:0/3776863792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc108be0 0x7f91cc109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.821+0000 7f91d3bc9640 1 --2- 172.21.15.82:0/3776863792 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91cc11b330 0x7f91cc11d720 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.821+0000 7f91d3bc9640 1 --2- 172.21.15.82:0/3776863792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91cc110170 0x7f91cc110550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.821+0000 7f91d3bc9640 1 -- 172.21.15.82:0/3776863792 >> 172.21.15.82:0/3776863792 conn(0x7f91cc06cb00 msgr2=0x7f91cc06cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:15.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.825+0000 7f91d3bc9640 1 -- 172.21.15.82:0/3776863792 shutdown_connections 2024-03-27T07:28:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.825+0000 7f91d3bc9640 1 -- 172.21.15.82:0/3776863792 wait complete. 2024-03-27T07:28:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.826+0000 7f91d3bc9640 1 Processor -- start 2024-03-27T07:28:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.826+0000 7f91d3bc9640 1 -- start start 2024-03-27T07:28:15.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.826+0000 7f91d3bc9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91cc108be0 0x7f91cc1198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.826+0000 7f91d3bc9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91cc110170 0x7f91cc1129b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.826+0000 7f91d3bc9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc11b330 0x7f91cc112ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.826+0000 7f91d3bc9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc120c20 con 0x7f91cc11b330 2024-03-27T07:28:15.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.826+0000 7f91d3bc9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc120aa0 con 0x7f91cc108be0 2024-03-27T07:28:15.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.826+0000 7f91d3bc9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc120da0 con 0x7f91cc110170 2024-03-27T07:28:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.826+0000 7f91d1965640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91cc108be0 0x7f91cc1198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.827+0000 7f91d1164640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91cc110170 0x7f91cc1129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.827+0000 7f91d1164640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91cc110170 0x7f91cc1129b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47868/0 (socket says 172.21.15.82:47868) 2024-03-27T07:28:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.827+0000 7f91d1164640 1 -- 172.21.15.82:0/1471992883 learned_addr learned my addr 172.21.15.82:0/1471992883 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.827+0000 7f91d2166640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc11b330 0x7f91cc112ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.827+0000 7f91d1164640 1 -- 172.21.15.82:0/1471992883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91cc108be0 msgr2=0x7f91cc1198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.827+0000 7f91d1164640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91cc108be0 0x7f91cc1198c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.827+0000 7f91d1164640 1 -- 172.21.15.82:0/1471992883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc11b330 msgr2=0x7f91cc112ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:15.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.827+0000 7f91d1164640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc11b330 0x7f91cc112ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.827+0000 7f91d1164640 1 -- 172.21.15.82:0/1471992883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc1134e0 con 0x7f91cc110170 2024-03-27T07:28:15.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.827+0000 7f91d1164640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91cc110170 0x7f91cc1129b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f91c800e9f0 tx=0x7f91c800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:15.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.828+0000 7f91d1965640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91cc108be0 0x7f91cc1198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:15.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.849+0000 7f91c2ffd640 1 -- 172.21.15.82:0/1471992883 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c800cd20 con 0x7f91cc110170 2024-03-27T07:28:15.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.849+0000 7f91d3bc9640 1 -- 172.21.15.82:0/1471992883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91cc1137d0 con 0x7f91cc110170 2024-03-27T07:28:15.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.849+0000 7f91d3bc9640 1 -- 172.21.15.82:0/1471992883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91cc1177d0 con 0x7f91cc110170 2024-03-27T07:28:15.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.854+0000 7f91d67b5740 1 Processor -- start 2024-03-27T07:28:15.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.854+0000 7f91c2ffd640 1 -- 172.21.15.82:0/1471992883 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c8010910 con 0x7f91cc110170 2024-03-27T07:28:15.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.854+0000 7f91c2ffd640 1 -- 172.21.15.82:0/1471992883 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c8018980 con 0x7f91cc110170 2024-03-27T07:28:15.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.854+0000 7f91d67b5740 1 -- start start 2024-03-27T07:28:15.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.860+0000 7f91c2ffd640 1 -- 172.21.15.82:0/1471992883 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f91c8018ba0 con 0x7f91cc110170 2024-03-27T07:28:15.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.860+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc6866d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.860+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc68672c0 0x55bcc686f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.860+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc686fea0 0x55bcc6872290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.860+0000 7f91d67b5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bcc67ca710 con 0x55bcc68672c0 2024-03-27T07:28:15.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.860+0000 7f91d67b5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55bcc6772af0 con 0x55bcc68669a0 2024-03-27T07:28:15.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.860+0000 7f91d67b5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bcc67c66c0 con 0x55bcc686fea0 2024-03-27T07:28:15.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.860+0000 7f91d2166640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc6866d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.861+0000 7f91d2166640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc6866d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:55768/0 (socket says 172.21.15.82:55768) 2024-03-27T07:28:15.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.861+0000 7f91d2166640 1 -- 172.21.15.82:0/4116286037 learned_addr learned my addr 172.21.15.82:0/4116286037 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:15.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.861+0000 7f91d1965640 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc68672c0 0x55bcc686f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.861+0000 7f91d1164640 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc686fea0 0x55bcc6872290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.861+0000 7f91d2166640 1 -- 172.21.15.82:0/4116286037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc686fea0 msgr2=0x55bcc6872290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:15.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.861+0000 7f91d2166640 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc686fea0 0x55bcc6872290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.861+0000 7f91d2166640 1 -- 172.21.15.82:0/4116286037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc68672c0 msgr2=0x55bcc686f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:15.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.861+0000 7f91d2166640 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc68672c0 0x55bcc686f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.861+0000 7f91d2166640 1 -- 172.21.15.82:0/4116286037 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc64de3f0 con 0x55bcc68669a0 2024-03-27T07:28:15.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.861+0000 7f91d1965640 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc68672c0 0x55bcc686f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:15.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.862+0000 7f91d2166640 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc6866d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009cd0 tx=0x7f91c40329d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea5ceb74cb5c6fb5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:15.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.862+0000 7f91d1164640 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc686fea0 0x55bcc6872290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:28:15.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.863+0000 7f91c2ffd640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91b80a3990 0x7f91b80a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.863+0000 7f91d1965640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91b80a3990 0x7f91b80a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.865+0000 7f91d1965640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91b80a3990 0x7f91b80a5e50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91bc005d80 tx=0x7f91bc005d10 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:15.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.867+0000 7f91c2ffd640 1 -- 172.21.15.82:0/1471992883 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f91c80d1480 con 0x7f91cc110170 2024-03-27T07:28:15.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.875+0000 7f91b7fff640 1 -- 172.21.15.82:0/4116286037 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4039040 con 0x55bcc68669a0 2024-03-27T07:28:15.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.877+0000 7f91b7fff640 1 -- 172.21.15.82:0/4116286037 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c4003e50 con 0x55bcc68669a0 2024-03-27T07:28:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.879+0000 7f91d67b5740 1 -- 172.21.15.82:0/4116286037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 msgr2=0x55bcc6866d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:15.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.879+0000 7f91d67b5740 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc6866d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f91c4009cd0 tx=0x7f91c40329d0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.881+0000 7f91d67b5740 1 -- 172.21.15.82:0/4116286037 shutdown_connections 2024-03-27T07:28:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.881+0000 7f91d67b5740 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc68672c0 0x55bcc686f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.881+0000 7f91d67b5740 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc686fea0 0x55bcc6872290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.881+0000 7f91d67b5740 1 --2- 172.21.15.82:0/4116286037 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc6866d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.881+0000 7f91d67b5740 1 -- 172.21.15.82:0/4116286037 >> 172.21.15.82:0/4116286037 conn(0x55bcc68610d0 msgr2=0x55bcc68614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.884+0000 7f91d67b5740 1 -- 172.21.15.82:0/4116286037 shutdown_connections 2024-03-27T07:28:15.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.884+0000 7f91d67b5740 1 -- 172.21.15.82:0/4116286037 wait complete. 2024-03-27T07:28:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.884+0000 7f91d67b5740 1 -- start start 2024-03-27T07:28:15.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.885+0000 7f91d67b5740 1 Processor -- start 2024-03-27T07:28:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.886+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc686cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.886+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68672c0 0x55bcc686d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d1965640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc686cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d1965640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc686cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:55784/0 (socket says 172.21.15.82:55784) 2024-03-27T07:28:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc686d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d1164640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68672c0 0x55bcc686d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d1164640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68672c0 0x55bcc686d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47886/0 (socket says 172.21.15.82:47886) 2024-03-27T07:28:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d2166640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc686d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d2166640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc686d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41254/0 (socket says 172.21.15.82:41254) 2024-03-27T07:28:15.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d1164640 1 -- 172.21.15.82:0/310561171 learned_addr learned my addr 172.21.15.82:0/310561171 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bcc6872c80 con 0x55bcc686fea0 2024-03-27T07:28:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55bcc6785eb0 con 0x55bcc68669a0 2024-03-27T07:28:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.887+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55bcc6872e00 con 0x55bcc68672c0 2024-03-27T07:28:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.888+0000 7f91d67b5740 10 client.0 _ll_register_callbacks cb 0x55bcc67c26a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.888+0000 7f91d2166640 1 -- 172.21.15.82:0/310561171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68672c0 msgr2=0x55bcc686d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.888+0000 7f91d2166640 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68672c0 0x55bcc686d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.888+0000 7f91d2166640 1 -- 172.21.15.82:0/310561171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 msgr2=0x55bcc686cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.888+0000 7f91d2166640 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc686cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.888+0000 7f91d2166640 1 -- 172.21.15.82:0/310561171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcc65a87d0 con 0x55bcc686fea0 2024-03-27T07:28:15.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.889+0000 7f91d2166640 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc686d840 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f91c4005e30 tx=0x7f91c40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94abbbbedaed74f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:15.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.905+0000 7f91b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:15.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.905+0000 7f91b57fa640 1 -- 172.21.15.82:0/310561171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c404c070 con 0x55bcc686fea0 2024-03-27T07:28:15.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.908+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91c4003e50 con 0x55bcc686fea0 2024-03-27T07:28:15.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.908+0000 7f91b57fa640 1 -- 172.21.15.82:0/310561171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f91c4032cd0 con 0x55bcc686fea0 2024-03-27T07:28:15.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.909+0000 7f91b57fa640 1 -- 172.21.15.82:0/310561171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91c4058050 con 0x55bcc686fea0 2024-03-27T07:28:15.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.909+0000 7f91d67b5740 10 client.16599 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:15.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.910+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bcc687ee40 con 0x55bcc686fea0 2024-03-27T07:28:15.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.910+0000 7f91b57fa640 1 -- 172.21.15.82:0/310561171 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c4003e50 con 0x55bcc686fea0 2024-03-27T07:28:15.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.911+0000 7f91b57fa640 1 -- 172.21.15.82:0/310561171 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f91c403fb40 con 0x55bcc686fea0 2024-03-27T07:28:15.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.912+0000 7f91d67b5740 10 client.16599 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:15.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.912+0000 7f91d67b5740 10 client.16599 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:28:15.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.912+0000 7f91d67b5740 20 client.16599 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:15.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.912+0000 7f91d67b5740 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55bcc68802a0 0x55bcc6882700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.912+0000 7f91d67b5740 4 client.16599 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:15.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.912+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcc67d7c50 con 0x55bcc68802a0 2024-03-27T07:28:15.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.912+0000 7f91d1965640 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55bcc68802a0 0x55bcc6882700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.914+0000 7f91d1965640 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55bcc68802a0 0x55bcc6882700 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c93a15b8e3eb5160 server_cookie=cdd585c1432dd069 in_seq=0 out_seq=0 2024-03-27T07:28:15.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.914+0000 7f91b57fa640 10 client.16599 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:28:15.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.914+0000 7f91b57fa640 1 -- 172.21.15.82:0/310561171 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55bcc67d7c50 con 0x55bcc68802a0 2024-03-27T07:28:15.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.915+0000 7f91b57fa640 10 client.16599 handle_command_reply: tid=0 2024-03-27T07:28:15.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.915+0000 7f91d67b5740 1 client.16599 shutdown 2024-03-27T07:28:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.922+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 msgr2=0x55bcc686d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.922+0000 7f91d67b5740 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc686d840 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f91c4005e30 tx=0x7f91c40326e0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.925+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 shutdown_connections 2024-03-27T07:28:15.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.925+0000 7f91d67b5740 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55bcc68802a0 0x55bcc6882700 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.925+0000 7f91d67b5740 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc686d840 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.925+0000 7f91d67b5740 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68672c0 0x55bcc686d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.925+0000 7f91d67b5740 1 --2- 172.21.15.82:0/310561171 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68669a0 0x55bcc686cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.925+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 >> 172.21.15.82:0/310561171 conn(0x55bcc68610d0 msgr2=0x55bcc6862e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.925+0000 7f91b57fa640 0 client.16599 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:28:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.926+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 shutdown_connections 2024-03-27T07:28:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.926+0000 7f91d67b5740 1 -- 172.21.15.82:0/310561171 wait complete. 2024-03-27T07:28:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:15.927+0000 7f91d67b5740 20 client.16599 trim_cache size 0 max 16384 2024-03-27T07:28:15.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.943+0000 7fb90f37a640 1 -- 172.21.15.82:0/4278448608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb90810dcc0 msgr2=0x7fb90810e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:15.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.943+0000 7fb90f37a640 1 --2- 172.21.15.82:0/4278448608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb90810dcc0 0x7fb90810e120 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009900 tx=0x7fb8f802bd10 comp rx=0 tx=0).stop 2024-03-27T07:28:15.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.944+0000 7fb90f37a640 1 -- 172.21.15.82:0/4278448608 shutdown_connections 2024-03-27T07:28:15.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.944+0000 7fb90f37a640 1 --2- 172.21.15.82:0/4278448608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb90810dcc0 0x7fb90810e120 secure :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009900 tx=0x7fb8f802bd10 comp rx=0 tx=0).stop 2024-03-27T07:28:15.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.944+0000 7fb90f37a640 1 --2- 172.21.15.82:0/4278448608 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb90810e740 0x7fb90811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.944+0000 7fb90f37a640 1 --2- 172.21.15.82:0/4278448608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb908110150 0x7fb908110530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.944+0000 7fb90f37a640 1 -- 172.21.15.82:0/4278448608 >> 172.21.15.82:0/4278448608 conn(0x7fb90806cad0 msgr2=0x7fb90806cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:15.953 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.951+0000 7fb90f37a640 1 -- 172.21.15.82:0/4278448608 shutdown_connections 2024-03-27T07:28:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.951+0000 7fb90f37a640 1 -- 172.21.15.82:0/4278448608 wait complete. 2024-03-27T07:28:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.952+0000 7fb90f37a640 1 Processor -- start 2024-03-27T07:28:15.954 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.952+0000 7fb90f37a640 1 -- start start 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.952+0000 7fb90f37a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb90810e740 0x7fb9081a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.952+0000 7fb90f37a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908110150 0x7fb9081a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.952+0000 7fb90f37a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9081abab0 0x7fb9081abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.952+0000 7fb90f37a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb908120b80 con 0x7fb90810e740 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.952+0000 7fb90f37a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb908120a00 con 0x7fb908110150 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.952+0000 7fb90f37a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb908120d00 con 0x7fb9081abab0 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.953+0000 7fb90d116640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb90810e740 0x7fb9081a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.953+0000 7fb90d917640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9081abab0 0x7fb9081abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.953+0000 7fb90d116640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb90810e740 0x7fb9081a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41276/0 (socket says 172.21.15.82:41276) 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.953+0000 7fb90d116640 1 -- 172.21.15.82:0/3979386545 learned_addr learned my addr 172.21.15.82:0/3979386545 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.953+0000 7fb90d116640 1 -- 172.21.15.82:0/3979386545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9081abab0 msgr2=0x7fb9081abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:15.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.953+0000 7fb90d116640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9081abab0 0x7fb9081abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.953+0000 7fb90d116640 1 -- 172.21.15.82:0/3979386545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908110150 msgr2=0x7fb9081a7730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:28:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.953+0000 7fb90d116640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908110150 0x7fb9081a7730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.953+0000 7fb90d116640 1 -- 172.21.15.82:0/3979386545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9081ac5a0 con 0x7fb90810e740 2024-03-27T07:28:15.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.953+0000 7fb90d116640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb90810e740 0x7fb9081a71f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb90401d8a0 tx=0x7fb90401dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:15.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.991+0000 7fb8fe7fc640 1 -- 172.21.15.82:0/3979386545 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb904004220 con 0x7fb90810e740 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.991+0000 7fb90f37a640 1 -- 172.21.15.82:0/3979386545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9081ac890 con 0x7fb90810e740 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.991+0000 7fb90f37a640 1 -- 172.21.15.82:0/3979386545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb908110e30 con 0x7fb90810e740 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.996+0000 7fb911bfd740 1 Processor -- start 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.996+0000 7fb911bfd740 1 -- start start 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.996+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d601d7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.996+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601e0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.996+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601e0980 0x557d601e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.996+0000 7fb911bfd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557d6019dcd0 con 0x557d601d7bb0 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.996+0000 7fb911bfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x557d600e2950 con 0x557d601e0980 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.996+0000 7fb911bfd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557d6013ae50 con 0x557d601d7290 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.997+0000 7fb90d917640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d601d7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.997+0000 7fb90d917640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d601d7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47912/0 (socket says 172.21.15.82:47912) 2024-03-27T07:28:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.997+0000 7fb90d917640 1 -- 172.21.15.82:0/3107833097 learned_addr learned my addr 172.21.15.82:0/3107833097 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.997+0000 7fb90d917640 1 -- 172.21.15.82:0/3107833097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601e0980 msgr2=0x557d601e2d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T07:28:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.997+0000 7fb90d917640 1 --2- 172.21.15.82:0/3107833097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601e0980 0x557d601e2d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.997+0000 7fb90d917640 1 -- 172.21.15.82:0/3107833097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 msgr2=0x557d601e0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:16.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.999+0000 7fb90d116640 1 --2- 172.21.15.82:0/3107833097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601e0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.999+0000 7fb8fe7fc640 1 -- 172.21.15.82:0/3979386545 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9040043c0 con 0x7fb90810e740 2024-03-27T07:28:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.999+0000 7fb90d917640 1 --2- 172.21.15.82:0/3107833097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601e0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.999+0000 7fb8fe7fc640 1 -- 172.21.15.82:0/3979386545 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9040049e0 con 0x7fb90810e740 2024-03-27T07:28:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.999+0000 7fb90d917640 1 -- 172.21.15.82:0/3107833097 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5fe4f210 con 0x557d601d7290 2024-03-27T07:28:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:15.999+0000 7fb90d116640 1 --2- 172.21.15.82:0/3107833097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601e0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:28:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.001+0000 7fb90d917640 1 --2- 172.21.15.82:0/3107833097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d601d7670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb90000ae10 tx=0x7fb90000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=731afb58146c6dc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.003+0000 7fb8fe7fc640 1 -- 172.21.15.82:0/3979386545 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fb904004cc0 con 0x7fb90810e740 2024-03-27T07:28:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.004+0000 7fb8fe7fc640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8f40a3980 0x7fb8f40a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.004+0000 7fb90d116640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8f40a3980 0x7fb8f40a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.007+0000 7fb8fe7fc640 1 -- 172.21.15.82:0/3979386545 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fb9040d4510 con 0x7fb90810e740 2024-03-27T07:28:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.007+0000 7fb90d116640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8f40a3980 0x7fb8f40a5e40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb904000c00 tx=0x7fb9040058a0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.017+0000 7fb8f37fe640 1 -- 172.21.15.82:0/3107833097 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb900003b70 con 0x557d601d7290 2024-03-27T07:28:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.017+0000 7fb8f37fe640 1 -- 172.21.15.82:0/3107833097 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb900003d10 con 0x557d601d7290 2024-03-27T07:28:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.019+0000 7fb911bfd740 1 -- 172.21.15.82:0/3107833097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 msgr2=0x557d601d7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:16.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.019+0000 7fb911bfd740 1 --2- 172.21.15.82:0/3107833097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d601d7670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb90000ae10 tx=0x7fb90000f790 comp rx=0 tx=0).stop 2024-03-27T07:28:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.019+0000 7fb911bfd740 1 -- 172.21.15.82:0/3107833097 shutdown_connections 2024-03-27T07:28:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.019+0000 7fb911bfd740 1 --2- 172.21.15.82:0/3107833097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601e0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.019+0000 7fb911bfd740 1 --2- 172.21.15.82:0/3107833097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601e0980 0x557d601e2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.019+0000 7fb911bfd740 1 --2- 172.21.15.82:0/3107833097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d601d7670 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.019+0000 7fb911bfd740 1 -- 172.21.15.82:0/3107833097 >> 172.21.15.82:0/3107833097 conn(0x557d601d1bb0 msgr2=0x557d601d1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.022+0000 7fb911bfd740 1 -- 172.21.15.82:0/3107833097 shutdown_connections 2024-03-27T07:28:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.022+0000 7fb911bfd740 1 -- 172.21.15.82:0/3107833097 wait complete. 2024-03-27T07:28:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.022+0000 7fb911bfd740 1 -- start start 2024-03-27T07:28:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.023+0000 7fb911bfd740 1 Processor -- start 2024-03-27T07:28:16.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.023+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d601dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.023+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601dde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.023+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601e0980 0x557d601de360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.023+0000 7fb911bfd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557d60136e00 con 0x557d601d7bb0 2024-03-27T07:28:16.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.023+0000 7fb911bfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x557d600e3520 con 0x557d601e0980 2024-03-27T07:28:16.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.023+0000 7fb911bfd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557d600f68e0 con 0x557d601d7290 2024-03-27T07:28:16.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.023+0000 7fb911bfd740 10 client.0 _ll_register_callbacks cb 0x557d60131a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:16.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.024+0000 7fb90c915640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601dde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.024+0000 7fb90c915640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601dde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41296/0 (socket says 172.21.15.82:41296) 2024-03-27T07:28:16.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.024+0000 7fb90c915640 1 -- 172.21.15.82:0/591447940 learned_addr learned my addr 172.21.15.82:0/591447940 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:16.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.024+0000 7fb90c915640 1 -- 172.21.15.82:0/591447940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 msgr2=0x557d601dd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:16.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.024+0000 7fb90c915640 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d601dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.024+0000 7fb90c915640 1 -- 172.21.15.82:0/591447940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601e0980 msgr2=0x557d601de360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T07:28:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.024+0000 7fb90c915640 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601e0980 0x557d601de360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.024+0000 7fb90c915640 1 -- 172.21.15.82:0/591447940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5ff1b620 con 0x557d601d7bb0 2024-03-27T07:28:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.024+0000 7fb90c915640 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601dde20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009230 tx=0x7fb8f8004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d277e3043328f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.093+0000 7fb8f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:16.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.093+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/591447940 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8039040 con 0x557d601d7bb0 2024-03-27T07:28:16.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.093+0000 7fb911bfd740 1 -- 172.21.15.82:0/591447940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb900003d10 con 0x557d601d7bb0 2024-03-27T07:28:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.093+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/591447940 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fb8f8004330 con 0x557d601d7bb0 2024-03-27T07:28:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.096+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/591447940 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb8f802c970 con 0x557d601d7bb0 2024-03-27T07:28:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.096+0000 7fb911bfd740 10 client.16608 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.096+0000 7fb911bfd740 1 -- 172.21.15.82:0/591447940 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557d602114a0 con 0x557d601d7bb0 2024-03-27T07:28:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.099+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/591447940 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb900003d10 con 0x557d601d7bb0 2024-03-27T07:28:16.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.099+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/591447940 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb8f803c070 con 0x557d601d7bb0 2024-03-27T07:28:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.099+0000 7fb911bfd740 10 client.16608 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.099+0000 7fb911bfd740 10 client.16608 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.099+0000 7fb911bfd740 20 client.16608 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.099+0000 7fb911bfd740 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557d60212e60 0x557d602152c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.099+0000 7fb911bfd740 4 client.16608 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.099+0000 7fb911bfd740 1 -- 172.21.15.82:0/591447940 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d60148390 con 0x557d60212e60 2024-03-27T07:28:16.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.099+0000 7fb90d917640 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557d60212e60 0x557d602152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.100+0000 7fb90d917640 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557d60212e60 0x557d602152c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=676ac63a884eeebc server_cookie=f3e45394d6c93461 in_seq=0 out_seq=0 2024-03-27T07:28:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.103+0000 7fb8f0ff9640 10 client.16608 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.104+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/591447940 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557d60148390 con 0x557d60212e60 2024-03-27T07:28:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.104+0000 7fb8f0ff9640 10 client.16608 handle_command_reply: tid=0 2024-03-27T07:28:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.105+0000 7fb911bfd740 1 client.16608 shutdown 2024-03-27T07:28:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.106+0000 7fb911bfd740 1 -- 172.21.15.82:0/591447940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 msgr2=0x557d601dde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.106+0000 7fb911bfd740 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601dde20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8009230 tx=0x7fb8f8004040 comp rx=0 tx=0).stop 2024-03-27T07:28:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.108+0000 7fb911bfd740 1 -- 172.21.15.82:0/591447940 shutdown_connections 2024-03-27T07:28:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.108+0000 7fb911bfd740 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557d60212e60 0x557d602152c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.108+0000 7fb911bfd740 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d601dde20 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.108+0000 7fb911bfd740 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601e0980 0x557d601de360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.108+0000 7fb911bfd740 1 --2- 172.21.15.82:0/591447940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d601dd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.108+0000 7fb911bfd740 1 -- 172.21.15.82:0/591447940 >> 172.21.15.82:0/591447940 conn(0x557d601d1bb0 msgr2=0x557d601d3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.108+0000 7fb8f0ff9640 0 client.16608 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.109+0000 7fb911bfd740 1 -- 172.21.15.82:0/591447940 shutdown_connections 2024-03-27T07:28:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.109+0000 7fb911bfd740 1 -- 172.21.15.82:0/591447940 wait complete. 2024-03-27T07:28:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.109+0000 7fb911bfd740 20 client.16608 trim_cache size 0 max 16384 2024-03-27T07:28:16.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.131+0000 7f91d67b5740 1 Processor -- start 2024-03-27T07:28:16.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.139+0000 7f91d67b5740 1 -- start start 2024-03-27T07:28:16.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.139+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc686f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.139+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 0x55bcc687bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc6888010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d1965640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc686f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d1965640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc686f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47930/0 (socket says 172.21.15.82:47930) 2024-03-27T07:28:16.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d1965640 1 -- 172.21.15.82:0/3976823222 learned_addr learned my addr 172.21.15.82:0/3976823222 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:16.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d67b5740 1 -- 172.21.15.82:0/3976823222 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91b00110e0 con 0x55bcc686fea0 2024-03-27T07:28:16.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d67b5740 1 -- 172.21.15.82:0/3976823222 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91b000e950 con 0x55bcc68672c0 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d67b5740 1 -- 172.21.15.82:0/3976823222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91b000c7a0 con 0x55bcc68669a0 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d1164640 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 0x55bcc687bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d2166640 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc6888010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d1965640 1 -- 172.21.15.82:0/3976823222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 msgr2=0x55bcc687bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d1965640 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 0x55bcc687bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d1965640 1 -- 172.21.15.82:0/3976823222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 msgr2=0x55bcc6888010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d1965640 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc6888010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d1965640 1 -- 172.21.15.82:0/3976823222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc6860f00 con 0x55bcc68669a0 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.140+0000 7f91d2166640 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc6888010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.141+0000 7f91d1164640 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 0x55bcc687bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:16.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.141+0000 7f91d1965640 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc686f4f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91bc029b10 tx=0x7f91bc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1f658baa0a06cdb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:16.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.170+0000 7f91b77fe640 1 -- 172.21.15.82:0/3976823222 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc012e00 con 0x55bcc68669a0 2024-03-27T07:28:16.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.170+0000 7f91b77fe640 1 -- 172.21.15.82:0/3976823222 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91bc02f070 con 0x55bcc68669a0 2024-03-27T07:28:16.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.170+0000 7f91b77fe640 1 -- 172.21.15.82:0/3976823222 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc01f450 con 0x55bcc68669a0 2024-03-27T07:28:16.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.172+0000 7f91d67b5740 1 -- 172.21.15.82:0/3976823222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 msgr2=0x55bcc686f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:16.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.172+0000 7f91d67b5740 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc686f4f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f91bc029b10 tx=0x7f91bc014000 comp rx=0 tx=0).stop 2024-03-27T07:28:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.173+0000 7f91d67b5740 1 -- 172.21.15.82:0/3976823222 shutdown_connections 2024-03-27T07:28:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.173+0000 7f91d67b5740 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc6888010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.173+0000 7f91d67b5740 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 0x55bcc687bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.173+0000 7f91d67b5740 1 --2- 172.21.15.82:0/3976823222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc686f4f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.174+0000 7f91d67b5740 1 -- 172.21.15.82:0/3976823222 >> 172.21.15.82:0/3976823222 conn(0x55bcc68610d0 msgr2=0x55bcc686d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:16.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.174+0000 7f91d67b5740 1 -- 172.21.15.82:0/3976823222 shutdown_connections 2024-03-27T07:28:16.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.174+0000 7f91d67b5740 1 -- 172.21.15.82:0/3976823222 wait complete. 2024-03-27T07:28:16.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.175+0000 7f91d67b5740 1 -- start start 2024-03-27T07:28:16.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.175+0000 7f91d67b5740 1 Processor -- start 2024-03-27T07:28:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.176+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc6878050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.176+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 0x55bcc6878590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.176+0000 7f91d67b5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc6873700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.176+0000 7f91d1965640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc6878050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.176+0000 7f91d1965640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc6878050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47942/0 (socket says 172.21.15.82:47942) 2024-03-27T07:28:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.176+0000 7f91d1164640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 0x55bcc6878590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d1164640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 0x55bcc6878590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:55828/0 (socket says 172.21.15.82:55828) 2024-03-27T07:28:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d2166640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc6873700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d2166640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc6873700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41324/0 (socket says 172.21.15.82:41324) 2024-03-27T07:28:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91b000ce10 con 0x55bcc686fea0 2024-03-27T07:28:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d1965640 1 -- 172.21.15.82:0/4281186530 learned_addr learned my addr 172.21.15.82:0/4281186530 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91b000e280 con 0x55bcc68672c0 2024-03-27T07:28:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91b000d4e0 con 0x55bcc68669a0 2024-03-27T07:28:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d67b5740 10 client.0 _ll_register_callbacks cb 0x7f91c8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d1965640 1 -- 172.21.15.82:0/4281186530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 msgr2=0x55bcc6878590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:16.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d1965640 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 0x55bcc6878590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d1965640 1 -- 172.21.15.82:0/4281186530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 msgr2=0x55bcc6873700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d1965640 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc6873700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.177+0000 7f91d1965640 1 -- 172.21.15.82:0/4281186530 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcc6873f00 con 0x55bcc68669a0 2024-03-27T07:28:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.178+0000 7f91d1965640 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc6878050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0058c0 tx=0x7f91bc020660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80fdaf1499ee6948 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:16.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.178+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91bc02f070 con 0x55bcc68669a0 2024-03-27T07:28:16.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.208+0000 7f91b57fa640 10 client.26446 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:28:16.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.208+0000 7f91b57fa640 1 -- 172.21.15.82:0/4281186530 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc020d60 con 0x55bcc68669a0 2024-03-27T07:28:16.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.208+0000 7f91b57fa640 1 -- 172.21.15.82:0/4281186530 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f91bc0293a0 con 0x55bcc68669a0 2024-03-27T07:28:16.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.208+0000 7f91b57fa640 1 -- 172.21.15.82:0/4281186530 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91bc012e10 con 0x55bcc68669a0 2024-03-27T07:28:16.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.208+0000 7f91d67b5740 10 client.26446 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:16.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.208+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55bcc68e61f0 con 0x55bcc68669a0 2024-03-27T07:28:16.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.210+0000 7f91b57fa640 1 -- 172.21.15.82:0/4281186530 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f91bc0295a0 con 0x55bcc68669a0 2024-03-27T07:28:16.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.210+0000 7f91d67b5740 10 client.26446 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:16.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.210+0000 7f91d67b5740 10 client.26446 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:28:16.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.210+0000 7f91d67b5740 20 client.26446 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:16.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.210+0000 7f91d67b5740 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55bcc68e6740 0x55bcc68e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.210+0000 7f91d67b5740 4 client.26446 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:28:16.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.210+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f91bc02f070 con 0x55bcc68e6740 2024-03-27T07:28:16.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.210+0000 7f91d1164640 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55bcc68e6740 0x55bcc68e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.212+0000 7f91d1164640 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55bcc68e6740 0x55bcc68e8b60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=23cd90c98a839ec5 server_cookie=499dda710e6a49c6 in_seq=0 out_seq=0 2024-03-27T07:28:16.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.216+0000 7f91b57fa640 10 client.26446 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:28:16.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.216+0000 7f91b57fa640 1 -- 172.21.15.82:0/4281186530 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f91bc02f070 con 0x55bcc68e6740 2024-03-27T07:28:16.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.216+0000 7f91b57fa640 10 client.26446 handle_command_reply: tid=0 2024-03-27T07:28:16.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.216+0000 7f91d67b5740 1 client.26446 shutdown 2024-03-27T07:28:16.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.217+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 msgr2=0x55bcc6878050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:16.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.217+0000 7f91d67b5740 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc6878050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0058c0 tx=0x7f91bc020660 comp rx=0 tx=0).stop 2024-03-27T07:28:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.220+0000 7fb911bfd740 1 Processor -- start 2024-03-27T07:28:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.220+0000 7fb911bfd740 1 -- start start 2024-03-27T07:28:16.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.220+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7290 0x557d6020e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.221+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d6021abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.222+0000 7fb90c915640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d6021abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.222+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601e0980 0x557d601dde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.222+0000 7fb911bfd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec0110e0 con 0x557d601d7bb0 2024-03-27T07:28:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.222+0000 7fb911bfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec00e950 con 0x557d601d7290 2024-03-27T07:28:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.222+0000 7fb911bfd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec00c7a0 con 0x557d601e0980 2024-03-27T07:28:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.223+0000 7fb90d917640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7290 0x557d6020e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.223+0000 7fb90d917640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7290 0x557d6020e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:55842/0 (socket says 172.21.15.82:55842) 2024-03-27T07:28:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.223+0000 7fb90d917640 1 -- 172.21.15.82:0/545587946 learned_addr learned my addr 172.21.15.82:0/545587946 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.223+0000 7fb90d917640 1 --2- 172.21.15.82:0/545587946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601e0980 0x557d601dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.223+0000 7fb90d917640 1 -- 172.21.15.82:0/545587946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601e0980 msgr2=0x557d601dde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.223+0000 7fb90d917640 1 --2- 172.21.15.82:0/545587946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601e0980 0x557d601dde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.223+0000 7fb90d917640 1 -- 172.21.15.82:0/545587946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 msgr2=0x557d6021abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.223+0000 7fb90d917640 1 --2- 172.21.15.82:0/545587946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d6021abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.223+0000 7fb90d917640 1 -- 172.21.15.82:0/545587946 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d601d86b0 con 0x557d601d7290 2024-03-27T07:28:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.224+0000 7fb90d917640 1 --2- 172.21.15.82:0/545587946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7290 0x557d6020e0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9000106b0 tx=0x7fb9000106e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b010dbdf856e255 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:16.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.224+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 shutdown_connections 2024-03-27T07:28:16.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.224+0000 7f91d67b5740 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55bcc68e6740 0x55bcc68e8b60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.225+0000 7f91d67b5740 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bcc686fea0 0x55bcc6873700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.225+0000 7f91d67b5740 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55bcc68672c0 0x55bcc6878590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.225+0000 7f91d67b5740 1 --2- 172.21.15.82:0/4281186530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55bcc68669a0 0x55bcc6878050 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.225+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 >> 172.21.15.82:0/4281186530 conn(0x55bcc68610d0 msgr2=0x55bcc686cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:16.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.225+0000 7f91b57fa640 0 client.26446 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:28:16.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.225+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 shutdown_connections 2024-03-27T07:28:16.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.225+0000 7f91d67b5740 1 -- 172.21.15.82:0/4281186530 wait complete. 2024-03-27T07:28:16.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.225+0000 7f91d67b5740 20 client.26446 trim_cache size 0 max 16384 2024-03-27T07:28:16.229 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:28:16.250 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.248+0000 7fb8f2ffd640 1 -- 172.21.15.82:0/545587946 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90001d040 con 0x557d601d7290 2024-03-27T07:28:16.250 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.248+0000 7fb8f2ffd640 1 -- 172.21.15.82:0/545587946 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9000275b0 con 0x557d601d7290 2024-03-27T07:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.251+0000 7fb911bfd740 1 -- 172.21.15.82:0/545587946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7290 msgr2=0x557d6020e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.251+0000 7fb911bfd740 1 --2- 172.21.15.82:0/545587946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7290 0x557d6020e0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb9000106b0 tx=0x7fb9000106e0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.251+0000 7fb911bfd740 1 -- 172.21.15.82:0/545587946 shutdown_connections 2024-03-27T07:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.251+0000 7fb911bfd740 1 --2- 172.21.15.82:0/545587946 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601d7bb0 0x557d6021abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.251+0000 7fb911bfd740 1 --2- 172.21.15.82:0/545587946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601e0980 0x557d601dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.251+0000 7fb911bfd740 1 --2- 172.21.15.82:0/545587946 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7290 0x557d6020e0e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.252+0000 7fb911bfd740 1 -- 172.21.15.82:0/545587946 >> 172.21.15.82:0/545587946 conn(0x557d601d1bb0 msgr2=0x557d601d8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.252+0000 7fb911bfd740 1 -- 172.21.15.82:0/545587946 shutdown_connections 2024-03-27T07:28:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.253+0000 7fb911bfd740 1 -- 172.21.15.82:0/545587946 wait complete. 2024-03-27T07:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.253+0000 7fb911bfd740 1 -- start start 2024-03-27T07:28:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.254+0000 7fb911bfd740 1 Processor -- start 2024-03-27T07:28:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.254+0000 7f91d3bc9640 1 -- 172.21.15.82:0/1471992883 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91b80a3990 msgr2=0x7f91b80a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.254+0000 7f91d3bc9640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91b80a3990 0x7f91b80a5e50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f91bc005d80 tx=0x7f91bc005d10 comp rx=0 tx=0).stop 2024-03-27T07:28:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.254+0000 7f91d3bc9640 1 -- 172.21.15.82:0/1471992883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91cc110170 msgr2=0x7f91cc1129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:16.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.254+0000 7f91d3bc9640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91cc110170 0x7f91cc1129b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f91c800e9f0 tx=0x7f91c800eeb0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.257 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.255+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d602058c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.255+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7bb0 0x557d60205e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.258 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.255+0000 7fb911bfd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601e0980 0x557d602771f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.255+0000 7fb90d917640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d602058c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.255+0000 7fb911bfd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec00ce10 con 0x557d601e0980 2024-03-27T07:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.255+0000 7fb911bfd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec00e280 con 0x557d601d7bb0 2024-03-27T07:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.255+0000 7fb911bfd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ec00d4e0 con 0x557d601d7290 2024-03-27T07:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.255+0000 7fb90d917640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d602058c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:47952/0 (socket says 172.21.15.82:47952) 2024-03-27T07:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.255+0000 7fb90d917640 1 -- 172.21.15.82:0/2077585361 learned_addr learned my addr 172.21.15.82:0/2077585361 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.255+0000 7fb911bfd740 10 client.0 _ll_register_callbacks cb 0x7fb8f8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:16.259 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.256+0000 7fb90c915640 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7bb0 0x557d60205e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.260 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.257+0000 7fb90d917640 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601e0980 0x557d602771f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.258+0000 7f91d3bc9640 1 -- 172.21.15.82:0/1471992883 shutdown_connections 2024-03-27T07:28:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.258+0000 7f91d3bc9640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91b80a3990 0x7f91b80a5e50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.258+0000 7f91d3bc9640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91cc11b330 0x7f91cc112ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.258+0000 7f91d3bc9640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91cc110170 0x7f91cc1129b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.258+0000 7f91d3bc9640 1 --2- 172.21.15.82:0/1471992883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91cc108be0 0x7f91cc1198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.258+0000 7fb90d917640 1 -- 172.21.15.82:0/2077585361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7bb0 msgr2=0x557d60205e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.258+0000 7fb90d917640 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7bb0 0x557d60205e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.258+0000 7fb90d917640 1 -- 172.21.15.82:0/2077585361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601e0980 msgr2=0x557d602771f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.258+0000 7fb90d917640 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601e0980 0x557d602771f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:16.261 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.258+0000 7fb90d917640 1 -- 172.21.15.82:0/2077585361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d60277730 con 0x557d601d7290 2024-03-27T07:28:16.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.258+0000 7f91d3bc9640 1 -- 172.21.15.82:0/1471992883 >> 172.21.15.82:0/1471992883 conn(0x7f91cc06cb00 msgr2=0x7f91cc0704a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:16.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.258+0000 7f91d3bc9640 1 -- 172.21.15.82:0/1471992883 shutdown_connections 2024-03-27T07:28:16.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:16.258+0000 7f91d3bc9640 1 -- 172.21.15.82:0/1471992883 wait complete. 2024-03-27T07:28:16.262 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.259+0000 7fb90d917640 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d602058c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb900012040 tx=0x7fb900003d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e6bebc5c4d93c90 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.281+0000 7fb8f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:28:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.281+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/2077585361 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90001d040 con 0x557d601d7290 2024-03-27T07:28:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.281+0000 7fb911bfd740 1 -- 172.21.15.82:0/2077585361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9000275b0 con 0x557d601d7290 2024-03-27T07:28:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.281+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/2077585361 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fb900027760 con 0x557d601d7290 2024-03-27T07:28:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.281+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/2077585361 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb900003970 con 0x557d601d7290 2024-03-27T07:28:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.281+0000 7fb911bfd740 10 client.26452 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.281+0000 7fb911bfd740 1 -- 172.21.15.82:0/2077585361 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557d602789d0 con 0x557d601d7290 2024-03-27T07:28:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.282+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/2077585361 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9000275b0 con 0x557d601d7290 2024-03-27T07:28:16.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.283+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/2077585361 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb9000254d0 con 0x557d601d7290 2024-03-27T07:28:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.283+0000 7fb911bfd740 10 client.26452 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.283+0000 7fb911bfd740 10 client.26452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.283+0000 7fb911bfd740 20 client.26452 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.283+0000 7fb911bfd740 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557d60278fb0 0x557d6027b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.283+0000 7fb911bfd740 4 client.26452 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:28:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.283+0000 7fb911bfd740 1 -- 172.21.15.82:0/2077585361 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557d601426e0 con 0x557d60278fb0 2024-03-27T07:28:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.284+0000 7fb90c915640 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557d60278fb0 0x557d6027b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.284+0000 7fb90c915640 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557d60278fb0 0x557d6027b3d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88a1b6533f0d84af server_cookie=10716472c72e34c3 in_seq=0 out_seq=0 2024-03-27T07:28:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:16.285+0000 7fb8f0ff9640 10 client.26452 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:16.432 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T07:28:16.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:16 smithi082 ceph-mon[32178]: pgmap v143: 97 pgs: 97 active+clean; 944 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 349 op/s 2024-03-27T07:28:16.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:16 smithi153 ceph-mon[36179]: pgmap v143: 97 pgs: 97 active+clean; 944 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 349 op/s 2024-03-27T07:28:17.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:16 smithi149 ceph-mon[36065]: pgmap v143: 97 pgs: 97 active+clean; 944 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 349 op/s 2024-03-27T07:28:17.166 INFO:tasks.workunit.client.0.smithi082.stdout: 245 2529490 1418 1797095 1257 936916 1100 2024-03-27T07:28:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb8f0ff9640 1 -- 172.21.15.82:0/2077585361 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557d601426e0 con 0x557d60278fb0 2024-03-27T07:28:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb8f0ff9640 10 client.26452 handle_command_reply: tid=0 2024-03-27T07:28:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb911bfd740 1 client.26452 shutdown 2024-03-27T07:28:17.925 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb911bfd740 1 -- 172.21.15.82:0/2077585361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 msgr2=0x557d602058c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb911bfd740 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d602058c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb900012040 tx=0x7fb900003d60 comp rx=0 tx=0).stop 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb911bfd740 1 -- 172.21.15.82:0/2077585361 shutdown_connections 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb911bfd740 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557d60278fb0 0x557d6027b3d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb911bfd740 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557d601e0980 0x557d602771f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb911bfd740 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557d601d7bb0 0x557d60205e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb911bfd740 1 --2- 172.21.15.82:0/2077585361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557d601d7290 0x557d602058c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb911bfd740 1 -- 172.21.15.82:0/2077585361 >> 172.21.15.82:0/2077585361 conn(0x557d601d1bb0 msgr2=0x557d601d2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.922+0000 7fb8f0ff9640 0 client.26452 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.923+0000 7fb911bfd740 1 -- 172.21.15.82:0/2077585361 shutdown_connections 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.923+0000 7fb911bfd740 1 -- 172.21.15.82:0/2077585361 wait complete. 2024-03-27T07:28:17.926 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.923+0000 7fb911bfd740 20 client.26452 trim_cache size 0 max 16384 2024-03-27T07:28:17.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:28:17.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:28:17.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:28:17.927 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:28:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.945+0000 7fb90f37a640 1 -- 172.21.15.82:0/3979386545 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8f40a3980 msgr2=0x7fb8f40a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:17.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.945+0000 7fb90f37a640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8f40a3980 0x7fb8f40a5e40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb904000c00 tx=0x7fb9040058a0 comp rx=0 tx=0).stop 2024-03-27T07:28:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.945+0000 7fb90f37a640 1 -- 172.21.15.82:0/3979386545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb90810e740 msgr2=0x7fb9081a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:17.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.945+0000 7fb90f37a640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb90810e740 0x7fb9081a71f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb90401d8a0 tx=0x7fb90401dd60 comp rx=0 tx=0).stop 2024-03-27T07:28:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.946+0000 7fb90f37a640 1 -- 172.21.15.82:0/3979386545 shutdown_connections 2024-03-27T07:28:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.947+0000 7fb90f37a640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8f40a3980 0x7fb8f40a5e40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.947+0000 7fb90f37a640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9081abab0 0x7fb9081abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.947+0000 7fb90f37a640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb908110150 0x7fb9081a7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.947+0000 7fb90f37a640 1 --2- 172.21.15.82:0/3979386545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb90810e740 0x7fb9081a71f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.947+0000 7fb90f37a640 1 -- 172.21.15.82:0/3979386545 >> 172.21.15.82:0/3979386545 conn(0x7fb90806cad0 msgr2=0x7fb908070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.947+0000 7fb90f37a640 1 -- 172.21.15.82:0/3979386545 shutdown_connections 2024-03-27T07:28:17.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:17.947+0000 7fb90f37a640 1 -- 172.21.15.82:0/3979386545 wait complete. 2024-03-27T07:28:18.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.097+0000 7fafa69c9640 1 -- 172.21.15.82:0/4216197643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa0108dc0 msgr2=0x7fafa01091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:18.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.097+0000 7fafa69c9640 1 --2- 172.21.15.82:0/4216197643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa0108dc0 0x7fafa01091a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faf90008570 tx=0x7faf9002ba30 comp rx=0 tx=0).stop 2024-03-27T07:28:18.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.106+0000 7fafa69c9640 1 -- 172.21.15.82:0/4216197643 shutdown_connections 2024-03-27T07:28:18.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.106+0000 7fafa69c9640 1 --2- 172.21.15.82:0/4216197643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa0109770 0x7fafa010cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.106+0000 7fafa69c9640 1 --2- 172.21.15.82:0/4216197643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa010d360 0x7fafa0079e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.106+0000 7fafa69c9640 1 --2- 172.21.15.82:0/4216197643 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa0108dc0 0x7fafa01091a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.106+0000 7fafa69c9640 1 -- 172.21.15.82:0/4216197643 >> 172.21.15.82:0/4216197643 conn(0x7fafa006cb00 msgr2=0x7fafa006cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:18.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.106+0000 7fafa69c9640 1 -- 172.21.15.82:0/4216197643 shutdown_connections 2024-03-27T07:28:18.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.106+0000 7fafa69c9640 1 -- 172.21.15.82:0/4216197643 wait complete. 2024-03-27T07:28:18.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.107+0000 7fafa69c9640 1 Processor -- start 2024-03-27T07:28:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.107+0000 7fafa69c9640 1 -- start start 2024-03-27T07:28:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.108+0000 7fafa69c9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa0108dc0 0x7fafa007d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.108+0000 7fafa69c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa010d360 0x7fafa007db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.108+0000 7fafa69c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa0081ec0 0x7fafa0082370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.108+0000 7fafa69c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fafa007bee0 con 0x7fafa0081ec0 2024-03-27T07:28:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.108+0000 7fafa69c9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fafa007bd60 con 0x7fafa0108dc0 2024-03-27T07:28:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.108+0000 7fafa69c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fafa007c060 con 0x7fafa010d360 2024-03-27T07:28:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.109+0000 7faf9f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa010d360 0x7fafa007db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.109+0000 7faf9f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa010d360 0x7fafa007db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:41960/0 (socket says 172.21.15.82:41960) 2024-03-27T07:28:18.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.109+0000 7faf9f7fe640 1 -- 172.21.15.82:0/540312132 learned_addr learned my addr 172.21.15.82:0/540312132 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.110+0000 7faf9ffff640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa0108dc0 0x7fafa007d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.110+0000 7faf9f7fe640 1 -- 172.21.15.82:0/540312132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa0108dc0 msgr2=0x7fafa007d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.110+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa0108dc0 0x7fafa007d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.110+0000 7faf9f7fe640 1 -- 172.21.15.82:0/540312132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa0081ec0 msgr2=0x7fafa0082370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.110+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa0081ec0 0x7fafa0082370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.110+0000 7faf9f7fe640 1 -- 172.21.15.82:0/540312132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa0082930 con 0x7fafa010d360 2024-03-27T07:28:18.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.110+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa010d360 0x7fafa007db90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faf9800b9f0 tx=0x7faf9800beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:18.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.131+0000 7faf9d7fa640 1 -- 172.21.15.82:0/540312132 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf98019070 con 0x7fafa010d360 2024-03-27T07:28:18.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.131+0000 7faf9d7fa640 1 -- 172.21.15.82:0/540312132 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf9800cbd0 con 0x7fafa010d360 2024-03-27T07:28:18.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.131+0000 7faf9d7fa640 1 -- 172.21.15.82:0/540312132 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf980126b0 con 0x7fafa010d360 2024-03-27T07:28:18.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.131+0000 7fafa69c9640 1 -- 172.21.15.82:0/540312132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa0082c20 con 0x7fafa010d360 2024-03-27T07:28:18.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.131+0000 7fafa69c9640 1 -- 172.21.15.82:0/540312132 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa01cd790 con 0x7fafa010d360 2024-03-27T07:28:18.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.139+0000 7faf9d7fa640 1 -- 172.21.15.82:0/540312132 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7faf9801c070 con 0x7fafa010d360 2024-03-27T07:28:18.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.154+0000 7fafa95b4740 1 Processor -- start 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.154+0000 7fafa95b4740 1 -- start start 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.155+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247139a0 0x559424713d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.155+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247142c0 0x55942471c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.155+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x55942471f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.155+0000 7fafa95b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559424677710 con 0x5594247142c0 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.155+0000 7fafa95b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55942461faf0 con 0x5594247139a0 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.155+0000 7fafa95b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5594246736c0 con 0x55942471cea0 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.155+0000 7fafa4f66640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247139a0 0x559424713d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.155+0000 7fafa4f66640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247139a0 0x559424713d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:39574/0 (socket says 172.21.15.82:39574) 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.155+0000 7fafa4f66640 1 -- 172.21.15.82:0/3693841501 learned_addr learned my addr 172.21.15.82:0/3693841501 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.155+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/3693841501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x55942471f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.156+0000 7fafa4f66640 1 -- 172.21.15.82:0/3693841501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 msgr2=0x55942471f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.156+0000 7fafa4f66640 1 --2- 172.21.15.82:0/3693841501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x55942471f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.156+0000 7fafa4f66640 1 -- 172.21.15.82:0/3693841501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247142c0 msgr2=0x55942471c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.156+0000 7fafa4f66640 1 --2- 172.21.15.82:0/3693841501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247142c0 0x55942471c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.156+0000 7fafa4f66640 1 -- 172.21.15.82:0/3693841501 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55942438b3f0 con 0x5594247139a0 2024-03-27T07:28:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.156+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/3693841501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x55942471f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.156+0000 7fafa4f66640 1 --2- 172.21.15.82:0/3693841501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247139a0 0x559424713d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faf9400aa80 tx=0x7faf9400af40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31971e272a1d6270 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.156+0000 7faf9d7fa640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faf880a3990 0x7faf880a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.157+0000 7faf9d7fa640 1 -- 172.21.15.82:0/540312132 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7faf980d0540 con 0x7fafa010d360 2024-03-27T07:28:18.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.161+0000 7faf9ffff640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faf880a3990 0x7faf880a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.171+0000 7faf8e7fc640 1 -- 172.21.15.82:0/3693841501 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94005020 con 0x5594247139a0 2024-03-27T07:28:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.172+0000 7faf8e7fc640 1 -- 172.21.15.82:0/3693841501 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf940047a0 con 0x5594247139a0 2024-03-27T07:28:18.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.174+0000 7faf9ffff640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faf880a3990 0x7faf880a5e50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faf90005a70 tx=0x7faf9003a040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:18.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.174+0000 7fafa95b4740 1 -- 172.21.15.82:0/3693841501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247139a0 msgr2=0x559424713d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:18.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.174+0000 7fafa95b4740 1 --2- 172.21.15.82:0/3693841501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247139a0 0x559424713d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faf9400aa80 tx=0x7faf9400af40 comp rx=0 tx=0).stop 2024-03-27T07:28:18.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.175+0000 7fafa95b4740 1 -- 172.21.15.82:0/3693841501 shutdown_connections 2024-03-27T07:28:18.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.175+0000 7fafa95b4740 1 --2- 172.21.15.82:0/3693841501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247142c0 0x55942471c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.175+0000 7fafa95b4740 1 --2- 172.21.15.82:0/3693841501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x55942471f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.175+0000 7fafa95b4740 1 --2- 172.21.15.82:0/3693841501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247139a0 0x559424713d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.175+0000 7fafa95b4740 1 -- 172.21.15.82:0/3693841501 >> 172.21.15.82:0/3693841501 conn(0x55942470e0d0 msgr2=0x55942470e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:18.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.175+0000 7fafa95b4740 1 -- 172.21.15.82:0/3693841501 shutdown_connections 2024-03-27T07:28:18.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.175+0000 7fafa95b4740 1 -- 172.21.15.82:0/3693841501 wait complete. 2024-03-27T07:28:18.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.176+0000 7fafa95b4740 1 -- start start 2024-03-27T07:28:18.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.176+0000 7fafa95b4740 1 Processor -- start 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x559424719de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594247142c0 0x55942471a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55942471cea0 0x55942471a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7fafa95b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55942471fce0 con 0x5594247139a0 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7fafa95b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x559424632eb0 con 0x55942471cea0 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7fafa95b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55942471fe60 con 0x5594247142c0 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7fafa95b4740 10 client.0 _ll_register_callbacks cb 0x55942466f6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7faf9f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594247142c0 0x55942471a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7faf9f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594247142c0 0x55942471a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:41972/0 (socket says 172.21.15.82:41972) 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7faf9f7fe640 1 -- 172.21.15.82:0/405512801 learned_addr learned my addr 172.21.15.82:0/405512801 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.177+0000 7fafa4f66640 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55942471cea0 0x55942471a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.178+0000 7faf9f7fe640 1 -- 172.21.15.82:0/405512801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55942471cea0 msgr2=0x55942471a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.178+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55942471cea0 0x55942471a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.178+0000 7faf9f7fe640 1 -- 172.21.15.82:0/405512801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 msgr2=0x559424719de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.178+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x559424719de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.178+0000 7faf9f7fe640 1 -- 172.21.15.82:0/405512801 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594244557d0 con 0x5594247142c0 2024-03-27T07:28:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.178+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594247142c0 0x55942471a320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf98099250 tx=0x7faf9809c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db4dbd332c4d7cd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:18.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.195+0000 7faf837fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:28:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.195+0000 7faf837fe640 1 -- 172.21.15.82:0/405512801 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf980a51b0 con 0x5594247142c0 2024-03-27T07:28:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.195+0000 7fafa95b4740 1 -- 172.21.15.82:0/405512801 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf940047a0 con 0x5594247142c0 2024-03-27T07:28:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.195+0000 7faf837fe640 1 -- 172.21.15.82:0/405512801 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7faf980d0070 con 0x5594247142c0 2024-03-27T07:28:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7faf837fe640 1 -- 172.21.15.82:0/405512801 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf980a0b80 con 0x5594247142c0 2024-03-27T07:28:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7fafa95b4740 10 client.26464 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7fafa95b4740 1 -- 172.21.15.82:0/405512801 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55942472bf50 con 0x5594247142c0 2024-03-27T07:28:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7faf837fe640 1 -- 172.21.15.82:0/405512801 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf940047a0 con 0x5594247142c0 2024-03-27T07:28:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7faf837fe640 1 -- 172.21.15.82:0/405512801 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7faf980bb2b0 con 0x5594247142c0 2024-03-27T07:28:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7fafa95b4740 10 client.26464 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7fafa95b4740 10 client.26464 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:28:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7fafa95b4740 20 client.26464 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7fafa95b4740 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55942472d920 0x55942472fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7fafa95b4740 4 client.26464 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.196+0000 7fafa95b4740 1 -- 172.21.15.82:0/405512801 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559424684c50 con 0x55942472d920 2024-03-27T07:28:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.197+0000 7faf9ffff640 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55942472d920 0x55942472fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.197+0000 7faf837fe640 10 client.26464 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:28:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.197+0000 7faf9ffff640 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55942472d920 0x55942472fd80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f43aff8cc9d6d26a server_cookie=bef55a77403a1e1c in_seq=0 out_seq=0 2024-03-27T07:28:18.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.198+0000 7faf837fe640 1 -- 172.21.15.82:0/405512801 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x559424684c50 con 0x55942472d920 2024-03-27T07:28:18.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.198+0000 7faf837fe640 10 client.26464 handle_command_reply: tid=0 2024-03-27T07:28:18.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.199+0000 7fafa95b4740 1 client.26464 shutdown 2024-03-27T07:28:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.201+0000 7fafa95b4740 1 -- 172.21.15.82:0/405512801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594247142c0 msgr2=0x55942471a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.201+0000 7fafa95b4740 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594247142c0 0x55942471a320 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf98099250 tx=0x7faf9809c480 comp rx=0 tx=0).stop 2024-03-27T07:28:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.201+0000 7fafa95b4740 1 -- 172.21.15.82:0/405512801 shutdown_connections 2024-03-27T07:28:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.201+0000 7fafa95b4740 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x55942472d920 0x55942472fd80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.201+0000 7fafa95b4740 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55942471cea0 0x55942471a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.201+0000 7fafa95b4740 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5594247142c0 0x55942471a320 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.201+0000 7fafa95b4740 1 --2- 172.21.15.82:0/405512801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x559424719de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.201+0000 7fafa95b4740 1 -- 172.21.15.82:0/405512801 >> 172.21.15.82:0/405512801 conn(0x55942470e0d0 msgr2=0x55942470fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.202+0000 7faf837fe640 0 client.26464 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:28:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.202+0000 7fafa95b4740 1 -- 172.21.15.82:0/405512801 shutdown_connections 2024-03-27T07:28:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.202+0000 7fafa95b4740 1 -- 172.21.15.82:0/405512801 wait complete. 2024-03-27T07:28:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.202+0000 7fafa95b4740 20 client.26464 trim_cache size 0 max 16384 2024-03-27T07:28:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.281+0000 7fafa95b4740 1 Processor -- start 2024-03-27T07:28:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.281+0000 7fafa95b4740 1 -- start start 2024-03-27T07:28:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x55942471c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 0x559424718f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x559424728b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7fafa95b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf84011040 con 0x5594247139a0 2024-03-27T07:28:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7fafa95b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf8400e8b0 con 0x5594247142c0 2024-03-27T07:28:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7fafa95b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf8400c700 con 0x55942471cea0 2024-03-27T07:28:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7faf9ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x55942471c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7faf9f7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 0x559424718f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7faf9ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x55942471c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48004/0 (socket says 172.21.15.82:48004) 2024-03-27T07:28:18.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7faf9ffff640 1 -- 172.21.15.82:0/161793317 learned_addr learned my addr 172.21.15.82:0/161793317 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:18.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.282+0000 7fafa4f66640 1 --2- 172.21.15.82:0/161793317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x559424728b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.283+0000 7fafa4f66640 1 -- 172.21.15.82:0/161793317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 msgr2=0x559424718f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:18.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.283+0000 7fafa4f66640 1 --2- 172.21.15.82:0/161793317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 0x559424718f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.283+0000 7fafa4f66640 1 -- 172.21.15.82:0/161793317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 msgr2=0x55942471c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:18.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.283+0000 7fafa4f66640 1 --2- 172.21.15.82:0/161793317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x55942471c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.283+0000 7fafa4f66640 1 -- 172.21.15.82:0/161793317 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55942470df00 con 0x55942471cea0 2024-03-27T07:28:18.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.283+0000 7faf9ffff640 1 --2- 172.21.15.82:0/161793317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x55942471c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:18.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.283+0000 7fafa4f66640 1 --2- 172.21.15.82:0/161793317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x559424728b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf9400afd0 tx=0x7faf94015430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec8081cd9f9572a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:18.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.287+0000 7faf8dffb640 1 -- 172.21.15.82:0/161793317 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94024030 con 0x55942471cea0 2024-03-27T07:28:18.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.287+0000 7faf8dffb640 1 -- 172.21.15.82:0/161793317 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf94004030 con 0x55942471cea0 2024-03-27T07:28:18.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.287+0000 7faf8dffb640 1 -- 172.21.15.82:0/161793317 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf940054d0 con 0x55942471cea0 2024-03-27T07:28:18.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.288+0000 7fafa95b4740 1 -- 172.21.15.82:0/161793317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 msgr2=0x559424728b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:18.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.288+0000 7fafa95b4740 1 --2- 172.21.15.82:0/161793317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x559424728b30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf9400afd0 tx=0x7faf94015430 comp rx=0 tx=0).stop 2024-03-27T07:28:18.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.303+0000 7fafa95b4740 1 -- 172.21.15.82:0/161793317 shutdown_connections 2024-03-27T07:28:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.303+0000 7fafa95b4740 1 --2- 172.21.15.82:0/161793317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x559424728b30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.303+0000 7fafa95b4740 1 --2- 172.21.15.82:0/161793317 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 0x559424718f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.303+0000 7fafa95b4740 1 --2- 172.21.15.82:0/161793317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x55942471c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.303+0000 7fafa95b4740 1 -- 172.21.15.82:0/161793317 >> 172.21.15.82:0/161793317 conn(0x55942470e0d0 msgr2=0x55942470c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.303+0000 7fafa95b4740 1 -- 172.21.15.82:0/161793317 shutdown_connections 2024-03-27T07:28:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.303+0000 7fafa95b4740 1 -- 172.21.15.82:0/161793317 wait complete. 2024-03-27T07:28:18.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.304+0000 7fafa95b4740 1 -- start start 2024-03-27T07:28:18.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.304+0000 7fafa95b4740 1 Processor -- start 2024-03-27T07:28:18.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x559424725160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 0x559424716440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7fafa95b4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x559424716980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7faf9ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x559424725160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7faf9ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x559424725160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48010/0 (socket says 172.21.15.82:48010) 2024-03-27T07:28:18.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7fafa95b4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faf8400cd70 con 0x5594247139a0 2024-03-27T07:28:18.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7fafa95b4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7faf8400e1e0 con 0x5594247142c0 2024-03-27T07:28:18.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7fafa95b4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7faf8400d440 con 0x55942471cea0 2024-03-27T07:28:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7faf9ffff640 1 -- 172.21.15.82:0/1905153468 learned_addr learned my addr 172.21.15.82:0/1905153468 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7fafa95b4740 10 client.0 _ll_register_callbacks cb 0x7faf9809c650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.305+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 0x559424716440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.306+0000 7fafa4f66640 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x559424716980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.306+0000 7faf9ffff640 1 -- 172.21.15.82:0/1905153468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 msgr2=0x559424716980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.306+0000 7faf9ffff640 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x559424716980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.306+0000 7faf9ffff640 1 -- 172.21.15.82:0/1905153468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 msgr2=0x559424716440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.306+0000 7faf9ffff640 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 0x559424716440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.306+0000 7faf9ffff640 1 -- 172.21.15.82:0/1905153468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559424725940 con 0x5594247139a0 2024-03-27T07:28:18.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.306+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 0x559424716440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:18.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.306+0000 7faf9ffff640 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x559424725160 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faf9002c040 tx=0x7faf9002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69876e1bce7f9af0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.310+0000 7faf837fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:18.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.310+0000 7faf837fe640 1 -- 172.21.15.82:0/1905153468 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf9004d6a0 con 0x5594247139a0 2024-03-27T07:28:18.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.310+0000 7faf837fe640 1 -- 172.21.15.82:0/1905153468 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7faf90004020 con 0x5594247139a0 2024-03-27T07:28:18.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.310+0000 7fafa95b4740 1 -- 172.21.15.82:0/1905153468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf94004030 con 0x5594247139a0 2024-03-27T07:28:18.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.311+0000 7faf837fe640 1 -- 172.21.15.82:0/1905153468 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faf9005c050 con 0x5594247139a0 2024-03-27T07:28:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.311+0000 7fafa95b4740 10 client.16623 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:18.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.311+0000 7fafa95b4740 1 -- 172.21.15.82:0/1905153468 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559424793820 con 0x5594247139a0 2024-03-27T07:28:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.312+0000 7faf837fe640 1 -- 172.21.15.82:0/1905153468 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf94004030 con 0x5594247139a0 2024-03-27T07:28:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.312+0000 7faf837fe640 1 -- 172.21.15.82:0/1905153468 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7faf90042070 con 0x5594247139a0 2024-03-27T07:28:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.312+0000 7fafa95b4740 10 client.16623 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.312+0000 7fafa95b4740 10 client.16623 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:28:18.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.312+0000 7fafa95b4740 20 client.16623 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.312+0000 7fafa95b4740 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x559424794000 0x559424796420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.312+0000 7fafa95b4740 4 client.16623 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:28:18.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.312+0000 7fafa95b4740 1 -- 172.21.15.82:0/1905153468 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55942467efa0 con 0x559424794000 2024-03-27T07:28:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.313+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x559424794000 0x559424796420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.313+0000 7faf837fe640 10 client.16623 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:28:18.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.314+0000 7faf9f7fe640 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x559424794000 0x559424796420 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97b046f68d470de4 server_cookie=4557352fab6dfbf4 in_seq=0 out_seq=0 2024-03-27T07:28:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.314+0000 7faf837fe640 1 -- 172.21.15.82:0/1905153468 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55942467efa0 con 0x559424794000 2024-03-27T07:28:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.314+0000 7faf837fe640 10 client.16623 handle_command_reply: tid=0 2024-03-27T07:28:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.314+0000 7fafa95b4740 1 client.16623 shutdown 2024-03-27T07:28:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.314+0000 7fafa95b4740 1 -- 172.21.15.82:0/1905153468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 msgr2=0x559424725160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:18.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.314+0000 7fafa95b4740 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x559424725160 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faf9002c040 tx=0x7faf9002ba30 comp rx=0 tx=0).stop 2024-03-27T07:28:18.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.318+0000 7fafa95b4740 1 -- 172.21.15.82:0/1905153468 shutdown_connections 2024-03-27T07:28:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.318+0000 7fafa95b4740 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x559424794000 0x559424796420 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.318+0000 7fafa95b4740 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55942471cea0 0x559424716980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.318+0000 7fafa95b4740 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5594247142c0 0x559424716440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.318+0000 7fafa95b4740 1 --2- 172.21.15.82:0/1905153468 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594247139a0 0x559424725160 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.318+0000 7faf837fe640 0 client.16623 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:28:18.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.318+0000 7fafa95b4740 1 -- 172.21.15.82:0/1905153468 >> 172.21.15.82:0/1905153468 conn(0x55942470e0d0 msgr2=0x55942470d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.322+0000 7fafa95b4740 1 -- 172.21.15.82:0/1905153468 shutdown_connections 2024-03-27T07:28:18.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.322+0000 7fafa95b4740 1 -- 172.21.15.82:0/1905153468 wait complete. 2024-03-27T07:28:18.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.322+0000 7fafa95b4740 20 client.16623 trim_cache size 0 max 16384 2024-03-27T07:28:18.325 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:28:18.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.333+0000 7fafa69c9640 1 -- 172.21.15.82:0/540312132 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faf880a3990 msgr2=0x7faf880a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:18.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.333+0000 7fafa69c9640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faf880a3990 0x7faf880a5e50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faf90005a70 tx=0x7faf9003a040 comp rx=0 tx=0).stop 2024-03-27T07:28:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.333+0000 7fafa69c9640 1 -- 172.21.15.82:0/540312132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa010d360 msgr2=0x7fafa007db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.333+0000 7fafa69c9640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa010d360 0x7fafa007db90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faf9800b9f0 tx=0x7faf9800beb0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.334+0000 7fafa69c9640 1 -- 172.21.15.82:0/540312132 shutdown_connections 2024-03-27T07:28:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.334+0000 7fafa69c9640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7faf880a3990 0x7faf880a5e50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.334+0000 7fafa69c9640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fafa0081ec0 0x7fafa0082370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.334+0000 7fafa69c9640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fafa010d360 0x7fafa007db90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.334+0000 7fafa69c9640 1 --2- 172.21.15.82:0/540312132 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fafa0108dc0 0x7fafa007d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.334+0000 7fafa69c9640 1 -- 172.21.15.82:0/540312132 >> 172.21.15.82:0/540312132 conn(0x7fafa006cb00 msgr2=0x7fafa00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.334+0000 7fafa69c9640 1 -- 172.21.15.82:0/540312132 shutdown_connections 2024-03-27T07:28:18.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:18.334+0000 7fafa69c9640 1 -- 172.21.15.82:0/540312132 wait complete. 2024-03-27T07:28:18.376 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T07:28:18.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:18 smithi082 ceph-mon[32178]: pgmap v144: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.0 MiB/s wr, 395 op/s 2024-03-27T07:28:18.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:18 smithi153 ceph-mon[36179]: pgmap v144: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.0 MiB/s wr, 395 op/s 2024-03-27T07:28:19.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:18 smithi149 ceph-mon[36065]: pgmap v144: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 4.0 MiB/s wr, 395 op/s 2024-03-27T07:28:19.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.231+0000 7f3ca39c7640 1 -- 172.21.15.82:0/3063392743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9c11b330 msgr2=0x7f3c9c11d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:19.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.231+0000 7f3ca39c7640 1 --2- 172.21.15.82:0/3063392743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9c11b330 0x7f3c9c11d720 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3c94009cd0 tx=0x7f3c9402c120 comp rx=0 tx=0).stop 2024-03-27T07:28:19.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.232+0000 7f3ca39c7640 1 -- 172.21.15.82:0/3063392743 shutdown_connections 2024-03-27T07:28:19.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.232+0000 7f3ca39c7640 1 --2- 172.21.15.82:0/3063392743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9c11b330 0x7f3c9c11d720 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.232+0000 7f3ca39c7640 1 --2- 172.21.15.82:0/3063392743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c9c108be0 0x7f3c9c109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.232+0000 7f3ca39c7640 1 --2- 172.21.15.82:0/3063392743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c9c110170 0x7f3c9c110550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.232+0000 7f3ca39c7640 1 -- 172.21.15.82:0/3063392743 >> 172.21.15.82:0/3063392743 conn(0x7f3c9c06cb00 msgr2=0x7f3c9c06cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:19.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.237+0000 7f3ca39c7640 1 -- 172.21.15.82:0/3063392743 shutdown_connections 2024-03-27T07:28:19.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.237+0000 7f3ca39c7640 1 -- 172.21.15.82:0/3063392743 wait complete. 2024-03-27T07:28:19.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.237+0000 7f3ca39c7640 1 Processor -- start 2024-03-27T07:28:19.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca39c7640 1 -- start start 2024-03-27T07:28:19.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca39c7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c9c108be0 0x7f3c9c1a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca39c7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9c110170 0x7f3c9c1a7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca39c7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c9c1ab6b0 0x7f3c9c1abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca39c7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c120c20 con 0x7f3c9c110170 2024-03-27T07:28:19.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca39c7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c120aa0 con 0x7f3c9c108be0 2024-03-27T07:28:19.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca39c7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c120da0 con 0x7f3c9c1ab6b0 2024-03-27T07:28:19.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca1f64640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c9c1ab6b0 0x7f3c9c1abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca0f62640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9c110170 0x7f3c9c1a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca1f64640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c9c1ab6b0 0x7f3c9c1abb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42022/0 (socket says 172.21.15.82:42022) 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca1f64640 1 -- 172.21.15.82:0/1206929474 learned_addr learned my addr 172.21.15.82:0/1206929474 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.238+0000 7f3ca1763640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c9c108be0 0x7f3c9c1a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.239+0000 7f3ca1f64640 1 -- 172.21.15.82:0/1206929474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c9c108be0 msgr2=0x7f3c9c1a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.239+0000 7f3ca1f64640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c9c108be0 0x7f3c9c1a6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.239+0000 7f3ca1f64640 1 -- 172.21.15.82:0/1206929474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9c110170 msgr2=0x7f3c9c1a7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.239+0000 7f3ca1f64640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9c110170 0x7f3c9c1a7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.239+0000 7f3ca1f64640 1 -- 172.21.15.82:0/1206929474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c1ac210 con 0x7f3c9c1ab6b0 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.239+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9c110170 0x7f3c9c1a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:19.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.239+0000 7f3ca1f64640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c9c1ab6b0 0x7f3c9c1abb60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c94006010 tx=0x7f3c94034670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:19.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.246+0000 7f3c927fc640 1 -- 172.21.15.82:0/1206929474 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94039040 con 0x7f3c9c1ab6b0 2024-03-27T07:28:19.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.247+0000 7f3ca39c7640 1 -- 172.21.15.82:0/1206929474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c9c1ac4a0 con 0x7f3c9c1ab6b0 2024-03-27T07:28:19.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.247+0000 7f3c927fc640 1 -- 172.21.15.82:0/1206929474 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c94042070 con 0x7f3c9c1ab6b0 2024-03-27T07:28:19.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.247+0000 7f3c927fc640 1 -- 172.21.15.82:0/1206929474 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9403ddc0 con 0x7f3c9c1ab6b0 2024-03-27T07:28:19.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.247+0000 7f3ca39c7640 1 -- 172.21.15.82:0/1206929474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c9c110e00 con 0x7f3c9c1ab6b0 2024-03-27T07:28:19.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.252+0000 7f3c927fc640 1 -- 172.21.15.82:0/1206929474 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f3c9403d4c0 con 0x7f3c9c1ab6b0 2024-03-27T07:28:19.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.253+0000 7f3c927fc640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c880a3990 0x7f3c880a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.254+0000 7f3ca65ad740 1 Processor -- start 2024-03-27T07:28:19.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.254+0000 7f3ca65ad740 1 -- start start 2024-03-27T07:28:19.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.254+0000 7f3ca1763640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c880a3990 0x7f3c880a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.254+0000 7f3ca65ad740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 0x5615005e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.254+0000 7f3ca65ad740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x5615005f2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.255+0000 7f3ca0f62640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x5615005f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.255+0000 7f3ca0f62640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x5615005f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48052/0 (socket says 172.21.15.82:48052) 2024-03-27T07:28:19.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.255+0000 7f3ca0f62640 1 -- 172.21.15.82:0/4099289334 learned_addr learned my addr 172.21.15.82:0/4099289334 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:19.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.255+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4099289334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005f2ea0 0x5615005f5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.255+0000 7f3ca1763640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c880a3990 0x7f3c880a5e50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c98005fd0 tx=0x7f3c98005850 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:19.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.255+0000 7f3c927fc640 1 -- 172.21.15.82:0/1206929474 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f3c940f1ba0 con 0x7f3c9c1ab6b0 2024-03-27T07:28:19.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.256+0000 7f3ca1763640 1 --2- 172.21.15.82:0/4099289334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 0x5615005e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.256+0000 7f3ca1f64640 1 --2- 172.21.15.82:0/4099289334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005f2ea0 0x5615005f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.256+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4099289334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56150054d710 con 0x5615005ea2c0 2024-03-27T07:28:19.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.256+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4099289334 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5615004f5af0 con 0x5615005e99a0 2024-03-27T07:28:19.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.256+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4099289334 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5615005496c0 con 0x5615005f2ea0 2024-03-27T07:28:19.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.257+0000 7f3ca0f62640 1 -- 172.21.15.82:0/4099289334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005f2ea0 msgr2=0x5615005f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:19.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.257+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/4099289334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005f2ea0 0x5615005f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.257+0000 7f3ca0f62640 1 -- 172.21.15.82:0/4099289334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 msgr2=0x5615005e9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:19.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.257+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/4099289334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 0x5615005e9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.257+0000 7f3ca0f62640 1 -- 172.21.15.82:0/4099289334 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615002613f0 con 0x5615005ea2c0 2024-03-27T07:28:19.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.258+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/4099289334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x5615005f2960 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009d40 tx=0x7f3c8c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f413627e79187de server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:19.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.258+0000 7f3c877fe640 1 -- 172.21.15.82:0/4099289334 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c012650 con 0x5615005ea2c0 2024-03-27T07:28:19.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.258+0000 7f3c877fe640 1 -- 172.21.15.82:0/4099289334 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c8c009e30 con 0x5615005ea2c0 2024-03-27T07:28:19.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.258+0000 7f3c877fe640 1 -- 172.21.15.82:0/4099289334 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c00fca0 con 0x5615005ea2c0 2024-03-27T07:28:19.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.259+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4099289334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 msgr2=0x5615005f2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:19.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.259+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4099289334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x5615005f2960 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c009d40 tx=0x7f3c8c0117b0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.260+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4099289334 shutdown_connections 2024-03-27T07:28:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.260+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4099289334 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x5615005f2960 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.260+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4099289334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005f2ea0 0x5615005f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.260+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4099289334 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 0x5615005e9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.260+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4099289334 >> 172.21.15.82:0/4099289334 conn(0x5615005e40d0 msgr2=0x5615005e44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.260+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4099289334 shutdown_connections 2024-03-27T07:28:19.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.260+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4099289334 wait complete. 2024-03-27T07:28:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.261+0000 7f3ca65ad740 1 -- start start 2024-03-27T07:28:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.261+0000 7f3ca65ad740 1 Processor -- start 2024-03-27T07:28:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.262+0000 7f3ca65ad740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005e99a0 0x5615005effa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.262+0000 7f3ca65ad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 0x5615005f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.262+0000 7f3ca65ad740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 0x5615005f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.262+0000 7f3ca1763640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005e99a0 0x5615005effa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.262+0000 7f3ca1763640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005e99a0 0x5615005effa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48066/0 (socket says 172.21.15.82:48066) 2024-03-27T07:28:19.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.262+0000 7f3ca0f62640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 0x5615005f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.262+0000 7f3ca0f62640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 0x5615005f04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42044/0 (socket says 172.21.15.82:42044) 2024-03-27T07:28:19.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.263+0000 7f3ca1763640 1 -- 172.21.15.82:0/4220475155 learned_addr learned my addr 172.21.15.82:0/4220475155 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:19.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.263+0000 7f3ca1f64640 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 0x5615005f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.263+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5615005f5ce0 con 0x5615005e99a0 2024-03-27T07:28:19.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.263+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561500508eb0 con 0x5615005f2ea0 2024-03-27T07:28:19.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.263+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5615005f5e60 con 0x5615005ea2c0 2024-03-27T07:28:19.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3ca1763640 1 -- 172.21.15.82:0/4220475155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 msgr2=0x5615005f04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:19.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3ca1763640 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 0x5615005f04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3ca1763640 1 -- 172.21.15.82:0/4220475155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 msgr2=0x5615005f0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:19.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3ca1763640 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 0x5615005f0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3ca1763640 1 -- 172.21.15.82:0/4220475155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56150032b7d0 con 0x5615005e99a0 2024-03-27T07:28:19.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3ca65ad740 10 client.0 _ll_register_callbacks cb 0x5615005456a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:19.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c8c009e30 con 0x5615005e99a0 2024-03-27T07:28:19.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3ca1763640 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005e99a0 0x5615005effa0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3c980116c0 tx=0x7f3c980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa065f3668bcf19 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:19.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3c84ff9640 10 client.16635 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:19.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3c84ff9640 1 -- 172.21.15.82:0/4220475155 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9801f900 con 0x5615005e99a0 2024-03-27T07:28:19.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.264+0000 7f3c84ff9640 1 -- 172.21.15.82:0/4220475155 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f3c9801faa0 con 0x5615005e99a0 2024-03-27T07:28:19.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.265+0000 7f3c84ff9640 1 -- 172.21.15.82:0/4220475155 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c9801fce0 con 0x5615005e99a0 2024-03-27T07:28:19.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.266+0000 7f3ca65ad740 10 client.16635 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:19.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.266+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=28}) -- 0x561500601d90 con 0x5615005e99a0 2024-03-27T07:28:19.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.266+0000 7f3c84ff9640 1 -- 172.21.15.82:0/4220475155 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3c98032480 con 0x5615005e99a0 2024-03-27T07:28:19.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.267+0000 7f3ca65ad740 10 client.16635 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:19.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.267+0000 7f3ca65ad740 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:19.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.267+0000 7f3ca65ad740 20 client.16635 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:19.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.267+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561500603140 0x5615006055b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.267+0000 7f3ca65ad740 4 client.16635 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:19.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.267+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56150055ac50 con 0x561500603140 2024-03-27T07:28:19.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.267+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561500603140 0x5615006055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.267+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561500603140 0x5615006055b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dd77a2663cd7014 server_cookie=8a98e38bcca48288 in_seq=0 out_seq=0 2024-03-27T07:28:19.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.267+0000 7f3c84ff9640 10 client.16635 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:19.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.268+0000 7f3c84ff9640 1 -- 172.21.15.82:0/4220475155 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56150055ac50 con 0x561500603140 2024-03-27T07:28:19.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.268+0000 7f3c84ff9640 10 client.16635 handle_command_reply: tid=0 2024-03-27T07:28:19.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 client.16635 shutdown 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005e99a0 msgr2=0x5615005effa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005e99a0 0x5615005effa0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3c980116c0 tx=0x7f3c980046c0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 shutdown_connections 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 0x5615005f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 0x5615005f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561500603140 0x5615006055b0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3c84ff9640 0 client.16635 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/4220475155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005e99a0 0x5615005effa0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 >> 172.21.15.82:0/4220475155 conn(0x5615005e40d0 msgr2=0x5615005e5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 shutdown_connections 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 1 -- 172.21.15.82:0/4220475155 wait complete. 2024-03-27T07:28:19.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.269+0000 7f3ca65ad740 20 client.16635 trim_cache size 0 max 16384 2024-03-27T07:28:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.284+0000 7f3ca65ad740 1 Processor -- start 2024-03-27T07:28:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.284+0000 7f3ca65ad740 1 -- start start 2024-03-27T07:28:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.284+0000 7f3ca65ad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005e99a0 0x5615005fea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.284+0000 7f3ca65ad740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x56150060aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.284+0000 7f3ca65ad740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 0x5615005e30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.284+0000 7f3ca65ad740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c1c7590 con 0x5615005ea2c0 2024-03-27T07:28:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.284+0000 7f3ca65ad740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c1c4e00 con 0x5615005f2ea0 2024-03-27T07:28:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.284+0000 7f3ca65ad740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c068860 con 0x5615005e99a0 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.284+0000 7f3ca1763640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005e99a0 0x5615005fea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca1f64640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 0x5615005e30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca1763640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005e99a0 0x5615005fea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42058/0 (socket says 172.21.15.82:42058) 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca1763640 1 -- 172.21.15.82:0/2620408181 learned_addr learned my addr 172.21.15.82:0/2620408181 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca1f64640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 0x5615005e30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:39648/0 (socket says 172.21.15.82:39648) 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/2620408181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x56150060aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca1763640 1 -- 172.21.15.82:0/2620408181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 msgr2=0x5615005e30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca1763640 1 --2- 172.21.15.82:0/2620408181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 0x5615005e30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca1763640 1 -- 172.21.15.82:0/2620408181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 msgr2=0x56150060aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca1763640 1 --2- 172.21.15.82:0/2620408181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x56150060aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca1763640 1 -- 172.21.15.82:0/2620408181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615005ea0c0 con 0x5615005e99a0 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/2620408181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x56150060aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3ca1763640 1 --2- 172.21.15.82:0/2620408181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005e99a0 0x5615005fea80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c98011fd0 tx=0x7f3c98021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff4da5cb084ce757 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3c86ffd640 1 -- 172.21.15.82:0/2620408181 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9801f700 con 0x5615005e99a0 2024-03-27T07:28:19.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3c86ffd640 1 -- 172.21.15.82:0/2620408181 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c8c009e30 con 0x5615005e99a0 2024-03-27T07:28:19.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.285+0000 7f3c86ffd640 1 -- 172.21.15.82:0/2620408181 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9801fb00 con 0x5615005e99a0 2024-03-27T07:28:19.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.286+0000 7f3ca65ad740 1 -- 172.21.15.82:0/2620408181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005e99a0 msgr2=0x5615005fea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:19.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.286+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/2620408181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005e99a0 0x5615005fea80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3c98011fd0 tx=0x7f3c98021000 comp rx=0 tx=0).stop 2024-03-27T07:28:19.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.286+0000 7f3ca65ad740 1 -- 172.21.15.82:0/2620408181 shutdown_connections 2024-03-27T07:28:19.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.286+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/2620408181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005ea2c0 0x56150060aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.286+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/2620408181 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005f2ea0 0x5615005e30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.286+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/2620408181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005e99a0 0x5615005fea80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.286+0000 7f3ca65ad740 1 -- 172.21.15.82:0/2620408181 >> 172.21.15.82:0/2620408181 conn(0x5615005e40d0 msgr2=0x5615005e29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.286+0000 7f3ca65ad740 1 -- 172.21.15.82:0/2620408181 shutdown_connections 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.286+0000 7f3ca65ad740 1 -- 172.21.15.82:0/2620408181 wait complete. 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.287+0000 7f3ca65ad740 1 -- start start 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.287+0000 7f3ca65ad740 1 Processor -- start 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.288+0000 7f3ca65ad740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 0x5615005fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.288+0000 7f3ca1763640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 0x5615005fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.288+0000 7f3ca1763640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 0x5615005fafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:39650/0 (socket says 172.21.15.82:39650) 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.288+0000 7f3ca65ad740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 0x5615005fb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.288+0000 7f3ca1763640 1 -- 172.21.15.82:0/758864916 learned_addr learned my addr 172.21.15.82:0/758864916 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.288+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005f2ea0 0x5615005f6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.288+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c117c90 con 0x5615005f2ea0 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.288+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 0x5615005fb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.289+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c1190e0 con 0x5615005e99a0 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.289+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9c118340 con 0x5615005ea2c0 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.289+0000 7f3ca1f64640 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005f2ea0 0x5615005f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.289+0000 7f3ca65ad740 10 client.0 _ll_register_callbacks cb 0x7f3c9800b8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.289+0000 7f3ca0f62640 1 -- 172.21.15.82:0/758864916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 msgr2=0x5615005fafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.289+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 0x5615005fafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.289+0000 7f3ca0f62640 1 -- 172.21.15.82:0/758864916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005f2ea0 msgr2=0x5615005f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.289+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005f2ea0 0x5615005f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.289+0000 7f3ca0f62640 1 -- 172.21.15.82:0/758864916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615005f6e80 con 0x5615005ea2c0 2024-03-27T07:28:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.289+0000 7f3ca1f64640 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005f2ea0 0x5615005f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:19.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.290+0000 7f3ca0f62640 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 0x5615005fb520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c000c00 tx=0x7f3c8c00f510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac8b734bbc51b480 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:19.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.290+0000 7f3c84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:28:19.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.290+0000 7f3c84ff9640 1 -- 172.21.15.82:0/758864916 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c034060 con 0x5615005ea2c0 2024-03-27T07:28:19.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.290+0000 7f3c84ff9640 1 -- 172.21.15.82:0/758864916 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f3c8c00fac0 con 0x5615005ea2c0 2024-03-27T07:28:19.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.291+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c8c009e30 con 0x5615005ea2c0 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.292+0000 7f3c84ff9640 1 -- 172.21.15.82:0/758864916 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3c8c00fcc0 con 0x5615005ea2c0 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.292+0000 7f3ca65ad740 10 client.26488 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.292+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561500669120 con 0x5615005ea2c0 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.292+0000 7f3c84ff9640 1 -- 172.21.15.82:0/758864916 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c8c00fe60 con 0x5615005ea2c0 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.292+0000 7f3c84ff9640 1 -- 172.21.15.82:0/758864916 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3c8c003bf0 con 0x5615005ea2c0 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.293+0000 7f3ca65ad740 10 client.26488 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.293+0000 7f3ca65ad740 10 client.26488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.293+0000 7f3ca65ad740 20 client.26488 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.293+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561500669640 0x56150066ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.293+0000 7f3ca65ad740 4 client.26488 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.293+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3c8c009e30 con 0x561500669640 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.293+0000 7f3ca1763640 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561500669640 0x56150066ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.294+0000 7f3ca1763640 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561500669640 0x56150066ba60 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ffc04f45564474a server_cookie=686f849dc11aa165 in_seq=0 out_seq=0 2024-03-27T07:28:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.294+0000 7f3c84ff9640 10 client.26488 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.295+0000 7f3c84ff9640 1 -- 172.21.15.82:0/758864916 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3c8c009e30 con 0x561500669640 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.295+0000 7f3c84ff9640 10 client.26488 handle_command_reply: tid=0 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.295+0000 7f3ca65ad740 1 client.26488 shutdown 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.295+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 msgr2=0x5615005fb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.295+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 0x5615005fb520 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c000c00 tx=0x7f3c8c00f510 comp rx=0 tx=0).stop 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.296+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 shutdown_connections 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.296+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561500669640 0x56150066ba60 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.296+0000 7f3c84ff9640 0 client.26488 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.296+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5615005f2ea0 0x5615005f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.296+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5615005ea2c0 0x5615005fb520 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.296+0000 7f3ca65ad740 1 --2- 172.21.15.82:0/758864916 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5615005e99a0 0x5615005fafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.296+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 >> 172.21.15.82:0/758864916 conn(0x5615005e40d0 msgr2=0x5615005f07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.296+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 shutdown_connections 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.296+0000 7f3ca65ad740 1 -- 172.21.15.82:0/758864916 wait complete. 2024-03-27T07:28:19.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.296+0000 7f3ca65ad740 20 client.26488 trim_cache size 0 max 16384 2024-03-27T07:28:19.300 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 -- 172.21.15.82:0/1206929474 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c880a3990 msgr2=0x7f3c880a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c880a3990 0x7f3c880a5e50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3c98005fd0 tx=0x7f3c98005850 comp rx=0 tx=0).stop 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 -- 172.21.15.82:0/1206929474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c9c1ab6b0 msgr2=0x7f3c9c1abb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c9c1ab6b0 0x7f3c9c1abb60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3c94006010 tx=0x7f3c94034670 comp rx=0 tx=0).stop 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 -- 172.21.15.82:0/1206929474 shutdown_connections 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3c880a3990 0x7f3c880a5e50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9c110170 0x7f3c9c1a7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c9c1ab6b0 0x7f3c9c1abb60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 --2- 172.21.15.82:0/1206929474 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3c9c108be0 0x7f3c9c1a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 -- 172.21.15.82:0/1206929474 >> 172.21.15.82:0/1206929474 conn(0x7f3c9c06cb00 msgr2=0x7f3c9c0705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 -- 172.21.15.82:0/1206929474 shutdown_connections 2024-03-27T07:28:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:19.297+0000 7f3ca39c7640 1 -- 172.21.15.82:0/1206929474 wait complete. 2024-03-27T07:28:20.315 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T07:28:20.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:28:20.315 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T07:28:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.428+0000 7ff96c3e4640 1 -- 172.21.15.82:0/2473312293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff964100da0 msgr2=0x7ff964104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.428+0000 7ff96c3e4640 1 --2- 172.21.15.82:0/2473312293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff964100da0 0x7ff964104de0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff954009900 tx=0x7ff95402bc30 comp rx=0 tx=0).stop 2024-03-27T07:28:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.428+0000 7ff96c3e4640 1 -- 172.21.15.82:0/2473312293 shutdown_connections 2024-03-27T07:28:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.428+0000 7ff96c3e4640 1 --2- 172.21.15.82:0/2473312293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff964100da0 0x7ff964104de0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.428+0000 7ff96c3e4640 1 --2- 172.21.15.82:0/2473312293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9641054c0 0x7ff96410d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.428+0000 7ff96c3e4640 1 --2- 172.21.15.82:0/2473312293 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641003f0 0x7ff9641007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.428+0000 7ff96c3e4640 1 -- 172.21.15.82:0/2473312293 >> 172.21.15.82:0/2473312293 conn(0x7ff964077010 msgr2=0x7ff9640fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.428+0000 7ff96c3e4640 1 -- 172.21.15.82:0/2473312293 shutdown_connections 2024-03-27T07:28:20.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.428+0000 7ff96c3e4640 1 -- 172.21.15.82:0/2473312293 wait complete. 2024-03-27T07:28:20.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96c3e4640 1 Processor -- start 2024-03-27T07:28:20.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96c3e4640 1 -- start start 2024-03-27T07:28:20.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96c3e4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641003f0 0x7ff964199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96c3e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9641054c0 0x7ff9641997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96c3e4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff964199d10 0x7ff9641a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96c3e4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff964110df0 con 0x7ff964199d10 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96c3e4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff964110c70 con 0x7ff9641003f0 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96c3e4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff964110f70 con 0x7ff9641054c0 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96a981640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff964199d10 0x7ff9641a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96a981640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff964199d10 0x7ff9641a4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48100/0 (socket says 172.21.15.82:48100) 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96a981640 1 -- 172.21.15.82:0/3666015712 learned_addr learned my addr 172.21.15.82:0/3666015712 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96a180640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641003f0 0x7ff964199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96997f640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9641054c0 0x7ff9641997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96a981640 1 -- 172.21.15.82:0/3666015712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9641054c0 msgr2=0x7ff9641997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96a981640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9641054c0 0x7ff9641997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96a981640 1 -- 172.21.15.82:0/3666015712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641003f0 msgr2=0x7ff964199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96a981640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641003f0 0x7ff964199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96a981640 1 -- 172.21.15.82:0/3666015712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9641a4a90 con 0x7ff964199d10 2024-03-27T07:28:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.429+0000 7ff96997f640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9641054c0 0x7ff9641997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.430+0000 7ff96a981640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff964199d10 0x7ff9641a4310 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00eb10 tx=0x7ff95c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.430+0000 7ff95b7fe640 1 -- 172.21.15.82:0/3666015712 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c004b20 con 0x7ff964199d10 2024-03-27T07:28:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.430+0000 7ff96c3e4640 1 -- 172.21.15.82:0/3666015712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9641a4d80 con 0x7ff964199d10 2024-03-27T07:28:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.430+0000 7ff95b7fe640 1 -- 172.21.15.82:0/3666015712 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff95c004cc0 con 0x7ff964199d10 2024-03-27T07:28:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.430+0000 7ff95b7fe640 1 -- 172.21.15.82:0/3666015712 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c010760 con 0x7ff964199d10 2024-03-27T07:28:20.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.430+0000 7ff96c3e4640 1 -- 172.21.15.82:0/3666015712 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9641a52a0 con 0x7ff964199d10 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.432+0000 7ff95b7fe640 1 -- 172.21.15.82:0/3666015712 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7ff95c005020 con 0x7ff964199d10 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96efc5740 1 Processor -- start 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96efc5740 1 -- start start 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff95b7fe640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff9500a3800 0x7ff9500a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a52fb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a52fb770 0x5631a5303e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a5304350 0x5631a5306740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96efc5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5631a5205c20 con 0x5631a52fae50 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96efc5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5631a525e430 con 0x5631a5304350 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96efc5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5631a5206900 con 0x5631a52fb770 2024-03-27T07:28:20.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96997f640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff9500a3800 0x7ff9500a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96a180640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a52fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96a981640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a5304350 0x5631a5306740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff95b7fe640 1 -- 172.21.15.82:0/3666015712 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7ff95c0d06d0 con 0x7ff964199d10 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96a180640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a52fb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48110/0 (socket says 172.21.15.82:48110) 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96a180640 1 -- 172.21.15.82:0/141869750 learned_addr learned my addr 172.21.15.82:0/141869750 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96997f640 1 --2- 172.21.15.82:0/141869750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a52fb770 0x5631a5303e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96a180640 1 -- 172.21.15.82:0/141869750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a52fb770 msgr2=0x5631a5303e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96a180640 1 --2- 172.21.15.82:0/141869750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a52fb770 0x5631a5303e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96a180640 1 -- 172.21.15.82:0/141869750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a5304350 msgr2=0x5631a5306740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96a180640 1 --2- 172.21.15.82:0/141869750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a5304350 0x5631a5306740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.433+0000 7ff96a180640 1 -- 172.21.15.82:0/141869750 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a5259180 con 0x5631a52fae50 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.434+0000 7ff96a981640 1 --2- 172.21.15.82:0/141869750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a5304350 0x5631a5306740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:20.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.434+0000 7ff96a180640 1 --2- 172.21.15.82:0/141869750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a52fb230 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff960009cf0 tx=0x7ff960011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d97114cbb8c61c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.434+0000 7ff96997f640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff9500a3800 0x7ff9500a5cc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff954006010 tx=0x7ff95402cae0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.434+0000 7ff958bfe640 1 -- 172.21.15.82:0/141869750 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960004020 con 0x5631a52fae50 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.434+0000 7ff958bfe640 1 -- 172.21.15.82:0/141869750 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9600041c0 con 0x5631a52fae50 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.434+0000 7ff958bfe640 1 -- 172.21.15.82:0/141869750 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960018750 con 0x5631a52fae50 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 -- 172.21.15.82:0/141869750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 msgr2=0x5631a52fb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 --2- 172.21.15.82:0/141869750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a52fb230 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff960009cf0 tx=0x7ff960011810 comp rx=0 tx=0).stop 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 -- 172.21.15.82:0/141869750 shutdown_connections 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 --2- 172.21.15.82:0/141869750 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a5304350 0x5631a5306740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 --2- 172.21.15.82:0/141869750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a52fb770 0x5631a5303e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 --2- 172.21.15.82:0/141869750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a52fb230 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 -- 172.21.15.82:0/141869750 >> 172.21.15.82:0/141869750 conn(0x5631a52f5580 msgr2=0x5631a52f5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 -- 172.21.15.82:0/141869750 shutdown_connections 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 -- 172.21.15.82:0/141869750 wait complete. 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 -- start start 2024-03-27T07:28:20.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 Processor -- start 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a5303c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fb770 0x5631a5300fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 0x5631a5301510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5631a5219cc0 con 0x5631a52fae50 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5631a525a3e0 con 0x5631a52fb770 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5631a5307140 con 0x5631a5304350 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96efc5740 10 client.0 _ll_register_callbacks cb 0x5631a5254f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96a180640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a5303c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96a180640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a5303c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48114/0 (socket says 172.21.15.82:48114) 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.435+0000 7ff96a180640 1 -- 172.21.15.82:0/3441182759 learned_addr learned my addr 172.21.15.82:0/3441182759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96997f640 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fb770 0x5631a5300fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96a981640 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 0x5631a5301510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96a180640 1 -- 172.21.15.82:0/3441182759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 msgr2=0x5631a5301510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96a180640 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 0x5631a5301510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96a180640 1 -- 172.21.15.82:0/3441182759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fb770 msgr2=0x5631a5300fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96a180640 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fb770 0x5631a5300fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96a180640 1 -- 172.21.15.82:0/3441182759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631a5220ef0 con 0x5631a52fae50 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96a180640 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a5303c40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff960003f10 tx=0x7ff960003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93e565572368703 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff94dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff94dffb640 1 -- 172.21.15.82:0/3441182759 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff960026070 con 0x5631a52fae50 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff94dffb640 1 -- 172.21.15.82:0/3441182759 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7ff960009de0 con 0x5631a52fae50 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96efc5740 1 -- 172.21.15.82:0/3441182759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9600041c0 con 0x5631a52fae50 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff94dffb640 1 -- 172.21.15.82:0/3441182759 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff960032050 con 0x5631a52fae50 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96efc5740 10 client.16653 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff96efc5740 1 -- 172.21.15.82:0/3441182759 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5631a503a7e0 con 0x5631a52fae50 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.436+0000 7ff94dffb640 1 -- 172.21.15.82:0/3441182759 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9600041c0 con 0x5631a52fae50 2024-03-27T07:28:20.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.437+0000 7ff94dffb640 1 -- 172.21.15.82:0/3441182759 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7ff960019430 con 0x5631a52fae50 2024-03-27T07:28:20.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.437+0000 7ff96efc5740 10 client.16653 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:20.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.437+0000 7ff96efc5740 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:20.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.437+0000 7ff96efc5740 20 client.16653 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:20.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.437+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5631a5314110 0x5631a5316500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.437+0000 7ff96efc5740 4 client.16653 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:20.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.437+0000 7ff96efc5740 1 -- 172.21.15.82:0/3441182759 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631a526b970 con 0x5631a5314110 2024-03-27T07:28:20.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.437+0000 7ff96997f640 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5631a5314110 0x5631a5316500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.437+0000 7ff94dffb640 10 client.16653 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:20.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.437+0000 7ff96997f640 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5631a5314110 0x5631a5316500 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cf0650bc13473ef server_cookie=10ec6b8e5f6155b4 in_seq=0 out_seq=0 2024-03-27T07:28:20.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff94dffb640 1 -- 172.21.15.82:0/3441182759 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5631a526b970 con 0x5631a5314110 2024-03-27T07:28:20.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff94dffb640 10 client.16653 handle_command_reply: tid=0 2024-03-27T07:28:20.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 client.16653 shutdown 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 -- 172.21.15.82:0/3441182759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 msgr2=0x5631a5303c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a5303c40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff960003f10 tx=0x7ff960003c40 comp rx=0 tx=0).stop 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 -- 172.21.15.82:0/3441182759 shutdown_connections 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 0x5631a5301510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fb770 0x5631a5300fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5631a5314110 0x5631a5316500 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3441182759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fae50 0x5631a5303c40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff94dffb640 0 client.16653 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 -- 172.21.15.82:0/3441182759 >> 172.21.15.82:0/3441182759 conn(0x5631a52f5580 msgr2=0x5631a52f72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 -- 172.21.15.82:0/3441182759 shutdown_connections 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.440+0000 7ff96efc5740 1 -- 172.21.15.82:0/3441182759 wait complete. 2024-03-27T07:28:20.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.441+0000 7ff96efc5740 20 client.16653 trim_cache size 0 max 16384 2024-03-27T07:28:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.458+0000 7ff96efc5740 1 Processor -- start 2024-03-27T07:28:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.458+0000 7ff96efc5740 1 -- start start 2024-03-27T07:28:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fae50 0x5631a530fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a52fb770 0x5631a52fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a5304350 0x5631a531bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96efc5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9641b0090 con 0x5631a5304350 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96efc5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff9641ad900 con 0x5631a52fae50 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96efc5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff9641ab770 con 0x5631a52fb770 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96a981640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a5304350 0x5631a531bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96a981640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a5304350 0x5631a531bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48118/0 (socket says 172.21.15.82:48118) 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96a180640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fae50 0x5631a530fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96a981640 1 -- 172.21.15.82:0/1793101029 learned_addr learned my addr 172.21.15.82:0/1793101029 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96997f640 1 --2- 172.21.15.82:0/1793101029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a52fb770 0x5631a52fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96a981640 1 -- 172.21.15.82:0/1793101029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a52fb770 msgr2=0x5631a52fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96a981640 1 --2- 172.21.15.82:0/1793101029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a52fb770 0x5631a52fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96a981640 1 -- 172.21.15.82:0/1793101029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fae50 msgr2=0x5631a530fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96a981640 1 --2- 172.21.15.82:0/1793101029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fae50 0x5631a530fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96a981640 1 -- 172.21.15.82:0/1793101029 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631a52fb5a0 con 0x5631a5304350 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff96a981640 1 --2- 172.21.15.82:0/1793101029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a5304350 0x5631a531bd30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff95c098cb0 tx=0x7ff95c009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48239ba712f2c3de server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff94ffff640 1 -- 172.21.15.82:0/1793101029 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c09cf50 con 0x5631a5304350 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff94ffff640 1 -- 172.21.15.82:0/1793101029 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff95c09c850 con 0x5631a5304350 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.459+0000 7ff94ffff640 1 -- 172.21.15.82:0/1793101029 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0870c0 con 0x5631a5304350 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 -- 172.21.15.82:0/1793101029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a5304350 msgr2=0x5631a531bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 --2- 172.21.15.82:0/1793101029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a5304350 0x5631a531bd30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff95c098cb0 tx=0x7ff95c009200 comp rx=0 tx=0).stop 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 -- 172.21.15.82:0/1793101029 shutdown_connections 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 --2- 172.21.15.82:0/1793101029 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a5304350 0x5631a531bd30 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 --2- 172.21.15.82:0/1793101029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a52fb770 0x5631a52fc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 --2- 172.21.15.82:0/1793101029 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fae50 0x5631a530fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 -- 172.21.15.82:0/1793101029 >> 172.21.15.82:0/1793101029 conn(0x5631a52f5580 msgr2=0x5631a52fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 -- 172.21.15.82:0/1793101029 shutdown_connections 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 -- 172.21.15.82:0/1793101029 wait complete. 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 -- start start 2024-03-27T07:28:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.460+0000 7ff96efc5740 1 Processor -- start 2024-03-27T07:28:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fae50 0x5631a53080b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fb770 0x5631a53085f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96efc5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 0x5631a537d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96efc5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9641abdc0 con 0x5631a52fb770 2024-03-27T07:28:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96efc5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff9641ad230 con 0x5631a52fae50 2024-03-27T07:28:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96efc5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff9641ac490 con 0x5631a5304350 2024-03-27T07:28:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96efc5740 10 client.0 _ll_register_callbacks cb 0x7ff960009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96997f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fb770 0x5631a53085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96997f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fb770 0x5631a53085f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48130/0 (socket says 172.21.15.82:48130) 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96997f640 1 -- 172.21.15.82:0/3176073890 learned_addr learned my addr 172.21.15.82:0/3176073890 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96a180640 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fae50 0x5631a53080b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96a981640 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 0x5631a537d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96997f640 1 -- 172.21.15.82:0/3176073890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 msgr2=0x5631a537d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96997f640 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 0x5631a537d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96997f640 1 -- 172.21.15.82:0/3176073890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fae50 msgr2=0x5631a53080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96997f640 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fae50 0x5631a53080b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96997f640 1 -- 172.21.15.82:0/3176073890 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631a509af70 con 0x5631a52fb770 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96a981640 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 0x5631a537d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96997f640 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fb770 0x5631a53085f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff9640742d0 tx=0x7ff95402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c727c38ceab7f7f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff94dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff94dffb640 1 -- 172.21.15.82:0/3176073890 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff954048070 con 0x5631a52fb770 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff94dffb640 1 -- 172.21.15.82:0/3176073890 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7ff954005510 con 0x5631a52fb770 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.461+0000 7ff96efc5740 1 -- 172.21.15.82:0/3176073890 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff95c09c850 con 0x5631a52fb770 2024-03-27T07:28:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff94dffb640 1 -- 172.21.15.82:0/3176073890 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff9540500b0 con 0x5631a52fb770 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff96efc5740 10 client.16659 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff96efc5740 1 -- 172.21.15.82:0/3176073890 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5631a4f32170 con 0x5631a52fb770 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff94dffb640 1 -- 172.21.15.82:0/3176073890 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff95c09c850 con 0x5631a52fb770 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff94dffb640 1 -- 172.21.15.82:0/3176073890 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7ff954050ce0 con 0x5631a52fb770 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff96efc5740 10 client.16659 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff96efc5740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff96efc5740 20 client.16659 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5631a537f2d0 0x5631a53816f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff96efc5740 4 client.16659 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff96efc5740 1 -- 172.21.15.82:0/3176073890 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5631a5265cc0 con 0x5631a537f2d0 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff96a180640 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5631a537f2d0 0x5631a53816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff94dffb640 10 client.16659 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:20.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.462+0000 7ff96a180640 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5631a537f2d0 0x5631a53816f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc557aaace7e16de server_cookie=80add9ba28ad6d4d in_seq=0 out_seq=0 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff94dffb640 1 -- 172.21.15.82:0/3176073890 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5631a5265cc0 con 0x5631a537f2d0 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff94dffb640 10 client.16659 handle_command_reply: tid=0 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 client.16659 shutdown 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 -- 172.21.15.82:0/3176073890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fb770 msgr2=0x5631a53085f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fb770 0x5631a53085f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff9640742d0 tx=0x7ff95402bc30 comp rx=0 tx=0).stop 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 -- 172.21.15.82:0/3176073890 shutdown_connections 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5631a537f2d0 0x5631a53816f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5631a52fb770 0x5631a53085f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5631a5304350 0x5631a537d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff94dffb640 0 client.16659 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 --2- 172.21.15.82:0/3176073890 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5631a52fae50 0x5631a53080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 -- 172.21.15.82:0/3176073890 >> 172.21.15.82:0/3176073890 conn(0x5631a52f5580 msgr2=0x5631a52f4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 -- 172.21.15.82:0/3176073890 shutdown_connections 2024-03-27T07:28:20.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.464+0000 7ff96efc5740 1 -- 172.21.15.82:0/3176073890 wait complete. 2024-03-27T07:28:20.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96efc5740 20 client.16659 trim_cache size 0 max 16384 2024-03-27T07:28:20.473 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:28:20.473 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-03-27T07:28:20.473 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "fd009f19-a787-4235-9acd-0c29ec151cb3", 2024-03-27T07:28:20.473 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-03-27T07:28:20.473 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:28:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 -- 172.21.15.82:0/3666015712 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff9500a3800 msgr2=0x7ff9500a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff9500a3800 0x7ff9500a5cc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff954006010 tx=0x7ff95402cae0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 -- 172.21.15.82:0/3666015712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff964199d10 msgr2=0x7ff9641a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff964199d10 0x7ff9641a4310 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00eb10 tx=0x7ff95c00c2d0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 -- 172.21.15.82:0/3666015712 shutdown_connections 2024-03-27T07:28:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff9500a3800 0x7ff9500a5cc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff964199d10 0x7ff9641a4310 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9641054c0 0x7ff9641997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 --2- 172.21.15.82:0/3666015712 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff9641003f0 0x7ff964199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 -- 172.21.15.82:0/3666015712 >> 172.21.15.82:0/3666015712 conn(0x7ff964077010 msgr2=0x7ff9641036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 -- 172.21.15.82:0/3666015712 shutdown_connections 2024-03-27T07:28:20.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.465+0000 7ff96c3e4640 1 -- 172.21.15.82:0/3666015712 wait complete. 2024-03-27T07:28:20.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:28:20.479 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:28:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.589+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1513659311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3c10c160 msgr2=0x7f5d3c10e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.589+0000 7f5d40aa4640 1 --2- 172.21.15.82:0/1513659311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3c10c160 0x7f5d3c10e590 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009900 tx=0x7f5d2402bcd0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.589+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1513659311 shutdown_connections 2024-03-27T07:28:20.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.589+0000 7f5d40aa4640 1 --2- 172.21.15.82:0/1513659311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3c10c160 0x7f5d3c10e590 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.589+0000 7f5d40aa4640 1 --2- 172.21.15.82:0/1513659311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3c1036b0 0x7f5d3c10bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.589+0000 7f5d40aa4640 1 --2- 172.21.15.82:0/1513659311 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d3c102d90 0x7f5d3c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.589+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1513659311 >> 172.21.15.82:0/1513659311 conn(0x7f5d3c076dd0 msgr2=0x7f5d3c0771e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.590+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1513659311 shutdown_connections 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.590+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1513659311 wait complete. 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.590+0000 7f5d40aa4640 1 Processor -- start 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.590+0000 7f5d40aa4640 1 -- start start 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.590+0000 7f5d40aa4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3c102d90 0x7f5d3c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.590+0000 7f5d40aa4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3c1036b0 0x7f5d3c198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.590+0000 7f5d40aa4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d3c10c160 0x7f5d3c19cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.590+0000 7f5d40aa4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c111ef0 con 0x7f5d3c102d90 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.590+0000 7f5d40aa4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c111d70 con 0x7f5d3c10c160 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.590+0000 7f5d40aa4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c112070 con 0x7f5d3c1036b0 2024-03-27T07:28:20.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3c102d90 0x7f5d3c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3a59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3c102d90 0x7f5d3c198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48152/0 (socket says 172.21.15.82:48152) 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3a59c640 1 -- 172.21.15.82:0/1821141445 learned_addr learned my addr 172.21.15.82:0/1821141445 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3c1036b0 0x7f5d3c198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3ad9d640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d3c10c160 0x7f5d3c19cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3a59c640 1 -- 172.21.15.82:0/1821141445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3c1036b0 msgr2=0x7f5d3c198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3a59c640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3c1036b0 0x7f5d3c198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3a59c640 1 -- 172.21.15.82:0/1821141445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d3c10c160 msgr2=0x7f5d3c19cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3a59c640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d3c10c160 0x7f5d3c19cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3a59c640 1 -- 172.21.15.82:0/1821141445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c19d3b0 con 0x7f5d3c102d90 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3ad9d640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d3c10c160 0x7f5d3c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d3a59c640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3c102d90 0x7f5d3c198410 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400ebc0 tx=0x7f5d3400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d337fe640 1 -- 172.21.15.82:0/1821141445 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34010630 con 0x7f5d3c102d90 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1821141445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c19d6a0 con 0x7f5d3c102d90 2024-03-27T07:28:20.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d337fe640 1 -- 172.21.15.82:0/1821141445 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d34010cb0 con 0x7f5d3c102d90 2024-03-27T07:28:20.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d337fe640 1 -- 172.21.15.82:0/1821141445 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34018bd0 con 0x7f5d3c102d90 2024-03-27T07:28:20.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.591+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1821141445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c1a4f30 con 0x7f5d3c102d90 2024-03-27T07:28:20.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.593+0000 7f5d337fe640 1 -- 172.21.15.82:0/1821141445 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f5d340107d0 con 0x7f5d3c102d90 2024-03-27T07:28:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.593+0000 7f5d4376f740 1 Processor -- start 2024-03-27T07:28:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d4376f740 1 -- start start 2024-03-27T07:28:20.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675250 0x555898675630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555898675b70 0x55589867e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55589867e750 0x555898680b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d4376f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5558985d9860 con 0x555898675250 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d4376f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5558985818d0 con 0x55589867e750 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d4376f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5558985d5810 con 0x555898675b70 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d3ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675250 0x555898675630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d3a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555898675b70 0x55589867e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d3ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675250 0x555898675630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48154/0 (socket says 172.21.15.82:48154) 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d3ad9d640 1 -- 172.21.15.82:0/1613070856 learned_addr learned my addr 172.21.15.82:0/1613070856 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/1613070856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55589867e750 0x555898680b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d337fe640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5d280a3780 0x7f5d280a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d3ad9d640 1 -- 172.21.15.82:0/1613070856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555898675b70 msgr2=0x55589867e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d3ad9d640 1 --2- 172.21.15.82:0/1613070856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555898675b70 0x55589867e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d3ad9d640 1 -- 172.21.15.82:0/1613070856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55589867e750 msgr2=0x555898680b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d3ad9d640 1 --2- 172.21.15.82:0/1613070856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55589867e750 0x555898680b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d3ad9d640 1 -- 172.21.15.82:0/1613070856 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55589858c120 con 0x555898675250 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.594+0000 7f5d337fe640 1 -- 172.21.15.82:0/1821141445 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f5d340d0760 con 0x7f5d3c102d90 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.595+0000 7f5d3ad9d640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5d280a3780 0x7f5d280a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.595+0000 7f5d3ad9d640 1 --2- 172.21.15.82:0/1613070856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675250 0x555898675630 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c06b200 tx=0x7f5d2402c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f816cfe1667625 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.595+0000 7f5d30ff9640 1 -- 172.21.15.82:0/1613070856 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24044070 con 0x555898675250 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.595+0000 7f5d3ad9d640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5d280a3780 0x7f5d280a5c40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x555898681110 tx=0x7f5d24044000 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.595+0000 7f5d30ff9640 1 -- 172.21.15.82:0/1613070856 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d24005520 con 0x555898675250 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.595+0000 7f5d30ff9640 1 -- 172.21.15.82:0/1613070856 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24004c90 con 0x555898675250 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 -- 172.21.15.82:0/1613070856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675250 msgr2=0x555898675630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1613070856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675250 0x555898675630 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c06b200 tx=0x7f5d2402c670 comp rx=0 tx=0).stop 2024-03-27T07:28:20.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 -- 172.21.15.82:0/1613070856 shutdown_connections 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1613070856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55589867e750 0x555898680b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1613070856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555898675b70 0x55589867e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1613070856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675250 0x555898675630 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 -- 172.21.15.82:0/1613070856 >> 172.21.15.82:0/1613070856 conn(0x55589866f980 msgr2=0x55589866fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 -- 172.21.15.82:0/1613070856 shutdown_connections 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 -- 172.21.15.82:0/1613070856 wait complete. 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 -- start start 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 Processor -- start 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555898675250 0x55589867b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589867bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55589867e750 0x55589867c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555898681540 con 0x555898675b70 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555898594cd0 con 0x55589867e750 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5558986816c0 con 0x555898675250 2024-03-27T07:28:20.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d4376f740 10 client.0 _ll_register_callbacks cb 0x555898586ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d39d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589867bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d39d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589867bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48168/0 (socket says 172.21.15.82:48168) 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.596+0000 7f5d39d9b640 1 -- 172.21.15.82:0/1249966036 learned_addr learned my addr 172.21.15.82:0/1249966036 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d3a59c640 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555898675250 0x55589867b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d3ad9d640 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55589867e750 0x55589867c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d39d9b640 1 -- 172.21.15.82:0/1249966036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555898675250 msgr2=0x55589867b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555898675250 0x55589867b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d39d9b640 1 -- 172.21.15.82:0/1249966036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55589867e750 msgr2=0x55589867c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55589867e750 0x55589867c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d39d9b640 1 -- 172.21.15.82:0/1249966036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558983b77d0 con 0x555898675b70 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589867bc90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c012700 tx=0x7f5d2c012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ea3f21dc070f40 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d21ffb640 1 -- 172.21.15.82:0/1249966036 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c00f8c0 con 0x555898675b70 2024-03-27T07:28:20.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d21ffb640 1 -- 172.21.15.82:0/1249966036 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f5d2c00fa60 con 0x555898675b70 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d4376f740 1 -- 172.21.15.82:0/1249966036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d24005520 con 0x555898675b70 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d21ffb640 1 -- 172.21.15.82:0/1249966036 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d2c00fc60 con 0x555898675b70 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d4376f740 10 client.16671 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d4376f740 1 -- 172.21.15.82:0/1249966036 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5558982ed3f0 con 0x555898675b70 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d21ffb640 1 -- 172.21.15.82:0/1249966036 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d24005520 con 0x555898675b70 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.597+0000 7f5d21ffb640 1 -- 172.21.15.82:0/1249966036 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f5d2c01c590 con 0x555898675b70 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.598+0000 7f5d4376f740 10 client.16671 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.598+0000 7f5d4376f740 10 client.16671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.598+0000 7f5d4376f740 20 client.16671 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.598+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55589868eb30 0x555898690f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.598+0000 7f5d4376f740 4 client.16671 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.598+0000 7f5d4376f740 1 -- 172.21.15.82:0/1249966036 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558985e6da0 con 0x55589868eb30 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.598+0000 7f5d3a59c640 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55589868eb30 0x555898690f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.598+0000 7f5d21ffb640 10 client.16671 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:20.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.598+0000 7f5d3a59c640 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55589868eb30 0x555898690f90 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a14e455dae21982d server_cookie=a6c2df6b6cab4fd2 in_seq=0 out_seq=0 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d21ffb640 1 -- 172.21.15.82:0/1249966036 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5558985e6da0 con 0x55589868eb30 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d21ffb640 10 client.16671 handle_command_reply: tid=0 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 client.16671 shutdown 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 -- 172.21.15.82:0/1249966036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 msgr2=0x55589867bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589867bc90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c012700 tx=0x7f5d2c012bc0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 -- 172.21.15.82:0/1249966036 shutdown_connections 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55589868eb30 0x555898690f90 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589867bc90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d21ffb640 0 client.16671 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55589867e750 0x55589867c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1249966036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555898675250 0x55589867b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 -- 172.21.15.82:0/1249966036 >> 172.21.15.82:0/1249966036 conn(0x55589866f980 msgr2=0x5558986716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 -- 172.21.15.82:0/1249966036 shutdown_connections 2024-03-27T07:28:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 1 -- 172.21.15.82:0/1249966036 wait complete. 2024-03-27T07:28:20.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.612+0000 7f5d4376f740 20 client.16671 trim_cache size 0 max 16384 2024-03-27T07:28:20.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.629+0000 7f5d4376f740 1 Processor -- start 2024-03-27T07:28:20.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.629+0000 7f5d4376f740 1 -- start start 2024-03-27T07:28:20.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 0x55589867de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589868a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55589867e750 0x5558986714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d4376f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c1b0080 con 0x555898675b70 2024-03-27T07:28:20.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d4376f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c1ad8f0 con 0x555898675250 2024-03-27T07:28:20.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d4376f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c1ab740 con 0x55589867e750 2024-03-27T07:28:20.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d39d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589868a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d3a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 0x55589867de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d3ad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55589867e750 0x5558986714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d39d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589868a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48170/0 (socket says 172.21.15.82:48170) 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d39d9b640 1 -- 172.21.15.82:0/1259717974 learned_addr learned my addr 172.21.15.82:0/1259717974 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d39d9b640 1 -- 172.21.15.82:0/1259717974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55589867e750 msgr2=0x5558986714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/1259717974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55589867e750 0x5558986714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d39d9b640 1 -- 172.21.15.82:0/1259717974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 msgr2=0x55589867de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/1259717974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 0x55589867de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d39d9b640 1 -- 172.21.15.82:0/1259717974 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558982ad0f0 con 0x555898675b70 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d3a59c640 1 --2- 172.21.15.82:0/1259717974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 0x55589867de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/1259717974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589868a2e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009950 tx=0x7f5d2c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ab4434b56c5dad server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.630+0000 7f5d23fff640 1 -- 172.21.15.82:0/1259717974 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c02b030 con 0x555898675b70 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d23fff640 1 -- 172.21.15.82:0/1259717974 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d2c01cc60 con 0x555898675b70 2024-03-27T07:28:20.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d23fff640 1 -- 172.21.15.82:0/1259717974 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c00f790 con 0x555898675b70 2024-03-27T07:28:20.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d4376f740 1 -- 172.21.15.82:0/1259717974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 msgr2=0x55589868a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1259717974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589868a2e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c009950 tx=0x7f5d2c00ff90 comp rx=0 tx=0).stop 2024-03-27T07:28:20.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d4376f740 1 -- 172.21.15.82:0/1259717974 shutdown_connections 2024-03-27T07:28:20.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1259717974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x55589868a2e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1259717974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55589867e750 0x5558986714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d4376f740 1 --2- 172.21.15.82:0/1259717974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 0x55589867de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d4376f740 1 -- 172.21.15.82:0/1259717974 >> 172.21.15.82:0/1259717974 conn(0x55589866f980 msgr2=0x555898670db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d4376f740 1 -- 172.21.15.82:0/1259717974 shutdown_connections 2024-03-27T07:28:20.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.631+0000 7f5d4376f740 1 -- 172.21.15.82:0/1259717974 wait complete. 2024-03-27T07:28:20.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d4376f740 1 -- start start 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d4376f740 1 Processor -- start 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 0x5558986868e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x555898681e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d4376f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55589867e750 0x5558986823d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d4376f740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c1abdb0 con 0x555898675b70 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d4376f740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c1ad220 con 0x555898675250 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d4376f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c1ac480 con 0x55589867e750 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d4376f740 10 client.0 _ll_register_callbacks cb 0x7f5d2c009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d39d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x555898681e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d39d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x555898681e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48186/0 (socket says 172.21.15.82:48186) 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d39d9b640 1 -- 172.21.15.82:0/3714784631 learned_addr learned my addr 172.21.15.82:0/3714784631 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d3a59c640 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 0x5558986868e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d3ad9d640 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55589867e750 0x5558986823d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d39d9b640 1 -- 172.21.15.82:0/3714784631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55589867e750 msgr2=0x5558986823d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55589867e750 0x5558986823d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d39d9b640 1 -- 172.21.15.82:0/3714784631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 msgr2=0x5558986868e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 0x5558986868e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.632+0000 7f5d39d9b640 1 -- 172.21.15.82:0/3714784631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555898682940 con 0x555898675b70 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d39d9b640 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x555898681e90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c01c4b0 tx=0x7f5d2c01c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f50b9b89c84059 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d21ffb640 1 -- 172.21.15.82:0/3714784631 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c02b070 con 0x555898675b70 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d21ffb640 1 -- 172.21.15.82:0/3714784631 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f5d2c026690 con 0x555898675b70 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d4376f740 1 -- 172.21.15.82:0/3714784631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d2c01cc60 con 0x555898675b70 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d21ffb640 1 -- 172.21.15.82:0/3714784631 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d2c026890 con 0x555898675b70 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d4376f740 10 client.16677 fetch_fsmap learned FSMap version 28 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d4376f740 1 -- 172.21.15.82:0/3714784631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5558986f4c40 con 0x555898675b70 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d21ffb640 1 -- 172.21.15.82:0/3714784631 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d2c01cc60 con 0x555898675b70 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d21ffb640 1 -- 172.21.15.82:0/3714784631 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f5d2c0306a0 con 0x555898675b70 2024-03-27T07:28:20.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d4376f740 10 client.16677 fetch_fsmap finished waiting for FSMap version 28 2024-03-27T07:28:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d4376f740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d4376f740 20 client.16677 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d4376f740 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5558986f5300 0x5558986f7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d4376f740 4 client.16677 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:28:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d4376f740 1 -- 172.21.15.82:0/3714784631 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5558985e10f0 con 0x5558986f5300 2024-03-27T07:28:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.633+0000 7f5d3a59c640 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5558986f5300 0x5558986f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.634+0000 7f5d21ffb640 10 client.16677 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:20.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.634+0000 7f5d3a59c640 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5558986f5300 0x5558986f7720 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99d5fdb578b1a04e server_cookie=37ddf77ebbd04451 in_seq=0 out_seq=0 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.654+0000 7f5d21ffb640 1 -- 172.21.15.82:0/3714784631 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x5558985e10f0 con 0x5558986f5300 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.654+0000 7f5d21ffb640 10 client.16677 handle_command_reply: tid=0 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.654+0000 7f5d4376f740 1 client.16677 shutdown 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 1 -- 172.21.15.82:0/3714784631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 msgr2=0x555898681e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x555898681e90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c01c4b0 tx=0x7f5d2c01c650 comp rx=0 tx=0).stop 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 1 -- 172.21.15.82:0/3714784631 shutdown_connections 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5558986f5300 0x5558986f7720 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555898675b70 0x555898681e90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55589867e750 0x5558986823d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 1 --2- 172.21.15.82:0/3714784631 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555898675250 0x5558986868e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 1 -- 172.21.15.82:0/3714784631 >> 172.21.15.82:0/3714784631 conn(0x55589866f980 msgr2=0x55589866e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d21ffb640 0 client.16677 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 1 -- 172.21.15.82:0/3714784631 shutdown_connections 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 1 -- 172.21.15.82:0/3714784631 wait complete. 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.655+0000 7f5d4376f740 20 client.16677 trim_cache size 0 max 16384 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "scrub active (2443 inodes in the stack)", 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stdout: "fd009f19-a787-4235-9acd-0c29ec151cb3": { 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "fd009f19-a787-4235-9acd-0c29ec151cb3", 2024-03-27T07:28:20.659 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-03-27T07:28:20.660 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:28:20.660 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:28:20.660 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:28:20.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1821141445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5d280a3780 msgr2=0x7f5d280a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5d280a3780 0x7f5d280a5c40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x555898681110 tx=0x7f5d24044000 comp rx=0 tx=0).stop 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1821141445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3c102d90 msgr2=0x7f5d3c198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3c102d90 0x7f5d3c198410 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400ebc0 tx=0x7f5d3400c6a0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1821141445 shutdown_connections 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5d280a3780 0x7f5d280a5c40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5d3c10c160 0x7f5d3c19cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d3c1036b0 0x7f5d3c198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 --2- 172.21.15.82:0/1821141445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5d3c102d90 0x7f5d3c198410 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1821141445 >> 172.21.15.82:0/1821141445 conn(0x7f5d3c076dd0 msgr2=0x7f5d3c0fd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1821141445 shutdown_connections 2024-03-27T07:28:20.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:20.656+0000 7f5d40aa4640 1 -- 172.21.15.82:0/1821141445 wait complete. 2024-03-27T07:28:20.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:20 smithi082 ceph-mon[32178]: pgmap v145: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 408 op/s 2024-03-27T07:28:20.670 INFO:tasks.cephfs.filesystem:scrub status for tag:fd009f19-a787-4235-9acd-0c29ec151cb3 - {'path': '/', 'tag': 'fd009f19-a787-4235-9acd-0c29ec151cb3', 'options': 'recursive,force'} 2024-03-27T07:28:20.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-mon[36179]: pgmap v145: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 408 op/s 2024-03-27T07:28:21.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:20 smithi149 ceph-mon[36065]: pgmap v145: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 2.5 MiB/s wr, 408 op/s 2024-03-27T07:28:21.116 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.839+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cf2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-59.xml auth{0=1} v864 ap=1 s=11993 n(v0 rc2024-03-27T07:26:17.661011+0000 b11993 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8f9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cf2:[<0x20000002cc2/article-59.xml v864>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cf2:[<0x20000002cc2/article-59.xml v864>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.839+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eca [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-13.jpg auth{0=1} v1100 ap=1 s=62814 n(v0 rc2024-03-27T07:26:22.390918+0000 b62814 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8f9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eca:[<0x20000002cc2/picture-13.jpg v754>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eca:[<0x20000002cc2/picture-13.jpg v1100>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.840+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ebb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-18.jpg auth{0=1} v1090 ap=1 s=56612 n(v0 rc2024-03-27T07:26:22.363918+0000 b56612 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ebb:[<0x20000002cc2/picture-18.jpg v724>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ebb:[<0x20000002cc2/picture-18.jpg v1090>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.840+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cc6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-74.xml auth{0=1} v910 ap=1 s=28172 n(v0 rc2024-03-27T07:26:17.549013+0000 b28172 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8fa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cc6:[<0x20000002cc2/article-74.xml v910>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cc6:[<0x20000002cc2/article-74.xml v910>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.841+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d80 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-18.xml auth{0=1} v996 ap=1 s=10056 n(v0 rc2024-03-27T07:26:18.237000+0000 b10056 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8fa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d80:[<0x20000002cc2/article-18.xml v996>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d80:[<0x20000002cc2/article-18.xml v996>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.841+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-5.xml auth{0=1} v1241 ap=1 s=7003 n(v0 rc2024-03-27T07:27:36.361466+0000 b7003 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac8fac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd0:[<0x20000002cc2/comment-5.xml v1231>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bd0:[<0x20000002cc2/comment-5.xml v1241>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.842+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c8d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-19.jpg auth{0=1} v1102 ap=1 s=64091 n(v0 rc2024-03-27T07:26:25.933848+0000 b64091 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c8d:[<0x20000002cc2/picture-19.jpg v1030>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c8d:[<0x20000002cc2/picture-19.jpg v1102>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.843+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d0a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-51.xml auth{0=1} v976 ap=1 s=3044 n(v0 rc2024-03-27T07:26:17.709010+0000 b3044 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8fb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d0a:[<0x20000002cc2/article-51.xml v976>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d0a:[<0x20000002cc2/article-51.xml v976>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.843+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ac8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-29.xml auth{0=1} v1247 ap=1 s=2251 n(v0 rc2024-03-27T07:27:34.355505+0000 b2251 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607abe9a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ac8:[<0x20000002cc2/comment-29.xml v1176>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ac8:[<0x20000002cc2/comment-29.xml v1247>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.844+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d5e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-27.xml auth{0=1} v964 ap=1 s=29448 n(v0 rc2024-03-27T07:26:18.112002+0000 b29448 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe9a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d5e:[<0x20000002cc2/article-27.xml v964>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d5e:[<0x20000002cc2/article-27.xml v964>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.844+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ee5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-4.jpg auth{0=1} v1088 ap=1 s=57226 n(v0 rc2024-03-27T07:26:22.473916+0000 b57226 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe9ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ee5:[<0x20000002cc2/picture-4.jpg v808>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ee5:[<0x20000002cc2/picture-4.jpg v1088>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.117 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.845+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e5f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-35.jpg auth{0=1} v1086 ap=1 s=21795 n(v0 rc2024-03-27T07:26:21.997926+0000 b21795 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe9b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e5f:[<0x20000002cc2/picture-35.jpg v622>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e5f:[<0x20000002cc2/picture-35.jpg v1086>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.846+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eeb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-2.jpg auth{0=1} v1094 ap=1 s=8438 n(v0 rc2024-03-27T07:26:22.491916+0000 b8438 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe9b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eeb:[<0x20000002cc2/picture-2.jpg v820>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eeb:[<0x20000002cc2/picture-2.jpg v1094>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.846+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cd2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-70.xml auth{0=1} v962 ap=1 s=1047 n(v0 rc2024-03-27T07:26:17.590013+0000 b1047 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe9bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cd2:[<0x20000002cc2/article-70.xml v962>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cd2:[<0x20000002cc2/article-70.xml v962>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.847+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d79 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-20.xml auth{0=1} v926 ap=1 s=23245 n(v0 rc2024-03-27T07:26:18.221000+0000 b23245 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe9c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d79:[<0x20000002cc2/article-20.xml v926>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d79:[<0x20000002cc2/article-20.xml v926>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.847+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ec7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-14.jpg auth{0=1} v1096 ap=1 s=15677 n(v0 rc2024-03-27T07:26:22.384918+0000 b15677 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe9c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ec7:[<0x20000002cc2/picture-14.jpg v748>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ec7:[<0x20000002cc2/picture-14.jpg v1096>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.848+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c8f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-83.xml auth v1104 ap=1 s=14671 n(v0 rc2024-03-27T07:26:26.075845+0000 b14671 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607abe9cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c8f:[<0x20000002cc2/article-83.xml v1037>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c8f:[<0x20000002cc2/article-83.xml v1104>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.848+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cec [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-61.xml auth{0=1} v1008 ap=1 s=22446 n(v0 rc2024-03-27T07:26:17.650011+0000 b22446 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe9d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cec:[<0x20000002cc2/article-61.xml v1008>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cec:[<0x20000002cc2/article-61.xml v1008>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.849+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001702 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-41.xml auth{0=1} v1154 ap=1 s=23845 n(v0 rc2024-03-27T07:27:16.326858+0000 b23845 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab1fe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001702:[<0x20000002cc2/article-41.xml v1154>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001702:[<0x20000002cc2/article-41.xml v1154>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.850+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d1c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-45.xml auth{0=1} v1018 ap=1 s=13044 n(v0 rc2024-03-27T07:26:17.770009+0000 b13044 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab1fe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d1c:[<0x20000002cc2/article-45.xml v1018>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d1c:[<0x20000002cc2/article-45.xml v1018>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.850+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cd4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-69.xml auth{0=1} v918 ap=1 s=24776 n(v0 rc2024-03-27T07:26:17.598012+0000 b24776 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab1feb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cd4:[<0x20000002cc2/article-69.xml v918>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cd4:[<0x20000002cc2/article-69.xml v918>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.851+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dc8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-61.jpg auth{0=1} v878 ap=1 s=13881 n(v0 rc2024-03-27T07:26:18.525994+0000 b13881 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab1ff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dc8:[<0x20000002cc2/picture-61.jpg v878>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dc8:[<0x20000002cc2/picture-61.jpg v878>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.118 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.852+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002edc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-7.jpg auth{0=1} v1092 ap=1 s=27212 n(v0 rc2024-03-27T07:26:22.431917+0000 b27212 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab1ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002edc:[<0x20000002cc2/picture-7.jpg v790>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002edc:[<0x20000002cc2/picture-7.jpg v1092>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.127 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.853+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d4f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-31.xml auth{0=1} v842 ap=1 s=32474 n(v0 rc2024-03-27T07:26:17.987005+0000 b32474 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab1ffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d4f:[<0x20000002cc2/article-31.xml v842>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d4f:[<0x20000002cc2/article-31.xml v842>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.127 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.853+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ed6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-9.jpg auth{0=1} v1098 ap=1 s=14094 n(v0 rc2024-03-27T07:26:22.419917+0000 b14094 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab200100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ed6:[<0x20000002cc2/picture-9.jpg v778>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ed6:[<0x20000002cc2/picture-9.jpg v1098>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.127 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.854+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b6c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-11.xml auth{0=1} v1243 ap=1 s=5020 n(v0 rc2024-03-27T07:27:35.799477+0000 b5020 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ab200680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b6c:[<0x20000002cc2/comment-11.xml v1210>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b6c:[<0x20000002cc2/comment-11.xml v1243>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.127 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.854+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b14 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-20.xml auth{0=1} v1245 ap=1 s=9634 n(v0 rc2024-03-27T07:27:35.202488+0000 b9634 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ab200c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b14:[<0x20000002cc2/comment-20.xml v1208>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b14:[<0x20000002cc2/comment-20.xml v1245>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.127 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.855+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a4c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-37.xml auth{0=1} v1176 ap=1 s=7182 n(v0 rc2024-03-27T07:27:25.394680+0000 b7182 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad98cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a4c:[<0x20000002cc2/comment-37.xml v1149>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a4c:[<0x20000002cc2/comment-37.xml v1176>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.127 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.855+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ed3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-10.jpg auth{0=1} v1103 ap=1 s=22651 n(v0 rc2024-03-27T07:26:22.411918+0000 b22651 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad98d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ed3:[<0x20000002cc2/picture-10.jpg v772>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ed3:[<0x20000002cc2/picture-10.jpg v1103>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.127 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.856+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eee [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-1.jpg auth v1083 ap=1 s=14345 n(v0 rc2024-03-27T07:26:22.514916+0000 b14345 1=1+0) caps={15291=pAsLsXsFscr/pFscr@37},l=15291 | request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a81f5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eee:[<0x20000002cc2/picture-1.jpg v830>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eee:[<0x20000002cc2/picture-1.jpg v1083>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.127 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.857+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b3e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-16.xml auth{0=1} v1237 ap=1 s=3864 n(v0 rc2024-03-27T07:27:35.512482+0000 b3864 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad98d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b3e:[<0x20000002cc2/comment-16.xml v1224>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b3e:[<0x20000002cc2/comment-16.xml v1237>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.857+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-9.xml auth{0=1} v1161 ap=1 s=17618 n(v0 rc2024-03-27T07:27:11.219958+0000 b17618 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad98e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d7:[<0x20000002cc2/article-9.xml v1113>,<0x10000000399/blog-81 v117257>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000014d7:[<0x20000002cc2/article-9.xml v1161>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.858+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d1f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-44.xml auth{0=1} v904 ap=1 s=20782 n(v0 rc2024-03-27T07:26:17.779009+0000 b20782 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad98e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d1f:[<0x20000002cc2/article-44.xml v904>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d1f:[<0x20000002cc2/article-44.xml v904>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.859+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002edf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-6.jpg auth{0=1} v1099 ap=1 s=52195 n(v0 rc2024-03-27T07:26:22.458917+0000 b52195 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad98ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002edf:[<0x20000002cc2/picture-6.jpg v796>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002edf:[<0x20000002cc2/picture-6.jpg v1099>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.859+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ce0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-65.xml auth{0=1} v906 ap=1 s=6864 n(v0 rc2024-03-27T07:26:17.624012+0000 b6864 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad98f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ce0:[<0x20000002cc2/article-65.xml v906>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ce0:[<0x20000002cc2/article-65.xml v906>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.860+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ce9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-62.xml auth{0=1} v946 ap=1 s=7382 n(v0 rc2024-03-27T07:26:17.641012+0000 b7382 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad98f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ce9:[<0x20000002cc2/article-62.xml v946>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ce9:[<0x20000002cc2/article-62.xml v946>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.860+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d6b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-24.xml auth{0=1} v912 ap=1 s=25182 n(v0 rc2024-03-27T07:26:18.176001+0000 b25182 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad990000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d6b:[<0x20000002cc2/article-24.xml v912>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d6b:[<0x20000002cc2/article-24.xml v912>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.861+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a5e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-34.xml auth{0=1} v1174 ap=1 s=8497 n(v0 rc2024-03-27T07:27:25.505678+0000 b8497 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad990580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a5e:[<0x20000002cc2/comment-34.xml v1157>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a5e:[<0x20000002cc2/comment-34.xml v1174>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.861+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ad2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-25.xml auth{0=1} v1243 ap=1 s=4156 n(v0 rc2024-03-27T07:27:34.731497+0000 b4156 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad990b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ad2:[<0x20000002cc2/comment-25.xml v1196>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ad2:[<0x20000002cc2/comment-25.xml v1243>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.862+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-28.jpg auth{0=1} v1107 ap=1 s=24607 n(v0 rc2024-03-27T07:26:46.339446+0000 b24607 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad991080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db6:[<0x20000002cc2/picture-28.jpg v1107>,<0x10000000399/blog-81 v113837>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000db6:[<0x20000002cc2/picture-28.jpg v1107>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.863+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a39 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-41.xml auth{0=1} v1172 ap=1 s=2712 n(v0 rc2024-03-27T07:27:25.261683+0000 b2712 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad991600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a39:[<0x20000002cc2/comment-41.xml v1143>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a39:[<0x20000002cc2/comment-41.xml v1172>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.864+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cda [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-67.xml auth{0=1} v942 ap=1 s=17995 n(v0 rc2024-03-27T07:26:17.613012+0000 b17995 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad991b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cda:[<0x20000002cc2/article-67.xml v942>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cda:[<0x20000002cc2/article-67.xml v942>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.864+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e52 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-37.jpg auth{0=1} v1095 ap=1 s=23512 n(v0 rc2024-03-27T07:26:21.942927+0000 b23512 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad992100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e52:[<0x20000002cc2/picture-37.jpg v610>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e52:[<0x20000002cc2/picture-37.jpg v1095>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.128 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.865+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ebe [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-17.jpg auth{0=1} v1101 ap=1 s=55152 n(v0 rc2024-03-27T07:26:22.369918+0000 b55152 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad992680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ebe:[<0x20000002cc2/picture-17.jpg v730>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ebe:[<0x20000002cc2/picture-17.jpg v1101>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.865+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002db3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-3.xml auth{0=1} v988 ap=1 s=23071 n(v0 rc2024-03-27T07:26:18.446996+0000 b23071 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad992c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002db3:[<0x20000002cc2/article-3.xml v988>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002db3:[<0x20000002cc2/article-3.xml v988>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.866+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ea4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-24.jpg auth{0=1} v1093 ap=1 s=35320 n(v0 rc2024-03-27T07:26:22.304920+0000 b35320 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad993180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ea4:[<0x20000002cc2/picture-24.jpg v688>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ea4:[<0x20000002cc2/picture-24.jpg v1093>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.866+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e72 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-33.jpg auth{0=1} v1097 ap=1 s=47697 n(v0 rc2024-03-27T07:26:22.129923+0000 b47697 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad993700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e72:[<0x20000002cc2/picture-33.jpg v634>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e72:[<0x20000002cc2/picture-33.jpg v1097>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.867+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dd8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-57.jpg auth{0=1} v936 ap=1 s=11857 n(v0 rc2024-03-27T07:26:18.587993+0000 b11857 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad69e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dd8:[<0x20000002cc2/picture-57.jpg v936>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dd8:[<0x20000002cc2/picture-57.jpg v936>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.868+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002da5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-7.xml auth{0=1} v958 ap=1 s=31686 n(v0 rc2024-03-27T07:26:18.364997+0000 b31686 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad69e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002da5:[<0x20000002cc2/article-7.xml v958>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002da5:[<0x20000002cc2/article-7.xml v958>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.868+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e2c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-42.jpg auth{0=1} v950 ap=1 s=12891 n(v0 rc2024-03-27T07:26:18.940986+0000 b12891 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad69eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e2c:[<0x20000002cc2/picture-42.jpg v950>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e2c:[<0x20000002cc2/picture-42.jpg v950>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.869+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e43 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-39.jpg auth{0=1} v1091 ap=1 s=28132 n(v0 rc2024-03-27T07:26:21.901928+0000 b28132 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad69f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e43:[<0x20000002cc2/picture-39.jpg v598>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e43:[<0x20000002cc2/picture-39.jpg v1091>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.870+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b01 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-23.xml auth{0=1} v1239 ap=1 s=2335 n(v0 rc2024-03-27T07:27:34.970493+0000 b2335 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad69f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b01:[<0x20000002cc2/comment-23.xml v1202>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b01:[<0x20000002cc2/comment-23.xml v1239>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.870+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001afb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-24.xml auth{0=1} v1241 ap=1 s=6574 n(v0 rc2024-03-27T07:27:34.938493+0000 b6574 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad69fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001afb:[<0x20000002cc2/comment-24.xml v1200>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001afb:[<0x20000002cc2/comment-24.xml v1241>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.871+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cfe [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-55.xml auth{0=1} v920 ap=1 s=27810 n(v0 rc2024-03-27T07:26:17.685011+0000 b27810 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cfe:[<0x20000002cc2/article-55.xml v920>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cfe:[<0x20000002cc2/article-55.xml v920>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.871+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ea0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-25.jpg auth{0=1} v1090 ap=1 s=34238 n(v0 rc2024-03-27T07:26:22.295920+0000 b34238 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ea0:[<0x20000002cc2/picture-25.jpg v682>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ea0:[<0x20000002cc2/picture-25.jpg v1090>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.872+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002da2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-8.xml auth{0=1} v882 ap=1 s=12623 n(v0 rc2024-03-27T07:26:18.345998+0000 b12623 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002da2:[<0x20000002cc2/article-8.xml v882>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002da2:[<0x20000002cc2/article-8.xml v882>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.129 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.873+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a16 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-47.xml auth{0=1} v1169 ap=1 s=6957 n(v0 rc2024-03-27T07:27:25.063687+0000 b6957 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a16:[<0x20000002cc2/comment-47.xml v1133>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a16:[<0x20000002cc2/comment-47.xml v1169>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.873+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a1c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-46.xml auth{0=1} v1167 ap=1 s=5567 n(v0 rc2024-03-27T07:27:25.079687+0000 b5567 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aace0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a1c:[<0x20000002cc2/comment-46.xml v1135>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a1c:[<0x20000002cc2/comment-46.xml v1167>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.874+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e82 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-31.jpg auth{0=1} v1086 ap=1 s=12998 n(v0 rc2024-03-27T07:26:22.170922+0000 b12998 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aace0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e82:[<0x20000002cc2/picture-31.jpg v646>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e82:[<0x20000002cc2/picture-31.jpg v1086>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.874+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cd7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-68.xml auth{0=1} v968 ap=1 s=9664 n(v0 rc2024-03-27T07:26:17.607012+0000 b9664 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aace0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cd7:[<0x20000002cc2/article-68.xml v968>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cd7:[<0x20000002cc2/article-68.xml v968>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.875+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dfb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-49.jpg auth{0=1} v922 ap=1 s=33286 n(v0 rc2024-03-27T07:26:18.684991+0000 b33286 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aace1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dfb:[<0x20000002cc2/picture-49.jpg v922>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dfb:[<0x20000002cc2/picture-49.jpg v922>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.876+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ed9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-8.jpg auth{0=1} v1092 ap=1 s=42568 n(v0 rc2024-03-27T07:26:22.425917+0000 b42568 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aace1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ed9:[<0x20000002cc2/picture-8.jpg v784>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ed9:[<0x20000002cc2/picture-8.jpg v1092>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.877+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e9c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-26.jpg auth{0=1} v1094 ap=1 s=32483 n(v0 rc2024-03-27T07:26:22.283920+0000 b32483 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac560000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e9c:[<0x20000002cc2/picture-26.jpg v676>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e9c:[<0x20000002cc2/picture-26.jpg v1094>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.878+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d4b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-32.xml auth{0=1} v1002 ap=1 s=24497 n(v0 rc2024-03-27T07:26:17.970005+0000 b24497 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac560580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d4b:[<0x20000002cc2/article-32.xml v1002>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d4b:[<0x20000002cc2/article-32.xml v1002>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.879+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d75 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-21.xml auth{0=1} v956 ap=1 s=8984 n(v0 rc2024-03-27T07:26:18.214000+0000 b8984 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac560b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d75:[<0x20000002cc2/article-21.xml v956>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d75:[<0x20000002cc2/article-21.xml v956>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.880+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d52 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-30.xml auth{0=1} v994 ap=1 s=18949 n(v0 rc2024-03-27T07:26:18.007004+0000 b18949 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac561080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d52:[<0x20000002cc2/article-30.xml v994>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d52:[<0x20000002cc2/article-30.xml v994>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.881+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a52 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-36.xml auth{0=1} v1171 ap=1 s=4239 n(v0 rc2024-03-27T07:27:25.428680+0000 b4239 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac561600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a52:[<0x20000002cc2/comment-36.xml v1152>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a52:[<0x20000002cc2/comment-36.xml v1171>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.884+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001be3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-4.xml auth{0=1} v1237 ap=1 s=8880 n(v0 rc2024-03-27T07:27:36.463464+0000 b8880 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac562100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001be3:[<0x20000002cc2/comment-4.xml v1231>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001be3:[<0x20000002cc2/comment-4.xml v1237>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.130 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.885+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d0d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-50.xml auth{0=1} v952 ap=1 s=13248 n(v0 rc2024-03-27T07:26:17.719010+0000 b13248 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac562680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d0d:[<0x20000002cc2/article-50.xml v952>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d0d:[<0x20000002cc2/article-50.xml v952>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.885+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002da9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-6.xml auth{0=1} v908 ap=1 s=20312 n(v0 rc2024-03-27T07:26:18.387997+0000 b20312 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac562c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002da9:[<0x20000002cc2/article-6.xml v908>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002da9:[<0x20000002cc2/article-6.xml v908>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.885+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fbe [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-2.xml auth{0=1} v1156 ap=1 s=19064 n(v0 rc2024-03-27T07:27:02.407131+0000 b19064 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac563700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fbe:[<0x20000002cc2/article-2.xml v1099>,<0x10000000399/blog-81 v117257>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000fbe:[<0x20000002cc2/article-2.xml v1156>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.886+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b51 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-14.xml auth{0=1} v1239 ap=1 s=2255 n(v0 rc2024-03-27T07:27:35.608480+0000 b2255 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac564000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b51:[<0x20000002cc2/comment-14.xml v1214>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b51:[<0x20000002cc2/comment-14.xml v1239>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.886+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002de4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-54.jpg auth{0=1} v860 ap=1 s=25740 n(v0 rc2024-03-27T07:26:18.625992+0000 b25740 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac564580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002de4:[<0x20000002cc2/picture-54.jpg v860>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002de4:[<0x20000002cc2/picture-54.jpg v860>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.886+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b1d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-19.xml auth{0=1} v1241 ap=1 s=5441 n(v0 rc2024-03-27T07:27:35.269487+0000 b5441 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac565080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b1d:[<0x20000002cc2/comment-19.xml v1212>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b1d:[<0x20000002cc2/comment-19.xml v1241>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.886+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e90 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-29.jpg auth{0=1} v1088 ap=1 s=43456 n(v0 rc2024-03-27T07:26:22.240921+0000 b43456 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac564b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e90:[<0x20000002cc2/picture-29.jpg v658>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e90:[<0x20000002cc2/picture-29.jpg v1088>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.887+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cfb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-56.xml auth{0=1} v1016 ap=1 s=14251 n(v0 rc2024-03-27T07:26:17.678011+0000 b14251 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac565600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cfb:[<0x20000002cc2/article-56.xml v1016>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cfb:[<0x20000002cc2/article-56.xml v1016>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.887+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b06 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-22.xml auth{0=1} v1251 ap=1 s=8507 n(v0 rc2024-03-27T07:27:35.027492+0000 b8507 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607aae7ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b06:[<0x20000002cc2/comment-22.xml v1204>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b06:[<0x20000002cc2/comment-22.xml v1251>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.887+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c00 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-2.xml auth{0=1} v1241 ap=1 s=9969 n(v0 rc2024-03-27T07:27:36.609461+0000 b9969 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607aae7b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c00:[<0x20000002cc2/comment-2.xml v1235>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c00:[<0x20000002cc2/comment-2.xml v1241>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.888+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a29 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-44.xml auth{0=1} v1178 ap=1 s=4485 n(v0 rc2024-03-27T07:27:25.149685+0000 b4485 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae7b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a29:[<0x20000002cc2/comment-44.xml v1139>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a29:[<0x20000002cc2/comment-44.xml v1178>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.888+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d23 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-43.xml auth{0=1} v938 ap=1 s=8796 n(v0 rc2024-03-27T07:26:17.806008+0000 b8796 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae7bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d23:[<0x20000002cc2/article-43.xml v938>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d23:[<0x20000002cc2/article-43.xml v938>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.888+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d46 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-33.xml auth{0=1} v954 ap=1 s=12921 n(v0 rc2024-03-27T07:26:17.960005+0000 b12921 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae7c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d46:[<0x20000002cc2/article-33.xml v954>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d46:[<0x20000002cc2/article-33.xml v954>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.131 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.888+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001acc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-27.xml auth{0=1} v1253 ap=1 s=10213 n(v0 rc2024-03-27T07:27:34.376504+0000 b10213 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607aae7cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001acc:[<0x20000002cc2/comment-27.xml v1188>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001acc:[<0x20000002cc2/comment-27.xml v1253>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.889+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ee2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-5.jpg auth{0=1} v1090 ap=1 s=18730 n(v0 rc2024-03-27T07:26:22.465916+0000 b18730 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae7c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ee2:[<0x20000002cc2/picture-5.jpg v802>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ee2:[<0x20000002cc2/picture-5.jpg v1090>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.889+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002df4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-50.jpg auth{0=1} v978 ap=1 s=12474 n(v0 rc2024-03-27T07:26:18.664991+0000 b12474 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae7d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002df4:[<0x20000002cc2/picture-50.jpg v978>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002df4:[<0x20000002cc2/picture-50.jpg v978>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.889+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cf8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-57.xml auth{0=1} v832 ap=1 s=8411 n(v0 rc2024-03-27T07:26:17.672011+0000 b8411 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0c6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cf8:[<0x20000002cc2/article-57.xml v832>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cf8:[<0x20000002cc2/article-57.xml v832>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.889+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dd4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-58.jpg auth{0=1} v984 ap=1 s=14064 n(v0 rc2024-03-27T07:26:18.575993+0000 b14064 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae7d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dd4:[<0x20000002cc2/picture-58.jpg v984>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dd4:[<0x20000002cc2/picture-58.jpg v984>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.890+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bab [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-7.xml auth{0=1} v1243 ap=1 s=2256 n(v0 rc2024-03-27T07:27:36.146470+0000 b2256 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad0c6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bab:[<0x20000002cc2/comment-7.xml v1227>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bab:[<0x20000002cc2/comment-7.xml v1243>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.890+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b48 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-15.xml auth{0=1} v1247 ap=1 s=6376 n(v0 rc2024-03-27T07:27:35.561481+0000 b6376 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad0c6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b48:[<0x20000002cc2/comment-15.xml v1211>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b48:[<0x20000002cc2/comment-15.xml v1247>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.890+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cf5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-58.xml auth{0=1} v848 ap=1 s=19983 n(v0 rc2024-03-27T07:26:17.666011+0000 b19983 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0c7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cf5:[<0x20000002cc2/article-58.xml v848>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cf5:[<0x20000002cc2/article-58.xml v848>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.890+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a2e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-43.xml auth{0=1} v1174 ap=1 s=9952 n(v0 rc2024-03-27T07:27:25.177685+0000 b9952 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0c7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a2e:[<0x20000002cc2/comment-43.xml v1141>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a2e:[<0x20000002cc2/comment-43.xml v1174>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.890+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b35 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-17.xml auth{0=1} v1249 ap=1 s=3048 n(v0 rc2024-03-27T07:27:35.469483+0000 b3048 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad0c8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b35:[<0x20000002cc2/comment-17.xml v1209>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b35:[<0x20000002cc2/comment-17.xml v1249>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.890+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d5a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-28.xml auth{0=1} v1010 ap=1 s=27723 n(v0 rc2024-03-27T07:26:18.088003+0000 b27723 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0c8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d5a:[<0x20000002cc2/article-28.xml v1010>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d5a:[<0x20000002cc2/article-28.xml v1010>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.891+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b86 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-9.xml auth{0=1} v1245 ap=1 s=5347 n(v0 rc2024-03-27T07:27:35.962473+0000 b5347 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad0c8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b86:[<0x20000002cc2/comment-9.xml v1217>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b86:[<0x20000002cc2/comment-9.xml v1245>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.891+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d07 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-52.xml auth{0=1} v870 ap=1 s=9516 n(v0 rc2024-03-27T07:26:17.701010+0000 b9516 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0c9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d07:[<0x20000002cc2/article-52.xml v870>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d07:[<0x20000002cc2/article-52.xml v870>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.132 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.891+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a22 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-45.xml auth{0=1} v1176 ap=1 s=2087 n(v0 rc2024-03-27T07:27:25.119686+0000 b2087 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a22:[<0x20000002cc2/comment-45.xml v1130>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a22:[<0x20000002cc2/comment-45.xml v1176>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.891+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002df0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-51.jpg auth{0=1} v874 ap=1 s=34595 n(v0 rc2024-03-27T07:26:18.652992+0000 b34595 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0c9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002df0:[<0x20000002cc2/picture-51.jpg v874>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002df0:[<0x20000002cc2/picture-51.jpg v874>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.891+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dc4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-62.jpg auth{0=1} v900 ap=1 s=18224 n(v0 rc2024-03-27T07:26:18.510994+0000 b18224 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dc4:[<0x20000002cc2/picture-62.jpg v900>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dc4:[<0x20000002cc2/picture-62.jpg v900>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.891+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e10 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-46.jpg auth{0=1} v966 ap=1 s=20339 n(v0 rc2024-03-27T07:26:18.844988+0000 b20339 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e10:[<0x20000002cc2/picture-46.jpg v966>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e10:[<0x20000002cc2/picture-46.jpg v966>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.892+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b79 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-10.xml auth{0=1} v1235 ap=1 s=8498 n(v0 rc2024-03-27T07:27:35.906474+0000 b8498 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad0cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b79:[<0x20000002cc2/comment-10.xml v1211>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b79:[<0x20000002cc2/comment-10.xml v1235>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.892+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ee8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-3.jpg auth{0=1} v1090 ap=1 s=49909 n(v0 rc2024-03-27T07:26:22.480916+0000 b49909 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ee8:[<0x20000002cc2/picture-3.jpg v814>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ee8:[<0x20000002cc2/picture-3.jpg v1090>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.892+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002de0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-55.jpg auth{0=1} v880 ap=1 s=60368 n(v0 rc2024-03-27T07:26:18.609992+0000 b60368 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002de0:[<0x20000002cc2/picture-55.jpg v880>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002de0:[<0x20000002cc2/picture-55.jpg v880>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.892+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bbe [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-6.xml auth{0=1} v1231 ap=1 s=6254 n(v0 rc2024-03-27T07:27:36.255468+0000 b6254 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad0cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bbe:[<0x20000002cc2/comment-6.xml v1225>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bbe:[<0x20000002cc2/comment-6.xml v1231>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.893+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ed0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-11.jpg auth{0=1} v1088 ap=1 s=32256 n(v0 rc2024-03-27T07:26:22.404918+0000 b32256 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ed0:[<0x20000002cc2/picture-11.jpg v766>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ed0:[<0x20000002cc2/picture-11.jpg v1088>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.893+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d42 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-34.xml auth{0=1} v1014 ap=1 s=5748 n(v0 rc2024-03-27T07:26:17.947005+0000 b5748 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d42:[<0x20000002cc2/article-34.xml v1014>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d42:[<0x20000002cc2/article-34.xml v1014>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.893+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dac [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-5.xml auth{0=1} v1004 ap=1 s=24639 n(v0 rc2024-03-27T07:26:18.405996+0000 b24639 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dac:[<0x20000002cc2/article-5.xml v1004>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dac:[<0x20000002cc2/article-5.xml v1004>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.893+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a57 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-35.xml auth{0=1} v1167 ap=1 s=7058 n(v0 rc2024-03-27T07:27:25.468679+0000 b7058 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a57:[<0x20000002cc2/comment-35.xml v1152>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a57:[<0x20000002cc2/comment-35.xml v1167>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.893+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aca [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-28.xml auth{0=1} v1237 ap=1 s=6288 n(v0 rc2024-03-27T07:27:34.367505+0000 b6288 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ab0b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aca:[<0x20000002cc2/comment-28.xml v1185>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001aca:[<0x20000002cc2/comment-28.xml v1237>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.133 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.893+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d56 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-29.xml auth{0=1} v982 ap=1 s=23497 n(v0 rc2024-03-27T07:26:18.029004+0000 b23497 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d56:[<0x20000002cc2/article-29.xml v982>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d56:[<0x20000002cc2/article-29.xml v982>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.134 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.894+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dc0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-63.jpg auth{0=1} v868 ap=1 s=15562 n(v0 rc2024-03-27T07:26:18.495995+0000 b15562 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dc0:[<0x20000002cc2/picture-63.jpg v868>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dc0:[<0x20000002cc2/picture-63.jpg v868>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.134 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.894+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cef [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-60.xml auth{0=1} v914 ap=1 s=10407 n(v0 rc2024-03-27T07:26:17.656011+0000 b10407 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cef:[<0x20000002cc2/article-60.xml v914>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cef:[<0x20000002cc2/article-60.xml v914>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.134 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.894+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e3a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-40.jpg auth{0=1} v1086 ap=1 s=65226 n(v0 rc2024-03-27T07:26:21.863928+0000 b65226 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e3a:[<0x20000002cc2/picture-40.jpg v592>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e3a:[<0x20000002cc2/picture-40.jpg v1086>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.134 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.894+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d72 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-22.xml auth{0=1} v850 ap=1 s=24976 n(v0 rc2024-03-27T07:26:18.206000+0000 b24976 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d72:[<0x20000002cc2/article-22.xml v850>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d72:[<0x20000002cc2/article-22.xml v850>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.134 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.894+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a48 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-38.xml auth{0=1} v1169 ap=1 s=2938 n(v0 rc2024-03-27T07:27:25.364681+0000 b2938 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a48:[<0x20000002cc2/comment-38.xml v1146>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a48:[<0x20000002cc2/comment-38.xml v1169>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.134 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.895+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d10 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-49.xml auth{0=1} v1000 ap=1 s=32372 n(v0 rc2024-03-27T07:26:17.728010+0000 b32372 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d10:[<0x20000002cc2/article-49.xml v1000>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d10:[<0x20000002cc2/article-49.xml v1000>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.134 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.895+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b96 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-8.xml auth{0=1} v1233 ap=1 s=10196 n(v0 rc2024-03-27T07:27:36.034472+0000 b10196 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ab0bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b96:[<0x20000002cc2/comment-8.xml v1220>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b96:[<0x20000002cc2/comment-8.xml v1233>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.134 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.895+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d8d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-14.xml auth{0=1} v866 ap=1 s=7339 n(v0 rc2024-03-27T07:26:18.288999+0000 b7339 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d8d:[<0x20000002cc2/article-14.xml v866>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d8d:[<0x20000002cc2/article-14.xml v866>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.134 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.895+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ea8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-23.jpg auth{0=1} v1096 ap=1 s=44723 n(v0 rc2024-03-27T07:26:22.312919+0000 b44723 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ea8:[<0x20000002cc2/picture-23.jpg v694>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ea8:[<0x20000002cc2/picture-23.jpg v1096>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.134 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.895+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e17 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-45.jpg auth{0=1} v876 ap=1 s=18640 n(v0 rc2024-03-27T07:26:18.870987+0000 b18640 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e17:[<0x20000002cc2/picture-45.jpg v876>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e17:[<0x20000002cc2/picture-45.jpg v876>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.896+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e34 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-41.jpg auth{0=1} v1090 ap=1 s=47335 n(v0 rc2024-03-27T07:26:21.551934+0000 b47335 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e34:[<0x20000002cc2/picture-41.jpg v586>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e34:[<0x20000002cc2/picture-41.jpg v1090>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.896+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dcc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-60.jpg auth{0=1} v1022 ap=1 s=33486 n(v0 rc2024-03-27T07:26:18.540994+0000 b33486 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dcc:[<0x20000002cc2/picture-60.jpg v1022>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dcc:[<0x20000002cc2/picture-60.jpg v1022>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.896+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d19 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-46.xml auth{0=1} v944 ap=1 s=4116 n(v0 rc2024-03-27T07:26:17.761009+0000 b4116 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d19:[<0x20000002cc2/article-46.xml v944>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d19:[<0x20000002cc2/article-46.xml v944>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.896+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ccf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-71.xml auth{0=1} v1006 ap=1 s=7291 n(v0 rc2024-03-27T07:26:17.581013+0000 b7291 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ccf:[<0x20000002cc2/article-71.xml v1006>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ccf:[<0x20000002cc2/article-71.xml v1006>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.897+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d16 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-47.xml auth{0=1} v896 ap=1 s=2484 n(v0 rc2024-03-27T07:26:17.752009+0000 b2484 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d16:[<0x20000002cc2/article-47.xml v896>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d16:[<0x20000002cc2/article-47.xml v896>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.897+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d98 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-11.xml auth{0=1} v854 ap=1 s=2327 n(v0 rc2024-03-27T07:26:18.313998+0000 b2327 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0be680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d98:[<0x20000002cc2/article-11.xml v854>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d98:[<0x20000002cc2/article-11.xml v854>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.897+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eac [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-22.jpg auth{0=1} v1098 ap=1 s=19576 n(v0 rc2024-03-27T07:26:22.320919+0000 b19576 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0be100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eac:[<0x20000002cc2/picture-22.jpg v700>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eac:[<0x20000002cc2/picture-22.jpg v1098>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.897+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d87 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-16.xml auth{0=1} v1020 ap=1 s=20087 n(v0 rc2024-03-27T07:26:18.263999+0000 b20087 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d87:[<0x20000002cc2/article-16.xml v1020>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d87:[<0x20000002cc2/article-16.xml v1020>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.897+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d01 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-54.xml auth{0=1} v884 ap=1 s=10419 n(v0 rc2024-03-27T07:26:17.690011+0000 b10419 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d01:[<0x20000002cc2/article-54.xml v884>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d01:[<0x20000002cc2/article-54.xml v884>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.898+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d62 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-26.xml auth{0=1} v898 ap=1 s=11556 n(v0 rc2024-03-27T07:26:18.132002+0000 b11556 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab0bf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d62:[<0x20000002cc2/article-26.xml v898>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d62:[<0x20000002cc2/article-26.xml v898>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.898+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ec4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-15.jpg auth{0=1} v1092 ap=1 s=22142 n(v0 rc2024-03-27T07:26:22.379918+0000 b22142 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacda000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ec4:[<0x20000002cc2/picture-15.jpg v742>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ec4:[<0x20000002cc2/picture-15.jpg v1092>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.135 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.898+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ddc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-56.jpg auth{0=1} v960 ap=1 s=59716 n(v0 rc2024-03-27T07:26:18.596993+0000 b59716 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacda580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ddc:[<0x20000002cc2/picture-56.jpg v960>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ddc:[<0x20000002cc2/picture-56.jpg v960>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.898+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e09 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-47.jpg auth{0=1} v990 ap=1 s=30486 n(v0 rc2024-03-27T07:26:18.793989+0000 b30486 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e09:[<0x20000002cc2/picture-47.jpg v990>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e09:[<0x20000002cc2/picture-47.jpg v990>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.898+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-10.xml auth{0=1} v1102 ap=1 s=10515 n(v0 rc2024-03-27T07:26:46.362446+0000 b10515 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbd:[<0x20000002cc2/article-10.xml v1102>,<0x10000000399/blog-81 v113837>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000dbd:[<0x20000002cc2/article-10.xml v1102>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.899+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ecd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-12.jpg auth{0=1} v1094 ap=1 s=37630 n(v0 rc2024-03-27T07:26:22.395918+0000 b37630 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ecd:[<0x20000002cc2/picture-12.jpg v760>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ecd:[<0x20000002cc2/picture-12.jpg v1094>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.899+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e1e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-44.jpg auth{0=1} v932 ap=1 s=64909 n(v0 rc2024-03-27T07:26:18.893987+0000 b64909 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e1e:[<0x20000002cc2/picture-44.jpg v932>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e1e:[<0x20000002cc2/picture-44.jpg v932>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.899+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d13 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-48.xml auth{0=1} v844 ap=1 s=30806 n(v0 rc2024-03-27T07:26:17.742010+0000 b30806 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d13:[<0x20000002cc2/article-48.xml v844>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d13:[<0x20000002cc2/article-48.xml v844>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.899+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a10 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-48.xml auth{0=1} v1134 ap=1 s=8754 n(v0 rc2024-03-27T07:27:25.032688+0000 b8754 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a10:[<0x20000002cc2/comment-48.xml v1127>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a10:[<0x20000002cc2/comment-48.xml v1134>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.900+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002db0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-4.xml auth{0=1} v948 ap=1 s=7107 n(v0 rc2024-03-27T07:26:18.428996+0000 b7107 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002db0:[<0x20000002cc2/article-4.xml v948>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002db0:[<0x20000002cc2/article-4.xml v948>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.900+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dd0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-59.jpg auth{0=1} v902 ap=1 s=13935 n(v0 rc2024-03-27T07:26:18.558993+0000 b13935 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dd0:[<0x20000002cc2/picture-59.jpg v902>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dd0:[<0x20000002cc2/picture-59.jpg v902>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.900+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d66 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-25.xml auth{0=1} v992 ap=1 s=2024 n(v0 rc2024-03-27T07:26:18.156001+0000 b2024 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacdd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d66:[<0x20000002cc2/article-25.xml v992>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d66:[<0x20000002cc2/article-25.xml v992>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.900+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ac2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-31.xml auth{0=1} v1187 ap=1 s=9239 n(v0 rc2024-03-27T07:27:34.018511+0000 b9239 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607aacde580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ac2:[<0x20000002cc2/comment-31.xml v1170>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ac2:[<0x20000002cc2/comment-31.xml v1187>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.900+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d34 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-38.xml auth{0=1} v890 ap=1 s=4120 n(v0 rc2024-03-27T07:26:17.883007+0000 b4120 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aacde000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d34:[<0x20000002cc2/article-38.xml v890>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d34:[<0x20000002cc2/article-38.xml v890>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.900+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ccc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-72.xml auth{0=1} v886 ap=1 s=7088 n(v0 rc2024-03-27T07:26:17.570013+0000 b7088 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac567180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ccc:[<0x20000002cc2/article-72.xml v886>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ccc:[<0x20000002cc2/article-72.xml v886>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.901+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eb0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-21.jpg auth{0=1} v1098 ap=1 s=55876 n(v0 rc2024-03-27T07:26:22.328919+0000 b55876 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac567700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eb0:[<0x20000002cc2/picture-21.jpg v706>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eb0:[<0x20000002cc2/picture-21.jpg v1098>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.136 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.901+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d3f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-35.xml auth{0=1} v1012 ap=1 s=27010 n(v0 rc2024-03-27T07:26:17.935006+0000 b27010 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d3f:[<0x20000002cc2/article-35.xml v1012>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d3f:[<0x20000002cc2/article-35.xml v1012>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.901+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c0e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-1.xml auth{0=1} v1243 ap=1 s=4742 n(v0 rc2024-03-27T07:27:36.709459+0000 b4742 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3dc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c0e:[<0x20000002cc2/comment-1.xml v1243>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c0e:[<0x20000002cc2/comment-1.xml v1243>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.901+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e8a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-30.jpg auth{0=1} v1090 ap=1 s=63886 n(v0 rc2024-03-27T07:26:22.222921+0000 b63886 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3dd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e8a:[<0x20000002cc2/picture-30.jpg v652>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e8a:[<0x20000002cc2/picture-30.jpg v1090>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.901+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d8a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-15.xml auth{0=1} v934 ap=1 s=16319 n(v0 rc2024-03-27T07:26:18.275999+0000 b16319 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3dd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d8a:[<0x20000002cc2/article-15.xml v934>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d8a:[<0x20000002cc2/article-15.xml v934>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.902+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a3e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-40.xml auth{0=1} v1159 ap=1 s=7547 n(v0 rc2024-03-27T07:27:25.295682+0000 b7547 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3ddb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a3e:[<0x20000002cc2/comment-40.xml v1144>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a3e:[<0x20000002cc2/comment-40.xml v1159>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.902+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d2d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-40.xml auth{0=1} v888 ap=1 s=20821 n(v0 rc2024-03-27T07:26:17.846007+0000 b20821 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3dcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d2d:[<0x20000002cc2/article-40.xml v888>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d2d:[<0x20000002cc2/article-40.xml v888>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.902+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a64 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-33.xml auth{0=1} v1251 ap=1 s=7381 n(v0 rc2024-03-27T07:27:30.732576+0000 b7381 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad3de100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a64:[<0x20000002cc2/comment-33.xml v1163>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001a64:[<0x20000002cc2/comment-33.xml v1251>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.902+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a42 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-39.xml auth{0=1} v1161 ap=1 s=4633 n(v0 rc2024-03-27T07:27:25.323682+0000 b4633 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3de680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a42:[<0x20000002cc2/comment-39.xml v1148>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a42:[<0x20000002cc2/comment-39.xml v1161>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.902+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e58 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-36.jpg auth{0=1} v1096 ap=1 s=24165 n(v0 rc2024-03-27T07:26:21.965926+0000 b24165 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3dec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e58:[<0x20000002cc2/picture-36.jpg v616>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e58:[<0x20000002cc2/picture-36.jpg v1096>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.903+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e25 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-43.jpg auth{0=1} v980 ap=1 s=12497 n(v0 rc2024-03-27T07:26:18.917986+0000 b12497 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e25:[<0x20000002cc2/picture-43.jpg v980>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e25:[<0x20000002cc2/picture-43.jpg v980>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.903+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d7c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-19.xml auth{0=1} v872 ap=1 s=11655 n(v0 rc2024-03-27T07:26:18.229000+0000 b11655 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d7c:[<0x20000002cc2/article-19.xml v872>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d7c:[<0x20000002cc2/article-19.xml v872>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.903+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eb4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-20.jpg auth{0=1} v1092 ap=1 s=31288 n(v0 rc2024-03-27T07:26:22.341919+0000 b31288 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad1e6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eb4:[<0x20000002cc2/picture-20.jpg v712>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eb4:[<0x20000002cc2/picture-20.jpg v1092>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.903+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ac1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-32.xml auth{0=1} v1249 ap=1 s=4488 n(v0 rc2024-03-27T07:27:33.985512+0000 b4488 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad1e6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ac1:[<0x20000002cc2/comment-32.xml v1167>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ac1:[<0x20000002cc2/comment-32.xml v1249>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.137 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.903+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d26 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-42.xml auth{0=1} v846 ap=1 s=3872 n(v0 rc2024-03-27T07:26:17.819008+0000 b3872 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad1e6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d26:[<0x20000002cc2/article-42.xml v846>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d26:[<0x20000002cc2/article-42.xml v846>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.138 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.903+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e49 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-38.jpg auth{0=1} v1094 ap=1 s=37061 n(v0 rc2024-03-27T07:26:21.923927+0000 b37061 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad1e7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e49:[<0x20000002cc2/picture-38.jpg v604>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e49:[<0x20000002cc2/picture-38.jpg v1094>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.904+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ce3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-64.xml auth{0=1} v986 ap=1 s=16391 n(v0 rc2024-03-27T07:26:17.629012+0000 b16391 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac04c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ce3:[<0x20000002cc2/article-64.xml v986>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ce3:[<0x20000002cc2/article-64.xml v986>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.904+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b0b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-21.xml auth{0=1} v1264 ap=1 s=6850 n(v0 rc2024-03-27T07:27:35.117490+0000 b6850 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac04cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b0b:[<0x20000002cc2/comment-21.xml v1205>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b0b:[<0x20000002cc2/comment-21.xml v1264>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.904+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b5a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-13.xml auth{0=1} v1262 ap=1 s=5035 n(v0 rc2024-03-27T07:27:35.647480+0000 b5035 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac04c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b5a:[<0x20000002cc2/comment-13.xml v1229>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b5a:[<0x20000002cc2/comment-13.xml v1262>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.904+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ace [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-26.xml auth{0=1} v1266 ap=1 s=6206 n(v0 rc2024-03-27T07:27:34.409504+0000 b6206 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac04d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ace:[<0x20000002cc2/comment-26.xml v1192>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ace:[<0x20000002cc2/comment-26.xml v1266>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.905+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d38 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-37.xml auth{0=1} v892 ap=1 s=16982 n(v0 rc2024-03-27T07:26:17.903006+0000 b16982 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac04db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d38:[<0x20000002cc2/article-37.xml v892>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d38:[<0x20000002cc2/article-37.xml v892>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.905+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-27.jpg auth{0=1} v1145 ap=1 s=62245 n(v0 rc2024-03-27T07:27:02.353132+0000 b62245 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac04e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb7:[<0x20000002cc2/picture-27.jpg v1110>,<0x10000000399/blog-81 v117257>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000fb7:[<0x20000002cc2/picture-27.jpg v1145>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.905+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cc9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-73.xml auth{0=1} v928 ap=1 s=3589 n(v0 rc2024-03-27T07:26:17.561013+0000 b3589 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac04ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cc9:[<0x20000002cc2/article-73.xml v928>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cc9:[<0x20000002cc2/article-73.xml v928>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.905+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d31 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-39.xml auth{0=1} v916 ap=1 s=19592 n(v0 rc2024-03-27T07:26:17.860007+0000 b19592 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac04f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d31:[<0x20000002cc2/article-39.xml v916>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d31:[<0x20000002cc2/article-39.xml v916>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.906+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d3b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-36.xml auth{0=1} v894 ap=1 s=20351 n(v0 rc2024-03-27T07:26:17.921006+0000 b20351 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac04f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d3b:[<0x20000002cc2/article-36.xml v894>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d3b:[<0x20000002cc2/article-36.xml v894>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.906+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cc3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-75.xml auth{0=1} v972 ap=1 s=2261 n(v0 rc2024-03-27T07:26:17.538014+0000 b2261 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac04d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cc3:[<0x20000002cc2/article-75.xml v972>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cc3:[<0x20000002cc2/article-75.xml v972>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.906+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dec [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-52.jpg auth{0=1} v858 ap=1 s=33625 n(v0 rc2024-03-27T07:26:18.644992+0000 b33625 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2fe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dec:[<0x20000002cc2/picture-52.jpg v858>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dec:[<0x20000002cc2/picture-52.jpg v858>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.143 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.906+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ac4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-30.xml auth{0=1} v1256 ap=1 s=3303 n(v0 rc2024-03-27T07:27:34.084510+0000 b3303 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac2ff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ac4:[<0x20000002cc2/comment-30.xml v1173>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ac4:[<0x20000002cc2/comment-30.xml v1256>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.907+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e6a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-34.jpg auth{0=1} v1086 ap=1 s=22552 n(v0 rc2024-03-27T07:26:22.093924+0000 b22552 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2ffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e6a:[<0x20000002cc2/picture-34.jpg v628>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e6a:[<0x20000002cc2/picture-34.jpg v1086>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.907+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002de8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-53.jpg auth{0=1} v1024 ap=1 s=54925 n(v0 rc2024-03-27T07:26:18.636992+0000 b54925 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac300100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002de8:[<0x20000002cc2/picture-53.jpg v1024>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002de8:[<0x20000002cc2/picture-53.jpg v1024>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.907+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d94 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-12.xml auth{0=1} v834 ap=1 s=11849 n(v0 rc2024-03-27T07:26:18.306998+0000 b11849 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2fe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d94:[<0x20000002cc2/article-12.xml v834>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d94:[<0x20000002cc2/article-12.xml v834>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.907+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bf2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-3.xml auth{0=1} v1258 ap=1 s=4299 n(v0 rc2024-03-27T07:27:36.523462+0000 b4299 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac300680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bf2:[<0x20000002cc2/comment-3.xml v1237>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bf2:[<0x20000002cc2/comment-3.xml v1258>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.907+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b29 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-18.xml auth{0=1} v1270 ap=1 s=5539 n(v0 rc2024-03-27T07:27:35.361485+0000 b5539 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac300c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b29:[<0x20000002cc2/comment-18.xml v1219>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b29:[<0x20000002cc2/comment-18.xml v1270>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.907+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002cdd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-66.xml auth{0=1} v970 ap=1 s=17561 n(v0 rc2024-03-27T07:26:17.619012+0000 b17561 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac301180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002cdd:[<0x20000002cc2/article-66.xml v970>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002cdd:[<0x20000002cc2/article-66.xml v970>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.908+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ec1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-16.jpg auth{0=1} v1092 ap=1 s=20474 n(v0 rc2024-03-27T07:26:22.374918+0000 b20474 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac301700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ec1:[<0x20000002cc2/picture-16.jpg v736>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ec1:[<0x20000002cc2/picture-16.jpg v1092>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.908+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b63 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-12.xml auth{0=1} v1260 ap=1 s=5673 n(v0 rc2024-03-27T07:27:35.705478+0000 b5673 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac26c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b63:[<0x20000002cc2/comment-12.xml v1234>,<0x10000000399/blog-81 v125810>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b63:[<0x20000002cc2/comment-12.xml v1260>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.908+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a33 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-42.xml auth{0=1} v1152 ap=1 s=4802 n(v0 rc2024-03-27T07:27:25.222684+0000 b4802 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac26c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a33:[<0x20000002cc2/comment-42.xml v1137>,<0x10000000399/blog-81 v121363>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a33:[<0x20000002cc2/comment-42.xml v1152>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.908+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d6e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-23.xml auth{0=1} v856 ap=1 s=14281 n(v0 rc2024-03-27T07:26:18.192001+0000 b14281 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac26cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d6e:[<0x20000002cc2/article-23.xml v856>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d6e:[<0x20000002cc2/article-23.xml v856>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.144 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.909+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002d83 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-17.xml auth{0=1} v862 ap=1 s=3758 n(v0 rc2024-03-27T07:26:18.251000+0000 b3758 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac26d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002d83:[<0x20000002cc2/article-17.xml v862>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002d83:[<0x20000002cc2/article-17.xml v862>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.909+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e78 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-32.jpg auth{0=1} v1088 ap=1 s=24305 n(v0 rc2024-03-27T07:26:22.144923+0000 b24305 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac26d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e78:[<0x20000002cc2/picture-32.jpg v640>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e78:[<0x20000002cc2/picture-32.jpg v1088>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.909+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ce6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-63.xml auth{0=1} v974 ap=1 s=15377 n(v0 rc2024-03-27T07:26:17.635012+0000 b15377 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac26db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ce6:[<0x20000002cc2/article-63.xml v974>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ce6:[<0x20000002cc2/article-63.xml v974>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:20.909+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e02 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-48.jpg auth{0=1} v940 ap=1 s=24323 n(v0 rc2024-03-27T07:26:18.736990+0000 b24323 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac26e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e02:[<0x20000002cc2/picture-48.jpg v940>,<0x10000000399/blog-81 v94068>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e02:[<0x20000002cc2/picture-48.jpg v940>,<0x10000000399/blog-81 v132804>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.112+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d7a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-59.xml auth{0=1} v540 ap=1 s=17078 n(v0 rc2024-03-27T07:25:52.239512+0000 b17078 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab2d8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d7a:[<0x20000001d6e/article-59.xml v540>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d7a:[<0x20000001d6e/article-59.xml v540>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.112+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017fb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-74.xml auth v619 ap=1 s=19299 n(v0 rc2024-03-27T07:27:18.091824+0000 b19299 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab2d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017fb:[<0x20000001d6e/article-74.xml v613>,<0x10000000399/blog-51 v121379>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017fb:[<0x20000001d6e/article-74.xml v619>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.112+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dea [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-18.xml auth{0=1} v574 ap=1 s=5993 n(v0 rc2024-03-27T07:25:52.581505+0000 b5993 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab2d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dea:[<0x20000001d6e/article-18.xml v574>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dea:[<0x20000001d6e/article-18.xml v574>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.113+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e41 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-4.jpg auth{0=1} v462 ap=1 s=58922 n(v0 rc2024-03-27T07:25:53.002497+0000 b58922 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad02eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e41:[<0x20000001d6e/picture-4.jpg v462>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e41:[<0x20000001d6e/picture-4.jpg v462>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.113+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d8e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-51.xml auth{0=1} v516 ap=1 s=19095 n(v0 rc2024-03-27T07:25:52.298511+0000 b19095 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad02e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d8e:[<0x20000001d6e/article-51.xml v516>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d8e:[<0x20000001d6e/article-51.xml v516>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.113+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e47 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-2.jpg auth{0=1} v558 ap=1 s=64062 n(v0 rc2024-03-27T07:25:53.036496+0000 b64062 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad02f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e47:[<0x20000001d6e/picture-2.jpg v558>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e47:[<0x20000001d6e/picture-2.jpg v558>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.113+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dca [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-27.xml auth{0=1} v564 ap=1 s=21786 n(v0 rc2024-03-27T07:25:52.491507+0000 b21786 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad02e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dca:[<0x20000001d6e/article-27.xml v564>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dca:[<0x20000001d6e/article-27.xml v564>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.113+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001de3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-20.xml auth{0=1} v454 ap=1 s=7759 n(v0 rc2024-03-27T07:25:52.561506+0000 b7759 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad02f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001de3:[<0x20000001d6e/article-20.xml v454>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001de3:[<0x20000001d6e/article-20.xml v454>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.114+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d75 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-61.xml auth{0=1} v498 ap=1 s=21263 n(v0 rc2024-03-27T07:25:52.226512+0000 b21263 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad02fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d75:[<0x20000001d6e/article-61.xml v498>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d75:[<0x20000001d6e/article-61.xml v498>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.145 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.114+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001da7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-41.xml auth{0=1} v562 ap=1 s=30371 n(v0 rc2024-03-27T07:25:52.372509+0000 b30371 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad030100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001da7:[<0x20000001d6e/article-41.xml v562>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001da7:[<0x20000001d6e/article-41.xml v562>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.114+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dbf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-31.xml auth{0=1} v556 ap=1 s=9505 n(v0 rc2024-03-27T07:25:52.461508+0000 b9505 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad031180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dbf:[<0x20000001d6e/article-31.xml v556>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dbf:[<0x20000001d6e/article-31.xml v556>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.115+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e36 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-7.jpg auth{0=1} v572 ap=1 s=56151 n(v0 rc2024-03-27T07:25:52.880499+0000 b56151 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad030c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e36:[<0x20000001d6e/picture-7.jpg v572>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e36:[<0x20000001d6e/picture-7.jpg v572>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.115+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d9d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-45.xml auth{0=1} v496 ap=1 s=26952 n(v0 rc2024-03-27T07:25:52.345510+0000 b26952 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad030680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d9d:[<0x20000001d6e/article-45.xml v496>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d9d:[<0x20000001d6e/article-45.xml v496>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.116+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e4a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-1.jpg auth v608 ap=1 s=52725 n(v0 rc2024-03-27T07:25:53.045496+0000 b52725 1=1+0) caps={15291=pAsLsXsFscr/pFscr@3},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a83e9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e4a:[<0x20000001d6e/picture-1.jpg v608>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e4a:[<0x20000001d6e/picture-1.jpg v608>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.116+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e2e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-9.jpg auth{0=1} v518 ap=1 s=18080 n(v0 rc2024-03-27T07:25:52.817501+0000 b18080 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad031700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e2e:[<0x20000001d6e/picture-9.jpg v518>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e2e:[<0x20000001d6e/picture-9.jpg v518>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.116+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e2a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-10.jpg auth{0=1} v484 ap=1 s=25620 n(v0 rc2024-03-27T07:25:52.782501+0000 b25620 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafcc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e2a:[<0x20000001d6e/picture-10.jpg v484>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e2a:[<0x20000001d6e/picture-10.jpg v484>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.116+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e09 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-9.xml auth{0=1} v472 ap=1 s=2695 n(v0 rc2024-03-27T07:25:52.681503+0000 b2695 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafcc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e09:[<0x20000001d6e/article-9.xml v472>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e09:[<0x20000001d6e/article-9.xml v472>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.117+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e3a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-6.jpg auth{0=1} v512 ap=1 s=41996 n(v0 rc2024-03-27T07:25:52.909499+0000 b41996 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafcd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e3a:[<0x20000001d6e/picture-6.jpg v512>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e3a:[<0x20000001d6e/picture-6.jpg v512>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.117+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dd5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-24.xml auth{0=1} v504 ap=1 s=6430 n(v0 rc2024-03-27T07:25:52.525506+0000 b6430 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafcdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dd5:[<0x20000001d6e/article-24.xml v504>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dd5:[<0x20000001d6e/article-24.xml v504>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.117+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d9f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-44.xml auth{0=1} v456 ap=1 s=25835 n(v0 rc2024-03-27T07:25:52.353510+0000 b25835 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d9f:[<0x20000001d6e/article-44.xml v456>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d9f:[<0x20000001d6e/article-44.xml v456>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.146 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.117+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d72 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-62.xml auth{0=1} v554 ap=1 s=23076 n(v0 rc2024-03-27T07:25:52.219512+0000 b23076 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafcd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d72:[<0x20000001d6e/article-62.xml v554>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d72:[<0x20000001d6e/article-62.xml v554>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.117+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e1e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-3.xml auth{0=1} v506 ap=1 s=14741 n(v0 rc2024-03-27T07:25:52.729502+0000 b14741 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e1e:[<0x20000001d6e/article-3.xml v506>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e1e:[<0x20000001d6e/article-3.xml v506>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.118+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e10 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-7.xml auth{0=1} v510 ap=1 s=23883 n(v0 rc2024-03-27T07:25:52.697503+0000 b23883 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafce680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e10:[<0x20000001d6e/article-7.xml v510>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e10:[<0x20000001d6e/article-7.xml v510>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.118+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d84 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-55.xml auth{0=1} v514 ap=1 s=25336 n(v0 rc2024-03-27T07:25:52.273511+0000 b25336 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafcec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d84:[<0x20000001d6e/article-55.xml v514>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d84:[<0x20000001d6e/article-55.xml v514>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.118+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e0d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-8.xml auth{0=1} v486 ap=1 s=17070 n(v0 rc2024-03-27T07:25:52.690503+0000 b17070 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafcf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e0d:[<0x20000001d6e/article-8.xml v486>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e0d:[<0x20000001d6e/article-8.xml v486>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.118+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e32 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-8.jpg auth{0=1} v524 ap=1 s=21506 n(v0 rc2024-03-27T07:25:52.845500+0000 b21506 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafcf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e32:[<0x20000001d6e/picture-8.jpg v524>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e32:[<0x20000001d6e/picture-8.jpg v524>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.118+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dbd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-32.xml auth{0=1} v594 ap=1 s=22093 n(v0 rc2024-03-27T07:25:52.452508+0000 b22093 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dbd:[<0x20000001d6e/article-32.xml v594>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dbd:[<0x20000001d6e/article-32.xml v594>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.119+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ddf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-21.xml auth{0=1} v582 ap=1 s=8387 n(v0 rc2024-03-27T07:25:52.553506+0000 b8387 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ddf:[<0x20000001d6e/article-21.xml v582>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ddf:[<0x20000001d6e/article-21.xml v582>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.119+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dc2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-30.xml auth{0=1} v534 ap=1 s=7044 n(v0 rc2024-03-27T07:25:52.467507+0000 b7044 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dc2:[<0x20000001d6e/article-30.xml v534>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dc2:[<0x20000001d6e/article-30.xml v534>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.119+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d90 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-50.xml auth{0=1} v532 ap=1 s=1357 n(v0 rc2024-03-27T07:25:52.306511+0000 b1357 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d90:[<0x20000001d6e/article-50.xml v532>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d90:[<0x20000001d6e/article-50.xml v532>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.119+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dfb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-13.xml auth{0=1} v560 ap=1 s=27384 n(v0 rc2024-03-27T07:25:52.647504+0000 b27384 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dfb:[<0x20000001d6e/article-13.xml v560>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dfb:[<0x20000001d6e/article-13.xml v560>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.119+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e13 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-6.xml auth{0=1} v526 ap=1 s=8539 n(v0 rc2024-03-27T07:25:52.705503+0000 b8539 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e13:[<0x20000001d6e/article-6.xml v526>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e13:[<0x20000001d6e/article-6.xml v526>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.147 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.120+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e20 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-2.xml auth{0=1} v544 ap=1 s=24755 n(v0 rc2024-03-27T07:25:52.741502+0000 b24755 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e20:[<0x20000001d6e/article-2.xml v544>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e20:[<0x20000001d6e/article-2.xml v544>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.120+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d81 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-56.xml auth{0=1} v480 ap=1 s=14518 n(v0 rc2024-03-27T07:25:52.264511+0000 b14518 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d81:[<0x20000001d6e/article-56.xml v480>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d81:[<0x20000001d6e/article-56.xml v480>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.120+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001da2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-43.xml auth{0=1} v460 ap=1 s=2405 n(v0 rc2024-03-27T07:25:52.360510+0000 b2405 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001da2:[<0x20000001d6e/article-43.xml v460>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001da2:[<0x20000001d6e/article-43.xml v460>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.120+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dba [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-33.xml auth{0=1} v468 ap=1 s=14333 n(v0 rc2024-03-27T07:25:52.442508+0000 b14333 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dba:[<0x20000001d6e/article-33.xml v468>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dba:[<0x20000001d6e/article-33.xml v468>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.120+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e3e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-5.jpg auth{0=1} v578 ap=1 s=65446 n(v0 rc2024-03-27T07:25:52.960498+0000 b65446 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaae5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e3e:[<0x20000001d6e/picture-5.jpg v578>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e3e:[<0x20000001d6e/picture-5.jpg v578>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.120+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d7f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-57.xml auth{0=1} v474 ap=1 s=3824 n(v0 rc2024-03-27T07:25:52.256512+0000 b3824 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab890000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d7f:[<0x20000001d6e/article-57.xml v474>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d7f:[<0x20000001d6e/article-57.xml v474>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.121+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d7c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-58.xml auth{0=1} v452 ap=1 s=10937 n(v0 rc2024-03-27T07:25:52.248512+0000 b10937 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab890580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d7c:[<0x20000001d6e/article-58.xml v452>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d7c:[<0x20000001d6e/article-58.xml v452>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.121+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dc7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-28.xml auth{0=1} v536 ap=1 s=13384 n(v0 rc2024-03-27T07:25:52.482507+0000 b13384 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab891080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dc7:[<0x20000001d6e/article-28.xml v536>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dc7:[<0x20000001d6e/article-28.xml v536>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.121+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e44 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-3.jpg auth{0=1} v598 ap=1 s=62786 n(v0 rc2024-03-27T07:25:53.026496+0000 b62786 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab891b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e44:[<0x20000001d6e/picture-3.jpg v598>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e44:[<0x20000001d6e/picture-3.jpg v598>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.121+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d8b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-52.xml auth{0=1} v466 ap=1 s=20147 n(v0 rc2024-03-27T07:25:52.292511+0000 b20147 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab891600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d8b:[<0x20000001d6e/article-52.xml v466>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d8b:[<0x20000001d6e/article-52.xml v466>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.121+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e28 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-11.jpg auth{0=1} v586 ap=1 s=49612 n(v0 rc2024-03-27T07:25:52.768501+0000 b49612 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab892100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e28:[<0x20000001d6e/picture-11.jpg v586>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e28:[<0x20000001d6e/picture-11.jpg v586>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.122+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e17 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-5.xml auth{0=1} v596 ap=1 s=27966 n(v0 rc2024-03-27T07:25:52.713503+0000 b27966 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab892680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e17:[<0x20000001d6e/article-5.xml v596>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e17:[<0x20000001d6e/article-5.xml v596>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.122+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d89 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-53.xml auth{0=1} v520 ap=1 s=1955 n(v0 rc2024-03-27T07:25:52.287511+0000 b1955 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab890b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d89:[<0x20000001d6e/article-53.xml v520>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d89:[<0x20000001d6e/article-53.xml v520>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.148 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.122+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dc4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-29.xml auth{0=1} v482 ap=1 s=15594 n(v0 rc2024-03-27T07:25:52.474507+0000 b15594 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab893180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dc4:[<0x20000001d6e/article-29.xml v482>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dc4:[<0x20000001d6e/article-29.xml v482>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.122+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001db8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-34.xml auth{0=1} v464 ap=1 s=30053 n(v0 rc2024-03-27T07:25:52.428508+0000 b30053 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab892c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001db8:[<0x20000001d6e/article-34.xml v464>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001db8:[<0x20000001d6e/article-34.xml v464>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.122+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d77 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-60.xml auth{0=1} v576 ap=1 s=17763 n(v0 rc2024-03-27T07:25:52.233512+0000 b17763 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab893700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d77:[<0x20000001d6e/article-60.xml v576>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d77:[<0x20000001d6e/article-60.xml v576>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.123+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ddc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-22.xml auth{0=1} v592 ap=1 s=32544 n(v0 rc2024-03-27T07:25:52.546506+0000 b32544 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ddc:[<0x20000001d6e/article-22.xml v592>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ddc:[<0x20000001d6e/article-22.xml v592>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.123+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001df8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-14.xml auth{0=1} v584 ap=1 s=8548 n(v0 rc2024-03-27T07:25:52.634504+0000 b8548 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001df8:[<0x20000001d6e/article-14.xml v584>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001df8:[<0x20000001d6e/article-14.xml v584>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.123+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d9a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-46.xml auth{0=1} v500 ap=1 s=2225 n(v0 rc2024-03-27T07:25:52.340510+0000 b2225 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d9a:[<0x20000001d6e/article-46.xml v500>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d9a:[<0x20000001d6e/article-46.xml v500>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.123+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d98 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-47.xml auth{0=1} v580 ap=1 s=9657 n(v0 rc2024-03-27T07:25:52.332510+0000 b9657 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d98:[<0x20000001d6e/article-47.xml v580>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d98:[<0x20000001d6e/article-47.xml v580>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.123+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001df1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-16.xml auth{0=1} v552 ap=1 s=30630 n(v0 rc2024-03-27T07:25:52.602505+0000 b30630 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001df1:[<0x20000001d6e/article-16.xml v552>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001df1:[<0x20000001d6e/article-16.xml v552>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.124+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d86 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-54.xml auth{0=1} v530 ap=1 s=19081 n(v0 rc2024-03-27T07:25:52.281511+0000 b19081 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d86:[<0x20000001d6e/article-54.xml v530>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d86:[<0x20000001d6e/article-54.xml v530>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.124+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e02 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-11.xml auth{0=1} v458 ap=1 s=16138 n(v0 rc2024-03-27T07:25:52.664504+0000 b16138 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e02:[<0x20000001d6e/article-11.xml v458>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e02:[<0x20000001d6e/article-11.xml v458>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.149 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.124+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dce [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-26.xml auth{0=1} v488 ap=1 s=25900 n(v0 rc2024-03-27T07:25:52.500507+0000 b25900 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dce:[<0x20000001d6e/article-26.xml v488>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dce:[<0x20000001d6e/article-26.xml v488>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.124+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e06 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-10.xml auth{0=1} v546 ap=1 s=28862 n(v0 rc2024-03-27T07:25:52.673503+0000 b28862 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e06:[<0x20000001d6e/article-10.xml v546>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e06:[<0x20000001d6e/article-10.xml v546>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.124+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d93 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-49.xml auth{0=1} v494 ap=1 s=11998 n(v0 rc2024-03-27T07:25:52.314510+0000 b11998 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d93:[<0x20000001d6e/article-49.xml v494>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d93:[<0x20000001d6e/article-49.xml v494>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.125+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e25 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-12.jpg auth{0=1} v478 ap=1 s=22840 n(v0 rc2024-03-27T07:25:52.759502+0000 b22840 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adab3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e25:[<0x20000001d6e/picture-12.jpg v478>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e25:[<0x20000001d6e/picture-12.jpg v478>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.125+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dd1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-25.xml auth{0=1} v566 ap=1 s=26583 n(v0 rc2024-03-27T07:25:52.515506+0000 b26583 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab496b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dd1:[<0x20000001d6e/article-25.xml v566>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dd1:[<0x20000001d6e/article-25.xml v566>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.125+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d95 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-48.xml auth{0=1} v522 ap=1 s=24703 n(v0 rc2024-03-27T07:25:52.323510+0000 b24703 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab496000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d95:[<0x20000001d6e/article-48.xml v522>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d95:[<0x20000001d6e/article-48.xml v522>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.125+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001db5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-35.xml auth{0=1} v570 ap=1 s=18272 n(v0 rc2024-03-27T07:25:52.414508+0000 b18272 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab497600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001db5:[<0x20000001d6e/article-35.xml v570>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001db5:[<0x20000001d6e/article-35.xml v570>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.125+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e1a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-4.xml auth{0=1} v542 ap=1 s=18647 n(v0 rc2024-03-27T07:25:52.720502+0000 b18647 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab496580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e1a:[<0x20000001d6e/article-4.xml v542>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e1a:[<0x20000001d6e/article-4.xml v542>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.126+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001de6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-19.xml auth{0=1} v476 ap=1 s=29359 n(v0 rc2024-03-27T07:25:52.573505+0000 b29359 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab498100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001de6:[<0x20000001d6e/article-19.xml v476>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001de6:[<0x20000001d6e/article-19.xml v476>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.126+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001da4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-42.xml auth{0=1} v588 ap=1 s=18428 n(v0 rc2024-03-27T07:25:52.366509+0000 b18428 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab498680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001da4:[<0x20000001d6e/article-42.xml v588>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001da4:[<0x20000001d6e/article-42.xml v588>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.126+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001db0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-37.xml auth{0=1} v550 ap=1 s=8375 n(v0 rc2024-03-27T07:25:52.397509+0000 b8375 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab498c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001db0:[<0x20000001d6e/article-37.xml v550>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001db0:[<0x20000001d6e/article-37.xml v550>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.126+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dae [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-38.xml auth{0=1} v492 ap=1 s=9222 n(v0 rc2024-03-27T07:25:52.390509+0000 b9222 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab497080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dae:[<0x20000001d6e/article-38.xml v492>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dae:[<0x20000001d6e/article-38.xml v492>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.150 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.127+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001da9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-40.xml auth{0=1} v490 ap=1 s=13580 n(v0 rc2024-03-27T07:25:52.378509+0000 b13580 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab497b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001da9:[<0x20000001d6e/article-40.xml v490>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001da9:[<0x20000001d6e/article-40.xml v490>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.151 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.127+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001df4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-15.xml auth v606 ap=1 s=19931 n(v0 rc2024-03-27T07:25:52.618504+0000 b19931 1=1+0) caps={15291=pAsLsXsFscr/pFscr@6},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a95afb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001df4:[<0x20000001d6e/article-15.xml v606>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001df4:[<0x20000001d6e/article-15.xml v606>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.151 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.127+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dab [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-39.xml auth{0=1} v600 ap=1 s=2636 n(v0 rc2024-03-27T07:25:52.384509+0000 b2636 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab499180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dab:[<0x20000001d6e/article-39.xml v600>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dab:[<0x20000001d6e/article-39.xml v600>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.151 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.127+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001db3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-36.xml auth{0=1} v590 ap=1 s=17920 n(v0 rc2024-03-27T07:25:52.405509+0000 b17920 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab499700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001db3:[<0x20000001d6e/article-36.xml v590>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001db3:[<0x20000001d6e/article-36.xml v590>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.151 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.127+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e23 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-1.xml auth{0=1} v568 ap=1 s=9303 n(v0 rc2024-03-27T07:25:52.751502+0000 b9303 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab590580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e23:[<0x20000001d6e/article-1.xml v568>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e23:[<0x20000001d6e/article-1.xml v568>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.151 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.128+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dd8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-23.xml auth{0=1} v538 ap=1 s=18487 n(v0 rc2024-03-27T07:25:52.536506+0000 b18487 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab590b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dd8:[<0x20000001d6e/article-23.xml v538>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dd8:[<0x20000001d6e/article-23.xml v538>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.151 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.128+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d6f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-63.xml auth{0=1} v528 ap=1 s=31769 n(v0 rc2024-03-27T07:25:52.211512+0000 b31769 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab591600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d6f:[<0x20000001d6e/article-63.xml v528>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d6f:[<0x20000001d6e/article-63.xml v528>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.151 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.128+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ded [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-17.xml auth{0=1} v508 ap=1 s=12269 n(v0 rc2024-03-27T07:25:52.589505+0000 b12269 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab591080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ded:[<0x20000001d6e/article-17.xml v508>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ded:[<0x20000001d6e/article-17.xml v508>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.151 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.129+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dff [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-12.xml auth{0=1} v470 ap=1 s=10756 n(v0 rc2024-03-27T07:25:52.657504+0000 b10756 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab590000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dff:[<0x20000001d6e/article-12.xml v470>,<0x10000000399/blog-51 v62221>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dff:[<0x20000001d6e/article-12.xml v470>,<0x10000000399/blog-51 v124018>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.362 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: 2024-03-27T07:28:21.036+0000 7f077f72f700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003382 [...6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-94/ auth{1=1,2=1} fragtree_t(*^3) v123917 ap=2 f(v2 m2024-03-27T07:27:11.546952+0000 194=194+0) n(v5 rc2024-03-27T07:27:11.546952+0000 b4156190 195=194+1) old_inodes=1 (inest sync->mix g=1,2) caps={15291=pAsLsXsFs/pAsLsXsFsxcral@4} mcw={2=AsLsXsFs} | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=8 caps=1 stickydirs=0 dirtyrstat=0 dirtyparent=0 dirwaiter=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x559955a41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x20000003382:[<0x10000000399/blog-94 v115421>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x20000003382:[<0x10000000399/blog-94 v123917>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1802>,<0x10000000005/tmp v79>,<0x100000001fb/client.0 v78>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v92>,<0x10000000001/sv_1 v116>,<0x10000000000/qa v106>,<0x1/volumes v98>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T07:26:49.481384+0000 148=148+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T07:27:11.546952+0000 b4156190 195=194+1)","memory_value.dirstat":"f(v2 m2024-03-27T07:27:11.546952+0000 194=194+0)","memory_value.rstat":"n(v5 rc2024-03-27T07:27:11.546952+0000 b4156190 195=194+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-03-27T07:28:21.362 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: 2024-03-27T07:28:21.096+0000 7f077f72f700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000189b [...5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41/ auth{1=1,2=1} fragtree_t(*^3) v115976 ap=2 f(v3 m2024-03-27T07:26:33.239704+0000 185=185+0) n(v7 rc2024-03-27T07:26:33.239704+0000 b3632632 186=185+1) old_inodes=1 (inest sync->mix g=1,2) caps={15291=pAsLsXsFs/pAsLsXsFsxcral@1} | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=8 caps=1 stickydirs=0 dirtyparent=0 dirwaiter=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x559954e30000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x2000000189b:[<0x10000000399/blog-41 v113318>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(2)0x2000000189b:[<0x10000000399/blog-41 v115976>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1802>,<0x10000000005/tmp v79>,<0x100000001fb/client.0 v78>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v92>,<0x10000000001/sv_1 v116>,<0x10000000000/qa v106>,<0x1/volumes v98>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T07:26:26.499837+0000 184=184+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T07:26:33.239704+0000 b3632632 186=185+1)","memory_value.dirstat":"f(v3 m2024-03-27T07:26:33.239704+0000 185=185+0)","memory_value.rstat":"n(v7 rc2024-03-27T07:26:33.239704+0000 b3632632 186=185+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-03-27T07:28:21.362 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: 2024-03-27T07:28:21.272+0000 7f077f72f700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x200000034d5 [...7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-99/ auth{1=1,2=1} fragtree_t(*^3) v136533 ap=2 f(v5 m2024-03-27T07:28:02.160960+0000 115=115+0) n(v5 rc2024-03-27T07:28:02.160960+0000 b1725838 116=115+1) old_inodes=2 (inest sync->mix g=1,2) caps={15291=pAsLsXsFs/pAsLsXsFsxcral@3} | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=8 caps=1 stickydirs=0 dirtyrstat=0 dirtyparent=0 dirwaiter=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5599578e9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x200000034d5:[<0x10000000399/blog-99 v124574>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(2)0x200000034d5:[<0x10000000399/blog-99 v136533>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1802>,<0x10000000005/tmp v79>,<0x100000001fb/client.0 v78>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v92>,<0x10000000001/sv_1 v116>,<0x10000000000/qa v106>,<0x1/volumes v98>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T07:27:22.865730+0000 113=113+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T07:28:02.160960+0000 b1725838 116=115+1)","memory_value.dirstat":"f(v5 m2024-03-27T07:28:02.160960+0000 115=115+0)","memory_value.rstat":"n(v5 rc2024-03-27T07:28:02.160960+0000 b1725838 116=115+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-03-27T07:28:21.620 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.366+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000eac [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-59.xml auth{0=1} v865 ap=1 s=13392 n(v0 rc2024-03-27T07:25:35.926833+0000 b13392 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab745b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000eac:[<0x20000000eaa/article-59.xml v4>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000eac:[<0x20000000eaa/article-59.xml v865>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.621 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.367+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001057 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg auth{0=1} v879 ap=1 s=49620 n(v0 rc2024-03-27T07:25:37.851795+0000 b49620 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab746100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001057:[<0x20000000eaa/picture-13.jpg v574>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001057:[<0x20000000eaa/picture-13.jpg v879>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.621 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.367+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001044 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg auth{0=1} v883 ap=1 s=41864 n(v0 rc2024-03-27T07:25:37.755797+0000 b41864 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab747180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001044:[<0x20000000eaa/picture-18.jpg v544>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001044:[<0x20000000eaa/picture-18.jpg v883>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.621 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.367+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f7b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml auth{0=1} v885 ap=1 s=1067 n(v0 rc2024-03-27T07:25:36.825815+0000 b1067 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab747700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f7b:[<0x20000000eaa/article-18.xml v250>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f7b:[<0x20000000eaa/article-18.xml v885>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.621 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: scrub queued for path: / 2024-03-27T07:28:21.621 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:21.621 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:28:21.621 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:28:21.621 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: scrub summary: active paths [/] 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ebb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ac8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.622 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ee5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.623 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.623 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eeb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.623 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.623 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.367+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f7a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-56.xml auth{0=1} v1586 ap=1 s=7066 n(v0 rc2024-03-27T07:26:59.802182+0000 b7066 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab746c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f7a:[<0x20000000eaa/comment-56.xml v1373>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f7a:[<0x20000000eaa/comment-56.xml v1586>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.623 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.367+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000169b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-5.xml auth{0=1} v1578 ap=1 s=5888 n(v0 rc2024-03-27T07:27:15.847867+0000 b5888 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8bcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000169b:[<0x20000000eaa/comment-5.xml v1578>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000169b:[<0x20000000eaa/comment-5.xml v1578>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.623 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.368+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001041 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg auth{0=1} v873 ap=1 s=60720 n(v0 rc2024-03-27T07:25:37.731798+0000 b60720 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8bd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001041:[<0x20000000eaa/picture-19.jpg v538>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001041:[<0x20000000eaa/picture-19.jpg v873>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.624 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.368+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ecb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-51.xml auth{0=1} v895 ap=1 s=12814 n(v0 rc2024-03-27T07:25:36.061830+0000 b12814 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8bd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ecb:[<0x20000000eaa/article-51.xml v52>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ecb:[<0x20000000eaa/article-51.xml v895>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.624 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.368+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001645 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-29.xml auth{0=1} v1584 ap=1 s=5465 n(v0 rc2024-03-27T07:27:14.973885+0000 b5465 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8be680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001645:[<0x20000000eaa/comment-29.xml v1584>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001645:[<0x20000000eaa/comment-29.xml v1584>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.624 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.368+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001079 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg auth{0=1} v871 ap=1 s=55986 n(v0 rc2024-03-27T07:25:37.997792+0000 b55986 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8bf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001079:[<0x20000000eaa/picture-4.jpg v628>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001079:[<0x20000000eaa/picture-4.jpg v871>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.624 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.368+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f4f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml auth{0=1} v889 ap=1 s=12531 n(v0 rc2024-03-27T07:25:36.650819+0000 b12531 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8bec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f4f:[<0x20000000eaa/article-27.xml v196>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f4f:[<0x20000000eaa/article-27.xml v889>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.624 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.624 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ec7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.624 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.624 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.624 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001702 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.624 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002edc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ed6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b6c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ed3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.625 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.626 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.368+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001001 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-35.jpg auth{0=1} v869 ap=1 s=44862 n(v0 rc2024-03-27T07:25:37.442803+0000 b44862 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8bf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001001:[<0x20000000eaa/picture-35.jpg v442>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001001:[<0x20000000eaa/picture-35.jpg v869>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.626 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.368+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-93.jpg auth v1590 ap=1 s=62387 n(v0 rc2024-03-27T07:27:07.123038+0000 b62387 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac216000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a3:[<0x20000000eaa/picture-93.jpg v1470>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000012a3:[<0x20000000eaa/picture-93.jpg v1590>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.626 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.369+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001081 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg auth v772 ap=1 s=33772 n(v0 rc2024-03-27T07:25:38.036792+0000 b33772 1=1+0) caps={15291=pAsLsXsFscr/pFscr@20},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a7063180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001081:[<0x20000000eaa/picture-2.jpg v658>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001081:[<0x20000000eaa/picture-2.jpg v772>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.626 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.369+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f72 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml auth{0=1} v887 ap=1 s=17611 n(v0 rc2024-03-27T07:25:36.790816+0000 b17611 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac216580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f72:[<0x20000000eaa/article-20.xml v238>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f72:[<0x20000000eaa/article-20.xml v887>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.626 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.369+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001053 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg auth{0=1} v881 ap=1 s=27741 n(v0 rc2024-03-27T07:25:37.826796+0000 b27741 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac216b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001053:[<0x20000000eaa/picture-14.jpg v568>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001053:[<0x20000000eaa/picture-14.jpg v881>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.626 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.626 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.626 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002edf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ce0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ce9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ad2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000db6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ebe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002db3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ea4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.627 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.628 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.369+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-92.xml auth{0=1} v1319 ap=1 s=6003 n(v0 rc2024-03-27T07:26:45.906455+0000 b6003 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac217080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7a:[<0x20000000eaa/comment-92.xml v1319>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d7a:[<0x20000000eaa/comment-92.xml v1319>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.628 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.370+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ee6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-45.xml auth{0=1} v875 ap=1 s=15092 n(v0 rc2024-03-27T07:25:36.205828+0000 b15092 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac218100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ee6:[<0x20000000eaa/article-45.xml v88>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ee6:[<0x20000000eaa/article-45.xml v875>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.628 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.370+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d78 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-94.xml auth{0=1} v1317 ap=1 s=10199 n(v0 rc2024-03-27T07:26:45.882455+0000 b10199 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac218680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d78:[<0x20000000eaa/comment-94.xml v1317>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d78:[<0x20000000eaa/comment-94.xml v1317>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.628 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.370+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000efb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-41.xml auth{0=1} v893 ap=1 s=29769 n(v0 rc2024-03-27T07:25:36.293826+0000 b29769 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac217b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000efb:[<0x20000000eaa/article-41.xml v112>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000efb:[<0x20000000eaa/article-41.xml v893>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.628 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.370+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f37 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml auth{0=1} v891 ap=1 s=19122 n(v0 rc2024-03-27T07:25:36.548821+0000 b19122 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac219180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f37:[<0x20000000eaa/article-31.xml v172>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f37:[<0x20000000eaa/article-31.xml v891>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.628 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.628 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002da5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001afb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cfe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ea0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002da2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ed9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.629 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.630 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.630 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.370+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000106d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg auth{0=1} v877 ap=1 s=20528 n(v0 rc2024-03-27T07:25:37.941793+0000 b20528 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac218c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000106d:[<0x20000000eaa/picture-7.jpg v610>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000106d:[<0x20000000eaa/picture-7.jpg v877>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.630 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.370+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001066 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg auth{0=1} v867 ap=1 s=11768 n(v0 rc2024-03-27T07:25:37.910794+0000 b11768 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac219700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001066:[<0x20000000eaa/picture-9.jpg v598>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001066:[<0x20000000eaa/picture-9.jpg v867>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.630 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.370+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000166e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-11.xml auth{0=1} v1580 ap=1 s=2220 n(v0 rc2024-03-27T07:27:15.573873+0000 b2220 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac882b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000166e:[<0x20000000eaa/comment-11.xml v1580>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000166e:[<0x20000000eaa/comment-11.xml v1580>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.630 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.371+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001660 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-20.xml auth{0=1} v1582 ap=1 s=4489 n(v0 rc2024-03-27T07:27:15.378877+0000 b4489 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac883b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001660:[<0x20000000eaa/comment-20.xml v1582>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001660:[<0x20000000eaa/comment-20.xml v1582>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.630 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.371+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ebb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-55.xml auth{0=1} v900 ap=1 s=3107 n(v0 rc2024-03-27T07:25:35.994832+0000 b3107 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab201180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ebb:[<0x20000000eaa/article-55.xml v28>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ebb:[<0x20000000eaa/article-55.xml v900>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001be3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002da9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000fbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002de4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b1d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.631 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.632 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.632 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.632 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.632 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.371+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001029 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-25.jpg auth{0=1} v884 ap=1 s=15314 n(v0 rc2024-03-27T07:25:37.609800+0000 b15314 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab201700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001029:[<0x20000000eaa/picture-25.jpg v502>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001029:[<0x20000000eaa/picture-25.jpg v884>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.632 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.371+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fab [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml auth{0=1} v880 ap=1 s=22834 n(v0 rc2024-03-27T07:25:37.021812+0000 b22834 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aac56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fab:[<0x20000000eaa/article-8.xml v310>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fab:[<0x20000000eaa/article-8.xml v880>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.632 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.632 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001acc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ee2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002df4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cf5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.633 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.634 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002df0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.634 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.634 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.371+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000160e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-47.xml auth{0=1} v1584 ap=1 s=6430 n(v0 rc2024-03-27T07:27:14.443895+0000 b6430 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aac57080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000160e:[<0x20000000eaa/comment-47.xml v1584>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000160e:[<0x20000000eaa/comment-47.xml v1584>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.634 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.371+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001610 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-46.xml auth{0=1} v1582 ap=1 s=6258 n(v0 rc2024-03-27T07:27:14.456895+0000 b6258 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aac58100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001610:[<0x20000000eaa/comment-46.xml v1582>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001610:[<0x20000000eaa/comment-46.xml v1582>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.634 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.372+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001010 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-31.jpg auth{0=1} v892 ap=1 s=41910 n(v0 rc2024-03-27T07:25:37.511802+0000 b41910 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aac58680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001010:[<0x20000000eaa/picture-31.jpg v466>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001010:[<0x20000000eaa/picture-31.jpg v892>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.634 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.372+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e44 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-70.xml auth{0=1} v1316 ap=1 s=4877 n(v0 rc2024-03-27T07:26:47.467424+0000 b4877 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aac58c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e44:[<0x20000000eaa/comment-70.xml v1316>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e44:[<0x20000000eaa/comment-70.xml v1316>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.634 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.372+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fce [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-49.jpg auth{0=1} v896 ap=1 s=26671 n(v0 rc2024-03-27T07:25:37.159809+0000 b26671 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aac59180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fce:[<0x20000000eaa/picture-49.jpg v358>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fce:[<0x20000000eaa/picture-49.jpg v896>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ee8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002de0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ed0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001aca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.635 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.636 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.636 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.636 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.636 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.636 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.636 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.372+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000106a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg auth{0=1} v878 ap=1 s=32954 n(v0 rc2024-03-27T07:25:37.927794+0000 b32954 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aac59700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000106a:[<0x20000000eaa/picture-8.jpg v604>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000106a:[<0x20000000eaa/picture-8.jpg v878>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.636 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.373+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001025 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-26.jpg auth{0=1} v886 ap=1 s=58339 n(v0 rc2024-03-27T07:25:37.595800+0000 b58339 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad68a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001025:[<0x20000000eaa/picture-26.jpg v496>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001025:[<0x20000000eaa/picture-26.jpg v886>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.636 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.636 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ea8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ccf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ec4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.637 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ddc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.638 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.373+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f31 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml auth{0=1} v894 ap=1 s=24474 n(v0 rc2024-03-27T07:25:36.520821+0000 b24474 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad68a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f31:[<0x20000000eaa/article-32.xml v166>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f31:[<0x20000000eaa/article-32.xml v894>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.638 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.373+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d86 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-83.xml auth{0=1} v1324 ap=1 s=3075 n(v0 rc2024-03-27T07:26:46.141450+0000 b3075 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad68ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d86:[<0x20000000eaa/comment-83.xml v1324>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d86:[<0x20000000eaa/comment-83.xml v1324>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.638 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.373+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e49 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-69.xml auth{0=1} v1318 ap=1 s=9464 n(v0 rc2024-03-27T07:26:47.547422+0000 b9464 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad68b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e49:[<0x20000000eaa/comment-69.xml v1318>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e49:[<0x20000000eaa/comment-69.xml v1318>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.638 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.373+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f6d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml auth{0=1} v872 ap=1 s=10325 n(v0 rc2024-03-27T07:25:36.773816+0000 b10325 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad68b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f6d:[<0x20000000eaa/article-21.xml v232>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f6d:[<0x20000000eaa/article-21.xml v872>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.373+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f3d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml auth{0=1} v890 ap=1 s=32498 n(v0 rc2024-03-27T07:25:36.572820+0000 b32498 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad68bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f3d:[<0x20000000eaa/article-30.xml v178>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f3d:[<0x20000000eaa/article-30.xml v890>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000dbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ecd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002db0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.639 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ac2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ccc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d3f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.640 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.640 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.374+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-89.xml auth{0=1} v1314 ap=1 s=9758 n(v0 rc2024-03-27T07:26:45.970453+0000 b9758 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad68c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7f:[<0x20000000eaa/comment-89.xml v1314>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d7f:[<0x20000000eaa/comment-89.xml v1314>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.640 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.374+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e35 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-74.xml auth{0=1} v1330 ap=1 s=5707 n(v0 rc2024-03-27T07:26:47.164430+0000 b5707 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad68cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e35:[<0x20000000eaa/comment-74.xml v1330>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e35:[<0x20000000eaa/comment-74.xml v1330>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.640 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.374+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b90 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-94.xml auth v998 ap=1 s=29491 n(v0 rc2024-03-27T07:26:14.903065+0000 b29491 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad68c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b90:[<0x20000000eaa/article-94.xml v998>,<0x10000000399/blog-24 v94598>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b90:[<0x20000000eaa/article-94.xml v998>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ac1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.641 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.642 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.642 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ace (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.642 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.643 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.374+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-90.xml auth{0=1} v1322 ap=1 s=5493 n(v0 rc2024-03-27T07:26:45.941454+0000 b5493 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad68d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7e:[<0x20000000eaa/comment-90.xml v1322>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d7e:[<0x20000000eaa/comment-90.xml v1322>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.643 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.374+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-36.xml auth{0=1} v1580 ap=1 s=8973 n(v0 rc2024-03-27T07:27:14.717890+0000 b8973 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab21a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162d:[<0x20000000eaa/comment-36.xml v1580>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000162d:[<0x20000000eaa/comment-36.xml v1580>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.643 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.374+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f93 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml auth{0=1} v882 ap=1 s=32466 n(v0 rc2024-03-27T07:25:36.933813+0000 b32466 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab21ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f93:[<0x20000000eaa/article-13.xml v280>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f93:[<0x20000000eaa/article-13.xml v882>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.643 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.374+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f5b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-64.xml auth{0=1} v1586 ap=1 s=9912 n(v0 rc2024-03-27T07:26:59.376190+0000 b9912 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab21b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f5b:[<0x20000000eaa/comment-64.xml v1357>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f5b:[<0x20000000eaa/comment-64.xml v1586>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.643 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.375+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-72.xml auth{0=1} v1326 ap=1 s=9402 n(v0 rc2024-03-27T07:26:47.396425+0000 b9402 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab21bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e3d:[<0x20000000eaa/comment-72.xml v1326>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e3d:[<0x20000000eaa/comment-72.xml v1326>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.644 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000fb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.644 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.644 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.644 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.644 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.644 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.644 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ac4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.644 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.644 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002de8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.644 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.645 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.645 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.645 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002cdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.645 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ec1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.645 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.645 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.645 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.375+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016a1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-4.xml auth{0=1} v1574 ap=1 s=3098 n(v0 rc2024-03-27T07:27:15.874867+0000 b3098 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab21cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016a1:[<0x20000000eaa/comment-4.xml v1574>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016a1:[<0x20000000eaa/comment-4.xml v1574>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.645 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.375+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ed0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-50.xml auth{0=1} v898 ap=1 s=6910 n(v0 rc2024-03-27T07:25:36.102830+0000 b6910 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab21d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ed0:[<0x20000000eaa/article-50.xml v58>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ed0:[<0x20000000eaa/article-50.xml v898>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.646 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.646 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002d83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.646 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.646 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ce6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.646 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.661 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.375+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fc5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml auth{0=1} v874 ap=1 s=15102 n(v0 rc2024-03-27T07:25:37.133809+0000 b15102 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adac2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fc5:[<0x20000000eaa/article-2.xml v346>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fc5:[<0x20000000eaa/article-2.xml v874>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.375+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fb5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml auth{0=1} v876 ap=1 s=9158 n(v0 rc2024-03-27T07:25:37.056811+0000 b9158 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab21d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fb5:[<0x20000000eaa/article-6.xml v322>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fb5:[<0x20000000eaa/article-6.xml v876>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.375+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001667 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-14.xml auth{0=1} v1576 ap=1 s=6550 n(v0 rc2024-03-27T07:27:15.525874+0000 b6550 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adac3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001667:[<0x20000000eaa/comment-14.xml v1576>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001667:[<0x20000000eaa/comment-14.xml v1576>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.376+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f50 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-67.xml auth{0=1} v1588 ap=1 s=2749 n(v0 rc2024-03-27T07:26:59.215193+0000 b2749 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adac3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f50:[<0x20000000eaa/comment-67.xml v1354>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f50:[<0x20000000eaa/comment-67.xml v1588>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.376+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000865 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-29.jpg auth{0=1} v888 ap=1 s=20810 n(v0 rc2024-03-27T07:25:50.722542+0000 b20810 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adac4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000865:[<0x20000000eaa/picture-29.jpg v888>,<0x10000000399/blog-24 v50974>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000865:[<0x20000000eaa/picture-29.jpg v888>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.376+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001661 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-19.xml auth{0=1} v1578 ap=1 s=8815 n(v0 rc2024-03-27T07:27:15.404876+0000 b8815 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adac5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001661:[<0x20000000eaa/comment-19.xml v1578>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001661:[<0x20000000eaa/comment-19.xml v1578>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.376+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000eb8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-56.xml auth{0=1} v902 ap=1 s=11552 n(v0 rc2024-03-27T07:25:35.980832+0000 b11552 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adac5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000eb8:[<0x20000000eaa/article-56.xml v22>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000eb8:[<0x20000000eaa/article-56.xml v902>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.376+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-22.xml auth{0=1} v1589 ap=1 s=6443 n(v0 rc2024-03-27T07:27:15.294878+0000 b6443 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc69080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165e:[<0x20000000eaa/comment-22.xml v1589>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000165e:[<0x20000000eaa/comment-22.xml v1589>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.376+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016af [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-2.xml auth{0=1} v1579 ap=1 s=5530 n(v0 rc2024-03-27T07:27:15.933866+0000 b5530 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc6a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016af:[<0x20000000eaa/comment-2.xml v1579>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016af:[<0x20000000eaa/comment-2.xml v1579>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.377+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001617 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-44.xml auth{0=1} v1595 ap=1 s=7218 n(v0 rc2024-03-27T07:27:14.495894+0000 b7218 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc6b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001617:[<0x20000000eaa/comment-44.xml v1595>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001617:[<0x20000000eaa/comment-44.xml v1595>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.377+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ef0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-43.xml auth{0=1} v870 ap=1 s=21479 n(v0 rc2024-03-27T07:25:36.249827+0000 b21479 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc6b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ef0:[<0x20000000eaa/article-43.xml v100>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ef0:[<0x20000000eaa/article-43.xml v870>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.377+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f2b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml auth{0=1} v876 ap=1 s=15649 n(v0 rc2024-03-27T07:25:36.494822+0000 b15649 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f2b:[<0x20000000eaa/article-33.xml v160>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f2b:[<0x20000000eaa/article-33.xml v876>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.377+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d79 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-93.xml auth{0=1} v1316 ap=1 s=6775 n(v0 rc2024-03-27T07:26:45.901455+0000 b6775 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7e4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d79:[<0x20000000eaa/comment-93.xml v1316>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d79:[<0x20000000eaa/comment-93.xml v1316>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.377+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001075 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg auth v774 ap=1 s=31254 n(v0 rc2024-03-27T07:25:37.975793+0000 b31254 1=1+0) caps={15291=pAsLsXsFscr/pFscr@17},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a89fec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001075:[<0x20000000eaa/picture-5.jpg v622>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001075:[<0x20000000eaa/picture-5.jpg v774>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.377+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001655 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-27.xml auth{0=1} v1591 ap=1 s=5291 n(v0 rc2024-03-27T07:27:15.146881+0000 b5291 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001655:[<0x20000000eaa/comment-27.xml v1591>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001655:[<0x20000000eaa/comment-27.xml v1591>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.377+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e29 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-76.xml auth{0=1} v1326 ap=1 s=2513 n(v0 rc2024-03-27T07:26:47.090431+0000 b2513 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7e5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e29:[<0x20000000eaa/comment-76.xml v1326>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e29:[<0x20000000eaa/comment-76.xml v1326>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.378+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000eb5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-57.xml auth{0=1} v868 ap=1 s=15152 n(v0 rc2024-03-27T07:25:35.965832+0000 b15152 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000eb5:[<0x20000000eaa/article-57.xml v16>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000eb5:[<0x20000000eaa/article-57.xml v868>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.378+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f85 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-52.xml auth{0=1} v1599 ap=1 s=6357 n(v0 rc2024-03-27T07:26:59.951179+0000 b6357 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7e7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f85:[<0x20000000eaa/comment-52.xml v1384>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f85:[<0x20000000eaa/comment-52.xml v1599>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.378+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001681 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-7.xml auth{0=1} v1581 ap=1 s=8845 n(v0 rc2024-03-27T07:27:15.711870+0000 b8845 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6fd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001681:[<0x20000000eaa/comment-7.xml v1581>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001681:[<0x20000000eaa/comment-7.xml v1581>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.378+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001665 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-15.xml auth{0=1} v1585 ap=1 s=3260 n(v0 rc2024-03-27T07:27:15.509874+0000 b3260 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6fe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001665:[<0x20000000eaa/comment-15.xml v1585>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001665:[<0x20000000eaa/comment-15.xml v1585>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.378+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000eb0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-58.xml auth{0=1} v882 ap=1 s=20707 n(v0 rc2024-03-27T07:25:35.948833+0000 b20707 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6fe680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000eb0:[<0x20000000eaa/article-58.xml v10>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000eb0:[<0x20000000eaa/article-58.xml v882>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.663 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.378+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f53 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-66.xml auth{0=1} v1601 ap=1 s=2251 n(v0 rc2024-03-27T07:26:59.258193+0000 b2251 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6fc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f53:[<0x20000000eaa/comment-66.xml v1349>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f53:[<0x20000000eaa/comment-66.xml v1601>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.379+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ec4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-53.xml auth{0=1} v880 ap=1 s=16532 n(v0 rc2024-03-27T07:25:36.022831+0000 b16532 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6fec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ec4:[<0x20000000eaa/article-53.xml v40>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ec4:[<0x20000000eaa/article-53.xml v880>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.379+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001619 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-43.xml auth{0=1} v1593 ap=1 s=2154 n(v0 rc2024-03-27T07:27:14.513894+0000 b2154 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a70b6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001619:[<0x20000000eaa/comment-43.xml v1593>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001619:[<0x20000000eaa/comment-43.xml v1593>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.379+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001663 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-17.xml auth{0=1} v1587 ap=1 s=2336 n(v0 rc2024-03-27T07:27:15.444875+0000 b2336 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a70b7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001663:[<0x20000000eaa/comment-17.xml v1587>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001663:[<0x20000000eaa/comment-17.xml v1587>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.379+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f49 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml auth{0=1} v874 ap=1 s=30715 n(v0 rc2024-03-27T07:25:36.620819+0000 b30715 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a70b7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f49:[<0x20000000eaa/article-28.xml v190>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f49:[<0x20000000eaa/article-28.xml v874>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.379+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001678 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-9.xml auth{0=1} v1583 ap=1 s=8007 n(v0 rc2024-03-27T07:27:15.631872+0000 b8007 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a70b8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001678:[<0x20000000eaa/comment-9.xml v1583>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001678:[<0x20000000eaa/comment-9.xml v1583>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.379+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ec8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-52.xml auth{0=1} v878 ap=1 s=23756 n(v0 rc2024-03-27T07:25:36.038831+0000 b23756 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a70b8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ec8:[<0x20000000eaa/article-52.xml v46>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ec8:[<0x20000000eaa/article-52.xml v878>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.379+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001613 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-45.xml auth{0=1} v1597 ap=1 s=5237 n(v0 rc2024-03-27T07:27:14.474894+0000 b5237 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac83e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001613:[<0x20000000eaa/comment-45.xml v1597>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001613:[<0x20000000eaa/comment-45.xml v1597>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.380+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fdc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-46.jpg auth{0=1} v872 ap=1 s=62243 n(v0 rc2024-03-27T07:25:37.252807+0000 b62243 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac83eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fdc:[<0x20000000eaa/picture-46.jpg v376>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fdc:[<0x20000000eaa/picture-46.jpg v872>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.380+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d84 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-84.xml auth{0=1} v1342 ap=1 s=3094 n(v0 rc2024-03-27T07:26:46.122450+0000 b3094 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac83e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d84:[<0x20000000eaa/comment-84.xml v1342>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d84:[<0x20000000eaa/comment-84.xml v1342>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.380+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d92 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-81.xml auth{0=1} v1322 ap=1 s=8718 n(v0 rc2024-03-27T07:26:46.187449+0000 b8718 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d92:[<0x20000000eaa/comment-81.xml v1322>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d92:[<0x20000000eaa/comment-81.xml v1322>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.380+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001673 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-10.xml auth{0=1} v1568 ap=1 s=5729 n(v0 rc2024-03-27T07:27:15.602872+0000 b5729 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7f8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001673:[<0x20000000eaa/comment-10.xml v1568>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001673:[<0x20000000eaa/comment-10.xml v1568>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000107d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg auth{0=1} v859 ap=1 s=23448 n(v0 rc2024-03-27T07:25:38.017792+0000 b23448 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000107d:[<0x20000000eaa/picture-3.jpg v634>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000107d:[<0x20000000eaa/picture-3.jpg v859>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f81 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-53.xml auth{0=1} v1576 ap=1 s=2867 n(v0 rc2024-03-27T07:26:59.910180+0000 b2867 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad95c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f81:[<0x20000000eaa/comment-53.xml v1380>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f81:[<0x20000000eaa/comment-53.xml v1576>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001692 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-6.xml auth{0=1} v1564 ap=1 s=3196 n(v0 rc2024-03-27T07:27:15.799868+0000 b3196 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad95d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001692:[<0x20000000eaa/comment-6.xml v1564>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001692:[<0x20000000eaa/comment-6.xml v1564>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d83 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-85.xml auth{0=1} v1303 ap=1 s=7156 n(v0 rc2024-03-27T07:26:46.088451+0000 b7156 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad95d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d83:[<0x20000000eaa/comment-85.xml v1303>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d83:[<0x20000000eaa/comment-85.xml v1303>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000105e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg auth{0=1} v863 ap=1 s=46840 n(v0 rc2024-03-27T07:25:37.883795+0000 b46840 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad95db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000105e:[<0x20000000eaa/picture-11.jpg v586>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000105e:[<0x20000000eaa/picture-11.jpg v863>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.382+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fba [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml auth{0=1} v861 ap=1 s=28107 n(v0 rc2024-03-27T07:25:37.078810+0000 b28107 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad95e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fba:[<0x20000000eaa/article-5.xml v328>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fba:[<0x20000000eaa/article-5.xml v861>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.382+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f25 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml auth{0=1} v855 ap=1 s=6609 n(v0 rc2024-03-27T07:25:36.467822+0000 b6609 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad95e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f25:[<0x20000000eaa/article-34.xml v154>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f25:[<0x20000000eaa/article-34.xml v855>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.382+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-35.xml auth{0=1} v1572 ap=1 s=5677 n(v0 rc2024-03-27T07:27:14.741889+0000 b5677 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad95f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162f:[<0x20000000eaa/comment-35.xml v1572>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000162f:[<0x20000000eaa/comment-35.xml v1572>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.382+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-28.xml auth{0=1} v1570 ap=1 s=4291 n(v0 rc2024-03-27T07:27:15.070883+0000 b4291 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac42ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164f:[<0x20000000eaa/comment-28.xml v1570>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000164f:[<0x20000000eaa/comment-28.xml v1570>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.382+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f76 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-57.xml auth{0=1} v1582 ap=1 s=4626 n(v0 rc2024-03-27T07:26:59.733183+0000 b4626 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac42b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f76:[<0x20000000eaa/comment-57.xml v1368>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f76:[<0x20000000eaa/comment-57.xml v1582>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.665 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.383+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f43 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml auth{0=1} v865 ap=1 s=28658 n(v0 rc2024-03-27T07:25:36.596820+0000 b28658 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac42bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f43:[<0x20000000eaa/article-29.xml v184>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f43:[<0x20000000eaa/article-29.xml v865>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.666 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.383+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ff3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-40.jpg auth{0=1} v867 ap=1 s=63724 n(v0 rc2024-03-27T07:25:37.375805+0000 b63724 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac42c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ff3:[<0x20000000eaa/picture-40.jpg v412>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ff3:[<0x20000000eaa/picture-40.jpg v867>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.666 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.383+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f68 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-61.xml auth{0=1} v1580 ap=1 s=2298 n(v0 rc2024-03-27T07:26:59.503188+0000 b2298 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac42cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f68:[<0x20000000eaa/comment-61.xml v1365>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f68:[<0x20000000eaa/comment-61.xml v1580>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.666 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.383+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f69 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml auth{0=1} v857 ap=1 s=17974 n(v0 rc2024-03-27T07:25:36.756817+0000 b17974 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac42d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f69:[<0x20000000eaa/article-22.xml v226>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f69:[<0x20000000eaa/article-22.xml v857>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.666 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.383+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001627 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-38.xml auth{0=1} v1574 ap=1 s=4810 n(v0 rc2024-03-27T07:27:14.659891+0000 b4810 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acba8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001627:[<0x20000000eaa/comment-38.xml v1574>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001627:[<0x20000000eaa/comment-38.xml v1574>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.666 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.383+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e50 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-68.xml auth{0=1} v1318 ap=1 s=4824 n(v0 rc2024-03-27T07:26:47.670420+0000 b4824 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acba8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e50:[<0x20000000eaa/comment-68.xml v1318>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e50:[<0x20000000eaa/comment-68.xml v1318>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.666 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.384+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ed5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-49.xml auth{0=1} v869 ap=1 s=15435 n(v0 rc2024-03-27T07:25:36.127829+0000 b15435 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acba9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ed5:[<0x20000000eaa/article-49.xml v64>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ed5:[<0x20000000eaa/article-49.xml v869>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.666 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.384+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000167b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-8.xml auth{0=1} v1566 ap=1 s=5132 n(v0 rc2024-03-27T07:27:15.667871+0000 b5132 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbaa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000167b:[<0x20000000eaa/comment-8.xml v1566>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000167b:[<0x20000000eaa/comment-8.xml v1566>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.666 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.384+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e14 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-80.xml auth{0=1} v1320 ap=1 s=3686 n(v0 rc2024-03-27T07:26:46.855436+0000 b3686 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbaa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e14:[<0x20000000eaa/comment-80.xml v1320>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e14:[<0x20000000eaa/comment-80.xml v1320>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.666 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.384+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001031 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-23.jpg auth{0=1} v854 ap=1 s=11687 n(v0 rc2024-03-27T07:25:37.647799+0000 b11687 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbaac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001031:[<0x20000000eaa/picture-23.jpg v514>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001031:[<0x20000000eaa/picture-23.jpg v854>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.384+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f8e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml auth{0=1} v848 ap=1 s=14069 n(v0 rc2024-03-27T07:25:36.912814+0000 b14069 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f8e:[<0x20000000eaa/article-14.xml v274>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f8e:[<0x20000000eaa/article-14.xml v848>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.384+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fe1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-45.jpg auth{0=1} v862 ap=1 s=43961 n(v0 rc2024-03-27T07:25:37.275807+0000 b43961 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fe1:[<0x20000000eaa/picture-45.jpg v382>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fe1:[<0x20000000eaa/picture-45.jpg v862>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.384+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ff0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-41.jpg auth{0=1} v832 ap=1 s=16973 n(v0 rc2024-03-27T07:25:37.363805+0000 b16973 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade22000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ff0:[<0x20000000eaa/picture-41.jpg v406>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ff0:[<0x20000000eaa/picture-41.jpg v832>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.385+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000edd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-47.xml auth{0=1} v868 ap=1 s=32295 n(v0 rc2024-03-27T07:25:36.167828+0000 b32295 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade23600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000edd:[<0x20000000eaa/article-47.xml v76>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000edd:[<0x20000000eaa/article-47.xml v868>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.385+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f65 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-62.xml auth{0=1} v1542 ap=1 s=6318 n(v0 rc2024-03-27T07:26:59.466189+0000 b6318 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade22b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f65:[<0x20000000eaa/comment-62.xml v1331>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f65:[<0x20000000eaa/comment-62.xml v1542>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.385+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ee1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-46.xml auth{0=1} v864 ap=1 s=31017 n(v0 rc2024-03-27T07:25:36.186828+0000 b31017 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade23080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ee1:[<0x20000000eaa/article-46.xml v82>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ee1:[<0x20000000eaa/article-46.xml v864>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.385+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001035 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-22.jpg auth{0=1} v852 ap=1 s=9373 n(v0 rc2024-03-27T07:25:37.668799+0000 b9373 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade23b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001035:[<0x20000000eaa/picture-22.jpg v520>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001035:[<0x20000000eaa/picture-22.jpg v852>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.385+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f9c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml auth{0=1} v844 ap=1 s=18365 n(v0 rc2024-03-27T07:25:36.968813+0000 b18365 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade24100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f9c:[<0x20000000eaa/article-11.xml v292>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f9c:[<0x20000000eaa/article-11.xml v844>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.386+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f85 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml auth{0=1} v830 ap=1 s=16287 n(v0 rc2024-03-27T07:25:36.864815+0000 b16287 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade25180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f85:[<0x20000000eaa/article-16.xml v262>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f85:[<0x20000000eaa/article-16.xml v830>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.387+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f6f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-59.xml auth{0=1} v1540 ap=1 s=9132 n(v0 rc2024-03-27T07:26:59.648185+0000 b9132 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade24c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f6f:[<0x20000000eaa/comment-59.xml v1335>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f6f:[<0x20000000eaa/comment-59.xml v1540>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.389+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ec0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-54.xml auth{0=1} v836 ap=1 s=18894 n(v0 rc2024-03-27T07:25:36.008831+0000 b18894 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac390000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ec0:[<0x20000000eaa/article-54.xml v34>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ec0:[<0x20000000eaa/article-54.xml v836>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.389+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f55 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml auth{0=1} v858 ap=1 s=10803 n(v0 rc2024-03-27T07:25:36.681818+0000 b10803 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac390580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f55:[<0x20000000eaa/article-26.xml v202>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f55:[<0x20000000eaa/article-26.xml v858>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.389+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e1f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-77.xml auth{0=1} v1280 ap=1 s=3057 n(v0 rc2024-03-27T07:26:47.033433+0000 b3057 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade25700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e1f:[<0x20000000eaa/comment-77.xml v1280>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e1f:[<0x20000000eaa/comment-77.xml v1280>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.391+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001050 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg auth{0=1} v850 ap=1 s=40824 n(v0 rc2024-03-27T07:25:37.803796+0000 b40824 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac390b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001050:[<0x20000000eaa/picture-15.jpg v562>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001050:[<0x20000000eaa/picture-15.jpg v850>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.391+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fd7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-47.jpg auth{0=1} v866 ap=1 s=64881 n(v0 rc2024-03-27T07:25:37.216808+0000 b64881 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac391080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fd7:[<0x20000000eaa/picture-47.jpg v370>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fd7:[<0x20000000eaa/picture-47.jpg v866>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.391+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fa1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml auth{0=1} v842 ap=1 s=2318 n(v0 rc2024-03-27T07:25:36.986812+0000 b2318 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac391600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fa1:[<0x20000000eaa/article-10.xml v298>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fa1:[<0x20000000eaa/article-10.xml v842>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.392+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000105b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg auth{0=1} v846 ap=1 s=44804 n(v0 rc2024-03-27T07:25:37.868795+0000 b44804 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac391b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000105b:[<0x20000000eaa/picture-12.jpg v580>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000105b:[<0x20000000eaa/picture-12.jpg v846>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.394+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fe6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-44.jpg auth{0=1} v834 ap=1 s=59963 n(v0 rc2024-03-27T07:25:37.308806+0000 b59963 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac392100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fe6:[<0x20000000eaa/picture-44.jpg v388>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fe6:[<0x20000000eaa/picture-44.jpg v834>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.394+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001600 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-50.xml auth{0=1} v1538 ap=1 s=7393 n(v0 rc2024-03-27T07:27:14.379896+0000 b7393 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac393180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001600:[<0x20000000eaa/comment-50.xml v1538>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001600:[<0x20000000eaa/comment-50.xml v1538>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.395+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ed8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-48.xml auth{0=1} v838 ap=1 s=21150 n(v0 rc2024-03-27T07:25:36.150829+0000 b21150 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac393700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ed8:[<0x20000000eaa/article-48.xml v70>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ed8:[<0x20000000eaa/article-48.xml v838>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.395+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000160a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-48.xml auth{0=1} v1536 ap=1 s=4203 n(v0 rc2024-03-27T07:27:14.423895+0000 b4203 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000160a:[<0x20000000eaa/comment-48.xml v1536>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000160a:[<0x20000000eaa/comment-48.xml v1536>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.395+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fbe [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml auth{0=1} v840 ap=1 s=6415 n(v0 rc2024-03-27T07:25:37.092810+0000 b6415 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fbe:[<0x20000000eaa/article-4.xml v334>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fbe:[<0x20000000eaa/article-4.xml v840>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.395+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml auth{0=1} v1266 ap=1 s=5005 n(v0 rc2024-03-27T07:26:32.077727+0000 b5005 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc3:[<0x20000000eaa/article-25.xml v994>,<0x10000000399/blog-24 v112234>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cc3:[<0x20000000eaa/article-25.xml v1266>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.395+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f0b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-38.xml auth{0=1} v860 ap=1 s=7580 n(v0 rc2024-03-27T07:25:36.352825+0000 b7580 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f0b:[<0x20000000eaa/article-38.xml v130>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f0b:[<0x20000000eaa/article-38.xml v860>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.396+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000163d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-31.xml auth{0=1} v1534 ap=1 s=6845 n(v0 rc2024-03-27T07:27:14.870887+0000 b6845 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000163d:[<0x20000000eaa/comment-31.xml v1534>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000163d:[<0x20000000eaa/comment-31.xml v1534>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.396+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001669 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-13.xml auth{0=1} v1593 ap=1 s=3972 n(v0 rc2024-03-27T07:27:15.541873+0000 b3972 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab592680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001669:[<0x20000000eaa/comment-13.xml v1593>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001669:[<0x20000000eaa/comment-13.xml v1593>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.396+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-21.xml auth{0=1} v1540 ap=1 s=3108 n(v0 rc2024-03-27T07:27:15.319878+0000 b3108 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab593700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165f:[<0x20000000eaa/comment-21.xml v1540>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000165f:[<0x20000000eaa/comment-21.xml v1540>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.396+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001659 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-26.xml auth{0=1} v1597 ap=1 s=4965 n(v0 rc2024-03-27T07:27:15.211880+0000 b4965 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7eeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001659:[<0x20000000eaa/comment-26.xml v1597>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001659:[<0x20000000eaa/comment-26.xml v1597>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.396+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a00 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-75.xml auth v929 ap=1 s=21692 n(v0 rc2024-03-27T07:26:05.360253+0000 b21692 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad7ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a00:[<0x20000000eaa/article-75.xml v918>,<0x10000000399/blog-24 v63059>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x10000000a00:[<0x20000000eaa/article-75.xml v929>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.396+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f14 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-37.xml auth{0=1} v874 ap=1 s=6438 n(v0 rc2024-03-27T07:25:36.389824+0000 b6438 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7ef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f14:[<0x20000000eaa/article-37.xml v136>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f14:[<0x20000000eaa/article-37.xml v874>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.396+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001021 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-27.jpg auth{0=1} v886 ap=1 s=58511 n(v0 rc2024-03-27T07:25:37.582800+0000 b58511 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7efb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001021:[<0x20000000eaa/picture-27.jpg v490>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001021:[<0x20000000eaa/picture-27.jpg v886>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.397+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f06 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-39.xml auth{0=1} v894 ap=1 s=9427 n(v0 rc2024-03-27T07:25:36.334825+0000 b9427 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7f0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f06:[<0x20000000eaa/article-39.xml v124>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f06:[<0x20000000eaa/article-39.xml v894>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.397+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000867 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-36.xml auth{0=1} v892 ap=1 s=32036 n(v0 rc2024-03-27T07:25:50.737541+0000 b32036 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7f0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000867:[<0x20000000eaa/article-36.xml v892>,<0x10000000399/blog-24 v50974>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000867:[<0x20000000eaa/article-36.xml v892>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.397+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f97 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml auth{0=1} v880 ap=1 s=24934 n(v0 rc2024-03-27T07:25:36.950813+0000 b24934 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7f0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f97:[<0x20000000eaa/article-12.xml v286>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f97:[<0x20000000eaa/article-12.xml v880>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.397+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fca [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml auth{0=1} v878 ap=1 s=19885 n(v0 rc2024-03-27T07:25:37.146809+0000 b19885 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7f1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fca:[<0x20000000eaa/article-1.xml v352>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fca:[<0x20000000eaa/article-1.xml v878>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.669 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.398+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001641 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-30.xml auth{0=1} v1599 ap=1 s=9007 n(v0 rc2024-03-27T07:27:14.897886+0000 b9007 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001641:[<0x20000000eaa/comment-30.xml v1599>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001641:[<0x20000000eaa/comment-30.xml v1599>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.398+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a07 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-34.jpg auth{0=1} v931 ap=1 s=60916 n(v0 rc2024-03-27T07:26:05.589249+0000 b60916 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf57080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a07:[<0x20000000eaa/picture-34.jpg v920>,<0x10000000399/blog-24 v63059>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x10000000a07:[<0x20000000eaa/picture-34.jpg v931>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.398+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016a8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-3.xml auth{0=1} v1589 ap=1 s=7462 n(v0 rc2024-03-27T07:27:15.902866+0000 b7462 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf58100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016a8:[<0x20000000eaa/comment-3.xml v1589>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016a8:[<0x20000000eaa/comment-3.xml v1589>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.398+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001662 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-18.xml auth{0=1} v1595 ap=1 s=3486 n(v0 rc2024-03-27T07:27:15.422876+0000 b3486 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf59180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001662:[<0x20000000eaa/comment-18.xml v1595>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001662:[<0x20000000eaa/comment-18.xml v1595>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.398+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000104c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg auth{0=1} v882 ap=1 s=11649 n(v0 rc2024-03-27T07:25:37.788796+0000 b11649 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf59700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000104c:[<0x20000000eaa/picture-16.jpg v556>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000104c:[<0x20000000eaa/picture-16.jpg v882>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.398+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000166b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-12.xml auth{0=1} v1591 ap=1 s=4044 n(v0 rc2024-03-27T07:27:15.556873+0000 b4044 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000166b:[<0x20000000eaa/comment-12.xml v1591>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000166b:[<0x20000000eaa/comment-12.xml v1591>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.399+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001605 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-49.xml auth{0=1} v1603 ap=1 s=3494 n(v0 rc2024-03-27T07:27:14.402896+0000 b3494 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd51b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001605:[<0x20000000eaa/comment-49.xml v1603>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001605:[<0x20000000eaa/comment-49.xml v1603>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.399+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000161d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-42.xml auth{0=1} v1601 ap=1 s=2111 n(v0 rc2024-03-27T07:27:14.533893+0000 b2111 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd53180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000161d:[<0x20000000eaa/comment-42.xml v1601>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000161d:[<0x20000000eaa/comment-42.xml v1601>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.399+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d81 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-87.xml auth{0=1} v1328 ap=1 s=8248 n(v0 rc2024-03-27T07:26:46.042452+0000 b8248 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd52100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d81:[<0x20000000eaa/comment-87.xml v1328>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d81:[<0x20000000eaa/comment-87.xml v1328>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.399+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f64 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml auth{0=1} v884 ap=1 s=17409 n(v0 rc2024-03-27T07:25:36.739817+0000 b17409 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acda2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f64:[<0x20000000eaa/article-23.xml v220>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f64:[<0x20000000eaa/article-23.xml v884>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.399+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f80 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml auth v766 ap=1 s=27003 n(v0 rc2024-03-27T07:25:36.847815+0000 b27003 1=1+0) caps={15291=pAsLsXsFscr/pFscr@11},l=15291 | request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a95b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f80:[<0x20000000eaa/article-17.xml v654>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f80:[<0x20000000eaa/article-17.xml v766>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.400+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f57 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-65.xml auth{0=1} v1607 ap=1 s=4224 n(v0 rc2024-03-27T07:26:59.310192+0000 b4224 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acda2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f57:[<0x20000000eaa/comment-65.xml v1357>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f57:[<0x20000000eaa/comment-65.xml v1607>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.400+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fd2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-48.jpg auth{0=1} v876 ap=1 s=45679 n(v0 rc2024-03-27T07:25:37.183808+0000 b45679 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acda3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fd2:[<0x20000000eaa/picture-48.jpg v364>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fd2:[<0x20000000eaa/picture-48.jpg v876>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.400+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015fa [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-51.xml auth{0=1} v1605 ap=1 s=8974 n(v0 rc2024-03-27T07:27:14.358897+0000 b8974 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acda4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015fa:[<0x20000000eaa/comment-51.xml v1605>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000015fa:[<0x20000000eaa/comment-51.xml v1605>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.400+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000100c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-32.jpg auth{0=1} v888 ap=1 s=35575 n(v0 rc2024-03-27T07:25:37.490802+0000 b35575 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acda2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000100c:[<0x20000000eaa/picture-32.jpg v460>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000100c:[<0x20000000eaa/picture-32.jpg v888>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.400+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-37.xml auth{0=1} v1584 ap=1 s=2651 n(v0 rc2024-03-27T07:27:14.689890+0000 b2651 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162a:[<0x20000000eaa/comment-37.xml v1584>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000162a:[<0x20000000eaa/comment-37.xml v1584>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.400+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e41 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-71.xml auth{0=1} v1323 ap=1 s=10214 n(v0 rc2024-03-27T07:26:47.437425+0000 b10214 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7d3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e41:[<0x20000000eaa/comment-71.xml v1323>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e41:[<0x20000000eaa/comment-71.xml v1323>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.401+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001063 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg auth{0=1} v864 ap=1 s=8311 n(v0 rc2024-03-27T07:25:37.896794+0000 b8311 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7d4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001063:[<0x20000000eaa/picture-10.jpg v592>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001063:[<0x20000000eaa/picture-10.jpg v864>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.401+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001664 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-16.xml auth{0=1} v1574 ap=1 s=7565 n(v0 rc2024-03-27T07:27:15.459875+0000 b7565 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7d5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001664:[<0x20000000eaa/comment-16.xml v1574>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001664:[<0x20000000eaa/comment-16.xml v1574>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.401+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fa6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml auth{0=1} v870 ap=1 s=10429 n(v0 rc2024-03-27T07:25:37.004812+0000 b10429 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafc4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fa6:[<0x20000000eaa/article-9.xml v304>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fa6:[<0x20000000eaa/article-9.xml v870>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.401+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-83.jpg auth v1309 ap=1 s=52696 n(v0 rc2024-03-27T07:26:32.068727+0000 b52696 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aafc4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc2:[<0x20000000eaa/picture-83.jpg v1000>,<0x10000000399/blog-24 v112234>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cc2:[<0x20000000eaa/picture-83.jpg v1309>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.401+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000eeb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-44.xml auth{0=1} v884 ap=1 s=30531 n(v0 rc2024-03-27T07:25:36.225827+0000 b30531 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafc4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000eeb:[<0x20000000eaa/article-44.xml v94>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000eeb:[<0x20000000eaa/article-44.xml v884>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.401+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001072 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg auth{0=1} v866 ap=1 s=44822 n(v0 rc2024-03-27T07:25:37.953793+0000 b44822 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafc5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001072:[<0x20000000eaa/picture-6.jpg v616>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001072:[<0x20000000eaa/picture-6.jpg v866>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.402+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f7c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-55.xml auth{0=1} v1588 ap=1 s=9005 n(v0 rc2024-03-27T07:26:59.837181+0000 b9005 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafc6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f7c:[<0x20000000eaa/comment-55.xml v1376>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f7c:[<0x20000000eaa/comment-55.xml v1588>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.402+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f74 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-58.xml auth{0=1} v1590 ap=1 s=2859 n(v0 rc2024-03-27T07:26:59.688184+0000 b2859 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafc5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f74:[<0x20000000eaa/comment-58.xml v1369>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f74:[<0x20000000eaa/comment-58.xml v1590>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.402+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f5f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml auth{0=1} v874 ap=1 s=25229 n(v0 rc2024-03-27T07:25:36.722817+0000 b25229 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafc6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f5f:[<0x20000000eaa/article-24.xml v214>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f5f:[<0x20000000eaa/article-24.xml v874>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.402+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001632 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-34.xml auth{0=1} v1582 ap=1 s=4853 n(v0 rc2024-03-27T07:27:14.771889+0000 b4853 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad94e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001632:[<0x20000000eaa/comment-34.xml v1582>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001632:[<0x20000000eaa/comment-34.xml v1582>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.402+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-25.xml auth{0=1} v1580 ap=1 s=3062 n(v0 rc2024-03-27T07:27:15.257879+0000 b3062 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad94f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165b:[<0x20000000eaa/comment-25.xml v1580>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000165b:[<0x20000000eaa/comment-25.xml v1580>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.403+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000101c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-28.jpg auth{0=1} v876 ap=1 s=56384 n(v0 rc2024-03-27T07:25:37.569801+0000 b56384 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad94f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000101c:[<0x20000000eaa/picture-28.jpg v484>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000101c:[<0x20000000eaa/picture-28.jpg v876>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.403+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-85.xml auth v890 ap=1 s=7179 n(v0 rc2024-03-27T07:25:44.816658+0000 b7179 1=1+0) | authpin=1 scrubqueue=0 0x5607ac529700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000072f:[<0x20000000eaa/article-85.xml v780>,<0x10000000399/blog-24 v50974>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000072f:[<0x20000000eaa/article-85.xml v890>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.403+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000161f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-41.xml auth{0=1} v1586 ap=1 s=4680 n(v0 rc2024-03-27T07:27:14.550893+0000 b4680 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad950680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000161f:[<0x20000000eaa/comment-41.xml v1586>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000161f:[<0x20000000eaa/comment-41.xml v1586>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.403+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e31 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-75.xml auth{0=1} v1315 ap=1 s=4113 n(v0 rc2024-03-27T07:26:47.119431+0000 b4113 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad950c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e31:[<0x20000000eaa/comment-75.xml v1315>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e31:[<0x20000000eaa/comment-75.xml v1315>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.403+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ffb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-37.jpg auth{0=1} v880 ap=1 s=25820 n(v0 rc2024-03-27T07:25:37.410804+0000 b25820 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad951180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ffb:[<0x20000000eaa/picture-37.jpg v430>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ffb:[<0x20000000eaa/picture-37.jpg v880>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.403+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fc1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml auth{0=1} v868 ap=1 s=13804 n(v0 rc2024-03-27T07:25:37.110810+0000 b13804 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad61e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fc1:[<0x20000000eaa/article-3.xml v340>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fc1:[<0x20000000eaa/article-3.xml v868>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.404+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000102c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-24.jpg auth v770 ap=1 s=23667 n(v0 rc2024-03-27T07:25:37.627800+0000 b23667 1=1+0) caps={15291=pAsLsXsFscr/pFscr@15},l=15291 | request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9118580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000102c:[<0x20000000eaa/picture-24.jpg v652>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000102c:[<0x20000000eaa/picture-24.jpg v770>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.672 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.404+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001048 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg auth{0=1} v872 ap=1 s=10016 n(v0 rc2024-03-27T07:25:37.773797+0000 b10016 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad951700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001048:[<0x20000000eaa/picture-17.jpg v550>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001048:[<0x20000000eaa/picture-17.jpg v872>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.404+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009fe [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-33.jpg auth{0=1} v934 ap=1 s=29239 n(v0 rc2024-03-27T07:26:05.327254+0000 b29239 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad61eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009fe:[<0x20000000eaa/picture-33.jpg v904>,<0x10000000399/blog-24 v63059>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x100000009fe:[<0x20000000eaa/picture-33.jpg v934>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.404+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fb0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml auth{0=1} v862 ap=1 s=27491 n(v0 rc2024-03-27T07:25:37.039811+0000 b27491 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad61f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fb0:[<0x20000000eaa/article-7.xml v316>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fb0:[<0x20000000eaa/article-7.xml v862>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.405+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fed [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-42.jpg auth v768 ap=1 s=31826 n(v0 rc2024-03-27T07:25:37.351805+0000 b31826 1=1+0) caps={15291=pAsLsXsFscr/pFscr@13},l=15291 | request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a7e2fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fed:[<0x20000000eaa/picture-42.jpg v650>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fed:[<0x20000000eaa/picture-42.jpg v768>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.405+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ff6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-39.jpg auth{0=1} v882 ap=1 s=25634 n(v0 rc2024-03-27T07:25:37.385804+0000 b25634 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad61f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ff6:[<0x20000000eaa/picture-39.jpg v418>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ff6:[<0x20000000eaa/picture-39.jpg v882>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.405+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-23.xml auth{0=1} v1576 ap=1 s=9842 n(v0 rc2024-03-27T07:27:15.281879+0000 b9842 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad620680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165d:[<0x20000000eaa/comment-23.xml v1576>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000165d:[<0x20000000eaa/comment-23.xml v1576>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.405+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-24.xml auth{0=1} v1578 ap=1 s=3883 n(v0 rc2024-03-27T07:27:15.267879+0000 b3883 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad621700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165c:[<0x20000000eaa/comment-24.xml v1578>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000165c:[<0x20000000eaa/comment-24.xml v1578>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.422+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f1f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml auth{0=1} v874 ap=1 s=3152 n(v0 rc2024-03-27T07:25:36.439823+0000 b3152 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9218000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f1f:[<0x20000000eaa/article-35.xml v148>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f1f:[<0x20000000eaa/article-35.xml v874>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.422+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001039 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-21.jpg auth{0=1} v884 ap=1 s=27195 n(v0 rc2024-03-27T07:25:37.690798+0000 b27195 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad96b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001039:[<0x20000000eaa/picture-21.jpg v526>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001039:[<0x20000000eaa/picture-21.jpg v884>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.422+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f6b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-60.xml auth{0=1} v1603 ap=1 s=3515 n(v0 rc2024-03-27T07:26:59.609186+0000 b3515 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9219080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f6b:[<0x20000000eaa/comment-60.xml v1366>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f6b:[<0x20000000eaa/comment-60.xml v1603>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.422+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e1c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-78.xml auth{0=1} v1343 ap=1 s=7644 n(v0 rc2024-03-27T07:26:46.971434+0000 b7644 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9219600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e1c:[<0x20000000eaa/comment-78.xml v1343>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e1c:[<0x20000000eaa/comment-78.xml v1343>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.422+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e39 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-73.xml auth{0=1} v1349 ap=1 s=8263 n(v0 rc2024-03-27T07:26:47.295427+0000 b8263 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9218580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e39:[<0x20000000eaa/comment-73.xml v1349>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e39:[<0x20000000eaa/comment-73.xml v1349>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.423+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016b6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-1.xml auth{0=1} v1591 ap=1 s=6336 n(v0 rc2024-03-27T07:27:15.985865+0000 b6336 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a921a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016b6:[<0x20000000eaa/comment-1.xml v1591>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016b6:[<0x20000000eaa/comment-1.xml v1591>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.423+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f01 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-40.xml auth{0=1} v888 ap=1 s=13916 n(v0 rc2024-03-27T07:25:36.316825+0000 b13916 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a921a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f01:[<0x20000000eaa/article-40.xml v118>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f01:[<0x20000000eaa/article-40.xml v888>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.424+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001014 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-30.jpg auth{0=1} v872 ap=1 s=15878 n(v0 rc2024-03-27T07:25:37.528802+0000 b15878 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a921ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001014:[<0x20000000eaa/picture-30.jpg v472>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001014:[<0x20000000eaa/picture-30.jpg v872>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.424+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d80 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-88.xml auth{0=1} v1332 ap=1 s=10048 n(v0 rc2024-03-27T07:26:46.006453+0000 b10048 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a921b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d80:[<0x20000000eaa/comment-88.xml v1332>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d80:[<0x20000000eaa/comment-88.xml v1332>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.424+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f89 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml auth{0=1} v878 ap=1 s=25633 n(v0 rc2024-03-27T07:25:36.883814+0000 b25633 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a921b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f89:[<0x20000000eaa/article-15.xml v268>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f89:[<0x20000000eaa/article-15.xml v878>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.424+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e18 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-79.xml auth{0=1} v1330 ap=1 s=3964 n(v0 rc2024-03-27T07:26:46.944434+0000 b3964 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad550000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e18:[<0x20000000eaa/comment-79.xml v1330>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e18:[<0x20000000eaa/comment-79.xml v1330>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.424+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001622 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-40.xml auth{0=1} v1599 ap=1 s=5875 n(v0 rc2024-03-27T07:27:14.570893+0000 b5875 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad550b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001622:[<0x20000000eaa/comment-40.xml v1599>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001622:[<0x20000000eaa/comment-40.xml v1599>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.424+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001635 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-33.xml auth{0=1} v1595 ap=1 s=9296 n(v0 rc2024-03-27T07:27:14.794888+0000 b9296 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad551600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001635:[<0x20000000eaa/comment-33.xml v1595>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001635:[<0x20000000eaa/comment-33.xml v1595>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.425+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001625 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-39.xml auth{0=1} v1597 ap=1 s=7037 n(v0 rc2024-03-27T07:27:14.612892+0000 b7037 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad552100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001625:[<0x20000000eaa/comment-39.xml v1597>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001625:[<0x20000000eaa/comment-39.xml v1597>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.425+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d82 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-86.xml auth{0=1} v1341 ap=1 s=3618 n(v0 rc2024-03-27T07:26:46.064452+0000 b3618 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad552680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d82:[<0x20000000eaa/comment-86.xml v1341>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d82:[<0x20000000eaa/comment-86.xml v1341>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.674 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.425+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ffe [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-36.jpg auth{0=1} v886 ap=1 s=31693 n(v0 rc2024-03-27T07:25:37.426804+0000 b31693 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad552c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ffe:[<0x20000000eaa/picture-36.jpg v436>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ffe:[<0x20000000eaa/picture-36.jpg v886>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.425+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fea [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-43.jpg auth{0=1} v892 ap=1 s=62616 n(v0 rc2024-03-27T07:25:37.332805+0000 b62616 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad553180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fea:[<0x20000000eaa/picture-43.jpg v394>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fea:[<0x20000000eaa/picture-43.jpg v892>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.425+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f77 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml auth{0=1} v880 ap=1 s=20653 n(v0 rc2024-03-27T07:25:36.807816+0000 b20653 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad553700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f77:[<0x20000000eaa/article-19.xml v244>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f77:[<0x20000000eaa/article-19.xml v880>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.425+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ad [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-89.xml auth v1613 ap=1 s=28280 n(v0 rc2024-03-27T07:27:07.155038+0000 b28280 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad554580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ad:[<0x20000000eaa/article-89.xml v1475>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000012ad:[<0x20000000eaa/article-89.xml v1613>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.426+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000103c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-20.jpg auth{0=1} v882 ap=1 s=57750 n(v0 rc2024-03-27T07:25:37.711798+0000 b57750 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad554000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000103c:[<0x20000000eaa/picture-20.jpg v532>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000103c:[<0x20000000eaa/picture-20.jpg v882>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.426+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-82.xml auth{0=1} v1331 ap=1 s=7164 n(v0 rc2024-03-27T07:26:46.167450+0000 b7164 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad554b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8c:[<0x20000000eaa/comment-82.xml v1331>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d8c:[<0x20000000eaa/comment-82.xml v1331>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.426+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001638 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-32.xml auth{0=1} v1593 ap=1 s=6849 n(v0 rc2024-03-27T07:27:14.843887+0000 b6849 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad555600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001638:[<0x20000000eaa/comment-32.xml v1593>,<0x10000000399/blog-24 v121359>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001638:[<0x20000000eaa/comment-32.xml v1593>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.426+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f60 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-63.xml auth{0=1} v1605 ap=1 s=3025 n(v0 rc2024-03-27T07:26:59.421189+0000 b3025 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad556100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f60:[<0x20000000eaa/comment-63.xml v1361>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f60:[<0x20000000eaa/comment-63.xml v1605>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.426+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f7e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-54.xml auth{0=1} v1601 ap=1 s=5980 n(v0 rc2024-03-27T07:26:59.873181+0000 b5980 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad556c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f7e:[<0x20000000eaa/comment-54.xml v1371>,<0x10000000399/blog-24 v117253>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f7e:[<0x20000000eaa/comment-54.xml v1601>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.426+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ef6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-42.xml auth{0=1} v890 ap=1 s=32013 n(v0 rc2024-03-27T07:25:36.270826+0000 b32013 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad557180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ef6:[<0x20000000eaa/article-42.xml v106>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ef6:[<0x20000000eaa/article-42.xml v890>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.427+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-91.xml auth{0=1} v1335 ap=1 s=4987 n(v0 rc2024-03-27T07:26:45.920454+0000 b4987 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad557700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7c:[<0x20000000eaa/comment-91.xml v1335>,<0x10000000399/blog-24 v113829>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d7c:[<0x20000000eaa/comment-91.xml v1335>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.427+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ff9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-38.jpg auth{0=1} v876 ap=1 s=56174 n(v0 rc2024-03-27T07:25:37.399804+0000 b56174 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad812000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ff9:[<0x20000000eaa/picture-38.jpg v424>,<0x10000000399/blog-24 v31031>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ff9:[<0x20000000eaa/picture-38.jpg v876>,<0x10000000399/blog-24 v129765>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.535+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c98 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-13.jpg auth{0=1} v891 ap=1 s=48194 n(v0 rc2024-03-27T07:26:27.337821+0000 b48194 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab33f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c98:[<0x20000002ef1/picture-13.jpg v690>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c98:[<0x20000002ef1/picture-13.jpg v891>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.536+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001980 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-56.xml auth{0=1} v1058 ap=1 s=9520 n(v0 rc2024-03-27T07:27:22.588735+0000 b9520 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab340000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001980:[<0x20000002ef1/comment-56.xml v1058>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001980:[<0x20000002ef1/comment-56.xml v1058>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.536+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c93 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-18.jpg auth{0=1} v895 ap=1 s=35986 n(v0 rc2024-03-27T07:26:26.856830+0000 b35986 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab340580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c93:[<0x20000002ef1/picture-18.jpg v660>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c93:[<0x20000002ef1/picture-18.jpg v895>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.537+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f41 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-18.xml auth{0=1} v875 ap=1 s=32161 n(v0 rc2024-03-27T07:26:23.129903+0000 b32161 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab340b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f41:[<0x20000002ef1/article-18.xml v168>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f41:[<0x20000002ef1/article-18.xml v875>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.538+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ce [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-5.xml auth{0=1} v1050 ap=1 s=2307 n(v0 rc2024-03-27T07:27:24.253703+0000 b2307 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab341080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ce:[<0x20000002ef1/comment-5.xml v1050>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ce:[<0x20000002ef1/comment-5.xml v1050>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.541+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c92 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-19.jpg auth{0=1} v897 ap=1 s=33268 n(v0 rc2024-03-27T07:26:26.675834+0000 b33268 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab341600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c92:[<0x20000002ef1/picture-19.jpg v654>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c92:[<0x20000002ef1/picture-19.jpg v897>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.542+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019b4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-29.xml auth{0=1} v1056 ap=1 s=3632 n(v0 rc2024-03-27T07:27:23.137725+0000 b3632 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab341b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019b4:[<0x20000002ef1/comment-29.xml v1056>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019b4:[<0x20000002ef1/comment-29.xml v1056>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.543+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f7b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-82.jpg auth v901 ap=1 s=52891 n(v0 rc2024-03-27T07:26:23.375899+0000 b52891 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab342100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f7b:[<0x20000002ef1/picture-82.jpg v276>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f7b:[<0x20000002ef1/picture-82.jpg v901>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.543+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f26 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-27.xml auth{0=1} v879 ap=1 s=25786 n(v0 rc2024-03-27T07:26:22.903908+0000 b25786 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab342680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f26:[<0x20000002ef1/article-27.xml v112>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f26:[<0x20000002ef1/article-27.xml v879>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.546+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-4.jpg auth{0=1} v905 ap=1 s=59327 n(v0 rc2024-03-27T07:26:29.582776+0000 b59327 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab342c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb7:[<0x20000002ef1/picture-4.jpg v851>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb7:[<0x20000002ef1/picture-4.jpg v905>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.547+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000300a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-35.jpg auth{0=1} v883 ap=1 s=45479 n(v0 rc2024-03-27T07:26:23.944887+0000 b45479 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab343180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000300a:[<0x20000002ef1/picture-35.jpg v558>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000300a:[<0x20000002ef1/picture-35.jpg v883>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.676 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.549+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-2.jpg auth{0=1} v903 ap=1 s=55051 n(v0 rc2024-03-27T07:26:29.652775+0000 b55051 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab343700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb9:[<0x20000002ef1/picture-2.jpg v863>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb9:[<0x20000002ef1/picture-2.jpg v903>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.549+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f87 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-78.jpg auth v899 ap=1 s=60342 n(v0 rc2024-03-27T07:26:23.400898+0000 b60342 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aae76000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f87:[<0x20000002ef1/picture-78.jpg v300>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f87:[<0x20000002ef1/picture-78.jpg v899>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.552+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-93.jpg auth v1061 ap=1 s=22452 n(v0 rc2024-03-27T07:27:17.772830+0000 b22452 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aae76580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d1:[<0x20000002ef1/picture-93.jpg v919>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017d1:[<0x20000002ef1/picture-93.jpg v1061>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.553+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f3b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-20.xml auth{0=1} v877 ap=1 s=31532 n(v0 rc2024-03-27T07:26:23.087904+0000 b31532 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae76b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f3b:[<0x20000002ef1/article-20.xml v156>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f3b:[<0x20000002ef1/article-20.xml v877>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.555+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c97 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-14.jpg auth{0=1} v893 ap=1 s=8773 n(v0 rc2024-03-27T07:26:27.253822+0000 b8773 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae77080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c97:[<0x20000002ef1/picture-14.jpg v684>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c97:[<0x20000002ef1/picture-14.jpg v893>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.555+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002efe [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-41.xml auth{0=1} v885 ap=1 s=20063 n(v0 rc2024-03-27T07:26:22.596914+0000 b20063 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae77600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002efe:[<0x20000002ef1/article-41.xml v28>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002efe:[<0x20000002ef1/article-41.xml v885>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.558+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014dc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-45.xml auth{0=1} v1048 ap=1 s=9029 n(v0 rc2024-03-27T07:27:11.542952+0000 b9029 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae78100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014dc:[<0x20000002ef1/article-45.xml v914>,<0x10000000399/blog-84 v116262>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000014dc:[<0x20000002ef1/article-45.xml v1048>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.559+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fbb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-61.jpg auth v909 ap=1 s=25402 n(v0 rc2024-03-27T07:26:23.578895+0000 b25402 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aae78680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fbb:[<0x20000002ef1/picture-61.jpg v402>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fbb:[<0x20000002ef1/picture-61.jpg v909>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.561+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-7.jpg auth{0=1} v907 ap=1 s=51459 n(v0 rc2024-03-27T07:26:29.007788+0000 b51459 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae78c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca4:[<0x20000002ef1/picture-7.jpg v829>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ca4:[<0x20000002ef1/picture-7.jpg v907>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.561+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f1c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-31.xml auth{0=1} v881 ap=1 s=14549 n(v0 rc2024-03-27T07:26:22.748911+0000 b14549 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae79180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f1c:[<0x20000002ef1/article-31.xml v88>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f1c:[<0x20000002ef1/article-31.xml v881>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.565+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-9.jpg auth{0=1} v889 ap=1 s=53562 n(v0 rc2024-03-27T07:26:28.775792+0000 b53562 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae79700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca0:[<0x20000002ef1/picture-9.jpg v817>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ca0:[<0x20000002ef1/picture-9.jpg v889>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.565+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019c8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-11.xml auth{0=1} v1052 ap=1 s=7230 n(v0 rc2024-03-27T07:27:24.138705+0000 b7230 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae7a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019c8:[<0x20000002ef1/comment-11.xml v1052>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019c8:[<0x20000002ef1/comment-11.xml v1052>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.566+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019bd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-20.xml auth{0=1} v1054 ap=1 s=5143 n(v0 rc2024-03-27T07:27:23.295722+0000 b5143 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae7a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019bd:[<0x20000002ef1/comment-20.xml v1054>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019bd:[<0x20000002ef1/comment-20.xml v1054>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.567+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fb2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-64.jpg auth v911 ap=1 s=50095 n(v0 rc2024-03-27T07:26:23.547895+0000 b50095 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aa553180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fb2:[<0x20000002ef1/picture-64.jpg v384>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fb2:[<0x20000002ef1/picture-64.jpg v911>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.567+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019a7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-37.xml auth{0=1} v1055 ap=1 s=8729 n(v0 rc2024-03-27T07:27:22.961728+0000 b8729 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa726100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019a7:[<0x20000002ef1/comment-37.xml v1055>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019a7:[<0x20000002ef1/comment-37.xml v1055>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.569+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001955 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-71.xml auth{0=1} v1063 ap=1 s=7125 n(v0 rc2024-03-27T07:27:22.170744+0000 b7125 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7501180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001955:[<0x20000002ef1/comment-71.xml v1063>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001955:[<0x20000002ef1/comment-71.xml v1063>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.570+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c9d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-10.jpg auth{0=1} v901 ap=1 s=58459 n(v0 rc2024-03-27T07:26:28.586796+0000 b58459 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa334c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c9d:[<0x20000002ef1/picture-10.jpg v811>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000c9d:[<0x20000002ef1/picture-10.jpg v901>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.570+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cba [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-1.jpg auth{0=1} v907 ap=1 s=41197 n(v0 rc2024-03-27T07:26:29.661775+0000 b41197 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac487080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cba:[<0x20000002ef1/picture-1.jpg v869>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cba:[<0x20000002ef1/picture-1.jpg v907>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.572+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019c2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-16.xml auth{0=1} v1045 ap=1 s=5786 n(v0 rc2024-03-27T07:27:23.354720+0000 b5786 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a73f1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019c2:[<0x20000002ef1/comment-16.xml v1045>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019c2:[<0x20000002ef1/comment-16.xml v1045>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.572+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f5e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-9.xml auth{0=1} v881 ap=1 s=22081 n(v0 rc2024-03-27T07:26:23.300900+0000 b22081 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6acb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f5e:[<0x20000002ef1/article-9.xml v222>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f5e:[<0x20000002ef1/article-9.xml v881>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.678 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.572+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ef5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-44.xml auth{0=1} v893 ap=1 s=18531 n(v0 rc2024-03-27T07:26:22.558915+0000 b18531 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8d62580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ef5:[<0x20000002ef1/article-44.xml v10>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ef5:[<0x20000002ef1/article-44.xml v893>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.575+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-6.jpg auth{0=1} v837 ap=1 s=61987 n(v0 rc2024-03-27T07:26:29.111786+0000 b61987 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9a54b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca6:[<0x20000002ef1/picture-6.jpg v837>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ca6:[<0x20000002ef1/picture-6.jpg v837>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.575+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000197b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-58.xml auth{0=1} v1061 ap=1 s=2580 n(v0 rc2024-03-27T07:27:22.565736+0000 b2580 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa343b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000197b:[<0x20000002ef1/comment-58.xml v1061>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000197b:[<0x20000002ef1/comment-58.xml v1061>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.575+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001982 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-55.xml auth{0=1} v1059 ap=1 s=6554 n(v0 rc2024-03-27T07:27:22.602735+0000 b6554 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9a04b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001982:[<0x20000002ef1/comment-55.xml v1059>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001982:[<0x20000002ef1/comment-55.xml v1059>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.577+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f2d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-24.xml auth{0=1} v883 ap=1 s=29881 n(v0 rc2024-03-27T07:26:22.953907+0000 b29881 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a827c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f2d:[<0x20000002ef1/article-24.xml v130>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f2d:[<0x20000002ef1/article-24.xml v883>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.577+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ad [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-34.xml auth{0=1} v1053 ap=1 s=6550 n(v0 rc2024-03-27T07:27:23.074726+0000 b6550 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a74bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ad:[<0x20000002ef1/comment-34.xml v1053>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ad:[<0x20000002ef1/comment-34.xml v1053>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.578+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019b8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-25.xml auth{0=1} v1051 ap=1 s=5447 n(v0 rc2024-03-27T07:27:23.200723+0000 b5447 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7d82c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019b8:[<0x20000002ef1/comment-25.xml v1051>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019b8:[<0x20000002ef1/comment-25.xml v1051>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.581+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000301e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-28.jpg auth{0=1} v899 ap=1 s=24315 n(v0 rc2024-03-27T07:26:24.022886+0000 b24315 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a72bc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000301e:[<0x20000002ef1/picture-28.jpg v600>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000301e:[<0x20000002ef1/picture-28.jpg v899>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.582+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019a1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-41.xml auth{0=1} v1057 ap=1 s=5752 n(v0 rc2024-03-27T07:27:22.892729+0000 b5752 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8451b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019a1:[<0x20000002ef1/comment-41.xml v1057>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019a1:[<0x20000002ef1/comment-41.xml v1057>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.583+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001940 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-75.xml auth{0=1} v1065 ap=1 s=9671 n(v0 rc2024-03-27T07:27:22.025746+0000 b9671 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adfaab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001940:[<0x20000002ef1/comment-75.xml v1065>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001940:[<0x20000002ef1/comment-75.xml v1065>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.583+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003004 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-37.jpg auth{0=1} v887 ap=1 s=54581 n(v0 rc2024-03-27T07:26:23.921888+0000 b54581 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7a78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000003004:[<0x20000002ef1/picture-37.jpg v546>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000003004:[<0x20000002ef1/picture-37.jpg v887>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.584+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c94 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-17.jpg auth{0=1} v903 ap=1 s=38938 n(v0 rc2024-03-27T07:26:26.973828+0000 b38938 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aab97b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c94:[<0x20000002ef1/picture-17.jpg v666>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c94:[<0x20000002ef1/picture-17.jpg v903>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.585+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f72 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-3.xml auth{0=1} v895 ap=1 s=7364 n(v0 rc2024-03-27T07:26:23.357899+0000 b7364 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab76e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f72:[<0x20000002ef1/article-3.xml v258>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f72:[<0x20000002ef1/article-3.xml v895>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.585+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c89 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-24.jpg auth{0=1} v897 ap=1 s=22683 n(v0 rc2024-03-27T07:26:25.653854+0000 b22683 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7e5b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c89:[<0x20000002ef1/picture-24.jpg v624>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c89:[<0x20000002ef1/picture-24.jpg v897>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.585+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003010 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-33.jpg auth{0=1} v885 ap=1 s=14081 n(v0 rc2024-03-27T07:26:23.962887+0000 b14081 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a911a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000003010:[<0x20000002ef1/picture-33.jpg v570>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000003010:[<0x20000002ef1/picture-33.jpg v885>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.588+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fc7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-57.jpg auth v905 ap=1 s=48296 n(v0 rc2024-03-27T07:26:23.617894+0000 b48296 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8c27180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fc7:[<0x20000002ef1/picture-57.jpg v426>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fc7:[<0x20000002ef1/picture-57.jpg v905>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.588+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f64 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-7.xml auth{0=1} v879 ap=1 s=24701 n(v0 rc2024-03-27T07:26:23.311900+0000 b24701 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ada16680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f64:[<0x20000002ef1/article-7.xml v234>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f64:[<0x20000002ef1/article-7.xml v879>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.589+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fa6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-68.jpg auth v909 ap=1 s=55411 n(v0 rc2024-03-27T07:26:23.505896+0000 b55411 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a74d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fa6:[<0x20000002ef1/picture-68.jpg v360>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fa6:[<0x20000002ef1/picture-68.jpg v909>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.590+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ffe [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-39.jpg auth{0=1} v889 ap=1 s=53381 n(v0 rc2024-03-27T07:26:23.906888+0000 b53381 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a97d5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ffe:[<0x20000002ef1/picture-39.jpg v534>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ffe:[<0x20000002ef1/picture-39.jpg v889>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.590+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ba [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-23.xml auth{0=1} v1047 ap=1 s=7427 n(v0 rc2024-03-27T07:27:23.246723+0000 b7427 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa662680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ba:[<0x20000002ef1/comment-23.xml v1047>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ba:[<0x20000002ef1/comment-23.xml v1047>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.590+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019b9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-24.xml auth{0=1} v1049 ap=1 s=5925 n(v0 rc2024-03-27T07:27:23.222723+0000 b5925 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa00e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019b9:[<0x20000002ef1/comment-24.xml v1049>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019b9:[<0x20000002ef1/comment-24.xml v1049>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.591+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000302d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-25.jpg auth{0=1} v889 ap=1 s=55437 n(v0 rc2024-03-27T07:26:24.296880+0000 b55437 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf35600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000302d:[<0x20000002ef1/picture-25.jpg v618>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000302d:[<0x20000002ef1/picture-25.jpg v889>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.591+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f61 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-8.xml auth{0=1} v875 ap=1 s=17774 n(v0 rc2024-03-27T07:26:23.305900+0000 b17774 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf35b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f61:[<0x20000002ef1/article-8.xml v228>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f61:[<0x20000002ef1/article-8.xml v875>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.591+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001997 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-47.xml auth{0=1} v1053 ap=1 s=8569 n(v0 rc2024-03-27T07:27:22.786732+0000 b8569 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf36100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001997:[<0x20000002ef1/comment-47.xml v1053>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001997:[<0x20000002ef1/comment-47.xml v1053>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.591+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001999 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-46.xml auth{0=1} v1051 ap=1 s=8888 n(v0 rc2024-03-27T07:27:22.802731+0000 b8888 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf36680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001999:[<0x20000002ef1/comment-46.xml v1051>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001999:[<0x20000002ef1/comment-46.xml v1051>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.591+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003016 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-31.jpg auth{0=1} v895 ap=1 s=10782 n(v0 rc2024-03-27T07:26:23.981887+0000 b10782 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf36c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000003016:[<0x20000002ef1/picture-31.jpg v582>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000003016:[<0x20000002ef1/picture-31.jpg v895>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.591+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000195a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-70.xml auth{0=1} v1061 ap=1 s=2469 n(v0 rc2024-03-27T07:27:22.246742+0000 b2469 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf37180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000195a:[<0x20000002ef1/comment-70.xml v1061>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000195a:[<0x20000002ef1/comment-70.xml v1061>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.592+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fdf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-49.jpg auth v899 ap=1 s=28626 n(v0 rc2024-03-27T07:26:23.747891+0000 b28626 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607abf37700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fdf:[<0x20000002ef1/picture-49.jpg v474>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fdf:[<0x20000002ef1/picture-49.jpg v899>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.592+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-8.jpg auth{0=1} v897 ap=1 s=56136 n(v0 rc2024-03-27T07:26:28.930789+0000 b56136 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb0e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca2:[<0x20000002ef1/picture-8.jpg v823>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ca2:[<0x20000002ef1/picture-8.jpg v897>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.592+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003024 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-26.jpg auth{0=1} v891 ap=1 s=10666 n(v0 rc2024-03-27T07:26:24.107884+0000 b10666 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb0e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000003024:[<0x20000002ef1/picture-26.jpg v612>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000003024:[<0x20000002ef1/picture-26.jpg v891>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.592+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f19 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-32.xml auth{0=1} v883 ap=1 s=11892 n(v0 rc2024-03-27T07:26:22.714912+0000 b11892 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb0eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f19:[<0x20000002ef1/article-32.xml v82>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f19:[<0x20000002ef1/article-32.xml v883>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.592+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001922 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-83.xml auth{0=1} v1067 ap=1 s=8341 n(v0 rc2024-03-27T07:27:21.859750+0000 b8341 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb0f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001922:[<0x20000002ef1/comment-83.xml v1067>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001922:[<0x20000002ef1/comment-83.xml v1067>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.592+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000195c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-69.xml auth{0=1} v1059 ap=1 s=2804 n(v0 rc2024-03-27T07:27:22.335740+0000 b2804 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb0f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000195c:[<0x20000002ef1/comment-69.xml v1059>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000195c:[<0x20000002ef1/comment-69.xml v1059>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.593+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f1f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-30.xml auth{0=1} v881 ap=1 s=31566 n(v0 rc2024-03-27T07:26:22.865909+0000 b31566 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb10100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f1f:[<0x20000002ef1/article-30.xml v94>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f1f:[<0x20000002ef1/article-30.xml v881>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.593+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001946 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-74.xml auth{0=1} v1065 ap=1 s=2263 n(v0 rc2024-03-27T07:27:22.085745+0000 b2263 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb10c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001946:[<0x20000002ef1/comment-74.xml v1065>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001946:[<0x20000002ef1/comment-74.xml v1065>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.593+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019a8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-36.xml auth{0=1} v1049 ap=1 s=7325 n(v0 rc2024-03-27T07:27:22.986728+0000 b7325 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb11180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019a8:[<0x20000002ef1/comment-36.xml v1049>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019a8:[<0x20000002ef1/comment-36.xml v1049>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.593+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000196f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-64.xml auth{0=1} v1055 ap=1 s=5129 n(v0 rc2024-03-27T07:27:22.459738+0000 b5129 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb12000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000196f:[<0x20000002ef1/comment-64.xml v1055>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000196f:[<0x20000002ef1/comment-64.xml v1055>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.594+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001950 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-72.xml auth{0=1} v1063 ap=1 s=7862 n(v0 rc2024-03-27T07:27:22.145744+0000 b7862 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb12580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001950:[<0x20000002ef1/comment-72.xml v1063>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001950:[<0x20000002ef1/comment-72.xml v1063>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.594+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019cf [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-4.xml auth{0=1} v1043 ap=1 s=6157 n(v0 rc2024-03-27T07:27:24.283702+0000 b6157 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb12b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019cf:[<0x20000002ef1/comment-4.xml v1043>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019cf:[<0x20000002ef1/comment-4.xml v1043>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.600+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f53 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-13.xml auth{0=1} v877 ap=1 s=10040 n(v0 rc2024-03-27T07:26:23.271901+0000 b10040 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb11700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f53:[<0x20000002ef1/article-13.xml v198>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f53:[<0x20000002ef1/article-13.xml v877>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.602+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f38 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-21.xml auth{0=1} v879 ap=1 s=12575 n(v0 rc2024-03-27T07:26:23.049905+0000 b12575 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb0fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f38:[<0x20000002ef1/article-21.xml v150>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f38:[<0x20000002ef1/article-21.xml v879>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.602+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001911 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-89.xml auth{0=1} v1069 ap=1 s=4907 n(v0 rc2024-03-27T07:27:21.771751+0000 b4907 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb10680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001911:[<0x20000002ef1/comment-89.xml v1069>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001911:[<0x20000002ef1/comment-89.xml v1069>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.603+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f67 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-6.xml auth{0=1} v887 ap=1 s=14471 n(v0 rc2024-03-27T07:26:23.321900+0000 b14471 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb13080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f67:[<0x20000002ef1/article-6.xml v240>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f67:[<0x20000002ef1/article-6.xml v887>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.603+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f75 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-2.xml auth{0=1} v885 ap=1 s=8764 n(v0 rc2024-03-27T07:26:23.363899+0000 b8764 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb13600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f75:[<0x20000002ef1/article-2.xml v264>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f75:[<0x20000002ef1/article-2.xml v885>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.603+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001964 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-67.xml auth{0=1} v1057 ap=1 s=9489 n(v0 rc2024-03-27T07:27:22.381739+0000 b9489 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb14100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001964:[<0x20000002ef1/comment-67.xml v1057>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001964:[<0x20000002ef1/comment-67.xml v1057>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.603+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000301b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-29.jpg auth{0=1} v893 ap=1 s=64547 n(v0 rc2024-03-27T07:26:24.007886+0000 b64547 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb14c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000301b:[<0x20000002ef1/picture-29.jpg v594>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000301b:[<0x20000002ef1/picture-29.jpg v893>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.603+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fd0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-54.jpg auth v901 ap=1 s=43101 n(v0 rc2024-03-27T07:26:23.646893+0000 b43101 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acb14680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fd0:[<0x20000002ef1/picture-54.jpg v444>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fd0:[<0x20000002ef1/picture-54.jpg v901>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.604+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019be [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-19.xml auth{0=1} v1047 ap=1 s=5371 n(v0 rc2024-03-27T07:27:23.305721+0000 b5371 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb15180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019be:[<0x20000002ef1/comment-19.xml v1047>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019be:[<0x20000002ef1/comment-19.xml v1047>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.604+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019bb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-22.xml auth{0=1} v1057 ap=1 s=5322 n(v0 rc2024-03-27T07:27:23.263722+0000 b5322 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a883bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019bb:[<0x20000002ef1/comment-22.xml v1057>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019bb:[<0x20000002ef1/comment-22.xml v1057>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.604+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000199e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-44.xml auth{0=1} v1063 ap=1 s=5249 n(v0 rc2024-03-27T07:27:22.850730+0000 b5249 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9533700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000199e:[<0x20000002ef1/comment-44.xml v1063>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000199e:[<0x20000002ef1/comment-44.xml v1063>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.604+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019d1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-2.xml auth{0=1} v1047 ap=1 s=3617 n(v0 rc2024-03-27T07:27:24.316702+0000 b3617 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a6004b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019d1:[<0x20000002ef1/comment-2.xml v1047>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019d1:[<0x20000002ef1/comment-2.xml v1047>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.604+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ef8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-43.xml auth{0=1} v884 ap=1 s=14796 n(v0 rc2024-03-27T07:26:22.570914+0000 b14796 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaed4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ef8:[<0x20000002ef1/article-43.xml v16>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ef8:[<0x20000002ef1/article-43.xml v884>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.604+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f16 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-33.xml auth{0=1} v882 ap=1 s=27529 n(v0 rc2024-03-27T07:26:22.700912+0000 b27529 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aabea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f16:[<0x20000002ef1/article-33.xml v76>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f16:[<0x20000002ef1/article-33.xml v882>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.605+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-5.jpg auth{0=1} v845 ap=1 s=37110 n(v0 rc2024-03-27T07:26:29.261783+0000 b37110 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a772c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca8:[<0x20000002ef1/picture-5.jpg v845>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ca8:[<0x20000002ef1/picture-5.jpg v845>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.605+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f7e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-81.jpg auth v888 ap=1 s=59662 n(v0 rc2024-03-27T07:26:23.382898+0000 b59662 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aa961080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f7e:[<0x20000002ef1/picture-81.jpg v282>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f7e:[<0x20000002ef1/picture-81.jpg v888>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.605+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000193a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-76.xml auth{0=1} v1071 ap=1 s=2932 n(v0 rc2024-03-27T07:27:21.997747+0000 b2932 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a94dc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000193a:[<0x20000002ef1/comment-76.xml v1071>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000193a:[<0x20000002ef1/comment-76.xml v1071>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.683 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.606+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fc4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-58.jpg auth v896 ap=1 s=38148 n(v0 rc2024-03-27T07:26:23.609894+0000 b38148 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a7eb6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fc4:[<0x20000002ef1/picture-58.jpg v420>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fc4:[<0x20000002ef1/picture-58.jpg v896>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.607+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019c5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-14.xml auth{0=1} v1045 ap=1 s=3218 n(v0 rc2024-03-27T07:27:23.394720+0000 b3218 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb13b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019c5:[<0x20000002ef1/comment-14.xml v1045>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019c5:[<0x20000002ef1/comment-14.xml v1045>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.608+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fdc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-50.jpg auth v894 ap=1 s=57440 n(v0 rc2024-03-27T07:26:23.728892+0000 b57440 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a88bd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fdc:[<0x20000002ef1/picture-50.jpg v468>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fdc:[<0x20000002ef1/picture-50.jpg v894>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.609+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019b6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-27.xml auth{0=1} v1059 ap=1 s=10062 n(v0 rc2024-03-27T07:27:23.166724+0000 b10062 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7af5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019b6:[<0x20000002ef1/comment-27.xml v1059>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019b6:[<0x20000002ef1/comment-27.xml v1059>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.610+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001988 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-52.xml auth{0=1} v1067 ap=1 s=9161 n(v0 rc2024-03-27T07:27:22.693733+0000 b9161 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a74b7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001988:[<0x20000002ef1/comment-52.xml v1067>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001988:[<0x20000002ef1/comment-52.xml v1067>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.610+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001969 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-66.xml auth{0=1} v1069 ap=1 s=3323 n(v0 rc2024-03-27T07:27:22.409739+0000 b3323 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8f22100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001969:[<0x20000002ef1/comment-66.xml v1069>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001969:[<0x20000002ef1/comment-66.xml v1069>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.610+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019cc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-7.xml auth{0=1} v1049 ap=1 s=3127 n(v0 rc2024-03-27T07:27:24.211704+0000 b3127 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8f11700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019cc:[<0x20000002ef1/comment-7.xml v1049>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019cc:[<0x20000002ef1/comment-7.xml v1049>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.611+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ea2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-79.xml auth v908 ap=1 s=18251 n(v0 rc2024-03-27T07:26:48.638401+0000 b18251 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a732a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ea2:[<0x20000002ef1/article-79.xml v908>,<0x10000000399/blog-84 v115576>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000ea2:[<0x20000002ef1/article-79.xml v908>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.611+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019c4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-15.xml auth{0=1} v1053 ap=1 s=7109 n(v0 rc2024-03-27T07:27:23.376720+0000 b7109 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7193080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019c4:[<0x20000002ef1/comment-15.xml v1053>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019c4:[<0x20000002ef1/comment-15.xml v1053>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.612+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d07 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-57.xml auth v904 ap=1 s=5255 n(v0 rc2024-03-27T07:26:45.035472+0000 b5255 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8a18000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d07:[<0x20000002ef1/article-57.xml v904>,<0x10000000399/blog-84 v115576>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d07:[<0x20000002ef1/article-57.xml v904>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.614+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019c0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-17.xml auth{0=1} v1055 ap=1 s=8436 n(v0 rc2024-03-27T07:27:23.344721+0000 b8436 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab956000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019c0:[<0x20000002ef1/comment-17.xml v1055>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019c0:[<0x20000002ef1/comment-17.xml v1055>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.614+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f24 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-28.xml auth{0=1} v880 ap=1 s=4988 n(v0 rc2024-03-27T07:26:22.884908+0000 b4988 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa4f6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f24:[<0x20000002ef1/article-28.xml v106>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f24:[<0x20000002ef1/article-28.xml v880>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.617+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ca [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-9.xml auth{0=1} v1051 ap=1 s=7602 n(v0 rc2024-03-27T07:27:24.169704+0000 b7602 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abc5eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ca:[<0x20000002ef1/comment-9.xml v1051>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ca:[<0x20000002ef1/comment-9.xml v1051>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.618+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002faf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-65.jpg auth v902 ap=1 s=61758 n(v0 rc2024-03-27T07:26:23.538895+0000 b61758 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8a10c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002faf:[<0x20000002ef1/picture-65.jpg v378>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002faf:[<0x20000002ef1/picture-65.jpg v902>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.618+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f8b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-77.jpg auth v890 ap=1 s=18078 n(v0 rc2024-03-27T07:26:23.409898+0000 b18078 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab5d4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f8b:[<0x20000002ef1/picture-77.jpg v306>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f8b:[<0x20000002ef1/picture-77.jpg v890>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.619+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000199f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-43.xml auth{0=1} v1061 ap=1 s=4646 n(v0 rc2024-03-27T07:27:22.863730+0000 b4646 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a925a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000199f:[<0x20000002ef1/comment-43.xml v1061>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000199f:[<0x20000002ef1/comment-43.xml v1061>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.621+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fa3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-69.jpg auth v900 ap=1 s=16549 n(v0 rc2024-03-27T07:26:23.495896+0000 b16549 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab5f0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fa3:[<0x20000002ef1/picture-69.jpg v354>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fa3:[<0x20000002ef1/picture-69.jpg v900>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.621+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fd9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-51.jpg auth v892 ap=1 s=52519 n(v0 rc2024-03-27T07:26:23.688892+0000 b52519 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab579080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fd9:[<0x20000002ef1/picture-51.jpg v462>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fd9:[<0x20000002ef1/picture-51.jpg v892>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.622+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000199c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-45.xml auth{0=1} v1065 ap=1 s=6340 n(v0 rc2024-03-27T07:27:22.825731+0000 b6340 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab8f1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000199c:[<0x20000002ef1/comment-45.xml v1065>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000199c:[<0x20000002ef1/comment-45.xml v1065>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.622+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000191f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-84.xml auth{0=1} v1073 ap=1 s=4498 n(v0 rc2024-03-27T07:27:21.848750+0000 b4498 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aad78c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000191f:[<0x20000002ef1/comment-84.xml v1073>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000191f:[<0x20000002ef1/comment-84.xml v1073>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.623+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fb8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-62.jpg auth v898 ap=1 s=11344 n(v0 rc2024-03-27T07:26:23.567895+0000 b11344 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a71ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fb8:[<0x20000002ef1/picture-62.jpg v396>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fb8:[<0x20000002ef1/picture-62.jpg v898>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.624+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fe8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-46.jpg auth{0=1} v886 ap=1 s=36981 n(v0 rc2024-03-27T07:26:23.804890+0000 b36981 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab263600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fe8:[<0x20000002ef1/picture-46.jpg v492>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fe8:[<0x20000002ef1/picture-46.jpg v886>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.628+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001926 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-81.xml auth{0=1} v1060 ap=1 s=2979 n(v0 rc2024-03-27T07:27:21.908749+0000 b2979 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001926:[<0x20000002ef1/comment-81.xml v1060>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001926:[<0x20000002ef1/comment-81.xml v1060>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.628+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019c9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-10.xml auth{0=1} v1042 ap=1 s=9016 n(v0 rc2024-03-27T07:27:24.149705+0000 b9016 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019c9:[<0x20000002ef1/comment-10.xml v1042>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019c9:[<0x20000002ef1/comment-10.xml v1042>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.630+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-3.jpg auth{0=1} v893 ap=1 s=48648 n(v0 rc2024-03-27T07:26:29.599776+0000 b48648 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb8:[<0x20000002ef1/picture-3.jpg v857>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb8:[<0x20000002ef1/picture-3.jpg v893>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.685 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.630+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001987 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-53.xml auth{0=1} v1050 ap=1 s=8947 n(v0 rc2024-03-27T07:27:22.664734+0000 b8947 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001987:[<0x20000002ef1/comment-53.xml v1050>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001987:[<0x20000002ef1/comment-53.xml v1050>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.686 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.631+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019cd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-6.xml auth{0=1} v1038 ap=1 s=7248 n(v0 rc2024-03-27T07:27:24.240703+0000 b7248 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019cd:[<0x20000002ef1/comment-6.xml v1038>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019cd:[<0x20000002ef1/comment-6.xml v1038>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.686 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.633+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000191c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-85.xml auth{0=1} v1062 ap=1 s=2284 n(v0 rc2024-03-27T07:27:21.830750+0000 b2284 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000191c:[<0x20000002ef1/comment-85.xml v1062>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000191c:[<0x20000002ef1/comment-85.xml v1062>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.686 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.633+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fcd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-55.jpg auth v887 ap=1 s=56335 n(v0 rc2024-03-27T07:26:23.638893+0000 b56335 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad6a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fcd:[<0x20000002ef1/picture-55.jpg v438>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fcd:[<0x20000002ef1/picture-55.jpg v887>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.686 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.633+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fa0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-70.jpg auth v895 ap=1 s=27320 n(v0 rc2024-03-27T07:26:23.485896+0000 b27320 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad6a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fa0:[<0x20000002ef1/picture-70.jpg v348>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fa0:[<0x20000002ef1/picture-70.jpg v895>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.686 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.635+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c9b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-11.jpg auth{0=1} v885 ap=1 s=37416 n(v0 rc2024-03-27T07:26:28.388800+0000 b37416 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c9b:[<0x20000002ef1/picture-11.jpg v805>,<0x10000000399/blog-84 v111385>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000c9b:[<0x20000002ef1/picture-11.jpg v885>,<0x10000000399/blog-84 v146070>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.756 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: 2024-03-27T07:28:21.359+0000 7f077f72f700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001811 [...7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-40/ auth{1=1,2=1} fragtree_t(*^3) v133249 ap=2 f(v7 m2024-03-27T07:27:55.552090+0000 106=106+0) n(v9 rc2024-03-27T07:27:55.552090+0000 b1696077 107=106+1) old_inodes=3 (inest sync->mix g=1,2) caps={15291=pAsLsXsFs/pAsLsXsFsxcral@3} mcw={2=AsLsXsFs} | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=8 caps=1 stickydirs=0 dirtyparent=0 dirwaiter=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x559954e32680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x20000001811:[<0x10000000399/blog-40 v125611>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(2)0x20000001811:[<0x10000000399/blog-40 v133249>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1802>,<0x10000000005/tmp v79>,<0x100000001fb/client.0 v78>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v92>,<0x10000000001/sv_1 v116>,<0x10000000000/qa v106>,<0x1/volumes v98>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T07:27:23.181724+0000 104=104+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T07:27:55.552090+0000 b1696077 107=106+1)","memory_value.dirstat":"f(v7 m2024-03-27T07:27:55.552090+0000 106=106+0)","memory_value.rstat":"n(v9 rc2024-03-27T07:27:55.552090+0000 b1696077 107=106+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-03-27T07:28:21.756 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: 2024-03-27T07:28:21.363+0000 7f077f72f700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ff0 [...7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-57/ auth{1=1,2=1} v137652 ap=2 f(v5 m2024-03-27T07:28:02.804948+0000 83=83+0) n(v9 rc2024-03-27T07:28:02.804948+0000 b2053324 84=83+1) old_inodes=2 (inest sync->mix g=1,2) caps={15291=pAsLsXsFs/pAsLsXsFsxcral@5} | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirtyparent=0 dirwaiter=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x5599562f2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x20000001ff0:[<0x10000000399/blog-57 v125713>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(2)0x20000001ff0:[<0x10000000399/blog-57 v137652>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1802>,<0x10000000005/tmp v79>,<0x100000001fb/client.0 v78>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v92>,<0x10000000001/sv_1 v116>,<0x10000000000/qa v106>,<0x1/volumes v98>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T07:27:56.263076+0000 82=82+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T07:28:02.804948+0000 b2053324 84=83+1)","memory_value.dirstat":"f(v5 m2024-03-27T07:28:02.804948+0000 83=83+0)","memory_value.rstat":"n(v9 rc2024-03-27T07:28:02.804948+0000 b2053324 84=83+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-03-27T07:28:21.756 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.466+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bd3 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-13.jpg auth v358 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.627775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d83db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bd3:[<0x10000002b97/picture-13.jpg v358>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bd3:[<0x10000002b97/picture-13.jpg v358>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.757 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.466+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bce [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-18.jpg auth v328 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.609776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d83e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bce:[<0x10000002b97/picture-18.jpg v328>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bce:[<0x10000002b97/picture-18.jpg v328>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.757 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.468+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bcd [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-19.jpg auth v322 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.607776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d83e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bcd:[<0x10000002b97/picture-19.jpg v322>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bcd:[<0x10000002b97/picture-19.jpg v322>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.757 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.469+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bdc [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-4.jpg auth v412 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.660775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d83ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bdc:[<0x10000002b97/picture-4.jpg v412>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bdc:[<0x10000002b97/picture-4.jpg v412>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: scrub queued for path: / 2024-03-27T07:28:21.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:21.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:28:21.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:28:21.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: scrub summary: active paths [/] 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ebb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ac8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ee5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eeb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.759 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.470+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bbd [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-35.jpg auth v226 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.558777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d83f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bbd:[<0x10000002b97/picture-35.jpg v226>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bbd:[<0x10000002b97/picture-35.jpg v226>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.759 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.471+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bde [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-2.jpg auth v424 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.667775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d83f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bde:[<0x10000002b97/picture-2.jpg v424>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bde:[<0x10000002b97/picture-2.jpg v424>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.759 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.472+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bd2 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-14.jpg auth v352 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.624776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x556618354100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bd2:[<0x10000002b97/picture-14.jpg v352>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bd2:[<0x10000002b97/picture-14.jpg v352>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.759 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.473+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba3 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-61.jpg auth v70 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.475778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d698000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ba3:[<0x10000002b97/picture-61.jpg v70>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ba3:[<0x10000002b97/picture-61.jpg v70>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.759 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.474+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bd9 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-7.jpg auth v394 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.649775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d698580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bd9:[<0x10000002b97/picture-7.jpg v394>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bd9:[<0x10000002b97/picture-7.jpg v394>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ec7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001702 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002edc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ed6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b6c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ed3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002edf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ce0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ce9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ad2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000db6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ebe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002db3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ea4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002da5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001afb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cfe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ea0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002da2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ed9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.764 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.475+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bd7 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-9.jpg auth v382 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.641775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d698b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bd7:[<0x10000002b97/picture-9.jpg v382>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bd7:[<0x10000002b97/picture-9.jpg v382>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.764 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.476+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bd6 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-10.jpg auth v376 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.637775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d699080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bd6:[<0x10000002b97/picture-10.jpg v376>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bd6:[<0x10000002b97/picture-10.jpg v376>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.764 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.477+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bdf [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-1.jpg auth v430 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.670775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d699600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bdf:[<0x10000002b97/picture-1.jpg v430>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bdf:[<0x10000002b97/picture-1.jpg v430>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.764 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.478+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9a [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-9.xml auth v16 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.439779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d699b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002b9a:[<0x10000002b97/article-9.xml v16>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002b9a:[<0x10000002b97/article-9.xml v16>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.765 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.479+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bda [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-6.jpg auth v400 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.652775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d69a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bda:[<0x10000002b97/picture-6.jpg v400>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bda:[<0x10000002b97/picture-6.jpg v400>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.765 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.480+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bc4 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-28.jpg auth v268 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.581776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d69a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bc4:[<0x10000002b97/picture-28.jpg v268>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bc4:[<0x10000002b97/picture-28.jpg v268>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.765 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.481+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bbb [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-37.jpg auth v214 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.550777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d69ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bbb:[<0x10000002b97/picture-37.jpg v214>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bbb:[<0x10000002b97/picture-37.jpg v214>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.765 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.482+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bcf [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-17.jpg auth v334 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.613776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d69b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bcf:[<0x10000002b97/picture-17.jpg v334>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bcf:[<0x10000002b97/picture-17.jpg v334>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.765 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.484+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba0 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-3.xml auth v52 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.462779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d69b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ba0:[<0x10000002b97/article-3.xml v52>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ba0:[<0x10000002b97/article-3.xml v52>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.765 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.485+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bc8 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-24.jpg auth v292 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.591776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d5fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bc8:[<0x10000002b97/picture-24.jpg v292>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bc8:[<0x10000002b97/picture-24.jpg v292>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.765 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.486+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bbf [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-33.jpg auth v238 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.564777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d5fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bbf:[<0x10000002b97/picture-33.jpg v238>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bbf:[<0x10000002b97/picture-33.jpg v238>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.765 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.487+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba7 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-57.jpg auth v94 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.488778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d5fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ba7:[<0x10000002b97/picture-57.jpg v94>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ba7:[<0x10000002b97/picture-57.jpg v94>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.765 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.488+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9c [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-7.xml auth v28 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.448779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d5fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002b9c:[<0x10000002b97/article-7.xml v28>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002b9c:[<0x10000002b97/article-7.xml v28>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.765 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.489+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb6 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-42.jpg auth v184 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.536777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d5fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bb6:[<0x10000002b97/picture-42.jpg v184>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bb6:[<0x10000002b97/picture-42.jpg v184>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001be3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002da9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000fbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002de4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b1d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.767 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.490+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb9 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-39.jpg auth v202 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.544777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d5fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bb9:[<0x10000002b97/picture-39.jpg v202>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bb9:[<0x10000002b97/picture-39.jpg v202>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.767 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.491+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bc7 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-25.jpg auth v286 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.588776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d5fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bc7:[<0x10000002b97/picture-25.jpg v286>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bc7:[<0x10000002b97/picture-25.jpg v286>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001acc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ee2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002df4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cf5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002df0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.769 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.492+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9b [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-8.xml auth v22 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.444779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d5fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002b9b:[<0x10000002b97/article-8.xml v22>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002b9b:[<0x10000002b97/article-8.xml v22>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.769 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.493+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bc1 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-31.jpg auth v250 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.571777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d5fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bc1:[<0x10000002b97/picture-31.jpg v250>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bc1:[<0x10000002b97/picture-31.jpg v250>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.769 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.494+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002baf [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-49.jpg auth v142 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.512778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d5fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002baf:[<0x10000002b97/picture-49.jpg v142>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002baf:[<0x10000002b97/picture-49.jpg v142>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.769 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.495+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bd8 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-8.jpg auth{0=1} v436 ap=1 s=44344 n(v0 rc2024-03-27T07:28:11.645775+0000 b44344 1=1+0) caps={15291=pAsLsXsFscr/pFscr@4} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55661d5fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bd8:[<0x10000002b97/picture-8.jpg v388>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bd8:[<0x10000002b97/picture-8.jpg v436>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.769 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.496+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bc6 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-26.jpg auth v280 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.585776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d604000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bc6:[<0x10000002b97/picture-26.jpg v280>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bc6:[<0x10000002b97/picture-26.jpg v280>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.769 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.498+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9d [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-6.xml auth v34 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.452779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d604580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002b9d:[<0x10000002b97/article-6.xml v34>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002b9d:[<0x10000002b97/article-6.xml v34>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.770 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.498+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba1 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-2.xml auth v58 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.467779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d604b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ba1:[<0x10000002b97/article-2.xml v58>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ba1:[<0x10000002b97/article-2.xml v58>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.770 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.499+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002baa [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-54.jpg auth v112 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.498778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d605080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002baa:[<0x10000002b97/picture-54.jpg v112>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002baa:[<0x10000002b97/picture-54.jpg v112>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.770 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.499+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bc3 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-29.jpg auth v262 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.577776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d605600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bc3:[<0x10000002b97/picture-29.jpg v262>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bc3:[<0x10000002b97/picture-29.jpg v262>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ee8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002de0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ed0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001aca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.772 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.501+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bdb [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-5.jpg auth v406 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.656775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d605b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bdb:[<0x10000002b97/picture-5.jpg v406>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bdb:[<0x10000002b97/picture-5.jpg v406>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.772 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.503+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bae [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-50.jpg auth v136 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.508778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d606100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bae:[<0x10000002b97/picture-50.jpg v136>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bae:[<0x10000002b97/picture-50.jpg v136>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.772 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.503+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba6 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-58.jpg auth v88 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.485778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d606680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ba6:[<0x10000002b97/picture-58.jpg v88>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ba6:[<0x10000002b97/picture-58.jpg v88>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.772 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.503+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bad [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-51.jpg auth v130 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.505778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d606c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bad:[<0x10000002b97/picture-51.jpg v130>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bad:[<0x10000002b97/picture-51.jpg v130>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.772 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.505+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb2 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-46.jpg auth v160 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.522778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d607180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bb2:[<0x10000002b97/picture-46.jpg v160>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bb2:[<0x10000002b97/picture-46.jpg v160>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ea8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ccf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ec4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ddc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.774 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.507+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bdd [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-3.jpg auth v418 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.664775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d607700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bdd:[<0x10000002b97/picture-3.jpg v418>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bdd:[<0x10000002b97/picture-3.jpg v418>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.774 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.509+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba9 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-55.jpg auth v106 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.495778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d852000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ba9:[<0x10000002b97/picture-55.jpg v106>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ba9:[<0x10000002b97/picture-55.jpg v106>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.774 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.511+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bd5 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-11.jpg auth v370 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.634775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d852580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bd5:[<0x10000002b97/picture-11.jpg v370>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bd5:[<0x10000002b97/picture-11.jpg v370>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.774 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.513+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9e [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-5.xml auth v40 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.456779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d852b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002b9e:[<0x10000002b97/article-5.xml v40>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002b9e:[<0x10000002b97/article-5.xml v40>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.774 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.514+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb8 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-40.jpg auth v196 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.540777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d853080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bb8:[<0x10000002b97/picture-40.jpg v196>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bb8:[<0x10000002b97/picture-40.jpg v196>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000dbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ecd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002db0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ac2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ccc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d3f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.776 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.515+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bc9 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-23.jpg auth v298 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.594776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d853600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bc9:[<0x10000002b97/picture-23.jpg v298>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bc9:[<0x10000002b97/picture-23.jpg v298>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.776 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.515+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb3 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-45.jpg auth v166 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.526777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d853b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bb3:[<0x10000002b97/picture-45.jpg v166>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bb3:[<0x10000002b97/picture-45.jpg v166>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.776 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.516+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb7 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-41.jpg auth v190 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.538777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d854100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bb7:[<0x10000002b97/picture-41.jpg v190>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bb7:[<0x10000002b97/picture-41.jpg v190>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.776 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.518+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba4 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-60.jpg auth v76 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.478778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d854680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ba4:[<0x10000002b97/picture-60.jpg v76>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ba4:[<0x10000002b97/picture-60.jpg v76>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ac1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ace (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.778 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.519+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bca [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-22.jpg auth v304 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.597776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d854c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bca:[<0x10000002b97/picture-22.jpg v304>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bca:[<0x10000002b97/picture-22.jpg v304>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.519+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b98 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-11.xml auth v4 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.428779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d855180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002b98:[<0x10000002b97/article-11.xml v4>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002b98:[<0x10000002b97/article-11.xml v4>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.519+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bd1 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-15.jpg auth v346 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.620776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d855700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bd1:[<0x10000002b97/picture-15.jpg v346>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bd1:[<0x10000002b97/picture-15.jpg v346>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.520+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba8 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-56.jpg auth v100 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.492778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d85e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ba8:[<0x10000002b97/picture-56.jpg v100>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ba8:[<0x10000002b97/picture-56.jpg v100>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.520+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb1 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-47.jpg auth v154 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.519778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d85e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bb1:[<0x10000002b97/picture-47.jpg v154>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bb1:[<0x10000002b97/picture-47.jpg v154>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000fb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ac4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002de8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.780 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.780 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.780 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002cdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.780 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ec1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.780 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.780 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.780 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.520+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b99 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-10.xml auth v10 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.433779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d85eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002b99:[<0x10000002b97/article-10.xml v10>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002b99:[<0x10000002b97/article-10.xml v10>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.780 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.522+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bd4 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-12.jpg auth v364 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.630775+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d85f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bd4:[<0x10000002b97/picture-12.jpg v364>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bd4:[<0x10000002b97/picture-12.jpg v364>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002d83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ce6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.782 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.522+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb4 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-44.jpg auth v172 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.529777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d85f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bb4:[<0x10000002b97/picture-44.jpg v172>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bb4:[<0x10000002b97/picture-44.jpg v172>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.782 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.524+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9f [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-4.xml auth v46 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.458779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d85fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002b9f:[<0x10000002b97/article-4.xml v46>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002b9f:[<0x10000002b97/article-4.xml v46>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.782 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.526+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba5 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-59.jpg auth v82 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.482778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d860100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ba5:[<0x10000002b97/picture-59.jpg v82>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ba5:[<0x10000002b97/picture-59.jpg v82>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.782 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.528+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bcb [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-21.jpg auth v310 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.601776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d860680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bcb:[<0x10000002b97/picture-21.jpg v310>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bcb:[<0x10000002b97/picture-21.jpg v310>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.782 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.528+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bc2 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-30.jpg auth v256 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.574777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d860c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bc2:[<0x10000002b97/picture-30.jpg v256>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bc2:[<0x10000002b97/picture-30.jpg v256>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.782 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.530+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bbc [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-36.jpg auth v220 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.554777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d861180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bbc:[<0x10000002b97/picture-36.jpg v220>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bbc:[<0x10000002b97/picture-36.jpg v220>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.782 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.532+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb5 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-43.jpg auth v178 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.533777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d861700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bb5:[<0x10000002b97/picture-43.jpg v178>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bb5:[<0x10000002b97/picture-43.jpg v178>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.782 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.534+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bcc [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-20.jpg auth v316 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.603776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d866000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bcc:[<0x10000002b97/picture-20.jpg v316>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bcc:[<0x10000002b97/picture-20.jpg v316>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.783 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.536+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bba [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-38.jpg auth v208 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.547777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d866580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bba:[<0x10000002b97/picture-38.jpg v208>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bba:[<0x10000002b97/picture-38.jpg v208>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.783 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.538+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bc5 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-27.jpg auth v274 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.583776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d866b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bc5:[<0x10000002b97/picture-27.jpg v274>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bc5:[<0x10000002b97/picture-27.jpg v274>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.783 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.540+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bac [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-52.jpg auth v124 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.503778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d867080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bac:[<0x10000002b97/picture-52.jpg v124>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bac:[<0x10000002b97/picture-52.jpg v124>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.783 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.541+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba2 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-1.xml auth v64 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.471779+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d867600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ba2:[<0x10000002b97/article-1.xml v64>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ba2:[<0x10000002b97/article-1.xml v64>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.783 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.544+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bbe [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-34.jpg auth v232 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.561777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d867b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bbe:[<0x10000002b97/picture-34.jpg v232>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bbe:[<0x10000002b97/picture-34.jpg v232>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.783 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.544+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bab [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-53.jpg auth v118 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.501778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d868100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bab:[<0x10000002b97/picture-53.jpg v118>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bab:[<0x10000002b97/picture-53.jpg v118>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.783 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.544+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bd0 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-16.jpg auth v340 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.616776+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d868680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bd0:[<0x10000002b97/picture-16.jpg v340>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bd0:[<0x10000002b97/picture-16.jpg v340>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.783 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.544+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bc0 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-32.jpg auth v244 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.568777+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d868c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bc0:[<0x10000002b97/picture-32.jpg v244>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bc0:[<0x10000002b97/picture-32.jpg v244>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.783 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:21.546+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb0 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-48.jpg auth v148 ap=1 s=0 n(v0 rc2024-03-27T07:28:11.515778+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d869180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002bb0:[<0x10000002b97/picture-48.jpg v148>,<0x10000000399/blog-234 v141078>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002bb0:[<0x10000002b97/picture-48.jpg v148>,<0x10000000399/blog-234 v143912>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:21.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: scrub queued for path: / 2024-03-27T07:28:21.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:21.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:28:21.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:28:21.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: scrub summary: active paths [/] 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ebb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ac8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ee5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eeb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ec7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001702 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002edc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ed6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b6c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ed3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002edf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ce0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ce9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ad2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000db6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ebe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002db3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ea4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002da5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001afb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cfe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ea0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002da2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ed9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001be3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002da9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000fbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002de4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b1d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001acc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ee2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002df4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cf5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002df0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ee8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002de0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ed0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001aca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ea8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ccf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ec4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ddc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000dbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ecd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002db0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ac2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ccc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d3f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ac1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ace (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000fb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ac4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002de8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002cdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ec1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002d83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ce6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:21.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:21 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.040 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.755+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f6b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-5.xml auth{0=1} v883 ap=1 s=18340 n(v0 rc2024-03-27T07:26:23.335899+0000 b18340 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f6b:[<0x20000002ef1/article-5.xml v246>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f6b:[<0x20000002ef1/article-5.xml v883>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.040 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.756+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f13 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-34.xml auth{0=1} v879 ap=1 s=11383 n(v0 rc2024-03-27T07:26:22.686912+0000 b11383 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f13:[<0x20000002ef1/article-34.xml v70>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f13:[<0x20000002ef1/article-34.xml v879>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.040 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.757+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019aa [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-35.xml auth{0=1} v1046 ap=1 s=3351 n(v0 rc2024-03-27T07:27:23.057726+0000 b3351 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019aa:[<0x20000002ef1/comment-35.xml v1046>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019aa:[<0x20000002ef1/comment-35.xml v1046>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.758+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019b5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-28.xml auth{0=1} v1044 ap=1 s=8203 n(v0 rc2024-03-27T07:27:23.143725+0000 b8203 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad6a5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019b5:[<0x20000002ef1/comment-28.xml v1044>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019b5:[<0x20000002ef1/comment-28.xml v1044>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.759+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000197e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-57.xml auth{0=1} v1052 ap=1 s=2621 n(v0 rc2024-03-27T07:27:22.577736+0000 b2621 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac736000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000197e:[<0x20000002ef1/comment-57.xml v1052>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000197e:[<0x20000002ef1/comment-57.xml v1052>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.761+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f9d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-71.jpg auth v889 ap=1 s=26143 n(v0 rc2024-03-27T07:26:23.468897+0000 b26143 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac736580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f9d:[<0x20000002ef1/picture-71.jpg v342>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f9d:[<0x20000002ef1/picture-71.jpg v889>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.761+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f21 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-29.xml auth{0=1} v877 ap=1 s=6489 n(v0 rc2024-03-27T07:26:22.873908+0000 b6489 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac736b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f21:[<0x20000002ef1/article-29.xml v100>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f21:[<0x20000002ef1/article-29.xml v877>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.762+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fb5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-63.jpg auth v891 ap=1 s=53583 n(v0 rc2024-03-27T07:26:23.558895+0000 b53583 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac737080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fb5:[<0x20000002ef1/picture-63.jpg v390>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fb5:[<0x20000002ef1/picture-63.jpg v891>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.762+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ffb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-40.jpg auth{0=1} v881 ap=1 s=24956 n(v0 rc2024-03-27T07:26:23.899888+0000 b24956 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac737600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ffb:[<0x20000002ef1/picture-40.jpg v528>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ffb:[<0x20000002ef1/picture-40.jpg v881>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.763+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001974 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-61.xml auth{0=1} v1054 ap=1 s=5080 n(v0 rc2024-03-27T07:27:22.511737+0000 b5080 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac737b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001974:[<0x20000002ef1/comment-61.xml v1054>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001974:[<0x20000002ef1/comment-61.xml v1054>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.764+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f35 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-22.xml auth{0=1} v875 ap=1 s=3824 n(v0 rc2024-03-27T07:26:23.025905+0000 b3824 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac738100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f35:[<0x20000002ef1/article-22.xml v144>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f35:[<0x20000002ef1/article-22.xml v875>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.765+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019a6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-38.xml auth{0=1} v1048 ap=1 s=5708 n(v0 rc2024-03-27T07:27:22.941728+0000 b5708 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac738680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019a6:[<0x20000002ef1/comment-38.xml v1048>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019a6:[<0x20000002ef1/comment-38.xml v1048>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.766+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001960 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-68.xml auth{0=1} v1056 ap=1 s=2757 n(v0 rc2024-03-27T07:27:22.355740+0000 b2757 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac738c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001960:[<0x20000002ef1/comment-68.xml v1056>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001960:[<0x20000002ef1/comment-68.xml v1056>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.766+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019cb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-8.xml auth{0=1} v1040 ap=1 s=10184 n(v0 rc2024-03-27T07:27:24.199704+0000 b10184 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac739180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019cb:[<0x20000002ef1/comment-8.xml v1040>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019cb:[<0x20000002ef1/comment-8.xml v1040>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.041 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.767+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000192a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-80.xml auth{0=1} v1058 ap=1 s=9481 n(v0 rc2024-03-27T07:27:21.919749+0000 b9481 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac739700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000192a:[<0x20000002ef1/comment-80.xml v1058>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000192a:[<0x20000002ef1/comment-80.xml v1058>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.768+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c8c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-23.jpg auth{0=1} v908 ap=1 s=61924 n(v0 rc2024-03-27T07:26:25.862850+0000 b61924 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9366580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c8c:[<0x20000002ef1/picture-23.jpg v630>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c8c:[<0x20000002ef1/picture-23.jpg v908>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.768+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018da [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-79.jpg auth v1025 ap=1 s=39624 n(v0 rc2024-03-27T07:27:20.595774+0000 b39624 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a7ac2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018da:[<0x20000002ef1/picture-79.jpg v935>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018da:[<0x20000002ef1/picture-79.jpg v1025>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.768+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002feb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-45.jpg auth{0=1} v902 ap=1 s=14752 n(v0 rc2024-03-27T07:26:23.817890+0000 b14752 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a82f0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002feb:[<0x20000002ef1/picture-45.jpg v498>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002feb:[<0x20000002ef1/picture-45.jpg v902>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.769+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f4e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-14.xml auth{0=1} v888 ap=1 s=19044 n(v0 rc2024-03-27T07:26:23.248901+0000 b19044 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9481700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f4e:[<0x20000002ef1/article-14.xml v192>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f4e:[<0x20000002ef1/article-14.xml v888>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.771+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ff7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-41.jpg auth{0=1} v898 ap=1 s=29235 n(v0 rc2024-03-27T07:26:23.882889+0000 b29235 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9458100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ff7:[<0x20000002ef1/picture-41.jpg v522>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ff7:[<0x20000002ef1/picture-41.jpg v898>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.772+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001972 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-62.xml auth{0=1} v1021 ap=1 s=5589 n(v0 rc2024-03-27T07:27:22.490737+0000 b5589 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7e13080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001972:[<0x20000002ef1/comment-62.xml v1021>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001972:[<0x20000002ef1/comment-62.xml v1021>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.773+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e9e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-60.jpg auth v930 ap=1 s=16073 n(v0 rc2024-03-27T07:26:48.603402+0000 b16073 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a93ae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e9e:[<0x20000002ef1/picture-60.jpg v930>,<0x10000000399/blog-84 v115576>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e9e:[<0x20000002ef1/picture-60.jpg v930>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.774+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fac [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-66.jpg auth v922 ap=1 s=39232 n(v0 rc2024-03-27T07:26:23.528896+0000 b39232 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a7e30680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fac:[<0x20000002ef1/picture-66.jpg v372>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fac:[<0x20000002ef1/picture-66.jpg v922>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.776+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f81 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-80.jpg auth v916 ap=1 s=48667 n(v0 rc2024-03-27T07:26:23.387898+0000 b48667 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a882ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f81:[<0x20000002ef1/picture-80.jpg v288>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f81:[<0x20000002ef1/picture-80.jpg v916>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.777+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c8e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-22.jpg auth{0=1} v906 ap=1 s=17271 n(v0 rc2024-03-27T07:26:26.053846+0000 b17271 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9456000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c8e:[<0x20000002ef1/picture-22.jpg v636>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c8e:[<0x20000002ef1/picture-22.jpg v906>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.778+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f58 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-11.xml auth{0=1} v886 ap=1 s=5829 n(v0 rc2024-03-27T07:26:23.290900+0000 b5829 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a93ad080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f58:[<0x20000002ef1/article-11.xml v210>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f58:[<0x20000002ef1/article-11.xml v886>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.042 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.779+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001978 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-59.xml auth{0=1} v1019 ap=1 s=8104 n(v0 rc2024-03-27T07:27:22.553736+0000 b8104 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a74eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001978:[<0x20000002ef1/comment-59.xml v1019>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001978:[<0x20000002ef1/comment-59.xml v1019>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.043 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.780+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f47 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-16.xml auth{0=1} v890 ap=1 s=20619 n(v0 rc2024-03-27T07:26:23.176902+0000 b20619 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7f2a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f47:[<0x20000002ef1/article-16.xml v180>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f47:[<0x20000002ef1/article-16.xml v890>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.782+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001935 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-77.xml auth{0=1} v1023 ap=1 s=2739 n(v0 rc2024-03-27T07:27:21.970748+0000 b2739 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a94a6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001935:[<0x20000002ef1/comment-77.xml v1023>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001935:[<0x20000002ef1/comment-77.xml v1023>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.784+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f29 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-26.xml auth{0=1} v894 ap=1 s=25601 n(v0 rc2024-03-27T07:26:22.918908+0000 b25601 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7b87080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f29:[<0x20000002ef1/article-26.xml v118>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f29:[<0x20000002ef1/article-26.xml v894>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.784+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c96 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-15.jpg auth{0=1} v912 ap=1 s=48536 n(v0 rc2024-03-27T07:26:27.157824+0000 b48536 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7486000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c96:[<0x20000002ef1/picture-15.jpg v678>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c96:[<0x20000002ef1/picture-15.jpg v912>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.784+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fca [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-56.jpg auth v918 ap=1 s=52642 n(v0 rc2024-03-27T07:26:23.627894+0000 b52642 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a9532100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fca:[<0x20000002ef1/picture-56.jpg v432>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fca:[<0x20000002ef1/picture-56.jpg v918>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.785+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fe5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-47.jpg auth v914 ap=1 s=42397 n(v0 rc2024-03-27T07:26:23.784890+0000 b42397 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8d64c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fe5:[<0x20000002ef1/picture-47.jpg v486>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fe5:[<0x20000002ef1/picture-47.jpg v914>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.785+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f5b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-10.xml auth{0=1} v884 ap=1 s=3882 n(v0 rc2024-03-27T07:26:23.295900+0000 b3882 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7dae580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f5b:[<0x20000002ef1/article-10.xml v216>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f5b:[<0x20000002ef1/article-10.xml v884>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.785+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c99 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-12.jpg auth{0=1} v910 ap=1 s=40852 n(v0 rc2024-03-27T07:26:27.428819+0000 b40852 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a91b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c99:[<0x20000002ef1/picture-12.jpg v696>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c99:[<0x20000002ef1/picture-12.jpg v910>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.785+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000198c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-50.xml auth{0=1} v1017 ap=1 s=5554 n(v0 rc2024-03-27T07:27:22.734733+0000 b5554 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7ff4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000198c:[<0x20000002ef1/comment-50.xml v1017>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000198c:[<0x20000002ef1/comment-50.xml v1017>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.785+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f6f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-4.xml auth{0=1} v904 ap=1 s=32350 n(v0 rc2024-03-27T07:26:23.347899+0000 b32350 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8da4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f6f:[<0x20000002ef1/article-4.xml v252>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f6f:[<0x20000002ef1/article-4.xml v904>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.786+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f2b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-25.xml auth{0=1} v892 ap=1 s=30015 n(v0 rc2024-03-27T07:26:22.942907+0000 b30015 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9560000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f2b:[<0x20000002ef1/article-25.xml v124>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f2b:[<0x20000002ef1/article-25.xml v892>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.046 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.786+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fc1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-59.jpg auth v924 ap=1 s=21746 n(v0 rc2024-03-27T07:26:23.600894+0000 b21746 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a89dc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fc1:[<0x20000002ef1/picture-59.jpg v414>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fc1:[<0x20000002ef1/picture-59.jpg v924>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.786+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fee [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-44.jpg auth{0=1} v900 ap=1 s=39895 n(v0 rc2024-03-27T07:26:23.829890+0000 b39895 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a97d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fee:[<0x20000002ef1/picture-44.jpg v504>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fee:[<0x20000002ef1/picture-44.jpg v900>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.786+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001995 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-48.xml auth{0=1} v1015 ap=1 s=2955 n(v0 rc2024-03-27T07:27:22.763732+0000 b2955 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8f70100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001995:[<0x20000002ef1/comment-48.xml v1015>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001995:[<0x20000002ef1/comment-48.xml v1015>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.786+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f9a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-72.jpg auth v926 ap=1 s=32016 n(v0 rc2024-03-27T07:26:23.447897+0000 b32016 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a739b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f9a:[<0x20000002ef1/picture-72.jpg v336>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f9a:[<0x20000002ef1/picture-72.jpg v926>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.786+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f07 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-38.xml auth{0=1} v896 ap=1 s=5270 n(v0 rc2024-03-27T07:26:22.633913+0000 b5270 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7a7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f07:[<0x20000002ef1/article-38.xml v46>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f07:[<0x20000002ef1/article-38.xml v896>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.787+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019b2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-31.xml auth{0=1} v1013 ap=1 s=4239 n(v0 rc2024-03-27T07:27:23.120725+0000 b4239 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a945eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019b2:[<0x20000002ef1/comment-31.xml v1013>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019b2:[<0x20000002ef1/comment-31.xml v1013>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.787+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f97 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-73.jpg auth v901 ap=1 s=52853 n(v0 rc2024-03-27T07:26:23.438897+0000 b52853 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad1e7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f97:[<0x20000002ef1/picture-73.jpg v330>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f97:[<0x20000002ef1/picture-73.jpg v901>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.787+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c90 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-21.jpg auth{0=1} v897 ap=1 s=46963 n(v0 rc2024-03-27T07:26:26.226842+0000 b46963 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad1e7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c90:[<0x20000002ef1/picture-21.jpg v642>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c90:[<0x20000002ef1/picture-21.jpg v897>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.787+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001976 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-60.xml auth{0=1} v1065 ap=1 s=4271 n(v0 rc2024-03-27T07:27:22.534736+0000 b4271 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad1e8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001976:[<0x20000002ef1/comment-60.xml v1065>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001976:[<0x20000002ef1/comment-60.xml v1065>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.787+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f10 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-35.xml auth{0=1} v883 ap=1 s=11519 n(v0 rc2024-03-27T07:26:22.674912+0000 b11519 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad1e8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f10:[<0x20000002ef1/article-35.xml v64>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f10:[<0x20000002ef1/article-35.xml v883>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.787+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000194b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-73.xml auth{0=1} v1069 ap=1 s=9260 n(v0 rc2024-03-27T07:27:22.111745+0000 b9260 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad1e8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000194b:[<0x20000002ef1/comment-73.xml v1069>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000194b:[<0x20000002ef1/comment-73.xml v1069>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.787+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f91 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-75.jpg auth v903 ap=1 s=51167 n(v0 rc2024-03-27T07:26:23.426898+0000 b51167 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad1e9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f91:[<0x20000002ef1/picture-75.jpg v318>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f91:[<0x20000002ef1/picture-75.jpg v903>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.047 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.788+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001931 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-78.xml auth{0=1} v1071 ap=1 s=2221 n(v0 rc2024-03-27T07:27:21.941748+0000 b2221 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad1e9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001931:[<0x20000002ef1/comment-78.xml v1071>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001931:[<0x20000002ef1/comment-78.xml v1071>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.788+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019d2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-1.xml auth{0=1} v1053 ap=1 s=8432 n(v0 rc2024-03-27T07:27:24.328701+0000 b8432 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb90000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019d2:[<0x20000002ef1/comment-1.xml v1053>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019d2:[<0x20000002ef1/comment-1.xml v1053>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.788+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001914 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-88.xml auth{0=1} v1079 ap=1 s=3228 n(v0 rc2024-03-27T07:27:21.784751+0000 b3228 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb91080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001914:[<0x20000002ef1/comment-88.xml v1079>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001914:[<0x20000002ef1/comment-88.xml v1079>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.788+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f01 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-40.xml auth{0=1} v889 ap=1 s=21511 n(v0 rc2024-03-27T07:26:22.607914+0000 b21511 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb90580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f01:[<0x20000002ef1/article-40.xml v34>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f01:[<0x20000002ef1/article-40.xml v889>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.788+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003018 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-30.jpg auth{0=1} v899 ap=1 s=64360 n(v0 rc2024-03-27T07:26:23.991886+0000 b64360 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb90b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000003018:[<0x20000002ef1/picture-30.jpg v588>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000003018:[<0x20000002ef1/picture-30.jpg v899>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.788+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000192d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-79.xml auth{0=1} v1073 ap=1 s=4028 n(v0 rc2024-03-27T07:27:21.933748+0000 b4028 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb92100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000192d:[<0x20000002ef1/comment-79.xml v1073>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000192d:[<0x20000002ef1/comment-79.xml v1073>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.789+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019a3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-40.xml auth{0=1} v1061 ap=1 s=7333 n(v0 rc2024-03-27T07:27:22.918729+0000 b7333 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb92680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019a3:[<0x20000002ef1/comment-40.xml v1061>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019a3:[<0x20000002ef1/comment-40.xml v1061>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.789+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019a5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-39.xml auth{0=1} v1059 ap=1 s=7679 n(v0 rc2024-03-27T07:27:22.931729+0000 b7679 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb93180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019a5:[<0x20000002ef1/comment-39.xml v1059>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019a5:[<0x20000002ef1/comment-39.xml v1059>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.789+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018db [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-15.xml auth{0=1} v1051 ap=1 s=28007 n(v0 rc2024-03-27T07:27:20.602774+0000 b28007 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb91b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018db:[<0x20000002ef1/article-15.xml v1051>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018db:[<0x20000002ef1/article-15.xml v1051>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.789+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ae [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-33.xml auth{0=1} v1057 ap=1 s=7567 n(v0 rc2024-03-27T07:27:23.088726+0000 b7567 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ae:[<0x20000002ef1/comment-33.xml v1057>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ae:[<0x20000002ef1/comment-33.xml v1057>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.789+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ff1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-43.jpg auth{0=1} v893 ap=1 s=34366 n(v0 rc2024-03-27T07:26:23.842889+0000 b34366 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb94580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ff1:[<0x20000002ef1/picture-43.jpg v510>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ff1:[<0x20000002ef1/picture-43.jpg v893>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.789+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003007 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-36.jpg auth{0=1} v885 ap=1 s=44892 n(v0 rc2024-03-27T07:26:23.932888+0000 b44892 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb94000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000003007:[<0x20000002ef1/picture-36.jpg v552>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000003007:[<0x20000002ef1/picture-36.jpg v885>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.048 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.790+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c91 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-20.jpg auth{0=1} v895 ap=1 s=12059 n(v0 rc2024-03-27T07:26:26.413839+0000 b12059 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb95080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c91:[<0x20000002ef1/picture-20.jpg v648>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c91:[<0x20000002ef1/picture-20.jpg v895>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.790+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019af [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-32.xml auth{0=1} v1055 ap=1 s=5871 n(v0 rc2024-03-27T07:27:23.107725+0000 b5871 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb95b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019af:[<0x20000002ef1/comment-32.xml v1055>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019af:[<0x20000002ef1/comment-32.xml v1055>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.790+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001984 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-54.xml auth{0=1} v1063 ap=1 s=4504 n(v0 rc2024-03-27T07:27:22.636734+0000 b4504 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb96680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001984:[<0x20000002ef1/comment-54.xml v1063>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001984:[<0x20000002ef1/comment-54.xml v1063>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.791+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002efb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-42.xml auth{0=1} v891 ap=1 s=18485 n(v0 rc2024-03-27T07:26:22.584914+0000 b18485 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb96c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002efb:[<0x20000002ef1/article-42.xml v22>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002efb:[<0x20000002ef1/article-42.xml v891>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.791+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000191a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-86.xml auth{0=1} v1077 ap=1 s=6169 n(v0 rc2024-03-27T07:27:21.816751+0000 b6169 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb93700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000191a:[<0x20000002ef1/comment-86.xml v1077>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000191a:[<0x20000002ef1/comment-86.xml v1077>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.791+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f3e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-19.xml auth{0=1} v881 ap=1 s=19751 n(v0 rc2024-03-27T07:26:23.111904+0000 b19751 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb94b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f3e:[<0x20000002ef1/article-19.xml v162>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f3e:[<0x20000002ef1/article-19.xml v881>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.791+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001924 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-82.xml auth{0=1} v1075 ap=1 s=7377 n(v0 rc2024-03-27T07:27:21.887749+0000 b7377 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb95600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001924:[<0x20000002ef1/comment-82.xml v1075>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001924:[<0x20000002ef1/comment-82.xml v1075>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001970 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-63.xml auth{0=1} v1067 ap=1 s=6156 n(v0 rc2024-03-27T07:27:22.472738+0000 b6156 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb96100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001970:[<0x20000002ef1/comment-63.xml v1067>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001970:[<0x20000002ef1/comment-63.xml v1067>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003001 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-38.jpg auth{0=1} v887 ap=1 s=59724 n(v0 rc2024-03-27T07:26:23.912888+0000 b59724 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acb97180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000003001:[<0x20000002ef1/picture-38.jpg v540>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000003001:[<0x20000002ef1/picture-38.jpg v887>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019c6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-13.xml auth{0=1} v1058 ap=1 s=9590 n(v0 rc2024-03-27T07:27:23.657714+0000 b9590 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad010c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019c6:[<0x20000002ef1/comment-13.xml v1058>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019c6:[<0x20000002ef1/comment-13.xml v1058>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019bc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-21.xml auth{0=1} v1062 ap=1 s=7144 n(v0 rc2024-03-27T07:27:23.273722+0000 b7144 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad011180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019bc:[<0x20000002ef1/comment-21.xml v1062>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019bc:[<0x20000002ef1/comment-21.xml v1062>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019b7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-26.xml auth{0=1} v1064 ap=1 s=9064 n(v0 rc2024-03-27T07:27:23.184724+0000 b9064 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad011700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019b7:[<0x20000002ef1/comment-26.xml v1064>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019b7:[<0x20000002ef1/comment-26.xml v1064>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003021 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-27.jpg auth{0=1} v891 ap=1 s=9382 n(v0 rc2024-03-27T07:26:24.034886+0000 b9382 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8a4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000003021:[<0x20000002ef1/picture-27.jpg v606>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000003021:[<0x20000002ef1/picture-27.jpg v891>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.049 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f04 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-39.xml auth{0=1} v887 ap=1 s=19876 n(v0 rc2024-03-27T07:26:22.618913+0000 b19876 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8a5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f04:[<0x20000002ef1/article-39.xml v40>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f04:[<0x20000002ef1/article-39.xml v887>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f0d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-36.xml auth{0=1} v883 ap=1 s=19555 n(v0 rc2024-03-27T07:26:22.662913+0000 b19555 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8a5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f0d:[<0x20000002ef1/article-36.xml v58>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f0d:[<0x20000002ef1/article-36.xml v883>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f55 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-12.xml auth{0=1} v875 ap=1 s=8082 n(v0 rc2024-03-27T07:26:23.282900+0000 b8082 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8a5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f55:[<0x20000002ef1/article-12.xml v204>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f55:[<0x20000002ef1/article-12.xml v875>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fd6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-52.jpg auth v901 ap=1 s=16978 n(v0 rc2024-03-27T07:26:23.675893+0000 b16978 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac8a6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fd6:[<0x20000002ef1/picture-52.jpg v456>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fd6:[<0x20000002ef1/picture-52.jpg v901>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f78 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-1.xml auth{0=1} v889 ap=1 s=2728 n(v0 rc2024-03-27T07:26:23.368899+0000 b2728 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8a6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f78:[<0x20000002ef1/article-1.xml v270>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f78:[<0x20000002ef1/article-1.xml v889>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.794+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019b3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-30.xml auth{0=1} v1066 ap=1 s=5018 n(v0 rc2024-03-27T07:27:23.130725+0000 b5018 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8a6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019b3:[<0x20000002ef1/comment-30.xml v1066>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019b3:[<0x20000002ef1/comment-30.xml v1066>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.794+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000300d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-34.jpg auth{0=1} v881 ap=1 s=30044 n(v0 rc2024-03-27T07:26:23.953887+0000 b30044 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8a7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000300d:[<0x20000002ef1/picture-34.jpg v564>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000300d:[<0x20000002ef1/picture-34.jpg v881>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.794+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fd3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-53.jpg auth v905 ap=1 s=17492 n(v0 rc2024-03-27T07:26:23.654893+0000 b17492 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac8a7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fd3:[<0x20000002ef1/picture-53.jpg v450>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fd3:[<0x20000002ef1/picture-53.jpg v905>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.794+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fa9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-67.jpg auth v895 ap=1 s=61261 n(v0 rc2024-03-27T07:26:23.515896+0000 b61261 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac9b0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fa9:[<0x20000002ef1/picture-67.jpg v366>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fa9:[<0x20000002ef1/picture-67.jpg v895>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.794+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019bf [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-18.xml auth{0=1} v1060 ap=1 s=9292 n(v0 rc2024-03-27T07:27:23.317721+0000 b9292 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9b0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019bf:[<0x20000002ef1/comment-18.xml v1060>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019bf:[<0x20000002ef1/comment-18.xml v1060>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.794+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019c7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-12.xml auth{0=1} v1056 ap=1 s=8832 n(v0 rc2024-03-27T07:27:23.793712+0000 b8832 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9b1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019c7:[<0x20000002ef1/comment-12.xml v1056>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019c7:[<0x20000002ef1/comment-12.xml v1056>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.794+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c95 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-16.jpg auth{0=1} v893 ap=1 s=11617 n(v0 rc2024-03-27T07:26:27.064826+0000 b11617 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9b1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c95:[<0x20000002ef1/picture-16.jpg v672>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c95:[<0x20000002ef1/picture-16.jpg v893>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.050 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.795+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f94 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-74.jpg auth v897 ap=1 s=52568 n(v0 rc2024-03-27T07:26:23.432897+0000 b52568 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac9b1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f94:[<0x20000002ef1/picture-74.jpg v324>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f94:[<0x20000002ef1/picture-74.jpg v897>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.795+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019d0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-3.xml auth{0=1} v1054 ap=1 s=3916 n(v0 rc2024-03-27T07:27:24.292702+0000 b3916 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9b0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019d0:[<0x20000002ef1/comment-3.xml v1054>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019d0:[<0x20000002ef1/comment-3.xml v1054>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.795+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001992 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-49.xml auth{0=1} v1070 ap=1 s=4042 n(v0 rc2024-03-27T07:27:22.746732+0000 b4042 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9b2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001992:[<0x20000002ef1/comment-49.xml v1070>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001992:[<0x20000002ef1/comment-49.xml v1070>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.795+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001917 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-87.xml auth{0=1} v1076 ap=1 s=4787 n(v0 rc2024-03-27T07:27:21.798751+0000 b4787 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9b2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001917:[<0x20000002ef1/comment-87.xml v1076>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001917:[<0x20000002ef1/comment-87.xml v1076>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.795+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019a0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-42.xml auth{0=1} v1068 ap=1 s=2353 n(v0 rc2024-03-27T07:27:22.873730+0000 b2353 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9b2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019a0:[<0x20000002ef1/comment-42.xml v1068>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019a0:[<0x20000002ef1/comment-42.xml v1068>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.795+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000196c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-65.xml auth{0=1} v1074 ap=1 s=8384 n(v0 rc2024-03-27T07:27:22.441738+0000 b8384 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9b3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000196c:[<0x20000002ef1/comment-65.xml v1074>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000196c:[<0x20000002ef1/comment-65.xml v1074>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.796+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f30 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-23.xml auth{0=1} v138 ap=1 s=14096 n(v0 rc2024-03-27T07:26:22.974906+0000 b14096 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9b3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f30:[<0x20000002ef1/article-23.xml v138>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f30:[<0x20000002ef1/article-23.xml v138>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.796+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f8e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-76.jpg auth v899 ap=1 s=35896 n(v0 rc2024-03-27T07:26:23.418898+0000 b35896 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad56e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f8e:[<0x20000002ef1/picture-76.jpg v312>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f8e:[<0x20000002ef1/picture-76.jpg v899>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.796+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002fe2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-48.jpg auth v903 ap=1 s=31391 n(v0 rc2024-03-27T07:26:23.767891+0000 b31391 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad56f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002fe2:[<0x20000002ef1/picture-48.jpg v480>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002fe2:[<0x20000002ef1/picture-48.jpg v903>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.796+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f44 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-17.xml auth{0=1} v877 ap=1 s=4495 n(v0 rc2024-03-27T07:26:23.150903+0000 b4495 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad56e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f44:[<0x20000002ef1/article-17.xml v174>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f44:[<0x20000002ef1/article-17.xml v877>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.796+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000003013 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-32.jpg auth{0=1} v879 ap=1 s=64888 n(v0 rc2024-03-27T07:26:23.973887+0000 b64888 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad56eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000003013:[<0x20000002ef1/picture-32.jpg v576>,<0x10000000399/blog-84 v96170>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000003013:[<0x20000002ef1/picture-32.jpg v879>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.051 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:21.797+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000198a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-51.xml auth{0=1} v1072 ap=1 s=8975 n(v0 rc2024-03-27T07:27:22.707733+0000 b8975 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad56f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000198a:[<0x20000002ef1/comment-51.xml v1072>,<0x10000000399/blog-84 v126207>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000198a:[<0x20000002ef1/comment-51.xml v1072>,<0x10000000399/blog-84 v146076>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.373 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.108+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002592 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-13.jpg auth v206 ap=1 s=52951 n(v0 rc2024-03-27T07:27:56.213077+0000 b52951 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d61c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002592:[<0x10000002502/picture-13.jpg v206>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002592:[<0x10000002502/picture-13.jpg v206>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.373 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.109+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000257c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-18.jpg auth v338 ap=1 s=34128 n(v0 rc2024-03-27T07:27:56.040080+0000 b34128 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d61c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000257c:[<0x10000002502/picture-18.jpg v174>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000257c:[<0x10000002502/picture-18.jpg v338>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.373 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.109+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002577 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-19.jpg auth v374 ap=1 s=57967 n(v0 rc2024-03-27T07:27:56.006081+0000 b57967 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d61cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002577:[<0x10000002502/picture-19.jpg v168>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002577:[<0x10000002502/picture-19.jpg v374>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.373 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.109+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000258e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-14.jpg auth v370 ap=1 s=63219 n(v0 rc2024-03-27T07:27:56.178077+0000 b63219 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d674580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000258e:[<0x10000002502/picture-14.jpg v198>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000258e:[<0x10000002502/picture-14.jpg v370>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.374 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.110+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025b2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-7.jpg auth v252 ap=1 s=39250 n(v0 rc2024-03-27T07:27:56.472072+0000 b39250 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d674b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025b2:[<0x10000002502/picture-7.jpg v252>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000025b2:[<0x10000002502/picture-7.jpg v252>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.374 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.110+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025ce [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-2.jpg auth v296 ap=1 s=44247 n(v0 rc2024-03-27T07:27:56.621069+0000 b44247 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d674000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025ce:[<0x10000002502/picture-2.jpg v296>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000025ce:[<0x10000002502/picture-2.jpg v296>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.374 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.110+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-9.jpg auth v238 ap=1 s=59748 n(v0 rc2024-03-27T07:27:56.391073+0000 b59748 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d675080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a9:[<0x10000002502/picture-9.jpg v238>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000025a9:[<0x10000002502/picture-9.jpg v238>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.374 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.110+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025a3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-10.jpg auth v230 ap=1 s=33605 n(v0 rc2024-03-27T07:27:56.355074+0000 b33605 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d675600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025a3:[<0x10000002502/picture-10.jpg v230>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000025a3:[<0x10000002502/picture-10.jpg v230>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.374 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.111+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002509 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-9.xml auth v320 ap=1 s=25051 n(v0 rc2024-03-27T07:27:55.340094+0000 b25051 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d676100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002509:[<0x10000002502/article-9.xml v320>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002509:[<0x10000002502/article-9.xml v320>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.375 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.111+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025c3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-4.jpg auth v304 ap=1 s=46937 n(v0 rc2024-03-27T07:27:56.570070+0000 b46937 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d61d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025c3:[<0x10000002502/picture-4.jpg v304>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000025c3:[<0x10000002502/picture-4.jpg v304>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.375 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.111+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002528 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-35.jpg auth v394 ap=1 s=40723 n(v0 rc2024-03-27T07:27:55.537090+0000 b40723 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d61d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002528:[<0x10000002502/picture-35.jpg v72>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002528:[<0x10000002502/picture-35.jpg v394>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.375 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.111+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025d4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-1.jpg auth{0=1} v402 ap=1 s=33846 n(v0 rc2024-03-27T07:27:56.642068+0000 b33846 1=1+0) caps={15291=pAsLsXsFscr/pFscr@5} mcw={0=Fscr} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55661d675b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025d4:[<0x10000002502/picture-1.jpg v292>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000025d4:[<0x10000002502/picture-1.jpg v402>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.111+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025b7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-6.jpg auth v312 ap=1 s=38358 n(v0 rc2024-03-27T07:27:56.519071+0000 b38358 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d676680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025b7:[<0x10000002502/picture-6.jpg v312>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000025b7:[<0x10000002502/picture-6.jpg v312>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.112+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002549 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-28.jpg auth v386 ap=1 s=54333 n(v0 rc2024-03-27T07:27:55.724086+0000 b54333 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d676c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002549:[<0x10000002502/picture-28.jpg v114>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002549:[<0x10000002502/picture-28.jpg v386>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.112+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002582 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-17.jpg auth v336 ap=1 s=55569 n(v0 rc2024-03-27T07:27:56.075079+0000 b55569 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d677180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002582:[<0x10000002502/picture-17.jpg v180>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002582:[<0x10000002502/picture-17.jpg v336>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.112+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000251b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-3.xml auth v302 ap=1 s=23458 n(v0 rc2024-03-27T07:27:55.454091+0000 b23458 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d677700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000251b:[<0x10000002502/article-3.xml v302>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000251b:[<0x10000002502/article-3.xml v302>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.112+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002530 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-33.jpg auth v330 ap=1 s=29054 n(v0 rc2024-03-27T07:27:55.586089+0000 b29054 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d67a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002530:[<0x10000002502/picture-33.jpg v84>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002530:[<0x10000002502/picture-33.jpg v330>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.113+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000250c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-8.xml auth v318 ap=1 s=6789 n(v0 rc2024-03-27T07:27:55.379093+0000 b6789 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d67b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000250c:[<0x10000002502/article-8.xml v318>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000250c:[<0x10000002502/article-8.xml v318>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.113+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000250f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-7.xml auth v24 ap=1 s=11745 n(v0 rc2024-03-27T07:27:55.397093+0000 b11745 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d67ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000250f:[<0x10000002502/article-7.xml v24>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000250f:[<0x10000002502/article-7.xml v24>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.113+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000253b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-31.jpg auth v392 ap=1 s=54279 n(v0 rc2024-03-27T07:27:55.655087+0000 b54279 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d67bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000253b:[<0x10000002502/picture-31.jpg v96>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000253b:[<0x10000002502/picture-31.jpg v392>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.113+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025ae [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-8.jpg auth v316 ap=1 s=49537 n(v0 rc2024-03-27T07:27:56.440072+0000 b49537 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d67c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025ae:[<0x10000002502/picture-8.jpg v316>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000025ae:[<0x10000002502/picture-8.jpg v316>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.114+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002554 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-26.jpg auth v328 ap=1 s=64568 n(v0 rc2024-03-27T07:27:55.797085+0000 b64568 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d67c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002554:[<0x10000002502/picture-26.jpg v126>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002554:[<0x10000002502/picture-26.jpg v328>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.376 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.114+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002513 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-6.xml auth v314 ap=1 s=16009 n(v0 rc2024-03-27T07:27:55.431092+0000 b16009 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d67cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002513:[<0x10000002502/article-6.xml v314>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002513:[<0x10000002502/article-6.xml v314>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.377 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.114+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002544 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-29.jpg auth v388 ap=1 s=47254 n(v0 rc2024-03-27T07:27:55.698087+0000 b47254 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d67d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002544:[<0x10000002502/picture-29.jpg v108>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002544:[<0x10000002502/picture-29.jpg v388>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.377 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.114+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000025bd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-5.jpg auth v308 ap=1 s=38656 n(v0 rc2024-03-27T07:27:56.543070+0000 b38656 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661de76000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000025bd:[<0x10000002502/picture-5.jpg v308>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000025bd:[<0x10000002502/picture-5.jpg v308>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.377 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.115+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000251c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-2.xml auth v298 ap=1 s=9890 n(v0 rc2024-03-27T07:27:55.460091+0000 b9890 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d67d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000251c:[<0x10000002502/article-2.xml v298>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000251c:[<0x10000002502/article-2.xml v298>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.377 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.115+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000255e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-24.jpg auth v380 ap=1 s=22385 n(v0 rc2024-03-27T07:27:55.850084+0000 b22385 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d67a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000255e:[<0x10000002502/picture-24.jpg v138>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000255e:[<0x10000002502/picture-24.jpg v380>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.377 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.115+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000255a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-25.jpg auth v382 ap=1 s=44348 n(v0 rc2024-03-27T07:27:55.821084+0000 b44348 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d67b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000255a:[<0x10000002502/picture-25.jpg v132>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000255a:[<0x10000002502/picture-25.jpg v382>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.377 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.116+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000259e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-11.jpg auth v222 ap=1 s=44028 n(v0 rc2024-03-27T07:27:56.304075+0000 b44028 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661de76b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000259e:[<0x10000002502/picture-11.jpg v222>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000259e:[<0x10000002502/picture-11.jpg v222>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.377 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.116+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002564 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-23.jpg auth v378 ap=1 s=23557 n(v0 rc2024-03-27T07:27:55.887083+0000 b23557 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de77600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002564:[<0x10000002502/picture-23.jpg v144>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002564:[<0x10000002502/picture-23.jpg v378>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.379 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.116+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002516 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-5.xml auth v310 ap=1 s=4472 n(v0 rc2024-03-27T07:27:55.441092+0000 b4472 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661de77080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002516:[<0x10000002502/article-5.xml v310>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002516:[<0x10000002502/article-5.xml v310>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.379 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.116+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002568 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-22.jpg auth v326 ap=1 s=48020 n(v0 rc2024-03-27T07:27:55.920082+0000 b48020 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de77b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002568:[<0x10000002502/picture-22.jpg v150>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002568:[<0x10000002502/picture-22.jpg v326>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.379 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.116+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002505 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-10.xml auth v322 ap=1 s=24378 n(v0 rc2024-03-27T07:27:55.321094+0000 b24378 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661de78680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002505:[<0x10000002502/article-10.xml v322>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002505:[<0x10000002502/article-10.xml v322>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.379 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.117+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000258c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-15.jpg auth v372 ap=1 s=34034 n(v0 rc2024-03-27T07:27:56.145078+0000 b34034 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de78100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000258c:[<0x10000002502/picture-15.jpg v192>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000258c:[<0x10000002502/picture-15.jpg v372>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.379 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.117+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002598 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-12.jpg auth v214 ap=1 s=57651 n(v0 rc2024-03-27T07:27:56.246076+0000 b57651 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661de78c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002598:[<0x10000002502/picture-12.jpg v214>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002598:[<0x10000002502/picture-12.jpg v214>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.379 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.117+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002517 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-4.xml auth v306 ap=1 s=32210 n(v0 rc2024-03-27T07:27:55.446092+0000 b32210 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661de79180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002517:[<0x10000002502/article-4.xml v306>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002517:[<0x10000002502/article-4.xml v306>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.380 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.117+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000256d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-21.jpg auth v340 ap=1 s=21500 n(v0 rc2024-03-27T07:27:55.949082+0000 b21500 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de79700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000256d:[<0x10000002502/picture-21.jpg v156>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000256d:[<0x10000002502/picture-21.jpg v340>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.380 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.117+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002523 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-36.jpg auth v324 ap=1 s=54672 n(v0 rc2024-03-27T07:27:55.520090+0000 b54672 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de4e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002523:[<0x10000002502/picture-36.jpg v66>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002523:[<0x10000002502/picture-36.jpg v324>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.380 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.118+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002572 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-20.jpg auth v376 ap=1 s=24066 n(v0 rc2024-03-27T07:27:55.975081+0000 b24066 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de4eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002572:[<0x10000002502/picture-20.jpg v162>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002572:[<0x10000002502/picture-20.jpg v376>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.380 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.118+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002550 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-27.jpg auth v384 ap=1 s=16730 n(v0 rc2024-03-27T07:27:55.761085+0000 b16730 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de4f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002550:[<0x10000002502/picture-27.jpg v120>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002550:[<0x10000002502/picture-27.jpg v384>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.380 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.118+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000251f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-1.xml auth v294 ap=1 s=29808 n(v0 rc2024-03-27T07:27:55.477091+0000 b29808 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661de4f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000251f:[<0x10000002502/article-1.xml v294>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000251f:[<0x10000002502/article-1.xml v294>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.380 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.118+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000252c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-34.jpg auth v342 ap=1 s=52876 n(v0 rc2024-03-27T07:27:55.570089+0000 b52876 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de4fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000252c:[<0x10000002502/picture-34.jpg v78>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000252c:[<0x10000002502/picture-34.jpg v342>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.380 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.119+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002587 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-16.jpg auth v334 ap=1 s=43517 n(v0 rc2024-03-27T07:27:56.102079+0000 b43517 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de50100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002587:[<0x10000002502/picture-16.jpg v186>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002587:[<0x10000002502/picture-16.jpg v334>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.380 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.119+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002536 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-32.jpg auth v332 ap=1 s=20699 n(v0 rc2024-03-27T07:27:55.611088+0000 b20699 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de50c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002536:[<0x10000002502/picture-32.jpg v90>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002536:[<0x10000002502/picture-32.jpg v332>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.380 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.119+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002540 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-30.jpg auth v390 ap=1 s=16225 n(v0 rc2024-03-27T07:27:55.681087+0000 b16225 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661de4e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002540:[<0x10000002502/picture-30.jpg v102>,<0x10000000399/blog-211 v138177>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002540:[<0x10000002502/picture-30.jpg v390>,<0x10000000399/blog-211 v143928>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.380 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.370+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000242b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-13.xml auth{0=1} v1148 ap=1 s=8134 n(v0 rc2024-03-27T07:27:53.462130+0000 b8134 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db1f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000242b:[<0x2000000165e/comment-13.xml v1148>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000242b:[<0x2000000165e/comment-13.xml v1148>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.370+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002401 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-21.xml auth{0=1} v1152 ap=1 s=5206 n(v0 rc2024-03-27T07:27:53.243135+0000 b5206 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db20580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002401:[<0x2000000165e/comment-21.xml v1152>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002401:[<0x2000000165e/comment-21.xml v1152>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.370+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-26.xml auth{0=1} v1154 ap=1 s=4252 n(v0 rc2024-03-27T07:27:53.177136+0000 b4252 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db21080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023e8:[<0x2000000165e/comment-26.xml v1154>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023e8:[<0x2000000165e/comment-26.xml v1154>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.371+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e2d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-75.xml auth v651 ap=1 s=15180 n(v0 rc2024-03-27T07:25:52.814501+0000 b15180 1=1+0) | authpin=1 scrubqueue=0 0x55661dfcf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e2d:[<0x2000000165e/article-75.xml v216>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e2d:[<0x2000000165e/article-75.xml v651>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.371+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001665 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-12.xml auth{0=1} v190 ap=1 s=16064 n(v0 rc2024-03-27T07:25:44.489665+0000 b16064 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db21b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001665:[<0x2000000165e/article-12.xml v190>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001665:[<0x2000000165e/article-12.xml v190>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.371+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001694 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-1.xml auth{0=1} v202 ap=1 s=11357 n(v0 rc2024-03-27T07:25:44.696660+0000 b11357 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db22100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001694:[<0x2000000165e/article-1.xml v202>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001694:[<0x2000000165e/article-1.xml v202>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.371+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023da [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-30.xml auth{0=1} v1156 ap=1 s=6314 n(v0 rc2024-03-27T07:27:53.131137+0000 b6314 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db22c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023da:[<0x2000000165e/comment-30.xml v1156>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023da:[<0x2000000165e/comment-30.xml v1156>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.371+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000248e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-3.xml auth{0=1} v1146 ap=1 s=4097 n(v0 rc2024-03-27T07:27:54.200116+0000 b4097 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db23700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000248e:[<0x2000000165e/comment-3.xml v1146>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000248e:[<0x2000000165e/comment-3.xml v1146>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.372+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001698 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-16.jpg auth v194 ap=1 s=45246 n(v0 rc2024-03-27T07:25:44.704660+0000 b45246 1=1+0) | authpin=1 scrubqueue=0 0x55661c3be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001698:[<0x2000000165e/picture-16.jpg v194>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001698:[<0x2000000165e/picture-16.jpg v194>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.372+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002411 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-18.xml auth{0=1} v1150 ap=1 s=7202 n(v0 rc2024-03-27T07:27:53.280134+0000 b7202 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661daca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002411:[<0x2000000165e/comment-18.xml v1150>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002411:[<0x2000000165e/comment-18.xml v1150>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.372+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002430 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-12.xml auth{0=1} v1135 ap=1 s=9532 n(v0 rc2024-03-27T07:27:53.488130+0000 b9532 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dacb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002430:[<0x2000000165e/comment-12.xml v1135>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002430:[<0x2000000165e/comment-12.xml v1135>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.372+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002348 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-49.xml auth{0=1} v1167 ap=1 s=7168 n(v0 rc2024-03-27T07:27:52.273154+0000 b7168 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55661dacb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002348:[<0x2000000165e/comment-49.xml v858>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002348:[<0x2000000165e/comment-49.xml v1167>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.381 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.372+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022c4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-65.xml auth{0=1} v1160 ap=1 s=7473 n(v0 rc2024-03-27T07:27:51.625166+0000 b7473 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dacc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022c4:[<0x2000000165e/comment-65.xml v1160>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022c4:[<0x2000000165e/comment-65.xml v1160>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.382 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.372+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000991 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-32.jpg auth v629 ap=1 s=23604 n(v0 rc2024-03-27T07:26:03.393292+0000 b23604 1=1+0) | authpin=1 scrubqueue=0 0x55661b777080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000991:[<0x2000000165e/picture-32.jpg v244>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x10000000991:[<0x2000000165e/picture-32.jpg v629>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.382 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.373+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002336 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-51.xml auth{0=1} v1168 ap=1 s=2669 n(v0 rc2024-03-27T07:27:52.131156+0000 b2669 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55661dacd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002336:[<0x2000000165e/comment-51.xml v842>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002336:[<0x2000000165e/comment-51.xml v1168>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.382 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.374+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002384 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-42.xml auth{0=1} v1158 ap=1 s=2375 n(v0 rc2024-03-27T07:27:52.624147+0000 b2375 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dacc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002384:[<0x2000000165e/comment-42.xml v1158>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002384:[<0x2000000165e/comment-42.xml v1158>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.382 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.374+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016c4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-48.jpg auth v689 ap=1 s=64103 n(v0 rc2024-03-27T07:27:16.123862+0000 b64103 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661daccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016c4:[<0x2000000165e/picture-48.jpg v665>,<0x10000000399/blog-36 v121369>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016c4:[<0x2000000165e/picture-48.jpg v689>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.382 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.374+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000227a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-73.xml auth{0=1} v1162 ap=1 s=4212 n(v0 rc2024-03-27T07:27:51.277173+0000 b4212 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc58100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000227a:[<0x2000000165e/comment-73.xml v1162>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000227a:[<0x2000000165e/comment-73.xml v1162>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.383 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.374+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022ee [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-60.xml auth{0=1} v1158 ap=1 s=4539 n(v0 rc2024-03-27T07:27:51.757164+0000 b4539 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc58680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022ee:[<0x2000000165e/comment-60.xml v1158>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022ee:[<0x2000000165e/comment-60.xml v1158>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.383 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.375+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002396 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-40.xml auth{0=1} v1154 ap=1 s=8044 n(v0 rc2024-03-27T07:27:52.717145+0000 b8044 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db1c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002396:[<0x2000000165e/comment-40.xml v1154>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002396:[<0x2000000165e/comment-40.xml v1154>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.383 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.375+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002491 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-1.xml auth{0=1} v1146 ap=1 s=4180 n(v0 rc2024-03-27T07:27:54.234115+0000 b4180 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc59180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002491:[<0x2000000165e/comment-1.xml v1146>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002491:[<0x2000000165e/comment-1.xml v1146>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.383 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.375+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023a0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-39.xml auth{0=1} v1152 ap=1 s=3223 n(v0 rc2024-03-27T07:27:52.756144+0000 b3223 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db1d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023a0:[<0x2000000165e/comment-39.xml v1152>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023a0:[<0x2000000165e/comment-39.xml v1152>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.383 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.376+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022d5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-63.xml auth{0=1} v1160 ap=1 s=5387 n(v0 rc2024-03-27T07:27:51.687165+0000 b5387 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db1e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022d5:[<0x2000000165e/comment-63.xml v1160>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022d5:[<0x2000000165e/comment-63.xml v1160>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.383 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.376+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023d3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-32.xml auth{0=1} v1148 ap=1 s=9625 n(v0 rc2024-03-27T07:27:53.106137+0000 b9625 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db1e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023d3:[<0x2000000165e/comment-32.xml v1148>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023d3:[<0x2000000165e/comment-32.xml v1148>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.383 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.376+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023cf [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-33.xml auth{0=1} v1150 ap=1 s=6718 n(v0 rc2024-03-27T07:27:53.093138+0000 b6718 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db1cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023cf:[<0x2000000165e/comment-33.xml v1150>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023cf:[<0x2000000165e/comment-33.xml v1150>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.383 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.376+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000243a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-10.xml auth{0=1} v1162 ap=1 s=9139 n(v0 rc2024-03-27T07:27:53.538129+0000 b9139 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da1eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000243a:[<0x2000000165e/comment-10.xml v1162>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000243a:[<0x2000000165e/comment-10.xml v1162>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.383 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.376+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000231e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-54.xml auth{0=1} v1156 ap=1 s=5644 n(v0 rc2024-03-27T07:27:51.980159+0000 b5644 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661db1ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000231e:[<0x2000000165e/comment-54.xml v1156>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000231e:[<0x2000000165e/comment-54.xml v1156>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.384 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.377+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016cc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-3.jpg auth{0=1} v192 ap=1 s=35632 n(v0 rc2024-03-27T07:25:44.852657+0000 b35632 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da1f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016cc:[<0x2000000165e/picture-3.jpg v192>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016cc:[<0x2000000165e/picture-3.jpg v192>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.384 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.377+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002477 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-6.xml auth{0=1} v1158 ap=1 s=2571 n(v0 rc2024-03-27T07:27:54.035119+0000 b2571 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da20100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002477:[<0x2000000165e/comment-6.xml v1158>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002477:[<0x2000000165e/comment-6.xml v1158>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.384 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.377+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002325 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-53.xml auth{0=1} v1168 ap=1 s=4057 n(v0 rc2024-03-27T07:27:52.026159+0000 b4057 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da1f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002325:[<0x2000000165e/comment-53.xml v1168>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002325:[<0x2000000165e/comment-53.xml v1168>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.384 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.377+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016ac [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-11.jpg auth{0=1} v208 ap=1 s=22550 n(v0 rc2024-03-27T07:25:44.754659+0000 b22550 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da20680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016ac:[<0x2000000165e/picture-11.jpg v208>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016ac:[<0x2000000165e/picture-11.jpg v208>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.384 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.378+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023bf [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-35.xml auth{0=1} v1186 ap=1 s=4633 n(v0 rc2024-03-27T07:27:53.018139+0000 b4633 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55661da21700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023bf:[<0x2000000165e/comment-35.xml v956>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023bf:[<0x2000000165e/comment-35.xml v1186>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.387 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.063+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001eba [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-59.xml auth{0=1} v1154 ap=1 s=21655 n(v0 rc2024-03-27T07:25:53.339490+0000 b21655 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa472580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001eba:[<0x20000001e50/article-59.xml v993>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001eba:[<0x20000001e50/article-59.xml v1154>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.387 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.063+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bc5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-13.jpg auth{0=1} v1174 ap=1 s=11046 n(v0 rc2024-03-27T07:26:15.687050+0000 b11046 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa472b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bc5:[<0x20000001e50/picture-13.jpg v1174>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bc5:[<0x20000001e50/picture-13.jpg v1174>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.387 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.064+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e54 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-92.xml auth{0=1} v258 ap=1 s=24929 n(v0 rc2024-03-27T07:25:53.072495+0000 b24929 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa473b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e54:[<0x20000001e50/article-92.xml v258>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e54:[<0x20000001e50/article-92.xml v258>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.064+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ba7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-18.jpg auth{0=1} v1186 ap=1 s=23742 n(v0 rc2024-03-27T07:26:15.276058+0000 b23742 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa474100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ba7:[<0x20000001e50/picture-18.jpg v1186>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000ba7:[<0x20000001e50/picture-18.jpg v1186>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.064+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e8c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-74.xml auth{0=1} v272 ap=1 s=26337 n(v0 rc2024-03-27T07:25:53.225492+0000 b26337 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa474680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e8c:[<0x20000001e50/article-74.xml v272>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e8c:[<0x20000001e50/article-74.xml v272>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.064+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-18.xml auth{0=1} v1212 ap=1 s=11321 n(v0 rc2024-03-27T07:27:09.032001+0000 b11321 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa475180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a1:[<0x20000001e50/article-18.xml v1201>,<0x10000000399/blog-53 v117676>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000013a1:[<0x20000001e50/article-18.xml v1212>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.065+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ba1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-19.jpg auth{0=1} v1180 ap=1 s=57673 n(v0 rc2024-03-27T07:26:15.227059+0000 b57673 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acee6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ba1:[<0x20000001e50/picture-19.jpg v1180>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000ba1:[<0x20000001e50/picture-19.jpg v1180>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.065+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001eda [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-51.xml auth v966 ap=1 s=25435 n(v0 rc2024-03-27T07:25:58.938380+0000 b25435 1=1+0) caps={15291=pAsLsXsFscr/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a8997180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001eda:[<0x20000001e50/article-51.xml v966>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001eda:[<0x20000001e50/article-51.xml v966>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.066+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000946 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-27.xml auth{0=1} v1144 ap=1 s=3741 n(v0 rc2024-03-27T07:26:02.558309+0000 b3741 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acee7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000946:[<0x20000001e50/article-27.xml v500>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000946:[<0x20000001e50/article-27.xml v1144>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.067+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bef [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-4.jpg auth{0=1} v1176 ap=1 s=8482 n(v0 rc2024-03-27T07:26:15.982044+0000 b8482 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acee8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bef:[<0x20000001e50/picture-4.jpg v1176>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bef:[<0x20000001e50/picture-4.jpg v1176>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.067+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a11 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-35.jpg auth{0=1} v1148 ap=1 s=9395 n(v0 rc2024-03-27T07:26:05.775245+0000 b9395 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acee8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a11:[<0x20000001e50/picture-35.jpg v940>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a11:[<0x20000001e50/picture-35.jpg v1148>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.068+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000998 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-78.jpg auth{0=1} v1158 ap=1 s=54720 n(v0 rc2024-03-27T07:26:03.461291+0000 b54720 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acee9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000998:[<0x20000001e50/picture-78.jpg v677>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000998:[<0x20000001e50/picture-78.jpg v1158>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.068+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bf5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-2.jpg auth{0=1} v1178 ap=1 s=65521 n(v0 rc2024-03-27T07:26:16.068043+0000 b65521 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acee8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bf5:[<0x20000001e50/picture-2.jpg v1178>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bf5:[<0x20000001e50/picture-2.jpg v1178>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.069+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e6f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-83.xml auth{0=1} v294 ap=1 s=21324 n(v0 rc2024-03-27T07:25:53.145494+0000 b21324 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9ca5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e6f:[<0x20000001e50/article-83.xml v294>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e6f:[<0x20000001e50/article-83.xml v294>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.388 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.069+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bc1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-14.jpg auth{0=1} v1168 ap=1 s=49084 n(v0 rc2024-03-27T07:26:15.643051+0000 b49084 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9ca4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bc1:[<0x20000001e50/picture-14.jpg v1168>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bc1:[<0x20000001e50/picture-14.jpg v1168>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.069+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e98 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-70.xml auth{0=1} v250 ap=1 s=7240 n(v0 rc2024-03-27T07:25:53.257492+0000 b7240 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acee9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e98:[<0x20000001e50/article-70.xml v250>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e98:[<0x20000001e50/article-70.xml v250>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.069+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000952 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-20.xml auth{0=1} v1142 ap=1 s=29655 n(v0 rc2024-03-27T07:26:02.671306+0000 b29655 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9ca4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000952:[<0x20000001e50/article-20.xml v542>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000952:[<0x20000001e50/article-20.xml v1142>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.070+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001eb4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-61.xml auth{0=1} v304 ap=1 s=32266 n(v0 rc2024-03-27T07:25:53.325490+0000 b32266 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9ca5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001eb4:[<0x20000001e50/article-61.xml v304>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001eb4:[<0x20000001e50/article-61.xml v304>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.070+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-41.xml auth{0=1} v1150 ap=1 s=16011 n(v0 rc2024-03-27T07:25:59.923361+0000 b16011 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9ca6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092a:[<0x20000001e50/article-41.xml v403>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000092a:[<0x20000001e50/article-41.xml v1150>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.070+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ac3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-92.xml auth{0=1} v1368 ap=1 s=6673 n(v0 rc2024-03-27T07:27:34.019511+0000 b6673 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607a9ca4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ac3:[<0x20000001e50/comment-92.xml v1221>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ac3:[<0x20000001e50/comment-92.xml v1368>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.070+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000921 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-45.xml auth{0=1} v1152 ap=1 s=10803 n(v0 rc2024-03-27T07:25:59.616367+0000 b10803 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9ca6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000921:[<0x20000001e50/article-45.xml v379>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000921:[<0x20000001e50/article-45.xml v1152>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.070+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e9b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-69.xml auth{0=1} v284 ap=1 s=15941 n(v0 rc2024-03-27T07:25:53.265492+0000 b15941 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9ca7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e9b:[<0x20000001e50/article-69.xml v284>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e9b:[<0x20000001e50/article-69.xml v284>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.070+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a61 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-94.xml auth{0=1} v1370 ap=1 s=2650 n(v0 rc2024-03-27T07:27:29.126607+0000 b2650 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607a9ca7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a61:[<0x20000001e50/comment-94.xml v1215>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001a61:[<0x20000001e50/comment-94.xml v1370>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.071+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-7.jpg auth{0=1} v1182 ap=1 s=46983 n(v0 rc2024-03-27T07:26:15.924045+0000 b46983 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd92580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be0:[<0x20000001e50/picture-7.jpg v1182>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000be0:[<0x20000001e50/picture-7.jpg v1182>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.071+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bdb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-9.jpg auth{0=1} v1172 ap=1 s=43883 n(v0 rc2024-03-27T07:26:15.886046+0000 b43883 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd93080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bdb:[<0x20000001e50/picture-9.jpg v1172>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bdb:[<0x20000001e50/picture-9.jpg v1172>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.071+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ef [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-64.jpg auth{0=1} v1159 ap=1 s=40474 n(v0 rc2024-03-27T07:26:04.467271+0000 b40474 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad814c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ef:[<0x20000001e50/picture-64.jpg v764>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009ef:[<0x20000001e50/picture-64.jpg v1159>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.389 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.072+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e78 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-80.xml auth{0=1} v254 ap=1 s=16883 n(v0 rc2024-03-27T07:25:53.168494+0000 b16883 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad815180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e78:[<0x20000001e50/article-80.xml v254>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e78:[<0x20000001e50/article-80.xml v254>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.072+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-61.jpg auth{0=1} v1156 ap=1 s=48750 n(v0 rc2024-03-27T07:26:04.559269+0000 b48750 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd92000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f2:[<0x20000001e50/picture-61.jpg v782>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009f2:[<0x20000001e50/picture-61.jpg v1156>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.073+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bd4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-10.jpg auth{0=1} v1189 ap=1 s=48237 n(v0 rc2024-03-27T07:26:15.843047+0000 b48237 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad816b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bd4:[<0x20000001e50/picture-10.jpg v1189>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bd4:[<0x20000001e50/picture-10.jpg v1189>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.073+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000969 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-9.xml auth{0=1} v1141 ap=1 s=23927 n(v0 rc2024-03-27T07:26:02.940301+0000 b23927 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad818680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000969:[<0x20000001e50/article-9.xml v611>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000969:[<0x20000001e50/article-9.xml v1141>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.074+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000923 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-44.xml auth{0=1} v1155 ap=1 s=16215 n(v0 rc2024-03-27T07:25:59.692365+0000 b16215 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad818c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000923:[<0x20000001e50/article-44.xml v385>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000923:[<0x20000001e50/article-44.xml v1155>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.074+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-6.jpg auth{0=1} v1175 ap=1 s=13327 n(v0 rc2024-03-27T07:26:15.947045+0000 b13327 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad819180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be7:[<0x20000001e50/picture-6.jpg v1175>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000be7:[<0x20000001e50/picture-6.jpg v1175>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.075+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ea8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-65.xml auth{0=1} v268 ap=1 s=25940 n(v0 rc2024-03-27T07:25:53.295491+0000 b25940 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad819700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ea8:[<0x20000001e50/article-65.xml v268>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001ea8:[<0x20000001e50/article-65.xml v268>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.075+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000093f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-31.xml auth{0=1} v1146 ap=1 s=21731 n(v0 rc2024-03-27T07:26:02.459311+0000 b21731 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd92b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000093f:[<0x20000001e50/article-31.xml v476>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000093f:[<0x20000001e50/article-31.xml v1146>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.075+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001eb1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-62.xml auth{0=1} v302 ap=1 s=22935 n(v0 rc2024-03-27T07:25:53.317491+0000 b22935 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc7cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001eb1:[<0x20000001e50/article-62.xml v302>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001eb1:[<0x20000001e50/article-62.xml v302>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.076+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000094b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-24.xml auth{0=1} v1143 ap=1 s=9798 n(v0 rc2024-03-27T07:26:02.652307+0000 b9798 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc7db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000094b:[<0x20000001e50/article-24.xml v518>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000094b:[<0x20000001e50/article-24.xml v1143>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.076+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a18 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-28.jpg auth{0=1} v1145 ap=1 s=14306 n(v0 rc2024-03-27T07:26:05.955242+0000 b14306 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc7f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a18:[<0x20000001e50/picture-28.jpg v986>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a18:[<0x20000001e50/picture-28.jpg v1145>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.390 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.078+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bf8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-1.jpg auth{0=1} v1191 ap=1 s=26111 n(v0 rc2024-03-27T07:26:16.080042+0000 b26111 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad817600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bf8:[<0x20000001e50/picture-1.jpg v1191>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bf8:[<0x20000001e50/picture-1.jpg v1191>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.078+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e69 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-85.xml auth{0=1} v270 ap=1 s=12562 n(v0 rc2024-03-27T07:25:53.128494+0000 b12562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc80000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e69:[<0x20000001e50/article-85.xml v270>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e69:[<0x20000001e50/article-85.xml v270>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.079+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a5c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-95.xml auth{0=1} v1219 ap=1 s=6232 n(v0 rc2024-03-27T07:27:25.488679+0000 b6232 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad817080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a5c:[<0x20000001e50/comment-95.xml v1212>,<0x10000000399/blog-53 v126199>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a5c:[<0x20000001e50/comment-95.xml v1219>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.079+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e60 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-88.xml auth{0=1} v290 ap=1 s=16711 n(v0 rc2024-03-27T07:25:53.105495+0000 b16711 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc80580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e60:[<0x20000001e50/article-88.xml v290>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e60:[<0x20000001e50/article-88.xml v290>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.079+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ea2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-67.xml auth{0=1} v300 ap=1 s=29947 n(v0 rc2024-03-27T07:25:53.280491+0000 b29947 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc81600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ea2:[<0x20000001e50/article-67.xml v300>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001ea2:[<0x20000001e50/article-67.xml v300>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.079+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-37.jpg auth{0=1} v1149 ap=1 s=49805 n(v0 rc2024-03-27T07:26:05.763245+0000 b49805 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc82100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a0f:[<0x20000001e50/picture-37.jpg v928>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a0f:[<0x20000001e50/picture-37.jpg v1149>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.080+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-3.xml auth{0=1} v1214 ap=1 s=3000 n(v0 rc2024-03-27T07:27:16.720850+0000 b3000 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc83180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172f:[<0x20000001e50/article-3.xml v1214>,<0x10000000399/blog-53 v126199>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000172f:[<0x20000001e50/article-3.xml v1214>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.080+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a13 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-33.jpg auth{0=1} v1147 ap=1 s=55976 n(v0 rc2024-03-27T07:26:05.788245+0000 b55976 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab33c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a13:[<0x20000001e50/picture-33.jpg v952>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a13:[<0x20000001e50/picture-33.jpg v1147>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.080+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b8a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-24.jpg auth{0=1} v1167 ap=1 s=61737 n(v0 rc2024-03-27T07:26:14.730069+0000 b61737 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc83700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b8a:[<0x20000001e50/picture-24.jpg v1167>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b8a:[<0x20000001e50/picture-24.jpg v1167>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.081+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bab [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-17.jpg auth{0=1} v1171 ap=1 s=20480 n(v0 rc2024-03-27T07:26:15.458055+0000 b20480 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc82680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bab:[<0x20000001e50/picture-17.jpg v1171>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bab:[<0x20000001e50/picture-17.jpg v1171>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.081+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b85 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-96.xml auth v1165 ap=1 s=23728 n(v0 rc2024-03-27T07:26:14.567072+0000 b23728 1=1+0) | authpin=1 scrubqueue=0 0x5607ad0c7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b85:[<0x20000001e50/article-96.xml v1165>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b85:[<0x20000001e50/article-96.xml v1165>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.081+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-7.xml auth{0=1} v1139 ap=1 s=5182 n(v0 rc2024-03-27T07:26:02.952301+0000 b5182 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab33cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000096c:[<0x20000001e50/article-7.xml v623>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000096c:[<0x20000001e50/article-7.xml v1139>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.081+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-39.jpg auth{0=1} v1151 ap=1 s=60535 n(v0 rc2024-03-27T07:26:05.747246+0000 b60535 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab33db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a0d:[<0x20000001e50/picture-39.jpg v916>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a0d:[<0x20000001e50/picture-39.jpg v1151>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.391 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.082+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-57.jpg auth{0=1} v1157 ap=1 s=24471 n(v0 rc2024-03-27T07:26:04.773265+0000 b24471 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab33c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f6:[<0x20000001e50/picture-57.jpg v806>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009f6:[<0x20000001e50/picture-57.jpg v1157>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.392 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.082+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001439 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-55.xml auth{0=1} v1212 ap=1 s=6892 n(v0 rc2024-03-27T07:27:10.000982+0000 b6892 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abec3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001439:[<0x20000001e50/article-55.xml v1203>,<0x10000000399/blog-53 v117676>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000001439:[<0x20000001e50/article-55.xml v1212>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.392 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.082+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-8.xml auth{0=1} v1139 ap=1 s=5522 n(v0 rc2024-03-27T07:26:02.947301+0000 b5522 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607add7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000096a:[<0x20000001e50/article-8.xml v617>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000096a:[<0x20000001e50/article-8.xml v1139>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.392 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.083+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b87 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-25.jpg auth{0=1} v1173 ap=1 s=38031 n(v0 rc2024-03-27T07:26:14.593072+0000 b38031 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abec3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b87:[<0x20000001e50/picture-25.jpg v1173>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b87:[<0x20000001e50/picture-25.jpg v1173>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.392 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.084+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a15 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-31.jpg auth{0=1} v1149 ap=1 s=53065 n(v0 rc2024-03-27T07:26:05.804245+0000 b53065 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607add7db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a15:[<0x20000001e50/picture-31.jpg v968>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a15:[<0x20000001e50/picture-31.jpg v1149>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.392 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.084+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e9f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-68.xml auth{0=1} v296 ap=1 s=2699 n(v0 rc2024-03-27T07:25:53.273492+0000 b2699 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607add7e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e9f:[<0x20000001e50/article-68.xml v296>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e9f:[<0x20000001e50/article-68.xml v296>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.392 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.085+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e85 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-76.xml auth{0=1} v276 ap=1 s=24280 n(v0 rc2024-03-27T07:25:53.204493+0000 b24280 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607add7f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e85:[<0x20000001e50/article-76.xml v276>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e85:[<0x20000001e50/article-76.xml v276>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.392 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.085+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013a0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-8.jpg auth{0=1} v1210 ap=1 s=41654 n(v0 rc2024-03-27T07:27:09.021001+0000 b41654 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013a0:[<0x20000001e50/picture-8.jpg v1198>,<0x10000000399/blog-53 v117676>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000013a0:[<0x20000001e50/picture-8.jpg v1210>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.392 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.086+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b83 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-26.jpg auth{0=1} v1171 ap=1 s=32993 n(v0 rc2024-03-27T07:26:14.453074+0000 b32993 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0d6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b83:[<0x20000001e50/picture-26.jpg v1171>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b83:[<0x20000001e50/picture-26.jpg v1171>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.392 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.087+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-42.jpg auth{0=1} v1153 ap=1 s=41161 n(v0 rc2024-03-27T07:26:05.731246+0000 b41161 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab33d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a0a:[<0x20000001e50/picture-42.jpg v898>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a0a:[<0x20000001e50/picture-42.jpg v1153>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.392 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.087+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ea [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-68.jpg auth{0=1} v1161 ap=1 s=45451 n(v0 rc2024-03-27T07:26:04.251275+0000 b45451 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab33d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ea:[<0x20000001e50/picture-68.jpg v740>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009ea:[<0x20000001e50/picture-68.jpg v1161>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.393 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.087+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ff [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-49.jpg auth{0=1} v1153 ap=1 s=28434 n(v0 rc2024-03-27T07:26:05.359253+0000 b28434 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607add7ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ff:[<0x20000001e50/picture-49.jpg v854>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009ff:[<0x20000001e50/picture-49.jpg v1153>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.393 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.087+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000093e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-32.xml auth{0=1} v1151 ap=1 s=8865 n(v0 rc2024-03-27T07:26:02.409312+0000 b8865 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0d6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000093e:[<0x20000001e50/article-32.xml v470>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000093e:[<0x20000001e50/article-32.xml v1151>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.393 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.087+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b0a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-83.xml auth{0=1} v1378 ap=1 s=6879 n(v0 rc2024-03-27T07:27:35.103490+0000 b6879 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad0d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b0a:[<0x20000001e50/comment-83.xml v1230>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b0a:[<0x20000001e50/comment-83.xml v1378>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.401 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.088+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001acb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-89.xml auth{0=1} v1380 ap=1 s=5336 n(v0 rc2024-03-27T07:27:34.368505+0000 b5336 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad0d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001acb:[<0x20000001e50/comment-89.xml v1228>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001acb:[<0x20000001e50/comment-89.xml v1380>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.401 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.088+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000941 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-30.xml auth{0=1} v1147 ap=1 s=25537 n(v0 rc2024-03-27T07:26:02.499310+0000 b25537 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000941:[<0x20000001e50/article-30.xml v482>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000941:[<0x20000001e50/article-30.xml v1147>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.401 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.088+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-13.xml auth{0=1} v1141 ap=1 s=10816 n(v0 rc2024-03-27T07:26:02.850303+0000 b10816 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad9d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095f:[<0x20000001e50/article-13.xml v584>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000095f:[<0x20000001e50/article-13.xml v1141>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.401 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.089+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000951 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-21.xml auth{0=1} v1143 ap=1 s=20756 n(v0 rc2024-03-27T07:26:02.666307+0000 b20756 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000951:[<0x20000001e50/article-21.xml v536>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000951:[<0x20000001e50/article-21.xml v1143>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.401 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.089+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ac9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-90.xml auth{0=1} v1382 ap=1 s=8547 n(v0 rc2024-03-27T07:27:34.357505+0000 b8547 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad0d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ac9:[<0x20000001e50/comment-90.xml v1226>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ac9:[<0x20000001e50/comment-90.xml v1382>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.401 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.089+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000914 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-50.xml auth{0=1} v1155 ap=1 s=8462 n(v0 rc2024-03-27T07:25:59.154376+0000 b8462 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad9dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000914:[<0x20000001e50/article-50.xml v340>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000914:[<0x20000001e50/article-50.xml v1155>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.401 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.090+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-6.xml auth{0=1} v1137 ap=1 s=8666 n(v0 rc2024-03-27T07:26:02.993300+0000 b8666 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad9db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000096e:[<0x20000001e50/article-6.xml v629>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000096e:[<0x20000001e50/article-6.xml v1137>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.401 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.091+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-54.jpg auth{0=1} v1157 ap=1 s=47006 n(v0 rc2024-03-27T07:26:05.012260+0000 b47006 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad435080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f9:[<0x20000001e50/picture-54.jpg v824>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009f9:[<0x20000001e50/picture-54.jpg v1157>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.401 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.091+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-2.xml auth{0=1} v1135 ap=1 s=21101 n(v0 rc2024-03-27T07:26:03.095298+0000 b21101 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad9db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097e:[<0x20000001e50/article-2.xml v653>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000097e:[<0x20000001e50/article-2.xml v1135>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.091+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e5a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-90.xml auth{0=1} v282 ap=1 s=21936 n(v0 rc2024-03-27T07:25:53.089495+0000 b21936 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad435600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e5a:[<0x20000001e50/article-90.xml v282>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e5a:[<0x20000001e50/article-90.xml v282>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.092+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b18 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-81.xml auth{0=1} v1371 ap=1 s=7270 n(v0 rc2024-03-27T07:27:35.245487+0000 b7270 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac884100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b18:[<0x20000001e50/comment-81.xml v1234>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b18:[<0x20000001e50/comment-81.xml v1371>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.092+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bf2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-3.jpg auth{0=1} v1174 ap=1 s=15250 n(v0 rc2024-03-27T07:26:16.033043+0000 b15250 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac885180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bf2:[<0x20000001e50/picture-3.jpg v1174>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bf2:[<0x20000001e50/picture-3.jpg v1174>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.092+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-55.jpg auth{0=1} v1142 ap=1 s=24611 n(v0 rc2024-03-27T07:26:04.943262+0000 b24611 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab5e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f8:[<0x20000001e50/picture-55.jpg v818>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009f8:[<0x20000001e50/picture-55.jpg v1142>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.094+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ec3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-56.xml auth{0=1} v1161 ap=1 s=18550 n(v0 rc2024-03-27T07:25:53.383489+0000 b18550 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad437180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ec3:[<0x20000001e50/article-56.xml v995>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001ec3:[<0x20000001e50/article-56.xml v1161>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.094+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-11.jpg auth{0=1} v1164 ap=1 s=33796 n(v0 rc2024-03-27T07:26:15.801048+0000 b33796 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab5e3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcf:[<0x20000001e50/picture-11.jpg v1164>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bcf:[<0x20000001e50/picture-11.jpg v1164>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.094+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-70.jpg auth{0=1} v1146 ap=1 s=64340 n(v0 rc2024-03-27T07:26:04.090278+0000 b64340 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab5e4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009e8:[<0x20000001e50/picture-70.jpg v728>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009e8:[<0x20000001e50/picture-70.jpg v1146>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.095+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a17 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-29.jpg auth{0=1} v1145 ap=1 s=28292 n(v0 rc2024-03-27T07:26:05.925242+0000 b28292 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad435b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a17:[<0x20000001e50/picture-29.jpg v980>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a17:[<0x20000001e50/picture-29.jpg v1145>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.096+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001aff [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-85.xml auth{0=1} v1373 ap=1 s=6823 n(v0 rc2024-03-27T07:27:34.964493+0000 b6823 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ab5e3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001aff:[<0x20000001e50/comment-85.xml v1230>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001aff:[<0x20000001e50/comment-85.xml v1373>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.096+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000935 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-34.xml auth{0=1} v1136 ap=1 s=17292 n(v0 rc2024-03-27T07:26:02.332313+0000 b17292 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab5e4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000935:[<0x20000001e50/article-34.xml v458>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000935:[<0x20000001e50/article-34.xml v1136>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.402 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.096+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e75 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-81.xml auth{0=1} v264 ap=1 s=28354 n(v0 rc2024-03-27T07:25:53.160494+0000 b28354 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8ac5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e75:[<0x20000001e50/article-81.xml v264>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e75:[<0x20000001e50/article-81.xml v264>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.097+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-71.jpg auth{0=1} v1148 ap=1 s=13370 n(v0 rc2024-03-27T07:26:03.989280+0000 b13370 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8ac6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009e5:[<0x20000001e50/picture-71.jpg v722>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009e5:[<0x20000001e50/picture-71.jpg v1148>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.098+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000972 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-5.xml auth{0=1} v1130 ap=1 s=17251 n(v0 rc2024-03-27T07:26:03.036299+0000 b17251 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab5e4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000972:[<0x20000001e50/article-5.xml v635>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000972:[<0x20000001e50/article-5.xml v1130>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.098+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e7e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-78.xml auth{0=1} v244 ap=1 s=1149 n(v0 rc2024-03-27T07:25:53.183493+0000 b1149 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8ac5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e7e:[<0x20000001e50/article-78.xml v244>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e7e:[<0x20000001e50/article-78.xml v244>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.098+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001eb7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-60.xml auth{0=1} v280 ap=1 s=6738 n(v0 rc2024-03-27T07:25:53.332490+0000 b6738 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8ac6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001eb7:[<0x20000001e50/article-60.xml v280>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001eb7:[<0x20000001e50/article-60.xml v280>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.099+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-40.jpg auth{0=1} v1138 ap=1 s=40075 n(v0 rc2024-03-27T07:26:05.742246+0000 b40075 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8ac7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a0c:[<0x20000001e50/picture-40.jpg v910>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a0c:[<0x20000001e50/picture-40.jpg v1138>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.099+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-63.jpg auth{0=1} v1144 ap=1 s=44395 n(v0 rc2024-03-27T07:26:04.477271+0000 b44395 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8ac7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f0:[<0x20000001e50/picture-63.jpg v770>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009f0:[<0x20000001e50/picture-63.jpg v1144>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.099+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000950 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-22.xml auth{0=1} v1132 ap=1 s=30311 n(v0 rc2024-03-27T07:26:02.661307+0000 b30311 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aadaeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000950:[<0x20000001e50/article-22.xml v530>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000950:[<0x20000001e50/article-22.xml v1132>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.099+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000916 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-49.xml auth{0=1} v1140 ap=1 s=2542 n(v0 rc2024-03-27T07:25:59.249374+0000 b2542 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aadb0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000916:[<0x20000001e50/article-49.xml v346>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000916:[<0x20000001e50/article-49.xml v1140>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.100+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b24 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-80.xml auth{0=1} v1369 ap=1 s=7262 n(v0 rc2024-03-27T07:27:35.315486+0000 b7262 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607aadb1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b24:[<0x20000001e50/comment-80.xml v1236>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b24:[<0x20000001e50/comment-80.xml v1369>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.100+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b8d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-23.jpg auth{0=1} v1168 ap=1 s=21354 n(v0 rc2024-03-27T07:26:14.851066+0000 b21354 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acda4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b8d:[<0x20000001e50/picture-23.jpg v1168>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b8d:[<0x20000001e50/picture-23.jpg v1168>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.403 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.100+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000989 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-79.jpg auth{0=1} v1146 ap=1 s=54242 n(v0 rc2024-03-27T07:26:03.372293+0000 b54242 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acda4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000989:[<0x20000001e50/picture-79.jpg v671>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000989:[<0x20000001e50/picture-79.jpg v1146>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.101+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-14.xml auth{0=1} v1112 ap=1 s=3396 n(v0 rc2024-03-27T07:26:02.808304+0000 b3396 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acda5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095d:[<0x20000001e50/article-14.xml v578>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000095d:[<0x20000001e50/article-14.xml v1112>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.101+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-41.jpg auth{0=1} v1122 ap=1 s=32127 n(v0 rc2024-03-27T07:26:05.735246+0000 b32127 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad118000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a0b:[<0x20000001e50/picture-41.jpg v904>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a0b:[<0x20000001e50/picture-41.jpg v1122>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.101+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e6c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-84.xml auth{0=1} v308 ap=1 s=16934 n(v0 rc2024-03-27T07:25:53.137494+0000 b16934 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad118580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e6c:[<0x20000001e50/article-84.xml v308>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e6c:[<0x20000001e50/article-84.xml v308>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.101+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b81 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-60.jpg auth{0=1} v1160 ap=1 s=30831 n(v0 rc2024-03-27T07:26:14.438075+0000 b30831 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad119600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b81:[<0x20000001e50/picture-60.jpg v1160>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b81:[<0x20000001e50/picture-60.jpg v1160>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.101+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ec [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-66.jpg auth{0=1} v1142 ap=1 s=35388 n(v0 rc2024-03-27T07:26:04.349273+0000 b35388 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad11ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ec:[<0x20000001e50/picture-66.jpg v752>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009ec:[<0x20000001e50/picture-66.jpg v1142>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.102+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e57 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-91.xml auth{0=1} v286 ap=1 s=28936 n(v0 rc2024-03-27T07:25:53.081495+0000 b28936 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad11a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e57:[<0x20000001e50/article-91.xml v286>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e57:[<0x20000001e50/article-91.xml v286>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.102+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000091e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-46.xml auth{0=1} v1128 ap=1 s=24788 n(v0 rc2024-03-27T07:25:59.539368+0000 b24788 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad11a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000091e:[<0x20000001e50/article-46.xml v372>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000091e:[<0x20000001e50/article-46.xml v1128>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.102+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000091c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-47.xml auth{0=1} v1132 ap=1 s=21919 n(v0 rc2024-03-27T07:25:59.462370+0000 b21919 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad4ec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000091c:[<0x20000001e50/article-47.xml v364>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000091c:[<0x20000001e50/article-47.xml v1132>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.102+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e95 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-71.xml auth{0=1} v256 ap=1 s=12402 n(v0 rc2024-03-27T07:25:53.249492+0000 b12402 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad4ec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e95:[<0x20000001e50/article-71.xml v256>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e95:[<0x20000001e50/article-71.xml v256>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.103+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000964 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-11.xml auth{0=1} v1110 ap=1 s=11625 n(v0 rc2024-03-27T07:26:02.894302+0000 b11625 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad4ed600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000964:[<0x20000001e50/article-11.xml v598>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000964:[<0x20000001e50/article-11.xml v1110>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.404 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.103+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a04 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-45.jpg auth{0=1} v1126 ap=1 s=57135 n(v0 rc2024-03-27T07:26:05.526250+0000 b57135 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acda5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a04:[<0x20000001e50/picture-45.jpg v878>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a04:[<0x20000001e50/picture-45.jpg v1126>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.103+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b91 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-22.jpg auth{0=1} v1166 ap=1 s=33105 n(v0 rc2024-03-27T07:26:14.966064+0000 b33105 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad4ecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b91:[<0x20000001e50/picture-22.jpg v1166>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b91:[<0x20000001e50/picture-22.jpg v1166>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.103+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000983 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-80.jpg auth{0=1} v1148 ap=1 s=56254 n(v0 rc2024-03-27T07:26:03.241295+0000 b56254 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad11b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000983:[<0x20000001e50/picture-80.jpg v665>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000983:[<0x20000001e50/picture-80.jpg v1148>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.103+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-16.xml auth{0=1} v1114 ap=1 s=11652 n(v0 rc2024-03-27T07:26:02.746305+0000 b11652 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad4ee680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095a:[<0x20000001e50/article-16.xml v566>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000095a:[<0x20000001e50/article-16.xml v1114>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.104+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ec9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-54.xml auth{0=1} v1136 ap=1 s=10219 n(v0 rc2024-03-27T07:25:53.508487+0000 b10219 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad4ef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ec9:[<0x20000001e50/article-54.xml v999>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001ec9:[<0x20000001e50/article-54.xml v1136>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.104+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000948 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-26.xml auth{0=1} v1118 ap=1 s=8754 n(v0 rc2024-03-27T07:26:02.592308+0000 b8754 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc70000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000948:[<0x20000001e50/article-26.xml v506>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000948:[<0x20000001e50/article-26.xml v1118>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.104+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bb4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-15.jpg auth{0=1} v1178 ap=1 s=27606 n(v0 rc2024-03-27T07:26:15.526053+0000 b27606 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc70580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bb4:[<0x20000001e50/picture-15.jpg v1178>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bb4:[<0x20000001e50/picture-15.jpg v1178>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.104+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-56.jpg auth{0=1} v1138 ap=1 s=49082 n(v0 rc2024-03-27T07:26:04.866263+0000 b49082 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc71080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f7:[<0x20000001e50/picture-56.jpg v812>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009f7:[<0x20000001e50/picture-56.jpg v1138>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.105+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000966 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-10.xml auth{0=1} v1108 ap=1 s=17105 n(v0 rc2024-03-27T07:26:02.901302+0000 b17105 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc71b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000966:[<0x20000001e50/article-10.xml v605>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000966:[<0x20000001e50/article-10.xml v1108>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.105+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000149d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-12.jpg auth{0=1} v1204 ap=1 s=62813 n(v0 rc2024-03-27T07:27:10.485973+0000 b62813 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc72680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000149d:[<0x20000001e50/picture-12.jpg v1191>,<0x10000000399/blog-53 v117676>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x1000000149d:[<0x20000001e50/picture-12.jpg v1204>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.105+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a05 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-44.jpg auth{0=1} v1124 ap=1 s=52439 n(v0 rc2024-03-27T07:26:05.584249+0000 b52439 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc72c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a05:[<0x20000001e50/picture-44.jpg v884>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a05:[<0x20000001e50/picture-44.jpg v1124>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.405 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.105+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a02 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-47.jpg auth{0=1} v1130 ap=1 s=29961 n(v0 rc2024-03-27T07:26:05.484251+0000 b29961 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc71600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a02:[<0x20000001e50/picture-47.jpg v866>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a02:[<0x20000001e50/picture-47.jpg v1130>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.406 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.105+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000919 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-48.xml auth{0=1} v1134 ap=1 s=3349 n(v0 rc2024-03-27T07:25:59.402371+0000 b3349 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5d0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000919:[<0x20000001e50/article-48.xml v358>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000919:[<0x20000001e50/article-48.xml v1134>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.406 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.106+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000978 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-4.xml auth{0=1} v1106 ap=1 s=3222 n(v0 rc2024-03-27T07:26:03.079298+0000 b3222 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5d1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000978:[<0x20000001e50/article-4.xml v641>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000978:[<0x20000001e50/article-4.xml v1106>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.406 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.106+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-59.jpg auth{0=1} v1140 ap=1 s=21349 n(v0 rc2024-03-27T07:26:04.649267+0000 b21349 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5d2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f4:[<0x20000001e50/picture-59.jpg v794>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009f4:[<0x20000001e50/picture-59.jpg v1140>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.406 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.106+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-38.xml auth{0=1} v1120 ap=1 s=15861 n(v0 rc2024-03-27T07:25:59.963360+0000 b15861 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5d3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092e:[<0x20000001e50/article-38.xml v421>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000092e:[<0x20000001e50/article-38.xml v1120>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.406 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.108+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009db [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-72.jpg auth{0=1} v1144 ap=1 s=38140 n(v0 rc2024-03-27T07:26:03.930282+0000 b38140 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5d2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009db:[<0x20000001e50/picture-72.jpg v716>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009db:[<0x20000001e50/picture-72.jpg v1144>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.406 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.108+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e92 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-72.xml auth{0=1} v248 ap=1 s=19317 n(v0 rc2024-03-27T07:25:53.241492+0000 b19317 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a94ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e92:[<0x20000001e50/article-72.xml v248>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e92:[<0x20000001e50/article-72.xml v248>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.406 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.108+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b96 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-21.jpg auth{0=1} v1173 ap=1 s=40372 n(v0 rc2024-03-27T07:26:15.090062+0000 b40372 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a94cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b96:[<0x20000001e50/picture-21.jpg v1173>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b96:[<0x20000001e50/picture-21.jpg v1173>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.406 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.109+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e51 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-93.xml auth{0=1} v298 ap=1 s=1532 n(v0 rc2024-03-27T07:25:53.062496+0000 b1532 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acc70b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e51:[<0x20000001e50/article-93.xml v298>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e51:[<0x20000001e50/article-93.xml v298>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.109+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b98 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-35.xml auth{0=1} v1177 ap=1 s=15001 n(v0 rc2024-03-27T07:26:15.096062+0000 b15001 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac346000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b98:[<0x20000001e50/article-35.xml v1177>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b98:[<0x20000001e50/article-35.xml v1177>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.109+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ce [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-73.jpg auth{0=1} v1159 ap=1 s=10925 n(v0 rc2024-03-27T07:26:03.894282+0000 b10925 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a94cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ce:[<0x20000001e50/picture-73.jpg v710>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009ce:[<0x20000001e50/picture-73.jpg v1159>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.110+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009c3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-75.jpg auth{0=1} v1161 ap=1 s=50624 n(v0 rc2024-03-27T07:26:03.716286+0000 b50624 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac347600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009c3:[<0x20000001e50/picture-75.jpg v698>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009c3:[<0x20000001e50/picture-75.jpg v1161>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.110+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000934 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-86.xml auth{0=1} v1163 ap=1 s=31812 n(v0 rc2024-03-27T07:26:02.321313+0000 b31812 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac348100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000934:[<0x20000001e50/article-86.xml v453>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000934:[<0x20000001e50/article-86.xml v1163>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.110+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a55 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-96.xml auth{0=1} v1216 ap=1 s=5923 n(v0 rc2024-03-27T07:27:25.458679+0000 b5923 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac349180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a55:[<0x20000001e50/comment-96.xml v1209>,<0x10000000399/blog-53 v126199>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a55:[<0x20000001e50/comment-96.xml v1216>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.111+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-40.xml auth{0=1} v1153 ap=1 s=19007 n(v0 rc2024-03-27T07:25:59.947360+0000 b19007 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab068000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092c:[<0x20000001e50/article-40.xml v409>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000092c:[<0x20000001e50/article-40.xml v1153>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.111+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a16 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-30.jpg auth{0=1} v1147 ap=1 s=53932 n(v0 rc2024-03-27T07:26:05.877243+0000 b53932 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab068580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a16:[<0x20000001e50/picture-30.jpg v974>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a16:[<0x20000001e50/picture-30.jpg v1147>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.111+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001acd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-88.xml auth{0=1} v1397 ap=1 s=9324 n(v0 rc2024-03-27T07:27:34.376504+0000 b9324 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ab069080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001acd:[<0x20000001e50/comment-88.xml v1226>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001acd:[<0x20000001e50/comment-88.xml v1397>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.111+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-15.xml auth{0=1} v1143 ap=1 s=28186 n(v0 rc2024-03-27T07:26:02.802304+0000 b28186 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab069600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095b:[<0x20000001e50/article-15.xml v572>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000095b:[<0x20000001e50/article-15.xml v1143>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.113+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ad5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-86.xml auth{0=1} v1395 ap=1 s=4807 n(v0 rc2024-03-27T07:27:34.926494+0000 b4807 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607adb62580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ad5:[<0x20000001e50/comment-86.xml v1228>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ad5:[<0x20000001e50/comment-86.xml v1395>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.407 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.114+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000094a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-25.xml auth{0=1} v1116 ap=1 s=27690 n(v0 rc2024-03-27T07:26:02.597308+0000 b27690 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5d1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000094a:[<0x20000001e50/article-25.xml v512>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000094a:[<0x20000001e50/article-25.xml v1116>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.114+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e72 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-82.xml auth{0=1} v306 ap=1 s=2617 n(v0 rc2024-03-27T07:25:53.153494+0000 b2617 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab068b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e72:[<0x20000001e50/article-82.xml v306>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e72:[<0x20000001e50/article-82.xml v306>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.114+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a10 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-36.jpg auth{0=1} v1149 ap=1 s=61348 n(v0 rc2024-03-27T07:26:05.770245+0000 b61348 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adb62b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a10:[<0x20000001e50/picture-36.jpg v934>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a10:[<0x20000001e50/picture-36.jpg v1149>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.114+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a08 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-43.jpg auth{0=1} v1157 ap=1 s=43327 n(v0 rc2024-03-27T07:26:05.617248+0000 b43327 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adb63080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a08:[<0x20000001e50/picture-43.jpg v890>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a08:[<0x20000001e50/picture-43.jpg v1157>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.114+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b9c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-20.jpg auth{0=1} v1179 ap=1 s=10116 n(v0 rc2024-03-27T07:26:15.190060+0000 b10116 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adb63b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b9c:[<0x20000001e50/picture-20.jpg v1179>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b9c:[<0x20000001e50/picture-20.jpg v1179>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.115+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b11 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-82.xml auth{0=1} v1393 ap=1 s=3959 n(v0 rc2024-03-27T07:27:35.190488+0000 b3959 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607adb64c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b11:[<0x20000001e50/comment-82.xml v1233>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b11:[<0x20000001e50/comment-82.xml v1393>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.115+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014a1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-89.xml auth{0=1} v1211 ap=1 s=23853 n(v0 rc2024-03-27T07:27:10.507972+0000 b23853 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adb64680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014a1:[<0x20000001e50/article-89.xml v1201>,<0x10000000399/blog-53 v117676>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000014a1:[<0x20000001e50/article-89.xml v1211>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.115+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000953 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-19.xml auth{0=1} v1145 ap=1 s=27162 n(v0 rc2024-03-27T07:26:02.728305+0000 b27162 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adb63600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000953:[<0x20000001e50/article-19.xml v548>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000953:[<0x20000001e50/article-19.xml v1145>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.116+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000928 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-42.xml auth{0=1} v1155 ap=1 s=23627 n(v0 rc2024-03-27T07:25:59.819363+0000 b23627 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aad81b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000928:[<0x20000001e50/article-42.xml v397>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000928:[<0x20000001e50/article-42.xml v1155>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.116+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ac5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-91.xml auth{0=1} v1399 ap=1 s=6994 n(v0 rc2024-03-27T07:27:34.087510+0000 b6994 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607aad82100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ac5:[<0x20000001e50/comment-91.xml v1222>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ac5:[<0x20000001e50/comment-91.xml v1399>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.117+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a0e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-38.jpg auth{0=1} v1151 ap=1 s=25768 n(v0 rc2024-03-27T07:26:05.756246+0000 b25768 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aad82680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a0e:[<0x20000001e50/picture-38.jpg v922>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a0e:[<0x20000001e50/picture-38.jpg v1151>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.117+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001f18 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-64.xml auth{0=1} v1391 ap=1 s=25364 n(v0 rc2024-03-27T07:27:41.413367+0000 b25364 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607aa380100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001f18:[<0x20000001e50/article-64.xml v1367>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001f18:[<0x20000001e50/article-64.xml v1391>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.408 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.119+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e63 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-87.xml auth{0=1} v278 ap=1 s=19744 n(v0 rc2024-03-27T07:25:53.112495+0000 b19744 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a996e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e63:[<0x20000001e50/article-87.xml v278>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e63:[<0x20000001e50/article-87.xml v278>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.119+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e89 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-75.xml auth{0=1} v266 ap=1 s=30320 n(v0 rc2024-03-27T07:25:53.217493+0000 b30320 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a82d0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e89:[<0x20000001e50/article-75.xml v266>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e89:[<0x20000001e50/article-75.xml v266>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.119+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-37.xml auth{0=1} v1005 ap=1 s=10818 n(v0 rc2024-03-27T07:26:02.178316+0000 b10818 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9abd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092f:[<0x20000001e50/article-37.xml v1005>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000092f:[<0x20000001e50/article-37.xml v1005>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.119+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a19 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-27.jpg auth{0=1} v1010 ap=1 s=28259 n(v0 rc2024-03-27T07:26:14.325077+0000 b28259 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/-@1},l=15291(-1) | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9f3e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a19:[<0x20000001e50/picture-27.jpg v1010>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000a19:[<0x20000001e50/picture-27.jpg v1010>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.120+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e8f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-73.xml auth{0=1} v310 ap=1 s=23205 n(v0 rc2024-03-27T07:25:53.233492+0000 b23205 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9f3e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e8f:[<0x20000001e50/article-73.xml v310>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e8f:[<0x20000001e50/article-73.xml v310>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.120+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f2e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-36.xml auth{0=1} v1210 ap=1 s=9232 n(v0 rc2024-03-27T07:26:58.611205+0000 b9232 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9f3fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f2e:[<0x20000001e50/article-36.xml v1199>,<0x10000000399/blog-53 v117676>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f2e:[<0x20000001e50/article-36.xml v1210>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.120+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000963 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-12.xml auth{0=1} v1146 ap=1 s=18000 n(v0 rc2024-03-27T07:26:02.857303+0000 b18000 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9f40100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000963:[<0x20000001e50/article-12.xml v590>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000963:[<0x20000001e50/article-12.xml v1146>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.120+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000980 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-1.xml auth{0=1} v1144 ap=1 s=32112 n(v0 rc2024-03-27T07:26:03.113298+0000 b32112 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9f40c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000980:[<0x20000001e50/article-1.xml v659>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000980:[<0x20000001e50/article-1.xml v1144>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.121+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009fa [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-53.jpg auth{0=1} v1164 ap=1 s=48501 n(v0 rc2024-03-27T07:26:05.062259+0000 b48501 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9ce580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009fa:[<0x20000001e50/picture-53.jpg v830>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009fa:[<0x20000001e50/picture-53.jpg v1164>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.121+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000092d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-39.xml auth{0=1} v1158 ap=1 s=28960 n(v0 rc2024-03-27T07:25:59.956360+0000 b28960 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9f3f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000092d:[<0x20000001e50/article-39.xml v415>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000092d:[<0x20000001e50/article-39.xml v1158>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.121+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009fb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-52.jpg auth{0=1} v1162 ap=1 s=56868 n(v0 rc2024-03-27T07:26:05.199257+0000 b56868 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9f40680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009fb:[<0x20000001e50/picture-52.jpg v836>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009fb:[<0x20000001e50/picture-52.jpg v1162>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.122+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a12 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-34.jpg auth{0=1} v1154 ap=1 s=60595 n(v0 rc2024-03-27T07:26:05.783245+0000 b60595 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a12:[<0x20000001e50/picture-34.jpg v946>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a12:[<0x20000001e50/picture-34.jpg v1154>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.409 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.122+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009eb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-67.jpg auth{0=1} v1166 ap=1 s=31768 n(v0 rc2024-03-27T07:26:04.258275+0000 b31768 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009eb:[<0x20000001e50/picture-67.jpg v746>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009eb:[<0x20000001e50/picture-67.jpg v1166>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.122+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ea5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-66.xml auth{0=1} v252 ap=1 s=18990 n(v0 rc2024-03-27T07:25:53.287491+0000 b18990 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ea5:[<0x20000001e50/article-66.xml v252>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001ea5:[<0x20000001e50/article-66.xml v252>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.123+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001acf [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-87.xml auth{0=1} v1389 ap=1 s=9769 n(v0 rc2024-03-27T07:27:34.410504+0000 b9769 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607abf87600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001acf:[<0x20000001e50/comment-87.xml v1223>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001acf:[<0x20000001e50/comment-87.xml v1389>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.123+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009cc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-74.jpg auth{0=1} v1168 ap=1 s=31163 n(v0 rc2024-03-27T07:26:03.799284+0000 b31163 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf86580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009cc:[<0x20000001e50/picture-74.jpg v704>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009cc:[<0x20000001e50/picture-74.jpg v1168>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.124+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e82 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-77.xml auth{0=1} v246 ap=1 s=7829 n(v0 rc2024-03-27T07:25:53.192493+0000 b7829 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e82:[<0x20000001e50/article-77.xml v246>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e82:[<0x20000001e50/article-77.xml v246>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.124+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000094f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-23.xml auth{0=1} v1150 ap=1 s=32240 n(v0 rc2024-03-27T07:26:02.657307+0000 b32240 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf88c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000094f:[<0x20000001e50/article-23.xml v524>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x1000000094f:[<0x20000001e50/article-23.xml v1150>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.124+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000958 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-17.xml auth{0=1} v1148 ap=1 s=27634 n(v0 rc2024-03-27T07:26:02.740305+0000 b27634 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf89180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000958:[<0x20000001e50/article-17.xml v560>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000958:[<0x20000001e50/article-17.xml v1148>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.124+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a14 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-32.jpg auth{0=1} v1152 ap=1 s=15612 n(v0 rc2024-03-27T07:26:05.793245+0000 b15612 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc90000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a14:[<0x20000001e50/picture-32.jpg v958>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a14:[<0x20000001e50/picture-32.jpg v1152>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.125+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a01 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-48.jpg auth{0=1} v1160 ap=1 s=21836 n(v0 rc2024-03-27T07:26:05.475251+0000 b21836 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc90b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a01:[<0x20000001e50/picture-48.jpg v860>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a01:[<0x20000001e50/picture-48.jpg v1160>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.125+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001eae [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-63.xml auth{0=1} v260 ap=1 s=6690 n(v0 rc2024-03-27T07:25:53.310491+0000 b6690 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adc90580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001eae:[<0x20000001e50/article-63.xml v260>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001eae:[<0x20000001e50/article-63.xml v260>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.126+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000937 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-33.xml auth{0=1} v1141 ap=1 s=12479 n(v0 rc2024-03-27T07:26:02.391312+0000 b12479 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ae08b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000937:[<0x20000001e50/article-33.xml v464>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000937:[<0x20000001e50/article-33.xml v1141>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.127+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000be9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-5.jpg auth{0=1} v1189 ap=1 s=21125 n(v0 rc2024-03-27T07:26:15.964045+0000 b21125 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab464580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000be9:[<0x20000001e50/picture-5.jpg v1189>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000be9:[<0x20000001e50/picture-5.jpg v1189>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.410 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.127+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000baf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-16.jpg auth{0=1} v1190 ap=1 s=49849 n(v0 rc2024-03-27T07:26:15.498054+0000 b49849 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000baf:[<0x20000001e50/picture-16.jpg v1190>,<0x10000000399/blog-53 v94676>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000baf:[<0x20000001e50/picture-16.jpg v1190>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.411 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.127+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009fd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-50.jpg auth{0=1} v1147 ap=1 s=12536 n(v0 rc2024-03-27T07:26:05.325254+0000 b12536 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab465600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009fd:[<0x20000001e50/picture-50.jpg v848>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009fd:[<0x20000001e50/picture-50.jpg v1147>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.411 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.128+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-58.jpg auth{0=1} v1153 ap=1 s=34351 n(v0 rc2024-03-27T07:26:04.698266+0000 b34351 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab466100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f5:[<0x20000001e50/picture-58.jpg v800>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009f5:[<0x20000001e50/picture-58.jpg v1153>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.411 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.129+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009b2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-76.jpg auth{0=1} v1170 ap=1 s=31013 n(v0 rc2024-03-27T07:26:03.630288+0000 b31013 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf89700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009b2:[<0x20000001e50/picture-76.jpg v691>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009b2:[<0x20000001e50/picture-76.jpg v1170>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.411 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.130+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ac0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-93.xml auth{0=1} v1381 ap=1 s=4269 n(v0 rc2024-03-27T07:27:33.966512+0000 b4269 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ab464000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ac0:[<0x20000001e50/comment-93.xml v1218>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ac0:[<0x20000001e50/comment-93.xml v1381>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.411 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.130+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009ee [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-65.jpg auth{0=1} v1159 ap=1 s=47415 n(v0 rc2024-03-27T07:26:04.362273+0000 b47415 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbfc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009ee:[<0x20000001e50/picture-65.jpg v758>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009ee:[<0x20000001e50/picture-65.jpg v1159>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.411 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.130+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e7b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-79.xml auth{0=1} v288 ap=1 s=18178 n(v0 rc2024-03-27T07:25:53.175493+0000 b18178 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbfd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e7b:[<0x20000001e50/article-79.xml v288>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001e7b:[<0x20000001e50/article-79.xml v288>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.411 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.130+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ec0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-57.xml auth{0=1} v1151 ap=1 s=27148 n(v0 rc2024-03-27T07:25:53.355490+0000 b27148 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab466c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ec0:[<0x20000001e50/article-57.xml v996>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001ec0:[<0x20000001e50/article-57.xml v1151>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.411 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.131+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ecc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-53.xml auth{0=1} v314 ap=1 s=15978 n(v0 rc2024-03-27T07:25:54.109475+0000 b15978 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbff180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ecc:[<0x20000001e50/article-53.xml v314>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001ecc:[<0x20000001e50/article-53.xml v314>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.411 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.131+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000945 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-28.xml auth{0=1} v1139 ap=1 s=22278 n(v0 rc2024-03-27T07:26:02.509310+0000 b22278 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000945:[<0x20000001e50/article-28.xml v494>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000945:[<0x20000001e50/article-28.xml v1139>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.411 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.132+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ed1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-52.xml auth{0=1} v998 ap=1 s=31654 n(v0 rc2024-03-27T07:25:58.725384+0000 b31654 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ed1:[<0x20000001e50/article-52.xml v998>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001ed1:[<0x20000001e50/article-52.xml v998>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.132+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-77.jpg auth{0=1} v1163 ap=1 s=18131 n(v0 rc2024-03-27T07:26:03.508290+0000 b18131 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a6:[<0x20000001e50/picture-77.jpg v683>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009a6:[<0x20000001e50/picture-77.jpg v1163>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.132+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ebd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-58.xml auth{0=1} v1155 ap=1 s=7488 n(v0 rc2024-03-27T07:25:53.347490+0000 b7488 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbfec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ebd:[<0x20000001e50/article-58.xml v997>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x20000001ebd:[<0x20000001e50/article-58.xml v1155>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.133+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009e9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-69.jpg auth{0=1} v1161 ap=1 s=11089 n(v0 rc2024-03-27T07:26:04.204276+0000 b11089 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7d8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009e9:[<0x20000001e50/picture-69.jpg v734>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009e9:[<0x20000001e50/picture-69.jpg v1161>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.133+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009fc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-51.jpg auth{0=1} v1149 ap=1 s=8767 n(v0 rc2024-03-27T07:26:05.293255+0000 b8767 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009fc:[<0x20000001e50/picture-51.jpg v842>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009fc:[<0x20000001e50/picture-51.jpg v1149>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.133+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009f1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-62.jpg auth{0=1} v1157 ap=1 s=38837 n(v0 rc2024-03-27T07:26:04.524270+0000 b38837 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad9b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009f1:[<0x20000001e50/picture-62.jpg v776>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x100000009f1:[<0x20000001e50/picture-62.jpg v1157>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.133+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b05 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-84.xml auth{0=1} v1379 ap=1 s=7760 n(v0 rc2024-03-27T07:27:35.011492+0000 b7760 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad9b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b05:[<0x20000001e50/comment-84.xml v1226>,<0x10000000399/blog-53 v133389>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b05:[<0x20000001e50/comment-84.xml v1379>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.133+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a03 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-46.jpg auth{0=1} v1145 ap=1 s=59502 n(v0 rc2024-03-27T07:26:05.522250+0000 b59502 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad9b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a03:[<0x20000001e50/picture-46.jpg v872>,<0x10000000399/blog-53 v70933>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2007>,<0x10000000006/blogbench-1.0 v1767>,<0x10000000005/tmp v47>,<0x100000001fb/client.0 v46>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v60>,<0x10000000001/sv_1 v84>,<0x10000000000/qa v74>,<0x1/volumes v66>]//[]","memoryvalue":"(3)0x10000000a03:[<0x20000001e50/picture-46.jpg v1145>,<0x10000000399/blog-53 v146110>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.380+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d46 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-13.jpg auth v284 ap=1 s=11066 n(v0 rc2024-03-27T07:25:52.091515+0000 b11066 1=1+0) | authpin=1 scrubqueue=0 0x5607a9c9db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d46:[<0x20000001d20/picture-13.jpg v208>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d46:[<0x20000001d20/picture-13.jpg v284>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.380+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d34 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-19.jpg auth v272 ap=1 s=55537 n(v0 rc2024-03-27T07:25:51.996517+0000 b55537 1=1+0) | authpin=1 scrubqueue=0 0x5607ac6df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d34:[<0x20000001d20/picture-19.jpg v182>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d34:[<0x20000001d20/picture-19.jpg v272>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d37 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-18.jpg auth v274 ap=1 s=32718 n(v0 rc2024-03-27T07:25:52.012516+0000 b32718 1=1+0) | authpin=1 scrubqueue=0 0x5607ab434680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d37:[<0x20000001d20/picture-18.jpg v186>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d37:[<0x20000001d20/picture-18.jpg v274>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d62 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-4.jpg auth v302 ap=1 s=27489 n(v0 rc2024-03-27T07:25:52.161513+0000 b27489 1=1+0) | authpin=1 scrubqueue=0 0x5607abc88b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d62:[<0x20000001d20/picture-4.jpg v170>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d62:[<0x20000001d20/picture-4.jpg v302>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000093a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-69.xml auth v230 ap=1 s=13029 n(v0 rc2024-03-27T07:26:02.369312+0000 b13029 1=1+0) | authpin=1 scrubqueue=0 0x5607a9426c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000093a:[<0x20000001d20/article-69.xml v220>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x1000000093a:[<0x20000001d20/article-69.xml v230>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.412 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d68 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-2.jpg auth{0=1} v172 ap=1 s=24003 n(v0 rc2024-03-27T07:25:52.179513+0000 b24003 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac54f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d68:[<0x20000001d20/picture-2.jpg v172>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d68:[<0x20000001d20/picture-2.jpg v172>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d43 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-14.jpg auth v282 ap=1 s=42198 n(v0 rc2024-03-27T07:25:52.078515+0000 b42198 1=1+0) | authpin=1 scrubqueue=0 0x5607ac6dfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d43:[<0x20000001d20/picture-14.jpg v190>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d43:[<0x20000001d20/picture-14.jpg v282>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.381+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d58 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-7.jpg auth v296 ap=1 s=60509 n(v0 rc2024-03-27T07:25:52.141514+0000 b60509 1=1+0) | authpin=1 scrubqueue=0 0x5607a780ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d58:[<0x20000001d20/picture-7.jpg v158>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d58:[<0x20000001d20/picture-7.jpg v296>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.382+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d52 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-9.jpg auth v292 ap=1 s=21330 n(v0 rc2024-03-27T07:25:52.127514+0000 b21330 1=1+0) | authpin=1 scrubqueue=0 0x5607a8e66b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d52:[<0x20000001d20/picture-9.jpg v194>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d52:[<0x20000001d20/picture-9.jpg v292>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.382+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d5c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-6.jpg auth v298 ap=1 s=32480 n(v0 rc2024-03-27T07:25:52.147514+0000 b32480 1=1+0) | authpin=1 scrubqueue=0 0x5607a73e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d5c:[<0x20000001d20/picture-6.jpg v188>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d5c:[<0x20000001d20/picture-6.jpg v298>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.382+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001858 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-24.xml auth v338 ap=1 s=25521 n(v0 rc2024-03-27T07:27:18.845809+0000 b25521 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aa34bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001858:[<0x20000001d20/article-24.xml v321>,<0x10000000399/blog-49 v120714>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001858:[<0x20000001d20/article-24.xml v338>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.382+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d4f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-10.jpg auth v290 ap=1 s=25223 n(v0 rc2024-03-27T07:25:52.119514+0000 b25223 1=1+0) | authpin=1 scrubqueue=0 0x5607a902ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d4f:[<0x20000001d20/picture-10.jpg v166>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d4f:[<0x20000001d20/picture-10.jpg v290>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.383+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d3a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-17.jpg auth v276 ap=1 s=52307 n(v0 rc2024-03-27T07:25:52.034516+0000 b52307 1=1+0) | authpin=1 scrubqueue=0 0x5607ac263600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d3a:[<0x20000001d20/picture-17.jpg v160>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d3a:[<0x20000001d20/picture-17.jpg v276>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.383+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d6b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-1.jpg auth v210 ap=1 s=12897 n(v0 rc2024-03-27T07:25:52.187513+0000 b12897 1=1+0) caps={15291=pAsLsXsFscr/pFscr@3},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607aa0ad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d6b:[<0x20000001d20/picture-1.jpg v210>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d6b:[<0x20000001d20/picture-1.jpg v210>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.383+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d27 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-24.jpg auth v262 ap=1 s=44338 n(v0 rc2024-03-27T07:25:51.902519+0000 b44338 1=1+0) | authpin=1 scrubqueue=0 0x5607ad9b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d27:[<0x20000001d20/picture-24.jpg v176>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d27:[<0x20000001d20/picture-24.jpg v262>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.384+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d90 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-2.xml auth{0=1} v257 ap=1 s=28382 n(v0 rc2024-03-27T07:26:46.176449+0000 b28382 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa34d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d90:[<0x20000001d20/article-2.xml v257>,<0x10000000399/blog-49 v115600>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d90:[<0x20000001d20/article-2.xml v257>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.384+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d65 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-3.jpg auth{0=1} v184 ap=1 s=39677 n(v0 rc2024-03-27T07:25:52.171513+0000 b39677 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9e78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d65:[<0x20000001d20/picture-3.jpg v184>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d65:[<0x20000001d20/picture-3.jpg v184>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.413 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.385+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d4c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-11.jpg auth v288 ap=1 s=20232 n(v0 rc2024-03-27T07:25:52.107514+0000 b20232 1=1+0) | authpin=1 scrubqueue=0 0x5607a7b71700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d4c:[<0x20000001d20/picture-11.jpg v168>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d4c:[<0x20000001d20/picture-11.jpg v288>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.385+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d55 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-8.jpg auth v294 ap=1 s=25300 n(v0 rc2024-03-27T07:25:52.134514+0000 b25300 1=1+0) | authpin=1 scrubqueue=0 0x5607aa7aeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d55:[<0x20000001d20/picture-8.jpg v202>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d55:[<0x20000001d20/picture-8.jpg v294>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.386+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d5f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-5.jpg auth v300 ap=1 s=21376 n(v0 rc2024-03-27T07:25:52.153514+0000 b21376 1=1+0) | authpin=1 scrubqueue=0 0x5607aa8edb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d5f:[<0x20000001d20/picture-5.jpg v206>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d5f:[<0x20000001d20/picture-5.jpg v300>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.386+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000143e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-29.xml auth v333 ap=1 s=12341 n(v0 rc2024-03-27T07:27:10.028982+0000 b12341 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a9e79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000143e:[<0x20000001d20/article-29.xml v307>,<0x10000000399/blog-49 v118308>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x1000000143e:[<0x20000001d20/article-29.xml v333>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.386+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000920 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-22.xml auth v228 ap=1 s=6845 n(v0 rc2024-03-27T07:25:59.610367+0000 b6845 1=1+0) | authpin=1 scrubqueue=0 0x5607a8fd9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000920:[<0x20000001d20/article-22.xml v214>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x10000000920:[<0x20000001d20/article-22.xml v228>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.387+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001855 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-45.jpg auth v336 ap=1 s=52583 n(v0 rc2024-03-27T07:27:18.784810+0000 b52583 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a9e7a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001855:[<0x20000001d20/picture-45.jpg v315>,<0x10000000399/blog-49 v120714>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001855:[<0x20000001d20/picture-45.jpg v336>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.387+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d29 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-23.jpg auth v264 ap=1 s=11499 n(v0 rc2024-03-27T07:25:51.920518+0000 b11499 1=1+0) | authpin=1 scrubqueue=0 0x5607abf01700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d29:[<0x20000001d20/picture-23.jpg v162>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d29:[<0x20000001d20/picture-23.jpg v264>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.387+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001932 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-43.xml auth v340 ap=1 s=10590 n(v0 rc2024-03-27T07:27:21.953748+0000 b10590 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a9e78000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001932:[<0x20000001d20/article-43.xml v327>,<0x10000000399/blog-49 v120714>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001932:[<0x20000001d20/article-43.xml v340>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.388+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d2c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-22.jpg auth v266 ap=1 s=9101 n(v0 rc2024-03-27T07:25:51.949518+0000 b9101 1=1+0) | authpin=1 scrubqueue=0 0x5607add9f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d2c:[<0x20000001d20/picture-22.jpg v192>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d2c:[<0x20000001d20/picture-22.jpg v266>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.388+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c79 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-11.xml auth v253 ap=1 s=9050 n(v0 rc2024-03-27T07:26:22.867909+0000 b9050 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a9e7b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c79:[<0x20000001d20/article-11.xml v234>,<0x10000000399/blog-49 v94686>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c79:[<0x20000001d20/article-11.xml v253>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.388+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d49 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-12.jpg auth v286 ap=1 s=49682 n(v0 rc2024-03-27T07:25:52.099515+0000 b49682 1=1+0) | authpin=1 scrubqueue=0 0x5607ad2fa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d49:[<0x20000001d20/picture-12.jpg v198>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d49:[<0x20000001d20/picture-12.jpg v286>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.414 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.388+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d8a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-52.jpg auth v259 ap=1 s=47311 n(v0 rc2024-03-27T07:26:46.161450+0000 b47311 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aa6c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d8a:[<0x20000001d20/picture-52.jpg v259>,<0x10000000399/blog-49 v115600>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d8a:[<0x20000001d20/picture-52.jpg v259>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.415 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.389+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d40 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-15.jpg auth v280 ap=1 s=61036 n(v0 rc2024-03-27T07:25:52.062515+0000 b61036 1=1+0) | authpin=1 scrubqueue=0 0x5607abe1eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d40:[<0x20000001d20/picture-15.jpg v178>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d40:[<0x20000001d20/picture-15.jpg v280>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.415 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.389+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d2e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-21.jpg auth v268 ap=1 s=27941 n(v0 rc2024-03-27T07:25:51.962517+0000 b27941 1=1+0) | authpin=1 scrubqueue=0 0x5607ad053600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d2e:[<0x20000001d20/picture-21.jpg v200>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d2e:[<0x20000001d20/picture-21.jpg v268>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.415 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.389+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d31 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-20.jpg auth v270 ap=1 s=36398 n(v0 rc2024-03-27T07:25:51.981517+0000 b36398 1=1+0) | authpin=1 scrubqueue=0 0x5607ad96b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d31:[<0x20000001d20/picture-20.jpg v164>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d31:[<0x20000001d20/picture-20.jpg v270>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.415 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.389+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d3d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-16.jpg auth v278 ap=1 s=54895 n(v0 rc2024-03-27T07:25:52.050516+0000 b54895 1=1+0) | authpin=1 scrubqueue=0 0x5607ac264100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d3d:[<0x20000001d20/picture-16.jpg v196>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d3d:[<0x20000001d20/picture-16.jpg v278>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.415 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.389+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d24 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-1.xml auth{0=1} v174 ap=1 s=30999 n(v0 rc2024-03-27T07:25:51.878519+0000 b30999 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa6c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d24:[<0x20000001d20/article-1.xml v174>,<0x10000000399/blog-49 v61781>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d24:[<0x20000001d20/article-1.xml v174>,<0x10000000399/blog-49 v144005>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.647 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.533+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002929 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-18.jpg auth v700 ap=1 s=15915 n(v0 rc2024-03-27T07:26:13.808087+0000 b15915 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ada9b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002929:[<0x20000002890/picture-18.jpg v700>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002929:[<0x20000002890/picture-18.jpg v700>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.647 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.533+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002927 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-19.jpg auth v642 ap=1 s=52906 n(v0 rc2024-03-27T07:26:13.797087+0000 b52906 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad7c6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002927:[<0x20000002890/picture-19.jpg v642>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002927:[<0x20000002890/picture-19.jpg v642>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.647 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.533+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000207d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-29.xml auth{0=1} v1208 ap=1 s=5823 n(v0 rc2024-03-27T07:27:44.254311+0000 b5823 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad7c6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000207d:[<0x20000002890/comment-29.xml v1154>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x1000000207d:[<0x20000002890/comment-29.xml v1208>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.647 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.533+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002933 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-13.jpg auth{0=1} v564 ap=1 s=21616 n(v0 rc2024-03-27T07:26:13.867086+0000 b21616 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ada9b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002933:[<0x20000002890/picture-13.jpg v564>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002933:[<0x20000002890/picture-13.jpg v564>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.647 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.533+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002906 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-35.jpg auth v580 ap=1 s=26779 n(v0 rc2024-03-27T07:26:13.655090+0000 b26779 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad7c7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002906:[<0x20000002890/picture-35.jpg v580>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002906:[<0x20000002890/picture-35.jpg v580>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.647 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.534+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028d2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-61.jpg auth v574 ap=1 s=43526 n(v0 rc2024-03-27T07:26:13.563092+0000 b43526 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad7c9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028d2:[<0x20000002890/picture-61.jpg v574>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028d2:[<0x20000002890/picture-61.jpg v574>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.647 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.534+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002949 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-2.jpg auth{0=1} v636 ap=1 s=14268 n(v0 rc2024-03-27T07:26:13.992083+0000 b14268 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7c7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002949:[<0x20000002890/picture-2.jpg v636>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002949:[<0x20000002890/picture-2.jpg v636>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.648 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000003382 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-94) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.648 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: pgmap v146: 97 pgs: 97 active+clean; 959 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 456 op/s 2024-03-27T07:28:22.648 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000189b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.648 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.648 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.648 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.648 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.649 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.649 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.649 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.649 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001de3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.649 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.649 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001da7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.649 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.649 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.649 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.649 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.534+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028b0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-78.jpg auth v612 ap=1 s=13004 n(v0 rc2024-03-27T07:26:13.509093+0000 b13004 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad7c8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028b0:[<0x20000002890/picture-78.jpg v612>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028b0:[<0x20000002890/picture-78.jpg v612>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.650 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.535+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000293b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-9.jpg auth{0=1} v588 ap=1 s=12552 n(v0 rc2024-03-27T07:26:13.909085+0000 b12552 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac8f8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000293b:[<0x20000002890/picture-9.jpg v588>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000293b:[<0x20000002890/picture-9.jpg v588>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.650 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.650 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.650 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.650 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ddf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.651 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.652 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.536+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019c1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-93.jpg auth v1113 ap=1 s=27248 n(v0 rc2024-03-27T07:27:23.339721+0000 b27248 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad7c8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019c1:[<0x20000002890/picture-93.jpg v1103>,<0x10000000399/blog-71 v120713>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019c1:[<0x20000002890/picture-93.jpg v1113>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.652 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.536+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002931 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-14.jpg auth v714 ap=1 s=20841 n(v0 rc2024-03-27T07:26:13.856086+0000 b20841 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad7c8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002931:[<0x20000002890/picture-14.jpg v714>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002931:[<0x20000002890/picture-14.jpg v714>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.652 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.536+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002059 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-37.xml auth{0=1} v1206 ap=1 s=2627 n(v0 rc2024-03-27T07:27:43.406327+0000 b2627 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607acf72580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002059:[<0x20000002890/comment-37.xml v1134>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002059:[<0x20000002890/comment-37.xml v1206>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.652 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.537+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028cc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-64.jpg auth v652 ap=1 s=9007 n(v0 rc2024-03-27T07:26:13.554092+0000 b9007 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aaf71700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028cc:[<0x20000002890/picture-64.jpg v652>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028cc:[<0x20000002890/picture-64.jpg v652>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.652 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.537+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002939 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-10.jpg auth{0=1} v694 ap=1 s=26022 n(v0 rc2024-03-27T07:26:13.896085+0000 b26022 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf72b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002939:[<0x20000002890/picture-10.jpg v694>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002939:[<0x20000002890/picture-10.jpg v694>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.652 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.537+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002898 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-9.xml auth{0=1} v604 ap=1 s=16581 n(v0 rc2024-03-27T07:26:13.420095+0000 b16581 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf73b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002898:[<0x20000002890/article-9.xml v604>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002898:[<0x20000002890/article-9.xml v604>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.652 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.539+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000294b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-1.jpg auth{0=1} v594 ap=1 s=15988 n(v0 rc2024-03-27T07:26:14.001083+0000 b15988 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf73080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000294b:[<0x20000002890/picture-1.jpg v594>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000294b:[<0x20000002890/picture-1.jpg v594>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.652 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.539+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002941 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-6.jpg auth{0=1} v602 ap=1 s=24461 n(v0 rc2024-03-27T07:26:13.947084+0000 b24461 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf74100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002941:[<0x20000002890/picture-6.jpg v602>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002941:[<0x20000002890/picture-6.jpg v602>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.653 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.653 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.653 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.653 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.653 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001da2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.653 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.653 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.653 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.653 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.653 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.654 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.654 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.654 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.654 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.654 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.654 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.654 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.540+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002043 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-41.xml auth{0=1} v1208 ap=1 s=2368 n(v0 rc2024-03-27T07:27:43.280330+0000 b2368 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607acf75700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002043:[<0x20000002890/comment-41.xml v1127>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002043:[<0x20000002890/comment-41.xml v1208>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.655 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.540+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002902 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-37.jpg auth v708 ap=1 s=18410 n(v0 rc2024-03-27T07:26:13.649090+0000 b18410 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aadfe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002902:[<0x20000002890/picture-37.jpg v708>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002902:[<0x20000002890/picture-37.jpg v708>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.655 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.541+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000292b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-17.jpg auth v668 ap=1 s=42093 n(v0 rc2024-03-27T07:26:13.820087+0000 b42093 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aadfe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000292b:[<0x20000002890/picture-17.jpg v668>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000292b:[<0x20000002890/picture-17.jpg v668>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.655 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.541+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028a4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-3.xml auth{0=1} v704 ap=1 s=25806 n(v0 rc2024-03-27T07:26:13.438094+0000 b25806 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aadfeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028a4:[<0x20000002890/article-3.xml v704>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028a4:[<0x20000002890/article-3.xml v704>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.655 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.541+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002064 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-34.xml auth{0=1} v1204 ap=1 s=4200 n(v0 rc2024-03-27T07:27:43.651323+0000 b4200 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607acf74680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002064:[<0x20000002890/comment-34.xml v1143>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002064:[<0x20000002890/comment-34.xml v1204>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.655 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001db8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.655 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.655 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ddc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.655 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001df8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.655 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.655 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001df1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001db5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.656 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.657 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.542+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000290a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-33.jpg auth v624 ap=1 s=29304 n(v0 rc2024-03-27T07:26:13.662090+0000 b29304 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aadff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000290a:[<0x20000002890/picture-33.jpg v624>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000290a:[<0x20000002890/picture-33.jpg v624>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.657 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.543+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028da [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-57.jpg auth v678 ap=1 s=27200 n(v0 rc2024-03-27T07:26:13.575092+0000 b27200 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aadffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028da:[<0x20000002890/picture-57.jpg v678>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028da:[<0x20000002890/picture-57.jpg v678>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.657 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.543+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002915 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-28.jpg auth v632 ap=1 s=42562 n(v0 rc2024-03-27T07:26:13.694089+0000 b42562 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acf75180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002915:[<0x20000002890/picture-28.jpg v632>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002915:[<0x20000002890/picture-28.jpg v632>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.657 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.543+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000293f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-7.jpg auth{0=1} v690 ap=1 s=56798 n(v0 rc2024-03-27T07:26:13.934085+0000 b56798 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7c9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000293f:[<0x20000002890/picture-7.jpg v690>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000293f:[<0x20000002890/picture-7.jpg v690>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.657 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.544+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028c4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-68.jpg auth v572 ap=1 s=39506 n(v0 rc2024-03-27T07:26:13.541092+0000 b39506 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aae00c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028c4:[<0x20000002890/picture-68.jpg v572>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028c4:[<0x20000002890/picture-68.jpg v572>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001de6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001da4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001db0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001da9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001df4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001db3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.658 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ded (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.659 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.659 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000034d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-99) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.659 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001811 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-40) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.659 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ff0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-57) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.659 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.544+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000291d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-24.jpg auth v648 ap=1 s=35838 n(v0 rc2024-03-27T07:26:13.746088+0000 b35838 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aadff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000291d:[<0x20000002890/picture-24.jpg v648>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000291d:[<0x20000002890/picture-24.jpg v648>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.659 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.544+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019e3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-80.xml auth v1124 ap=1 s=7383 n(v0 rc2024-03-27T07:27:24.677694+0000 b7383 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acf72000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019e3:[<0x20000002890/article-80.xml v1104>,<0x10000000399/blog-71 v120713>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019e3:[<0x20000002890/article-80.xml v1124>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.659 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.544+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000289c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-7.xml auth{0=1} v682 ap=1 s=9248 n(v0 rc2024-03-27T07:26:13.426095+0000 b9248 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aae00100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000289c:[<0x20000002890/article-7.xml v682>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000289c:[<0x20000002890/article-7.xml v682>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.660 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.545+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028f8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-42.jpg auth v662 ap=1 s=59315 n(v0 rc2024-03-27T07:26:13.633090+0000 b59315 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aae00680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028f8:[<0x20000002890/picture-42.jpg v662>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028f8:[<0x20000002890/picture-42.jpg v662>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.660 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.545+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000291b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-25.jpg auth v740 ap=1 s=25443 n(v0 rc2024-03-27T07:26:13.734088+0000 b25443 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ade67180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000291b:[<0x20000002890/picture-25.jpg v740>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000291b:[<0x20000002890/picture-25.jpg v740>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.660 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000eac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.660 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001057 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.660 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001044 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.660 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.660 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.660 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000169b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.660 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001041 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.661 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ecb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.661 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.661 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001079 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.661 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.661 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001001 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.661 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000012a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-93.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.661 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001081 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.661 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.661 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001053 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.661 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.545+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019c3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-8.xml auth{0=1} v1103 ap=1 s=2740 n(v0 rc2024-03-27T07:27:23.366720+0000 b2740 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adca2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019c3:[<0x20000002890/article-8.xml v1103>,<0x10000000399/blog-71 v120713>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019c3:[<0x20000002890/article-8.xml v1103>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.546+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-47.xml auth{0=1} v1113 ap=1 s=4877 n(v0 rc2024-03-27T07:27:02.920121+0000 b4877 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adca2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100e:[<0x20000002890/comment-47.xml v811>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x1000000100e:[<0x20000002890/comment-47.xml v1113>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.546+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001015 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-46.xml auth{0=1} v1111 ap=1 s=8092 n(v0 rc2024-03-27T07:27:02.978120+0000 b8092 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adca2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001015:[<0x20000002890/comment-46.xml v817>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000001015:[<0x20000002890/comment-46.xml v1111>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.546+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028ea [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-49.jpg auth v576 ap=1 s=56278 n(v0 rc2024-03-27T07:26:13.601091+0000 b56278 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607adca3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028ea:[<0x20000002890/picture-49.jpg v576>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028ea:[<0x20000002890/picture-49.jpg v576>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.662 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.546+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000293d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-8.jpg auth{0=1} v738 ap=1 s=57267 n(v0 rc2024-03-27T07:26:13.921085+0000 b57267 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adca3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000293d:[<0x20000002890/picture-8.jpg v738>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000293d:[<0x20000002890/picture-8.jpg v738>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ee6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000efb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000106d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001066 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000166e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001660 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ebb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001029 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.663 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000160e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.664 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001610 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.664 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001010 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.664 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.664 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.547+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002919 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-26.jpg auth v616 ap=1 s=63661 n(v0 rc2024-03-27T07:26:13.721089+0000 b63661 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607adca4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002919:[<0x20000002890/picture-26.jpg v616>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002919:[<0x20000002890/picture-26.jpg v616>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.664 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.547+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028fe [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-39.jpg auth v568 ap=1 s=58725 n(v0 rc2024-03-27T07:26:13.643090+0000 b58725 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aae01180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028fe:[<0x20000002890/picture-39.jpg v568>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028fe:[<0x20000002890/picture-39.jpg v568>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000106a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001025 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000162d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.665 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ed0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001667 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000865 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001661 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000eb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000165e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.666 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.667 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001617 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.667 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ef0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.667 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.667 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.667 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001075 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.667 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001655 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.667 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.547+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000205d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-36.xml auth{0=1} v1204 ap=1 s=5715 n(v0 rc2024-03-27T07:27:43.607324+0000 b5715 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607adca4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000205d:[<0x20000002890/comment-36.xml v1138>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x1000000205d:[<0x20000002890/comment-36.xml v1204>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.667 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.548+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028a6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-2.xml auth{0=1} v672 ap=1 s=1385 n(v0 rc2024-03-27T07:26:13.441094+0000 b1385 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adca5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028a6:[<0x20000002890/article-2.xml v672>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028a6:[<0x20000002890/article-2.xml v672>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.548+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028e0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-54.jpg auth v680 ap=1 s=61407 n(v0 rc2024-03-27T07:26:13.585091+0000 b61407 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acbc0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028e0:[<0x20000002890/picture-54.jpg v680>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028e0:[<0x20000002890/picture-54.jpg v680>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.550+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000290f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-31.jpg auth v582 ap=1 s=58222 n(v0 rc2024-03-27T07:26:13.673090+0000 b58222 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607adca3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000290f:[<0x20000002890/picture-31.jpg v582>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000290f:[<0x20000002890/picture-31.jpg v582>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.550+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000289e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-6.xml auth{0=1} v600 ap=1 s=22320 n(v0 rc2024-03-27T07:26:13.429094+0000 b22320 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adca5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000289e:[<0x20000002890/article-6.xml v600>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000289e:[<0x20000002890/article-6.xml v600>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.550+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002913 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-29.jpg auth v686 ap=1 s=13456 n(v0 rc2024-03-27T07:26:13.686089+0000 b13456 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acbc0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002913:[<0x20000002890/picture-29.jpg v686>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002913:[<0x20000002890/picture-29.jpg v686>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.550+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001025 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-44.xml auth{0=1} v1117 ap=1 s=6618 n(v0 rc2024-03-27T07:27:03.097117+0000 b6618 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7d6cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001025:[<0x20000002890/comment-44.xml v829>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000001025:[<0x20000002890/comment-44.xml v1117>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.551+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028aa [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-81.jpg auth v630 ap=1 s=29078 n(v0 rc2024-03-27T07:26:13.499093+0000 b29078 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a873b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028aa:[<0x20000002890/picture-81.jpg v630>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028aa:[<0x20000002890/picture-81.jpg v630>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.551+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028e8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-50.jpg auth v698 ap=1 s=9012 n(v0 rc2024-03-27T07:26:13.598091+0000 b9012 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a7ee2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028e8:[<0x20000002890/picture-50.jpg v698>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028e8:[<0x20000002890/picture-50.jpg v698>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.551+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028d8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-58.jpg auth v730 ap=1 s=21852 n(v0 rc2024-03-27T07:26:13.572092+0000 b21852 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a7ee0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028d8:[<0x20000002890/picture-58.jpg v730>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028d8:[<0x20000002890/picture-58.jpg v730>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.551+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fe4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-52.xml auth{0=1} v1099 ap=1 s=8339 n(v0 rc2024-03-27T07:27:02.682125+0000 b8339 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7d5ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fe4:[<0x20000002890/comment-52.xml v781>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000fe4:[<0x20000002890/comment-52.xml v1099>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.668 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.551+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028ca [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-65.jpg auth v654 ap=1 s=17835 n(v0 rc2024-03-27T07:26:13.550092+0000 b17835 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a7d58580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028ca:[<0x20000002890/picture-65.jpg v654>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028ca:[<0x20000002890/picture-65.jpg v654>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000eb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001681 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001665 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000eb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ec4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001619 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.669 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001663 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001678 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ec8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001613 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.670 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001673 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.552+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000102d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-43.xml auth{0=1} v1115 ap=1 s=2067 n(v0 rc2024-03-27T07:27:03.162116+0000 b2067 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9c8a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000102d:[<0x20000002890/comment-43.xml v835>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x1000000102d:[<0x20000002890/comment-43.xml v1115>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.670 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.552+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002943 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-5.jpg auth{0=1} v722 ap=1 s=20438 n(v0 rc2024-03-27T07:26:13.959084+0000 b20438 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a82f2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002943:[<0x20000002890/picture-5.jpg v722>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002943:[<0x20000002890/picture-5.jpg v722>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.553+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028e6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-51.jpg auth v684 ap=1 s=39113 n(v0 rc2024-03-27T07:26:13.595091+0000 b39113 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8a23080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028e6:[<0x20000002890/picture-51.jpg v684>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028e6:[<0x20000002890/picture-51.jpg v684>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.553+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-45.xml auth{0=1} v1119 ap=1 s=4219 n(v0 rc2024-03-27T07:27:03.033119+0000 b4219 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7db5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101d:[<0x20000002890/comment-45.xml v823>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x1000000101d:[<0x20000002890/comment-45.xml v1119>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.671 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.553+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028f0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-46.jpg auth v666 ap=1 s=9020 n(v0 rc2024-03-27T07:26:13.611091+0000 b9020 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac9a6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028f0:[<0x20000002890/picture-46.jpg v666>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028f0:[<0x20000002890/picture-46.jpg v666>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.671 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000107d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.671 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.671 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001692 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.671 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.671 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000105e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.671 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.671 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.672 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000162f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.672 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.672 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f76 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.672 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.672 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ff3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.672 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.672 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.672 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001627 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.672 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.553+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000291f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-23.jpg auth v692 ap=1 s=47061 n(v0 rc2024-03-27T07:26:13.757088+0000 b47061 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ade0d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000291f:[<0x20000002890/picture-23.jpg v692>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000291f:[<0x20000002890/picture-23.jpg v692>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.554+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028f2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-45.jpg auth v712 ap=1 s=13114 n(v0 rc2024-03-27T07:26:13.617091+0000 b13114 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae20a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028f2:[<0x20000002890/picture-45.jpg v712>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028f2:[<0x20000002890/picture-45.jpg v712>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.554+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028fa [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-41.jpg auth v626 ap=1 s=27704 n(v0 rc2024-03-27T07:26:13.636090+0000 b27704 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae20a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028fa:[<0x20000002890/picture-41.jpg v626>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028fa:[<0x20000002890/picture-41.jpg v626>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.555+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028d4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-60.jpg auth v726 ap=1 s=33047 n(v0 rc2024-03-27T07:26:13.566092+0000 b33047 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae20ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028d4:[<0x20000002890/picture-60.jpg v726>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028d4:[<0x20000002890/picture-60.jpg v726>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.555+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028d0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-62.jpg auth v660 ap=1 s=50437 n(v0 rc2024-03-27T07:26:13.560092+0000 b50437 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac9a6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028d0:[<0x20000002890/picture-62.jpg v660>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028d0:[<0x20000002890/picture-62.jpg v660>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.673 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.556+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028ae [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-79.jpg auth v562 ap=1 s=62983 n(v0 rc2024-03-27T07:26:13.506093+0000 b62983 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ade0d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028ae:[<0x20000002890/picture-79.jpg v562>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028ae:[<0x20000002890/picture-79.jpg v562>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ed5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.673 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000167b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001031 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fe1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ff0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000edd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ee1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001035 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.674 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ec0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.556+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028ac [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-80.jpg auth v744 ap=1 s=15810 n(v0 rc2024-03-27T07:26:13.502093+0000 b15810 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae20b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028ac:[<0x20000002890/picture-80.jpg v744>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028ac:[<0x20000002890/picture-80.jpg v744>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.675 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.556+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002894 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-11.xml auth{0=1} v724 ap=1 s=25179 n(v0 rc2024-03-27T07:26:13.414095+0000 b25179 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ae20c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002894:[<0x20000002890/article-11.xml v724>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002894:[<0x20000002890/article-11.xml v724>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001050 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.675 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fa1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000105b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fe6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001600 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ed8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000160a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000163d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001669 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000165f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001659 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.676 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.556+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002921 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-22.jpg auth v742 ap=1 s=46270 n(v0 rc2024-03-27T07:26:13.767088+0000 b46270 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae20bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002921:[<0x20000002890/picture-22.jpg v742>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002921:[<0x20000002890/picture-22.jpg v742>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.557+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028dc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-56.jpg auth v628 ap=1 s=21232 n(v0 rc2024-03-27T07:26:13.578092+0000 b21232 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae20cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028dc:[<0x20000002890/picture-56.jpg v628>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028dc:[<0x20000002890/picture-56.jpg v628>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.558+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028ee [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-47.jpg auth v734 ap=1 s=64997 n(v0 rc2024-03-27T07:26:13.607091+0000 b64997 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae20d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028ee:[<0x20000002890/picture-47.jpg v734>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028ee:[<0x20000002890/picture-47.jpg v734>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.558+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002896 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-10.xml auth{0=1} v560 ap=1 s=23772 n(v0 rc2024-03-27T07:26:13.417095+0000 b23772 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ae20d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002896:[<0x20000002890/article-10.xml v560>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002896:[<0x20000002890/article-10.xml v560>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.677 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.559+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002935 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-12.jpg auth{0=1} v586 ap=1 s=46221 n(v0 rc2024-03-27T07:26:13.875086+0000 b46221 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad242000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002935:[<0x20000002890/picture-12.jpg v586>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002935:[<0x20000002890/picture-12.jpg v586>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001021 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001641 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001662 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000104c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000166b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.678 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001605 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.679 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000161d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.679 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.679 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.679 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.560+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028f4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-44.jpg auth v702 ap=1 s=8977 n(v0 rc2024-03-27T07:26:13.623091+0000 b8977 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad242580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028f4:[<0x20000002890/picture-44.jpg v702>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028f4:[<0x20000002890/picture-44.jpg v702>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.560+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ff5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-50.xml auth{0=1} v1103 ap=1 s=3299 n(v0 rc2024-03-27T07:27:02.769124+0000 b3299 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad242b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ff5:[<0x20000002890/comment-50.xml v793>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000ff5:[<0x20000002890/comment-50.xml v1103>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.679 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.562+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028c2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-69.jpg auth v696 ap=1 s=51248 n(v0 rc2024-03-27T07:26:13.538092+0000 b51248 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8a24c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028c2:[<0x20000002890/picture-69.jpg v696>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028c2:[<0x20000002890/picture-69.jpg v696>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.563+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d2f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-77.jpg auth v761 ap=1 s=12325 n(v0 rc2024-03-27T07:26:45.237468+0000 b12325 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8805080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d2f:[<0x20000002890/picture-77.jpg v761>,<0x10000000399/blog-71 v115590>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d2f:[<0x20000002890/picture-77.jpg v761>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.563+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028c8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-66.jpg auth v596 ap=1 s=44457 n(v0 rc2024-03-27T07:26:13.547092+0000 b44457 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae20b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028c8:[<0x20000002890/picture-66.jpg v596>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028c8:[<0x20000002890/picture-66.jpg v596>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000015fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000100c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000162a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001063 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001664 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.680 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fa6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.681 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-83.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.681 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000eeb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.681 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001072 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.681 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.681 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.681 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.681 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001632 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.681 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.563+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000292f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-15.jpg auth v598 ap=1 s=49677 n(v0 rc2024-03-27T07:26:13.843086+0000 b49677 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae20c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000292f:[<0x20000002890/picture-15.jpg v598>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000292f:[<0x20000002890/picture-15.jpg v598>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.563+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028bc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-72.jpg auth v664 ap=1 s=13508 n(v0 rc2024-03-27T07:26:13.528093+0000 b13508 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad244100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028bc:[<0x20000002890/picture-72.jpg v664>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028bc:[<0x20000002890/picture-72.jpg v664>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.564+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028d6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-59.jpg auth v728 ap=1 s=30078 n(v0 rc2024-03-27T07:26:13.569092+0000 b30078 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad244680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028d6:[<0x20000002890/picture-59.jpg v728>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028d6:[<0x20000002890/picture-59.jpg v728>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.564+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028a2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-4.xml auth{0=1} v720 ap=1 s=4737 n(v0 rc2024-03-27T07:26:13.435094+0000 b4737 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad243b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028a2:[<0x20000002890/article-4.xml v720>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028a2:[<0x20000002890/article-4.xml v720>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.682 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.564+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d33 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-48.xml auth v764 ap=1 s=10396 n(v0 rc2024-03-27T07:26:45.252468+0000 b10396 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad243080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d33:[<0x20000002890/article-48.xml v764>,<0x10000000399/blog-71 v115590>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d33:[<0x20000002890/article-48.xml v764>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.682 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000165b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.682 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000101c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.682 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000072f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.682 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000161f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ffb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000102c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001048 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ff6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000165d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000165c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.683 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.565+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028ba [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-73.jpg auth v676 ap=1 s=58357 n(v0 rc2024-03-27T07:26:13.525093+0000 b58357 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607adc92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028ba:[<0x20000002890/picture-73.jpg v676>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028ba:[<0x20000002890/picture-73.jpg v676>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.566+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002044 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-40.xml auth{0=1} v1219 ap=1 s=3918 n(v0 rc2024-03-27T07:27:43.299330+0000 b3918 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad764b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002044:[<0x20000002890/comment-40.xml v1125>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002044:[<0x20000002890/comment-40.xml v1219>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.684 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.566+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001005 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-48.xml auth{0=1} v1107 ap=1 s=6289 n(v0 rc2024-03-27T07:27:02.862122+0000 b6289 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad243600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001005:[<0x20000002890/comment-48.xml v805>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000001005:[<0x20000002890/comment-48.xml v1107>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.684 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001039 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.684 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.684 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001014 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001622 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001635 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001625 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ffe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.685 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000103c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001638 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ef6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ff9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bcd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.686 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.687 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.687 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bde (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.687 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.687 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.566+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002073 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-31.xml auth{0=1} v1163 ap=1 s=6615 n(v0 rc2024-03-27T07:27:43.906318+0000 b6615 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad244c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002073:[<0x20000002890/comment-31.xml v1146>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002073:[<0x20000002890/comment-31.xml v1163>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.687 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.567+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002911 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-30.jpg auth v608 ap=1 s=16690 n(v0 rc2024-03-27T07:26:13.680090+0000 b16690 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad764580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002911:[<0x20000002890/picture-30.jpg v608>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002911:[<0x20000002890/picture-30.jpg v608>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.688 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.567+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002050 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-39.xml auth{0=1} v1217 ap=1 s=4556 n(v0 rc2024-03-27T07:27:43.365328+0000 b4556 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad765600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002050:[<0x20000002890/comment-39.xml v1129>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002050:[<0x20000002890/comment-39.xml v1217>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.688 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.567+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002904 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-36.jpg auth v622 ap=1 s=24281 n(v0 rc2024-03-27T07:26:13.652090+0000 b24281 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad765b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002904:[<0x20000002890/picture-36.jpg v622>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002904:[<0x20000002890/picture-36.jpg v622>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.688 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.567+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028f6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-43.jpg auth v670 ap=1 s=44516 n(v0 rc2024-03-27T07:26:13.629091+0000 b44516 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad766100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028f6:[<0x20000002890/picture-43.jpg v670>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028f6:[<0x20000002890/picture-43.jpg v670>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.688 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.568+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000206d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-32.xml auth{0=1} v1213 ap=1 s=2205 n(v0 rc2024-03-27T07:27:43.759321+0000 b2205 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad766c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000206d:[<0x20000002890/comment-32.xml v1142>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x1000000206d:[<0x20000002890/comment-32.xml v1213>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.688 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.568+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-54.xml auth{0=1} v1099 ap=1 s=5441 n(v0 rc2024-03-27T07:27:02.566128+0000 b5441 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad767180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd0:[<0x20000002890/comment-54.xml v769>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000fd0:[<0x20000002890/comment-54.xml v1099>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.688 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.569+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002900 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-38.jpg auth v706 ap=1 s=59545 n(v0 rc2024-03-27T07:26:13.646090+0000 b59545 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad767700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002900:[<0x20000002890/picture-38.jpg v706>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002900:[<0x20000002890/picture-38.jpg v706>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.688 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.569+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002068 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-33.xml auth{0=1} v1215 ap=1 s=4150 n(v0 rc2024-03-27T07:27:43.672322+0000 b4150 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad765080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002068:[<0x20000002890/comment-33.xml v1137>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002068:[<0x20000002890/comment-33.xml v1215>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.688 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.573+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002917 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-27.jpg auth v688 ap=1 s=64762 n(v0 rc2024-03-27T07:26:13.706089+0000 b64762 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8d10680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002917:[<0x20000002890/picture-27.jpg v688>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002917:[<0x20000002890/picture-27.jpg v688>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.688 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.573+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028b6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-75.jpg auth v566 ap=1 s=47106 n(v0 rc2024-03-27T07:26:13.519093+0000 b47106 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607adc93700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028b6:[<0x20000002890/picture-75.jpg v566>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028b6:[<0x20000002890/picture-75.jpg v566>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.573+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002925 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-20.jpg auth v570 ap=1 s=52661 n(v0 rc2024-03-27T07:26:13.785087+0000 b52661 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad766680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002925:[<0x20000002890/picture-20.jpg v570>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002925:[<0x20000002890/picture-20.jpg v570>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.574+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028e4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-52.jpg auth v620 ap=1 s=10889 n(v0 rc2024-03-27T07:26:13.591091+0000 b10889 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8d11180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028e4:[<0x20000002890/picture-52.jpg v620>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028e4:[<0x20000002890/picture-52.jpg v620>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.574+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028a8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-1.xml auth{0=1} v716 ap=1 s=25999 n(v0 rc2024-03-27T07:26:13.444094+0000 b25999 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8d11700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028a8:[<0x20000002890/article-1.xml v716>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028a8:[<0x20000002890/article-1.xml v716>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ba3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bd9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002b9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.689 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.690 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.690 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bcf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.690 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ba0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.690 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.690 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.690 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ba7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.690 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002b9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.690 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.690 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.690 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.574+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002079 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-30.xml auth{0=1} v1220 ap=1 s=2247 n(v0 rc2024-03-27T07:27:44.039315+0000 b2247 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ab632580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002079:[<0x20000002890/comment-30.xml v1150>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002079:[<0x20000002890/comment-30.xml v1220>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.691 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.575+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028e2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-53.jpg auth v614 ap=1 s=33924 n(v0 rc2024-03-27T07:26:13.588091+0000 b33924 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a9ae4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028e2:[<0x20000002890/picture-53.jpg v614>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028e2:[<0x20000002890/picture-53.jpg v614>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.691 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.575+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028c6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-67.jpg auth v718 ap=1 s=30934 n(v0 rc2024-03-27T07:26:13.544092+0000 b30934 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a81f7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028c6:[<0x20000002890/picture-67.jpg v718>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028c6:[<0x20000002890/picture-67.jpg v718>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.691 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.691 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002b9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.691 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.691 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002baf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.691 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.691 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.691 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002b9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.691 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ba1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.692 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002baa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.692 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.692 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bdb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.692 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.692 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ba6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.692 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.692 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.692 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.693 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.575+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000292d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-16.jpg auth v610 ap=1 s=33127 n(v0 rc2024-03-27T07:26:13.832087+0000 b33127 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8964b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000292d:[<0x20000002890/picture-16.jpg v610>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000292d:[<0x20000002890/picture-16.jpg v610>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.693 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.575+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028b8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-74.jpg auth v578 ap=1 s=32354 n(v0 rc2024-03-27T07:26:13.522093+0000 b32354 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a79f4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028b8:[<0x20000002890/picture-74.jpg v578>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028b8:[<0x20000002890/picture-74.jpg v578>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.693 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.576+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001036 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-42.xml auth{0=1} v1123 ap=1 s=4845 n(v0 rc2024-03-27T07:27:03.224115+0000 b4845 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8c61180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001036:[<0x20000002890/comment-42.xml v841>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000001036:[<0x20000002890/comment-42.xml v1123>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.693 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.576+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002908 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-34.jpg auth v634 ap=1 s=19415 n(v0 rc2024-03-27T07:26:13.659090+0000 b19415 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a9f81600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002908:[<0x20000002890/picture-34.jpg v634>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002908:[<0x20000002890/picture-34.jpg v634>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.693 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.576+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028b4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-76.jpg auth v638 ap=1 s=13273 n(v0 rc2024-03-27T07:26:13.515093+0000 b13273 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a7758100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028b4:[<0x20000002890/picture-76.jpg v638>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028b4:[<0x20000002890/picture-76.jpg v638>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.693 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.577+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fed [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-51.xml auth{0=1} v1109 ap=1 s=2087 n(v0 rc2024-03-27T07:27:02.731125+0000 b2087 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9276100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fed:[<0x20000002890/comment-51.xml v787>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000fed:[<0x20000002890/comment-51.xml v1109>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.693 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.578+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000020cd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-10.xml auth{0=1} v1204 ap=1 s=6041 n(v0 rc2024-03-27T07:27:48.047237+0000 b6041 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac58c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000020cd:[<0x20000002890/comment-10.xml v1204>,<0x10000000399/blog-71 v138336>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000020cd:[<0x20000002890/comment-10.xml v1204>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ba9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002b9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ba4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002b98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.694 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ba8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002b99 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002b9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ba5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bcb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bbc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.695 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001980 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ba2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.696 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.697 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.580+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002947 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-3.jpg auth{0=1} v590 ap=1 s=9036 n(v0 rc2024-03-27T07:26:13.982084+0000 b9036 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac58c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002947:[<0x20000002890/picture-3.jpg v590>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002947:[<0x20000002890/picture-3.jpg v590>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.697 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.581+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000290c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-32.jpg auth v736 ap=1 s=30089 n(v0 rc2024-03-27T07:26:13.668090+0000 b30089 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a8911b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000290c:[<0x20000002890/picture-32.jpg v736>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000290c:[<0x20000002890/picture-32.jpg v736>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.697 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.582+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ffd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-49.xml auth{0=1} v1107 ap=1 s=3229 n(v0 rc2024-03-27T07:27:02.805123+0000 b3229 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a95b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ffd:[<0x20000002890/comment-49.xml v799>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000ffd:[<0x20000002890/comment-49.xml v1107>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.697 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.582+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028ec [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-48.jpg auth v732 ap=1 s=14063 n(v0 rc2024-03-27T07:26:13.604091+0000 b14063 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a822bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028ec:[<0x20000002890/picture-48.jpg v732>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028ec:[<0x20000002890/picture-48.jpg v732>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.697 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.582+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000020e1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-6.xml auth{0=1} v1203 ap=1 s=2999 n(v0 rc2024-03-27T07:27:48.643225+0000 b2999 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac58d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000020e1:[<0x20000002890/comment-6.xml v1203>,<0x10000000399/blog-71 v138336>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000020e1:[<0x20000002890/comment-6.xml v1203>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.697 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.582+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002937 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-11.jpg auth{0=1} v710 ap=1 s=54745 n(v0 rc2024-03-27T07:26:13.885086+0000 b54745 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac58d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002937:[<0x20000002890/picture-11.jpg v710>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002937:[<0x20000002890/picture-11.jpg v710>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.697 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.583+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002060 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-35.xml auth{0=1} v1206 ap=1 s=4844 n(v0 rc2024-03-27T07:27:43.632323+0000 b4844 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002060:[<0x20000002890/comment-35.xml v1134>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002060:[<0x20000002890/comment-35.xml v1206>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.697 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.583+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002083 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-28.xml auth{0=1} v1205 ap=1 s=7548 n(v0 rc2024-03-27T07:27:44.394308+0000 b7548 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002083:[<0x20000002890/comment-28.xml v1205>,<0x10000000399/blog-71 v138336>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002083:[<0x20000002890/comment-28.xml v1205>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.697 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-82.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002bb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000300a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.698 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-93.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002efe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ca4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ca0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001955 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.699 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ef5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ca6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.700 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000197b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.700 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.584+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028be [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-71.jpg auth v618 ap=1 s=48944 n(v0 rc2024-03-27T07:26:13.531092+0000 b48944 1=1+0) | authpin=1 scrubqueue=0 0x5607aea99700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028be:[<0x20000002890/picture-71.jpg v618>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028be:[<0x20000002890/picture-71.jpg v618>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.700 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.591+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fda [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-53.xml auth{0=1} v1106 ap=1 s=5492 n(v0 rc2024-03-27T07:27:02.636126+0000 b5492 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac58cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fda:[<0x20000002890/comment-53.xml v775>,<0x10000000399/blog-71 v118317>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000fda:[<0x20000002890/comment-53.xml v1106>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.700 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.593+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028ce [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-63.jpg auth v606 ap=1 s=50980 n(v0 rc2024-03-27T07:26:13.557092+0000 b50980 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028ce:[<0x20000002890/picture-63.jpg v606>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028ce:[<0x20000002890/picture-63.jpg v606>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.700 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.593+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028c0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-70.jpg auth v650 ap=1 s=17629 n(v0 rc2024-03-27T07:26:13.534092+0000 b17629 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9e8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028c0:[<0x20000002890/picture-70.jpg v650>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028c0:[<0x20000002890/picture-70.jpg v650>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.701 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.594+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001971 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-22.xml auth v1122 ap=1 s=8364 n(v0 rc2024-03-27T07:27:22.469738+0000 b8364 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab9a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001971:[<0x20000002890/article-22.xml v1100>,<0x10000000399/blog-71 v120713>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001971:[<0x20000002890/article-22.xml v1122>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.701 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.597+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000020d7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-8.xml auth{0=1} v1183 ap=1 s=9140 n(v0 rc2024-03-27T07:27:48.256232+0000 b9140 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000020d7:[<0x20000002890/comment-8.xml v1183>,<0x10000000399/blog-71 v138336>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000020d7:[<0x20000002890/comment-8.xml v1183>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.701 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.600+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028de [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-55.jpg auth v658 ap=1 s=35783 n(v0 rc2024-03-27T07:26:13.582091+0000 b35783 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9e8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028de:[<0x20000002890/picture-55.jpg v658>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028de:[<0x20000002890/picture-55.jpg v658>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.701 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.600+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028a0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-5.xml auth{0=1} v656 ap=1 s=16991 n(v0 rc2024-03-27T07:26:13.432094+0000 b16991 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028a0:[<0x20000002890/article-5.xml v656>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028a0:[<0x20000002890/article-5.xml v656>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.701 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.601+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002055 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-38.xml auth{0=1} v1207 ap=1 s=2507 n(v0 rc2024-03-27T07:27:43.385328+0000 b2507 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002055:[<0x20000002890/comment-38.xml v1131>,<0x10000000399/blog-71 v130239>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002055:[<0x20000002890/comment-38.xml v1207>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.701 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.601+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028fc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-40.jpg auth v646 ap=1 s=25148 n(v0 rc2024-03-27T07:26:13.639090+0000 b25148 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028fc:[<0x20000002890/picture-40.jpg v646>,<0x10000000399/blog-71 v92722>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028fc:[<0x20000002890/picture-40.jpg v646>,<0x10000000399/blog-71 v142633>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001982 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.701 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000301e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001940 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000003004 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000003010 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fa6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.702 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ffe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.703 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.643+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000015eb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-55.xml auth v1051 ap=1 s=22820 n(v0 rc2024-03-27T07:25:43.907676+0000 b22820 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9c0d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000015eb:[<0x200000015b5/article-55.xml v1051>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000015eb:[<0x200000015b5/article-55.xml v1051>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.703 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.643+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016ae [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-8.xml auth v1049 ap=1 s=17825 n(v0 rc2024-03-27T07:25:44.758659+0000 b17825 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a848e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016ae:[<0x200000015b5/article-8.xml v1049>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016ae:[<0x200000015b5/article-8.xml v1049>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.703 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.644+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001777 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-25.jpg auth v1043 ap=1 s=44528 n(v0 rc2024-03-27T07:25:45.310648+0000 b44528 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9516000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001777:[<0x200000015b5/picture-25.jpg v1043>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001777:[<0x200000015b5/picture-25.jpg v1043>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.703 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.644+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000175c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-31.jpg auth v1073 ap=1 s=35909 n(v0 rc2024-03-27T07:25:45.161651+0000 b35909 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a7399600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000175c:[<0x200000015b5/picture-31.jpg v1073>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000175c:[<0x200000015b5/picture-31.jpg v1073>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.703 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000302d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001997 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001999 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000003016 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000195a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ca2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000003024 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001922 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.704 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000195c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001946 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000196f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001950 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001911 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001964 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000301b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.705 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.706 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.706 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.706 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000199e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.706 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.706 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ef8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.706 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.645+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000015b8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-68.xml auth v1091 ap=1 s=30047 n(v0 rc2024-03-27T07:25:43.800678+0000 b30047 1=1+0) caps={15291=pAsLsXsFscr/-@1} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9a1b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000015b8:[<0x200000015b5/article-68.xml v1091>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000015b8:[<0x200000015b5/article-68.xml v1091>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.706 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.645+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001948 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-70.xml auth v1059 ap=1 s=8221 n(v0 rc2024-03-27T07:25:47.426607+0000 b8221 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a8990580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001948:[<0x200000015b5/comment-70.xml v1059>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001948:[<0x200000015b5/comment-70.xml v1059>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.707 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.645+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000017cb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-8.jpg auth v1087 ap=1 s=59171 n(v0 rc2024-03-27T07:25:45.679641+0000 b59171 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a8e6e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000017cb:[<0x200000015b5/picture-8.jpg v1087>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000017cb:[<0x200000015b5/picture-8.jpg v1087>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.707 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.645+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001716 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-49.jpg auth v1031 ap=1 s=23259 n(v0 rc2024-03-27T07:25:44.978655+0000 b23259 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9ec8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001716:[<0x200000015b5/picture-49.jpg v1031>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001716:[<0x200000015b5/picture-49.jpg v1031>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.707 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.646+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001770 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-26.jpg auth v1075 ap=1 s=22485 n(v0 rc2024-03-27T07:25:45.279649+0000 b22485 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9829600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001770:[<0x200000015b5/picture-26.jpg v1075>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001770:[<0x200000015b5/picture-26.jpg v1075>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.707 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.646+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000163e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-32.xml auth v1045 ap=1 s=8073 n(v0 rc2024-03-27T07:25:44.341667+0000 b8073 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9ac9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000163e:[<0x200000015b5/article-32.xml v1045>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000163e:[<0x200000015b5/article-32.xml v1045>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.707 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.646+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000194f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-69.xml auth v1047 ap=1 s=4820 n(v0 rc2024-03-27T07:25:47.436607+0000 b4820 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a8992c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000194f:[<0x200000015b5/comment-69.xml v1047>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000194f:[<0x200000015b5/comment-69.xml v1047>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.707 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.647+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001668 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-21.xml auth v1027 ap=1 s=15009 n(v0 rc2024-03-27T07:25:44.500664+0000 b15009 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a77b5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001668:[<0x200000015b5/article-21.xml v1027>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001668:[<0x200000015b5/article-21.xml v1027>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.707 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.647+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001d7e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-30.xml auth{0=1} v1267 ap=1 s=27260 n(v0 rc2024-03-27T07:27:38.971414+0000 b27260 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607aa727700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001d7e:[<0x200000015b5/article-30.xml v1124>,<0x10000000399/blog-35 v133073>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001d7e:[<0x200000015b5/article-30.xml v1267>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ca8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000193a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001988 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001969 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.708 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ea2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002faf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000199f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fa3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fd9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000199c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000191f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.709 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fe8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001926 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001987 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000191c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fcd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fa0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000197e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ffb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001974 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001960 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000192a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.711 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002feb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ff7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001972 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001978 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001935 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.712 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.713 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.647+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000018b8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-89.xml auth v1067 ap=1 s=4362 n(v0 rc2024-03-27T07:25:46.689621+0000 b4362 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9873700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000018b8:[<0x200000015b5/comment-89.xml v1067>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000018b8:[<0x200000015b5/comment-89.xml v1067>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.713 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.647+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000018d0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-83.xml auth v1061 ap=1 s=3958 n(v0 rc2024-03-27T07:25:46.748620+0000 b3958 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a79cc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000018d0:[<0x200000015b5/comment-83.xml v1061>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000018d0:[<0x200000015b5/comment-83.xml v1061>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.713 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.647+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000193a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-74.xml auth v1099 ap=1 s=4229 n(v0 rc2024-03-27T07:25:47.392607+0000 b4229 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607aa041180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000193a:[<0x200000015b5/comment-74.xml v1099>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000193a:[<0x200000015b5/comment-74.xml v1099>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.713 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.648+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000018b3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-90.xml auth v1055 ap=1 s=3150 n(v0 rc2024-03-27T07:25:46.677621+0000 b3150 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9871b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000018b3:[<0x200000015b5/comment-90.xml v1055>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000018b3:[<0x200000015b5/comment-90.xml v1055>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.713 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.648+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001697 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-13.xml auth v1057 ap=1 s=15428 n(v0 rc2024-03-27T07:25:44.709660+0000 b15428 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a7d6c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001697:[<0x200000015b5/article-13.xml v1057>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001697:[<0x200000015b5/article-13.xml v1057>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.713 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.648+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001eb8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-64.xml auth{0=1} v1269 ap=1 s=3189 n(v0 rc2024-03-27T07:27:40.847378+0000 b3189 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ababc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001eb8:[<0x200000015b5/comment-64.xml v1127>,<0x10000000399/blog-35 v133073>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001eb8:[<0x200000015b5/comment-64.xml v1269>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.713 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.648+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001941 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-72.xml auth v1095 ap=1 s=7151 n(v0 rc2024-03-27T07:25:47.408607+0000 b7151 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a7a5fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001941:[<0x200000015b5/comment-72.xml v1095>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001941:[<0x200000015b5/comment-72.xml v1095>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.713 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.649+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016c6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-2.xml auth v1035 ap=1 s=11777 n(v0 rc2024-03-27T07:25:44.837658+0000 b11777 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9ab3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016c6:[<0x200000015b5/article-2.xml v1035>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016c6:[<0x200000015b5/article-2.xml v1035>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.714 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.650+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001957 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-67.xml auth v1053 ap=1 s=5089 n(v0 rc2024-03-27T07:25:47.463606+0000 b5089 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9325b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001957:[<0x200000015b5/comment-67.xml v1053>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001957:[<0x200000015b5/comment-67.xml v1053>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.714 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.650+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x300000004fa [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-54.jpg auth{0=1,2=1} v1108 ap=1 s=33224 n(v0 rc2024-03-27T07:26:32.892711+0000 b33224 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaaee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x300000004fa:[<0x200000015b5/picture-54.jpg v1108>,<0x10000000399/blog-35 v112386>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x300000004fa:[<0x200000015b5/picture-54.jpg v1108>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fe5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c99 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000198c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.714 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.715 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.715 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.715 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001995 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.715 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.715 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.715 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.715 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.715 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.715 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001976 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.715 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.650+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000015ff [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-50.xml auth v1033 ap=1 s=21168 n(v0 rc2024-03-27T07:25:43.993674+0000 b21168 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9baec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000015ff:[<0x200000015b5/article-50.xml v1033>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000015ff:[<0x200000015b5/article-50.xml v1033>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.651+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016b6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-6.xml auth v1037 ap=1 s=20163 n(v0 rc2024-03-27T07:25:44.787659+0000 b20163 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a98c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016b6:[<0x200000015b5/article-6.xml v1037>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016b6:[<0x200000015b5/article-6.xml v1037>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.651+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001764 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-29.jpg auth v1025 ap=1 s=39323 n(v0 rc2024-03-27T07:25:45.208650+0000 b39323 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9afd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001764:[<0x200000015b5/picture-29.jpg v1025>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001764:[<0x200000015b5/picture-29.jpg v1025>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.652+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000015e7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-56.xml auth v1079 ap=1 s=32196 n(v0 rc2024-03-27T07:25:43.892676+0000 b32196 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9c0c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000015e7:[<0x200000015b5/article-56.xml v1079>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000015e7:[<0x200000015b5/article-56.xml v1079>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.652+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000191d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-81.xml auth v1040 ap=1 s=6507 n(v0 rc2024-03-27T07:25:47.276610+0000 b6507 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a70beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000191d:[<0x200000015b5/comment-81.xml v1040>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000191d:[<0x200000015b5/comment-81.xml v1040>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.653+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000017dd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-3.jpg auth v1044 ap=1 s=54281 n(v0 rc2024-03-27T07:25:45.752640+0000 b54281 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9c5cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000017dd:[<0x200000015b5/picture-3.jpg v1044>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000017dd:[<0x200000015b5/picture-3.jpg v1044>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.653+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000018c7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-85.xml auth v1050 ap=1 s=2467 n(v0 rc2024-03-27T07:25:46.730620+0000 b2467 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a98f7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000018c7:[<0x200000015b5/comment-85.xml v1050>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000018c7:[<0x200000015b5/comment-85.xml v1050>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.653+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016fe [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-55.jpg auth v1036 ap=1 s=15753 n(v0 rc2024-03-27T07:25:44.939656+0000 b15753 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9d63700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016fe:[<0x200000015b5/picture-55.jpg v1036>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016fe:[<0x200000015b5/picture-55.jpg v1036>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.654+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016ba [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-5.xml auth v1030 ap=1 s=29785 n(v0 rc2024-03-27T07:25:44.802658+0000 b29785 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a98c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016ba:[<0x200000015b5/article-5.xml v1030>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016ba:[<0x200000015b5/article-5.xml v1030>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.654+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ccd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-34.xml auth{0=1} v1119 ap=1 s=23616 n(v0 rc2024-03-27T07:26:33.297703+0000 b23616 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ccd:[<0x200000015b5/article-34.xml v1112>,<0x10000000399/blog-35 v112386>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ccd:[<0x200000015b5/article-34.xml v1119>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.655+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001649 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-29.xml auth v1024 ap=1 s=10399 n(v0 rc2024-03-27T07:25:44.391666+0000 b10399 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9a6db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001649:[<0x200000015b5/article-29.xml v1024>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001649:[<0x200000015b5/article-29.xml v1024>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.718 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000194b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.718 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.718 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001931 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.718 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.718 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001914 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.718 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000003018 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000192d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ff1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000003007 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001984 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002efb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000191a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.719 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001924 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001970 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000003001 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000003021 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.720 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000300d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fa9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001992 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001917 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000196c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.721 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002fe2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000003013 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000198a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001eba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ba7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000013a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ba1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001eda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000946 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.722 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000998 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bf5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000952 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001eb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000092a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ac3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000921 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.723 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000be0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bdb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000923 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000be7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ea8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000093f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001eb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.724 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-95.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ea2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-96.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000096c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.725 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001439 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000096a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000013a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000093e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001acb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.726 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000095f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000951 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ac9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000914 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000096e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009f9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ec3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bcf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.727 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001aff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000935 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000972 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001eb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a0c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000950 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000916 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.728 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000989 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e6c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000091e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000091c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000964 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000983 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000095a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.729 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ec9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000948 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000966 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000149d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000919 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000092e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.730 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002592 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000257c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002577 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000258e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000025b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000025ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000025a9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000934 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000025a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.731 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002509 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-96.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000025c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000092c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002528 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000025d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001acd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000025b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000095b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002549 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002582 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000251b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.732 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002530 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000250c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000250f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000253b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000025ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002554 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002513 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002544 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000025bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000251c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000255e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000255a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000259e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002564 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.733 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002516 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002568 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002505 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000258c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002598 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002517 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000256d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002523 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002572 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002550 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000251f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000252c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002587 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002536 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.734 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002540 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.756 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.378+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001685 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-5.xml auth{0=1} v234 ap=1 s=12689 n(v0 rc2024-03-27T07:25:44.643662+0000 b12689 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da20c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001685:[<0x2000000165e/article-5.xml v234>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001685:[<0x2000000165e/article-5.xml v234>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.756 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.378+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002306 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-57.xml auth{0=1} v1170 ap=1 s=8033 n(v0 rc2024-03-27T07:27:51.847162+0000 b8033 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df3ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002306:[<0x2000000165e/comment-57.xml v1170>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002306:[<0x2000000165e/comment-57.xml v1170>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000003382 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-94) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: pgmap v146: 97 pgs: 97 active+clean; 959 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 456 op/s 2024-03-27T07:28:22.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000189b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.757 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001de3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001da7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.758 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.758 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.378+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-81.xml auth v648 ap=1 s=7962 n(v0 rc2024-03-27T07:26:31.868731+0000 b7962 1=1+0) | authpin=1 scrubqueue=0 0x55661dc2ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc0:[<0x2000000165e/article-81.xml v640>,<0x10000000399/blog-36 v112230>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cc0:[<0x2000000165e/article-81.xml v648>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.759 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.379+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-28.xml auth{0=1} v1164 ap=1 s=5805 n(v0 rc2024-03-27T07:27:53.153136+0000 b5805 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df3a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023e0:[<0x2000000165e/comment-28.xml v1164>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023e0:[<0x2000000165e/comment-28.xml v1164>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.759 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.379+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022e6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-61.xml auth{0=1} v1172 ap=1 s=6765 n(v0 rc2024-03-27T07:27:51.738164+0000 b6765 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df3b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022e6:[<0x2000000165e/comment-61.xml v1172>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022e6:[<0x2000000165e/comment-61.xml v1172>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.759 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.379+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023aa [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-38.xml auth{0=1} v1166 ap=1 s=4151 n(v0 rc2024-03-27T07:27:52.794143+0000 b4151 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df3bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023aa:[<0x2000000165e/comment-38.xml v1166>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023aa:[<0x2000000165e/comment-38.xml v1166>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.759 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.379+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022a9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-68.xml auth{0=1} v1174 ap=1 s=3285 n(v0 rc2024-03-27T07:27:51.479169+0000 b3285 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df3c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022a9:[<0x2000000165e/comment-68.xml v1174>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022a9:[<0x2000000165e/comment-68.xml v1174>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.759 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.760 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ddf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.761 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.761 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.380+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002467 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-8.xml auth{0=1} v1160 ap=1 s=9738 n(v0 rc2024-03-27T07:27:53.897122+0000 b9738 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df3d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002467:[<0x2000000165e/comment-8.xml v1160>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002467:[<0x2000000165e/comment-8.xml v1160>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.762 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.380+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023fc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-22.xml auth{0=1} v1166 ap=1 s=9460 n(v0 rc2024-03-27T07:27:53.230135+0000 b9460 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b38c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023fc:[<0x2000000165e/comment-22.xml v1166>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023fc:[<0x2000000165e/comment-22.xml v1166>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.762 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.380+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000248f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-2.xml auth{0=1} v1156 ap=1 s=7920 n(v0 rc2024-03-27T07:27:54.213116+0000 b7920 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b38cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000248f:[<0x2000000165e/comment-2.xml v1156>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000248f:[<0x2000000165e/comment-2.xml v1156>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.762 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.380+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000236f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-44.xml auth{0=1} v1170 ap=1 s=4797 n(v0 rc2024-03-27T07:27:52.474150+0000 b4797 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b38d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000236f:[<0x2000000165e/comment-44.xml v1170>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000236f:[<0x2000000165e/comment-44.xml v1170>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.762 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001da2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.763 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.764 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.381+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016c4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-5.jpg auth{0=1} v226 ap=1 s=31121 n(v0 rc2024-03-27T07:25:44.830658+0000 b31121 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b38e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016c4:[<0x2000000165e/picture-5.jpg v226>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016c4:[<0x2000000165e/picture-5.jpg v226>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.764 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.381+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023e3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-27.xml auth{0=1} v1168 ap=1 s=9783 n(v0 rc2024-03-27T07:27:53.162136+0000 b9783 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b38ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023e3:[<0x2000000165e/comment-27.xml v1168>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023e3:[<0x2000000165e/comment-27.xml v1168>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.764 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.381+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000232e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-52.xml auth{0=1} v1174 ap=1 s=5683 n(v0 rc2024-03-27T07:27:52.083157+0000 b5683 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b38f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000232e:[<0x2000000165e/comment-52.xml v1174>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000232e:[<0x2000000165e/comment-52.xml v1174>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.764 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.381+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001887 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-49.xml auth v691 ap=1 s=29279 n(v0 rc2024-03-27T07:27:19.518796+0000 b29279 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661df3c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001887:[<0x2000000165e/article-49.xml v677>,<0x10000000399/blog-36 v121369>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001887:[<0x2000000165e/article-49.xml v691>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.764 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.381+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002470 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-7.xml auth{0=1} v1158 ap=1 s=9684 n(v0 rc2024-03-27T07:27:53.980120+0000 b9684 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a7e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002470:[<0x2000000165e/comment-7.xml v1158>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002470:[<0x2000000165e/comment-7.xml v1158>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001db8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ddc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001df8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001df1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.765 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001db5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.766 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.766 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.382+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-15.xml auth{0=1} v1162 ap=1 s=10207 n(v0 rc2024-03-27T07:27:53.350133+0000 b10207 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a7e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241f:[<0x2000000165e/comment-15.xml v1162>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000241f:[<0x2000000165e/comment-15.xml v1162>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.767 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.382+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022bc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-66.xml auth{0=1} v1176 ap=1 s=4097 n(v0 rc2024-03-27T07:27:51.583167+0000 b4097 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b38f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022bc:[<0x2000000165e/comment-66.xml v1176>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022bc:[<0x2000000165e/comment-66.xml v1176>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.767 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.382+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002416 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-17.xml auth{0=1} v1164 ap=1 s=7900 n(v0 rc2024-03-27T07:27:53.303134+0000 b7900 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a7ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002416:[<0x2000000165e/comment-17.xml v1164>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002416:[<0x2000000165e/comment-17.xml v1164>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001de6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001da4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001db0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001da9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001df4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.767 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001db3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ded (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000034d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-99) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001811 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-40) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.768 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ff0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-57) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.769 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.382+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002379 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-43.xml auth{0=1} v1190 ap=1 s=7066 n(v0 rc2024-03-27T07:27:52.543148+0000 b7066 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55661a7e9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002379:[<0x2000000165e/comment-43.xml v898>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002379:[<0x2000000165e/comment-43.xml v1190>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.769 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.382+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002153 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-28.xml auth v1180 ap=1 s=7977 n(v0 rc2024-03-27T07:27:49.522208+0000 b7977 1=1+0) | replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661a7eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002153:[<0x2000000165e/article-28.xml v696>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002153:[<0x2000000165e/article-28.xml v1180>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.769 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.382+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002369 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-45.xml auth{0=1} v1172 ap=1 s=8527 n(v0 rc2024-03-27T07:27:52.432151+0000 b8527 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1fc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002369:[<0x2000000165e/comment-45.xml v1172>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002369:[<0x2000000165e/comment-45.xml v1172>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.769 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.383+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000245f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-9.xml auth{0=1} v1160 ap=1 s=8653 n(v0 rc2024-03-27T07:27:53.855123+0000 b8653 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a7eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000245f:[<0x2000000165e/comment-9.xml v1160>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000245f:[<0x2000000165e/comment-9.xml v1160>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000eac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001057 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.769 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001044 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000169b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001041 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ecb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001079 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001001 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000012a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-93.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.770 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001081 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001053 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.771 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.771 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.383+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000235d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-47.xml auth{0=1} v1163 ap=1 s=6632 n(v0 rc2024-03-27T07:27:52.360152+0000 b6632 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da4eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000235d:[<0x2000000165e/comment-47.xml v1163>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000235d:[<0x2000000165e/comment-47.xml v1163>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.771 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.383+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001676 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-8.xml auth{0=1} v198 ap=1 s=25948 n(v0 rc2024-03-27T07:25:44.575663+0000 b25948 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da4e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001676:[<0x2000000165e/article-8.xml v198>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001676:[<0x2000000165e/article-8.xml v198>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.771 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.383+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002296 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-70.xml auth{0=1} v1171 ap=1 s=8638 n(v0 rc2024-03-27T07:27:51.396171+0000 b8638 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da4f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002296:[<0x2000000165e/comment-70.xml v1171>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002296:[<0x2000000165e/comment-70.xml v1171>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.771 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.383+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016b8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-8.jpg auth{0=1} v206 ap=1 s=23897 n(v0 rc2024-03-27T07:25:44.795659+0000 b23897 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da4fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016b8:[<0x2000000165e/picture-8.jpg v206>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016b8:[<0x2000000165e/picture-8.jpg v206>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.772 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.384+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000229f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-69.xml auth{0=1} v1169 ap=1 s=2931 n(v0 rc2024-03-27T07:27:51.425170+0000 b2931 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da50100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000229f:[<0x2000000165e/comment-69.xml v1169>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000229f:[<0x2000000165e/comment-69.xml v1169>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ee6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000efb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000106d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001066 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.772 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000166e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001660 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ebb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001029 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000160e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001610 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001010 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.773 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.774 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.384+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002272 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-74.xml auth{0=1} v1175 ap=1 s=2232 n(v0 rc2024-03-27T07:27:51.242174+0000 b2232 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da50680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002272:[<0x2000000165e/comment-74.xml v1175>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002272:[<0x2000000165e/comment-74.xml v1175>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.774 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.384+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023b9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-36.xml auth{0=1} v1159 ap=1 s=7997 n(v0 rc2024-03-27T07:27:52.934141+0000 b7997 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da51180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023b9:[<0x2000000165e/comment-36.xml v1159>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023b9:[<0x2000000165e/comment-36.xml v1159>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.774 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.384+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000147a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-13.xml auth{0=1} v683 ap=1 s=16379 n(v0 rc2024-03-27T07:27:10.321976+0000 b16379 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da2e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000147a:[<0x2000000165e/article-13.xml v656>,<0x10000000399/blog-36 v117248>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x1000000147a:[<0x2000000165e/article-13.xml v683>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.774 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.384+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022cb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-64.xml auth{0=1} v1165 ap=1 s=7354 n(v0 rc2024-03-27T07:27:51.663166+0000 b7354 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da2e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022cb:[<0x2000000165e/comment-64.xml v1165>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022cb:[<0x2000000165e/comment-64.xml v1165>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.774 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.385+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002283 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-72.xml auth{0=1} v1173 ap=1 s=2382 n(v0 rc2024-03-27T07:27:51.329172+0000 b2382 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da2eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002283:[<0x2000000165e/comment-72.xml v1173>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002283:[<0x2000000165e/comment-72.xml v1173>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000106a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001025 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.774 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000162d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.775 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ed0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.776 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.385+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001680 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-6.xml auth{0=1} v232 ap=1 s=17347 n(v0 rc2024-03-27T07:25:44.619662+0000 b17347 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da2fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001680:[<0x2000000165e/article-6.xml v232>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001680:[<0x2000000165e/article-6.xml v232>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.776 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.385+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001690 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-2.xml auth{0=1} v222 ap=1 s=14252 n(v0 rc2024-03-27T07:25:44.689661+0000 b14252 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da30100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001690:[<0x2000000165e/article-2.xml v222>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001690:[<0x2000000165e/article-2.xml v222>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001667 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000865 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.776 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001661 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000eb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000165e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001617 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ef0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001075 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001655 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.777 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.385+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000248c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-4.xml auth{0=1} v1153 ap=1 s=7531 n(v0 rc2024-03-27T07:27:54.182116+0000 b7531 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da2f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000248c:[<0x2000000165e/comment-4.xml v1153>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000248c:[<0x2000000165e/comment-4.xml v1153>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.386+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022b2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-67.xml auth{0=1} v1167 ap=1 s=6271 n(v0 rc2024-03-27T07:27:51.529168+0000 b6271 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da31180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022b2:[<0x2000000165e/comment-67.xml v1167>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022b2:[<0x2000000165e/comment-67.xml v1167>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.386+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002362 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-46.xml auth{0=1} v1161 ap=1 s=6697 n(v0 rc2024-03-27T07:27:52.398151+0000 b6697 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da4f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002362:[<0x2000000165e/comment-46.xml v1161>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002362:[<0x2000000165e/comment-46.xml v1161>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.386+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000240c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-19.xml auth{0=1} v1157 ap=1 s=2296 n(v0 rc2024-03-27T07:27:53.266134+0000 b2296 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da1e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000240c:[<0x2000000165e/comment-19.xml v1157>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000240c:[<0x2000000165e/comment-19.xml v1157>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.386+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016a5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-13.jpg auth{0=1} v224 ap=1 s=46583 n(v0 rc2024-03-27T07:25:44.735660+0000 b46583 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dce6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016a5:[<0x2000000165e/picture-13.jpg v224>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016a5:[<0x2000000165e/picture-13.jpg v224>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.386+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000230e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-56.xml auth{0=1} v1157 ap=1 s=8224 n(v0 rc2024-03-27T07:27:51.904161+0000 b8224 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dce7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000230e:[<0x2000000165e/comment-56.xml v1157>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000230e:[<0x2000000165e/comment-56.xml v1157>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.778 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.386+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002487 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-5.xml auth{0=1} v1151 ap=1 s=4650 n(v0 rc2024-03-27T07:27:54.155117+0000 b4650 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dce7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002487:[<0x2000000165e/comment-5.xml v1151>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002487:[<0x2000000165e/comment-5.xml v1151>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000eb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001681 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001665 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000eb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ec4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001619 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001663 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001678 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ec8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001613 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.779 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.780 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.780 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001673 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.780 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.387+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002426 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-14.xml auth{0=1} v1155 ap=1 s=4886 n(v0 rc2024-03-27T07:27:53.398132+0000 b4886 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da30c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002426:[<0x2000000165e/comment-14.xml v1155>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002426:[<0x2000000165e/comment-14.xml v1155>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.780 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.388+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023dd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-29.xml auth{0=1} v1155 ap=1 s=7750 n(v0 rc2024-03-27T07:27:53.141137+0000 b7750 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dce8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023dd:[<0x2000000165e/comment-29.xml v1155>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023dd:[<0x2000000165e/comment-29.xml v1155>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.780 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.388+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016c8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-4.jpg auth{0=1} v182 ap=1 s=22040 n(v0 rc2024-03-27T07:25:44.843658+0000 b22040 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dce8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016c8:[<0x2000000165e/picture-4.jpg v182>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016c8:[<0x2000000165e/picture-4.jpg v182>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.780 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.388+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016a1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-14.jpg auth{0=1} v184 ap=1 s=27382 n(v0 rc2024-03-27T07:25:44.723660+0000 b27382 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dce9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016a1:[<0x2000000165e/picture-14.jpg v184>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016a1:[<0x2000000165e/picture-14.jpg v184>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.780 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.388+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016b4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-9.jpg auth{0=1} v204 ap=1 s=43066 n(v0 rc2024-03-27T07:25:44.780659+0000 b43066 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016b4:[<0x2000000165e/picture-9.jpg v204>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016b4:[<0x2000000165e/picture-9.jpg v204>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000107d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001692 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000105e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000162f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f76 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.781 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.782 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ff3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.782 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.782 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.782 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001627 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.782 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.782 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.389+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002435 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-11.xml auth{0=1} v1135 ap=1 s=6942 n(v0 rc2024-03-27T07:27:53.513129+0000 b6942 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc57080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002435:[<0x2000000165e/comment-11.xml v1135>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002435:[<0x2000000165e/comment-11.xml v1135>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.782 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.389+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016d0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-2.jpg auth{0=1} v214 ap=1 s=14355 n(v0 rc2024-03-27T07:25:44.859657+0000 b14355 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dce9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016d0:[<0x2000000165e/picture-2.jpg v214>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016d0:[<0x2000000165e/picture-2.jpg v214>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ed5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000167b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001031 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fe1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ff0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000edd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ee1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001035 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.783 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.784 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ec0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.784 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.784 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.784 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.389+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016bc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-7.jpg auth{0=1} v186 ap=1 s=53840 n(v0 rc2024-03-27T07:25:44.809658+0000 b53840 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016bc:[<0x2000000165e/picture-7.jpg v186>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016bc:[<0x2000000165e/picture-7.jpg v186>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.784 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.389+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002406 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-20.xml auth{0=1} v1153 ap=1 s=3303 n(v0 rc2024-03-27T07:27:53.254134+0000 b3303 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc57b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002406:[<0x2000000165e/comment-20.xml v1153>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002406:[<0x2000000165e/comment-20.xml v1153>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.784 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.506+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016cc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-84.xml auth v687 ap=1 s=19139 n(v0 rc2024-03-27T07:27:16.162861+0000 b19139 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661ddecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016cc:[<0x2000000165e/article-84.xml v671>,<0x10000000399/blog-36 v121369>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016cc:[<0x2000000165e/article-84.xml v687>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.784 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001050 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fa1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000105b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fe6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001600 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ed8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000160a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000163d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001669 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000165f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001659 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.785 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.786 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.507+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022de [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-62.xml auth{0=1} v1145 ap=1 s=7864 n(v0 rc2024-03-27T07:27:51.715165+0000 b7864 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dded080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022de:[<0x2000000165e/comment-62.xml v1145>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022de:[<0x2000000165e/comment-62.xml v1145>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.786 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.507+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001669 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-11.xml auth{0=1} v238 ap=1 s=7252 n(v0 rc2024-03-27T07:25:44.502664+0000 b7252 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dded600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001669:[<0x2000000165e/article-11.xml v238>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001669:[<0x2000000165e/article-11.xml v238>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.786 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.507+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000169c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-15.jpg auth v236 ap=1 s=33823 n(v0 rc2024-03-27T07:25:44.714660+0000 b33823 1=1+0) | authpin=1 scrubqueue=0 0x55661c683600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000169c:[<0x2000000165e/picture-15.jpg v236>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000169c:[<0x2000000165e/picture-15.jpg v236>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.786 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.507+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022f7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-59.xml auth{0=1} v1143 ap=1 s=2981 n(v0 rc2024-03-27T07:27:51.775163+0000 b2981 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ddedb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022f7:[<0x2000000165e/comment-59.xml v1143>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022f7:[<0x2000000165e/comment-59.xml v1143>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.786 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.507+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000099c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-93.xml auth v627 ap=1 s=11315 n(v0 rc2024-03-27T07:26:03.411292+0000 b11315 1=1+0) | authpin=1 scrubqueue=0 0x55661de76580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000099c:[<0x2000000165e/article-93.xml v250>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x1000000099c:[<0x2000000165e/article-93.xml v627>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001021 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001641 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001662 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000104c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000166b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.787 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001605 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.788 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000161d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.788 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.788 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.788 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.788 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.508+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000009a8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-10.xml auth{0=1} v625 ap=1 s=7035 n(v0 rc2024-03-27T07:26:03.516290+0000 b7035 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ddee100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000009a8:[<0x2000000165e/article-10.xml v256>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x100000009a8:[<0x2000000165e/article-10.xml v625>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.788 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.508+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016a8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-12.jpg auth{0=1} v200 ap=1 s=9782 n(v0 rc2024-03-27T07:25:44.742660+0000 b9782 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ddee680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016a8:[<0x2000000165e/picture-12.jpg v200>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016a8:[<0x2000000165e/picture-12.jpg v200>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.788 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.788 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000015fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000100c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000162a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001063 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001664 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fa6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-83.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000eeb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001072 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.789 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001632 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.790 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.508+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001689 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-4.xml auth{0=1} v228 ap=1 s=13612 n(v0 rc2024-03-27T07:25:44.663661+0000 b13612 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ddef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001689:[<0x2000000165e/article-4.xml v228>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001689:[<0x2000000165e/article-4.xml v228>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.790 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.508+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000233f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-50.xml auth{0=1} v1147 ap=1 s=5698 n(v0 rc2024-03-27T07:27:52.203155+0000 b5698 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55661ddeec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000233f:[<0x2000000165e/comment-50.xml v850>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000233f:[<0x2000000165e/comment-50.xml v1147>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.790 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.508+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023d6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-31.xml auth{0=1} v1139 ap=1 s=8277 n(v0 rc2024-03-27T07:27:53.122137+0000 b8277 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dce6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023d6:[<0x2000000165e/comment-31.xml v1139>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023d6:[<0x2000000165e/comment-31.xml v1139>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.790 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.509+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002352 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-48.xml auth{0=1} v1141 ap=1 s=8997 n(v0 rc2024-03-27T07:27:52.322153+0000 b8997 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ddef180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002352:[<0x2000000165e/comment-48.xml v1141>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002352:[<0x2000000165e/comment-48.xml v1141>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.790 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.549+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000228d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-71.xml auth{0=1} v1163 ap=1 s=5296 n(v0 rc2024-03-27T07:27:51.376171+0000 b5296 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da9ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000228d:[<0x2000000165e/comment-71.xml v1163>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000228d:[<0x2000000165e/comment-71.xml v1163>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000165b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000101c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000072f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000161f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ffb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000102c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001048 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.791 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.792 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ff6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.792 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000165d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.792 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000165c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.792 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.792 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.549+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016b0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-10.jpg auth{0=1} v230 ap=1 s=25705 n(v0 rc2024-03-27T07:25:44.765659+0000 b25705 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da9b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016b0:[<0x2000000165e/picture-10.jpg v230>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016b0:[<0x2000000165e/picture-10.jpg v230>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.792 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.549+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016d4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-1.jpg auth{0=1} v218 ap=1 s=22341 n(v0 rc2024-03-27T07:25:44.866657+0000 b22341 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da9b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016d4:[<0x2000000165e/picture-1.jpg v218>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016d4:[<0x2000000165e/picture-1.jpg v218>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.792 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.550+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001671 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-9.xml auth{0=1} v220 ap=1 s=16070 n(v0 rc2024-03-27T07:25:44.554663+0000 b16070 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da9c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001671:[<0x2000000165e/article-9.xml v220>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001671:[<0x2000000165e/article-9.xml v220>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.792 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.550+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000241a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-16.xml auth{0=1} v1135 ap=1 s=6181 n(v0 rc2024-03-27T07:27:53.324133+0000 b6181 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da9c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000241a:[<0x2000000165e/comment-16.xml v1135>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000241a:[<0x2000000165e/comment-16.xml v1135>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.793 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.550+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000022ff [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-58.xml auth{0=1} v1161 ap=1 s=8171 n(v0 rc2024-03-27T07:27:51.803163+0000 b8171 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da9d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000022ff:[<0x2000000165e/comment-58.xml v1161>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000022ff:[<0x2000000165e/comment-58.xml v1161>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.793 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001039 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.793 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.793 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.793 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.793 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.793 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.793 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001014 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.793 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.793 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.794 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.794 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001622 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.794 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001635 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.794 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001625 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.794 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.794 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ffe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.794 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.794 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.795 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.550+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002316 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-55.xml auth{0=1} v1159 ap=1 s=7122 n(v0 rc2024-03-27T07:27:51.946160+0000 b7122 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da9d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002316:[<0x2000000165e/comment-55.xml v1159>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002316:[<0x2000000165e/comment-55.xml v1159>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.795 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.551+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023ed [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-25.xml auth{0=1} v1151 ap=1 s=9943 n(v0 rc2024-03-27T07:27:53.195136+0000 b9943 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da61080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023ed:[<0x2000000165e/comment-25.xml v1151>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023ed:[<0x2000000165e/comment-25.xml v1151>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.795 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.552+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cbf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-85.xml auth v646 ap=1 s=2939 n(v0 rc2024-03-27T07:26:31.846732+0000 b2939 1=1+0) | authpin=1 scrubqueue=0 0x55661d234680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cbf:[<0x2000000165e/article-85.xml v634>,<0x10000000399/blog-36 v112230>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cbf:[<0x2000000165e/article-85.xml v646>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.795 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.552+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016c0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-6.jpg auth{0=1} v188 ap=1 s=49623 n(v0 rc2024-03-27T07:25:44.818658+0000 b49623 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da9cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016c0:[<0x2000000165e/picture-6.jpg v188>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016c0:[<0x2000000165e/picture-6.jpg v188>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.795 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.552+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023b1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-37.xml auth{0=1} v1155 ap=1 s=9025 n(v0 rc2024-03-27T07:27:52.884142+0000 b9025 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da9a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023b1:[<0x2000000165e/comment-37.xml v1155>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023b1:[<0x2000000165e/comment-37.xml v1155>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.795 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.795 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000103c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.795 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.795 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001638 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.795 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ef6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ff9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bcd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bde (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.796 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.797 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.553+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023cb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-34.xml auth{0=1} v1153 ap=1 s=3331 n(v0 rc2024-03-27T07:27:53.080138+0000 b3331 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da60580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023cb:[<0x2000000165e/comment-34.xml v1153>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023cb:[<0x2000000165e/comment-34.xml v1153>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.797 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.553+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000238e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-41.xml auth{0=1} v1157 ap=1 s=7325 n(v0 rc2024-03-27T07:27:52.655146+0000 b7325 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da61b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000238e:[<0x2000000165e/comment-41.xml v1157>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000238e:[<0x2000000165e/comment-41.xml v1157>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.797 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ba3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.797 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bd9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.797 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.797 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.797 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.797 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002b9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.797 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.797 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.798 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.798 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bcf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.798 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ba0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.798 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.798 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.798 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ba7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.798 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002b9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.798 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.798 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.799 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.554+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000168d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-3.xml auth{0=1} v212 ap=1 s=16907 n(v0 rc2024-03-27T07:25:44.681661+0000 b16907 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da62100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000168d:[<0x2000000165e/article-3.xml v212>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000168d:[<0x2000000165e/article-3.xml v212>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.799 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.554+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023f7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-23.xml auth{0=1} v1147 ap=1 s=5969 n(v0 rc2024-03-27T07:27:53.218135+0000 b5969 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da63180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023f7:[<0x2000000165e/comment-23.xml v1147>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023f7:[<0x2000000165e/comment-23.xml v1147>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.799 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.554+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000167b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-7.xml auth{0=1} v240 ap=1 s=22472 n(v0 rc2024-03-27T07:25:44.600662+0000 b22472 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da62680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000167b:[<0x2000000165e/article-7.xml v240>,<0x10000000399/blog-36 v62173>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000167b:[<0x2000000165e/article-7.xml v240>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.799 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:22.554+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000023f2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-24.xml auth{0=1} v1149 ap=1 s=8131 n(v0 rc2024-03-27T07:27:53.209135+0000 b8131 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da4e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000023f2:[<0x2000000165e/comment-24.xml v1149>,<0x10000000399/blog-36 v129608>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000023f2:[<0x2000000165e/comment-24.xml v1149>,<0x10000000399/blog-36 v132766>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.802 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.802 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002b9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.802 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.802 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002baf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.802 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002b9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ba1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002baa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bdb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ba6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ba9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.803 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002b9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ba4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002b98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ba8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002b99 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.804 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002b9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ba5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bcb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bbc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001980 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.805 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ba2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-82.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002bb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000300a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-93.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002efe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ca4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ca0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.807 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001955 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ef5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ca6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000197b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001982 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.808 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000301e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001940 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000003004 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000003010 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fa6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ffe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.809 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000302d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001997 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001999 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000003016 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000195a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ca2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000003024 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001922 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000195c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001946 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.810 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000196f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001950 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001911 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001964 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000301b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000199e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.811 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ef8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ca8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000193a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001988 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001969 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ea2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.812 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002faf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000199f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fa3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fd9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000199c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000191f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fe8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001926 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.813 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001987 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000191c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fcd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fa0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000197e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.814 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ffb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001974 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001960 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000192a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002feb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ff7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001972 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.815 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001978 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001935 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fe5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c99 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000198c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.816 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001995 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001976 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000194b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001931 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.817 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001914 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000003018 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000192d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ff1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000003007 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001984 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.818 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002efb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000191a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001924 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001970 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000003001 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000003021 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.819 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000300d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fa9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001992 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001917 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000196c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.820 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002fe2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000003013 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000198a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001eba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ba7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000013a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ba1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001eda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.821 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000946 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000998 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bf5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000952 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001eb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000092a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ac3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000921 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.822 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000be0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bdb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000923 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000be7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ea8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000093f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001eb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.823 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-95.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ea2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-96.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000096c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001439 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000096a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.824 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000013a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000093e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001acb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000095f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.825 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000951 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ac9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000914 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000096e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009f9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.826 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ec3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.827 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bcf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.827 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.827 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001aff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000935 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000972 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001eb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a0c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000950 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000916 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.828 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000989 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e6c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000091e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000091c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000964 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.829 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000983 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000095a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ec9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000948 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000966 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000149d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000919 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.830 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000092e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002592 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000257c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002577 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000258e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000025b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.831 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000025ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000025a9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000934 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000025a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002509 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-96.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000025c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000092c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002528 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000025d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001acd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000025b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000095b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.832 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002549 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002582 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000251b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002530 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000250c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000250f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000253b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000025ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002554 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002513 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002544 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000025bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000251c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.833 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000255e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000255a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000259e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002564 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002516 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002568 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002505 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000258c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002598 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002517 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000256d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002523 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002572 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002550 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.834 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000251f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.835 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000252c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.835 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002587 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.835 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002536 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.835 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:22 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002540 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.918 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.655+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000015d7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-60.xml auth v1020 ap=1 s=23992 n(v0 rc2024-03-27T07:25:43.859677+0000 b23992 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b88580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000015d7:[<0x200000015b5/article-60.xml v1020>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000015d7:[<0x200000015b5/article-60.xml v1020>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.918 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.655+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016de [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-63.jpg auth v1076 ap=1 s=37560 n(v0 rc2024-03-27T07:25:44.884657+0000 b37560 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9c88000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016de:[<0x200000015b5/picture-63.jpg v1076>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016de:[<0x200000015b5/picture-63.jpg v1076>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.918 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.656+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001738 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-40.jpg auth v1032 ap=1 s=17552 n(v0 rc2024-03-27T07:25:45.040654+0000 b17552 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607aa00eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001738:[<0x200000015b5/picture-40.jpg v1032>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001738:[<0x200000015b5/picture-40.jpg v1032>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.918 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.657+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002007 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-61.xml auth{0=1} v1281 ap=1 s=3942 n(v0 rc2024-03-27T07:27:42.806339+0000 b3942 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607a9f96680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002007:[<0x200000015b5/comment-61.xml v1139>,<0x10000000399/blog-35 v133073>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002007:[<0x200000015b5/comment-61.xml v1281>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.657+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001664 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-22.xml auth v1056 ap=1 s=5164 n(v0 rc2024-03-27T07:25:44.488665+0000 b5164 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9a41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001664:[<0x200000015b5/article-22.xml v1056>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001664:[<0x200000015b5/article-22.xml v1056>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.657+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001952 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-68.xml auth v1038 ap=1 s=6429 n(v0 rc2024-03-27T07:25:47.453606+0000 b6429 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9324000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001952:[<0x200000015b5/comment-68.xml v1038>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001952:[<0x200000015b5/comment-68.xml v1038>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.658+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001602 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-49.xml auth v1026 ap=1 s=12444 n(v0 rc2024-03-27T07:25:44.015674+0000 b12444 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b7a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001602:[<0x200000015b5/article-49.xml v1026>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001602:[<0x200000015b5/article-49.xml v1026>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.658+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001921 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-80.xml auth v1048 ap=1 s=3819 n(v0 rc2024-03-27T07:25:47.291609+0000 b3819 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a70c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001921:[<0x200000015b5/comment-80.xml v1048>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001921:[<0x200000015b5/comment-80.xml v1048>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.658+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001785 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-23.jpg auth v1007 ap=1 s=45053 n(v0 rc2024-03-27T07:25:45.362647+0000 b45053 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a99e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001785:[<0x200000015b5/picture-23.jpg v1007>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001785:[<0x200000015b5/picture-23.jpg v1007>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.659+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000ec6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-79.jpg auth{2=1} v1237 ap=1 s=53891 n(v0 rc2024-03-27T07:27:35.826476+0000 b53891 1=1+0) caps={15291=pAsLsXsFsc/-@1},l=15291(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ac73a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000000ec6:[<0x200000015b5/picture-79.jpg v1119>,<0x10000000399/blog-35 v133073>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x30000000ec6:[<0x200000015b5/picture-79.jpg v1237>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.659+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001726 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-45.jpg auth v1013 ap=1 s=35215 n(v0 rc2024-03-27T07:25:45.007654+0000 b35215 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9f30100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001726:[<0x200000015b5/picture-45.jpg v1013>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001726:[<0x200000015b5/picture-45.jpg v1013>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.659+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000168b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-14.xml auth v1039 ap=1 s=18782 n(v0 rc2024-03-27T07:25:44.685661+0000 b18782 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9c6db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000168b:[<0x200000015b5/article-14.xml v1039>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000168b:[<0x200000015b5/article-14.xml v1039>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.659+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001734 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-41.jpg auth v997 ap=1 s=17258 n(v0 rc2024-03-27T07:25:45.033654+0000 b17258 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9f97180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001734:[<0x200000015b5/picture-41.jpg v997>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001734:[<0x200000015b5/picture-41.jpg v997>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.660+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000f0f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-62.xml auth{0=1,2=1} v1125 ap=1 s=9028 n(v0 rc2024-03-27T07:27:41.099373+0000 b9028 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | request=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf19180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000000f0f:[<0x200000015b5/comment-62.xml v1125>,<0x10000000399/blog-35 v133073>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x30000000f0f:[<0x200000015b5/comment-62.xml v1125>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.919 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.660+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016ea [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-60.jpg auth v995 ap=1 s=45533 n(v0 rc2024-03-27T07:25:44.906656+0000 b45533 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9cf6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016ea:[<0x200000015b5/picture-60.jpg v995>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016ea:[<0x200000015b5/picture-60.jpg v995>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.920 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.660+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000017ed [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-91.xml auth v1015 ap=1 s=7452 n(v0 rc2024-03-27T07:25:45.810639+0000 b7452 1=1+0) | authpin=1 scrubqueue=0 0x5607ab903b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000017ed:[<0x200000015b5/article-91.xml v1015>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000017ed:[<0x200000015b5/article-91.xml v1015>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.920 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.660+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000160b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-46.xml auth v1001 ap=1 s=9716 n(v0 rc2024-03-27T07:25:44.066673+0000 b9716 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b7d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000160b:[<0x200000015b5/article-46.xml v1001>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000160b:[<0x200000015b5/article-46.xml v1001>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.920 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.660+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016d2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-66.jpg auth v1045 ap=1 s=13885 n(v0 rc2024-03-27T07:25:44.862657+0000 b13885 1=1+0) caps={15291=pAsLsXsFscr/-@1} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a91cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016d2:[<0x200000015b5/picture-66.jpg v1045>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016d2:[<0x200000015b5/picture-66.jpg v1045>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.920 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.661+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001608 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-47.xml auth v1017 ap=1 s=26600 n(v0 rc2024-03-27T07:25:44.048673+0000 b26600 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b7c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001608:[<0x200000015b5/article-47.xml v1017>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001608:[<0x200000015b5/article-47.xml v1017>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.920 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.661+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000178f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-22.jpg auth v1051 ap=1 s=57406 n(v0 rc2024-03-27T07:25:45.385647+0000 b57406 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a978ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000178f:[<0x200000015b5/picture-22.jpg v1051>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000178f:[<0x200000015b5/picture-22.jpg v1051>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.920 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.661+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000f17 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-59.xml auth{0=1,2=1} v1130 ap=1 s=6680 n(v0 rc2024-03-27T07:27:43.054334+0000 b6680 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | request=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab8e6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000000f17:[<0x200000015b5/comment-59.xml v1130>,<0x10000000399/blog-35 v133073>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x30000000f17:[<0x200000015b5/comment-59.xml v1130>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.920 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.662+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000192e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-77.xml auth v1043 ap=1 s=5742 n(v0 rc2024-03-27T07:25:47.347608+0000 b5742 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9d06c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000192e:[<0x200000015b5/comment-77.xml v1043>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000192e:[<0x200000015b5/comment-77.xml v1043>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.921 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.662+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016a3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-11.xml auth v1011 ap=1 s=3618 n(v0 rc2024-03-27T07:25:44.729660+0000 b3618 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a944a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016a3:[<0x200000015b5/article-11.xml v1011>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016a3:[<0x200000015b5/article-11.xml v1011>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.921 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.662+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000167f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-16.xml auth v1035 ap=1 s=20509 n(v0 rc2024-03-27T07:25:44.617662+0000 b20509 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a88f5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000167f:[<0x200000015b5/article-16.xml v1035>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000167f:[<0x200000015b5/article-16.xml v1035>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.921 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.662+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000015ef [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-54.xml auth v1009 ap=1 s=24855 n(v0 rc2024-03-27T07:25:43.920676+0000 b24855 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9c19080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000015ef:[<0x200000015b5/article-54.xml v1009>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000015ef:[<0x200000015b5/article-54.xml v1009>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.662+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001655 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-26.xml auth v1021 ap=1 s=5486 n(v0 rc2024-03-27T07:25:44.434666+0000 b5486 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9a66100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001655:[<0x200000015b5/article-26.xml v1021>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001655:[<0x200000015b5/article-26.xml v1021>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.662+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000017b6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-15.jpg auth v1005 ap=1 s=31165 n(v0 rc2024-03-27T07:25:45.579643+0000 b31165 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9a20c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000017b6:[<0x200000015b5/picture-15.jpg v1005>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000017b6:[<0x200000015b5/picture-15.jpg v1005>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.663+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016fa [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-56.jpg auth v1053 ap=1 s=8517 n(v0 rc2024-03-27T07:25:44.932656+0000 b8517 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9d62100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016fa:[<0x200000015b5/picture-56.jpg v1053>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016fa:[<0x200000015b5/picture-56.jpg v1053>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.663+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000171e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-47.jpg auth v1029 ap=1 s=42086 n(v0 rc2024-03-27T07:25:44.993655+0000 b42086 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9ecb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000171e:[<0x200000015b5/picture-47.jpg v1029>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000171e:[<0x200000015b5/picture-47.jpg v1029>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.663+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000af1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-10.xml auth{0=1,2=1} v1114 ap=1 s=14624 n(v0 rc2024-03-27T07:27:14.322897+0000 b14624 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac73bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000000af1:[<0x200000015b5/article-10.xml v1114>,<0x10000000399/blog-35 v125844>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x30000000af1:[<0x200000015b5/article-10.xml v1114>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.663+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000017bf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-12.jpg auth v1027 ap=1 s=18960 n(v0 rc2024-03-27T07:25:45.621642+0000 b18960 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a7d82100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000017bf:[<0x200000015b5/picture-12.jpg v1027>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000017bf:[<0x200000015b5/picture-12.jpg v1027>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.663+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000172a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-44.jpg auth v1055 ap=1 s=9489 n(v0 rc2024-03-27T07:25:45.014654+0000 b9489 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9f31700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000172a:[<0x200000015b5/picture-44.jpg v1055>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000172a:[<0x200000015b5/picture-44.jpg v1055>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.664+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001605 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-48.xml auth v1033 ap=1 s=22416 n(v0 rc2024-03-27T07:25:44.030674+0000 b22416 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b7b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001605:[<0x200000015b5/article-48.xml v1033>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001605:[<0x200000015b5/article-48.xml v1033>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.664+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001659 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-25.xml auth v999 ap=1 s=12600 n(v0 rc2024-03-27T07:25:44.448665+0000 b12600 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9a67700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001659:[<0x200000015b5/article-25.xml v999>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001659:[<0x200000015b5/article-25.xml v999>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.923 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.664+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016ee [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-59.jpg auth v1025 ap=1 s=12756 n(v0 rc2024-03-27T07:25:44.912656+0000 b12756 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9cf7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016ee:[<0x200000015b5/picture-59.jpg v1025>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016ee:[<0x200000015b5/picture-59.jpg v1025>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.665+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001796 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-21.jpg auth v1033 ap=1 s=35745 n(v0 rc2024-03-27T07:25:45.410646+0000 b35745 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a978d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001796:[<0x200000015b5/picture-21.jpg v1033>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001796:[<0x200000015b5/picture-21.jpg v1033>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.665+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001633 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-35.xml auth v1079 ap=1 s=11672 n(v0 rc2024-03-27T07:25:44.300668+0000 b11672 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b1db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001633:[<0x200000015b5/article-35.xml v1079>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001633:[<0x200000015b5/article-35.xml v1079>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.665+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000193d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-73.xml auth v1051 ap=1 s=7133 n(v0 rc2024-03-27T07:25:47.399607+0000 b7133 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a7a5e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000193d:[<0x200000015b5/comment-73.xml v1051>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000193d:[<0x200000015b5/comment-73.xml v1051>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.666+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002010 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-60.xml auth{0=1} v1229 ap=1 s=4246 n(v0 rc2024-03-27T07:27:42.878338+0000 b4246 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607a7ff1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002010:[<0x200000015b5/comment-60.xml v1140>,<0x10000000399/blog-35 v133073>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000002010:[<0x200000015b5/comment-60.xml v1229>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.666+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001929 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-78.xml auth v1069 ap=1 s=9203 n(v0 rc2024-03-27T07:25:47.317609+0000 b9203 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9d05080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001929:[<0x200000015b5/comment-78.xml v1069>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001929:[<0x200000015b5/comment-78.xml v1069>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.667+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001629 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-38.xml auth v1019 ap=1 s=12964 n(v0 rc2024-03-27T07:25:44.240669+0000 b12964 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b3c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001629:[<0x200000015b5/article-38.xml v1019>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001629:[<0x200000015b5/article-38.xml v1019>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.667+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001622 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-40.xml auth v1071 ap=1 s=8297 n(v0 rc2024-03-27T07:25:44.193670+0000 b8297 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b35700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001622:[<0x200000015b5/article-40.xml v1071>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001622:[<0x200000015b5/article-40.xml v1071>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.667+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001760 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-30.jpg auth v1059 ap=1 s=29841 n(v0 rc2024-03-27T07:25:45.187651+0000 b29841 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a80e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001760:[<0x200000015b5/picture-30.jpg v1059>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001760:[<0x200000015b5/picture-30.jpg v1059>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.668+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cc9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-4.xml auth{0=1} v1077 ap=1 s=17442 n(v0 rc2024-03-27T07:26:33.087707+0000 b17442 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac73d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cc9:[<0x200000015b5/article-4.xml v1068>,<0x10000000399/blog-35 v112386>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cc9:[<0x200000015b5/article-4.xml v1077>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.668+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000018bb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-88.xml auth v1057 ap=1 s=7895 n(v0 rc2024-03-27T07:25:46.705621+0000 b7895 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a95aeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000018bb:[<0x200000015b5/comment-88.xml v1057>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000018bb:[<0x200000015b5/comment-88.xml v1057>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.668+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001684 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-15.xml auth v1081 ap=1 s=9436 n(v0 rc2024-03-27T07:25:44.654661+0000 b9436 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a88f7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001684:[<0x200000015b5/article-15.xml v1081>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001684:[<0x200000015b5/article-15.xml v1081>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.924 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.668+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001926 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-79.xml auth v1049 ap=1 s=9484 n(v0 rc2024-03-27T07:25:47.307609+0000 b9484 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9d04000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001926:[<0x200000015b5/comment-79.xml v1049>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001926:[<0x200000015b5/comment-79.xml v1049>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.669+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001748 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-36.jpg auth v1077 ap=1 s=43004 n(v0 rc2024-03-27T07:25:45.070653+0000 b43004 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607aa0a2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001748:[<0x200000015b5/picture-36.jpg v1077>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001748:[<0x200000015b5/picture-36.jpg v1077>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.669+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000172e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-43.jpg auth v1041 ap=1 s=38704 n(v0 rc2024-03-27T07:25:45.021654+0000 b38704 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9f95080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000172e:[<0x200000015b5/picture-43.jpg v1041>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000172e:[<0x200000015b5/picture-43.jpg v1041>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.669+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001670 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-19.xml auth v1053 ap=1 s=7409 n(v0 rc2024-03-27T07:25:44.552663+0000 b7409 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a88dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001670:[<0x200000015b5/article-19.xml v1053>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001670:[<0x200000015b5/article-19.xml v1053>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.669+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000018c4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-86.xml auth v1063 ap=1 s=7695 n(v0 rc2024-03-27T07:25:46.721621+0000 b7695 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a98f6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000018c4:[<0x200000015b5/comment-86.xml v1063>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000018c4:[<0x200000015b5/comment-86.xml v1063>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.670+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000179d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-20.jpg auth v1073 ap=1 s=31028 n(v0 rc2024-03-27T07:25:45.453646+0000 b31028 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a8bf1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000179d:[<0x200000015b5/picture-20.jpg v1073>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000179d:[<0x200000015b5/picture-20.jpg v1073>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.670+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ec8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-63.xml auth{0=1} v1227 ap=1 s=8586 n(v0 rc2024-03-27T07:27:40.959375+0000 b8586 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607aa760b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ec8:[<0x200000015b5/comment-63.xml v1133>,<0x10000000399/blog-35 v133073>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ec8:[<0x200000015b5/comment-63.xml v1227>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.670+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000018d3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-82.xml auth v1045 ap=1 s=3519 n(v0 rc2024-03-27T07:25:46.758620+0000 b3519 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a79cd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000018d3:[<0x200000015b5/comment-82.xml v1045>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000018d3:[<0x200000015b5/comment-82.xml v1045>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.671+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000161a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-42.xml auth v1047 ap=1 s=20403 n(v0 rc2024-03-27T07:25:44.155671+0000 b20403 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b32b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000161a:[<0x200000015b5/article-42.xml v1047>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000161a:[<0x200000015b5/article-42.xml v1047>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.671+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000018af [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-91.xml auth v1055 ap=1 s=6913 n(v0 rc2024-03-27T07:25:46.668622+0000 b6913 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9870580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000018af:[<0x200000015b5/comment-91.xml v1055>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000018af:[<0x200000015b5/comment-91.xml v1055>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.925 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.671+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x3000000058d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-38.jpg auth{0=1,2=1} v1102 ap=1 s=14741 n(v0 rc2024-03-27T07:26:41.389544+0000 b14741 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9f2b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x3000000058d:[<0x200000015b5/picture-38.jpg v1102>,<0x10000000399/blog-35 v112386>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x3000000058d:[<0x200000015b5/picture-38.jpg v1102>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.926 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.671+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000015c8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-64.xml auth v1084 ap=1 s=3968 n(v0 rc2024-03-27T07:25:43.829678+0000 b3968 1=1+0) caps={15291=pAsLsXsFscr/-@1} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9a90c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000015c8:[<0x200000015b5/article-64.xml v1084>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000015c8:[<0x200000015b5/article-64.xml v1084>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.926 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.672+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001625 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-39.xml auth v1086 ap=1 s=11526 n(v0 rc2024-03-27T07:25:44.216670+0000 b11526 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b3ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001625:[<0x200000015b5/article-39.xml v1086>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001625:[<0x200000015b5/article-39.xml v1086>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.926 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.672+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001630 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-36.xml auth v1054 ap=1 s=20748 n(v0 rc2024-03-27T07:25:44.281669+0000 b20748 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b1cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001630:[<0x200000015b5/article-36.xml v1054>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001630:[<0x200000015b5/article-36.xml v1054>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.926 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.672+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000162c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-37.xml auth v1078 ap=1 s=27238 n(v0 rc2024-03-27T07:25:44.260669+0000 b27238 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b3d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000162c:[<0x200000015b5/article-37.xml v1078>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000162c:[<0x200000015b5/article-37.xml v1078>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.926 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.673+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000176c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-27.jpg auth v1040 ap=1 s=42164 n(v0 rc2024-03-27T07:25:45.254649+0000 b42164 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9828000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000176c:[<0x200000015b5/picture-27.jpg v1040>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000176c:[<0x200000015b5/picture-27.jpg v1040>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.928 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.673+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000170a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-52.jpg auth v1062 ap=1 s=40253 n(v0 rc2024-03-27T07:25:44.959655+0000 b40253 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9e4e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000170a:[<0x200000015b5/picture-52.jpg v1062>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000170a:[<0x200000015b5/picture-52.jpg v1062>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.928 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.673+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016ca [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-1.xml auth v1056 ap=1 s=31807 n(v0 rc2024-03-27T07:25:44.847657+0000 b31807 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a91ccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016ca:[<0x200000015b5/article-1.xml v1056>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016ca:[<0x200000015b5/article-1.xml v1056>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.928 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.673+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001750 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-34.jpg auth v1042 ap=1 s=29644 n(v0 rc2024-03-27T07:25:45.087653+0000 b29644 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607aa189600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001750:[<0x200000015b5/picture-34.jpg v1042>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001750:[<0x200000015b5/picture-34.jpg v1042>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.928 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.673+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001706 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-53.jpg auth v1060 ap=1 s=47877 n(v0 rc2024-03-27T07:25:44.952655+0000 b47877 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9dca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001706:[<0x200000015b5/picture-53.jpg v1060>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001706:[<0x200000015b5/picture-53.jpg v1060>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.674+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000593 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-66.xml auth{0=1,2=1} v1107 ap=1 s=13311 n(v0 rc2024-03-27T07:26:41.519541+0000 b13311 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade65080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000000593:[<0x200000015b5/article-66.xml v1107>,<0x10000000399/blog-35 v112386>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x30000000593:[<0x200000015b5/article-66.xml v1107>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.674+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000016ce [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-67.jpg auth v1094 ap=1 s=43145 n(v0 rc2024-03-27T07:25:44.855657+0000 b43145 1=1+0) caps={15291=pAsLsXsFscr/-@1} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a91ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000016ce:[<0x200000015b5/picture-67.jpg v1094>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000016ce:[<0x200000015b5/picture-67.jpg v1094>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.674+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000017b3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-16.jpg auth v1092 ap=1 s=63588 n(v0 rc2024-03-27T07:25:45.568643+0000 b63588 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9a1fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000017b3:[<0x200000015b5/picture-16.jpg v1092>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000017b3:[<0x200000015b5/picture-16.jpg v1092>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.675+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000018c0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-87.xml auth v1048 ap=1 s=8328 n(v0 rc2024-03-27T07:25:46.713621+0000 b8328 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a95b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000018c0:[<0x200000015b5/comment-87.xml v1048>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000018c0:[<0x200000015b5/comment-87.xml v1048>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.675+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000167a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-17.xml auth v1088 ap=1 s=15869 n(v0 rc2024-03-27T07:25:44.598662+0000 b15869 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a88df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000167a:[<0x200000015b5/article-17.xml v1088>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000167a:[<0x200000015b5/article-17.xml v1088>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.675+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001660 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-23.xml auth v1038 ap=1 s=21005 n(v0 rc2024-03-27T07:25:44.476665+0000 b21005 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9a40100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001660:[<0x200000015b5/article-23.xml v1038>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001660:[<0x200000015b5/article-23.xml v1038>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.675+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001758 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-32.jpg auth v1074 ap=1 s=20182 n(v0 rc2024-03-27T07:25:45.132652+0000 b20182 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a75f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001758:[<0x200000015b5/picture-32.jpg v1074>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001758:[<0x200000015b5/picture-32.jpg v1074>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.676+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000015cc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-63.xml auth v1080 ap=1 s=15071 n(v0 rc2024-03-27T07:25:43.836677+0000 b15071 1=1+0) caps={15291=pAsLsXsFscr/-@1} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9b00580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000015cc:[<0x200000015b5/article-63.xml v1080>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000015cc:[<0x200000015b5/article-63.xml v1080>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.676+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000171a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-48.jpg auth v1058 ap=1 s=23733 n(v0 rc2024-03-27T07:25:44.986655+0000 b23733 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a9ec9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000171a:[<0x200000015b5/picture-48.jpg v1058>,<0x10000000399/blog-35 v64827>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000171a:[<0x200000015b5/picture-48.jpg v1058>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.677+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x30000000ef8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-65.xml auth{0=1,2=1} v1129 ap=1 s=3640 n(v0 rc2024-03-27T07:27:39.179410+0000 b3640 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | request=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab832680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000000ef8:[<0x200000015b5/comment-65.xml v1129>,<0x10000000399/blog-35 v133073>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x30000000ef8:[<0x200000015b5/comment-65.xml v1129>,<0x10000000399/blog-35 v144231>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.929 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.789+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000117a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-13.xml auth{0=1} v1292 ap=1 s=3166 n(v0 rc2024-03-27T07:25:39.213768+0000 b3166 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad298b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000117a:[<0x2000000083a/comment-13.xml v1292>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x2000000117a:[<0x2000000083a/comment-13.xml v1292>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.789+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d39 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-75.xml auth v1276 ap=1 s=22058 n(v0 rc2024-03-27T07:25:34.849854+0000 b22058 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad299b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d39:[<0x2000000083a/article-75.xml v1276>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000d39:[<0x2000000083a/article-75.xml v1276>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.789+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001152 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-21.xml auth{0=1} v1306 ap=1 s=9171 n(v0 rc2024-03-27T07:25:39.043772+0000 b9171 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad299080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001152:[<0x2000000083a/comment-21.xml v1209>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000001152:[<0x2000000083a/comment-21.xml v1306>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.789+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001139 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-26.xml auth{0=1} v1312 ap=1 s=4282 n(v0 rc2024-03-27T07:25:38.931774+0000 b4282 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad299600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001139:[<0x2000000083a/comment-26.xml v1199>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000001139:[<0x2000000083a/comment-26.xml v1312>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.790+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008e2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-27.jpg auth v1282 ap=1 s=15591 n(v0 rc2024-03-27T07:25:30.650937+0000 b15591 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad29a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008e2:[<0x2000000083a/picture-27.jpg v1282>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x200000008e2:[<0x2000000083a/picture-27.jpg v1282>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.790+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e6e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-12.xml auth v1330 ap=1 s=17569 n(v0 rc2024-03-27T07:26:22.103924+0000 b17569 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5607ad29a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e6e:[<0x2000000083a/article-12.xml v1326>,<0x10000000399/blog-14 v94718>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e6e:[<0x2000000083a/article-12.xml v1330>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.790+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001125 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-30.xml auth{0=1} v1314 ap=1 s=7933 n(v0 rc2024-03-27T07:25:38.840776+0000 b7933 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab07c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001125:[<0x2000000083a/comment-30.xml v1190>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000001125:[<0x2000000083a/comment-30.xml v1314>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.790+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008d0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-34.jpg auth v1286 ap=1 s=8321 n(v0 rc2024-03-27T07:25:30.484940+0000 b8321 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab07cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008d0:[<0x2000000083a/picture-34.jpg v1286>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x200000008d0:[<0x2000000083a/picture-34.jpg v1286>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.791+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000089c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-53.jpg auth v1270 ap=1 s=27563 n(v0 rc2024-03-27T07:25:30.274944+0000 b27563 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab07d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000089c:[<0x2000000083a/picture-53.jpg v1270>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x2000000089c:[<0x2000000083a/picture-53.jpg v1270>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.791+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000872 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-67.jpg auth v1268 ap=1 s=44947 n(v0 rc2024-03-27T07:25:30.086948+0000 b44947 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab07d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000872:[<0x2000000083a/picture-67.jpg v1268>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000872:[<0x2000000083a/picture-67.jpg v1268>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.791+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000089f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-52.jpg auth v1278 ap=1 s=35553 n(v0 rc2024-03-27T07:25:30.283944+0000 b35553 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad29ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000089f:[<0x2000000083a/picture-52.jpg v1278>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x2000000089f:[<0x2000000083a/picture-52.jpg v1278>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.791+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000011aa [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-3.xml auth{0=1} v1296 ap=1 s=7645 n(v0 rc2024-03-27T07:25:39.425764+0000 b7645 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab07db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000011aa:[<0x2000000083a/comment-3.xml v1296>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x200000011aa:[<0x2000000083a/comment-3.xml v1296>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.930 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.791+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001161 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-18.xml auth{0=1} v1294 ap=1 s=2074 n(v0 rc2024-03-27T07:25:39.111770+0000 b2074 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab07e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001161:[<0x2000000083a/comment-18.xml v1294>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000001161:[<0x2000000083a/comment-18.xml v1294>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f1f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-1.xml auth{0=1} v1362 ap=1 s=21289 n(v0 rc2024-03-27T07:26:58.163214+0000 b21289 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab07c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f1f:[<0x2000000083a/article-1.xml v1335>,<0x10000000399/blog-14 v117675>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f1f:[<0x2000000083a/article-1.xml v1362>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000de8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-16.jpg auth v1288 ap=1 s=60004 n(v0 rc2024-03-27T07:25:35.476842+0000 b60004 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab07e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000de8:[<0x2000000083a/picture-16.jpg v1288>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000de8:[<0x2000000083a/picture-16.jpg v1288>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000117e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-12.xml auth{0=1} v1302 ap=1 s=9706 n(v0 rc2024-03-27T07:25:39.232768+0000 b9706 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab07ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000117e:[<0x2000000083a/comment-12.xml v1302>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x2000000117e:[<0x2000000083a/comment-12.xml v1302>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000085c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-74.jpg auth v1274 ap=1 s=18251 n(v0 rc2024-03-27T07:25:30.005950+0000 b18251 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab07f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000085c:[<0x2000000083a/picture-74.jpg v1274>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x2000000085c:[<0x2000000083a/picture-74.jpg v1274>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.792+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000010d0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-49.xml auth{0=1} v1304 ap=1 s=3322 n(v0 rc2024-03-27T07:25:38.463783+0000 b3322 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab07f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000010d0:[<0x2000000083a/comment-49.xml v1263>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x200000010d0:[<0x2000000083a/comment-49.xml v1304>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e1c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-87.xml auth{0=1} v1298 ap=1 s=7503 n(v0 rc2024-03-27T07:25:35.585840+0000 b7503 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ada98000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e1c:[<0x2000000083a/comment-87.xml v1298>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000e1c:[<0x2000000083a/comment-87.xml v1298>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000010eb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-42.xml auth{0=1} v1310 ap=1 s=6739 n(v0 rc2024-03-27T07:25:38.590781+0000 b6739 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ada98580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000010eb:[<0x2000000083a/comment-42.xml v1167>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x200000010eb:[<0x2000000083a/comment-42.xml v1310>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001094 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-65.xml auth{0=1} v1308 ap=1 s=2357 n(v0 rc2024-03-27T07:25:38.131790+0000 b2357 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ada98b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001094:[<0x2000000083a/comment-65.xml v1115>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000001094:[<0x2000000083a/comment-65.xml v1308>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-17.xml auth v1366 ap=1 s=6889 n(v0 rc2024-03-27T07:27:20.743772+0000 b6889 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ada99080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e3:[<0x2000000083a/article-17.xml v1356>,<0x10000000399/blog-14 v126203>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018e3:[<0x2000000083a/article-17.xml v1366>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000856 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-76.jpg auth v1280 ap=1 s=36150 n(v0 rc2024-03-27T07:25:29.969950+0000 b36150 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ada99600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000856:[<0x2000000083a/picture-76.jpg v1280>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000856:[<0x2000000083a/picture-76.jpg v1280>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008d5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-32.jpg auth v1284 ap=1 s=19561 n(v0 rc2024-03-27T07:25:30.520939+0000 b19561 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ada99b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008d5:[<0x2000000083a/picture-32.jpg v1284>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x200000008d5:[<0x2000000083a/picture-32.jpg v1284>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.931 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.793+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000010c8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-51.xml auth{0=1} v1300 ap=1 s=3400 n(v0 rc2024-03-27T07:25:38.422784+0000 b3400 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ada9a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000010c8:[<0x2000000083a/comment-51.xml v1300>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x200000010c8:[<0x2000000083a/comment-51.xml v1300>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.794+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008aa [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-48.jpg auth v1290 ap=1 s=26744 n(v0 rc2024-03-27T07:25:30.342943+0000 b26744 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ada9a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008aa:[<0x2000000083a/picture-48.jpg v1290>,<0x10000000399/blog-14 v49826>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x200000008aa:[<0x2000000083a/picture-48.jpg v1290>,<0x10000000399/blog-14 v143499>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.832+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d1a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-18.jpg auth{0=1} v688 ap=1 s=42663 n(v0 rc2024-03-27T07:25:51.814520+0000 b42663 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad980b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d1a:[<0x20000001c3d/picture-18.jpg v688>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d1a:[<0x20000001c3d/picture-18.jpg v688>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.832+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d32 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-13.jpg auth{0=1} v776 ap=1 s=59878 n(v0 rc2024-03-27T07:25:51.982517+0000 b59878 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad980580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d32:[<0x20000001c3d/picture-13.jpg v776>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d32:[<0x20000001c3d/picture-13.jpg v776>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.832+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c57 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-18.xml auth{0=1} v604 ap=1 s=25371 n(v0 rc2024-03-27T07:25:50.988537+0000 b25371 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad981080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c57:[<0x20000001c3d/article-18.xml v604>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c57:[<0x20000001c3d/article-18.xml v604>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.833+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d14 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-19.jpg auth{0=1} v780 ap=1 s=51091 n(v0 rc2024-03-27T07:25:51.760521+0000 b51091 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad981b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d14:[<0x20000001c3d/picture-19.jpg v780>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d14:[<0x20000001c3d/picture-19.jpg v780>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.833+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d4d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-4.jpg auth{0=1} v778 ap=1 s=10616 n(v0 rc2024-03-27T07:25:52.108514+0000 b10616 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad982680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d4d:[<0x20000001c3d/picture-4.jpg v778>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d4d:[<0x20000001c3d/picture-4.jpg v778>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.833+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ce4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-35.jpg auth v815 ap=1 s=46382 n(v0 rc2024-03-27T07:25:51.412528+0000 b46382 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad983180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ce4:[<0x20000001c3d/picture-35.jpg v786>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ce4:[<0x20000001c3d/picture-35.jpg v815>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.833+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d53 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-2.jpg auth{0=1} v782 ap=1 s=21517 n(v0 rc2024-03-27T07:25:52.128514+0000 b21517 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad983700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d53:[<0x20000001c3d/picture-2.jpg v782>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d53:[<0x20000001c3d/picture-2.jpg v782>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.834+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c51 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-20.xml auth{0=1} v618 ap=1 s=5067 n(v0 rc2024-03-27T07:25:50.974537+0000 b5067 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab2d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c51:[<0x20000001c3d/article-20.xml v618>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c51:[<0x20000001c3d/article-20.xml v618>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.834+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d2f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-14.jpg auth{0=1} v640 ap=1 s=46016 n(v0 rc2024-03-27T07:25:51.966517+0000 b46016 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab2d6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d2f:[<0x20000001c3d/picture-14.jpg v640>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d2f:[<0x20000001c3d/picture-14.jpg v640>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.932 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.834+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ca4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-61.jpg auth v813 ap=1 s=47594 n(v0 rc2024-03-27T07:25:51.201532+0000 b47594 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab2d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ca4:[<0x20000001c3d/picture-61.jpg v752>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ca4:[<0x20000001c3d/picture-61.jpg v813>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.834+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d44 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-7.jpg auth{0=1} v646 ap=1 s=33279 n(v0 rc2024-03-27T07:25:52.081515+0000 b33279 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab2d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d44:[<0x20000001c3d/picture-7.jpg v646>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d44:[<0x20000001c3d/picture-7.jpg v646>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.834+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d3e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-9.jpg auth{0=1} v788 ap=1 s=9149 n(v0 rc2024-03-27T07:25:52.052516+0000 b9149 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab2d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d3e:[<0x20000001c3d/picture-9.jpg v788>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d3e:[<0x20000001c3d/picture-9.jpg v788>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.835+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cfd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-25.jpg auth{0=1} v762 ap=1 s=28544 n(v0 rc2024-03-27T07:25:51.495527+0000 b28544 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd94c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cfd:[<0x20000001c3d/picture-25.jpg v762>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cfd:[<0x20000001c3d/picture-25.jpg v762>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.835+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c6f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-8.xml auth{0=1} v720 ap=1 s=12498 n(v0 rc2024-03-27T07:25:51.050535+0000 b12498 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd95180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c6f:[<0x20000001c3d/article-8.xml v720>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c6f:[<0x20000001c3d/article-8.xml v720>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.835+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cee [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-31.jpg auth v817 ap=1 s=13272 n(v0 rc2024-03-27T07:25:51.447527+0000 b13272 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a7792b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cee:[<0x20000001c3d/picture-31.jpg v772>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cee:[<0x20000001c3d/picture-31.jpg v817>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.836+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cc2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-49.jpg auth v815 ap=1 s=46701 n(v0 rc2024-03-27T07:25:51.309530+0000 b46701 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a7793600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cc2:[<0x20000001c3d/picture-49.jpg v676>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cc2:[<0x20000001c3d/picture-49.jpg v815>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.836+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d41 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-8.jpg auth{0=1} v634 ap=1 s=40378 n(v0 rc2024-03-27T07:25:52.067515+0000 b40378 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7793b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d41:[<0x20000001c3d/picture-8.jpg v634>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d41:[<0x20000001c3d/picture-8.jpg v634>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.836+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cfb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-26.jpg auth{0=1} v624 ap=1 s=58281 n(v0 rc2024-03-27T07:25:51.486527+0000 b58281 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7794100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cfb:[<0x20000001c3d/picture-26.jpg v624>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cfb:[<0x20000001c3d/picture-26.jpg v624>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.836+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c4e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-21.xml auth{0=1} v642 ap=1 s=10852 n(v0 rc2024-03-27T07:25:50.966537+0000 b10852 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7794680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c4e:[<0x20000001c3d/article-21.xml v642>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c4e:[<0x20000001c3d/article-21.xml v642>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.837+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c63 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-13.xml auth{0=1} v650 ap=1 s=13745 n(v0 rc2024-03-27T07:25:51.018536+0000 b13745 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7795180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c63:[<0x20000001c3d/article-13.xml v650>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c63:[<0x20000001c3d/article-13.xml v650>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.933 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.837+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c74 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-6.xml auth{0=1} v794 ap=1 s=25558 n(v0 rc2024-03-27T07:25:51.064535+0000 b25558 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad00e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c74:[<0x20000001c3d/article-6.xml v794>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c74:[<0x20000001c3d/article-6.xml v794>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.934 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.837+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cb5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-54.jpg auth v813 ap=1 s=43866 n(v0 rc2024-03-27T07:25:51.255531+0000 b43866 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad00f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cb5:[<0x20000001c3d/picture-54.jpg v748>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cb5:[<0x20000001c3d/picture-54.jpg v813>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.938 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.837+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cf3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-29.jpg auth v819 ap=1 s=30528 n(v0 rc2024-03-27T07:25:51.459527+0000 b30528 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad010100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cf3:[<0x20000001c3d/picture-29.jpg v700>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cf3:[<0x20000001c3d/picture-29.jpg v819>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.938 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.838+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d4a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-5.jpg auth{0=1} v630 ap=1 s=42623 n(v0 rc2024-03-27T07:25:52.100515+0000 b42623 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab8dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d4a:[<0x20000001c3d/picture-5.jpg v630>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d4a:[<0x20000001c3d/picture-5.jpg v630>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.938 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.838+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cbf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-50.jpg auth v823 ap=1 s=35474 n(v0 rc2024-03-27T07:25:51.299530+0000 b35474 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac184000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cbf:[<0x20000001c3d/picture-50.jpg v652>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cbf:[<0x20000001c3d/picture-50.jpg v823>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.938 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.839+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cab [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-58.jpg auth v819 ap=1 s=35831 n(v0 rc2024-03-27T07:25:51.225532+0000 b35831 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac184b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cab:[<0x20000001c3d/picture-58.jpg v698>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cab:[<0x20000001c3d/picture-58.jpg v819>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.938 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.839+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c9a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-65.jpg auth v815 ap=1 s=24397 n(v0 rc2024-03-27T07:25:51.171533+0000 b24397 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac185b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c9a:[<0x20000001c3d/picture-65.jpg v740>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c9a:[<0x20000001c3d/picture-65.jpg v815>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.938 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.840+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c90 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-69.jpg auth v813 ap=1 s=26677 n(v0 rc2024-03-27T07:25:51.146533+0000 b26677 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aaf6eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c90:[<0x20000001c3d/picture-69.jpg v608>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c90:[<0x20000001c3d/picture-69.jpg v813>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.938 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.840+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cbd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-51.jpg auth v821 ap=1 s=13488 n(v0 rc2024-03-27T07:25:51.290531+0000 b13488 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aaf6f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cbd:[<0x20000001c3d/picture-51.jpg v724>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cbd:[<0x20000001c3d/picture-51.jpg v821>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.840+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ca1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-62.jpg auth v817 ap=1 s=19274 n(v0 rc2024-03-27T07:25:51.195532+0000 b19274 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aaf70680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ca1:[<0x20000001c3d/picture-62.jpg v658>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ca1:[<0x20000001c3d/picture-62.jpg v817>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.840+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cc9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-46.jpg auth v825 ap=1 s=54005 n(v0 rc2024-03-27T07:25:51.327530+0000 b54005 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aaf71180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cc9:[<0x20000001c3d/picture-46.jpg v674>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cc9:[<0x20000001c3d/picture-46.jpg v825>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.841+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d50 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-3.jpg auth{0=1} v722 ap=1 s=62505 n(v0 rc2024-03-27T07:25:52.120514+0000 b62505 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab3ee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d50:[<0x20000001c3d/picture-3.jpg v722>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d50:[<0x20000001c3d/picture-3.jpg v722>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.841+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cb3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-55.jpg auth v819 ap=1 s=59900 n(v0 rc2024-03-27T07:25:51.245531+0000 b59900 1=1+0) | authpin=1 scrubqueue=0 0x5607ab1aa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cb3:[<0x20000001c3d/picture-55.jpg v662>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cb3:[<0x20000001c3d/picture-55.jpg v819>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.841+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d38 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-11.jpg auth{0=1} v702 ap=1 s=47296 n(v0 rc2024-03-27T07:25:52.015516+0000 b47296 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab3efb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d38:[<0x20000001c3d/picture-11.jpg v702>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d38:[<0x20000001c3d/picture-11.jpg v702>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.842+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c8d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-70.jpg auth v815 ap=1 s=58153 n(v0 rc2024-03-27T07:25:51.139534+0000 b58153 1=1+0) | authpin=1 scrubqueue=0 0x5607a9939700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c8d:[<0x20000001c3d/picture-70.jpg v746>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c8d:[<0x20000001c3d/picture-70.jpg v815>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.842+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c77 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-5.xml auth{0=1} v718 ap=1 s=19722 n(v0 rc2024-03-27T07:25:51.073535+0000 b19722 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab3f0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c77:[<0x20000001c3d/article-5.xml v718>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c77:[<0x20000001c3d/article-5.xml v718>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.842+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c8b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-71.jpg auth v813 ap=1 s=9380 n(v0 rc2024-03-27T07:25:51.132534+0000 b9380 1=1+0) | authpin=1 scrubqueue=0 0x5607aa9d3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c8b:[<0x20000001c3d/picture-71.jpg v770>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c8b:[<0x20000001c3d/picture-71.jpg v813>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.842+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c9f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-63.jpg auth v817 ap=1 s=29195 n(v0 rc2024-03-27T07:25:51.188533+0000 b29195 1=1+0) | authpin=1 scrubqueue=0 0x5607a90c9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c9f:[<0x20000001c3d/picture-63.jpg v686>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c9f:[<0x20000001c3d/picture-63.jpg v817>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.843+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cd8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-40.jpg auth v821 ap=1 s=59827 n(v0 rc2024-03-27T07:25:51.378529+0000 b59827 1=1+0) | authpin=1 scrubqueue=0 0x5607ab9beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cd8:[<0x20000001c3d/picture-40.jpg v656>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cd8:[<0x20000001c3d/picture-40.jpg v821>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.939 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.843+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c4b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-22.xml auth{0=1} v714 ap=1 s=7559 n(v0 rc2024-03-27T07:25:50.960537+0000 b7559 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a94cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c4b:[<0x20000001c3d/article-22.xml v714>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c4b:[<0x20000001c3d/article-22.xml v714>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.940 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.843+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c9c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-64.jpg auth v815 ap=1 s=62773 n(v0 rc2024-03-27T07:25:51.178533+0000 b62773 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9e9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c9c:[<0x20000001c3d/picture-64.jpg v672>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c9c:[<0x20000001c3d/picture-64.jpg v815>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.940 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.844+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d3b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-10.jpg auth{0=1} v704 ap=1 s=9822 n(v0 rc2024-03-27T07:25:52.037516+0000 b9822 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2c2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d3b:[<0x20000001c3d/picture-10.jpg v704>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d3b:[<0x20000001c3d/picture-10.jpg v704>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.940 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.844+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d56 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-1.jpg auth{0=1} v666 ap=1 s=63278 n(v0 rc2024-03-27T07:25:52.136514+0000 b63278 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2c2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d56:[<0x20000001c3d/picture-1.jpg v666>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d56:[<0x20000001c3d/picture-1.jpg v666>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.940 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.844+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c6d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-9.xml auth{0=1} v792 ap=1 s=3686 n(v0 rc2024-03-27T07:25:51.041535+0000 b3686 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2c3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c6d:[<0x20000001c3d/article-9.xml v792>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c6d:[<0x20000001c3d/article-9.xml v792>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.940 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.845+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d47 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-6.jpg auth{0=1} v648 ap=1 s=40363 n(v0 rc2024-03-27T07:25:52.093515+0000 b40363 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2c3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d47:[<0x20000001c3d/picture-6.jpg v648>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d47:[<0x20000001c3d/picture-6.jpg v648>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.940 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.845+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c45 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-24.xml auth{0=1} v800 ap=1 s=14734 n(v0 rc2024-03-27T07:25:50.944537+0000 b14734 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2c4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c45:[<0x20000001c3d/article-24.xml v800>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c45:[<0x20000001c3d/article-24.xml v800>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.940 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.845+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cf6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-28.jpg auth v827 ap=1 s=49875 n(v0 rc2024-03-27T07:25:51.467527+0000 b49875 1=1+0) | authpin=1 scrubqueue=0 0x5607aea10000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cf6:[<0x20000001c3d/picture-28.jpg v756>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cf6:[<0x20000001c3d/picture-28.jpg v827>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.940 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.845+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cdf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-37.jpg auth v823 ap=1 s=19682 n(v0 rc2024-03-27T07:25:51.397528+0000 b19682 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9eb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cdf:[<0x20000001c3d/picture-37.jpg v784>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cdf:[<0x20000001c3d/picture-37.jpg v823>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.940 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.845+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c7c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-3.xml auth{0=1} v744 ap=1 s=30526 n(v0 rc2024-03-27T07:25:51.086535+0000 b30526 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac66ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c7c:[<0x20000001c3d/article-3.xml v744>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c7c:[<0x20000001c3d/article-3.xml v744>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.940 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.846+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ce9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-33.jpg auth v825 ap=1 s=23588 n(v0 rc2024-03-27T07:25:51.432528+0000 b23588 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ce9:[<0x20000001c3d/picture-33.jpg v678>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ce9:[<0x20000001c3d/picture-33.jpg v825>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.846+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c72 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-7.xml auth{0=1} v654 ap=1 s=23965 n(v0 rc2024-03-27T07:25:51.056535+0000 b23965 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac66c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c72:[<0x20000001c3d/article-7.xml v654>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c72:[<0x20000001c3d/article-7.xml v654>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.846+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d1f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-17.jpg auth{0=1} v696 ap=1 s=27665 n(v0 rc2024-03-27T07:25:51.847520+0000 b27665 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac66a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d1f:[<0x20000001c3d/picture-17.jpg v696>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d1f:[<0x20000001c3d/picture-17.jpg v696>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.846+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d00 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-24.jpg auth{0=1} v660 ap=1 s=30920 n(v0 rc2024-03-27T07:25:51.503526+0000 b30920 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac66b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d00:[<0x20000001c3d/picture-24.jpg v660>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d00:[<0x20000001c3d/picture-24.jpg v660>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.847+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cae [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-57.jpg auth v817 ap=1 s=15013 n(v0 rc2024-03-27T07:25:51.234532+0000 b15013 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cae:[<0x20000001c3d/picture-57.jpg v764>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cae:[<0x20000001c3d/picture-57.jpg v817>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.847+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c92 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-68.jpg auth v813 ap=1 s=37459 n(v0 rc2024-03-27T07:25:51.152533+0000 b37459 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c92:[<0x20000001c3d/picture-68.jpg v612>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c92:[<0x20000001c3d/picture-68.jpg v813>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.847+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cd3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-42.jpg auth v819 ap=1 s=23291 n(v0 rc2024-03-27T07:25:51.357529+0000 b23291 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9ea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cd3:[<0x20000001c3d/picture-42.jpg v616>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cd3:[<0x20000001c3d/picture-42.jpg v819>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.847+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cda [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-39.jpg auth v821 ap=1 s=33673 n(v0 rc2024-03-27T07:25:51.384529+0000 b33673 1=1+0) | authpin=1 scrubqueue=0 0x5607ae9eac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cda:[<0x20000001c3d/picture-39.jpg v732>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cda:[<0x20000001c3d/picture-39.jpg v821>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.847+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d09 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-21.jpg auth{0=1} v798 ap=1 s=18317 n(v0 rc2024-03-27T07:25:51.587525+0000 b18317 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad070c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d09:[<0x20000001c3d/picture-21.jpg v798>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d09:[<0x20000001c3d/picture-21.jpg v798>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.848+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c86 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-73.jpg auth v813 ap=1 s=59208 n(v0 rc2024-03-27T07:25:51.120534+0000 b59208 1=1+0) | authpin=1 scrubqueue=0 0x5607aa2fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c86:[<0x20000001c3d/picture-73.jpg v694>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c86:[<0x20000001c3d/picture-73.jpg v813>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.848+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cf1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-30.jpg auth v821 ap=1 s=26891 n(v0 rc2024-03-27T07:25:51.453527+0000 b26891 1=1+0) | authpin=1 scrubqueue=0 0x5607ad434580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cf1:[<0x20000001c3d/picture-30.jpg v706>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cf1:[<0x20000001c3d/picture-30.jpg v821>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.848+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c5e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-15.xml auth{0=1} v712 ap=1 s=12729 n(v0 rc2024-03-27T07:25:51.006536+0000 b12729 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adb1c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c5e:[<0x20000001c3d/article-15.xml v712>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c5e:[<0x20000001c3d/article-15.xml v712>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.941 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.849+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c54 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-19.xml auth{0=1} v708 ap=1 s=9083 n(v0 rc2024-03-27T07:25:50.981537+0000 b9083 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adb1e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c54:[<0x20000001c3d/article-19.xml v708>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c54:[<0x20000001c3d/article-19.xml v708>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.849+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ce2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-36.jpg auth v819 ap=1 s=9966 n(v0 rc2024-03-27T07:25:51.403528+0000 b9966 1=1+0) | authpin=1 scrubqueue=0 0x5607acec4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ce2:[<0x20000001c3d/picture-36.jpg v622>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ce2:[<0x20000001c3d/picture-36.jpg v819>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.849+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cd1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-43.jpg auth v815 ap=1 s=33883 n(v0 rc2024-03-27T07:25:51.348529+0000 b33883 1=1+0) | authpin=1 scrubqueue=0 0x5607ac90d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cd1:[<0x20000001c3d/picture-43.jpg v768>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cd1:[<0x20000001c3d/picture-43.jpg v815>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.849+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cdd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-38.jpg auth v817 ap=1 s=18567 n(v0 rc2024-03-27T07:25:51.391529+0000 b18567 1=1+0) | authpin=1 scrubqueue=0 0x5607ad1b7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cdd:[<0x20000001c3d/picture-38.jpg v716>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cdd:[<0x20000001c3d/picture-38.jpg v817>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.850+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d0e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-20.jpg auth{0=1} v750 ap=1 s=9767 n(v0 rc2024-03-27T07:25:51.653523+0000 b9767 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adb1e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d0e:[<0x20000001c3d/picture-20.jpg v750>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d0e:[<0x20000001c3d/picture-20.jpg v750>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.850+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cf8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-27.jpg auth{0=1} v610 ap=1 s=39893 n(v0 rc2024-03-27T07:25:51.477527+0000 b39893 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9a8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cf8:[<0x20000001c3d/picture-27.jpg v610>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cf8:[<0x20000001c3d/picture-27.jpg v610>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.850+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b15 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-36.xml auth v1013 ap=1 s=31560 n(v0 rc2024-03-27T07:27:35.223488+0000 b31560 1=1+0) | ptrwaiter=0 lock=0 importingcaps=0 caps=0 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5607ac9a8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b15:[<0x20000001c3d/article-36.xml v836>,<0x10000000399/blog-47 v133393>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b15:[<0x20000001c3d/article-36.xml v1013>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.851+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c65 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-12.xml auth{0=1} v790 ap=1 s=7503 n(v0 rc2024-03-27T07:25:51.024536+0000 b7503 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9a8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c65:[<0x20000001c3d/article-12.xml v790>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c65:[<0x20000001c3d/article-12.xml v790>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.851+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c81 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-1.xml auth{0=1} v710 ap=1 s=1512 n(v0 rc2024-03-27T07:25:51.103534+0000 b1512 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a971e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c81:[<0x20000001c3d/article-1.xml v710>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c81:[<0x20000001c3d/article-1.xml v710>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.851+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cba [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-52.jpg auth v823 ap=1 s=30754 n(v0 rc2024-03-27T07:25:51.281531+0000 b30754 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac9a9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cba:[<0x20000001c3d/picture-52.jpg v670>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cba:[<0x20000001c3d/picture-52.jpg v823>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.851+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ce7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-34.jpg auth v827 ap=1 s=13461 n(v0 rc2024-03-27T07:25:51.422528+0000 b13461 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a779a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ce7:[<0x20000001c3d/picture-34.jpg v636>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ce7:[<0x20000001c3d/picture-34.jpg v827>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.942 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.851+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cb8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-53.jpg auth v821 ap=1 s=25553 n(v0 rc2024-03-27T07:25:51.269531+0000 b25553 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a9642000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cb8:[<0x20000001c3d/picture-53.jpg v730>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cb8:[<0x20000001c3d/picture-53.jpg v821>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.943 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.852+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c95 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-67.jpg auth v819 ap=1 s=59213 n(v0 rc2024-03-27T07:25:51.159533+0000 b59213 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aac46580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c95:[<0x20000001c3d/picture-67.jpg v796>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c95:[<0x20000001c3d/picture-67.jpg v819>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.943 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.852+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d25 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-16.jpg auth{0=1} v628 ap=1 s=14766 n(v0 rc2024-03-27T07:25:51.895519+0000 b14766 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa18ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d25:[<0x20000001c3d/picture-16.jpg v628>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d25:[<0x20000001c3d/picture-16.jpg v628>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.943 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.852+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000922 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-77.xml auth v812 ap=1 s=1597 n(v0 rc2024-03-27T07:25:59.665366+0000 b1597 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac311180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000922:[<0x20000001c3d/article-77.xml v804>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x10000000922:[<0x20000001c3d/article-77.xml v812>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.943 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.854+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c83 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-74.jpg auth v817 ap=1 s=19909 n(v0 rc2024-03-27T07:25:51.113534+0000 b19909 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac310100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c83:[<0x20000001c3d/picture-74.jpg v638>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c83:[<0x20000001c3d/picture-74.jpg v817>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.943 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.854+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c48 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-23.xml auth{0=1} v680 ap=1 s=6448 n(v0 rc2024-03-27T07:25:50.952537+0000 b6448 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac30f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c48:[<0x20000001c3d/article-23.xml v680>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c48:[<0x20000001c3d/article-23.xml v680>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.943 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.854+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c59 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-17.xml auth{0=1} v682 ap=1 s=11884 n(v0 rc2024-03-27T07:25:50.994536+0000 b11884 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac30eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c59:[<0x20000001c3d/article-17.xml v682>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c59:[<0x20000001c3d/article-17.xml v682>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.943 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.855+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cec [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-32.jpg auth v829 ap=1 s=20639 n(v0 rc2024-03-27T07:25:51.440528+0000 b20639 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac30e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cec:[<0x20000001c3d/picture-32.jpg v684>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cec:[<0x20000001c3d/picture-32.jpg v829>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.943 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.855+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cc4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-48.jpg auth v825 ap=1 s=49308 n(v0 rc2024-03-27T07:25:51.315530+0000 b49308 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607a883d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cc4:[<0x20000001c3d/picture-48.jpg v760>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cc4:[<0x20000001c3d/picture-48.jpg v825>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.943 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.855+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d02 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-23.jpg auth{0=1} v664 ap=1 s=57053 n(v0 rc2024-03-27T07:25:51.514526+0000 b57053 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad965080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d02:[<0x20000001c3d/picture-23.jpg v664>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d02:[<0x20000001c3d/picture-23.jpg v664>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.943 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.855+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c60 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-14.xml auth{0=1} v754 ap=1 s=9005 n(v0 rc2024-03-27T07:25:51.012536+0000 b9005 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad965b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c60:[<0x20000001c3d/article-14.xml v754>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c60:[<0x20000001c3d/article-14.xml v754>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.855+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ccc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-45.jpg auth v833 ap=1 s=53752 n(v0 rc2024-03-27T07:25:51.332530+0000 b53752 1=1+0) | authpin=1 scrubqueue=0 0x5607aea12100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ccc:[<0x20000001c3d/picture-45.jpg v738>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ccc:[<0x20000001c3d/picture-45.jpg v833>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.856+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ca6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-60.jpg auth v825 ap=1 s=40591 n(v0 rc2024-03-27T07:25:51.210532+0000 b40591 1=1+0) | authpin=1 scrubqueue=0 0x5607aea11080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ca6:[<0x20000001c3d/picture-60.jpg v726>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ca6:[<0x20000001c3d/picture-60.jpg v825>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.856+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001485 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-79.jpg auth v851 ap=1 s=51109 n(v0 rc2024-03-27T07:27:10.417974+0000 b51109 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad965600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001485:[<0x20000001c3d/picture-79.jpg v840>,<0x10000000399/blog-47 v116261>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000001485:[<0x20000001c3d/picture-79.jpg v851>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.856+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d05 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-22.jpg auth{0=1} v734 ap=1 s=53638 n(v0 rc2024-03-27T07:25:51.532526+0000 b53638 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac0d2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d05:[<0x20000001c3d/picture-22.jpg v734>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d05:[<0x20000001c3d/picture-22.jpg v734>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.858+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cd5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-41.jpg auth v837 ap=1 s=34582 n(v0 rc2024-03-27T07:25:51.368529+0000 b34582 1=1+0) | authpin=1 scrubqueue=0 0x5607aea12c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cd5:[<0x20000001c3d/picture-41.jpg v626>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cd5:[<0x20000001c3d/picture-41.jpg v837>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.858+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-91.xml auth v819 ap=1 s=1798 n(v0 rc2024-03-27T07:26:41.050550+0000 b1798 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad967180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf8:[<0x20000001c3d/article-91.xml v813>,<0x10000000399/blog-47 v95156>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cf8:[<0x20000001c3d/article-91.xml v819>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.858+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c97 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-66.jpg auth v823 ap=1 s=10249 n(v0 rc2024-03-27T07:25:51.166533+0000 b10249 1=1+0) | authpin=1 scrubqueue=0 0x5607aea10b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c97:[<0x20000001c3d/picture-66.jpg v614>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c97:[<0x20000001c3d/picture-66.jpg v823>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.858+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c3f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-26.xml auth{0=1} v602 ap=1 s=25675 n(v0 rc2024-03-27T07:25:50.930538+0000 b25675 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac0d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c3f:[<0x20000001c3d/article-26.xml v602>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c3f:[<0x20000001c3d/article-26.xml v602>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.859+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c68 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-11.xml auth{0=1} v774 ap=1 s=7558 n(v0 rc2024-03-27T07:25:51.029536+0000 b7558 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac0d2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c68:[<0x20000001c3d/article-11.xml v774>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c68:[<0x20000001c3d/article-11.xml v774>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.859+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c6a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-10.xml auth{0=1} v766 ap=1 s=19473 n(v0 rc2024-03-27T07:25:51.034536+0000 b19473 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac0d5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c6a:[<0x20000001c3d/article-10.xml v766>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c6a:[<0x20000001c3d/article-10.xml v766>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.861+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cc7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-47.jpg auth v831 ap=1 s=61027 n(v0 rc2024-03-27T07:25:51.321530+0000 b61027 1=1+0) | authpin=1 scrubqueue=0 0x5607aea11b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cc7:[<0x20000001c3d/picture-47.jpg v736>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cc7:[<0x20000001c3d/picture-47.jpg v831>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.944 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.881+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cce [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-44.jpg auth v835 ap=1 s=24497 n(v0 rc2024-03-27T07:25:51.338530+0000 b24497 1=1+0) | authpin=1 scrubqueue=0 0x5607aea12680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cce:[<0x20000001c3d/picture-44.jpg v606>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cce:[<0x20000001c3d/picture-44.jpg v835>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.945 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:22.913+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c5b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-16.xml auth{0=1} v644 ap=1 s=2332 n(v0 rc2024-03-27T07:25:50.999536+0000 b2332 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac0d2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c5b:[<0x20000001c3d/article-16.xml v644>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c5b:[<0x20000001c3d/article-16.xml v644>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:22.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000003382 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-94) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: pgmap v146: 97 pgs: 97 active+clean; 959 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 2.8 MiB/s wr, 456 op/s 2024-03-27T07:28:22.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000189b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-41) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001de3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001da7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ddf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001da2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001db8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ddc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001df8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001df1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001db5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001de6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001da4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001db0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001da9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001df4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001db3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ded (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000034d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-99) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001811 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-40) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ff0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-57) see mds.b log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000eac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001057 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001044 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000169b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001041 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ecb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001079 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001001 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000012a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-93.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001081 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001053 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ee6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000efb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000106d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001066 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000166e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001660 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ebb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001029 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000160e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001610 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001010 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000106a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001025 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000162d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ed0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001667 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000865 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001661 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000eb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000165e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001617 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ef0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001075 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001655 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000eb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001681 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001665 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000eb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ec4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001619 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001663 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001678 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ec8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001613 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001673 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000107d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001692 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000105e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000162f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f76 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ff3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001627 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ed5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000167b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001031 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fe1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ff0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000edd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ee1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001035 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ec0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001050 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fa1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000105b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fe6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001600 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ed8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000160a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000163d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001669 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000165f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001659 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001021 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001641 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001662 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000104c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000166b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001605 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000161d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000015fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000100c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000162a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001063 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001664 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fa6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-83.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000eeb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001072 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001632 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000165b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000101c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000072f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000161f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ffb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000102c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001048 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ff6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000165d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000165c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001039 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001014 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001622 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001635 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001625 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ffe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000103c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001638 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ef6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ff9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bcd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bde (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ba3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bd9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002b9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bcf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ba0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ba7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002b9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002b9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002baf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002b9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ba1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002baa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bdb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ba6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ba9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002b9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ba4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002b98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ba8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002b99 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002b9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ba5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bcb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bbc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001980 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ba2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-82.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002bb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000300a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-93.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002efe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ca4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ca0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001955 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ef5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ca6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000197b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001982 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000301e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001940 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000003004 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000003010 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fa6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ffe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000302d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001997 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001999 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000003016 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000195a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ca2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000003024 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001922 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000195c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001946 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000196f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001950 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001911 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001964 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000301b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000199e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ef8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ca8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000193a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001988 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001969 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ea2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.984 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002faf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000199f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fa3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fd9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000199c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000191f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fe8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001926 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001987 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.985 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000191c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fcd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fa0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000197e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.986 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ffb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001974 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001960 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000192a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002feb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ff7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001972 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001978 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001935 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fe5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c99 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.988 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000198c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001995 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001976 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000194b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001931 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001914 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000003018 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000192d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ff1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000003007 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001984 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002efb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000191a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001924 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001970 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000003001 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000003021 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000300d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fa9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001992 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001917 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000196c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002fe2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000003013 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000198a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001eba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ba7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000013a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ba1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001eda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000946 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000998 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bf5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000952 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001eb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000092a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ac3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000921 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000be0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bdb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000923 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000be7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ea8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000093f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001eb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000094b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-95.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ea2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000172f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-96.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000096c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a0d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001439 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000096a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000013a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000093e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001acb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000095f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000951 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ac9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000914 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000096e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009f9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ec3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bcf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001aff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000935 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000972 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:22.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001eb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a0c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000950 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000916 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000989 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e6c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000091e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000091c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000964 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000983 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000095a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ec9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000948 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000966 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000149d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000919 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000092e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002592 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000257c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002577 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000258e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000025b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000025ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000025a9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000934 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000025a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002509 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-96.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000025c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000092c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002528 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000025d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001acd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000025b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000095b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002549 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002582 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000251b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002530 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000250c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000250f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000253b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000025ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002554 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002513 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002544 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000025bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000251c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000255e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000255a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000259e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002564 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002516 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002568 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002505 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000258c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002598 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002517 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000256d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002523 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002572 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002550 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000251f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000252c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002587 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002536 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:22 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002540 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.186 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:23.074+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d35 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-12.jpg auth{0=1} v690 ap=1 s=10968 n(v0 rc2024-03-27T07:25:51.998517+0000 b10968 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac0d5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d35:[<0x20000001c3d/picture-12.jpg v690>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d35:[<0x20000001c3d/picture-12.jpg v690>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:23.186 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:23.097+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d2a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-15.jpg auth{0=1} v692 ap=1 s=41263 n(v0 rc2024-03-27T07:25:51.940518+0000 b41263 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac0d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d2a:[<0x20000001c3d/picture-15.jpg v692>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d2a:[<0x20000001c3d/picture-15.jpg v692>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:23.186 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:23.183+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c88 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-72.jpg auth v821 ap=1 s=21672 n(v0 rc2024-03-27T07:25:51.126534+0000 b21672 1=1+0) | authpin=1 scrubqueue=0 0x5607aea10580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c88:[<0x20000001c3d/picture-72.jpg v620>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c88:[<0x20000001c3d/picture-72.jpg v821>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:23.538 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:23.195+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000148c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-25.xml auth{0=1} v847 ap=1 s=4084 n(v0 rc2024-03-27T07:27:10.426974+0000 b4084 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab73db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000148c:[<0x20000001c3d/article-25.xml v842>,<0x10000000399/blog-47 v116261>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x1000000148c:[<0x20000001c3d/article-25.xml v847>,<0x10000000399/blog-47 v146031>,<0x10000000208/blogtest_in v2296>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:23.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[32174]: 2024-03-27T07:28:23.555+0000 7fbafc1bf700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T07:28:23.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ad5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000094a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a08 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000014a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000953 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000928 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ac5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000092f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000963 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000980 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000092d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ea5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001acf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000094f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000958 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001eae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000937 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000be9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000baf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009fd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.942 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ac0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ec0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ecc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000945 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ed1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ebd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009f1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.943 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a03 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000242b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002401 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001665 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001694 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000248e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001698 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002411 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002430 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002348 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.944 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000991 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002336 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002384 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000227a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002396 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002491 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000243a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000231e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.945 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002477 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002325 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016ac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001685 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002306 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-81.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022a9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002467 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000248f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000236f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.949 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000232e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000093a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001887 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002470 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000241f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002416 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002379 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.950 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002153 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002369 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001858 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000245f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000235d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001676 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002296 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000229f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002272 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000147a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002283 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001680 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001690 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000248c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002362 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000240c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000230e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002487 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000143e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000920 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001855 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002426 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001932 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002435 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002406 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-84.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001669 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000169c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000099c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000009a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001689 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000233f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002352 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002929 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002927 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000207d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002933 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002906 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002949 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028b0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000293b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019c1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-93.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002931 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002059 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002939 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002898 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000294b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002043 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002902 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000292b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028a4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.956 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002064 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000290a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002915 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000293f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000291d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000289c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000291b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001015 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000293d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002919 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000205d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000228d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016b0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001671 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000241a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000290f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000022ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000289e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002316 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002913 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001025 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000fe4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-85.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028ca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000102d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002943 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000238e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000101d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000168d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000291f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000167b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.960 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000023f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028ac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002894 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002921 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002896 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002935 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ff5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000292f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028a2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002044 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001005 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002073 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.962 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002911 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002050 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002904 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000206d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000fd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002900 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002068 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002917 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002925 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002079 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000292d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001036 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002908 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000fed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000020cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002947 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000290c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ffd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000020e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002937 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002060 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002083 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000fda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001971 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000020d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002055 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.965 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000015eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001777 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000175c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000015b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001948 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000017cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001716 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001770 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000163e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000194f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001668 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001d7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.966 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000018b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000018d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000193a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000018b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001697 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001eb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001957 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x300000004fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000015ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001764 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000015e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000191d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000017dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000018c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ccd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001649 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000015d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001738 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002007 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001664 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001952 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001602 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001921 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001785 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x30000000ec6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001726 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000168b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001734 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x30000000f0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000017ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000160b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001608 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000178f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x30000000f17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000192e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000167f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000015ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001655 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000017b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000171e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x30000000af1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000017bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000172a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001605 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001659 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001796 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001633 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000193d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002010 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001929 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001629 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001622 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001760 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000018bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001684 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001926 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001748 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000172e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001670 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000018c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000179d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ec8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000018d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000161a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000018af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x3000000058d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000015c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001625 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001630 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000162c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000176c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000170a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016ca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001750 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001706 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x30000000593 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000016ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000017b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000018c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000167a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001660 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001758 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000015cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000171a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x30000000ef8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000117a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001152 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001139 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001125 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000089c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000872 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000089f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000011aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001161 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000de8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000117e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000085c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000010d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000010eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001094 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.976 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000856 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000010c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ce4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ca4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.977 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cfd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cf3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.978 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ca1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.979 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cf6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ce9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.980 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cf1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ce2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ce7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000922 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c59 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ccc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ca6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001485 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c3f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:23.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:23 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ad5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000094a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a08 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000014a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000953 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000928 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ac5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000092f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000963 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000980 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000092d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ea5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001acf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000094f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000958 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001eae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000937 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000be9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000baf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009fd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ac0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ec0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ecc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000945 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ed1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ebd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009f1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a03 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000242b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002401 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001665 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001694 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000248e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001698 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002411 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002430 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002348 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000991 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002336 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002384 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000227a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002396 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002491 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000243a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000231e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002477 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002325 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016ac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001685 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002306 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-81.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022a9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002467 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000248f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000236f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000232e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000093a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001887 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002470 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000241f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002416 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002379 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002153 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002369 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001858 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000245f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000235d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001676 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002296 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000229f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002272 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000147a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002283 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001680 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001690 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000248c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002362 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000240c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000230e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002487 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000143e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000920 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001855 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002426 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001932 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002435 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002406 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-84.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001669 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000169c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000099c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000009a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001689 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000233f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002352 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002929 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002927 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000207d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002933 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002906 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002949 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028b0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000293b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019c1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-93.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002931 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002059 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002939 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002898 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.022 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000294b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002043 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002902 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000292b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028a4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002064 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000290a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002915 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000293f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000291d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.023 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000289c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000291b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001015 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000293d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002919 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000205d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000228d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.024 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016b0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001671 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000241a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000290f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000022ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000289e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002316 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002913 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001025 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.025 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000fe4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-85.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028ca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000102d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002943 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000238e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000101d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000168d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000291f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000167b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000023f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028ac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002894 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002921 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002896 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002935 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ff5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000292f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028a2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002044 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001005 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002073 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002911 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002050 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002904 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000206d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000fd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002900 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002068 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002917 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002925 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002079 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000292d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001036 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002908 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000fed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000020cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002947 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000290c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ffd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000020e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002937 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002060 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002083 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000fda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001971 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000020d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002055 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000015eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001777 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000175c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000015b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001948 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000017cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001716 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001770 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000163e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000194f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001668 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001d7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000018b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000018d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000193a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000018b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001697 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001eb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001957 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x300000004fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000015ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001764 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000015e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000191d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000017dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000018c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ccd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001649 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000015d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001738 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002007 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001664 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001952 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001602 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001921 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001785 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x30000000ec6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001726 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000168b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001734 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x30000000f0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000017ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000160b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001608 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000178f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x30000000f17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000192e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000167f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000015ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001655 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000017b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000171e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x30000000af1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000017bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000172a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001605 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001659 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001796 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001633 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000193d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002010 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001929 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001629 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001622 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001760 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000018bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001684 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001926 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001748 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000172e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001670 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000018c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000179d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ec8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000018d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000161a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000018af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x3000000058d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000015c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001625 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001630 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000162c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000176c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000170a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016ca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001750 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001706 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x30000000593 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000016ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000017b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000018c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000167a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001660 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001758 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000015cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000171a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x30000000ef8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000117a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001152 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001139 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001125 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000089c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000872 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000089f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000011aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001161 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000de8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000117e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000085c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000010d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000010eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001094 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000856 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000010c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ce4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ca4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cfd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cf3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ca1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cf6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ce9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cf1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ce2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ce7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000922 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c59 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ccc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ca6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001485 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c3f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:23 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ad5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000094a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a08 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000014a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000953 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000928 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.055 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ac5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001f18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000092f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000963 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000980 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000092d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.056 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ea5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001acf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000094f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000958 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001eae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000937 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000be9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.057 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000baf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009fd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ac0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ec0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ecc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000945 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ed1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ebd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.058 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009f1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a03 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000242b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002401 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001665 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001694 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000248e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001698 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002411 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.059 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002430 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002348 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000991 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002336 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002384 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000227a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002396 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002491 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.060 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000243a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000231e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002477 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002325 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016ac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001685 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002306 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-81.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022a9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002467 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.061 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000248f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000236f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000232e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000093a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001887 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002470 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.062 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000241f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002416 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002379 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002153 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002369 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001858 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000245f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.063 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000235d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001676 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002296 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000229f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002272 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000147a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002283 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001680 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.064 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001690 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000248c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002362 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000240c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000230e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002487 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000143e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000920 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001855 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002426 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.065 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001932 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002435 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d8a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.066 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002406 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-84.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001669 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000169c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000099c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000009a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001689 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000233f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002352 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002929 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.067 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002927 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000207d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002933 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002906 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002949 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028b0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000293b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019c1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-93.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002931 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002059 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002939 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002898 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.068 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000294b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002043 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002902 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000292b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028a4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002064 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000290a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002915 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000293f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000291d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000289c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.069 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000291b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000100e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001015 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000293d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002919 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000205d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000228d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016b0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.070 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001671 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000241a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000290f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000022ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000289e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002316 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002913 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001025 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.071 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000fe4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-85.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028ca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000102d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002943 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000238e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000101d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000168d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.072 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000291f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000167b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000023f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028ac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002894 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002921 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.073 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002896 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002935 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ff5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000292f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028a2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002044 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001005 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002073 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002911 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002050 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002904 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000206d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000fd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002900 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002068 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002917 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002925 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002079 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000292d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001036 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002908 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000fed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000020cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002947 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000290c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ffd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000020e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002937 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002060 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002083 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000fda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001971 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000020d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002055 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000015eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001777 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000175c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000015b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001948 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000017cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001716 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001770 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000163e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000194f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001668 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001d7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000018b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000018d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000193a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000018b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001697 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001eb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001957 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x300000004fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000015ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001764 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000015e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000191d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000017dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000018c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ccd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001649 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000015d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001738 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002007 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001664 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001952 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001602 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001921 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001785 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x30000000ec6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001726 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000168b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001734 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x30000000f0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000017ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000160b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001608 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000178f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x30000000f17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000192e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000167f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000015ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001655 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000017b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000171e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x30000000af1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000017bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000172a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001605 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001659 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001796 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001633 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000193d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002010 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001929 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001629 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001622 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001760 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000018bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001684 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001926 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001748 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000172e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001670 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000018c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000179d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ec8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000018d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000161a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000018af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x3000000058d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000015c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001625 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001630 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000162c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000176c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000170a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016ca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001750 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001706 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x30000000593 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000016ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000017b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000018c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000167a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001660 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001758 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000015cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000171a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x30000000ef8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000117a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001152 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001139 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001125 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000089c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000872 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000089f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000011aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001161 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000de8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000117e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000085c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000010d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000010eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001094 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000856 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000010c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ce4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ca4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cfd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cf3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cbf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ca1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cc9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cf6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ce9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c72 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cf1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ce2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ce7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000922 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c59 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ccc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ca6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001485 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c3f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:23 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.521 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.266+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ce3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-59.xml auth{0=1} v1312 ap=1 s=32189 n(v0 rc2024-03-27T07:25:34.411863+0000 b32189 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d01b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ce3:[<0x20000000cdf/article-59.xml v4>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ce3:[<0x20000000cdf/article-59.xml v1312>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.521 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.268+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001000 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg auth{0=1} v1302 ap=1 s=59457 n(v0 rc2024-03-27T07:25:37.430803+0000 b59457 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d01b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001000:[<0x20000000cdf/picture-13.jpg v796>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001000:[<0x20000000cdf/picture-13.jpg v1302>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.521 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.269+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-56.xml auth{0=1} v1332 ap=1 s=10125 n(v0 rc2024-03-27T07:25:47.860598+0000 b10125 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce40000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e7:[<0x20000000cdf/comment-56.xml v1181>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007e7:[<0x20000000cdf/comment-56.xml v1332>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.521 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.270+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ff1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg auth{0=1} v1310 ap=1 s=35401 n(v0 rc2024-03-27T07:25:37.365805+0000 b35401 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce40580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ff1:[<0x20000000cdf/picture-18.jpg v766>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ff1:[<0x20000000cdf/picture-18.jpg v1310>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.521 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.271+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000daf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml auth{0=1} v1326 ap=1 s=25300 n(v0 rc2024-03-27T07:25:35.347844+0000 b25300 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce40b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000daf:[<0x20000000cdf/article-18.xml v250>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000daf:[<0x20000000cdf/article-18.xml v1326>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.521 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.272+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-5.xml auth{0=1} v1347 ap=1 s=4910 n(v0 rc2024-03-27T07:25:49.489566+0000 b4910 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce41080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083d:[<0x20000000cdf/comment-5.xml v1285>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000083d:[<0x20000000cdf/comment-5.xml v1347>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.522 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.273+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fee [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg auth{0=1} v1320 ap=1 s=47862 n(v0 rc2024-03-27T07:25:37.352805+0000 b47862 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce41600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fee:[<0x20000000cdf/picture-19.jpg v760>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fee:[<0x20000000cdf/picture-19.jpg v1320>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.522 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.274+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d12 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-51.xml auth{0=1} v1324 ap=1 s=7985 n(v0 rc2024-03-27T07:25:34.705857+0000 b7985 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d12:[<0x20000000cdf/article-51.xml v52>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d12:[<0x20000000cdf/article-51.xml v1324>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.522 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.275+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000823 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-29.xml auth{0=1} v1334 ap=1 s=2829 n(v0 rc2024-03-27T07:25:48.570584+0000 b2829 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce42100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000823:[<0x20000000cdf/comment-29.xml v1240>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000823:[<0x20000000cdf/comment-29.xml v1334>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.522 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.276+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e0e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-82.jpg auth v1300 ap=1 s=37261 n(v0 rc2024-03-27T07:25:35.569840+0000 b37261 1=1+0) | authpin=1 scrubqueue=0 0x55661a7c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e0e:[<0x20000000cdf/picture-82.jpg v378>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e0e:[<0x20000000cdf/picture-82.jpg v1300>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.522 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.277+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d92 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml auth{0=1} v1308 ap=1 s=32671 n(v0 rc2024-03-27T07:25:35.122849+0000 b32671 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce42680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d92:[<0x20000000cdf/article-27.xml v196>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d92:[<0x20000000cdf/article-27.xml v1308>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.522 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.278+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001023 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg auth{0=1} v1318 ap=1 s=55562 n(v0 rc2024-03-27T07:25:37.587800+0000 b55562 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce42c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001023:[<0x20000000cdf/picture-4.jpg v850>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001023:[<0x20000000cdf/picture-4.jpg v1318>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.522 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.279+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fa4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg auth{0=1} v1340 ap=1 s=22047 n(v0 rc2024-03-27T07:25:37.001812+0000 b22047 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce43180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fa4:[<0x20000000cdf/picture-35.jpg v664>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fa4:[<0x20000000cdf/picture-35.jpg v1340>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.522 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.280+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000102b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg auth{0=1} v1345 ap=1 s=33585 n(v0 rc2024-03-27T07:25:37.615800+0000 b33585 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce43700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000102b:[<0x20000000cdf/picture-2.jpg v862>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000102b:[<0x20000000cdf/picture-2.jpg v1345>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.522 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.281+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e48 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-78.jpg auth v1314 ap=1 s=42610 n(v0 rc2024-03-27T07:25:35.678838+0000 b42610 1=1+0) | authpin=1 scrubqueue=0 0x55661c6ed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e48:[<0x20000000cdf/picture-78.jpg v406>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e48:[<0x20000000cdf/picture-78.jpg v1314>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.523 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.282+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000daa [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml auth{0=1} v1298 ap=1 s=3264 n(v0 rc2024-03-27T07:25:35.308845+0000 b3264 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000daa:[<0x20000000cdf/article-20.xml v238>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000daa:[<0x20000000cdf/article-20.xml v1298>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.525 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.283+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ffd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg auth{0=1} v1316 ap=1 s=54290 n(v0 rc2024-03-27T07:25:37.414804+0000 b54290 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ffd:[<0x20000000cdf/picture-14.jpg v790>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ffd:[<0x20000000cdf/picture-14.jpg v1316>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.526 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.283+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d4c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-41.xml auth{0=1} v1306 ap=1 s=26115 n(v0 rc2024-03-27T07:25:34.910853+0000 b26115 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d4c:[<0x20000000cdf/article-41.xml v112>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d4c:[<0x20000000cdf/article-41.xml v1306>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.526 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.284+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d36 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-45.xml auth{0=1} v1330 ap=1 s=1597 n(v0 rc2024-03-27T07:25:34.835855+0000 b1597 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d36:[<0x20000000cdf/article-45.xml v88>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d36:[<0x20000000cdf/article-45.xml v1330>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.526 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.285+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f1d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-61.jpg auth{0=1} v1328 ap=1 s=34190 n(v0 rc2024-03-27T07:25:36.435823+0000 b34190 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f1d:[<0x20000000cdf/picture-61.jpg v508>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f1d:[<0x20000000cdf/picture-61.jpg v1328>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.526 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.286+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001017 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg auth{0=1} v1322 ap=1 s=32547 n(v0 rc2024-03-27T07:25:37.536801+0000 b32547 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001017:[<0x20000000cdf/picture-7.jpg v832>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001017:[<0x20000000cdf/picture-7.jpg v1322>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.526 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.287+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d7e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-31.xml auth{0=1} v1304 ap=1 s=3236 n(v0 rc2024-03-27T07:25:35.060850+0000 b3236 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d7e:[<0x20000000cdf/article-31.xml v172>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d7e:[<0x20000000cdf/article-31.xml v1304>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.526 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.288+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000100f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg auth{0=1} v1338 ap=1 s=61546 n(v0 rc2024-03-27T07:25:37.495802+0000 b61546 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000100f:[<0x20000000cdf/picture-9.jpg v820>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000100f:[<0x20000000cdf/picture-9.jpg v1338>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.526 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.289+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000837 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-11.xml auth{0=1} v1336 ap=1 s=9706 n(v0 rc2024-03-27T07:25:49.418567+0000 b9706 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000837:[<0x20000000cdf/comment-11.xml v1265>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000837:[<0x20000000cdf/comment-11.xml v1336>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.526 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.290+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-20.xml auth{0=1} v1343 ap=1 s=5209 n(v0 rc2024-03-27T07:25:49.208572+0000 b5209 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082e:[<0x20000000cdf/comment-20.xml v1260>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000082e:[<0x20000000cdf/comment-20.xml v1343>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.526 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.291+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ef5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-64.jpg auth v1330 ap=1 s=59062 n(v0 rc2024-03-27T07:25:36.280826+0000 b59062 1=1+0) | authpin=1 scrubqueue=0 0x556619949180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ef5:[<0x20000000cdf/picture-64.jpg v490>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ef5:[<0x20000000cdf/picture-64.jpg v1330>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.292+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000812 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-37.xml auth{0=1} v1346 ap=1 s=8442 n(v0 rc2024-03-27T07:25:48.349589+0000 b8442 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfe8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000812:[<0x20000000cdf/comment-37.xml v1210>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000812:[<0x20000000cdf/comment-37.xml v1346>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.293+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-71.xml auth{0=1} v1332 ap=1 s=4929 n(v0 rc2024-03-27T07:25:47.384608+0000 b4929 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfe8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c0:[<0x20000000cdf/comment-71.xml v1159>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007c0:[<0x20000000cdf/comment-71.xml v1332>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.294+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000100b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg auth{0=1} v1334 ap=1 s=23016 n(v0 rc2024-03-27T07:25:37.483802+0000 b23016 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfe8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000100b:[<0x20000000cdf/picture-10.jpg v814>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000100b:[<0x20000000cdf/picture-10.jpg v1334>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.296+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000102f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg auth{0=1} v1328 ap=1 s=14369 n(v0 rc2024-03-27T07:25:37.633799+0000 b14369 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfe9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000102f:[<0x20000000cdf/picture-1.jpg v868>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000102f:[<0x20000000cdf/picture-1.jpg v1328>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.297+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000832 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-16.xml auth{0=1} v1322 ap=1 s=9816 n(v0 rc2024-03-27T07:25:49.300570+0000 b9816 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfe9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000832:[<0x20000000cdf/comment-16.xml v1322>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000832:[<0x20000000cdf/comment-16.xml v1322>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.298+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dd5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml auth{0=1} v1298 ap=1 s=5610 n(v0 rc2024-03-27T07:25:35.427843+0000 b5610 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfe9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dd5:[<0x20000000cdf/article-9.xml v304>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000dd5:[<0x20000000cdf/article-9.xml v1298>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.299+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e00 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-83.jpg auth v1314 ap=1 s=12000 n(v0 rc2024-03-27T07:25:35.529841+0000 b12000 1=1+0) | authpin=1 scrubqueue=0 0x55661b81c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e00:[<0x20000000cdf/picture-83.jpg v370>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e00:[<0x20000000cdf/picture-83.jpg v1314>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.300+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-44.xml auth{0=1} v1381 ap=1 s=23385 n(v0 rc2024-03-27T07:27:20.800770+0000 b23385 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfea680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e5:[<0x20000000cdf/article-44.xml v1381>,<0x10000000399/blog-22 v117980>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018e5:[<0x20000000cdf/article-44.xml v1381>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.301+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000101b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg auth{0=1} v1302 ap=1 s=22626 n(v0 rc2024-03-27T07:25:37.557801+0000 b22626 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfeac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000101b:[<0x20000000cdf/picture-6.jpg v838>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000101b:[<0x20000000cdf/picture-6.jpg v1302>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.302+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007dd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-58.xml auth{0=1} v1357 ap=1 s=5689 n(v0 rc2024-03-27T07:25:47.765600+0000 b5689 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfeb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007dd:[<0x20000000cdf/comment-58.xml v1177>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007dd:[<0x20000000cdf/comment-58.xml v1357>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.303+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-55.xml auth{0=1} v1324 ap=1 s=3788 n(v0 rc2024-03-27T07:25:47.871598+0000 b3788 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfeb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e9:[<0x20000000cdf/comment-55.xml v1184>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007e9:[<0x20000000cdf/comment-55.xml v1324>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.527 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.304+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000da1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml auth{0=1} v1336 ap=1 s=12303 n(v0 rc2024-03-27T07:25:35.248846+0000 b12303 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d644000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000da1:[<0x20000000cdf/article-24.xml v214>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000da1:[<0x20000000cdf/article-24.xml v1336>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.305+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-34.xml auth{0=1} v1353 ap=1 s=7506 n(v0 rc2024-03-27T07:25:48.453586+0000 b7506 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d644580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081a:[<0x20000000cdf/comment-34.xml v1219>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000081a:[<0x20000000cdf/comment-34.xml v1353>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.306+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000829 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-25.xml auth{0=1} v1344 ap=1 s=4456 n(v0 rc2024-03-27T07:25:49.136573+0000 b4456 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d644b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000829:[<0x20000000cdf/comment-25.xml v1241>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000829:[<0x20000000cdf/comment-25.xml v1344>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.307+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fc6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg auth{0=1} v1342 ap=1 s=34352 n(v0 rc2024-03-27T07:25:37.135809+0000 b34352 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d645080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fc6:[<0x20000000cdf/picture-28.jpg v706>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fc6:[<0x20000000cdf/picture-28.jpg v1342>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.308+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-41.xml auth{0=1} v1355 ap=1 s=4522 n(v0 rc2024-03-27T07:25:48.243591+0000 b4522 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d645600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080a:[<0x20000000cdf/comment-41.xml v1201>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000080a:[<0x20000000cdf/comment-41.xml v1355>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.309+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-75.xml auth{0=1} v1340 ap=1 s=5468 n(v0 rc2024-03-27T07:25:46.913617+0000 b5468 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d645b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b7:[<0x20000000cdf/comment-75.xml v1155>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007b7:[<0x20000000cdf/comment-75.xml v1340>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.310+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f9a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg auth{0=1} v1312 ap=1 s=57658 n(v0 rc2024-03-27T07:25:36.966813+0000 b57658 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d646100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f9a:[<0x20000000cdf/picture-37.jpg v652>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f9a:[<0x20000000cdf/picture-37.jpg v1312>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.311+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ff4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg auth{0=1} v1308 ap=1 s=28311 n(v0 rc2024-03-27T07:25:37.376805+0000 b28311 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d646680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ff4:[<0x20000000cdf/picture-17.jpg v772>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ff4:[<0x20000000cdf/picture-17.jpg v1308>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.312+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000df6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-85.jpg auth v1310 ap=1 s=21370 n(v0 rc2024-03-27T07:25:35.497842+0000 b21370 1=1+0) | authpin=1 scrubqueue=0 0x55661c683080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000df6:[<0x20000000cdf/picture-85.jpg v358>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000df6:[<0x20000000cdf/picture-85.jpg v1310>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.313+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000de9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml auth{0=1} v1300 ap=1 s=27908 n(v0 rc2024-03-27T07:25:35.472842+0000 b27908 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d646c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000de9:[<0x20000000cdf/article-3.xml v340>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000de9:[<0x20000000cdf/article-3.xml v1300>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.314+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fd8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg auth{0=1} v1306 ap=1 s=53001 n(v0 rc2024-03-27T07:25:37.224808+0000 b53001 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d647180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fd8:[<0x20000000cdf/picture-24.jpg v730>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fd8:[<0x20000000cdf/picture-24.jpg v1306>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.315+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fae [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg auth{0=1} v1320 ap=1 s=34486 n(v0 rc2024-03-27T07:25:37.036811+0000 b34486 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d647700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fae:[<0x20000000cdf/picture-33.jpg v676>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fae:[<0x20000000cdf/picture-33.jpg v1320>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.316+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f35 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-57.jpg auth{0=1} v1318 ap=1 s=30139 n(v0 rc2024-03-27T07:25:36.544821+0000 b30139 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d648000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f35:[<0x20000000cdf/picture-57.jpg v532>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f35:[<0x20000000cdf/picture-57.jpg v1318>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.528 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.317+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ddb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml auth{0=1} v1316 ap=1 s=21259 n(v0 rc2024-03-27T07:25:35.443843+0000 b21259 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d648580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ddb:[<0x20000000cdf/article-7.xml v316>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ddb:[<0x20000000cdf/article-7.xml v1316>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.318+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f83 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg auth{0=1} v1304 ap=1 s=17788 n(v0 rc2024-03-27T07:25:36.861815+0000 b17788 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d648b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f83:[<0x20000000cdf/picture-42.jpg v622>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f83:[<0x20000000cdf/picture-42.jpg v1304>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.319+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ec7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-68.jpg auth v1351 ap=1 s=31786 n(v0 rc2024-03-27T07:25:36.051831+0000 b31786 1=1+0) | authpin=1 scrubqueue=0 0x55661b27cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ec7:[<0x20000000cdf/picture-68.jpg v466>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ec7:[<0x20000000cdf/picture-68.jpg v1351>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.320+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f91 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg auth{0=1} v1326 ap=1 s=14272 n(v0 rc2024-03-27T07:25:36.930813+0000 b14272 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d649080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f91:[<0x20000000cdf/picture-39.jpg v640>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f91:[<0x20000000cdf/picture-39.jpg v1326>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.321+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-23.xml auth{0=1} v1338 ap=1 s=7475 n(v0 rc2024-03-27T07:25:49.174572+0000 b7475 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d649600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082b:[<0x20000000cdf/comment-23.xml v1252>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000082b:[<0x20000000cdf/comment-23.xml v1338>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.322+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-24.xml auth{0=1} v1247 ap=1 s=2845 n(v0 rc2024-03-27T07:25:49.153573+0000 b2845 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d649b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082a:[<0x20000000cdf/comment-24.xml v1247>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000082a:[<0x20000000cdf/comment-24.xml v1247>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.322+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cf9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-55.xml auth{0=1} v1290 ap=1 s=2532 n(v0 rc2024-03-27T07:25:34.596859+0000 b2532 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661def6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cf9:[<0x20000000cdf/article-55.xml v28>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000cf9:[<0x20000000cdf/article-55.xml v1290>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.324+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fd3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg auth{0=1} v1345 ap=1 s=40660 n(v0 rc2024-03-27T07:25:37.189808+0000 b40660 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661def6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fd3:[<0x20000000cdf/picture-25.jpg v724>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fd3:[<0x20000000cdf/picture-25.jpg v1345>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.325+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml auth{0=1} v1033 ap=1 s=8961 n(v0 rc2024-03-27T07:25:41.001733+0000 b8961 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661def7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f6:[<0x20000000cdf/article-8.xml v1033>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000006f6:[<0x20000000cdf/article-8.xml v1033>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.326+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fe [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-47.xml auth{0=1} v1340 ap=1 s=2803 n(v0 rc2024-03-27T07:25:48.092594+0000 b2803 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661def7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fe:[<0x20000000cdf/comment-47.xml v1190>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007fe:[<0x20000000cdf/comment-47.xml v1340>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.327+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000800 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-46.xml auth{0=1} v1330 ap=1 s=5289 n(v0 rc2024-03-27T07:25:48.130593+0000 b5289 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661def7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000800:[<0x20000000cdf/comment-46.xml v1195>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000800:[<0x20000000cdf/comment-46.xml v1330>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.328+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fb8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg auth{0=1} v1310 ap=1 s=38246 n(v0 rc2024-03-27T07:25:37.071811+0000 b38246 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661def8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fb8:[<0x20000000cdf/picture-31.jpg v688>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fb8:[<0x20000000cdf/picture-31.jpg v1310>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.529 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.329+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-70.xml auth{0=1} v1316 ap=1 s=6098 n(v0 rc2024-03-27T07:25:47.399607+0000 b6098 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661def8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c4:[<0x20000000cdf/comment-70.xml v1160>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007c4:[<0x20000000cdf/comment-70.xml v1316>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.530 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.330+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f62 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-49.jpg auth{0=1} v1304 ap=1 s=51319 n(v0 rc2024-03-27T07:25:36.736817+0000 b51319 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661def8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f62:[<0x20000000cdf/picture-49.jpg v580>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f62:[<0x20000000cdf/picture-49.jpg v1304>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.530 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.331+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000705 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-76.xml auth v1320 ap=1 s=14441 n(v0 rc2024-03-27T07:25:42.439705+0000 b14441 1=1+0) | authpin=1 scrubqueue=0 0x55661c682b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000705:[<0x20000000cdf/article-76.xml v1040>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000705:[<0x20000000cdf/article-76.xml v1320>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.530 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.332+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011e9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg auth{0=1} v1366 ap=1 s=40821 n(v0 rc2024-03-27T07:27:06.096059+0000 b40821 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661def9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011e9:[<0x20000000cdf/picture-8.jpg v1357>,<0x10000000399/blog-22 v115172>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000011e9:[<0x20000000cdf/picture-8.jpg v1366>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.530 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.333+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fcf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg auth{0=1} v1334 ap=1 s=42098 n(v0 rc2024-03-27T07:25:37.165809+0000 b42098 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fcf:[<0x20000000cdf/picture-26.jpg v718>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fcf:[<0x20000000cdf/picture-26.jpg v1334>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.537 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.334+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d78 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-32.xml auth{0=1} v1294 ap=1 s=6633 n(v0 rc2024-03-27T07:25:35.046850+0000 b6633 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d78:[<0x20000000cdf/article-32.xml v166>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d78:[<0x20000000cdf/article-32.xml v1294>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.537 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.336+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-69.xml auth{0=1} v1347 ap=1 s=4862 n(v0 rc2024-03-27T07:25:47.417607+0000 b4862 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c6:[<0x20000000cdf/comment-69.xml v1162>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007c6:[<0x20000000cdf/comment-69.xml v1347>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.537 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.337+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000da8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml auth{0=1} v1302 ap=1 s=18213 n(v0 rc2024-03-27T07:25:35.288846+0000 b18213 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000da8:[<0x20000000cdf/article-21.xml v232>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000da8:[<0x20000000cdf/article-21.xml v1302>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.537 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.338+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d82 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-30.xml auth{0=1} v1296 ap=1 s=26152 n(v0 rc2024-03-27T07:25:35.080850+0000 b26152 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d82:[<0x20000000cdf/article-30.xml v178>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d82:[<0x20000000cdf/article-30.xml v1296>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.537 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.339+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-74.xml auth{0=1} v1324 ap=1 s=8194 n(v0 rc2024-03-27T07:25:46.993615+0000 b8194 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b9:[<0x20000000cdf/comment-74.xml v1155>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007b9:[<0x20000000cdf/comment-74.xml v1324>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.537 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.340+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000814 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-36.xml auth{0=1} v1332 ap=1 s=3853 n(v0 rc2024-03-27T07:25:48.381588+0000 b3853 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000814:[<0x20000000cdf/comment-36.xml v1214>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000814:[<0x20000000cdf/comment-36.xml v1332>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.537 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.341+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dc3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml auth{0=1} v1328 ap=1 s=31985 n(v0 rc2024-03-27T07:25:35.391844+0000 b31985 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dc3:[<0x20000000cdf/article-13.xml v280>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000dc3:[<0x20000000cdf/article-13.xml v1328>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.537 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.342+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ce [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-64.xml auth{0=1} v1318 ap=1 s=3633 n(v0 rc2024-03-27T07:25:47.631603+0000 b3633 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ce:[<0x20000000cdf/comment-64.xml v1166>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007ce:[<0x20000000cdf/comment-64.xml v1318>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.537 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.343+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-72.xml auth{0=1} v1336 ap=1 s=2635 n(v0 rc2024-03-27T07:25:47.364608+0000 b2635 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bd:[<0x20000000cdf/comment-72.xml v1158>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007bd:[<0x20000000cdf/comment-72.xml v1336>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.538 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.344+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-4.xml auth{0=1} v1306 ap=1 s=4092 n(v0 rc2024-03-27T07:25:49.501566+0000 b4092 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cb1d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083e:[<0x20000000cdf/comment-4.xml v1306>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000083e:[<0x20000000cdf/comment-4.xml v1306>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.538 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.347+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ddf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml auth{0=1} v1292 ap=1 s=16022 n(v0 rc2024-03-27T07:25:35.450842+0000 b16022 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf66b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ddf:[<0x20000000cdf/article-6.xml v322>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ddf:[<0x20000000cdf/article-6.xml v1292>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.538 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.348+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dee [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml auth{0=1} v1300 ap=1 s=10142 n(v0 rc2024-03-27T07:25:35.479842+0000 b10142 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf67080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dee:[<0x20000000cdf/article-2.xml v346>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000dee:[<0x20000000cdf/article-2.xml v1300>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.538 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.349+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000834 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-14.xml auth{0=1} v1322 ap=1 s=4057 n(v0 rc2024-03-27T07:25:49.340569+0000 b4057 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf67600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000834:[<0x20000000cdf/comment-14.xml v1269>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000834:[<0x20000000cdf/comment-14.xml v1322>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.538 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.350+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-67.xml auth{0=1} v1343 ap=1 s=8291 n(v0 rc2024-03-27T07:25:47.525605+0000 b8291 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf67b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cb:[<0x20000000cdf/comment-67.xml v1164>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007cb:[<0x20000000cdf/comment-67.xml v1343>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.538 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.351+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f47 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-54.jpg auth{0=1} v1308 ap=1 s=20642 n(v0 rc2024-03-27T07:25:36.617819+0000 b20642 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf68100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f47:[<0x20000000cdf/picture-54.jpg v550>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f47:[<0x20000000cdf/picture-54.jpg v1308>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.538 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.352+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fc0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg auth{0=1} v1312 ap=1 s=9905 n(v0 rc2024-03-27T07:25:37.108810+0000 b9905 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf68680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fc0:[<0x20000000cdf/picture-29.jpg v700>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fc0:[<0x20000000cdf/picture-29.jpg v1312>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.538 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.353+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-19.xml auth{0=1} v1326 ap=1 s=8058 n(v0 rc2024-03-27T07:25:49.220571+0000 b8058 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf68c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082f:[<0x20000000cdf/comment-19.xml v1264>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000082f:[<0x20000000cdf/comment-19.xml v1326>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.538 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.354+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cf4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-56.xml auth{0=1} v1298 ap=1 s=21450 n(v0 rc2024-03-27T07:25:34.560860+0000 b21450 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf69180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cf4:[<0x20000000cdf/article-56.xml v22>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000cf4:[<0x20000000cdf/article-56.xml v1298>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.538 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.355+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-22.xml auth{0=1} v1331 ap=1 s=5068 n(v0 rc2024-03-27T07:25:49.188572+0000 b5068 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d01e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082c:[<0x20000000cdf/comment-22.xml v1251>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000082c:[<0x20000000cdf/comment-22.xml v1331>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.356+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000840 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-2.xml auth{0=1} v1350 ap=1 s=9821 n(v0 rc2024-03-27T07:25:49.532565+0000 b9821 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d01eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000840:[<0x20000000cdf/comment-2.xml v1290>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000840:[<0x20000000cdf/comment-2.xml v1350>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.357+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000805 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-44.xml auth{0=1} v1317 ap=1 s=4101 n(v0 rc2024-03-27T07:25:48.189592+0000 b4101 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d01f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000805:[<0x20000000cdf/comment-44.xml v1317>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000805:[<0x20000000cdf/comment-44.xml v1317>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.358+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006f5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-96.jpg auth v1352 ap=1 s=58794 n(v0 rc2024-03-27T07:25:40.931735+0000 b58794 1=1+0) | authpin=1 scrubqueue=0 0x5566187c9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006f5:[<0x20000000cdf/picture-96.jpg v1023>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000006f5:[<0x20000000cdf/picture-96.jpg v1352>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.359+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d42 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-43.xml auth{0=1} v1299 ap=1 s=5603 n(v0 rc2024-03-27T07:25:34.867854+0000 b5603 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d01f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d42:[<0x20000000cdf/article-43.xml v100>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d42:[<0x20000000cdf/article-43.xml v1299>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.361+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d74 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-33.xml auth{0=1} v1295 ap=1 s=19329 n(v0 rc2024-03-27T07:25:35.031851+0000 b19329 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d01fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d74:[<0x20000000cdf/article-33.xml v160>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d74:[<0x20000000cdf/article-33.xml v1295>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.362+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e22 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-81.jpg auth v1339 ap=1 s=34641 n(v0 rc2024-03-27T07:25:35.599839+0000 b34641 1=1+0) | authpin=1 scrubqueue=0 0x55661c682580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e22:[<0x20000000cdf/picture-81.jpg v388>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e22:[<0x20000000cdf/picture-81.jpg v1339>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.363+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000101f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg auth{0=1} v1327 ap=1 s=35652 n(v0 rc2024-03-27T07:25:37.573801+0000 b35652 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d020100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000101f:[<0x20000000cdf/picture-5.jpg v844>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x2000000101f:[<0x20000000cdf/picture-5.jpg v1327>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.364+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000827 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-27.xml auth{0=1} v1337 ap=1 s=8655 n(v0 rc2024-03-27T07:25:48.624583+0000 b8655 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d020680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000827:[<0x20000000cdf/comment-27.xml v1232>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000827:[<0x20000000cdf/comment-27.xml v1337>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.365+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f5d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-50.jpg auth{0=1} v1348 ap=1 s=9754 n(v0 rc2024-03-27T07:25:36.720817+0000 b9754 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d020c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f5d:[<0x20000000cdf/picture-50.jpg v574>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f5d:[<0x20000000cdf/picture-50.jpg v1348>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.366+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-76.xml auth{0=1} v1335 ap=1 s=7854 n(v0 rc2024-03-27T07:25:46.896617+0000 b7854 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d021180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b5:[<0x20000000cdf/comment-76.xml v1152>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007b5:[<0x20000000cdf/comment-76.xml v1335>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.367+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f2f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-58.jpg auth{0=1} v1307 ap=1 s=31531 n(v0 rc2024-03-27T07:25:36.517821+0000 b31531 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d021700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f2f:[<0x20000000cdf/picture-58.jpg v526>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f2f:[<0x20000000cdf/picture-58.jpg v1307>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.539 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.368+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ced [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-57.xml auth{0=1} v1297 ap=1 s=10624 n(v0 rc2024-03-27T07:25:34.532860+0000 b10624 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ced:[<0x20000000cdf/article-57.xml v16>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ced:[<0x20000000cdf/article-57.xml v1297>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.369+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-52.xml auth{0=1} v1309 ap=1 s=10053 n(v0 rc2024-03-27T07:25:47.921597+0000 b10053 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f0:[<0x20000000cdf/comment-52.xml v1309>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007f0:[<0x20000000cdf/comment-52.xml v1309>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.371+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-66.xml auth{0=1} v1343 ap=1 s=5963 n(v0 rc2024-03-27T07:25:47.558604+0000 b5963 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cc:[<0x20000000cdf/comment-66.xml v1156>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007cc:[<0x20000000cdf/comment-66.xml v1343>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.372+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ee7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-65.jpg auth v1311 ap=1 s=59158 n(v0 rc2024-03-27T07:25:36.237827+0000 b59158 1=1+0) | authpin=1 scrubqueue=0 0x55661b1ca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ee7:[<0x20000000cdf/picture-65.jpg v484>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ee7:[<0x20000000cdf/picture-65.jpg v1311>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.373+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-7.xml auth{0=1} v1356 ap=1 s=3223 n(v0 rc2024-03-27T07:25:49.477566+0000 b3223 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083b:[<0x20000000cdf/comment-7.xml v1281>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000083b:[<0x20000000cdf/comment-7.xml v1356>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.374+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000833 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-15.xml auth{0=1} v1354 ap=1 s=8516 n(v0 rc2024-03-27T07:25:49.327569+0000 b8516 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000833:[<0x20000000cdf/comment-15.xml v1265>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000833:[<0x20000000cdf/comment-15.xml v1354>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.375+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ce9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-58.xml auth{0=1} v1303 ap=1 s=9337 n(v0 rc2024-03-27T07:25:34.481862+0000 b9337 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ce9:[<0x20000000cdf/article-58.xml v10>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ce9:[<0x20000000cdf/article-58.xml v1303>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.376+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d06 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-53.xml auth{0=1} v1301 ap=1 s=13849 n(v0 rc2024-03-27T07:25:34.661858+0000 b13849 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d06:[<0x20000000cdf/article-53.xml v40>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d06:[<0x20000000cdf/article-53.xml v1301>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.376+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000807 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-43.xml auth{0=1} v1345 ap=1 s=9420 n(v0 rc2024-03-27T07:25:48.219591+0000 b9420 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000807:[<0x20000000cdf/comment-43.xml v1207>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000807:[<0x20000000cdf/comment-43.xml v1345>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.377+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000831 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-17.xml auth{0=1} v1341 ap=1 s=7402 n(v0 rc2024-03-27T07:25:49.292570+0000 b7402 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000831:[<0x20000000cdf/comment-17.xml v1260>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000831:[<0x20000000cdf/comment-17.xml v1341>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.379+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d8c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml auth{0=1} v1315 ap=1 s=22642 n(v0 rc2024-03-27T07:25:35.108849+0000 b22642 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d8c:[<0x20000000cdf/article-28.xml v190>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d8c:[<0x20000000cdf/article-28.xml v1315>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.379+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000839 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-9.xml auth{0=1} v1325 ap=1 s=7904 n(v0 rc2024-03-27T07:25:49.436567+0000 b7904 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000839:[<0x20000000cdf/comment-9.xml v1274>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000839:[<0x20000000cdf/comment-9.xml v1325>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.540 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.380+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d0b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-52.xml auth{0=1} v1329 ap=1 s=23428 n(v0 rc2024-03-27T07:25:34.688857+0000 b23428 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8e6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d0b:[<0x20000000cdf/article-52.xml v46>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d0b:[<0x20000000cdf/article-52.xml v1329>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.381+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e57 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-77.jpg auth v1319 ap=1 s=35019 n(v0 rc2024-03-27T07:25:35.719837+0000 b35019 1=1+0) | authpin=1 scrubqueue=0 0x55661cacd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e57:[<0x20000000cdf/picture-77.jpg v412>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e57:[<0x20000000cdf/picture-77.jpg v1319>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.382+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ebc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-69.jpg auth v1305 ap=1 s=28704 n(v0 rc2024-03-27T07:25:36.008831+0000 b28704 1=1+0) | authpin=1 scrubqueue=0 0x55661bd2ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ebc:[<0x20000000cdf/picture-69.jpg v460>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ebc:[<0x20000000cdf/picture-69.jpg v1305>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.384+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f59 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-51.jpg auth{0=1} v1323 ap=1 s=39456 n(v0 rc2024-03-27T07:25:36.700818+0000 b39456 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8e6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f59:[<0x20000000cdf/picture-51.jpg v568>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f59:[<0x20000000cdf/picture-51.jpg v1323>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.384+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000802 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-45.xml auth{0=1} v1333 ap=1 s=10055 n(v0 rc2024-03-27T07:25:48.161592+0000 b10055 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8e6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000802:[<0x20000000cdf/comment-45.xml v1197>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000802:[<0x20000000cdf/comment-45.xml v1333>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.385+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f0c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-62.jpg auth v1313 ap=1 s=60578 n(v0 rc2024-03-27T07:25:36.409824+0000 b60578 1=1+0) | authpin=1 scrubqueue=0 0x55661e1d8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f0c:[<0x20000000cdf/picture-62.jpg v502>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f0c:[<0x20000000cdf/picture-62.jpg v1313>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.385+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f70 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-46.jpg auth{0=1} v1321 ap=1 s=17401 n(v0 rc2024-03-27T07:25:36.787816+0000 b17401 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8e7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f70:[<0x20000000cdf/picture-46.jpg v598>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f70:[<0x20000000cdf/picture-46.jpg v1321>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.386+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000838 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-10.xml auth{0=1} v1328 ap=1 s=6506 n(v0 rc2024-03-27T07:25:49.426567+0000 b6506 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d295080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000838:[<0x20000000cdf/comment-10.xml v1260>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000838:[<0x20000000cdf/comment-10.xml v1328>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.387+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001027 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg auth{0=1} v1303 ap=1 s=37171 n(v0 rc2024-03-27T07:25:37.600800+0000 b37171 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d295600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001027:[<0x20000000cdf/picture-3.jpg v856>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001027:[<0x20000000cdf/picture-3.jpg v1303>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.388+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ed [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-53.xml auth{0=1} v1319 ap=1 s=6539 n(v0 rc2024-03-27T07:25:47.900597+0000 b6539 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d295b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ed:[<0x20000000cdf/comment-53.xml v1188>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007ed:[<0x20000000cdf/comment-53.xml v1319>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.389+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-6.xml auth{0=1} v1325 ap=1 s=3593 n(v0 rc2024-03-27T07:25:49.482566+0000 b3593 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d296100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083c:[<0x20000000cdf/comment-6.xml v1278>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000083c:[<0x20000000cdf/comment-6.xml v1325>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.389+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f41 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-55.jpg auth{0=1} v1297 ap=1 s=49292 n(v0 rc2024-03-27T07:25:36.593820+0000 b49292 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d296680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f41:[<0x20000000cdf/picture-55.jpg v544>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f41:[<0x20000000cdf/picture-55.jpg v1297>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.541 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.390+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001007 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg auth{0=1} v1309 ap=1 s=12944 n(v0 rc2024-03-27T07:25:37.465803+0000 b12944 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d296c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001007:[<0x20000000cdf/picture-11.jpg v808>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001007:[<0x20000000cdf/picture-11.jpg v1309>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.390+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000eb4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-70.jpg auth v1307 ap=1 s=28074 n(v0 rc2024-03-27T07:25:35.966832+0000 b28074 1=1+0) | authpin=1 scrubqueue=0 0x55661e1d9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000eb4:[<0x20000000cdf/picture-70.jpg v454>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000eb4:[<0x20000000cdf/picture-70.jpg v1307>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.391+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000de3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml auth{0=1} v1289 ap=1 s=18263 n(v0 rc2024-03-27T07:25:35.457842+0000 b18263 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d297180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000de3:[<0x20000000cdf/article-5.xml v328>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000de3:[<0x20000000cdf/article-5.xml v1289>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.392+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000140c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-34.xml auth{0=1} v1388 ap=1 s=27688 n(v0 rc2024-03-27T07:27:09.731987+0000 b27688 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000140c:[<0x20000000cdf/article-34.xml v1379>,<0x10000000399/blog-22 v115172>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x1000000140c:[<0x20000000cdf/article-34.xml v1388>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.392+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000817 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-35.xml auth{0=1} v1301 ap=1 s=7688 n(v0 rc2024-03-27T07:25:48.435587+0000 b7688 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000817:[<0x20000000cdf/comment-35.xml v1219>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000817:[<0x20000000cdf/comment-35.xml v1301>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.393+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000825 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-28.xml auth{0=1} v1315 ap=1 s=6842 n(v0 rc2024-03-27T07:25:48.613583+0000 b6842 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000825:[<0x20000000cdf/comment-28.xml v1227>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000825:[<0x20000000cdf/comment-28.xml v1315>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.394+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007e3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-57.xml auth{0=1} v1299 ap=1 s=6181 n(v0 rc2024-03-27T07:25:47.839599+0000 b6181 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007e3:[<0x20000000cdf/comment-57.xml v1299>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007e3:[<0x20000000cdf/comment-57.xml v1299>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.394+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000eab [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-71.jpg auth v1283 ap=1 s=46566 n(v0 rc2024-03-27T07:25:35.927833+0000 b46566 1=1+0) | authpin=1 scrubqueue=0 0x55661e1d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000eab:[<0x20000000cdf/picture-71.jpg v448>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000eab:[<0x20000000cdf/picture-71.jpg v1283>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.394+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d88 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml auth{0=1} v1305 ap=1 s=6634 n(v0 rc2024-03-27T07:25:35.094849+0000 b6634 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d88:[<0x20000000cdf/article-29.xml v184>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d88:[<0x20000000cdf/article-29.xml v1305>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.395+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000011ec [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-60.xml auth{0=1} v1390 ap=1 s=18089 n(v0 rc2024-03-27T07:27:06.125058+0000 b18089 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000011ec:[<0x20000000cdf/article-60.xml v1373>,<0x10000000399/blog-22 v115172>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000011ec:[<0x20000000cdf/article-60.xml v1390>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.396+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f00 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-63.jpg auth v1285 ap=1 s=27069 n(v0 rc2024-03-27T07:25:36.325825+0000 b27069 1=1+0) | authpin=1 scrubqueue=0 0x55661e1d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f00:[<0x20000000cdf/picture-63.jpg v496>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f00:[<0x20000000cdf/picture-63.jpg v1285>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.542 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.397+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f8c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg auth{0=1} v1287 ap=1 s=33910 n(v0 rc2024-03-27T07:25:36.904814+0000 b33910 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f8c:[<0x20000000cdf/picture-40.jpg v634>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f8c:[<0x20000000cdf/picture-40.jpg v1287>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.543 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.397+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-61.xml auth{0=1} v1323 ap=1 s=5932 n(v0 rc2024-03-27T07:25:47.697601+0000 b5932 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d6:[<0x20000000cdf/comment-61.xml v1173>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007d6:[<0x20000000cdf/comment-61.xml v1323>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.543 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.397+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000da5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml auth{0=1} v1295 ap=1 s=2449 n(v0 rc2024-03-27T07:25:35.269846+0000 b2449 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000da5:[<0x20000000cdf/article-22.xml v226>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000da5:[<0x20000000cdf/article-22.xml v1295>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.543 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.398+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-38.xml auth{0=1} v1317 ap=1 s=3764 n(v0 rc2024-03-27T07:25:48.329589+0000 b3764 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080f:[<0x20000000cdf/comment-38.xml v1205>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000080f:[<0x20000000cdf/comment-38.xml v1317>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.543 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.398+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-68.xml auth{0=1} v1321 ap=1 s=6308 n(v0 rc2024-03-27T07:25:47.440606+0000 b6308 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d0b3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c9:[<0x20000000cdf/comment-68.xml v1162>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007c9:[<0x20000000cdf/comment-68.xml v1321>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.543 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.399+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dfb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-84.jpg auth v1291 ap=1 s=17723 n(v0 rc2024-03-27T07:25:35.508841+0000 b17723 1=1+0) | authpin=1 scrubqueue=0 0x55661e1d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dfb:[<0x20000000cdf/picture-84.jpg v364>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000dfb:[<0x20000000cdf/picture-84.jpg v1291>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.543 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.400+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d1e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-49.xml auth{0=1} v1293 ap=1 s=5916 n(v0 rc2024-03-27T07:25:34.751856+0000 b5916 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf92000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d1e:[<0x20000000cdf/article-49.xml v64>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d1e:[<0x20000000cdf/article-49.xml v1293>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.543 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.400+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-8.xml auth{0=1} v1311 ap=1 s=3365 n(v0 rc2024-03-27T07:25:49.447567+0000 b3365 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf92580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083a:[<0x20000000cdf/comment-8.xml v1271>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000083a:[<0x20000000cdf/comment-8.xml v1311>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.543 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.402+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e51 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-56.xml auth{0=1} v1109 ap=1 s=6559 n(v0 rc2024-03-27T07:26:47.657420+0000 b6559 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661becc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e51:[<0x2000000284b/comment-56.xml v1109>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e51:[<0x2000000284b/comment-56.xml v1109>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.543 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.403+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028c1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-18.jpg auth{0=1} v577 ap=1 s=13540 n(v0 rc2024-03-27T07:26:13.537092+0000 b13540 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661beccb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028c1:[<0x2000000284b/picture-18.jpg v577>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028c1:[<0x2000000284b/picture-18.jpg v577>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.403+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000284d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-18.xml auth{0=1} v525 ap=1 s=3702 n(v0 rc2024-03-27T07:26:13.291097+0000 b3702 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661becd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000284d:[<0x2000000284b/article-18.xml v525>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000284d:[<0x2000000284b/article-18.xml v525>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.404+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001996 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-5.xml auth{0=1} v1234 ap=1 s=3293 n(v0 rc2024-03-27T07:27:22.768732+0000 b3293 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661becdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001996:[<0x2000000284b/comment-5.xml v1234>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001996:[<0x2000000284b/comment-5.xml v1234>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.405+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028bf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-19.jpg auth{0=1} v551 ap=1 s=20302 n(v0 rc2024-03-27T07:26:13.534092+0000 b20302 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bece100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028bf:[<0x2000000284b/picture-19.jpg v551>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028bf:[<0x2000000284b/picture-19.jpg v551>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.405+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000196b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-29.xml auth{0=1} v1240 ap=1 s=5751 n(v0 rc2024-03-27T07:27:22.423739+0000 b5751 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661becec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000196b:[<0x2000000284b/comment-29.xml v1240>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000196b:[<0x2000000284b/comment-29.xml v1240>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.407+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028dd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-4.jpg auth{0=1} v491 ap=1 s=58515 n(v0 rc2024-03-27T07:26:13.581091+0000 b58515 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661becf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028dd:[<0x2000000284b/picture-4.jpg v491>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028dd:[<0x2000000284b/picture-4.jpg v491>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.407+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000289f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-35.jpg auth v521 ap=1 s=40134 n(v0 rc2024-03-27T07:26:13.431094+0000 b40134 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661becf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000289f:[<0x2000000284b/picture-35.jpg v521>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000289f:[<0x2000000284b/picture-35.jpg v521>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.408+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028e1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-2.jpg auth{0=1} v543 ap=1 s=14704 n(v0 rc2024-03-27T07:26:13.587091+0000 b14704 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dff4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028e1:[<0x2000000284b/picture-2.jpg v543>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028e1:[<0x2000000284b/picture-2.jpg v543>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.408+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028c9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-14.jpg auth{0=1} v575 ap=1 s=35301 n(v0 rc2024-03-27T07:26:13.550092+0000 b35301 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dff4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028c9:[<0x2000000284b/picture-14.jpg v575>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028c9:[<0x2000000284b/picture-14.jpg v575>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.409+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028d7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-7.jpg auth{0=1} v599 ap=1 s=9559 n(v0 rc2024-03-27T07:26:13.572092+0000 b9559 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dff4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028d7:[<0x2000000284b/picture-7.jpg v599>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028d7:[<0x2000000284b/picture-7.jpg v599>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.410+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028d3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-9.jpg auth{0=1} v565 ap=1 s=31513 n(v0 rc2024-03-27T07:26:13.565092+0000 b31513 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dff5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028d3:[<0x2000000284b/picture-9.jpg v565>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028d3:[<0x2000000284b/picture-9.jpg v565>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.410+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000198e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-11.xml auth{0=1} v1236 ap=1 s=9630 n(v0 rc2024-03-27T07:27:22.729733+0000 b9630 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dff5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000198e:[<0x2000000284b/comment-11.xml v1236>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000198e:[<0x2000000284b/comment-11.xml v1236>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.544 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.411+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000197d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-20.xml auth{0=1} v1238 ap=1 s=9232 n(v0 rc2024-03-27T07:27:22.574736+0000 b9232 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dff6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000197d:[<0x2000000284b/comment-20.xml v1238>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000197d:[<0x2000000284b/comment-20.xml v1238>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.411+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001961 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-37.xml auth{0=1} v1240 ap=1 s=5647 n(v0 rc2024-03-27T07:27:22.348740+0000 b5647 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001961:[<0x2000000284b/comment-37.xml v1240>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001961:[<0x2000000284b/comment-37.xml v1240>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.413+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e36 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-71.xml auth{0=1} v1110 ap=1 s=4348 n(v0 rc2024-03-27T07:26:47.152430+0000 b4348 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e36:[<0x2000000284b/comment-71.xml v1110>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e36:[<0x2000000284b/comment-71.xml v1110>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.413+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028d1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-10.jpg auth{0=1} v553 ap=1 s=20937 n(v0 rc2024-03-27T07:26:13.562092+0000 b20937 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028d1:[<0x2000000284b/picture-10.jpg v553>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028d1:[<0x2000000284b/picture-10.jpg v553>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.414+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfa [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-1.jpg auth{0=1} v1098 ap=1 s=20484 n(v0 rc2024-03-27T07:26:41.664538+0000 b20484 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfa:[<0x2000000284b/picture-1.jpg v645>,<0x10000000399/blog-70 v101841>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cfa:[<0x2000000284b/picture-1.jpg v1098>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.415+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001985 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-16.xml auth{0=1} v1230 ap=1 s=3795 n(v0 rc2024-03-27T07:27:22.630735+0000 b3795 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a4bc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001985:[<0x2000000284b/comment-16.xml v1230>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001985:[<0x2000000284b/comment-16.xml v1230>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.415+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000285f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-9.xml auth{0=1} v485 ap=1 s=28689 n(v0 rc2024-03-27T07:26:13.322097+0000 b28689 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a4bc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000285f:[<0x2000000284b/article-9.xml v485>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000285f:[<0x2000000284b/article-9.xml v485>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.416+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028d9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-6.jpg auth{0=1} v617 ap=1 s=18343 n(v0 rc2024-03-27T07:26:13.575092+0000 b18343 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a4bcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028d9:[<0x2000000284b/picture-6.jpg v617>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028d9:[<0x2000000284b/picture-6.jpg v617>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.416+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e4d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-58.xml auth{0=1} v1100 ap=1 s=3533 n(v0 rc2024-03-27T07:26:47.551422+0000 b3533 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a4bd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e4d:[<0x2000000284b/comment-58.xml v1100>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e4d:[<0x2000000284b/comment-58.xml v1100>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.417+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000193c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-55.xml auth{0=1} v1244 ap=1 s=6575 n(v0 rc2024-03-27T07:27:21.994747+0000 b6575 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a4bdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000193c:[<0x2000000284b/comment-55.xml v1244>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000193c:[<0x2000000284b/comment-55.xml v1244>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.417+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001965 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-34.xml auth{0=1} v1238 ap=1 s=8612 n(v0 rc2024-03-27T07:27:22.372740+0000 b8612 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a4be680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001965:[<0x2000000284b/comment-34.xml v1238>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001965:[<0x2000000284b/comment-34.xml v1238>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.417+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001975 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-25.xml auth{0=1} v1236 ap=1 s=9811 n(v0 rc2024-03-27T07:27:22.532737+0000 b9811 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a4bf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001975:[<0x2000000284b/comment-25.xml v1236>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001975:[<0x2000000284b/comment-25.xml v1236>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.545 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.418+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028ad [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-28.jpg auth v549 ap=1 s=29053 n(v0 rc2024-03-27T07:26:13.505093+0000 b29053 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661a4bf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028ad:[<0x2000000284b/picture-28.jpg v549>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028ad:[<0x2000000284b/picture-28.jpg v549>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.418+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001956 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-41.xml auth{0=1} v1242 ap=1 s=9925 n(v0 rc2024-03-27T07:27:22.171744+0000 b9925 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556618856580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001956:[<0x2000000284b/comment-41.xml v1242>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001956:[<0x2000000284b/comment-41.xml v1242>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.419+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e2d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-75.xml auth{0=1} v1106 ap=1 s=9769 n(v0 rc2024-03-27T07:26:47.103431+0000 b9769 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556618856b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e2d:[<0x2000000284b/comment-75.xml v1106>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e2d:[<0x2000000284b/comment-75.xml v1106>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.420+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000289b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-37.jpg auth v509 ap=1 s=34608 n(v0 rc2024-03-27T07:26:13.425095+0000 b34608 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556618857080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000289b:[<0x2000000284b/picture-37.jpg v509>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000289b:[<0x2000000284b/picture-37.jpg v509>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.420+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028c3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-17.jpg auth{0=1} v619 ap=1 s=35636 n(v0 rc2024-03-27T07:26:13.540092+0000 b35636 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556618857600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028c3:[<0x2000000284b/picture-17.jpg v619>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028c3:[<0x2000000284b/picture-17.jpg v619>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.421+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000286b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-3.xml auth{0=1} v489 ap=1 s=5342 n(v0 rc2024-03-27T07:26:13.343096+0000 b5342 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556618857b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000286b:[<0x2000000284b/article-3.xml v489>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000286b:[<0x2000000284b/article-3.xml v489>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.421+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-24.jpg auth v1247 ap=1 s=43198 n(v0 rc2024-03-27T07:27:09.258997+0000 b43198 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556618858680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b8:[<0x2000000284b/picture-24.jpg v1131>,<0x10000000399/blog-70 v115169>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000013b8:[<0x2000000284b/picture-24.jpg v1247>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.422+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028a3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-33.jpg auth v589 ap=1 s=32816 n(v0 rc2024-03-27T07:26:13.437094+0000 b32816 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556618858c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028a3:[<0x2000000284b/picture-33.jpg v589>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028a3:[<0x2000000284b/picture-33.jpg v589>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.423+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002873 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-57.jpg auth v569 ap=1 s=43090 n(v0 rc2024-03-27T07:26:13.357096+0000 b43090 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556618859180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002873:[<0x2000000284b/picture-57.jpg v569>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002873:[<0x2000000284b/picture-57.jpg v569>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.424+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002863 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-7.xml auth{0=1} v487 ap=1 s=22645 n(v0 rc2024-03-27T07:26:13.329096+0000 b22645 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556618859700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002863:[<0x2000000284b/article-7.xml v487>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002863:[<0x2000000284b/article-7.xml v487>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.425+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002891 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-42.jpg auth v567 ap=1 s=34697 n(v0 rc2024-03-27T07:26:13.410095+0000 b34697 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b538000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002891:[<0x2000000284b/picture-42.jpg v567>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002891:[<0x2000000284b/picture-42.jpg v567>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.426+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002897 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-39.jpg auth v587 ap=1 s=13297 n(v0 rc2024-03-27T07:26:13.419095+0000 b13297 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b538580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002897:[<0x2000000284b/picture-39.jpg v587>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002897:[<0x2000000284b/picture-39.jpg v587>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.546 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.427+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001979 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-23.xml auth{0=1} v1232 ap=1 s=6258 n(v0 rc2024-03-27T07:27:22.554736+0000 b6258 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b539080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001979:[<0x2000000284b/comment-23.xml v1232>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001979:[<0x2000000284b/comment-23.xml v1232>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.428+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001977 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-24.xml auth{0=1} v1234 ap=1 s=7073 n(v0 rc2024-03-27T07:27:22.547736+0000 b7073 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b539b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001977:[<0x2000000284b/comment-24.xml v1234>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001977:[<0x2000000284b/comment-24.xml v1234>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.430+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028b3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-25.jpg auth v535 ap=1 s=21714 n(v0 rc2024-03-27T07:26:13.515093+0000 b21714 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661df03180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028b3:[<0x2000000284b/picture-25.jpg v535>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028b3:[<0x2000000284b/picture-25.jpg v535>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.431+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-95.xml auth v1100 ap=1 s=26984 n(v0 rc2024-03-27T07:26:41.699538+0000 b26984 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661df03700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfb:[<0x2000000284b/article-95.xml v1100>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000cfb:[<0x2000000284b/article-95.xml v1100>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.432+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ada [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-8.xml auth{0=1} v625 ap=1 s=30568 n(v0 rc2024-03-27T07:26:15.775048+0000 b30568 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d59e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ada:[<0x2000000284b/article-8.xml v625>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ada:[<0x2000000284b/article-8.xml v625>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.432+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001948 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-47.xml auth{0=1} v1242 ap=1 s=5622 n(v0 rc2024-03-27T07:27:22.084745+0000 b5622 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d59eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001948:[<0x2000000284b/comment-47.xml v1242>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001948:[<0x2000000284b/comment-47.xml v1242>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.433+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001949 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-46.xml auth{0=1} v1240 ap=1 s=3866 n(v0 rc2024-03-27T07:27:22.092745+0000 b3866 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d59f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001949:[<0x2000000284b/comment-46.xml v1240>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001949:[<0x2000000284b/comment-46.xml v1240>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.433+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028a7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-31.jpg auth v479 ap=1 s=43628 n(v0 rc2024-03-27T07:26:13.443094+0000 b43628 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d59fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028a7:[<0x2000000284b/picture-31.jpg v479>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028a7:[<0x2000000284b/picture-31.jpg v479>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.434+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e37 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-70.xml auth{0=1} v1110 ap=1 s=6159 n(v0 rc2024-03-27T07:26:47.224429+0000 b6159 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5a0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e37:[<0x2000000284b/comment-70.xml v1110>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e37:[<0x2000000284b/comment-70.xml v1110>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.434+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002883 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-49.jpg auth v497 ap=1 s=57180 n(v0 rc2024-03-27T07:26:13.385095+0000 b57180 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d5a0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002883:[<0x2000000284b/picture-49.jpg v497>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002883:[<0x2000000284b/picture-49.jpg v497>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.435+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028d5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-8.jpg auth{0=1} v513 ap=1 s=37365 n(v0 rc2024-03-27T07:26:13.568092+0000 b37365 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5a0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028d5:[<0x2000000284b/picture-8.jpg v513>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028d5:[<0x2000000284b/picture-8.jpg v513>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.436+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028b1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-26.jpg auth v533 ap=1 s=60834 n(v0 rc2024-03-27T07:26:13.512093+0000 b60834 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d5a1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028b1:[<0x2000000284b/picture-26.jpg v533>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028b1:[<0x2000000284b/picture-26.jpg v533>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.547 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.437+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-32.xml auth v1102 ap=1 s=17870 n(v0 rc2024-03-27T07:26:40.042570+0000 b17870 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d5a1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf6:[<0x2000000284b/article-32.xml v639>,<0x10000000399/blog-70 v101841>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cf6:[<0x2000000284b/article-32.xml v1102>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.548 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.438+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-69.xml auth{0=1} v1106 ap=1 s=5056 n(v0 rc2024-03-27T07:26:47.292427+0000 b5056 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfd0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e3a:[<0x2000000284b/comment-69.xml v1106>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e3a:[<0x2000000284b/comment-69.xml v1106>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.548 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.439+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e30 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-74.xml auth{0=1} v1108 ap=1 s=6373 n(v0 rc2024-03-27T07:26:47.112431+0000 b6373 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfd0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e30:[<0x2000000284b/comment-74.xml v1108>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e30:[<0x2000000284b/comment-74.xml v1108>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.548 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.439+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001962 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-36.xml auth{0=1} v1238 ap=1 s=8349 n(v0 rc2024-03-27T07:27:22.357740+0000 b8349 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfd1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001962:[<0x2000000284b/comment-36.xml v1238>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001962:[<0x2000000284b/comment-36.xml v1238>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.554 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.440+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002857 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-13.xml auth{0=1} v505 ap=1 s=17609 n(v0 rc2024-03-27T07:26:13.308097+0000 b17609 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfd1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002857:[<0x2000000284b/article-13.xml v505>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002857:[<0x2000000284b/article-13.xml v505>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.554 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.442+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e45 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-64.xml auth{0=1} v1104 ap=1 s=2721 n(v0 rc2024-03-27T07:26:47.464424+0000 b2721 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfd1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e45:[<0x2000000284b/comment-64.xml v1104>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e45:[<0x2000000284b/comment-64.xml v1104>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.554 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.443+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e33 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-72.xml auth{0=1} v1126 ap=1 s=3173 n(v0 rc2024-03-27T07:26:47.131431+0000 b3173 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfd2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e33:[<0x2000000284b/comment-72.xml v1126>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e33:[<0x2000000284b/comment-72.xml v1126>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.554 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.443+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001998 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-4.xml auth{0=1} v1232 ap=1 s=9692 n(v0 rc2024-03-27T07:27:22.797731+0000 b9692 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfd2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001998:[<0x2000000284b/comment-4.xml v1232>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001998:[<0x2000000284b/comment-4.xml v1232>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.554 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.445+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002865 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-6.xml auth{0=1} v529 ap=1 s=23275 n(v0 rc2024-03-27T07:26:13.333096+0000 b23275 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfd3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002865:[<0x2000000284b/article-6.xml v529>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002865:[<0x2000000284b/article-6.xml v529>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.446+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016a0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-2.xml auth{0=1} v1230 ap=1 s=29020 n(v0 rc2024-03-27T07:27:15.869867+0000 b29020 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df80000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016a0:[<0x2000000284b/article-2.xml v1230>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016a0:[<0x2000000284b/article-2.xml v1230>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.447+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001989 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-14.xml auth{0=1} v1234 ap=1 s=4446 n(v0 rc2024-03-27T07:27:22.701733+0000 b4446 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df80b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001989:[<0x2000000284b/comment-14.xml v1234>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001989:[<0x2000000284b/comment-14.xml v1234>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.447+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-67.xml auth{0=1} v1124 ap=1 s=3873 n(v0 rc2024-03-27T07:26:47.393425+0000 b3873 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df81080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e3e:[<0x2000000284b/comment-67.xml v1124>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e3e:[<0x2000000284b/comment-67.xml v1124>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.448+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002879 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-54.jpg auth v511 ap=1 s=26527 n(v0 rc2024-03-27T07:26:13.368096+0000 b26527 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661df81600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002879:[<0x2000000284b/picture-54.jpg v511>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002879:[<0x2000000284b/picture-54.jpg v511>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.449+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028ab [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-29.jpg auth v559 ap=1 s=44170 n(v0 rc2024-03-27T07:26:13.502093+0000 b44170 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661df81b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028ab:[<0x2000000284b/picture-29.jpg v559>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028ab:[<0x2000000284b/picture-29.jpg v559>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.450+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000197f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-19.xml auth{0=1} v1236 ap=1 s=4452 n(v0 rc2024-03-27T07:27:22.587735+0000 b4452 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df82680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000197f:[<0x2000000284b/comment-19.xml v1236>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000197f:[<0x2000000284b/comment-19.xml v1236>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.453+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000197a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-22.xml auth{0=1} v1245 ap=1 s=8869 n(v0 rc2024-03-27T07:27:22.562736+0000 b8869 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5566195c6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000197a:[<0x2000000284b/comment-22.xml v1245>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000197a:[<0x2000000284b/comment-22.xml v1245>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.453+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000199b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-2.xml auth{0=1} v1235 ap=1 s=9926 n(v0 rc2024-03-27T07:27:22.813731+0000 b9926 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5566195c6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000199b:[<0x2000000284b/comment-2.xml v1235>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000199b:[<0x2000000284b/comment-2.xml v1235>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.454+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000194c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-44.xml auth{0=1} v1251 ap=1 s=8699 n(v0 rc2024-03-27T07:27:22.113745+0000 b8699 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5566195c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000194c:[<0x2000000284b/comment-44.xml v1251>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000194c:[<0x2000000284b/comment-44.xml v1251>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.455+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028db [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-5.jpg auth{0=1} v501 ap=1 s=61399 n(v0 rc2024-03-27T07:26:13.578092+0000 b61399 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c8a6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028db:[<0x2000000284b/picture-5.jpg v501>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028db:[<0x2000000284b/picture-5.jpg v501>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.456+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000196e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-27.xml auth{0=1} v1247 ap=1 s=5170 n(v0 rc2024-03-27T07:27:22.463738+0000 b5170 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c8a6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000196e:[<0x2000000284b/comment-27.xml v1247>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000196e:[<0x2000000284b/comment-27.xml v1247>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.555 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.457+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002881 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-50.jpg auth v593 ap=1 s=31357 n(v0 rc2024-03-27T07:26:13.382095+0000 b31357 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c8a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002881:[<0x2000000284b/picture-50.jpg v593>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002881:[<0x2000000284b/picture-50.jpg v593>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.458+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e2b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-76.xml auth{0=1} v1107 ap=1 s=5475 n(v0 rc2024-03-27T07:26:47.089431+0000 b5475 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c8a7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e2b:[<0x2000000284b/comment-76.xml v1107>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e2b:[<0x2000000284b/comment-76.xml v1107>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.459+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002871 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-58.jpg auth v539 ap=1 s=41106 n(v0 rc2024-03-27T07:26:13.354096+0000 b41106 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c8a7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002871:[<0x2000000284b/picture-58.jpg v539>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002871:[<0x2000000284b/picture-58.jpg v539>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.460+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000193f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-52.xml auth{0=1} v1255 ap=1 s=7156 n(v0 rc2024-03-27T07:27:22.011747+0000 b7156 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c8a8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000193f:[<0x2000000284b/comment-52.xml v1255>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000193f:[<0x2000000284b/comment-52.xml v1255>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.460+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-66.xml auth{0=1} v1123 ap=1 s=8258 n(v0 rc2024-03-27T07:26:47.425425+0000 b8258 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c8a8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e3f:[<0x2000000284b/comment-66.xml v1123>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e3f:[<0x2000000284b/comment-66.xml v1123>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.461+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001993 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-7.xml auth{0=1} v1237 ap=1 s=5266 n(v0 rc2024-03-27T07:27:22.746732+0000 b5266 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c8a9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001993:[<0x2000000284b/comment-7.xml v1237>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001993:[<0x2000000284b/comment-7.xml v1237>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.462+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001986 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-15.xml auth{0=1} v1241 ap=1 s=7656 n(v0 rc2024-03-27T07:27:22.665734+0000 b7656 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001986:[<0x2000000284b/comment-15.xml v1241>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001986:[<0x2000000284b/comment-15.xml v1241>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.463+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000194f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-43.xml auth{0=1} v1249 ap=1 s=2195 n(v0 rc2024-03-27T07:27:22.132744+0000 b2195 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cded080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000194f:[<0x2000000284b/comment-43.xml v1249>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000194f:[<0x2000000284b/comment-43.xml v1249>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.463+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001983 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-17.xml auth{0=1} v1243 ap=1 s=9157 n(v0 rc2024-03-27T07:27:22.618735+0000 b9157 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdedb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001983:[<0x2000000284b/comment-17.xml v1243>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001983:[<0x2000000284b/comment-17.xml v1243>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.464+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001990 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-9.xml auth{0=1} v1239 ap=1 s=4062 n(v0 rc2024-03-27T07:27:22.737732+0000 b4062 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdee680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001990:[<0x2000000284b/comment-9.xml v1239>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001990:[<0x2000000284b/comment-9.xml v1239>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.464+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000287f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-51.jpg auth v591 ap=1 s=59383 n(v0 rc2024-03-27T07:26:13.378095+0000 b59383 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661cdeec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000287f:[<0x2000000284b/picture-51.jpg v591>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000287f:[<0x2000000284b/picture-51.jpg v591>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.466+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000194a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-45.xml auth{0=1} v1253 ap=1 s=6597 n(v0 rc2024-03-27T07:27:22.100745+0000 b6597 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000194a:[<0x2000000284b/comment-45.xml v1253>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000194a:[<0x2000000284b/comment-45.xml v1253>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.556 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.466+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002889 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-46.jpg auth v557 ap=1 s=55100 n(v0 rc2024-03-27T07:26:13.396095+0000 b55100 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661def6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002889:[<0x2000000284b/picture-46.jpg v557>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002889:[<0x2000000284b/picture-46.jpg v557>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.467+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e1e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-81.xml auth{0=1} v1104 ap=1 s=6572 n(v0 rc2024-03-27T07:26:47.008433+0000 b6572 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d026580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e1e:[<0x2000000284b/comment-81.xml v1104>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e1e:[<0x2000000284b/comment-81.xml v1104>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.468+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000198f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-10.xml auth{0=1} v1225 ap=1 s=8951 n(v0 rc2024-03-27T07:27:22.733733+0000 b8951 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d027080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000198f:[<0x2000000284b/comment-10.xml v1225>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000198f:[<0x2000000284b/comment-10.xml v1225>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.469+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028df [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-3.jpg auth{0=1} v473 ap=1 s=15007 n(v0 rc2024-03-27T07:26:13.584091+0000 b15007 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d027600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028df:[<0x2000000284b/picture-3.jpg v473>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028df:[<0x2000000284b/picture-3.jpg v473>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.470+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000193e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-53.xml auth{0=1} v1233 ap=1 s=5919 n(v0 rc2024-03-27T07:27:22.007747+0000 b5919 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d028100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000193e:[<0x2000000284b/comment-53.xml v1233>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000193e:[<0x2000000284b/comment-53.xml v1233>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.471+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001994 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-6.xml auth{0=1} v1221 ap=1 s=6055 n(v0 rc2024-03-27T07:27:22.757732+0000 b6055 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d028c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001994:[<0x2000000284b/comment-6.xml v1221>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001994:[<0x2000000284b/comment-6.xml v1221>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.472+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002877 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-55.jpg auth v583 ap=1 s=16314 n(v0 rc2024-03-27T07:26:13.364096+0000 b16314 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d029180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002877:[<0x2000000284b/picture-55.jpg v583>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002877:[<0x2000000284b/picture-55.jpg v583>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.473+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028cf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-11.jpg auth{0=1} v607 ap=1 s=32779 n(v0 rc2024-03-27T07:26:13.559092+0000 b32779 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d029700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028cf:[<0x2000000284b/picture-11.jpg v607>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028cf:[<0x2000000284b/picture-11.jpg v607>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.473+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002867 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-5.xml auth{0=1} v601 ap=1 s=18806 n(v0 rc2024-03-27T07:26:13.336096+0000 b18806 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1a4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002867:[<0x2000000284b/article-5.xml v601>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002867:[<0x2000000284b/article-5.xml v601>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.474+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001963 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-35.xml auth{0=1} v1229 ap=1 s=8363 n(v0 rc2024-03-27T07:27:22.363740+0000 b8363 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1a4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001963:[<0x2000000284b/comment-35.xml v1229>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001963:[<0x2000000284b/comment-35.xml v1229>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.475+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000196d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-28.xml auth{0=1} v1227 ap=1 s=2083 n(v0 rc2024-03-27T07:27:22.435738+0000 b2083 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1a5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000196d:[<0x2000000284b/comment-28.xml v1227>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000196d:[<0x2000000284b/comment-28.xml v1227>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.476+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e4e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-57.xml auth{0=1} v1108 ap=1 s=6461 n(v0 rc2024-03-27T07:26:47.576422+0000 b6461 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1a5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e4e:[<0x2000000284b/comment-57.xml v1108>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e4e:[<0x2000000284b/comment-57.xml v1108>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.557 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.476+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002895 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-40.jpg auth v477 ap=1 s=63556 n(v0 rc2024-03-27T07:26:13.416095+0000 b63556 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d1a6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002895:[<0x2000000284b/picture-40.jpg v477>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002895:[<0x2000000284b/picture-40.jpg v477>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.477+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e4a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-61.xml auth{0=1} v1126 ap=1 s=8333 n(v0 rc2024-03-27T07:26:47.516423+0000 b8333 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1a6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e4a:[<0x2000000284b/comment-61.xml v1126>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e4a:[<0x2000000284b/comment-61.xml v1126>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.478+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000195f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-38.xml auth{0=1} v1231 ap=1 s=2797 n(v0 rc2024-03-27T07:27:22.340740+0000 b2797 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1a7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000195f:[<0x2000000284b/comment-38.xml v1231>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000195f:[<0x2000000284b/comment-38.xml v1231>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.478+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e3b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-68.xml auth{0=1} v1112 ap=1 s=7463 n(v0 rc2024-03-27T07:26:47.335427+0000 b7463 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1a7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e3b:[<0x2000000284b/comment-68.xml v1112>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e3b:[<0x2000000284b/comment-68.xml v1112>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.479+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001991 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-8.xml auth{0=1} v1223 ap=1 s=8450 n(v0 rc2024-03-27T07:27:22.741732+0000 b8450 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1f8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001991:[<0x2000000284b/comment-8.xml v1223>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001991:[<0x2000000284b/comment-8.xml v1223>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.479+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e21 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-80.xml auth{0=1} v1118 ap=1 s=9473 n(v0 rc2024-03-27T07:26:47.037432+0000 b9473 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1f8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e21:[<0x2000000284b/comment-80.xml v1118>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e21:[<0x2000000284b/comment-80.xml v1118>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.480+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028b7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-23.jpg auth v573 ap=1 s=15732 n(v0 rc2024-03-27T07:26:13.521093+0000 b15732 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c501080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028b7:[<0x2000000284b/picture-23.jpg v573>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028b7:[<0x2000000284b/picture-23.jpg v573>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.481+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002855 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-14.xml auth{0=1} v561 ap=1 s=21899 n(v0 rc2024-03-27T07:26:13.305097+0000 b21899 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c501600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002855:[<0x2000000284b/article-14.xml v561>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002855:[<0x2000000284b/article-14.xml v561>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.481+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000288b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-45.jpg auth v499 ap=1 s=47141 n(v0 rc2024-03-27T07:26:13.399095+0000 b47141 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c501b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000288b:[<0x2000000284b/picture-45.jpg v499>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000288b:[<0x2000000284b/picture-45.jpg v499>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.482+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-41.jpg auth v1092 ap=1 s=33847 n(v0 rc2024-03-27T07:26:40.036570+0000 b33847 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c502100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf5:[<0x2000000284b/picture-41.jpg v632>,<0x10000000399/blog-70 v101841>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cf5:[<0x2000000284b/picture-41.jpg v1092>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.483+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e47 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-62.xml auth{0=1} v1094 ap=1 s=3061 n(v0 rc2024-03-27T07:26:47.501423+0000 b3061 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c502680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e47:[<0x2000000284b/comment-62.xml v1094>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e47:[<0x2000000284b/comment-62.xml v1094>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.484+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013be [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-46.xml auth v1202 ap=1 s=32721 n(v0 rc2024-03-27T07:27:09.282996+0000 b32721 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c502c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013be:[<0x2000000284b/article-46.xml v1110>,<0x10000000399/blog-70 v115169>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000013be:[<0x2000000284b/article-46.xml v1202>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.558 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.485+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028b9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-22.jpg auth v621 ap=1 s=28520 n(v0 rc2024-03-27T07:26:13.525093+0000 b28520 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c503180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028b9:[<0x2000000284b/picture-22.jpg v621>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028b9:[<0x2000000284b/picture-22.jpg v621>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.485+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000285b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-11.xml auth{0=1} v527 ap=1 s=25197 n(v0 rc2024-03-27T07:26:13.315097+0000 b25197 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c503700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000285b:[<0x2000000284b/article-11.xml v527>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000285b:[<0x2000000284b/article-11.xml v527>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.486+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e4c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-59.xml auth{0=1} v1100 ap=1 s=9595 n(v0 rc2024-03-27T07:26:47.541423+0000 b9595 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c504000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e4c:[<0x2000000284b/comment-59.xml v1100>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e4c:[<0x2000000284b/comment-59.xml v1100>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.487+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002851 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-16.xml auth{0=1} v503 ap=1 s=16622 n(v0 rc2024-03-27T07:26:13.298097+0000 b16622 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c504580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002851:[<0x2000000284b/article-16.xml v503>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002851:[<0x2000000284b/article-16.xml v503>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.487+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e28 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-77.xml auth{0=1} v1104 ap=1 s=6382 n(v0 rc2024-03-27T07:26:47.076432+0000 b6382 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c504b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e28:[<0x2000000284b/comment-77.xml v1104>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e28:[<0x2000000284b/comment-77.xml v1104>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.488+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028c7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-15.jpg auth{0=1} v555 ap=1 s=17676 n(v0 rc2024-03-27T07:26:13.547092+0000 b17676 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c505080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028c7:[<0x2000000284b/picture-15.jpg v555>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028c7:[<0x2000000284b/picture-15.jpg v555>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.489+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002875 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-56.jpg auth v581 ap=1 s=13624 n(v0 rc2024-03-27T07:26:13.361096+0000 b13624 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c505600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002875:[<0x2000000284b/picture-56.jpg v581>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002875:[<0x2000000284b/picture-56.jpg v581>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.490+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002887 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-47.jpg auth v481 ap=1 s=51970 n(v0 rc2024-03-27T07:26:13.393095+0000 b51970 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c505b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002887:[<0x2000000284b/picture-47.jpg v481>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002887:[<0x2000000284b/picture-47.jpg v481>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.490+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000285d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-10.xml auth{0=1} v571 ap=1 s=29926 n(v0 rc2024-03-27T07:26:13.318097+0000 b29926 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c506100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000285d:[<0x2000000284b/article-10.xml v571>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000285d:[<0x2000000284b/article-10.xml v571>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.491+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028cd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-12.jpg auth{0=1} v597 ap=1 s=13677 n(v0 rc2024-03-27T07:26:13.556092+0000 b13677 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c506680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028cd:[<0x2000000284b/picture-12.jpg v597>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028cd:[<0x2000000284b/picture-12.jpg v597>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.491+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000288d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-44.jpg auth v611 ap=1 s=31134 n(v0 rc2024-03-27T07:26:13.403095+0000 b31134 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c506c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000288d:[<0x2000000284b/picture-44.jpg v611>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000288d:[<0x2000000284b/picture-44.jpg v611>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.559 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.492+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001942 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-50.xml auth{0=1} v1199 ap=1 s=9936 n(v0 rc2024-03-27T07:27:22.043746+0000 b9936 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c507700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001942:[<0x2000000284b/comment-50.xml v1199>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001942:[<0x2000000284b/comment-50.xml v1199>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.560 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.493+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001947 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-48.xml auth{0=1} v1197 ap=1 s=4293 n(v0 rc2024-03-27T07:27:22.075745+0000 b4293 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfa4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001947:[<0x2000000284b/comment-48.xml v1197>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001947:[<0x2000000284b/comment-48.xml v1197>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.560 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.494+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002869 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-4.xml auth{0=1} v603 ap=1 s=2660 n(v0 rc2024-03-27T07:26:13.340096+0000 b2660 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfa4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002869:[<0x2000000284b/article-4.xml v603>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002869:[<0x2000000284b/article-4.xml v603>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.560 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.494+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001968 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-31.xml auth{0=1} v1195 ap=1 s=4945 n(v0 rc2024-03-27T07:27:22.395739+0000 b4945 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfa5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001968:[<0x2000000284b/comment-31.xml v1195>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001968:[<0x2000000284b/comment-31.xml v1195>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.560 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.494+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028bb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-21.jpg auth v517 ap=1 s=53144 n(v0 rc2024-03-27T07:26:13.528093+0000 b53144 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661de2a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028bb:[<0x2000000284b/picture-21.jpg v517>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028bb:[<0x2000000284b/picture-21.jpg v517>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.560 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.495+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e32 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-73.xml auth{0=1} v1112 ap=1 s=9425 n(v0 rc2024-03-27T07:26:47.119431+0000 b9425 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661de2a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e32:[<0x2000000284b/comment-73.xml v1112>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e32:[<0x2000000284b/comment-73.xml v1112>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.560 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.495+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e4b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-60.xml auth{0=1} v1110 ap=1 s=9865 n(v0 rc2024-03-27T07:26:47.530423+0000 b9865 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661de2ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e4b:[<0x2000000284b/comment-60.xml v1110>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e4b:[<0x2000000284b/comment-60.xml v1110>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.560 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.496+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e26 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-78.xml auth{0=1} v1116 ap=1 s=3923 n(v0 rc2024-03-27T07:26:47.066432+0000 b3923 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661de2b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e26:[<0x2000000284b/comment-78.xml v1116>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e26:[<0x2000000284b/comment-78.xml v1116>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.560 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.497+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000199d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-1.xml auth{0=1} v1239 ap=1 s=4871 n(v0 rc2024-03-27T07:27:22.819731+0000 b4871 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661de2bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000199d:[<0x2000000284b/comment-1.xml v1239>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000199d:[<0x2000000284b/comment-1.xml v1239>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.560 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.498+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028a9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-30.jpg auth v613 ap=1 s=38828 n(v0 rc2024-03-27T07:26:13.446094+0000 b38828 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661de2c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028a9:[<0x2000000284b/picture-30.jpg v613>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028a9:[<0x2000000284b/picture-30.jpg v613>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.560 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.499+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002853 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-15.xml auth{0=1} v475 ap=1 s=11071 n(v0 rc2024-03-27T07:26:13.301097+0000 b11071 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661de2c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002853:[<0x2000000284b/article-15.xml v475>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002853:[<0x2000000284b/article-15.xml v475>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.499+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e24 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-79.xml auth{0=1} v1098 ap=1 s=10057 n(v0 rc2024-03-27T07:26:47.046432+0000 b10057 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661de2cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e24:[<0x2000000284b/comment-79.xml v1098>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e24:[<0x2000000284b/comment-79.xml v1098>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.500+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001959 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-40.xml auth{0=1} v1247 ap=1 s=8407 n(v0 rc2024-03-27T07:27:22.245742+0000 b8407 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661de2d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001959:[<0x2000000284b/comment-40.xml v1247>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001959:[<0x2000000284b/comment-40.xml v1247>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.501+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001966 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-33.xml auth{0=1} v1243 ap=1 s=5868 n(v0 rc2024-03-27T07:27:22.381739+0000 b5868 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dde8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001966:[<0x2000000284b/comment-33.xml v1243>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001966:[<0x2000000284b/comment-33.xml v1243>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.503+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000195b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-39.xml auth{0=1} v1245 ap=1 s=7064 n(v0 rc2024-03-27T07:27:22.280741+0000 b7064 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dde9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000195b:[<0x2000000284b/comment-39.xml v1245>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000195b:[<0x2000000284b/comment-39.xml v1245>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.504+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000289d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-36.jpg auth v541 ap=1 s=22175 n(v0 rc2024-03-27T07:26:13.428095+0000 b22175 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661dde9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000289d:[<0x2000000284b/picture-36.jpg v541>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000289d:[<0x2000000284b/picture-36.jpg v541>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.505+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000288f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-43.jpg auth v563 ap=1 s=60735 n(v0 rc2024-03-27T07:26:13.407095+0000 b60735 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661dde9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000288f:[<0x2000000284b/picture-43.jpg v563>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000288f:[<0x2000000284b/picture-43.jpg v563>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.506+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028bd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-20.jpg auth v493 ap=1 s=61886 n(v0 rc2024-03-27T07:26:13.531092+0000 b61886 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661ddea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028bd:[<0x2000000284b/picture-20.jpg v493>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028bd:[<0x2000000284b/picture-20.jpg v493>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.507+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001967 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-32.xml auth{0=1} v1241 ap=1 s=8775 n(v0 rc2024-03-27T07:27:22.387739+0000 b8775 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ddeac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001967:[<0x2000000284b/comment-32.xml v1241>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001967:[<0x2000000284b/comment-32.xml v1241>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.508+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e46 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-63.xml auth{0=1} v1108 ap=1 s=4568 n(v0 rc2024-03-27T07:26:47.481424+0000 b4568 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ddeb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e46:[<0x2000000284b/comment-63.xml v1108>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e46:[<0x2000000284b/comment-63.xml v1108>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.510+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000193d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-54.xml auth{0=1} v1249 ap=1 s=10107 n(v0 rc2024-03-27T07:27:22.000747+0000 b10107 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ddec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000193d:[<0x2000000284b/comment-54.xml v1249>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000193d:[<0x2000000284b/comment-54.xml v1249>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.510+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002899 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-38.jpg auth v547 ap=1 s=38475 n(v0 rc2024-03-27T07:26:13.422095+0000 b38475 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661ddec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002899:[<0x2000000284b/picture-38.jpg v547>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002899:[<0x2000000284b/picture-38.jpg v547>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.561 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.512+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000198b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-13.xml auth{0=1} v1243 ap=1 s=5190 n(v0 rc2024-03-27T07:27:22.718733+0000 b5190 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d64ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000198b:[<0x2000000284b/comment-13.xml v1243>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000198b:[<0x2000000284b/comment-13.xml v1243>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.513+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000197c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-21.xml auth{0=1} v1247 ap=1 s=3328 n(v0 rc2024-03-27T07:27:22.568736+0000 b3328 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d64b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000197c:[<0x2000000284b/comment-21.xml v1247>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000197c:[<0x2000000284b/comment-21.xml v1247>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.514+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001973 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-26.xml auth{0=1} v1249 ap=1 s=8753 n(v0 rc2024-03-27T07:27:22.499737+0000 b8753 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d63a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001973:[<0x2000000284b/comment-26.xml v1249>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001973:[<0x2000000284b/comment-26.xml v1249>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.515+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028af [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-27.jpg auth v537 ap=1 s=51406 n(v0 rc2024-03-27T07:26:13.508093+0000 b51406 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d63ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028af:[<0x2000000284b/picture-27.jpg v537>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028af:[<0x2000000284b/picture-27.jpg v537>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.516+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002859 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-12.xml auth{0=1} v483 ap=1 s=25854 n(v0 rc2024-03-27T07:26:13.312097+0000 b25854 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d63b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002859:[<0x2000000284b/article-12.xml v483>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002859:[<0x2000000284b/article-12.xml v483>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.517+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000287d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-52.jpg auth v609 ap=1 s=25217 n(v0 rc2024-03-27T07:26:13.375096+0000 b25217 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d63b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000287d:[<0x2000000284b/picture-52.jpg v609>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000287d:[<0x2000000284b/picture-52.jpg v609>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.518+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000286f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-1.xml auth{0=1} v507 ap=1 s=18140 n(v0 rc2024-03-27T07:26:13.350096+0000 b18140 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d63bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000286f:[<0x2000000284b/article-1.xml v507>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000286f:[<0x2000000284b/article-1.xml v507>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.519+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000196a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-30.xml auth{0=1} v1251 ap=1 s=2263 n(v0 rc2024-03-27T07:27:22.407739+0000 b2263 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d63c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000196a:[<0x2000000284b/comment-30.xml v1251>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000196a:[<0x2000000284b/comment-30.xml v1251>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.519+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028a1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-34.jpg auth v615 ap=1 s=13128 n(v0 rc2024-03-27T07:26:13.434094+0000 b13128 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d63cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028a1:[<0x2000000284b/picture-34.jpg v615>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028a1:[<0x2000000284b/picture-34.jpg v615>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.519+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000287b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-53.jpg auth v515 ap=1 s=45076 n(v0 rc2024-03-27T07:26:13.371096+0000 b45076 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d63d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000287b:[<0x2000000284b/picture-53.jpg v515>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000287b:[<0x2000000284b/picture-53.jpg v515>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.520+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ad8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-90.jpg auth v623 ap=1 s=61722 n(v0 rc2024-03-27T07:26:15.760049+0000 b61722 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d63d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ad8:[<0x2000000284b/picture-90.jpg v623>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ad8:[<0x2000000284b/picture-90.jpg v623>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.521+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000199a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-3.xml auth{0=1} v1239 ap=1 s=3438 n(v0 rc2024-03-27T07:27:22.809731+0000 b3438 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d63e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000199a:[<0x2000000284b/comment-3.xml v1239>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000199a:[<0x2000000284b/comment-3.xml v1239>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.562 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.522+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001981 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-18.xml auth{0=1} v1245 ap=1 s=4587 n(v0 rc2024-03-27T07:27:22.597735+0000 b4587 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d63f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001981:[<0x2000000284b/comment-18.xml v1245>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001981:[<0x2000000284b/comment-18.xml v1245>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.522+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028c5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-16.jpg auth{0=1} v495 ap=1 s=56060 n(v0 rc2024-03-27T07:26:13.544092+0000 b56060 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d63f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028c5:[<0x2000000284b/picture-16.jpg v495>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028c5:[<0x2000000284b/picture-16.jpg v495>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.522+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000198d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-12.xml auth{0=1} v1241 ap=1 s=9478 n(v0 rc2024-03-27T07:27:22.724733+0000 b9478 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d640100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000198d:[<0x2000000284b/comment-12.xml v1241>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000198d:[<0x2000000284b/comment-12.xml v1241>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.524+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001945 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-49.xml auth{0=1} v1255 ap=1 s=6543 n(v0 rc2024-03-27T07:27:22.061746+0000 b6543 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d640c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001945:[<0x2000000284b/comment-49.xml v1255>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001945:[<0x2000000284b/comment-49.xml v1255>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.525+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001952 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-42.xml auth{0=1} v1253 ap=1 s=9108 n(v0 rc2024-03-27T07:27:22.152744+0000 b9108 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d641700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001952:[<0x2000000284b/comment-42.xml v1253>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001952:[<0x2000000284b/comment-42.xml v1253>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.525+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e42 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-65.xml auth{0=1} v1113 ap=1 s=9563 n(v0 rc2024-03-27T07:26:47.446424+0000 b9563 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d622000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e42:[<0x2000000284b/comment-65.xml v1113>,<0x10000000399/blog-70 v113435>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000e42:[<0x2000000284b/comment-65.xml v1113>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.527+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000284f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-17.xml auth{0=1} v579 ap=1 s=7279 n(v0 rc2024-03-27T07:26:13.294097+0000 b7279 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d622580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000284f:[<0x2000000284b/article-17.xml v579>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000284f:[<0x2000000284b/article-17.xml v579>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.528+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000028a5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-32.jpg auth v519 ap=1 s=13761 n(v0 rc2024-03-27T07:26:13.441094+0000 b13761 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d622b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000028a5:[<0x2000000284b/picture-32.jpg v519>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000028a5:[<0x2000000284b/picture-32.jpg v519>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.528+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002885 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-48.jpg auth v585 ap=1 s=20518 n(v0 rc2024-03-27T07:26:13.389095+0000 b20518 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d623080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002885:[<0x2000000284b/picture-48.jpg v585>,<0x10000000399/blog-70 v96860>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002885:[<0x2000000284b/picture-48.jpg v585>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.529+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001941 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-51.xml auth{0=1} v1257 ap=1 s=4675 n(v0 rc2024-03-27T07:27:22.033746+0000 b4675 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d623b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001941:[<0x2000000284b/comment-51.xml v1257>,<0x10000000399/blog-70 v122049>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001941:[<0x2000000284b/comment-51.xml v1257>,<0x10000000399/blog-70 v134016>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.529+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fdd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg auth{0=1} v1287 ap=1 s=21194 n(v0 rc2024-03-27T07:25:37.257807+0000 b21194 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fdd:[<0x20000000cdf/picture-23.jpg v736>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fdd:[<0x20000000cdf/picture-23.jpg v1287>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.530+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c85 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-79.jpg auth v1375 ap=1 s=26663 n(v0 rc2024-03-27T07:26:23.850889+0000 b26663 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661ce58000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c85:[<0x20000000cdf/picture-79.jpg v1366>,<0x10000000399/blog-22 v94424>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c85:[<0x20000000cdf/picture-79.jpg v1375>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.563 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.531+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001208 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml auth{0=1} v1389 ap=1 s=28851 n(v0 rc2024-03-27T07:27:06.299055+0000 b28851 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce58b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001208:[<0x20000000cdf/article-14.xml v1378>,<0x10000000399/blog-22 v115172>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000001208:[<0x20000000cdf/article-14.xml v1389>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.532+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f75 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-45.jpg auth{0=1} v1307 ap=1 s=57795 n(v0 rc2024-03-27T07:25:36.804816+0000 b57795 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce59080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f75:[<0x20000000cdf/picture-45.jpg v604>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f75:[<0x20000000cdf/picture-45.jpg v1307>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.532+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f87 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg auth{0=1} v1305 ap=1 s=18437 n(v0 rc2024-03-27T07:25:36.880814+0000 b18437 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce59600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f87:[<0x20000000cdf/picture-41.jpg v628>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f87:[<0x20000000cdf/picture-41.jpg v1305>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.533+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-62.xml auth{0=1} v1301 ap=1 s=7153 n(v0 rc2024-03-27T07:25:47.679602+0000 b7153 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce59b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d2:[<0x20000000cdf/comment-62.xml v1159>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007d2:[<0x20000000cdf/comment-62.xml v1301>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.534+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f23 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-60.jpg auth{0=1} v1293 ap=1 s=31233 n(v0 rc2024-03-27T07:25:36.463822+0000 b31233 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce5a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f23:[<0x20000000cdf/picture-60.jpg v514>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f23:[<0x20000000cdf/picture-60.jpg v1293>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.535+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d2f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-46.xml auth{0=1} v1295 ap=1 s=8511 n(v0 rc2024-03-27T07:25:34.819855+0000 b8511 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce5a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d2f:[<0x20000000cdf/article-46.xml v82>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d2f:[<0x20000000cdf/article-46.xml v1295>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.536+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ede [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-66.jpg auth v1257 ap=1 s=37639 n(v0 rc2024-03-27T07:25:36.184828+0000 b37639 1=1+0) | authpin=1 scrubqueue=0 0x55661e1dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ede:[<0x20000000cdf/picture-66.jpg v478>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ede:[<0x20000000cdf/picture-66.jpg v1257>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.537+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e2e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-80.jpg auth v1291 ap=1 s=17656 n(v0 rc2024-03-27T07:25:35.633839+0000 b17656 1=1+0) | authpin=1 scrubqueue=0 0x55661e1d9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e2e:[<0x20000000cdf/picture-80.jpg v394>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e2e:[<0x20000000cdf/picture-80.jpg v1291>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.537+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d2a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-47.xml auth{0=1} v1263 ap=1 s=9137 n(v0 rc2024-03-27T07:25:34.797855+0000 b9137 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce5ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d2a:[<0x20000000cdf/article-47.xml v76>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d2a:[<0x20000000cdf/article-47.xml v1263>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.538+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fe2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg auth{0=1} v1277 ap=1 s=57195 n(v0 rc2024-03-27T07:25:37.280806+0000 b57195 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce5b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fe2:[<0x20000000cdf/picture-22.jpg v742>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fe2:[<0x20000000cdf/picture-22.jpg v1277>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.538+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dcc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml auth{0=1} v1273 ap=1 s=4150 n(v0 rc2024-03-27T07:25:35.408843+0000 b4150 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce5b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dcc:[<0x20000000cdf/article-11.xml v292>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000dcc:[<0x20000000cdf/article-11.xml v1273>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.564 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.539+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007da [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-59.xml auth{0=1} v1316 ap=1 s=4426 n(v0 rc2024-03-27T07:25:47.739601+0000 b4426 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e04a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007da:[<0x20000000cdf/comment-59.xml v1163>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007da:[<0x20000000cdf/comment-59.xml v1316>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.565 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.540+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-97.jpg auth v1393 ap=1 s=32545 n(v0 rc2024-03-27T07:27:20.797771+0000 b32545 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661e04a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e4:[<0x20000000cdf/picture-97.jpg v1387>,<0x10000000399/blog-22 v117980>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018e4:[<0x20000000cdf/picture-97.jpg v1393>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.565 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.540+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000db8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml auth{0=1} v1313 ap=1 s=32049 n(v0 rc2024-03-27T07:25:35.370844+0000 b32049 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e04ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000db8:[<0x20000000cdf/article-16.xml v262>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000db8:[<0x20000000cdf/article-16.xml v1313>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.565 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.541+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-77.xml auth{0=1} v1281 ap=1 s=9002 n(v0 rc2024-03-27T07:25:46.876618+0000 b9002 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e04b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b2:[<0x20000000cdf/comment-77.xml v1141>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007b2:[<0x20000000cdf/comment-77.xml v1281>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.565 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.542+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d00 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-54.xml auth{0=1} v1309 ap=1 s=25267 n(v0 rc2024-03-27T07:25:34.632859+0000 b25267 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e04b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d00:[<0x20000000cdf/article-54.xml v34>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d00:[<0x20000000cdf/article-54.xml v1309>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.565 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.543+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d97 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml auth{0=1} v1261 ap=1 s=12483 n(v0 rc2024-03-27T07:25:35.137849+0000 b12483 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e04bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d97:[<0x20000000cdf/article-26.xml v202>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d97:[<0x20000000cdf/article-26.xml v1261>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.565 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.544+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ffa [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg auth{0=1} v1289 ap=1 s=41181 n(v0 rc2024-03-27T07:25:37.401804+0000 b41181 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e04c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ffa:[<0x20000000cdf/picture-15.jpg v784>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ffa:[<0x20000000cdf/picture-15.jpg v1289>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.565 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.544+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000726 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-93.xml auth v1285 ap=1 s=22299 n(v0 rc2024-03-27T07:25:44.480665+0000 b22299 1=1+0) | authpin=1 scrubqueue=0 0x55661e1db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000726:[<0x20000000cdf/article-93.xml v1071>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000726:[<0x20000000cdf/article-93.xml v1285>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:24 smithi153 ceph-mon[36179]: pgmap v147: 97 pgs: 97 active+clean; 953 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.7 MiB/s wr, 938 op/s 2024-03-27T07:28:24.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:24 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:24 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000148c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:24 smithi153 ceph-mon[36179]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T07:28:24.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:24 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] up:active 2024-03-27T07:28:24.789 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:24 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:28:24.789 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:24 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:24.411+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c79 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-4.xml auth{0=1} v728 ap=1 s=10963 n(v0 rc2024-03-27T07:25:51.080535+0000 b10963 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab73d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c79:[<0x20000001c3d/article-4.xml v728>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c79:[<0x20000001c3d/article-4.xml v728>,<0x10000000399/blog-47 v146554>,<0x10000000208/blogtest_in v2300>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.789 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:24 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:24.412+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ca9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-59.jpg auth v827 ap=1 s=33208 n(v0 rc2024-03-27T07:25:51.217532+0000 b33208 1=1+0) | authpin=1 scrubqueue=0 0x5607aea11600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ca9:[<0x20000001c3d/picture-59.jpg v758>,<0x10000000399/blog-47 v62217>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ca9:[<0x20000001c3d/picture-59.jpg v827>,<0x10000000399/blog-47 v146554>,<0x10000000208/blogtest_in v2300>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:24 smithi082 ceph-mon[32178]: pgmap v147: 97 pgs: 97 active+clean; 953 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.7 MiB/s wr, 938 op/s 2024-03-27T07:28:24.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:24 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:24 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000148c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:24 smithi082 ceph-mon[32178]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T07:28:24.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:24 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] up:active 2024-03-27T07:28:24.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:24 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:28:24.972 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-mon[36065]: pgmap v147: 97 pgs: 97 active+clean; 953 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 3.7 MiB/s wr, 938 op/s 2024-03-27T07:28:24.972 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.972 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000148c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:24.973 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-mon[36065]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T07:28:24.973 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] up:active 2024-03-27T07:28:24.973 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:28:24.974 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.545+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f3b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-56.jpg auth{0=1} v1271 ap=1 s=22157 n(v0 rc2024-03-27T07:25:36.569820+0000 b22157 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e04c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f3b:[<0x20000000cdf/picture-56.jpg v538>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f3b:[<0x20000000cdf/picture-56.jpg v1271>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.974 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.546+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f6b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-47.jpg auth{0=1} v1265 ap=1 s=43275 n(v0 rc2024-03-27T07:25:36.770816+0000 b43275 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e04cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f6b:[<0x20000000cdf/picture-47.jpg v592>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f6b:[<0x20000000cdf/picture-47.jpg v1265>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.974 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.546+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dd0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml auth{0=1} v1283 ap=1 s=16186 n(v0 rc2024-03-27T07:25:35.417843+0000 b16186 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e04d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dd0:[<0x20000000cdf/article-10.xml v298>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000dd0:[<0x20000000cdf/article-10.xml v1283>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.974 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.547+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001003 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg auth{0=1} v1269 ap=1 s=24019 n(v0 rc2024-03-27T07:25:37.445803+0000 b24019 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e04d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001003:[<0x20000000cdf/picture-12.jpg v802>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000001003:[<0x20000000cdf/picture-12.jpg v1269>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.974 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.548+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f79 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-44.jpg auth{0=1} v1255 ap=1 s=24498 n(v0 rc2024-03-27T07:25:36.822815+0000 b24498 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661deea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f79:[<0x20000000cdf/picture-44.jpg v610>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f79:[<0x20000000cdf/picture-44.jpg v1255>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.549+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-50.xml auth{0=1} v1318 ap=1 s=4093 n(v0 rc2024-03-27T07:25:47.975596+0000 b4093 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661deea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f5:[<0x20000000cdf/comment-50.xml v1186>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007f5:[<0x20000000cdf/comment-50.xml v1318>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.550+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d23 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-48.xml auth{0=1} v1251 ap=1 s=1854 n(v0 rc2024-03-27T07:25:34.776856+0000 b1854 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661deeab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d23:[<0x20000000cdf/article-48.xml v70>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d23:[<0x20000000cdf/article-48.xml v1251>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.550+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007fb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-48.xml auth{0=1} v1303 ap=1 s=2966 n(v0 rc2024-03-27T07:25:48.074594+0000 b2966 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661deeb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007fb:[<0x20000000cdf/comment-48.xml v1191>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007fb:[<0x20000000cdf/comment-48.xml v1303>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.551+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000de6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml auth{0=1} v1267 ap=1 s=20016 n(v0 rc2024-03-27T07:25:35.465842+0000 b20016 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661deeb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000de6:[<0x20000000cdf/article-4.xml v334>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000de6:[<0x20000000cdf/article-4.xml v1267>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.552+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d9c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml auth{0=1} v1253 ap=1 s=4530 n(v0 rc2024-03-27T07:25:35.213847+0000 b4530 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661deebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d9c:[<0x20000000cdf/article-25.xml v208>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d9c:[<0x20000000cdf/article-25.xml v1253>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.553+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e9d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-72.jpg auth v1297 ap=1 s=62854 n(v0 rc2024-03-27T07:25:35.887834+0000 b62854 1=1+0) | authpin=1 scrubqueue=0 0x55661e1da680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e9d:[<0x20000000cdf/picture-72.jpg v442>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e9d:[<0x20000000cdf/picture-72.jpg v1297>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.554+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f29 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-59.jpg auth{0=1} v1259 ap=1 s=43478 n(v0 rc2024-03-27T07:25:36.491822+0000 b43478 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661deec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f29:[<0x20000000cdf/picture-59.jpg v520>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f29:[<0x20000000cdf/picture-59.jpg v1259>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.555+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d5b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-38.xml auth{0=1} v1311 ap=1 s=17684 n(v0 rc2024-03-27T07:25:34.966852+0000 b17684 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661deec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d5b:[<0x20000000cdf/article-38.xml v130>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d5b:[<0x20000000cdf/article-38.xml v1311>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.555+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000820 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-31.xml auth{0=1} v1299 ap=1 s=2227 n(v0 rc2024-03-27T07:25:48.539585+0000 b2227 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661deecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000820:[<0x20000000cdf/comment-31.xml v1232>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000820:[<0x20000000cdf/comment-31.xml v1299>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.705+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001309 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-72.xml auth v1388 ap=1 s=12143 n(v0 rc2024-03-27T07:27:07.675028+0000 b12143 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556619eaab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001309:[<0x20000000cdf/article-72.xml v1382>,<0x10000000399/blog-22 v115172>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000001309:[<0x20000000cdf/article-72.xml v1388>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.705+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e8f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-73.jpg auth v1323 ap=1 s=37870 n(v0 rc2024-03-27T07:25:35.850835+0000 b37870 1=1+0) | authpin=1 scrubqueue=0 0x55661e1db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e8f:[<0x20000000cdf/picture-73.jpg v436>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e8f:[<0x20000000cdf/picture-73.jpg v1323>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.706+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fe7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg auth{0=1} v1305 ap=1 s=62081 n(v0 rc2024-03-27T07:25:37.311806+0000 b62081 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619eaa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fe7:[<0x20000000cdf/picture-21.jpg v748>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fe7:[<0x20000000cdf/picture-21.jpg v1305>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.975 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.706+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d6a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-35.xml auth{0=1} v1315 ap=1 s=5496 n(v0 rc2024-03-27T07:25:35.005851+0000 b5496 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bab5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d6a:[<0x20000000cdf/article-35.xml v148>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d6a:[<0x20000000cdf/article-35.xml v1315>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.976 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.706+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-73.xml auth{0=1} v1350 ap=1 s=6531 n(v0 rc2024-03-27T07:25:47.330609+0000 b6531 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bab4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bb:[<0x20000000cdf/comment-73.xml v1155>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007bb:[<0x20000000cdf/comment-73.xml v1350>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.976 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.707+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-60.xml auth{0=1} v1329 ap=1 s=6866 n(v0 rc2024-03-27T07:25:47.715601+0000 b6866 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bab3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d8:[<0x20000000cdf/comment-60.xml v1175>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007d8:[<0x20000000cdf/comment-60.xml v1329>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.976 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.707+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e75 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-75.jpg auth v1307 ap=1 s=28725 n(v0 rc2024-03-27T07:25:35.784836+0000 b28725 1=1+0) | authpin=1 scrubqueue=0 0x55661b7a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e75:[<0x20000000cdf/picture-75.jpg v424>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e75:[<0x20000000cdf/picture-75.jpg v1307>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.707+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-78.xml auth{0=1} v1325 ap=1 s=2101 n(v0 rc2024-03-27T07:25:46.862618+0000 b2101 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bab3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b1:[<0x20000000cdf/comment-78.xml v1153>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007b1:[<0x20000000cdf/comment-78.xml v1325>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.707+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000841 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-1.xml auth{0=1} v1343 ap=1 s=3461 n(v0 rc2024-03-27T07:25:49.542565+0000 b3461 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bab2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000841:[<0x20000000cdf/comment-1.xml v1300>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000841:[<0x20000000cdf/comment-1.xml v1343>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.708+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d50 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-40.xml auth{0=1} v1317 ap=1 s=9389 n(v0 rc2024-03-27T07:25:34.936853+0000 b9389 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ba9f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d50:[<0x20000000cdf/article-40.xml v118>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d50:[<0x20000000cdf/article-40.xml v1317>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.708+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fbc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg auth{0=1} v1335 ap=1 s=28957 n(v0 rc2024-03-27T07:25:37.089810+0000 b28957 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ba9ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fbc:[<0x20000000cdf/picture-30.jpg v694>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fbc:[<0x20000000cdf/picture-30.jpg v1335>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.708+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dbb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml auth{0=1} v1339 ap=1 s=24976 n(v0 rc2024-03-27T07:25:35.376844+0000 b24976 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ba9e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dbb:[<0x20000000cdf/article-15.xml v268>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000dbb:[<0x20000000cdf/article-15.xml v1339>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.709+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-40.xml auth{0=1} v1346 ap=1 s=9749 n(v0 rc2024-03-27T07:25:48.254590+0000 b9749 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ba9d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080b:[<0x20000000cdf/comment-40.xml v1211>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000080b:[<0x20000000cdf/comment-40.xml v1346>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.709+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-33.xml auth{0=1} v1331 ap=1 s=2355 n(v0 rc2024-03-27T07:25:48.493586+0000 b2355 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ba9cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081c:[<0x20000000cdf/comment-33.xml v1223>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000081c:[<0x20000000cdf/comment-33.xml v1331>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.709+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000080d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-39.xml auth{0=1} v1341 ap=1 s=4639 n(v0 rc2024-03-27T07:25:48.272590+0000 b4639 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ba9c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000080d:[<0x20000000cdf/comment-39.xml v1216>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000080d:[<0x20000000cdf/comment-39.xml v1341>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.709+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f9f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg auth{0=1} v1313 ap=1 s=62300 n(v0 rc2024-03-27T07:25:36.983812+0000 b62300 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b569180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f9f:[<0x20000000cdf/picture-36.jpg v658>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f9f:[<0x20000000cdf/picture-36.jpg v1313>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.710+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f7e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-43.jpg auth{0=1} v1311 ap=1 s=60088 n(v0 rc2024-03-27T07:25:36.843815+0000 b60088 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b568680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f7e:[<0x20000000cdf/picture-43.jpg v616>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f7e:[<0x20000000cdf/picture-43.jpg v1311>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.710+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dad [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml auth{0=1} v1319 ap=1 s=18765 n(v0 rc2024-03-27T07:25:35.333845+0000 b18765 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b567b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dad:[<0x20000000cdf/article-19.xml v244>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000dad:[<0x20000000cdf/article-19.xml v1319>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.710+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000feb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg auth{0=1} v1333 ap=1 s=42373 n(v0 rc2024-03-27T07:25:37.334805+0000 b42373 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b567080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000feb:[<0x20000000cdf/picture-20.jpg v754>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000feb:[<0x20000000cdf/picture-20.jpg v1333>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.711+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e15 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-89.xml auth v1321 ap=1 s=16078 n(v0 rc2024-03-27T07:25:35.581840+0000 b16078 1=1+0) | authpin=1 scrubqueue=0 0x55661e1e8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e15:[<0x20000000cdf/article-89.xml v382>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e15:[<0x20000000cdf/article-89.xml v1321>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.711+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000081e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-32.xml auth{0=1} v1228 ap=1 s=9408 n(v0 rc2024-03-27T07:25:48.506585+0000 b9408 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b566580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000081e:[<0x20000000cdf/comment-32.xml v1228>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000081e:[<0x20000000cdf/comment-32.xml v1228>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.711+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-63.xml auth{0=1} v1348 ap=1 s=8602 n(v0 rc2024-03-27T07:25:47.657602+0000 b8602 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bac5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cf:[<0x20000000cdf/comment-63.xml v1169>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007cf:[<0x20000000cdf/comment-63.xml v1348>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.711+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007eb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-54.xml auth{0=1} v1337 ap=1 s=5654 n(v0 rc2024-03-27T07:25:47.889598+0000 b5654 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bac4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007eb:[<0x20000000cdf/comment-54.xml v1182>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007eb:[<0x20000000cdf/comment-54.xml v1337>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.979 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.712+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d47 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-42.xml auth{0=1} v1309 ap=1 s=5378 n(v0 rc2024-03-27T07:25:34.885854+0000 b5378 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bac4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d47:[<0x20000000cdf/article-42.xml v106>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d47:[<0x20000000cdf/article-42.xml v1309>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.979 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.712+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f95 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg auth{0=1} v1327 ap=1 s=26061 n(v0 rc2024-03-27T07:25:36.948813+0000 b26061 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bac3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f95:[<0x20000000cdf/picture-38.jpg v646>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f95:[<0x20000000cdf/picture-38.jpg v1327>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.979 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.970+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000835 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-13.xml auth{0=1} v1343 ap=1 s=6129 n(v0 rc2024-03-27T07:25:49.356569+0000 b6129 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf56b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000835:[<0x20000000cdf/comment-13.xml v1284>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000835:[<0x20000000cdf/comment-13.xml v1343>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.979 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.971+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000082d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-21.xml auth{0=1} v1331 ap=1 s=3553 n(v0 rc2024-03-27T07:25:49.198572+0000 b3553 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf57080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000082d:[<0x20000000cdf/comment-21.xml v1256>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000082d:[<0x20000000cdf/comment-21.xml v1331>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.979 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.971+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000828 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-26.xml auth{0=1} v1345 ap=1 s=9563 n(v0 rc2024-03-27T07:25:48.637583+0000 b9563 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf57600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000828:[<0x20000000cdf/comment-26.xml v1247>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000828:[<0x20000000cdf/comment-26.xml v1345>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.979 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.972+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a1b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-75.xml auth v1365 ap=1 s=28586 n(v0 rc2024-03-27T07:26:06.120238+0000 b28586 1=1+0) | authpin=1 scrubqueue=0 0x55661e1e9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a1b:[<0x20000000cdf/article-75.xml v1361>,<0x10000000399/blog-22 v63065>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x10000000a1b:[<0x20000000cdf/article-75.xml v1365>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.979 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.972+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d60 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-37.xml auth{0=1} v1309 ap=1 s=21747 n(v0 rc2024-03-27T07:25:34.980852+0000 b21747 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf57b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d60:[<0x20000000cdf/article-37.xml v136>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d60:[<0x20000000cdf/article-37.xml v1309>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.979 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.973+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d56 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-39.xml auth{0=1} v1319 ap=1 s=9350 n(v0 rc2024-03-27T07:25:34.951852+0000 b9350 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf58680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d56:[<0x20000000cdf/article-39.xml v124>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d56:[<0x20000000cdf/article-39.xml v1319>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:24.979 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.974+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fcb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg auth{0=1} v1321 ap=1 s=24982 n(v0 rc2024-03-27T07:25:37.150809+0000 b24982 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf58100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fcb:[<0x20000000cdf/picture-27.jpg v712>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fcb:[<0x20000000cdf/picture-27.jpg v1321>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.010 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.974+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000d65 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-36.xml auth{0=1} v1315 ap=1 s=28698 n(v0 rc2024-03-27T07:25:34.993851+0000 b28698 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf58c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000d65:[<0x20000000cdf/article-36.xml v142>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000d65:[<0x20000000cdf/article-36.xml v1315>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.010 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.975+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dc8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml auth{0=1} v1341 ap=1 s=7397 n(v0 rc2024-03-27T07:25:35.399843+0000 b7397 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf59180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dc8:[<0x20000000cdf/article-12.xml v286>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000dc8:[<0x20000000cdf/article-12.xml v1341>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.010 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.975+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f53 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-52.jpg auth{0=1} v1333 ap=1 s=52642 n(v0 rc2024-03-27T07:25:36.677818+0000 b52642 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf59700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f53:[<0x20000000cdf/picture-52.jpg v562>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f53:[<0x20000000cdf/picture-52.jpg v1333>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.010 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.976+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000df1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml auth{0=1,1=1} v1019 ap=1 s=3525 n(v0 rc2024-03-27T07:25:35.488842+0000 b3525 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1} mcw={1=Fscr} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c840000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000df1:[<0x20000000cdf/article-1.xml v872>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000df1:[<0x20000000cdf/article-1.xml v1019>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.011 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.977+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000821 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-30.xml auth{0=1} v1347 ap=1 s=7809 n(v0 rc2024-03-27T07:25:48.553584+0000 b7809 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c840580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000821:[<0x20000000cdf/comment-30.xml v1236>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000821:[<0x20000000cdf/comment-30.xml v1347>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.011 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.978+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fa9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg auth{0=1} v1327 ap=1 s=27949 n(v0 rc2024-03-27T07:25:37.018812+0000 b27949 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c840b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fa9:[<0x20000000cdf/picture-34.jpg v670>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fa9:[<0x20000000cdf/picture-34.jpg v1327>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.978+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f4d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-53.jpg auth{0=1} v1335 ap=1 s=65521 n(v0 rc2024-03-27T07:25:36.646819+0000 b65521 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c841080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f4d:[<0x20000000cdf/picture-53.jpg v556>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f4d:[<0x20000000cdf/picture-53.jpg v1335>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.979+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ed2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-67.jpg auth v1325 ap=1 s=20373 n(v0 rc2024-03-27T07:25:36.138829+0000 b20373 1=1+0) | authpin=1 scrubqueue=0 0x55661e1e9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ed2:[<0x20000000cdf/picture-67.jpg v472>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ed2:[<0x20000000cdf/picture-67.jpg v1325>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.981+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000083f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-3.xml auth{0=1} v1358 ap=1 s=10126 n(v0 rc2024-03-27T07:25:49.515566+0000 b10126 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c841600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000083f:[<0x20000000cdf/comment-3.xml v1296>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000083f:[<0x20000000cdf/comment-3.xml v1358>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.982+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000830 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-18.xml auth{0=1} v1354 ap=1 s=4681 n(v0 rc2024-03-27T07:25:49.271570+0000 b4681 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c841b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000830:[<0x20000000cdf/comment-18.xml v1271>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000830:[<0x20000000cdf/comment-18.xml v1354>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.982+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ff7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg auth{0=1} v1323 ap=1 s=25035 n(v0 rc2024-03-27T07:25:37.387804+0000 b25035 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c842100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ff7:[<0x20000000cdf/picture-16.jpg v778>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000ff7:[<0x20000000cdf/picture-16.jpg v1323>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.983+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000836 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-12.xml auth{0=1} v1349 ap=1 s=2353 n(v0 rc2024-03-27T07:25:49.370568+0000 b2353 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c842680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000836:[<0x20000000cdf/comment-12.xml v1291>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000836:[<0x20000000cdf/comment-12.xml v1349>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.984+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e80 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-74.jpg auth v1317 ap=1 s=38751 n(v0 rc2024-03-27T07:25:35.817835+0000 b38751 1=1+0) | authpin=1 scrubqueue=0 0x55661e1e8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e80:[<0x20000000cdf/picture-74.jpg v430>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e80:[<0x20000000cdf/picture-74.jpg v1317>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.984+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-49.xml auth{0=1} v1352 ap=1 s=2671 n(v0 rc2024-03-27T07:25:48.048594+0000 b2671 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c842c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f8:[<0x20000000cdf/comment-49.xml v1189>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007f8:[<0x20000000cdf/comment-49.xml v1352>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.985+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000808 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-42.xml auth{0=1} v1329 ap=1 s=5932 n(v0 rc2024-03-27T07:25:48.231591+0000 b5932 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c843180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000808:[<0x20000000cdf/comment-42.xml v1200>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000808:[<0x20000000cdf/comment-42.xml v1329>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.986+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-65.xml auth{0=1} v1337 ap=1 s=7125 n(v0 rc2024-03-27T07:25:47.592603+0000 b7125 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c843700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cd:[<0x20000000cdf/comment-65.xml v1166>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007cd:[<0x20000000cdf/comment-65.xml v1337>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.986+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c86 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml auth{0=1} v1375 ap=1 s=11300 n(v0 rc2024-03-27T07:26:23.869889+0000 b11300 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc7e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c86:[<0x20000000cdf/article-23.xml v1370>,<0x10000000399/blog-22 v94424>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c86:[<0x20000000cdf/article-23.xml v1375>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.012 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.987+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000db3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml auth{0=1} v1339 ap=1 s=31723 n(v0 rc2024-03-27T07:25:35.360844+0000 b31723 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc7e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000db3:[<0x20000000cdf/article-17.xml v256>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000db3:[<0x20000000cdf/article-17.xml v1339>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.013 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.987+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000e67 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-76.jpg auth v1307 ap=1 s=23518 n(v0 rc2024-03-27T07:25:35.750837+0000 b23518 1=1+0) | authpin=1 scrubqueue=0 0x55661e1e8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000e67:[<0x20000000cdf/picture-76.jpg v418>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000e67:[<0x20000000cdf/picture-76.jpg v1307>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.013 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.988+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000fb3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg auth{0=1} v1313 ap=1 s=64878 n(v0 rc2024-03-27T07:25:37.054811+0000 b64878 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc7eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000fb3:[<0x20000000cdf/picture-32.jpg v682>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000fb3:[<0x20000000cdf/picture-32.jpg v1313>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.013 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.988+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f67 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-48.jpg auth{0=1} v1311 ap=1 s=50162 n(v0 rc2024-03-27T07:25:36.753817+0000 b50162 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc7f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f67:[<0x20000000cdf/picture-48.jpg v586>,<0x10000000399/blog-22 v30839>,<0x10000000208/blogtest_in v368>,<0x10000000201/src v2001>,<0x10000000006/blogbench-1.0 v1761>,<0x10000000005/tmp v41>,<0x100000001fb/client.0 v40>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v54>,<0x10000000001/sv_1 v77>,<0x10000000000/qa v66>,<0x1/volumes v57>]//[]","memoryvalue":"(3)0x20000000f67:[<0x20000000cdf/picture-48.jpg v1311>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.015 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.989+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007f4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-51.xml auth{0=1} v1356 ap=1 s=8330 n(v0 rc2024-03-27T07:25:47.938597+0000 b8330 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc7f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007f4:[<0x20000000cdf/comment-51.xml v1182>,<0x10000000399/blog-22 v50880>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x100000007f4:[<0x20000000cdf/comment-51.xml v1356>,<0x10000000399/blog-22 v133545>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.015 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.990+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002589 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg auth{0=1} v602 ap=1 s=53513 n(v0 rc2024-03-27T07:26:10.936144+0000 b53513 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d24c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002589:[<0x200000024c5/picture-13.jpg v602>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002589:[<0x200000024c5/picture-13.jpg v602>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.015 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.990+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016ee [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-56.xml auth{0=1} v1038 ap=1 s=3472 n(v0 rc2024-03-27T07:27:16.250860+0000 b3472 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d24c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016ee:[<0x200000024c5/comment-56.xml v934>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016ee:[<0x200000024c5/comment-56.xml v1038>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.015 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.991+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000257a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-18.jpg auth{0=1} v622 ap=1 s=16856 n(v0 rc2024-03-27T07:26:10.885145+0000 b16856 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d24cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000257a:[<0x200000024c5/picture-18.jpg v622>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000257a:[<0x200000024c5/picture-18.jpg v622>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.015 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.992+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024dd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-18.xml auth{0=1} v624 ap=1 s=3601 n(v0 rc2024-03-27T07:26:10.407154+0000 b3601 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d24d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024dd:[<0x200000024c5/article-18.xml v624>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024dd:[<0x200000024c5/article-18.xml v624>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.015 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.993+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-5.xml auth{0=1} v1030 ap=1 s=8165 n(v0 rc2024-03-27T07:27:17.812829+0000 b8165 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d24db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d9:[<0x200000024c5/comment-5.xml v1019>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017d9:[<0x200000024c5/comment-5.xml v1030>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.015 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.994+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002577 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-19.jpg auth{0=1} v626 ap=1 s=8573 n(v0 rc2024-03-27T07:26:10.879145+0000 b8573 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d24e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002577:[<0x200000024c5/picture-19.jpg v626>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002577:[<0x200000024c5/picture-19.jpg v626>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.015 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.995+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-29.xml auth{0=1} v1036 ap=1 s=2857 n(v0 rc2024-03-27T07:27:17.084843+0000 b2857 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d24e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177f:[<0x200000024c5/comment-29.xml v975>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000177f:[<0x200000024c5/comment-29.xml v1036>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.015 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.996+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024cb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-27.xml auth{0=1} v660 ap=1 s=27397 n(v0 rc2024-03-27T07:26:10.371155+0000 b27397 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d24ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024cb:[<0x200000024c5/article-27.xml v660>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024cb:[<0x200000024c5/article-27.xml v660>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.015 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.997+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000025a1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg auth{0=1} v566 ap=1 s=25126 n(v0 rc2024-03-27T07:26:11.048141+0000 b25126 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d24f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000025a1:[<0x200000024c5/picture-4.jpg v566>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000025a1:[<0x200000024c5/picture-4.jpg v566>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.998+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002544 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-35.jpg auth v706 ap=1 s=37371 n(v0 rc2024-03-27T07:26:10.724148+0000 b37371 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d24f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002544:[<0x200000024c5/picture-35.jpg v706>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002544:[<0x200000024c5/picture-35.jpg v706>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.999+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000025a5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg auth{0=1} v558 ap=1 s=51329 n(v0 rc2024-03-27T07:26:11.063141+0000 b51329 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce54000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000025a5:[<0x200000024c5/picture-2.jpg v558>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000025a5:[<0x200000024c5/picture-2.jpg v558>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.999+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024d9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-20.xml auth{0=1} v632 ap=1 s=21123 n(v0 rc2024-03-27T07:26:10.399154+0000 b21123 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce54580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024d9:[<0x200000024c5/article-20.xml v632>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024d9:[<0x200000024c5/article-20.xml v632>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:24.999+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002586 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-14.jpg auth{0=1} v606 ap=1 s=24939 n(v0 rc2024-03-27T07:26:10.924144+0000 b24939 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce54b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002586:[<0x200000024c5/picture-14.jpg v606>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002586:[<0x200000024c5/picture-14.jpg v606>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.000+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001406 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-45.xml auth v1040 ap=1 s=20883 n(v0 rc2024-03-27T07:27:09.696988+0000 b20883 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661ce55080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001406:[<0x200000024c5/article-45.xml v921>,<0x10000000399/blog-63 v115225>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000001406:[<0x200000024c5/article-45.xml v1040>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.000+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002500 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-61.jpg auth v720 ap=1 s=23029 n(v0 rc2024-03-27T07:26:10.476153+0000 b23029 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661ce55600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002500:[<0x200000024c5/picture-61.jpg v720>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002500:[<0x200000024c5/picture-61.jpg v720>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.000+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000259b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg auth{0=1} v578 ap=1 s=50703 n(v0 rc2024-03-27T07:26:11.018142+0000 b50703 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce55b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000259b:[<0x200000024c5/picture-7.jpg v578>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000259b:[<0x200000024c5/picture-7.jpg v578>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.000+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002595 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg auth{0=1} v586 ap=1 s=33521 n(v0 rc2024-03-27T07:26:10.994142+0000 b33521 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce56100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002595:[<0x200000024c5/picture-9.jpg v586>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002595:[<0x200000024c5/picture-9.jpg v586>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.001+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-11.xml auth{0=1} v1032 ap=1 s=4161 n(v0 rc2024-03-27T07:27:17.692831+0000 b4161 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce56c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c6:[<0x200000024c5/comment-11.xml v999>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017c6:[<0x200000024c5/comment-11.xml v1032>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.001+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001798 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-20.xml auth{0=1} v1034 ap=1 s=2867 n(v0 rc2024-03-27T07:27:17.292839+0000 b2867 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce57700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001798:[<0x200000024c5/comment-20.xml v996>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001798:[<0x200000024c5/comment-20.xml v1034>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.001+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000175d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-37.xml auth{0=1} v1034 ap=1 s=2962 n(v0 rc2024-03-27T07:27:16.987845+0000 b2962 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc7fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000175d:[<0x200000024c5/comment-37.xml v957>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000175d:[<0x200000024c5/comment-37.xml v1034>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.016 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.001+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002592 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg auth{0=1} v590 ap=1 s=64158 n(v0 rc2024-03-27T07:26:10.981143+0000 b64158 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc80100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002592:[<0x200000024c5/picture-10.jpg v590>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002592:[<0x200000024c5/picture-10.jpg v590>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.017 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.002+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000025a7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg auth{0=1} v554 ap=1 s=26882 n(v0 rc2024-03-27T07:26:11.073141+0000 b26882 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc80680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000025a7:[<0x200000024c5/picture-1.jpg v554>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000025a7:[<0x200000024c5/picture-1.jpg v554>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.017 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.002+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ac [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-16.xml auth{0=1} v1024 ap=1 s=2671 n(v0 rc2024-03-27T07:27:17.454836+0000 b2671 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc81180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ac:[<0x200000024c5/comment-16.xml v1011>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017ac:[<0x200000024c5/comment-16.xml v1024>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.017 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.002+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024ec [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-9.xml auth{0=1} v588 ap=1 s=17837 n(v0 rc2024-03-27T07:26:10.437153+0000 b17837 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dc81700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024ec:[<0x200000024c5/article-9.xml v588>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024ec:[<0x200000024c5/article-9.xml v588>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.017 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.002+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000259d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg auth{0=1} v574 ap=1 s=64526 n(v0 rc2024-03-27T07:26:11.031142+0000 b64526 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b855180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000259d:[<0x200000024c5/picture-6.jpg v574>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000259d:[<0x200000024c5/picture-6.jpg v574>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.017 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.003+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016de [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-58.xml auth{0=1} v1040 ap=1 s=8382 n(v0 rc2024-03-27T07:27:16.208860+0000 b8382 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b1ac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016de:[<0x200000024c5/comment-58.xml v931>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016de:[<0x200000024c5/comment-58.xml v1040>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.017 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.003+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016f7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-55.xml auth{0=1} v1038 ap=1 s=6814 n(v0 rc2024-03-27T07:27:16.284859+0000 b6814 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a183080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016f7:[<0x200000024c5/comment-55.xml v937>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016f7:[<0x200000024c5/comment-55.xml v1038>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.017 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.004+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024d1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-24.xml auth{0=1} v648 ap=1 s=18516 n(v0 rc2024-03-27T07:26:10.384154+0000 b18516 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b196100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024d1:[<0x200000024c5/article-24.xml v648>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024d1:[<0x200000024c5/article-24.xml v648>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.017 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.004+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001768 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-34.xml auth{0=1} v1032 ap=1 s=3405 n(v0 rc2024-03-27T07:27:17.032844+0000 b3405 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfcdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001768:[<0x200000024c5/comment-34.xml v965>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001768:[<0x200000024c5/comment-34.xml v1032>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.017 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.004+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-25.xml auth{0=1} v1030 ap=1 s=6954 n(v0 rc2024-03-27T07:27:17.128842+0000 b6954 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfcd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178f:[<0x200000024c5/comment-25.xml v979>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000178f:[<0x200000024c5/comment-25.xml v1030>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.017 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.004+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001401 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-28.jpg auth{0=1} v920 ap=1 s=39741 n(v0 rc2024-03-27T07:27:09.661989+0000 b39741 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b189700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001401:[<0x200000024c5/picture-28.jpg v920>,<0x10000000399/blog-63 v115225>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000001401:[<0x200000024c5/picture-28.jpg v920>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.019 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.005+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001745 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-41.xml auth{0=1} v1036 ap=1 s=6750 n(v0 rc2024-03-27T07:27:16.855848+0000 b6750 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b187080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001745:[<0x200000024c5/comment-41.xml v951>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001745:[<0x200000024c5/comment-41.xml v1036>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.019 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.005+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000253e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-37.jpg auth v732 ap=1 s=16864 n(v0 rc2024-03-27T07:26:10.702148+0000 b16864 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b183700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000253e:[<0x200000024c5/picture-37.jpg v732>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000253e:[<0x200000024c5/picture-37.jpg v732>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.019 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.005+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024f6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml auth{0=1} v564 ap=1 s=2581 n(v0 rc2024-03-27T07:26:10.456153+0000 b2581 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b163700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024f6:[<0x200000024c5/article-3.xml v564>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024f6:[<0x200000024c5/article-3.xml v564>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.006+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000257d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-17.jpg auth{0=1} v618 ap=1 s=31079 n(v0 rc2024-03-27T07:26:10.892144+0000 b31079 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b181080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000257d:[<0x200000024c5/picture-17.jpg v618>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000257d:[<0x200000024c5/picture-17.jpg v618>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.006+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002508 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-57.jpg auth v714 ap=1 s=24893 n(v0 rc2024-03-27T07:26:10.492152+0000 b24893 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b29e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002508:[<0x200000024c5/picture-57.jpg v714>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002508:[<0x200000024c5/picture-57.jpg v714>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.006+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002566 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-24.jpg auth{0=1} v646 ap=1 s=43917 n(v0 rc2024-03-27T07:26:10.841145+0000 b43917 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d369700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002566:[<0x200000024c5/picture-24.jpg v646>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002566:[<0x200000024c5/picture-24.jpg v646>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.006+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000254a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-33.jpg auth v730 ap=1 s=11683 n(v0 rc2024-03-27T07:26:10.747147+0000 b11683 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b776000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000254a:[<0x200000024c5/picture-33.jpg v730>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000254a:[<0x200000024c5/picture-33.jpg v730>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.006+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024ee [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml auth{0=1} v580 ap=1 s=13093 n(v0 rc2024-03-27T07:26:10.441153+0000 b13093 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619ce2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024ee:[<0x200000024c5/article-7.xml v580>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024ee:[<0x200000024c5/article-7.xml v580>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.007+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000252f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-42.jpg auth v736 ap=1 s=52329 n(v0 rc2024-03-27T07:26:10.639149+0000 b52329 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556619685180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000252f:[<0x200000024c5/picture-42.jpg v736>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000252f:[<0x200000024c5/picture-42.jpg v736>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.007+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002538 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-39.jpg auth v704 ap=1 s=22878 n(v0 rc2024-03-27T07:26:10.678149+0000 b22878 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661dfcc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002538:[<0x200000024c5/picture-39.jpg v704>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002538:[<0x200000024c5/picture-39.jpg v704>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.007+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001795 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-23.xml auth{0=1} v1026 ap=1 s=4514 n(v0 rc2024-03-27T07:27:17.165842+0000 b4514 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c122c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001795:[<0x200000024c5/comment-23.xml v988>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001795:[<0x200000024c5/comment-23.xml v1026>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.008+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001792 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-24.xml auth{0=1} v1028 ap=1 s=4863 n(v0 rc2024-03-27T07:27:17.145842+0000 b4863 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d31c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001792:[<0x200000024c5/comment-24.xml v983>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001792:[<0x200000024c5/comment-24.xml v1028>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.008+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024ed [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml auth{0=1} v584 ap=1 s=11785 n(v0 rc2024-03-27T07:26:10.439153+0000 b11785 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024ed:[<0x200000024c5/article-8.xml v584>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024ed:[<0x200000024c5/article-8.xml v584>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.009+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002563 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-25.jpg auth{0=1} v650 ap=1 s=17714 n(v0 rc2024-03-27T07:26:10.834146+0000 b17714 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002563:[<0x200000024c5/picture-25.jpg v650>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002563:[<0x200000024c5/picture-25.jpg v650>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.020 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.009+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001723 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-47.xml auth{0=1} v1034 ap=1 s=5558 n(v0 rc2024-03-27T07:27:16.663852+0000 b5558 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001723:[<0x200000024c5/comment-47.xml v939>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001723:[<0x200000024c5/comment-47.xml v1034>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.010+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001728 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-46.xml auth{0=1} v1032 ap=1 s=7269 n(v0 rc2024-03-27T07:27:16.687851+0000 b7269 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001728:[<0x200000024c5/comment-46.xml v941>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001728:[<0x200000024c5/comment-46.xml v1032>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.010+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002550 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-31.jpg auth v734 ap=1 s=45609 n(v0 rc2024-03-27T07:26:10.774147+0000 b45609 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b5a7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002550:[<0x200000024c5/picture-31.jpg v734>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002550:[<0x200000024c5/picture-31.jpg v734>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.011+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000251a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-49.jpg auth v696 ap=1 s=46981 n(v0 rc2024-03-27T07:26:10.539151+0000 b46981 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b05c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000251a:[<0x200000024c5/picture-49.jpg v696>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000251a:[<0x200000024c5/picture-49.jpg v696>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.011+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002598 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg auth{0=1} v582 ap=1 s=64948 n(v0 rc2024-03-27T07:26:11.007142+0000 b64948 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b05c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002598:[<0x200000024c5/picture-8.jpg v582>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002598:[<0x200000024c5/picture-8.jpg v582>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.011+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002560 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-26.jpg auth{0=1} v654 ap=1 s=22415 n(v0 rc2024-03-27T07:26:10.827146+0000 b22415 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b05cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002560:[<0x200000024c5/picture-26.jpg v654>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002560:[<0x200000024c5/picture-26.jpg v654>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.012+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024d7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-21.xml auth{0=1} v636 ap=1 s=25038 n(v0 rc2024-03-27T07:26:10.396154+0000 b25038 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b05d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024d7:[<0x200000024c5/article-21.xml v636>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024d7:[<0x200000024c5/article-21.xml v636>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.012+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001761 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-36.xml auth{0=1} v1030 ap=1 s=2645 n(v0 rc2024-03-27T07:27:17.007845+0000 b2645 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b05d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001761:[<0x200000024c5/comment-36.xml v960>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001761:[<0x200000024c5/comment-36.xml v1030>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.012+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024e7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-13.xml auth{0=1} v604 ap=1 s=12586 n(v0 rc2024-03-27T07:26:10.426154+0000 b12586 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b05db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024e7:[<0x200000024c5/article-13.xml v604>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024e7:[<0x200000024c5/article-13.xml v604>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.012+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017dd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-4.xml auth{0=1} v1024 ap=1 s=7450 n(v0 rc2024-03-27T07:27:17.842828+0000 b7450 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b05e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017dd:[<0x200000024c5/comment-4.xml v1019>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017dd:[<0x200000024c5/comment-4.xml v1024>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.013+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024f0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml auth{0=1} v576 ap=1 s=19135 n(v0 rc2024-03-27T07:26:10.445153+0000 b19135 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b05ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024f0:[<0x200000024c5/article-6.xml v576>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024f0:[<0x200000024c5/article-6.xml v576>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.013+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024f8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml auth{0=1} v560 ap=1 s=16023 n(v0 rc2024-03-27T07:26:10.460153+0000 b16023 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b05f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024f8:[<0x200000024c5/article-2.xml v560>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024f8:[<0x200000024c5/article-2.xml v560>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.021 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.013+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-14.xml auth{0=1} v1026 ap=1 s=4154 n(v0 rc2024-03-27T07:27:17.537834+0000 b4154 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661aa32000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b6:[<0x200000024c5/comment-14.xml v1003>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017b6:[<0x200000024c5/comment-14.xml v1026>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.022 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.014+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000250e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-54.jpg auth v682 ap=1 s=42721 n(v0 rc2024-03-27T07:26:10.504152+0000 b42721 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661aa32580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000250e:[<0x200000024c5/picture-54.jpg v682>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000250e:[<0x200000024c5/picture-54.jpg v682>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.022 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.014+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002557 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-29.jpg auth{0=1} v666 ap=1 s=9982 n(v0 rc2024-03-27T07:26:10.803146+0000 b9982 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661aa32b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002557:[<0x200000024c5/picture-29.jpg v666>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002557:[<0x200000024c5/picture-29.jpg v666>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.022 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.014+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000179b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-19.xml auth{0=1} v1028 ap=1 s=4927 n(v0 rc2024-03-27T07:27:17.336838+0000 b4927 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661aa33600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000179b:[<0x200000024c5/comment-19.xml v1000>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000179b:[<0x200000024c5/comment-19.xml v1028>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.022 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.015+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001796 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-22.xml auth{0=1} v1038 ap=1 s=3734 n(v0 rc2024-03-27T07:27:17.190841+0000 b3734 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dff7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001796:[<0x200000024c5/comment-22.xml v987>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001796:[<0x200000024c5/comment-22.xml v1038>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.022 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.015+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-2.xml auth{0=1} v1025 ap=1 s=7270 n(v0 rc2024-03-27T07:27:17.934827+0000 b7270 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d126000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e5:[<0x200000024c5/comment-2.xml v1025>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017e5:[<0x200000024c5/comment-2.xml v1025>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.022 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.016+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001732 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-44.xml auth{0=1} v1044 ap=1 s=4283 n(v0 rc2024-03-27T07:27:16.734850+0000 b4283 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d126580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001732:[<0x200000024c5/comment-44.xml v947>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001732:[<0x200000024c5/comment-44.xml v1044>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.234 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.016+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000259f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg auth{0=1} v570 ap=1 s=30536 n(v0 rc2024-03-27T07:26:11.039142+0000 b30536 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d126b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000259f:[<0x200000024c5/picture-5.jpg v570>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000259f:[<0x200000024c5/picture-5.jpg v570>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.234 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.016+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001787 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-27.xml auth{0=1} v1040 ap=1 s=6580 n(v0 rc2024-03-27T07:27:17.105843+0000 b6580 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d127600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001787:[<0x200000024c5/comment-27.xml v973>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001787:[<0x200000024c5/comment-27.xml v1040>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.234 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.016+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002517 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-50.jpg auth v702 ap=1 s=9159 n(v0 rc2024-03-27T07:26:10.525152+0000 b9159 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d127b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002517:[<0x200000024c5/picture-50.jpg v702>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002517:[<0x200000024c5/picture-50.jpg v702>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.235 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.017+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002506 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-58.jpg auth v724 ap=1 s=46806 n(v0 rc2024-03-27T07:26:10.488152+0000 b46806 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d128100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002506:[<0x200000024c5/picture-58.jpg v724>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002506:[<0x200000024c5/picture-58.jpg v724>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.235 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.017+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000170a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-52.xml auth{0=1} v1048 ap=1 s=2246 n(v0 rc2024-03-27T07:27:16.425856+0000 b2246 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d128680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000170a:[<0x200000024c5/comment-52.xml v943>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000170a:[<0x200000024c5/comment-52.xml v1048>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.235 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.018+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-7.xml auth{0=1} v1030 ap=1 s=3872 n(v0 rc2024-03-27T07:27:17.774830+0000 b3872 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d129180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d3:[<0x200000024c5/comment-7.xml v1015>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017d3:[<0x200000024c5/comment-7.xml v1030>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.235 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.018+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017b1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-15.xml auth{0=1} v1034 ap=1 s=2292 n(v0 rc2024-03-27T07:27:17.492835+0000 b2292 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b994000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017b1:[<0x200000024c5/comment-15.xml v999>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017b1:[<0x200000024c5/comment-15.xml v1034>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.235 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.020+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001736 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-43.xml auth{0=1} v1042 ap=1 s=6695 n(v0 rc2024-03-27T07:27:16.769849+0000 b6695 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b994580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001736:[<0x200000024c5/comment-43.xml v949>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001736:[<0x200000024c5/comment-43.xml v1042>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.235 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.020+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-17.xml auth{0=1} v1036 ap=1 s=6295 n(v0 rc2024-03-27T07:27:17.431836+0000 b6295 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b995080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a7:[<0x200000024c5/comment-17.xml v996>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017a7:[<0x200000024c5/comment-17.xml v1036>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.237 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.020+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024c9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-28.xml auth{0=1} v664 ap=1 s=28415 n(v0 rc2024-03-27T07:26:10.367155+0000 b28415 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b995600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024c9:[<0x200000024c5/article-28.xml v664>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024c9:[<0x200000024c5/article-28.xml v664>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.237 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.022+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017cb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-9.xml auth{0=1} v1032 ap=1 s=8553 n(v0 rc2024-03-27T07:27:17.723831+0000 b8553 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b996100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017cb:[<0x200000024c5/comment-9.xml v1006>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017cb:[<0x200000024c5/comment-9.xml v1032>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.237 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.023+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002514 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-51.jpg auth v686 ap=1 s=17086 n(v0 rc2024-03-27T07:26:10.517152+0000 b17086 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b996680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002514:[<0x200000024c5/picture-51.jpg v686>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002514:[<0x200000024c5/picture-51.jpg v686>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.237 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.024+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000172d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-45.xml auth{0=1} v1046 ap=1 s=6984 n(v0 rc2024-03-27T07:27:16.714851+0000 b6984 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b996c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000172d:[<0x200000024c5/comment-45.xml v945>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000172d:[<0x200000024c5/comment-45.xml v1046>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.237 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.025+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024fe [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-62.jpg auth v694 ap=1 s=59625 n(v0 rc2024-03-27T07:26:10.472153+0000 b59625 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b997180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024fe:[<0x200000024c5/picture-62.jpg v694>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024fe:[<0x200000024c5/picture-62.jpg v694>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.237 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.026+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002523 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-46.jpg auth v688 ap=1 s=26415 n(v0 rc2024-03-27T07:26:10.574151+0000 b26415 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b997700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002523:[<0x200000024c5/picture-46.jpg v688>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002523:[<0x200000024c5/picture-46.jpg v688>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.237 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.026+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-10.xml auth{0=1} v1017 ap=1 s=3288 n(v0 rc2024-03-27T07:27:17.705831+0000 b3288 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a040c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c9:[<0x200000024c5/comment-10.xml v994>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017c9:[<0x200000024c5/comment-10.xml v1017>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.237 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.026+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000025a3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg auth{0=1} v562 ap=1 s=14579 n(v0 rc2024-03-27T07:26:11.055141+0000 b14579 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a041180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000025a3:[<0x200000024c5/picture-3.jpg v562>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000025a3:[<0x200000024c5/picture-3.jpg v562>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.237 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.027+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001704 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-53.xml auth{0=1} v1025 ap=1 s=6471 n(v0 rc2024-03-27T07:27:16.364857+0000 b6471 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a041700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001704:[<0x200000024c5/comment-53.xml v940>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001704:[<0x200000024c5/comment-53.xml v1025>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.237 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.028+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017d6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-6.xml auth{0=1} v1013 ap=1 s=3304 n(v0 rc2024-03-27T07:27:17.791829+0000 b3304 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661902e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017d6:[<0x200000024c5/comment-6.xml v1008>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017d6:[<0x200000024c5/comment-6.xml v1013>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.028+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000250c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-55.jpg auth v700 ap=1 s=62268 n(v0 rc2024-03-27T07:26:10.500152+0000 b62268 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661902eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000250c:[<0x200000024c5/picture-55.jpg v700>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000250c:[<0x200000024c5/picture-55.jpg v700>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.029+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000258f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg auth{0=1} v594 ap=1 s=46391 n(v0 rc2024-03-27T07:26:10.969143+0000 b46391 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661902f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000258f:[<0x200000024c5/picture-11.jpg v594>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000258f:[<0x200000024c5/picture-11.jpg v594>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.029+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024f2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml auth{0=1} v572 ap=1 s=5897 n(v0 rc2024-03-27T07:26:10.449153+0000 b5897 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661902f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024f2:[<0x200000024c5/article-5.xml v572>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024f2:[<0x200000024c5/article-5.xml v572>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.030+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001765 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-35.xml auth{0=1} v1021 ap=1 s=4158 n(v0 rc2024-03-27T07:27:17.020845+0000 b4158 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661902fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001765:[<0x200000024c5/comment-35.xml v960>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001765:[<0x200000024c5/comment-35.xml v1021>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.030+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001783 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-28.xml auth{0=1} v1019 ap=1 s=5555 n(v0 rc2024-03-27T07:27:17.097843+0000 b5555 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619030100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001783:[<0x200000024c5/comment-28.xml v968>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001783:[<0x200000024c5/comment-28.xml v1019>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.031+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016e6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-57.xml auth{0=1} v1027 ap=1 s=3231 n(v0 rc2024-03-27T07:27:16.228860+0000 b3231 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619030680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016e6:[<0x200000024c5/comment-57.xml v929>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016e6:[<0x200000024c5/comment-57.xml v1027>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.031+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024c7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-29.xml auth{0=1} v668 ap=1 s=10030 n(v0 rc2024-03-27T07:26:10.363155+0000 b10030 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619030c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024c7:[<0x200000024c5/article-29.xml v668>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024c7:[<0x200000024c5/article-29.xml v668>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.032+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024fc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-63.jpg auth v718 ap=1 s=58979 n(v0 rc2024-03-27T07:26:10.468153+0000 b58979 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556619031180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024fc:[<0x200000024c5/picture-63.jpg v718>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024fc:[<0x200000024c5/picture-63.jpg v718>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.033+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002535 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-40.jpg auth v684 ap=1 s=55917 n(v0 rc2024-03-27T07:26:10.663149+0000 b55917 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556619031700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002535:[<0x200000024c5/picture-40.jpg v684>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002535:[<0x200000024c5/picture-40.jpg v684>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.033+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016c9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-61.xml auth{0=1} v1029 ap=1 s=4473 n(v0 rc2024-03-27T07:27:16.144862+0000 b4473 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016c9:[<0x200000024c5/comment-61.xml v927>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016c9:[<0x200000024c5/comment-61.xml v1029>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.034+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024d5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-22.xml auth{0=1} v640 ap=1 s=19740 n(v0 rc2024-03-27T07:26:10.392154+0000 b19740 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024d5:[<0x200000024c5/article-22.xml v640>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024d5:[<0x200000024c5/article-22.xml v640>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.238 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.035+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001757 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-38.xml auth{0=1} v1023 ap=1 s=8796 n(v0 rc2024-03-27T07:27:16.965846+0000 b8796 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001757:[<0x200000024c5/comment-38.xml v954>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001757:[<0x200000024c5/comment-38.xml v1023>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.239 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.036+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017cd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-8.xml auth{0=1} v1015 ap=1 s=5740 n(v0 rc2024-03-27T07:27:17.762830+0000 b5740 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017cd:[<0x200000024c5/comment-8.xml v1003>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017cd:[<0x200000024c5/comment-8.xml v1015>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.239 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.037+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002569 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-23.jpg auth{0=1} v642 ap=1 s=63790 n(v0 rc2024-03-27T07:26:10.847145+0000 b63790 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619fd5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002569:[<0x200000024c5/picture-23.jpg v642>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002569:[<0x200000024c5/picture-23.jpg v642>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.239 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.037+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024e5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-14.xml auth{0=1} v608 ap=1 s=21342 n(v0 rc2024-03-27T07:26:10.422154+0000 b21342 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df04000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024e5:[<0x200000024c5/article-14.xml v608>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024e5:[<0x200000024c5/article-14.xml v608>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.239 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.038+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002526 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-45.jpg auth v716 ap=1 s=65045 n(v0 rc2024-03-27T07:26:10.585151+0000 b65045 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661df04580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002526:[<0x200000024c5/picture-45.jpg v716>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002526:[<0x200000024c5/picture-45.jpg v716>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.239 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.039+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002532 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-41.jpg auth v728 ap=1 s=59469 n(v0 rc2024-03-27T07:26:10.650149+0000 b59469 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661df04b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002532:[<0x200000024c5/picture-41.jpg v728>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002532:[<0x200000024c5/picture-41.jpg v728>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.239 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.039+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016c2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-62.xml auth{0=1} v993 ap=1 s=3414 n(v0 rc2024-03-27T07:27:16.093863+0000 b3414 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df05080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016c2:[<0x200000024c5/comment-62.xml v926>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016c2:[<0x200000024c5/comment-62.xml v993>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.239 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.040+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002502 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-60.jpg auth v672 ap=1 s=51340 n(v0 rc2024-03-27T07:26:10.480153+0000 b51340 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661df05600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002502:[<0x200000024c5/picture-60.jpg v672>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002502:[<0x200000024c5/picture-60.jpg v672>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.239 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.041+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000256c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-22.jpg auth{0=1} v638 ap=1 s=50833 n(v0 rc2024-03-27T07:26:10.854145+0000 b50833 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df05b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000256c:[<0x200000024c5/picture-22.jpg v638>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000256c:[<0x200000024c5/picture-22.jpg v638>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.242 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.042+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024ea [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-11.xml auth{0=1} v596 ap=1 s=16505 n(v0 rc2024-03-27T07:26:10.433154+0000 b16505 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df06100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024ea:[<0x200000024c5/article-11.xml v596>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024ea:[<0x200000024c5/article-11.xml v596>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.242 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.043+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016d8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-59.xml auth{0=1} v991 ap=1 s=4785 n(v0 rc2024-03-27T07:27:16.191861+0000 b4785 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df06680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016d8:[<0x200000024c5/comment-59.xml v930>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016d8:[<0x200000024c5/comment-59.xml v991>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.242 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.043+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024e1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-16.xml auth{0=1} v616 ap=1 s=29993 n(v0 rc2024-03-27T07:26:10.415154+0000 b29993 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df06c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024e1:[<0x200000024c5/article-16.xml v616>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024e1:[<0x200000024c5/article-16.xml v616>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.242 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.044+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024cd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-26.xml auth{0=1} v656 ap=1 s=19627 n(v0 rc2024-03-27T07:26:10.375155+0000 b19627 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df07180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024cd:[<0x200000024c5/article-26.xml v656>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024cd:[<0x200000024c5/article-26.xml v656>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.242 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.044+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002583 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-15.jpg auth{0=1} v610 ap=1 s=13287 n(v0 rc2024-03-27T07:26:10.911144+0000 b13287 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df07700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002583:[<0x200000024c5/picture-15.jpg v610>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002583:[<0x200000024c5/picture-15.jpg v610>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.242 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.045+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000250a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-56.jpg auth v678 ap=1 s=35555 n(v0 rc2024-03-27T07:26:10.496152+0000 b35555 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d60e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000250a:[<0x200000024c5/picture-56.jpg v678>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000250a:[<0x200000024c5/picture-56.jpg v678>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.242 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.045+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002520 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-47.jpg auth v708 ap=1 s=64595 n(v0 rc2024-03-27T07:26:10.562151+0000 b64595 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d60e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002520:[<0x200000024c5/picture-47.jpg v708>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002520:[<0x200000024c5/picture-47.jpg v708>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.046+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024eb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-10.xml auth{0=1} v592 ap=1 s=10049 n(v0 rc2024-03-27T07:26:10.435153+0000 b10049 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d60eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024eb:[<0x200000024c5/article-10.xml v592>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024eb:[<0x200000024c5/article-10.xml v592>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.047+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000258c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg auth{0=1} v598 ap=1 s=16852 n(v0 rc2024-03-27T07:26:10.952143+0000 b16852 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d60f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000258c:[<0x200000024c5/picture-12.jpg v598>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000258c:[<0x200000024c5/picture-12.jpg v598>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.047+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002529 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-44.jpg auth v690 ap=1 s=17580 n(v0 rc2024-03-27T07:26:10.609150+0000 b17580 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d60f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002529:[<0x200000024c5/picture-44.jpg v690>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002529:[<0x200000024c5/picture-44.jpg v690>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.048+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001715 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-50.xml auth{0=1} v989 ap=1 s=7885 n(v0 rc2024-03-27T07:27:16.510855+0000 b7885 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d60fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001715:[<0x200000024c5/comment-50.xml v935>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001715:[<0x200000024c5/comment-50.xml v989>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.048+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000171e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-48.xml auth{0=1} v987 ap=1 s=5134 n(v0 rc2024-03-27T07:27:16.617852+0000 b5134 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d610100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000171e:[<0x200000024c5/comment-48.xml v937>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000171e:[<0x200000024c5/comment-48.xml v987>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.049+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024f4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml auth{0=1} v568 ap=1 s=29343 n(v0 rc2024-03-27T07:26:10.453153+0000 b29343 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d610680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024f4:[<0x200000024c5/article-4.xml v568>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024f4:[<0x200000024c5/article-4.xml v568>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.050+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024cf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-25.xml auth{0=1} v652 ap=1 s=25038 n(v0 rc2024-03-27T07:26:10.380155+0000 b25038 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d610c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024cf:[<0x200000024c5/article-25.xml v652>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024cf:[<0x200000024c5/article-25.xml v652>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.050+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002504 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-59.jpg auth v698 ap=1 s=63540 n(v0 rc2024-03-27T07:26:10.484152+0000 b63540 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661d611180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002504:[<0x200000024c5/picture-59.jpg v698>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002504:[<0x200000024c5/picture-59.jpg v698>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.051+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001776 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-31.xml auth{0=1} v985 ap=1 s=8272 n(v0 rc2024-03-27T07:27:17.062844+0000 b8272 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d611700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001776:[<0x200000024c5/comment-31.xml v969>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001776:[<0x200000024c5/comment-31.xml v985>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.051+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002570 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-21.jpg auth{0=1} v634 ap=1 s=40891 n(v0 rc2024-03-27T07:26:10.862145+0000 b40891 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d70ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002570:[<0x200000024c5/picture-21.jpg v634>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002570:[<0x200000024c5/picture-21.jpg v634>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.052+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016d0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-60.xml auth{0=1} v1047 ap=1 s=9945 n(v0 rc2024-03-27T07:27:16.170861+0000 b9945 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d70b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016d0:[<0x200000024c5/comment-60.xml v928>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016d0:[<0x200000024c5/comment-60.xml v1047>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.243 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.052+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017ea [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-1.xml auth{0=1} v1035 ap=1 s=9757 n(v0 rc2024-03-27T07:27:18.019825+0000 b9757 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cad8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017ea:[<0x200000024c5/comment-1.xml v1030>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017ea:[<0x200000024c5/comment-1.xml v1035>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.244 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.053+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002554 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-30.jpg auth{0=1} v670 ap=1 s=45532 n(v0 rc2024-03-27T07:26:10.789146+0000 b45532 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cad8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002554:[<0x200000024c5/picture-30.jpg v670>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002554:[<0x200000024c5/picture-30.jpg v670>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.244 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.053+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024e3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-15.xml auth{0=1} v612 ap=1 s=9875 n(v0 rc2024-03-27T07:26:10.418154+0000 b9875 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cad8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024e3:[<0x200000024c5/article-15.xml v612>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024e3:[<0x200000024c5/article-15.xml v612>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.244 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.054+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000174b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-40.xml auth{0=1} v1043 ap=1 s=8153 n(v0 rc2024-03-27T07:27:16.898847+0000 b8153 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cad9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000174b:[<0x200000024c5/comment-40.xml v952>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000174b:[<0x200000024c5/comment-40.xml v1043>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.244 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.054+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000176d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-33.xml auth{0=1} v1039 ap=1 s=5812 n(v0 rc2024-03-27T07:27:17.041844+0000 b5812 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cad9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000176d:[<0x200000024c5/comment-33.xml v964>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000176d:[<0x200000024c5/comment-33.xml v1039>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.244 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.055+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001751 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-39.xml auth{0=1} v1041 ap=1 s=8506 n(v0 rc2024-03-27T07:27:16.926846+0000 b8506 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cad9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001751:[<0x200000024c5/comment-39.xml v956>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001751:[<0x200000024c5/comment-39.xml v1041>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.244 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.055+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002541 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-36.jpg auth v726 ap=1 s=28707 n(v0 rc2024-03-27T07:26:10.713148+0000 b28707 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661cada100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002541:[<0x200000024c5/picture-36.jpg v726>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002541:[<0x200000024c5/picture-36.jpg v726>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.244 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.057+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000252c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-43.jpg auth v676 ap=1 s=11985 n(v0 rc2024-03-27T07:26:10.626150+0000 b11985 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661cada680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000252c:[<0x200000024c5/picture-43.jpg v676>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000252c:[<0x200000024c5/picture-43.jpg v676>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.244 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.057+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024db [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-19.xml auth{0=1} v628 ap=1 s=4581 n(v0 rc2024-03-27T07:26:10.403154+0000 b4581 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cadac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024db:[<0x200000024c5/article-19.xml v628>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024db:[<0x200000024c5/article-19.xml v628>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.244 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.058+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002574 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-20.jpg auth{0=1} v630 ap=1 s=34873 n(v0 rc2024-03-27T07:26:10.870145+0000 b34873 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cadb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002574:[<0x200000024c5/picture-20.jpg v630>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002574:[<0x200000024c5/picture-20.jpg v630>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.244 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.059+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001771 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-32.xml auth{0=1} v1037 ap=1 s=4445 n(v0 rc2024-03-27T07:27:17.054844+0000 b4445 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cadb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001771:[<0x200000024c5/comment-32.xml v966>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001771:[<0x200000024c5/comment-32.xml v1037>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.059+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016fe [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-54.xml auth{0=1} v1045 ap=1 s=8046 n(v0 rc2024-03-27T07:27:16.315858+0000 b8046 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c500000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016fe:[<0x200000024c5/comment-54.xml v932>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000016fe:[<0x200000024c5/comment-54.xml v1045>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.060+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000253b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-38.jpg auth v674 ap=1 s=45713 n(v0 rc2024-03-27T07:26:10.689148+0000 b45713 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c500580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000253b:[<0x200000024c5/picture-38.jpg v674>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000253b:[<0x200000024c5/picture-38.jpg v674>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.111+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017bb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-13.xml auth{0=1} v1039 ap=1 s=6755 n(v0 rc2024-03-27T07:27:17.605833+0000 b6755 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df7e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017bb:[<0x200000024c5/comment-13.xml v1018>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017bb:[<0x200000024c5/comment-13.xml v1039>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.112+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001797 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-21.xml auth{0=1} v1043 ap=1 s=9174 n(v0 rc2024-03-27T07:27:17.253840+0000 b9174 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df7f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001797:[<0x200000024c5/comment-21.xml v992>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001797:[<0x200000024c5/comment-21.xml v1043>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.112+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000178c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-26.xml auth{0=1} v1045 ap=1 s=8468 n(v0 rc2024-03-27T07:27:17.116843+0000 b8468 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661865e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000178c:[<0x200000024c5/comment-26.xml v978>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000178c:[<0x200000024c5/comment-26.xml v1045>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.112+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000255d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-27.jpg auth{0=1} v658 ap=1 s=21012 n(v0 rc2024-03-27T07:26:10.820146+0000 b21012 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661865e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000255d:[<0x200000024c5/picture-27.jpg v658>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000255d:[<0x200000024c5/picture-27.jpg v658>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.113+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024e9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-12.xml auth{0=1} v600 ap=1 s=8012 n(v0 rc2024-03-27T07:26:10.430154+0000 b8012 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661865eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024e9:[<0x200000024c5/article-12.xml v600>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024e9:[<0x200000024c5/article-12.xml v600>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.113+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002512 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-52.jpg auth v712 ap=1 s=41188 n(v0 rc2024-03-27T07:26:10.512152+0000 b41188 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661865f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002512:[<0x200000024c5/picture-52.jpg v712>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002512:[<0x200000024c5/picture-52.jpg v712>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.113+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000177a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-30.xml auth{0=1} v1047 ap=1 s=2691 n(v0 rc2024-03-27T07:27:17.072843+0000 b2691 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661865fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000177a:[<0x200000024c5/comment-30.xml v972>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000177a:[<0x200000024c5/comment-30.xml v1047>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.113+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024fa [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml auth{0=1} v556 ap=1 s=16899 n(v0 rc2024-03-27T07:26:10.464153+0000 b16899 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661865f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024fa:[<0x200000024c5/article-1.xml v556>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024fa:[<0x200000024c5/article-1.xml v556>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.245 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.114+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002547 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-34.jpg auth v680 ap=1 s=46479 n(v0 rc2024-03-27T07:26:10.735148+0000 b46479 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556618660100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002547:[<0x200000024c5/picture-34.jpg v680>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002547:[<0x200000024c5/picture-34.jpg v680>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.114+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002510 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-53.jpg auth v692 ap=1 s=52016 n(v0 rc2024-03-27T07:26:10.508152+0000 b52016 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556618660680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002510:[<0x200000024c5/picture-53.jpg v692>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002510:[<0x200000024c5/picture-53.jpg v692>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.114+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017e0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-3.xml auth{0=1} v1035 ap=1 s=8963 n(v0 rc2024-03-27T07:27:17.874828+0000 b8963 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556618661180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017e0:[<0x200000024c5/comment-3.xml v1026>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017e0:[<0x200000024c5/comment-3.xml v1035>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.115+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfe [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-77.xml auth v908 ap=1 s=31998 n(v0 rc2024-03-27T07:26:42.116529+0000 b31998 1=1+0) | authpin=1 scrubqueue=0 0x55661e1ea100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfe:[<0x200000024c5/article-77.xml v908>,<0x10000000399/blog-63 v113431>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000cfe:[<0x200000024c5/article-77.xml v908>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.115+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017a1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-18.xml auth{0=1} v1041 ap=1 s=9261 n(v0 rc2024-03-27T07:27:17.378837+0000 b9261 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df32000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017a1:[<0x200000024c5/comment-18.xml v1005>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017a1:[<0x200000024c5/comment-18.xml v1041>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.115+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002580 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-16.jpg auth{0=1} v614 ap=1 s=32409 n(v0 rc2024-03-27T07:26:10.899144+0000 b32409 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df32580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002580:[<0x200000024c5/picture-16.jpg v614>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002580:[<0x200000024c5/picture-16.jpg v614>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.115+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000017c0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-12.xml auth{0=1} v1037 ap=1 s=3141 n(v0 rc2024-03-27T07:27:17.680832+0000 b3141 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df33080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000017c0:[<0x200000024c5/comment-12.xml v1023>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000017c0:[<0x200000024c5/comment-12.xml v1037>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.116+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001719 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-49.xml auth{0=1} v1051 ap=1 s=10004 n(v0 rc2024-03-27T07:27:16.555854+0000 b10004 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df33600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001719:[<0x200000024c5/comment-49.xml v938>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001719:[<0x200000024c5/comment-49.xml v1051>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.116+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-42.xml auth{0=1} v1049 ap=1 s=7295 n(v0 rc2024-03-27T07:27:16.800849+0000 b7295 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df33b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173c:[<0x200000024c5/comment-42.xml v948>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000173c:[<0x200000024c5/comment-42.xml v1049>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.116+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024d3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-23.xml auth{0=1} v644 ap=1 s=7359 n(v0 rc2024-03-27T07:26:10.388154+0000 b7359 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df34100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024d3:[<0x200000024c5/article-23.xml v644>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024d3:[<0x200000024c5/article-23.xml v644>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.116+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000024df [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-17.xml auth{0=1} v620 ap=1 s=19997 n(v0 rc2024-03-27T07:26:10.411154+0000 b19997 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df34680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000024df:[<0x200000024c5/article-17.xml v620>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000024df:[<0x200000024c5/article-17.xml v620>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.246 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.117+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000254d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-32.jpg auth v722 ap=1 s=61067 n(v0 rc2024-03-27T07:26:10.759147+0000 b61067 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661df34c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000254d:[<0x200000024c5/picture-32.jpg v722>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000254d:[<0x200000024c5/picture-32.jpg v722>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.251 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.117+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000251d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-48.jpg auth v710 ap=1 s=25468 n(v0 rc2024-03-27T07:26:10.551151+0000 b25468 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661df35180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000251d:[<0x200000024c5/picture-48.jpg v710>,<0x10000000399/blog-63 v92562>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000251d:[<0x200000024c5/picture-48.jpg v710>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.251 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.117+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001710 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-51.xml auth{0=1} v1053 ap=1 s=9025 n(v0 rc2024-03-27T07:27:16.470855+0000 b9025 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df35700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001710:[<0x200000024c5/comment-51.xml v934>,<0x10000000399/blog-63 v122053>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001710:[<0x200000024c5/comment-51.xml v1053>,<0x10000000399/blog-63 v125147>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.251 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.118+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a37 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml auth{0=1} v1122 ap=1 s=13065 n(v0 rc2024-03-27T07:25:32.025910+0000 b13065 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1f9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a37:[<0x20000000a14/article-59.xml v1122>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a37:[<0x20000000a14/article-59.xml v1122>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.251 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.118+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b89 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg auth{0=1} v1150 ap=1 s=62262 n(v0 rc2024-03-27T07:25:33.019890+0000 b62262 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b89:[<0x20000000a14/picture-13.jpg v597>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b89:[<0x20000000a14/picture-13.jpg v1150>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.251 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.118+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000853 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml auth{0=1} v1161 ap=1 s=5254 n(v0 rc2024-03-27T07:25:50.472547+0000 b5254 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1fa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000853:[<0x20000000a14/comment-56.xml v796>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000853:[<0x20000000a14/comment-56.xml v1161>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.251 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.119+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-92.xml auth v1378 ap=1 s=26585 n(v0 rc2024-03-27T07:27:41.092373+0000 b26585 1=1+0) | replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661d1fa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edb:[<0x20000000a14/article-92.xml v1369>,<0x10000000399/blog-16 v125151>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001edb:[<0x20000000a14/article-92.xml v1378>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.251 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.120+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ef6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg auth{0=1} v1376 ap=1 s=16393 n(v0 rc2024-03-27T07:27:41.237370+0000 b16393 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ef6:[<0x20000000a14/picture-18.jpg v1371>,<0x10000000399/blog-16 v125151>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ef6:[<0x20000000a14/picture-18.jpg v1376>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.251 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.120+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000afb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml auth{0=1} v1156 ap=1 s=3372 n(v0 rc2024-03-27T07:25:32.546900+0000 b3372 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1fb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000afb:[<0x20000000a14/article-18.xml v599>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000afb:[<0x20000000a14/article-18.xml v1156>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.251 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.121+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml auth{0=1} v1343 ap=1 s=3743 n(v0 rc2024-03-27T07:26:29.481778+0000 b3743 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd06000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb2:[<0x20000000a14/comment-5.xml v1332>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb2:[<0x20000000a14/comment-5.xml v1343>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.122+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b71 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg auth{0=1} v1136 ap=1 s=27643 n(v0 rc2024-03-27T07:25:32.933892+0000 b27643 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd06580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b71:[<0x20000000a14/picture-19.jpg v1136>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b71:[<0x20000000a14/picture-19.jpg v1136>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.122+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a5b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml auth{0=1} v1126 ap=1 s=7438 n(v0 rc2024-03-27T07:25:32.140908+0000 b7438 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd06b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a5b:[<0x20000000a14/article-51.xml v1126>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a5b:[<0x20000000a14/article-51.xml v1126>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.123+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c38 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml auth{0=1} v1283 ap=1 s=3076 n(v0 rc2024-03-27T07:26:17.463015+0000 b3076 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd07080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c38:[<0x20000000a14/comment-29.xml v1283>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c38:[<0x20000000a14/comment-29.xml v1283>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.124+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ac6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml auth{0=1} v1140 ap=1 s=10213 n(v0 rc2024-03-27T07:25:32.391903+0000 b10213 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd07600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ac6:[<0x20000000a14/article-27.xml v1140>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ac6:[<0x20000000a14/article-27.xml v1140>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.124+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bb3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg auth{0=1} v1124 ap=1 s=42644 n(v0 rc2024-03-27T07:25:33.166887+0000 b42644 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd07b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bb3:[<0x20000000a14/picture-4.jpg v1124>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bb3:[<0x20000000a14/picture-4.jpg v1124>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.125+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bc0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg auth{0=1} v1152 ap=1 s=42377 n(v0 rc2024-03-27T07:25:33.215886+0000 b42377 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd08100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bc0:[<0x20000000a14/picture-2.jpg v604>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bc0:[<0x20000000a14/picture-2.jpg v1152>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.126+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000af0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml auth{0=1} v1134 ap=1 s=8491 n(v0 rc2024-03-27T07:25:32.518900+0000 b8491 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd08680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000af0:[<0x20000000a14/article-20.xml v1134>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000af0:[<0x20000000a14/article-20.xml v1134>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.127+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b84 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg auth{0=1} v1142 ap=1 s=18914 n(v0 rc2024-03-27T07:25:33.008890+0000 b18914 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd08c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b84:[<0x20000000a14/picture-14.jpg v1142>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b84:[<0x20000000a14/picture-14.jpg v1142>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.127+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a2f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml auth{0=1} v1144 ap=1 s=2049 n(v0 rc2024-03-27T07:25:31.988911+0000 b2049 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd09180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a2f:[<0x20000000a14/article-61.xml v1144>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a2f:[<0x20000000a14/article-61.xml v1144>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.128+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a83 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml auth{0=1} v1120 ap=1 s=22453 n(v0 rc2024-03-27T07:25:32.241906+0000 b22453 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cd09700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a83:[<0x20000000a14/article-41.xml v1120>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a83:[<0x20000000a14/article-41.xml v1120>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.129+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b95 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml auth{0=1} v1275 ap=1 s=29602 n(v0 rc2024-03-27T07:26:14.984064+0000 b29602 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cfbc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b95:[<0x20000000a14/article-45.xml v1275>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b95:[<0x20000000a14/article-45.xml v1275>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.252 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.129+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ba0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg auth{0=1} v1132 ap=1 s=39734 n(v0 rc2024-03-27T07:25:33.095889+0000 b39734 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cfbc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ba0:[<0x20000000a14/picture-7.jpg v1132>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ba0:[<0x20000000a14/picture-7.jpg v1132>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.130+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000aaf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml auth{0=1} v1130 ap=1 s=10115 n(v0 rc2024-03-27T07:25:32.336904+0000 b10115 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cfbcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000aaf:[<0x20000000a14/article-31.xml v1130>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000aaf:[<0x20000000a14/article-31.xml v1130>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.131+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b99 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg auth{0=1} v1128 ap=1 s=56290 n(v0 rc2024-03-27T07:25:33.066889+0000 b56290 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cfbd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b99:[<0x20000000a14/picture-9.jpg v1128>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b99:[<0x20000000a14/picture-9.jpg v1128>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.131+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cac [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml auth{0=1} v1345 ap=1 s=8704 n(v0 rc2024-03-27T07:26:29.439779+0000 b8704 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cfbd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cac:[<0x20000000a14/comment-11.xml v1308>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cac:[<0x20000000a14/comment-11.xml v1345>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.132+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c9e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml auth{0=1} v1347 ap=1 s=7153 n(v0 rc2024-03-27T07:26:28.550797+0000 b7153 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cfbdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c9e:[<0x20000000a14/comment-20.xml v1305>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000c9e:[<0x20000000a14/comment-20.xml v1347>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.133+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c30 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml auth{0=1} v1289 ap=1 s=2109 n(v0 rc2024-03-27T07:26:17.378017+0000 b2109 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d560680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c30:[<0x20000000a14/comment-37.xml v1289>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c30:[<0x20000000a14/comment-37.xml v1289>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.134+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000844 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml auth{0=1} v1155 ap=1 s=8799 n(v0 rc2024-03-27T07:25:50.042555+0000 b8799 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d560c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000844:[<0x20000000a14/comment-71.xml v704>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000844:[<0x20000000a14/comment-71.xml v1155>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.134+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b95 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg auth{0=1} v1118 ap=1 s=45009 n(v0 rc2024-03-27T07:25:33.054890+0000 b45009 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d561180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b95:[<0x20000000a14/picture-10.jpg v1118>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b95:[<0x20000000a14/picture-10.jpg v1118>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.135+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bc7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg auth{0=1,1=1} v574 ap=1 s=11954 n(v0 rc2024-03-27T07:25:33.242886+0000 b11954 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1} mcw={1=Fscr} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d561700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bc7:[<0x20000000a14/picture-1.jpg v574>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bc7:[<0x20000000a14/picture-1.jpg v574>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.136+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml auth{0=1} v1324 ap=1 s=7133 n(v0 rc2024-03-27T07:26:29.041787+0000 b7133 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca5:[<0x20000000a14/comment-16.xml v1324>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ca5:[<0x20000000a14/comment-16.xml v1324>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.136+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b28 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml auth{0=1} v1136 ap=1 s=16752 n(v0 rc2024-03-27T07:25:32.680897+0000 b16752 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b28:[<0x20000000a14/article-9.xml v1136>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b28:[<0x20000000a14/article-9.xml v1136>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.138+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a77 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml auth{0=1} v1142 ap=1 s=27956 n(v0 rc2024-03-27T07:25:32.213906+0000 b27956 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a77:[<0x20000000a14/article-44.xml v615>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a77:[<0x20000000a14/article-44.xml v1142>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.253 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.141+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ba7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg auth{0=1} v1126 ap=1 s=23527 n(v0 rc2024-03-27T07:25:33.117888+0000 b23527 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ba7:[<0x20000000a14/picture-6.jpg v1126>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ba7:[<0x20000000a14/picture-6.jpg v1126>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.141+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a1f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml auth{0=1} v1132 ap=1 s=7231 n(v0 rc2024-03-27T07:25:31.915912+0000 b7231 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a1f:[<0x20000000a14/article-65.xml v1132>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a1f:[<0x20000000a14/article-65.xml v1132>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.142+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000851 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml auth{0=1} v1144 ap=1 s=2774 n(v0 rc2024-03-27T07:25:50.417548+0000 b2774 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000851:[<0x20000000a14/comment-58.xml v784>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000851:[<0x20000000a14/comment-58.xml v1144>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.142+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000854 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml auth{0=1} v1159 ap=1 s=8750 n(v0 rc2024-03-27T07:25:50.510546+0000 b8750 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000854:[<0x20000000a14/comment-55.xml v802>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000854:[<0x20000000a14/comment-55.xml v1159>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.143+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000929 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml auth{0=1} v1271 ap=1 s=19308 n(v0 rc2024-03-27T07:25:59.838362+0000 b19308 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000929:[<0x20000000a14/article-62.xml v1167>,<0x10000000399/blog-16 v63051>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x10000000929:[<0x20000000a14/article-62.xml v1271>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.144+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml auth{0=1} v1281 ap=1 s=4251 n(v0 rc2024-03-27T07:26:17.499014+0000 b4251 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3c:[<0x20000000a14/comment-25.xml v1281>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c3c:[<0x20000000a14/comment-25.xml v1281>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.144+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b4b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg auth{0=1} v1140 ap=1 s=13757 n(v0 rc2024-03-27T07:25:32.822894+0000 b13757 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df00000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b4b:[<0x20000000a14/picture-28.jpg v620>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b4b:[<0x20000000a14/picture-28.jpg v1140>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.145+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-85.xml auth v1285 ap=1 s=18440 n(v0 rc2024-03-27T07:26:15.737049+0000 b18440 1=1+0) | authpin=1 scrubqueue=0 0x55661e202680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcc:[<0x20000000a14/article-85.xml v1285>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000bcc:[<0x20000000a14/article-85.xml v1285>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.145+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c33 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml auth{0=1} v1275 ap=1 s=3121 n(v0 rc2024-03-27T07:26:17.408016+0000 b3121 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c33:[<0x20000000a14/comment-34.xml v1275>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c33:[<0x20000000a14/comment-34.xml v1275>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.146+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c2c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml auth{0=1} v1279 ap=1 s=3700 n(v0 rc2024-03-27T07:26:17.339017+0000 b3700 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df00580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c2c:[<0x20000000a14/comment-41.xml v1279>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c2c:[<0x20000000a14/comment-41.xml v1279>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.146+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ad9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml auth{0=1} v1134 ap=1 s=20138 n(v0 rc2024-03-27T07:25:32.448902+0000 b20138 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661defcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ad9:[<0x20000000a14/article-24.xml v1134>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ad9:[<0x20000000a14/article-24.xml v1134>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.254 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.146+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a17 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-67.xml auth{0=1} v1128 ap=1 s=6041 n(v0 rc2024-03-27T07:25:31.880913+0000 b6041 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df00b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a17:[<0x20000000a14/article-67.xml v1128>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a17:[<0x20000000a14/article-67.xml v1128>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.147+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b78 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg auth{0=1} v1130 ap=1 s=26917 n(v0 rc2024-03-27T07:25:32.961891+0000 b26917 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df01080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b78:[<0x20000000a14/picture-17.jpg v1130>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b78:[<0x20000000a14/picture-17.jpg v1130>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.147+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b40 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml auth{0=1} v1122 ap=1 s=5151 n(v0 rc2024-03-27T07:25:32.765895+0000 b5151 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df01600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b40:[<0x20000000a14/article-3.xml v1122>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b40:[<0x20000000a14/article-3.xml v1122>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.147+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b5c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg auth{0=1} v1124 ap=1 s=42166 n(v0 rc2024-03-27T07:25:32.873893+0000 b42166 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df01b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b5c:[<0x20000000a14/picture-24.jpg v1124>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b5c:[<0x20000000a14/picture-24.jpg v1124>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.148+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml auth{0=1} v1283 ap=1 s=2798 n(v0 rc2024-03-27T07:26:17.515014+0000 b2798 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df02680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3e:[<0x20000000a14/comment-23.xml v1283>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c3e:[<0x20000000a14/comment-23.xml v1283>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.148+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b2f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml auth{0=1} v1116 ap=1 s=30380 n(v0 rc2024-03-27T07:25:32.704896+0000 b30380 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df02100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b2f:[<0x20000000a14/article-7.xml v1116>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b2f:[<0x20000000a14/article-7.xml v1116>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.149+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml auth{0=1} v1287 ap=1 s=4545 n(v0 rc2024-03-27T07:26:17.507014+0000 b4545 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df02c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3d:[<0x20000000a14/comment-24.xml v1287>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c3d:[<0x20000000a14/comment-24.xml v1287>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.231+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b69 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg auth{0=1} v1135 ap=1 s=55860 n(v0 rc2024-03-27T07:25:32.909892+0000 b55860 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e0b0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b69:[<0x20000000a14/picture-21.jpg v1135>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b69:[<0x20000000a14/picture-21.jpg v1135>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.231+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a9b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml auth{0=1} v1137 ap=1 s=22154 n(v0 rc2024-03-27T07:25:32.299904+0000 b22154 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e0b1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a9b:[<0x20000000a14/article-35.xml v1137>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a9b:[<0x20000000a14/article-35.xml v1137>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.232+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000842 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml auth{0=1} v1155 ap=1 s=10041 n(v0 rc2024-03-27T07:25:50.007556+0000 b10041 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e0b1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000842:[<0x20000000a14/comment-73.xml v692>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000842:[<0x20000000a14/comment-73.xml v1155>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.232+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml auth{0=1} v1143 ap=1 s=4004 n(v0 rc2024-03-27T07:25:50.192552+0000 b4004 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619fc2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084f:[<0x20000000a14/comment-60.xml v1143>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000084f:[<0x20000000a14/comment-60.xml v1143>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.233+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml auth{0=1} v1352 ap=1 s=8875 n(v0 rc2024-03-27T07:26:29.515778+0000 b8875 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619fc2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb6:[<0x20000000a14/comment-1.xml v1341>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb6:[<0x20000000a14/comment-1.xml v1352>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.233+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000091b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml auth{0=1} v1280 ap=1 s=9281 n(v0 rc2024-03-27T07:25:59.405371+0000 b9281 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619fc3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000091b:[<0x20000000a14/article-40.xml v1165>,<0x10000000399/blog-16 v63051>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x1000000091b:[<0x20000000a14/article-40.xml v1280>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.255 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.234+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-82.xml auth v1365 ap=1 s=24162 n(v0 rc2024-03-27T07:27:20.730772+0000 b24162 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556619fc3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e2:[<0x20000000a14/article-82.xml v1359>,<0x10000000399/blog-16 v116871>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018e2:[<0x20000000a14/article-82.xml v1365>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.256 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.234+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b0a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml auth{0=1} v1139 ap=1 s=15911 n(v0 rc2024-03-27T07:25:32.599899+0000 b15911 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619fc4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b0a:[<0x20000000a14/article-15.xml v1139>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b0a:[<0x20000000a14/article-15.xml v1139>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.256 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.235+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c2d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml auth{0=1} v1288 ap=1 s=2060 n(v0 rc2024-03-27T07:26:17.349017+0000 b2060 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619fc4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c2d:[<0x20000000a14/comment-40.xml v1288>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c2d:[<0x20000000a14/comment-40.xml v1288>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.256 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.235+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c34 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml auth{0=1} v1284 ap=1 s=10238 n(v0 rc2024-03-27T07:26:17.419016+0000 b10238 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619fc5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c34:[<0x20000000a14/comment-33.xml v1284>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c34:[<0x20000000a14/comment-33.xml v1284>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.256 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.236+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c2e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml auth{0=1} v1290 ap=1 s=2349 n(v0 rc2024-03-27T07:26:17.359017+0000 b2349 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc5a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c2e:[<0x20000000a14/comment-39.xml v1290>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c2e:[<0x20000000a14/comment-39.xml v1290>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.256 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.236+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000af4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml auth{0=1} v1133 ap=1 s=3980 n(v0 rc2024-03-27T07:25:32.528900+0000 b3980 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc5ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000af4:[<0x20000000a14/article-19.xml v1133>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000af4:[<0x20000000a14/article-19.xml v1133>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.256 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.237+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b6d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg auth{0=1} v1145 ap=1 s=65290 n(v0 rc2024-03-27T07:25:32.920892+0000 b65290 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc5b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b6d:[<0x20000000a14/picture-20.jpg v674>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b6d:[<0x20000000a14/picture-20.jpg v1145>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.256 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.238+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c35 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml auth{0=1} v1286 ap=1 s=7703 n(v0 rc2024-03-27T07:26:17.429016+0000 b7703 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc5bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c35:[<0x20000000a14/comment-32.xml v1286>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c35:[<0x20000000a14/comment-32.xml v1286>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.256 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.238+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml auth{0=1} v1162 ap=1 s=4655 n(v0 rc2024-03-27T07:25:50.176553+0000 b4655 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc5c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084c:[<0x20000000a14/comment-63.xml v752>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000084c:[<0x20000000a14/comment-63.xml v1162>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.239+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000855 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml auth{0=1} v1153 ap=1 s=3348 n(v0 rc2024-03-27T07:25:50.523546+0000 b3348 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc5c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000855:[<0x20000000a14/comment-54.xml v808>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000855:[<0x20000000a14/comment-54.xml v1153>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.239+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a7f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml auth{0=1} v1131 ap=1 s=22025 n(v0 rc2024-03-27T07:25:32.232906+0000 b22025 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc5cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a7f:[<0x20000000a14/article-42.xml v1131>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a7f:[<0x20000000a14/article-42.xml v1131>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.240+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000caa [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml auth{0=1} v1350 ap=1 s=4141 n(v0 rc2024-03-27T07:26:29.405780+0000 b4141 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bae3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000caa:[<0x20000000a14/comment-13.xml v1329>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000caa:[<0x20000000a14/comment-13.xml v1350>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.241+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c9c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml auth{0=1} v1348 ap=1 s=8594 n(v0 rc2024-03-27T07:26:28.462798+0000 b8594 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bae2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c9c:[<0x20000000a14/comment-21.xml v1301>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000c9c:[<0x20000000a14/comment-21.xml v1348>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.241+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml auth{0=1} v1294 ap=1 s=4241 n(v0 rc2024-03-27T07:26:17.489015+0000 b4241 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bae1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3b:[<0x20000000a14/comment-26.xml v1294>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c3b:[<0x20000000a14/comment-26.xml v1294>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.242+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a93 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml auth{0=1} v1137 ap=1 s=4989 n(v0 rc2024-03-27T07:25:32.278905+0000 b4989 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bae1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a93:[<0x20000000a14/article-37.xml v1137>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a93:[<0x20000000a14/article-37.xml v1137>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.243+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b50 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg auth{0=1} v1131 ap=1 s=57505 n(v0 rc2024-03-27T07:25:32.837894+0000 b57505 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bae0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b50:[<0x20000000a14/picture-27.jpg v1131>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b50:[<0x20000000a14/picture-27.jpg v1131>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.243+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001efa [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml auth{0=1} v1379 ap=1 s=30759 n(v0 rc2024-03-27T07:27:41.261369+0000 b30759 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb08c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001efa:[<0x20000000a14/article-39.xml v1374>,<0x10000000399/blog-16 v125151>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001efa:[<0x20000000a14/article-39.xml v1379>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.244+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a97 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml auth{0=1} v1155 ap=1 s=3909 n(v0 rc2024-03-27T07:25:32.288905+0000 b3909 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb08100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a97:[<0x20000000a14/article-36.xml v680>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a97:[<0x20000000a14/article-36.xml v1155>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.244+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b18 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml auth{0=1} v1135 ap=1 s=2378 n(v0 rc2024-03-27T07:25:32.640898+0000 b2378 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb07600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b18:[<0x20000000a14/article-12.xml v1135>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b18:[<0x20000000a14/article-12.xml v1135>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.245+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b48 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml auth{0=1} v1141 ap=1 s=3165 n(v0 rc2024-03-27T07:25:32.802895+0000 b3165 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb06b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b48:[<0x20000000a14/article-1.xml v1141>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b48:[<0x20000000a14/article-1.xml v1141>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.257 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.246+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c37 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml auth{0=1} v1292 ap=1 s=3015 n(v0 rc2024-03-27T07:26:17.451015+0000 b3015 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb06000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c37:[<0x20000000a14/comment-30.xml v1292>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c37:[<0x20000000a14/comment-30.xml v1292>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.258 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.246+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml auth{0=1} v1354 ap=1 s=8657 n(v0 rc2024-03-27T07:26:29.497778+0000 b8657 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bac1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb4:[<0x20000000a14/comment-3.xml v1337>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb4:[<0x20000000a14/comment-3.xml v1354>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.258 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.247+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml auth{0=1} v1316 ap=1 s=8701 n(v0 rc2024-03-27T07:26:28.825791+0000 b8701 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bac0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca1:[<0x20000000a14/comment-18.xml v1316>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ca1:[<0x20000000a14/comment-18.xml v1316>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.276 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.023+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-59.xml auth{0=1} v997 ap=1 s=9667 n(v0 rc2024-03-27T07:26:49.027393+0000 b9667 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed7:[<0x20000002049/article-59.xml v997>,<0x10000000399/blog-58 v114254>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000ed7:[<0x20000002049/article-59.xml v997>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.276 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.023+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022a7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg auth{0=1} v942 ap=1 s=62132 n(v0 rc2024-03-27T07:26:08.032201+0000 b62132 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad0bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022a7:[<0x20000002049/picture-13.jpg v942>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022a7:[<0x20000002049/picture-13.jpg v942>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.276 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.024+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019fe [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-56.xml auth{0=1} v1179 ap=1 s=7950 n(v0 rc2024-03-27T07:27:24.939689+0000 b7950 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abfb4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019fe:[<0x20000002049/comment-56.xml v1142>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019fe:[<0x20000002049/comment-56.xml v1179>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.276 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.024+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002272 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg auth{0=1} v943 ap=1 s=27538 n(v0 rc2024-03-27T07:26:07.823205+0000 b27538 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abfb4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002272:[<0x20000002049/picture-18.jpg v943>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002272:[<0x20000002049/picture-18.jpg v943>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.276 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.024+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000205e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-74.xml auth{0=1} v979 ap=1 s=8933 n(v0 rc2024-03-27T07:26:04.527270+0000 b8933 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abfb4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000205e:[<0x20000002049/article-74.xml v979>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000205e:[<0x20000002049/article-74.xml v979>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.276 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.024+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000215c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-18.xml auth{0=1} v945 ap=1 s=18593 n(v0 rc2024-03-27T07:26:06.794225+0000 b18593 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abfb5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000215c:[<0x20000002049/article-18.xml v945>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000215c:[<0x20000002049/article-18.xml v945>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.276 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.025+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000173d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg auth{0=1} v1162 ap=1 s=34756 n(v0 rc2024-03-27T07:27:16.795849+0000 b34756 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abfb6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000173d:[<0x20000002049/picture-19.jpg v1162>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000173d:[<0x20000002049/picture-19.jpg v1162>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.276 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.025+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020cf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-51.xml auth{0=1} v971 ap=1 s=17784 n(v0 rc2024-03-27T07:26:05.959242+0000 b17784 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abfb6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020cf:[<0x20000002049/article-51.xml v971>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020cf:[<0x20000002049/article-51.xml v971>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.277 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.026+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002131 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-27.xml auth{0=1} v948 ap=1 s=29676 n(v0 rc2024-03-27T07:26:06.573230+0000 b29676 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2d2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002131:[<0x20000002049/article-27.xml v948>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002131:[<0x20000002049/article-27.xml v948>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.277 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.026+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022e6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg auth{0=1} v949 ap=1 s=56940 n(v0 rc2024-03-27T07:26:08.275196+0000 b56940 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2d2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022e6:[<0x20000002049/picture-4.jpg v949>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022e6:[<0x20000002049/picture-4.jpg v949>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.277 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.026+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021d2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg auth{0=1} v964 ap=1 s=35474 n(v0 rc2024-03-27T07:26:07.096219+0000 b35474 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2d2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021d2:[<0x20000002049/picture-35.jpg v964>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021d2:[<0x20000002049/picture-35.jpg v964>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.277 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.027+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022ec [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg auth{0=1} v951 ap=1 s=30287 n(v0 rc2024-03-27T07:26:08.296196+0000 b30287 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022ec:[<0x20000002049/picture-2.jpg v951>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022ec:[<0x20000002049/picture-2.jpg v951>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.279 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.027+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002072 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-70.xml auth{0=1} v977 ap=1 s=9996 n(v0 rc2024-03-27T07:26:04.801264+0000 b9996 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2d3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002072:[<0x20000002049/article-70.xml v977>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002072:[<0x20000002049/article-70.xml v977>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.279 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.027+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002152 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-20.xml auth{0=1} v953 ap=1 s=4402 n(v0 rc2024-03-27T07:26:06.738226+0000 b4402 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2d3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002152:[<0x20000002049/article-20.xml v953>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002152:[<0x20000002049/article-20.xml v953>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.279 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.028+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000229c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg auth{0=1} v954 ap=1 s=48616 n(v0 rc2024-03-27T07:26:07.986202+0000 b48616 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2d4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000229c:[<0x20000002049/picture-14.jpg v954>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000229c:[<0x20000002049/picture-14.jpg v954>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.279 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.028+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019d4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-92.xml auth{0=1} v1177 ap=1 s=3970 n(v0 rc2024-03-27T07:27:24.543697+0000 b3970 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac2d4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019d4:[<0x20000002049/comment-92.xml v1106>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019d4:[<0x20000002049/comment-92.xml v1177>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.028+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f44 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-83.xml auth v1160 ap=1 s=2545 n(v0 rc2024-03-27T07:26:59.021197+0000 b2545 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac2d5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f44:[<0x20000002049/article-83.xml v1000>,<0x10000000399/blog-58 v115704>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f44:[<0x20000002049/article-83.xml v1160>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.029+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020f9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-41.xml auth{0=1} v967 ap=1 s=9934 n(v0 rc2024-03-27T07:26:06.403233+0000 b9934 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad968000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020f9:[<0x20000002049/article-41.xml v967>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020f9:[<0x20000002049/article-41.xml v967>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.029+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020ea [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-45.xml auth{0=1} v969 ap=1 s=27894 n(v0 rc2024-03-27T07:26:06.188237+0000 b27894 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad968580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020ea:[<0x20000002049/article-45.xml v969>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020ea:[<0x20000002049/article-45.xml v969>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.030+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002078 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-69.xml auth{0=1} v975 ap=1 s=27579 n(v0 rc2024-03-27T07:26:04.868263+0000 b27579 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad968b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002078:[<0x20000002049/article-69.xml v975>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002078:[<0x20000002049/article-69.xml v975>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.030+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022de [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg auth{0=1} v958 ap=1 s=53741 n(v0 rc2024-03-27T07:26:08.238197+0000 b53741 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad969080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022de:[<0x20000002049/picture-7.jpg v958>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022de:[<0x20000002049/picture-7.jpg v958>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.030+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002120 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-31.xml auth{0=1} v962 ap=1 s=18459 n(v0 rc2024-03-27T07:26:06.534230+0000 b18459 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad969600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002120:[<0x20000002049/article-31.xml v962>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002120:[<0x20000002049/article-31.xml v962>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.031+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022d2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg auth{0=1} v960 ap=1 s=48598 n(v0 rc2024-03-27T07:26:08.197198+0000 b48598 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad969b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022d2:[<0x20000002049/picture-9.jpg v960>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022d2:[<0x20000002049/picture-9.jpg v960>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.032+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ef [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-71.xml auth{0=1} v1197 ap=1 s=6473 n(v0 rc2024-03-27T07:27:24.789692+0000 b6473 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad9b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ef:[<0x20000002049/comment-71.xml v1133>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ef:[<0x20000002049/comment-71.xml v1197>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.032+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022c8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg auth{0=1} v934 ap=1 s=19442 n(v0 rc2024-03-27T07:26:08.173198+0000 b19442 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad9b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022c8:[<0x20000002049/picture-10.jpg v934>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022c8:[<0x20000002049/picture-10.jpg v934>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.032+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022ef [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg auth{0=1} v935 ap=1 s=14018 n(v0 rc2024-03-27T07:26:08.305195+0000 b14018 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad9b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022ef:[<0x20000002049/picture-1.jpg v935>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022ef:[<0x20000002049/picture-1.jpg v935>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.033+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000218a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-9.xml auth{0=1} v936 ap=1 s=12186 n(v0 rc2024-03-27T07:26:06.937222+0000 b12186 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad402000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000218a:[<0x20000002049/article-9.xml v936>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000218a:[<0x20000002049/article-9.xml v936>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.280 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.033+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001938 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-44.xml auth{0=1} v1168 ap=1 s=23738 n(v0 rc2024-03-27T07:27:21.972747+0000 b23738 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad402b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001938:[<0x20000002049/article-44.xml v1168>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001938:[<0x20000002049/article-44.xml v1168>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.034+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022e1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg auth{0=1} v938 ap=1 s=62583 n(v0 rc2024-03-27T07:26:08.253196+0000 b62583 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad403080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022e1:[<0x20000002049/picture-6.jpg v938>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022e1:[<0x20000002049/picture-6.jpg v938>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.034+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000208c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-65.xml auth{0=1} v962 ap=1 s=29918 n(v0 rc2024-03-27T07:26:05.253256+0000 b29918 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad403600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000208c:[<0x20000002049/article-65.xml v962>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000208c:[<0x20000002049/article-65.xml v962>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.034+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019fc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-58.xml auth{0=1} v1199 ap=1 s=8927 n(v0 rc2024-03-27T07:27:24.921690+0000 b8927 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad403b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019fc:[<0x20000002049/comment-58.xml v1139>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019fc:[<0x20000002049/comment-58.xml v1199>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.035+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001742 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-62.xml auth{0=1} v1170 ap=1 s=2426 n(v0 rc2024-03-27T07:27:16.835848+0000 b2426 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad404680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001742:[<0x20000002049/article-62.xml v1095>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001742:[<0x20000002049/article-62.xml v1170>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.035+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ff [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-55.xml auth{0=1} v1201 ap=1 s=2817 n(v0 rc2024-03-27T07:27:24.961689+0000 b2817 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad404c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ff:[<0x20000002049/comment-55.xml v1145>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ff:[<0x20000002049/comment-55.xml v1201>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.035+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000213f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-24.xml auth{0=1} v941 ap=1 s=9916 n(v0 rc2024-03-27T07:26:06.654228+0000 b9916 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad405180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000213f:[<0x20000002049/article-24.xml v941>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000213f:[<0x20000002049/article-24.xml v941>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.036+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002208 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg auth{0=1} v951 ap=1 s=60455 n(v0 rc2024-03-27T07:26:07.354214+0000 b60455 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe1f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002208:[<0x20000002049/picture-28.jpg v951>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002208:[<0x20000002049/picture-28.jpg v951>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.037+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002082 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-67.xml auth{0=1} v964 ap=1 s=25651 n(v0 rc2024-03-27T07:26:05.005260+0000 b25651 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe20100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002082:[<0x20000002049/article-67.xml v964>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002082:[<0x20000002049/article-67.xml v964>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.037+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019eb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-75.xml auth{0=1} v1195 ap=1 s=6697 n(v0 rc2024-03-27T07:27:24.742693+0000 b6697 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe20680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019eb:[<0x20000002049/comment-75.xml v1131>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019eb:[<0x20000002049/comment-75.xml v1195>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.037+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021c6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg auth{0=1} v956 ap=1 s=54315 n(v0 rc2024-03-27T07:26:07.056220+0000 b54315 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe20c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021c6:[<0x20000002049/picture-37.jpg v956>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021c6:[<0x20000002049/picture-37.jpg v956>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.038+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000227d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg auth{0=1} v945 ap=1 s=34186 n(v0 rc2024-03-27T07:26:07.868204+0000 b34186 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe21180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000227d:[<0x20000002049/picture-17.jpg v945>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000227d:[<0x20000002049/picture-17.jpg v945>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.281 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.038+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021ae [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-3.xml auth{0=1} v946 ap=1 s=17080 n(v0 rc2024-03-27T07:26:07.005221+0000 b17080 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abe21700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021ae:[<0x20000002049/article-3.xml v946>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021ae:[<0x20000002049/article-3.xml v946>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.282 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.038+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002230 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg auth{0=1} v947 ap=1 s=18126 n(v0 rc2024-03-27T07:26:07.595209+0000 b18126 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac262000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002230:[<0x20000002049/picture-24.jpg v947>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002230:[<0x20000002049/picture-24.jpg v947>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.282 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.039+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021de [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg auth{0=1} v953 ap=1 s=28335 n(v0 rc2024-03-27T07:26:07.135218+0000 b28335 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac262580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021de:[<0x20000002049/picture-33.jpg v953>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021de:[<0x20000002049/picture-33.jpg v953>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.282 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.039+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002196 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-7.xml auth{0=1} v949 ap=1 s=5380 n(v0 rc2024-03-27T07:26:06.960222+0000 b5380 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac262b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002196:[<0x20000002049/article-7.xml v949>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002196:[<0x20000002049/article-7.xml v949>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.282 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.040+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020bd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-55.xml auth{0=1} v964 ap=1 s=10127 n(v0 rc2024-03-27T07:26:05.801245+0000 b10127 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abdfc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020bd:[<0x20000002049/article-55.xml v964>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020bd:[<0x20000002049/article-55.xml v964>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.282 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.040+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002225 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg auth{0=1} v936 ap=1 s=28403 n(v0 rc2024-03-27T07:26:07.553210+0000 b28403 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abdfcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002225:[<0x20000002049/picture-25.jpg v936>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002225:[<0x20000002049/picture-25.jpg v936>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.282 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.040+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002190 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-8.xml auth{0=1} v937 ap=1 s=1054 n(v0 rc2024-03-27T07:26:06.948222+0000 b1054 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abdfd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002190:[<0x20000002049/article-8.xml v937>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002190:[<0x20000002049/article-8.xml v937>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.282 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.041+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014dd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg auth{0=1} v1164 ap=1 s=47684 n(v0 rc2024-03-27T07:27:11.565951+0000 b47684 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abdfec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014dd:[<0x20000002049/picture-31.jpg v1085>,<0x10000000399/blog-58 v115704>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000014dd:[<0x20000002049/picture-31.jpg v1164>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.282 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.042+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000207c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-68.xml auth{0=1} v968 ap=1 s=10355 n(v0 rc2024-03-27T07:26:04.938262+0000 b10355 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abdff180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000207c:[<0x20000002049/article-68.xml v968>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000207c:[<0x20000002049/article-68.xml v968>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.282 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.042+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019f0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-70.xml auth{0=1} v1201 ap=1 s=3185 n(v0 rc2024-03-27T07:27:24.798692+0000 b3185 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abdff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019f0:[<0x20000002049/comment-70.xml v1133>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019f0:[<0x20000002049/comment-70.xml v1201>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.282 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.042+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002056 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-76.xml auth{0=1} v970 ap=1 s=30128 n(v0 rc2024-03-27T07:26:04.328274+0000 b30128 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002056:[<0x20000002049/article-76.xml v970>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002056:[<0x20000002049/article-76.xml v970>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.289 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.043+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022d7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg auth{0=1} v941 ap=1 s=51606 n(v0 rc2024-03-27T07:26:08.214197+0000 b51606 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022d7:[<0x20000002049/picture-8.jpg v941>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022d7:[<0x20000002049/picture-8.jpg v941>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.289 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.043+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000221c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg auth{0=1} v942 ap=1 s=12464 n(v0 rc2024-03-27T07:26:07.486212+0000 b12464 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000221c:[<0x20000002049/picture-26.jpg v942>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000221c:[<0x20000002049/picture-26.jpg v942>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.289 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.043+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000211c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-32.xml auth{0=1} v959 ap=1 s=1542 n(v0 rc2024-03-27T07:26:06.526230+0000 b1542 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000211c:[<0x20000002049/article-32.xml v959>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000211c:[<0x20000002049/article-32.xml v959>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.289 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.044+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019df [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-83.xml auth{0=1} v1209 ap=1 s=4733 n(v0 rc2024-03-27T07:27:24.644695+0000 b4733 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019df:[<0x20000002049/comment-83.xml v1115>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019df:[<0x20000002049/comment-83.xml v1209>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.289 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.044+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019f1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-69.xml auth{0=1} v1205 ap=1 s=3105 n(v0 rc2024-03-27T07:27:24.808692+0000 b3105 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019f1:[<0x20000002049/comment-69.xml v1136>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019f1:[<0x20000002049/comment-69.xml v1205>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.289 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.044+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000214d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-21.xml auth{0=1} v944 ap=1 s=23093 n(v0 rc2024-03-27T07:26:06.722227+0000 b23093 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000214d:[<0x20000002049/article-21.xml v944>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000214d:[<0x20000002049/article-21.xml v944>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.289 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.045+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002124 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-30.xml auth{0=1} v955 ap=1 s=15802 n(v0 rc2024-03-27T07:26:06.543230+0000 b15802 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002124:[<0x20000002049/article-30.xml v955>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002124:[<0x20000002049/article-30.xml v955>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.289 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.045+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019d7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-89.xml auth{0=1} v1197 ap=1 s=7539 n(v0 rc2024-03-27T07:27:24.567697+0000 b7539 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019d7:[<0x20000002049/comment-89.xml v1113>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019d7:[<0x20000002049/comment-89.xml v1197>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.045+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ec [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-74.xml auth{0=1} v1207 ap=1 s=2203 n(v0 rc2024-03-27T07:27:24.750693+0000 b2203 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ec:[<0x20000002049/comment-74.xml v1121>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ec:[<0x20000002049/comment-74.xml v1207>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.046+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019d6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-90.xml auth{0=1} v1211 ap=1 s=9617 n(v0 rc2024-03-27T07:27:24.559697+0000 b9617 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad04d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019d6:[<0x20000002049/comment-90.xml v1111>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019d6:[<0x20000002049/comment-90.xml v1211>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.046+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002175 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-13.xml auth{0=1} v946 ap=1 s=17139 n(v0 rc2024-03-27T07:26:06.901223+0000 b17139 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8deb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002175:[<0x20000002049/article-13.xml v946>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002175:[<0x20000002049/article-13.xml v946>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.047+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019f6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-64.xml auth{0=1} v1199 ap=1 s=9248 n(v0 rc2024-03-27T07:27:24.872691+0000 b9248 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8df080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019f6:[<0x20000002049/comment-64.xml v1140>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019f6:[<0x20000002049/comment-64.xml v1199>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.047+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ee [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-72.xml auth{0=1} v1213 ap=1 s=8881 n(v0 rc2024-03-27T07:27:24.779692+0000 b8881 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8df600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ee:[<0x20000002049/comment-72.xml v1131>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ee:[<0x20000002049/comment-72.xml v1213>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.048+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020d2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-50.xml auth{0=1} v962 ap=1 s=31635 n(v0 rc2024-03-27T07:26:05.998241+0000 b31635 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020d2:[<0x20000002049/article-50.xml v962>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020d2:[<0x20000002049/article-50.xml v962>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.048+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000219c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-6.xml auth{0=1} v948 ap=1 s=16295 n(v0 rc2024-03-27T07:26:06.971222+0000 b16295 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000219c:[<0x20000002049/article-6.xml v948>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000219c:[<0x20000002049/article-6.xml v948>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.048+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021b5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-2.xml auth{0=1} v949 ap=1 s=15078 n(v0 rc2024-03-27T07:26:07.033220+0000 b15078 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021b5:[<0x20000002049/article-2.xml v949>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021b5:[<0x20000002049/article-2.xml v949>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.049+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019f3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-67.xml auth{0=1} v1203 ap=1 s=2214 n(v0 rc2024-03-27T07:27:24.835691+0000 b2214 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad052580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019f3:[<0x20000002049/comment-67.xml v1138>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019f3:[<0x20000002049/comment-67.xml v1203>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.050+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021ff [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg auth{0=1} v953 ap=1 s=61642 n(v0 rc2024-03-27T07:26:07.283216+0000 b61642 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad052b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021ff:[<0x20000002049/picture-29.jpg v953>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021ff:[<0x20000002049/picture-29.jpg v953>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.290 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.050+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020b8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-56.xml auth{0=1} v966 ap=1 s=27602 n(v0 rc2024-03-27T07:26:05.758246+0000 b27602 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad053b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020b8:[<0x20000002049/article-56.xml v966>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020b8:[<0x20000002049/article-56.xml v966>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.052+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020f1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-43.xml auth{0=1} v938 ap=1 s=9994 n(v0 rc2024-03-27T07:26:06.361234+0000 b9994 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad2f8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020f1:[<0x20000002049/article-43.xml v938>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020f1:[<0x20000002049/article-43.xml v938>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.052+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-33.xml auth{0=1} v992 ap=1 s=26462 n(v0 rc2024-03-27T07:26:45.924454+0000 b26462 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad2f8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7d:[<0x20000002049/article-33.xml v992>,<0x10000000399/blog-58 v114254>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d7d:[<0x20000002049/article-33.xml v992>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.053+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f40 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-81.jpg auth v1178 ap=1 s=18580 n(v0 rc2024-03-27T07:26:58.950199+0000 b18580 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad2f9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f40:[<0x20000002049/picture-81.jpg v995>,<0x10000000399/blog-58 v115704>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f40:[<0x20000002049/picture-81.jpg v1178>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.053+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022e3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg auth{0=1} v926 ap=1 s=52779 n(v0 rc2024-03-27T07:26:08.264196+0000 b52779 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad2f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022e3:[<0x20000002049/picture-5.jpg v926>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022e3:[<0x20000002049/picture-5.jpg v926>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.054+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ea [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-76.xml auth{0=1} v1211 ap=1 s=5646 n(v0 rc2024-03-27T07:27:24.732693+0000 b5646 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad2fac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ea:[<0x20000002049/comment-76.xml v1114>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ea:[<0x20000002049/comment-76.xml v1211>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.054+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020b3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-57.xml auth{0=1} v944 ap=1 s=32406 n(v0 rc2024-03-27T07:26:05.666247+0000 b32406 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad2fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020b3:[<0x20000002049/article-57.xml v944>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020b3:[<0x20000002049/article-57.xml v944>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.055+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a02 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-52.xml auth{0=1} v1204 ap=1 s=2696 n(v0 rc2024-03-27T07:27:25.004688+0000 b2696 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad2fb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a02:[<0x20000002049/comment-52.xml v1151>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a02:[<0x20000002049/comment-52.xml v1204>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.055+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019f4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-66.xml auth{0=1} v1209 ap=1 s=6037 n(v0 rc2024-03-27T07:27:24.845691+0000 b6037 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abefe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019f4:[<0x20000002049/comment-66.xml v1118>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019f4:[<0x20000002049/comment-66.xml v1209>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.056+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020ad [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-58.xml auth{0=1} v946 ap=1 s=30413 n(v0 rc2024-03-27T07:26:05.630248+0000 b30413 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abeffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020ad:[<0x20000002049/article-58.xml v946>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020ad:[<0x20000002049/article-58.xml v946>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.057+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020c7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-53.xml auth{0=1} v942 ap=1 s=9701 n(v0 rc2024-03-27T07:26:05.891243+0000 b9701 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf00100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020c7:[<0x20000002049/article-53.xml v942>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020c7:[<0x20000002049/article-53.xml v942>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.058+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000212c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-28.xml auth{0=1} v933 ap=1 s=13742 n(v0 rc2024-03-27T07:26:06.559230+0000 b13742 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac29a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000212c:[<0x20000002049/article-28.xml v933>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000212c:[<0x20000002049/article-28.xml v933>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.291 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.058+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020cb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-52.xml auth{0=1} v940 ap=1 s=11472 n(v0 rc2024-03-27T07:26:05.924242+0000 b11472 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac29b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020cb:[<0x20000002049/article-52.xml v940>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020cb:[<0x20000002049/article-52.xml v940>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.059+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019de [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-84.xml auth{0=1} v1213 ap=1 s=3615 n(v0 rc2024-03-27T07:27:24.638695+0000 b3615 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac29c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019de:[<0x20000002049/comment-84.xml v1099>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019de:[<0x20000002049/comment-84.xml v1213>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.059+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019e1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-81.xml auth{0=1} v1199 ap=1 s=7502 n(v0 rc2024-03-27T07:27:24.665695+0000 b7502 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab98b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019e1:[<0x20000002049/comment-81.xml v1119>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019e1:[<0x20000002049/comment-81.xml v1199>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.060+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022e9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg auth{0=1} v931 ap=1 s=32110 n(v0 rc2024-03-27T07:26:08.287196+0000 b32110 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa720580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022e9:[<0x20000002049/picture-3.jpg v931>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022e9:[<0x20000002049/picture-3.jpg v931>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.060+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a01 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-53.xml auth{0=1} v1188 ap=1 s=6794 n(v0 rc2024-03-27T07:27:24.985688+0000 b6794 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa720b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a01:[<0x20000002049/comment-53.xml v1148>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a01:[<0x20000002049/comment-53.xml v1188>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.061+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019db [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-85.xml auth{0=1} v1195 ap=1 s=2592 n(v0 rc2024-03-27T07:27:24.628695+0000 b2592 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa721b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019db:[<0x20000002049/comment-85.xml v1115>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019db:[<0x20000002049/comment-85.xml v1195>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.062+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022bd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg auth{0=1} v932 ap=1 s=61018 n(v0 rc2024-03-27T07:26:08.129199+0000 b61018 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa722100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022bd:[<0x20000002049/picture-11.jpg v932>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022bd:[<0x20000002049/picture-11.jpg v932>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.063+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ed6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-70.jpg auth{0=1} v995 ap=1 s=17521 n(v0 rc2024-03-27T07:26:49.019393+0000 b17521 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa722680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ed6:[<0x20000002049/picture-70.jpg v995>,<0x10000000399/blog-58 v114254>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000ed6:[<0x20000002049/picture-70.jpg v995>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.063+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021a2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-5.xml auth{0=1} v933 ap=1 s=6953 n(v0 rc2024-03-27T07:26:06.982221+0000 b6953 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa722c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021a2:[<0x20000002049/article-5.xml v933>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021a2:[<0x20000002049/article-5.xml v933>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.063+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002114 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-34.xml auth{0=1} v943 ap=1 s=19758 n(v0 rc2024-03-27T07:26:06.509231+0000 b19758 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa723180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002114:[<0x20000002049/article-34.xml v943>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002114:[<0x20000002049/article-34.xml v943>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.064+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019fd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-57.xml auth{0=1} v1203 ap=1 s=4496 n(v0 rc2024-03-27T07:27:24.930690+0000 b4496 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a902b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019fd:[<0x20000002049/comment-57.xml v1143>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019fd:[<0x20000002049/comment-57.xml v1203>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.065+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000204c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-78.xml auth{0=1} v950 ap=1 s=4099 n(v0 rc2024-03-27T07:26:04.186277+0000 b4099 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a902b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000204c:[<0x20000002049/article-78.xml v950>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000204c:[<0x20000002049/article-78.xml v950>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.292 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.065+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002128 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-29.xml auth{0=1} v941 ap=1 s=20938 n(v0 rc2024-03-27T07:26:06.551230+0000 b20938 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a902bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002128:[<0x20000002049/article-29.xml v941>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002128:[<0x20000002049/article-29.xml v941>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.293 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.066+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020a5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-60.xml auth{0=1} v948 ap=1 s=11946 n(v0 rc2024-03-27T07:26:05.546250+0000 b11946 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a902c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020a5:[<0x20000002049/article-60.xml v948>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020a5:[<0x20000002049/article-60.xml v948>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.293 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.066+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019f9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-61.xml auth{0=1} v1201 ap=1 s=4062 n(v0 rc2024-03-27T07:27:24.896690+0000 b4062 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a902c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019f9:[<0x20000002049/comment-61.xml v1141>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019f9:[<0x20000002049/comment-61.xml v1201>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.293 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.066+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002148 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-22.xml auth{0=1} v938 ap=1 s=25185 n(v0 rc2024-03-27T07:26:06.693227+0000 b25185 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a902cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002148:[<0x20000002049/article-22.xml v938>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002148:[<0x20000002049/article-22.xml v938>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.293 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.067+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019f2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-68.xml auth{0=1} v1197 ap=1 s=7303 n(v0 rc2024-03-27T07:27:24.828692+0000 b7303 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7f6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019f2:[<0x20000002049/comment-68.xml v1135>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019f2:[<0x20000002049/comment-68.xml v1197>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.293 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.067+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020d8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-49.xml auth{0=1} v946 ap=1 s=22068 n(v0 rc2024-03-27T07:26:06.039240+0000 b22068 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7f6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020d8:[<0x20000002049/article-49.xml v946>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020d8:[<0x20000002049/article-49.xml v946>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.293 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.068+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019e2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-80.xml auth{0=1} v1205 ap=1 s=5879 n(v0 rc2024-03-27T07:27:24.673695+0000 b5879 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad7f7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019e2:[<0x20000002049/comment-80.xml v1121>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019e2:[<0x20000002049/comment-80.xml v1205>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.293 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.068+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000223b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg auth{0=1} v934 ap=1 s=24665 n(v0 rc2024-03-27T07:26:07.648208+0000 b24665 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000223b:[<0x20000002049/picture-23.jpg v934>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000223b:[<0x20000002049/picture-23.jpg v934>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.293 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.069+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019f8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-62.xml auth{0=1} v1171 ap=1 s=2734 n(v0 rc2024-03-27T07:27:24.888690+0000 b2734 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019f8:[<0x20000002049/comment-62.xml v1134>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019f8:[<0x20000002049/comment-62.xml v1171>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.293 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.069+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020e5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-46.xml auth{0=1} v955 ap=1 s=14461 n(v0 rc2024-03-27T07:26:06.153238+0000 b14461 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020e5:[<0x20000002049/article-46.xml v955>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020e5:[<0x20000002049/article-46.xml v955>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.293 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.070+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020e1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-47.xml auth{0=1} v957 ap=1 s=16331 n(v0 rc2024-03-27T07:26:06.117239+0000 b16331 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020e1:[<0x20000002049/article-47.xml v957>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020e1:[<0x20000002049/article-47.xml v957>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.294 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.070+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000206d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-71.xml auth{0=1} v963 ap=1 s=14981 n(v0 rc2024-03-27T07:26:04.734266+0000 b14981 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000206d:[<0x20000002049/article-71.xml v963>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000206d:[<0x20000002049/article-71.xml v963>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.294 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.071+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002246 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg auth{0=1} v939 ap=1 s=48275 n(v0 rc2024-03-27T07:26:07.716207+0000 b48275 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002246:[<0x20000002049/picture-22.jpg v939>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002246:[<0x20000002049/picture-22.jpg v939>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.294 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.071+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000217f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-11.xml auth{0=1} v940 ap=1 s=23153 n(v0 rc2024-03-27T07:26:06.919223+0000 b23153 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000217f:[<0x20000002049/article-11.xml v940>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000217f:[<0x20000002049/article-11.xml v940>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.294 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.071+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019fb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-59.xml auth{0=1} v1173 ap=1 s=9561 n(v0 rc2024-03-27T07:27:24.912690+0000 b9561 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019fb:[<0x20000002049/comment-59.xml v1136>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019fb:[<0x20000002049/comment-59.xml v1173>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.294 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.072+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002165 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-16.xml auth{0=1} v941 ap=1 s=26886 n(v0 rc2024-03-27T07:26:06.873224+0000 b26886 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002165:[<0x20000002049/article-16.xml v941>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002165:[<0x20000002049/article-16.xml v941>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.294 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.072+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019e9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-77.xml auth{0=1} v1169 ap=1 s=6212 n(v0 rc2024-03-27T07:27:24.722694+0000 b6212 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019e9:[<0x20000002049/comment-77.xml v1128>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019e9:[<0x20000002049/comment-77.xml v1169>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.294 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.073+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020c1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-54.xml auth{0=1} v961 ap=1 s=7424 n(v0 rc2024-03-27T07:26:05.852244+0000 b7424 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020c1:[<0x20000002049/article-54.xml v961>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020c1:[<0x20000002049/article-54.xml v961>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.294 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.073+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-26.xml auth{0=1} v973 ap=1 s=28473 n(v0 rc2024-03-27T07:26:34.101687+0000 b28473 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd9:[<0x20000002049/article-26.xml v968>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cd9:[<0x20000002049/article-26.xml v973>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.294 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.073+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002293 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg auth{0=1} v944 ap=1 s=46089 n(v0 rc2024-03-27T07:26:07.955202+0000 b46089 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002293:[<0x20000002049/picture-15.jpg v944>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002293:[<0x20000002049/picture-15.jpg v944>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.294 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.074+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002184 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-10.xml auth{0=1} v945 ap=1 s=21993 n(v0 rc2024-03-27T07:26:06.928223+0000 b21993 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adae4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002184:[<0x20000002049/article-10.xml v945>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002184:[<0x20000002049/article-10.xml v945>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.074+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000022b2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg auth{0=1} v946 ap=1 s=27563 n(v0 rc2024-03-27T07:26:08.080200+0000 b27563 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adae4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000022b2:[<0x20000002049/picture-12.jpg v946>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000022b2:[<0x20000002049/picture-12.jpg v946>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.075+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020de [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-48.xml auth{0=1} v959 ap=1 s=23901 n(v0 rc2024-03-27T07:26:06.079239+0000 b23901 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adae5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020de:[<0x20000002049/article-48.xml v959>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020de:[<0x20000002049/article-48.xml v959>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.075+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021a8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-4.xml auth{0=1} v948 ap=1 s=9961 n(v0 rc2024-03-27T07:26:06.994221+0000 b9961 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adae5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021a8:[<0x20000002049/article-4.xml v948>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021a8:[<0x20000002049/article-4.xml v948>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.076+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000213b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-25.xml auth{0=1} v949 ap=1 s=6447 n(v0 rc2024-03-27T07:26:06.618229+0000 b6447 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adae6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000213b:[<0x20000002049/article-25.xml v949>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000213b:[<0x20000002049/article-25.xml v949>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.076+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002105 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-38.xml auth{0=1} v953 ap=1 s=1973 n(v0 rc2024-03-27T07:26:06.466232+0000 b1973 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adae6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002105:[<0x20000002049/article-38.xml v953>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002105:[<0x20000002049/article-38.xml v953>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.077+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002068 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-72.xml auth{0=1} v946 ap=1 s=11844 n(v0 rc2024-03-27T07:26:04.659267+0000 b11844 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac26e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002068:[<0x20000002049/article-72.xml v946>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002068:[<0x20000002049/article-72.xml v946>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.078+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002251 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg auth{0=1} v925 ap=1 s=16586 n(v0 rc2024-03-27T07:26:07.742207+0000 b16586 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac26ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002251:[<0x20000002049/picture-21.jpg v925>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002251:[<0x20000002049/picture-21.jpg v925>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.078+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002110 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-35.xml auth{0=1} v937 ap=1 s=6546 n(v0 rc2024-03-27T07:26:06.501231+0000 b6546 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac26f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002110:[<0x20000002049/article-35.xml v937>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002110:[<0x20000002049/article-35.xml v937>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.078+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019ed [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-73.xml auth{0=1} v1214 ap=1 s=9811 n(v0 rc2024-03-27T07:27:24.759693+0000 b9811 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac26f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019ed:[<0x20000002049/comment-73.xml v1128>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019ed:[<0x20000002049/comment-73.xml v1214>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.079+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019fa [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-60.xml auth{0=1} v1226 ap=1 s=3633 n(v0 rc2024-03-27T07:27:24.905690+0000 b3633 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd9a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019fa:[<0x20000002049/comment-60.xml v1142>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019fa:[<0x20000002049/comment-60.xml v1226>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.079+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019e7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-78.xml auth{0=1} v1230 ap=1 s=6149 n(v0 rc2024-03-27T07:27:24.707694+0000 b6149 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd9a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019e7:[<0x20000002049/comment-78.xml v1126>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019e7:[<0x20000002049/comment-78.xml v1230>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.079+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014de [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-86.xml auth v1189 ap=1 s=9304 n(v0 rc2024-03-27T07:27:11.575951+0000 b9304 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607abd9ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014de:[<0x20000002049/article-86.xml v1094>,<0x10000000399/blog-58 v115704>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000014de:[<0x20000002049/article-86.xml v1189>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.295 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.080+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020fe [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-40.xml auth{0=1} v942 ap=1 s=14051 n(v0 rc2024-03-27T07:26:06.425232+0000 b14051 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd9bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020fe:[<0x20000002049/article-40.xml v942>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020fe:[<0x20000002049/article-40.xml v942>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.080+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021f5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg auth{0=1} v935 ap=1 s=47524 n(v0 rc2024-03-27T07:26:07.231217+0000 b47524 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd9c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021f5:[<0x20000002049/picture-30.jpg v935>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021f5:[<0x20000002049/picture-30.jpg v935>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.081+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019d8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-88.xml auth{0=1} v1218 ap=1 s=9877 n(v0 rc2024-03-27T07:27:24.576696+0000 b9877 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd9c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019d8:[<0x20000002049/comment-88.xml v1106>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019d8:[<0x20000002049/comment-88.xml v1218>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.081+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000216a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-15.xml auth{0=1} v929 ap=1 s=26630 n(v0 rc2024-03-27T07:26:06.883223+0000 b26630 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd9cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000216a:[<0x20000002049/article-15.xml v929>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000216a:[<0x20000002049/article-15.xml v929>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.081+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019e4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-79.xml auth{0=1} v1222 ap=1 s=5753 n(v0 rc2024-03-27T07:27:24.686694+0000 b5753 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abd9d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019e4:[<0x20000002049/comment-79.xml v1124>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019e4:[<0x20000002049/comment-79.xml v1222>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.083+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019da [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-86.xml auth{0=1} v1220 ap=1 s=7982 n(v0 rc2024-03-27T07:27:24.615696+0000 b7982 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade7fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019da:[<0x20000002049/comment-86.xml v1108>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019da:[<0x20000002049/comment-86.xml v1220>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.083+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021cc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg auth{0=1} v940 ap=1 s=58755 n(v0 rc2024-03-27T07:26:07.074220+0000 b58755 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade80100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021cc:[<0x20000002049/picture-36.jpg v940>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021cc:[<0x20000002049/picture-36.jpg v940>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.083+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002157 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-19.xml auth{0=1} v931 ap=1 s=13335 n(v0 rc2024-03-27T07:26:06.764226+0000 b13335 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade80680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002157:[<0x20000002049/article-19.xml v931>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002157:[<0x20000002049/article-19.xml v931>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.084+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000225c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg auth{0=1} v932 ap=1 s=30372 n(v0 rc2024-03-27T07:26:07.767206+0000 b30372 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade80c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000225c:[<0x20000002049/picture-20.jpg v932>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000225c:[<0x20000002049/picture-20.jpg v932>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.084+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019e0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-82.xml auth{0=1} v1216 ap=1 s=6886 n(v0 rc2024-03-27T07:27:24.649695+0000 b6886 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade81180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019e0:[<0x20000002049/comment-82.xml v1118>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019e0:[<0x20000002049/comment-82.xml v1216>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.085+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019f7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-63.xml auth{0=1} v1228 ap=1 s=5722 n(v0 rc2024-03-27T07:27:24.881690+0000 b5722 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad06e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019f7:[<0x20000002049/comment-63.xml v1138>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019f7:[<0x20000002049/comment-63.xml v1228>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.085+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001a00 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-54.xml auth{0=1} v1232 ap=1 s=5767 n(v0 rc2024-03-27T07:27:24.971689+0000 b5767 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad06eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001a00:[<0x20000002049/comment-54.xml v1146>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001a00:[<0x20000002049/comment-54.xml v1232>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.296 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.085+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f26 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-42.xml auth{0=1} v1179 ap=1 s=6138 n(v0 rc2024-03-27T07:26:58.472208+0000 b6138 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad06f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f26:[<0x20000002049/article-42.xml v999>,<0x10000000399/blog-58 v115704>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f26:[<0x20000002049/article-42.xml v1179>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.086+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019d5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-91.xml auth{0=1} v1224 ap=1 s=5030 n(v0 rc2024-03-27T07:27:24.551697+0000 b5030 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad06fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019d5:[<0x20000002049/comment-91.xml v1102>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019d5:[<0x20000002049/comment-91.xml v1224>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.086+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d7b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg auth{0=1} v988 ap=1 s=62550 n(v0 rc2024-03-27T07:26:45.910455+0000 b62550 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad070100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d7b:[<0x20000002049/picture-38.jpg v988>,<0x10000000399/blog-58 v114254>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d7b:[<0x20000002049/picture-38.jpg v988>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.087+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002090 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-64.xml auth{0=1} v959 ap=1 s=28564 n(v0 rc2024-03-27T07:26:05.323254+0000 b28564 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adae7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002090:[<0x20000002049/article-64.xml v959>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002090:[<0x20000002049/article-64.xml v959>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.088+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002059 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-75.xml auth{0=1} v963 ap=1 s=7668 n(v0 rc2024-03-27T07:26:04.454271+0000 b7668 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6e0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002059:[<0x20000002049/article-75.xml v963>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002059:[<0x20000002049/article-75.xml v963>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.088+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002109 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-37.xml auth{0=1} v953 ap=1 s=24766 n(v0 rc2024-03-27T07:26:06.482231+0000 b24766 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6e0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002109:[<0x20000002049/article-37.xml v953>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002109:[<0x20000002049/article-37.xml v953>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.088+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002213 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg auth{0=1} v932 ap=1 s=64220 n(v0 rc2024-03-27T07:26:07.444212+0000 b64220 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6e0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002213:[<0x20000002049/picture-27.jpg v932>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002213:[<0x20000002049/picture-27.jpg v932>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.089+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002063 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-73.xml auth{0=1} v961 ap=1 s=15888 n(v0 rc2024-03-27T07:26:04.587269+0000 b15888 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6e1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002063:[<0x20000002049/article-73.xml v961>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002063:[<0x20000002049/article-73.xml v961>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.089+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002100 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-39.xml auth{0=1} v955 ap=1 s=30398 n(v0 rc2024-03-27T07:26:06.452232+0000 b30398 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6e1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002100:[<0x20000002049/article-39.xml v955>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002100:[<0x20000002049/article-39.xml v955>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.090+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000210c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-36.xml auth{0=1} v951 ap=1 s=26686 n(v0 rc2024-03-27T07:26:06.494231+0000 b26686 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607add9c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000210c:[<0x20000002049/article-36.xml v951>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000210c:[<0x20000002049/article-36.xml v951>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.090+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000217a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-12.xml auth{0=1} v936 ap=1 s=23947 n(v0 rc2024-03-27T07:26:06.910223+0000 b23947 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607add9c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000217a:[<0x20000002049/article-12.xml v936>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000217a:[<0x20000002049/article-12.xml v936>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.090+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021c0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml auth{0=1} v937 ap=1 s=14757 n(v0 rc2024-03-27T07:26:07.044220+0000 b14757 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607add9cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021c0:[<0x20000002049/article-1.xml v937>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021c0:[<0x20000002049/article-1.xml v937>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.297 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.091+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021d8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg auth{0=1} v948 ap=1 s=47794 n(v0 rc2024-03-27T07:26:07.115219+0000 b47794 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607add9db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021d8:[<0x20000002049/picture-34.jpg v948>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021d8:[<0x20000002049/picture-34.jpg v948>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.092+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002085 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-66.xml auth{0=1} v78 ap=1 s=11593 n(v0 rc2024-03-27T07:26:05.074259+0000 b11593 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607add9f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002085:[<0x20000002049/article-66.xml v78>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002085:[<0x20000002049/article-66.xml v78>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.093+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002288 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg auth{0=1} v939 ap=1 s=41274 n(v0 rc2024-03-27T07:26:07.924203+0000 b41274 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adae8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002288:[<0x20000002049/picture-16.jpg v939>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002288:[<0x20000002049/picture-16.jpg v939>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.093+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002051 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-77.xml auth{0=1} v965 ap=1 s=28899 n(v0 rc2024-03-27T07:26:04.258275+0000 b28899 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adae8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002051:[<0x20000002049/article-77.xml v965>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002051:[<0x20000002049/article-77.xml v965>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.094+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019d9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-87.xml auth{0=1} v1192 ap=1 s=2948 n(v0 rc2024-03-27T07:27:24.594696+0000 b2948 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adae9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019d9:[<0x20000002049/comment-87.xml v1098>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019d9:[<0x20000002049/comment-87.xml v1192>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.097+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000019f5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-65.xml auth{0=1} v1194 ap=1 s=5143 n(v0 rc2024-03-27T07:27:24.863691+0000 b5143 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adaeac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000019f5:[<0x20000002049/comment-65.xml v1123>,<0x10000000399/blog-58 v117602>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000019f5:[<0x20000002049/comment-65.xml v1194>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.097+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002143 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-23.xml auth{0=1} v941 ap=1 s=23420 n(v0 rc2024-03-27T07:26:06.672228+0000 b23420 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adaeb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002143:[<0x20000002049/article-23.xml v941>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002143:[<0x20000002049/article-23.xml v941>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.097+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002161 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-17.xml auth{0=1} v942 ap=1 s=20818 n(v0 rc2024-03-27T07:26:06.821225+0000 b20818 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adaeb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002161:[<0x20000002049/article-17.xml v942>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002161:[<0x20000002049/article-17.xml v942>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.097+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000021e4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg auth{0=1} v946 ap=1 s=52046 n(v0 rc2024-03-27T07:26:07.154218+0000 b52046 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acef8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000021e4:[<0x20000002049/picture-32.jpg v946>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000021e4:[<0x20000002049/picture-32.jpg v946>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.098+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002095 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-63.xml auth{0=1} v957 ap=1 s=12792 n(v0 rc2024-03-27T07:26:05.375253+0000 b12792 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acef8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002095:[<0x20000002049/article-63.xml v957>,<0x10000000399/blog-58 v95576>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002095:[<0x20000002049/article-63.xml v957>,<0x10000000399/blog-58 v131029>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.264+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000186c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-56.xml auth{0=1} v2275 ap=1 s=2356 n(v0 rc2024-03-27T07:27:19.290800+0000 b2356 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbc3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000186c:[<0x20000000ae8/comment-56.xml v2275>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000186c:[<0x20000000ae8/comment-56.xml v2275>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.265+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018dc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-5.xml auth{0=1} v2267 ap=1 s=7719 n(v0 rc2024-03-27T07:27:20.619774+0000 b7719 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ae082000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018dc:[<0x20000000ae8/comment-5.xml v2267>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018dc:[<0x20000000ae8/comment-5.xml v2267>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.298 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.265+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018af [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-29.xml auth{0=1} v2273 ap=1 s=3311 n(v0 rc2024-03-27T07:27:19.872789+0000 b3311 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ae082b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018af:[<0x20000000ae8/comment-29.xml v2273>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018af:[<0x20000000ae8/comment-29.xml v2273>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.299 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.265+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-4.jpg auth{0=1} v2025 ap=1 s=21631 n(v0 rc2024-03-27T07:26:33.547698+0000 b21631 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ae083600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd0:[<0x20000000ae8/picture-4.jpg v2011>,<0x10000000399/blog-18 v112230>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cd0:[<0x20000000ae8/picture-4.jpg v2025>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.299 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.265+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b58 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-2.jpg auth{0=1} v271 ap=1 s=25134 n(v0 rc2024-03-27T07:25:32.864893+0000 b25134 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ae083b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b58:[<0x20000000ae8/picture-2.jpg v271>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b58:[<0x20000000ae8/picture-2.jpg v271>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.299 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.265+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-20.xml auth v2027 ap=1 s=18969 n(v0 rc2024-03-27T07:26:33.555698+0000 b18969 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae084100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd1:[<0x20000000ae8/article-20.xml v2021>,<0x10000000399/blog-18 v112230>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cd1:[<0x20000000ae8/article-20.xml v2027>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.299 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.265+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-92.xml auth{0=1} v2277 ap=1 s=7665 n(v0 rc2024-03-27T07:27:18.203821+0000 b7665 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ae084c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180d:[<0x20000000ae8/comment-92.xml v2277>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000180d:[<0x20000000ae8/comment-92.xml v2277>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.299 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.266+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002163 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-94.xml auth{0=1} v1994 ap=1 s=9817 n(v0 rc2024-03-27T07:26:06.871224+0000 b9817 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ae085180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002163:[<0x20000000ae8/comment-94.xml v1994>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002163:[<0x20000000ae8/comment-94.xml v1994>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.299 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.266+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b44 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-7.jpg auth{0=1} v245 ap=1 s=44254 n(v0 rc2024-03-27T07:25:32.787895+0000 b44254 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ae085700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b44:[<0x20000000ae8/picture-7.jpg v245>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b44:[<0x20000000ae8/picture-7.jpg v245>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.307 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.266+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b3c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-9.jpg auth{0=1} v247 ap=1 s=23857 n(v0 rc2024-03-27T07:25:32.751896+0000 b23857 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b3c:[<0x20000000ae8/picture-9.jpg v247>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b3c:[<0x20000000ae8/picture-9.jpg v247>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.307 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.266+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018cb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-11.xml auth{0=1} v2269 ap=1 s=2567 n(v0 rc2024-03-27T07:27:20.446777+0000 b2567 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018cb:[<0x20000000ae8/comment-11.xml v2269>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018cb:[<0x20000000ae8/comment-11.xml v2269>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.307 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.266+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018bf [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-20.xml auth{0=1} v2271 ap=1 s=8716 n(v0 rc2024-03-27T07:27:20.084784+0000 b8716 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac9c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018bf:[<0x20000000ae8/comment-20.xml v2271>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018bf:[<0x20000000ae8/comment-20.xml v2271>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.307 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.266+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001899 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-37.xml auth{0=1} v2273 ap=1 s=2245 n(v0 rc2024-03-27T07:27:19.671793+0000 b2245 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaaef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001899:[<0x20000000ae8/comment-37.xml v2273>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001899:[<0x20000000ae8/comment-37.xml v2273>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.267+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001834 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-71.xml auth{0=1} v2281 ap=1 s=8022 n(v0 rc2024-03-27T07:27:18.553814+0000 b8022 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaaefb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001834:[<0x20000000ae8/comment-71.xml v2281>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001834:[<0x20000000ae8/comment-71.xml v2281>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.267+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000215f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-95.xml auth{0=1} v2001 ap=1 s=2961 n(v0 rc2024-03-27T07:26:06.814225+0000 b2961 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaaf0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000215f:[<0x20000000ae8/comment-95.xml v2001>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000215f:[<0x20000000ae8/comment-95.xml v2001>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.267+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b38 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-10.jpg auth{0=1} v303 ap=1 s=50433 n(v0 rc2024-03-27T07:25:32.735896+0000 b50433 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaaf0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b38:[<0x20000000ae8/picture-10.jpg v303>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b38:[<0x20000000ae8/picture-10.jpg v303>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.267+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018c5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-16.xml auth{0=1} v2263 ap=1 s=6858 n(v0 rc2024-03-27T07:27:20.404778+0000 b6858 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaaf1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018c5:[<0x20000000ae8/comment-16.xml v2263>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018c5:[<0x20000000ae8/comment-16.xml v2263>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.267+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b49 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-6.jpg auth{0=1} v277 ap=1 s=20879 n(v0 rc2024-03-27T07:25:32.804895+0000 b20879 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad60c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b49:[<0x20000000ae8/picture-6.jpg v277>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b49:[<0x20000000ae8/picture-6.jpg v277>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.267+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001866 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-58.xml auth{0=1} v2279 ap=1 s=5568 n(v0 rc2024-03-27T07:27:19.213802+0000 b5568 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad60d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001866:[<0x20000000ae8/comment-58.xml v2279>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001866:[<0x20000000ae8/comment-58.xml v2279>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.267+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000186e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-55.xml auth{0=1} v2277 ap=1 s=3807 n(v0 rc2024-03-27T07:27:19.300800+0000 b3807 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad60db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000186e:[<0x20000000ae8/comment-55.xml v2277>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000186e:[<0x20000000ae8/comment-55.xml v2277>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.268+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b5d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-1.jpg auth{0=1} v289 ap=1 s=43431 n(v0 rc2024-03-27T07:25:32.874893+0000 b43431 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaaf0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b5d:[<0x20000000ae8/picture-1.jpg v289>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b5d:[<0x20000000ae8/picture-1.jpg v289>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.268+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b06 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-9.xml auth{0=1} v267 ap=1 s=8525 n(v0 rc2024-03-27T07:25:32.583899+0000 b8525 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad60c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b06:[<0x20000000ae8/article-9.xml v267>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b06:[<0x20000000ae8/article-9.xml v267>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.268+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000188e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-41.xml auth{0=1} v2275 ap=1 s=7559 n(v0 rc2024-03-27T07:27:19.584794+0000 b7559 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac042000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000188e:[<0x20000000ae8/comment-41.xml v2275>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000188e:[<0x20000000ae8/comment-41.xml v2275>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.268+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-25.xml auth{0=1} v2269 ap=1 s=5829 n(v0 rc2024-03-27T07:27:20.016786+0000 b5829 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad60f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b9:[<0x20000000ae8/comment-25.xml v2269>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018b9:[<0x20000000ae8/comment-25.xml v2269>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.308 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.268+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000189e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-34.xml auth{0=1} v2271 ap=1 s=9324 n(v0 rc2024-03-27T07:27:19.726791+0000 b9324 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad60e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000189e:[<0x20000000ae8/comment-34.xml v2271>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000189e:[<0x20000000ae8/comment-34.xml v2271>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.268+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-75.xml auth{0=1} v2283 ap=1 s=9059 n(v0 rc2024-03-27T07:27:18.508815+0000 b9059 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac042b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182b:[<0x20000000ae8/comment-75.xml v2283>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000182b:[<0x20000000ae8/comment-75.xml v2283>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.269+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b23 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-3.xml auth{0=1} v259 ap=1 s=5628 n(v0 rc2024-03-27T07:25:32.667897+0000 b5628 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac043080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b23:[<0x20000000ae8/article-3.xml v259>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b23:[<0x20000000ae8/article-3.xml v259>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.269+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b10 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-7.xml auth{0=1} v273 ap=1 s=24103 n(v0 rc2024-03-27T07:25:32.618898+0000 b24103 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac043600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b10:[<0x20000000ae8/article-7.xml v273>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b10:[<0x20000000ae8/article-7.xml v273>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.269+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018bc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-23.xml auth{0=1} v2265 ap=1 s=5994 n(v0 rc2024-03-27T07:27:20.050785+0000 b5994 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac044100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018bc:[<0x20000000ae8/comment-23.xml v2265>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018bc:[<0x20000000ae8/comment-23.xml v2265>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.269+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018bb [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-24.xml auth{0=1} v2267 ap=1 s=9435 n(v0 rc2024-03-27T07:27:20.037785+0000 b9435 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac044c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018bb:[<0x20000000ae8/comment-24.xml v2267>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018bb:[<0x20000000ae8/comment-24.xml v2267>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.269+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002155 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-97.xml auth{0=1} v1999 ap=1 s=6742 n(v0 rc2024-03-27T07:26:06.761226+0000 b6742 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acefe680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002155:[<0x20000000ae8/comment-97.xml v1999>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002155:[<0x20000000ae8/comment-97.xml v1999>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.270+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b0b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-8.xml auth{0=1} v297 ap=1 s=16741 n(v0 rc2024-03-27T07:25:32.601899+0000 b16741 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acefec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b0b:[<0x20000000ae8/article-8.xml v297>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b0b:[<0x20000000ae8/article-8.xml v297>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.270+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001884 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-47.xml auth{0=1} v2273 ap=1 s=9058 n(v0 rc2024-03-27T07:27:19.488796+0000 b9058 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aceff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001884:[<0x20000000ae8/comment-47.xml v2273>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001884:[<0x20000000ae8/comment-47.xml v2273>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.270+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001885 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-46.xml auth{0=1} v2271 ap=1 s=4731 n(v0 rc2024-03-27T07:27:19.516796+0000 b4731 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001885:[<0x20000000ae8/comment-46.xml v2271>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001885:[<0x20000000ae8/comment-46.xml v2271>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.270+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dc6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-8.jpg auth{0=1} v301 ap=1 s=28051 n(v0 rc2024-03-27T07:25:35.397843+0000 b28051 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dc6:[<0x20000000ae8/picture-8.jpg v301>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000dc6:[<0x20000000ae8/picture-8.jpg v301>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.309 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.270+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001836 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-70.xml auth{0=1} v2281 ap=1 s=3335 n(v0 rc2024-03-27T07:27:18.571814+0000 b3335 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001836:[<0x20000000ae8/comment-70.xml v2281>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001836:[<0x20000000ae8/comment-70.xml v2281>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.271+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001817 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-83.xml auth{0=1} v2287 ap=1 s=8706 n(v0 rc2024-03-27T07:27:18.266820+0000 b8706 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001817:[<0x20000000ae8/comment-83.xml v2287>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001817:[<0x20000000ae8/comment-83.xml v2287>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.271+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002150 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-98.xml auth{0=1} v2001 ap=1 s=9435 n(v0 rc2024-03-27T07:26:06.736226+0000 b9435 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002150:[<0x20000000ae8/comment-98.xml v2001>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002150:[<0x20000000ae8/comment-98.xml v2001>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.271+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-69.xml auth{0=1} v2279 ap=1 s=4787 n(v0 rc2024-03-27T07:27:18.595814+0000 b4787 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183a:[<0x20000000ae8/comment-69.xml v2279>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000183a:[<0x20000000ae8/comment-69.xml v2279>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.271+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ecf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-32.xml auth v1997 ap=1 s=14119 n(v0 rc2024-03-27T07:25:56.484428+0000 b14119 1=1+0) | authpin=1 scrubqueue=0 0x5607aea36580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ecf:[<0x20000000ae8/article-32.xml v1997>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000001ecf:[<0x20000000ae8/article-32.xml v1997>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.271+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001810 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-89.xml auth{0=1} v2289 ap=1 s=4311 n(v0 rc2024-03-27T07:27:18.227821+0000 b4311 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001810:[<0x20000000ae8/comment-89.xml v2289>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001810:[<0x20000000ae8/comment-89.xml v2289>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.272+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-74.xml auth{0=1} v2285 ap=1 s=5629 n(v0 rc2024-03-27T07:27:18.516815+0000 b5629 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182d:[<0x20000000ae8/comment-74.xml v2285>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000182d:[<0x20000000ae8/comment-74.xml v2285>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.272+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-90.xml auth{0=1} v2291 ap=1 s=10136 n(v0 rc2024-03-27T07:27:18.220821+0000 b10136 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180f:[<0x20000000ae8/comment-90.xml v2291>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000180f:[<0x20000000ae8/comment-90.xml v2291>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.272+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000189a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-36.xml auth{0=1} v2269 ap=1 s=7474 n(v0 rc2024-03-27T07:27:19.685792+0000 b7474 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000189a:[<0x20000000ae8/comment-36.xml v2269>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000189a:[<0x20000000ae8/comment-36.xml v2269>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.272+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000af2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-13.xml auth{0=1} v253 ap=1 s=13890 n(v0 rc2024-03-27T07:25:32.520900+0000 b13890 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000af2:[<0x20000000ae8/article-13.xml v253>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000af2:[<0x20000000ae8/article-13.xml v253>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.272+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001847 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-64.xml auth{0=1} v2275 ap=1 s=8863 n(v0 rc2024-03-27T07:27:18.637813+0000 b8863 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acbe7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001847:[<0x20000000ae8/comment-64.xml v2275>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001847:[<0x20000000ae8/comment-64.xml v2275>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.310 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.272+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001831 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-72.xml auth{0=1} v2283 ap=1 s=3540 n(v0 rc2024-03-27T07:27:18.540815+0000 b3540 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf30000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001831:[<0x20000000ae8/comment-72.xml v2283>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001831:[<0x20000000ae8/comment-72.xml v2283>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.272+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018dd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-4.xml auth{0=1} v2263 ap=1 s=8296 n(v0 rc2024-03-27T07:27:20.628774+0000 b8296 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf30b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018dd:[<0x20000000ae8/comment-4.xml v2263>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018dd:[<0x20000000ae8/comment-4.xml v2263>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.273+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b14 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-6.xml auth{0=1} v243 ap=1 s=5999 n(v0 rc2024-03-27T07:25:32.630898+0000 b5999 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf31080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b14:[<0x20000000ae8/article-6.xml v243>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b14:[<0x20000000ae8/article-6.xml v243>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.273+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b29 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-2.xml auth{0=1} v249 ap=1 s=24830 n(v0 rc2024-03-27T07:25:32.682897+0000 b24830 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf31600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b29:[<0x20000000ae8/article-2.xml v249>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b29:[<0x20000000ae8/article-2.xml v249>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.273+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018c7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-14.xml auth{0=1} v2265 ap=1 s=5843 n(v0 rc2024-03-27T07:27:20.420778+0000 b5843 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf32100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018c7:[<0x20000000ae8/comment-14.xml v2265>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018c7:[<0x20000000ae8/comment-14.xml v2265>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.273+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-67.xml auth{0=1} v2277 ap=1 s=5462 n(v0 rc2024-03-27T07:27:18.610813+0000 b5462 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf32c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183f:[<0x20000000ae8/comment-67.xml v2277>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000183f:[<0x20000000ae8/comment-67.xml v2277>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.273+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018c2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-19.xml auth{0=1} v2267 ap=1 s=6155 n(v0 rc2024-03-27T07:27:20.360779+0000 b6155 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abf33700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018c2:[<0x20000000ae8/comment-19.xml v2267>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018c2:[<0x20000000ae8/comment-19.xml v2267>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.274+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001819 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-81.xml auth{0=1} v2132 ap=1 s=8225 n(v0 rc2024-03-27T07:27:18.339819+0000 b8225 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac83f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001819:[<0x20000000ae8/comment-81.xml v2132>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001819:[<0x20000000ae8/comment-81.xml v2132>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.274+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018cd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-10.xml auth{0=1} v2257 ap=1 s=3574 n(v0 rc2024-03-27T07:27:20.462777+0000 b3574 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac840680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018cd:[<0x20000000ae8/comment-10.xml v2257>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018cd:[<0x20000000ae8/comment-10.xml v2257>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.274+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b55 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-3.jpg auth{0=1} v255 ap=1 s=9248 n(v0 rc2024-03-27T07:25:32.849894+0000 b9248 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac840c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b55:[<0x20000000ae8/picture-3.jpg v255>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b55:[<0x20000000ae8/picture-3.jpg v255>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.274+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001871 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-53.xml auth{0=1} v2265 ap=1 s=5967 n(v0 rc2024-03-27T07:27:19.330799+0000 b5967 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac841700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001871:[<0x20000000ae8/comment-53.xml v2265>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001871:[<0x20000000ae8/comment-53.xml v2265>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.274+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018d8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-6.xml auth{0=1} v2253 ap=1 s=9017 n(v0 rc2024-03-27T07:27:20.602774+0000 b9017 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf32b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018d8:[<0x20000000ae8/comment-6.xml v2253>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018d8:[<0x20000000ae8/comment-6.xml v2253>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.311 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.274+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001814 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-85.xml auth{0=1} v2275 ap=1 s=8029 n(v0 rc2024-03-27T07:27:18.250820+0000 b8029 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf33600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001814:[<0x20000000ae8/comment-85.xml v2275>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001814:[<0x20000000ae8/comment-85.xml v2275>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.275+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b35 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-11.jpg auth{0=1} v239 ap=1 s=10150 n(v0 rc2024-03-27T07:25:32.716896+0000 b10150 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf33b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b35:[<0x20000000ae8/picture-11.jpg v239>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b35:[<0x20000000ae8/picture-11.jpg v239>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.275+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b19 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-5.xml auth{0=1} v251 ap=1 s=9362 n(v0 rc2024-03-27T07:25:32.641898+0000 b9362 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf34100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b19:[<0x20000000ae8/article-5.xml v251>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b19:[<0x20000000ae8/article-5.xml v251>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.275+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000189b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-35.xml auth{0=1} v2261 ap=1 s=5715 n(v0 rc2024-03-27T07:27:19.699792+0000 b5715 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf34c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000189b:[<0x20000000ae8/comment-35.xml v2261>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000189b:[<0x20000000ae8/comment-35.xml v2261>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.275+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-28.xml auth{0=1} v2259 ap=1 s=7513 n(v0 rc2024-03-27T07:27:19.904788+0000 b7513 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf35700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b1:[<0x20000000ae8/comment-28.xml v2259>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018b1:[<0x20000000ae8/comment-28.xml v2259>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.275+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000186b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-57.xml auth{0=1} v2267 ap=1 s=9626 n(v0 rc2024-03-27T07:27:19.256801+0000 b9626 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aadec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000186b:[<0x20000000ae8/comment-57.xml v2267>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000186b:[<0x20000000ae8/comment-57.xml v2267>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.276+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001852 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-61.xml auth{0=1} v2269 ap=1 s=6236 n(v0 rc2024-03-27T07:27:18.668812+0000 b6236 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaded080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001852:[<0x20000000ae8/comment-61.xml v2269>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001852:[<0x20000000ae8/comment-61.xml v2269>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.276+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cd4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-22.xml auth v2028 ap=1 s=2462 n(v0 rc2024-03-27T07:26:34.021689+0000 b2462 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aaded600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cd4:[<0x20000000ae8/article-22.xml v2024>,<0x10000000399/blog-18 v112230>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cd4:[<0x20000000ae8/article-22.xml v2028>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.276+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001895 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-38.xml auth{0=1} v2263 ap=1 s=8942 n(v0 rc2024-03-27T07:27:19.642793+0000 b8942 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aadee100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001895:[<0x20000000ae8/comment-38.xml v2263>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001895:[<0x20000000ae8/comment-38.xml v2263>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.276+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-68.xml auth{0=1} v2271 ap=1 s=4881 n(v0 rc2024-03-27T07:27:18.601814+0000 b4881 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aadeec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183c:[<0x20000000ae8/comment-68.xml v2271>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000183c:[<0x20000000ae8/comment-68.xml v2271>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.276+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018cf [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-8.xml auth{0=1} v2255 ap=1 s=7391 n(v0 rc2024-03-27T07:27:20.496776+0000 b7391 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafde000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018cf:[<0x20000000ae8/comment-8.xml v2255>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018cf:[<0x20000000ae8/comment-8.xml v2255>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.276+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-80.xml auth{0=1} v2273 ap=1 s=6973 n(v0 rc2024-03-27T07:27:18.417817+0000 b6973 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafdeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181f:[<0x20000000ae8/comment-80.xml v2273>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000181f:[<0x20000000ae8/comment-80.xml v2273>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.312 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.276+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000aeb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-14.xml auth{0=1} v269 ap=1 s=2565 n(v0 rc2024-03-27T07:25:32.503900+0000 b2565 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000aeb:[<0x20000000ae8/article-14.xml v269>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000aeb:[<0x20000000ae8/article-14.xml v269>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.277+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000184f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-62.xml auth{0=1} v2233 ap=1 s=7262 n(v0 rc2024-03-27T07:27:18.657812+0000 b7262 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3dc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000184f:[<0x20000000ae8/comment-62.xml v2233>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000184f:[<0x20000000ae8/comment-62.xml v2233>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.277+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000afc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-11.xml auth{0=1} v275 ap=1 s=3928 n(v0 rc2024-03-27T07:25:32.547900+0000 b3928 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3dcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000afc:[<0x20000000ae8/article-11.xml v275>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000afc:[<0x20000000ae8/article-11.xml v275>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.277+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001863 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-59.xml auth{0=1} v2231 ap=1 s=4563 n(v0 rc2024-03-27T07:27:19.141803+0000 b4563 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3dd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001863:[<0x20000000ae8/comment-59.xml v2231>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001863:[<0x20000000ae8/comment-59.xml v2231>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.277+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001828 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-77.xml auth{0=1} v2235 ap=1 s=2668 n(v0 rc2024-03-27T07:27:18.496816+0000 b2668 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3de100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001828:[<0x20000000ae8/comment-77.xml v2235>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001828:[<0x20000000ae8/comment-77.xml v2235>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.277+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001f0f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-93.xml auth v1995 ap=1 s=27095 n(v0 rc2024-03-27T07:25:59.179375+0000 b27095 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ac3dec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001f0f:[<0x20000000ae8/article-93.xml v1995>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000001f0f:[<0x20000000ae8/article-93.xml v1995>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.278+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b00 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-10.xml auth{0=1} v287 ap=1 s=13387 n(v0 rc2024-03-27T07:25:32.566899+0000 b13387 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b00:[<0x20000000ae8/article-10.xml v287>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b00:[<0x20000000ae8/article-10.xml v287>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.278+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001881 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-48.xml auth{0=1} v2227 ap=1 s=5521 n(v0 rc2024-03-27T07:27:19.462797+0000 b5521 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5a3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001881:[<0x20000000ae8/comment-48.xml v2227>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001881:[<0x20000000ae8/comment-48.xml v2227>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.278+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000187a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-50.xml auth{0=1} v2229 ap=1 s=6835 n(v0 rc2024-03-27T07:27:19.430797+0000 b6835 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5a2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000187a:[<0x20000000ae8/comment-50.xml v2229>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000187a:[<0x20000000ae8/comment-50.xml v2229>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.278+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b1f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-4.xml auth{0=1} v241 ap=1 s=6303 n(v0 rc2024-03-27T07:25:32.654897+0000 b6303 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b1f:[<0x20000000ae8/article-4.xml v241>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b1f:[<0x20000000ae8/article-4.xml v241>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.278+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b30 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-12.jpg auth{0=1} v291 ap=1 s=46535 n(v0 rc2024-03-27T07:25:32.705896+0000 b46535 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac3df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b30:[<0x20000000ae8/picture-12.jpg v291>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b30:[<0x20000000ae8/picture-12.jpg v291>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.313 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.278+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-31.xml auth{0=1} v2225 ap=1 s=5769 n(v0 rc2024-03-27T07:27:19.802790+0000 b5769 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5a4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a6:[<0x20000000ae8/comment-31.xml v2225>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018a6:[<0x20000000ae8/comment-31.xml v2225>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.279+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000dcb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-35.xml auth v281 ap=1 s=24495 n(v0 rc2024-03-27T07:25:35.407843+0000 b24495 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad56fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000dcb:[<0x20000000ae8/article-35.xml v281>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000dcb:[<0x20000000ae8/article-35.xml v281>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.279+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-73.xml auth{0=1} v2294 ap=1 s=5547 n(v0 rc2024-03-27T07:27:18.529815+0000 b5547 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad570680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182f:[<0x20000000ae8/comment-73.xml v2294>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000182f:[<0x20000000ae8/comment-73.xml v2294>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.279+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001854 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-60.xml auth{0=1} v2290 ap=1 s=7634 n(v0 rc2024-03-27T07:27:18.686812+0000 b7634 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad571180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001854:[<0x20000000ae8/comment-60.xml v2290>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001854:[<0x20000000ae8/comment-60.xml v2290>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.279+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001824 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-78.xml auth{0=1} v2296 ap=1 s=8747 n(v0 rc2024-03-27T07:27:18.488816+0000 b8747 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab668000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001824:[<0x20000000ae8/comment-78.xml v2296>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001824:[<0x20000000ae8/comment-78.xml v2296>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.279+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-1.xml auth{0=1} v2278 ap=1 s=5034 n(v0 rc2024-03-27T07:27:20.662773+0000 b5034 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab669080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e0:[<0x20000000ae8/comment-1.xml v2278>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018e0:[<0x20000000ae8/comment-1.xml v2278>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.279+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000215a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-96.xml auth{0=1} v1998 ap=1 s=3122 n(v0 rc2024-03-27T07:26:06.789225+0000 b3122 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab669600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000215a:[<0x20000000ae8/comment-96.xml v1998>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000215a:[<0x20000000ae8/comment-96.xml v1998>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.280+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001811 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-88.xml auth{0=1} v2304 ap=1 s=8960 n(v0 rc2024-03-27T07:27:18.232821+0000 b8960 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab66a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001811:[<0x20000000ae8/comment-88.xml v2304>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001811:[<0x20000000ae8/comment-88.xml v2304>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.280+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001823 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-79.xml auth{0=1} v2298 ap=1 s=7484 n(v0 rc2024-03-27T07:27:18.461816+0000 b7484 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab66ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001823:[<0x20000000ae8/comment-79.xml v2298>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001823:[<0x20000000ae8/comment-79.xml v2298>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.280+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001890 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-40.xml auth{0=1} v2286 ap=1 s=8880 n(v0 rc2024-03-27T07:27:19.615794+0000 b8880 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab66b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001890:[<0x20000000ae8/comment-40.xml v2286>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001890:[<0x20000000ae8/comment-40.xml v2286>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.280+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-33.xml auth{0=1} v2282 ap=1 s=5273 n(v0 rc2024-03-27T07:27:19.754791+0000 b5273 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8f6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a0:[<0x20000000ae8/comment-33.xml v2282>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018a0:[<0x20000000ae8/comment-33.xml v2282>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.280+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001894 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-39.xml auth{0=1} v2284 ap=1 s=5417 n(v0 rc2024-03-27T07:27:19.628793+0000 b5417 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8f7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001894:[<0x20000000ae8/comment-39.xml v2284>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001894:[<0x20000000ae8/comment-39.xml v2284>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.314 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.280+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001813 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-86.xml auth{0=1} v2302 ap=1 s=3059 n(v0 rc2024-03-27T07:27:18.245821+0000 b3059 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001813:[<0x20000000ae8/comment-86.xml v2302>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001813:[<0x20000000ae8/comment-86.xml v2302>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.281+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001818 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-82.xml auth{0=1} v2300 ap=1 s=6686 n(v0 rc2024-03-27T07:27:18.277820+0000 b6686 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8f8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001818:[<0x20000000ae8/comment-82.xml v2300>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001818:[<0x20000000ae8/comment-82.xml v2300>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.281+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-32.xml auth{0=1} v2280 ap=1 s=3920 n(v0 rc2024-03-27T07:27:19.773791+0000 b3920 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad8f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a4:[<0x20000000ae8/comment-32.xml v2280>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018a4:[<0x20000000ae8/comment-32.xml v2280>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.281+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000184b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-63.xml auth{0=1} v2292 ap=1 s=4894 n(v0 rc2024-03-27T07:27:18.647813+0000 b4894 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000184b:[<0x20000000ae8/comment-63.xml v2292>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000184b:[<0x20000000ae8/comment-63.xml v2292>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.281+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001870 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-54.xml auth{0=1} v2288 ap=1 s=7281 n(v0 rc2024-03-27T07:27:19.316800+0000 b7281 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3d6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001870:[<0x20000000ae8/comment-54.xml v2288>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001870:[<0x20000000ae8/comment-54.xml v2288>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.281+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-91.xml auth{0=1} v2306 ap=1 s=8115 n(v0 rc2024-03-27T07:27:18.212821+0000 b8115 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180e:[<0x20000000ae8/comment-91.xml v2306>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000180e:[<0x20000000ae8/comment-91.xml v2306>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.282+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018be [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-21.xml auth{0=1} v2286 ap=1 s=5595 n(v0 rc2024-03-27T07:27:20.070785+0000 b5595 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3d8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018be:[<0x20000000ae8/comment-21.xml v2286>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018be:[<0x20000000ae8/comment-21.xml v2286>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.282+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018c8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-13.xml auth{0=1} v2282 ap=1 s=6524 n(v0 rc2024-03-27T07:27:20.428778+0000 b6524 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018c8:[<0x20000000ae8/comment-13.xml v2282>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018c8:[<0x20000000ae8/comment-13.xml v2282>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.282+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-26.xml auth{0=1} v2288 ap=1 s=3681 n(v0 rc2024-03-27T07:27:19.981786+0000 b3681 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b5:[<0x20000000ae8/comment-26.xml v2288>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018b5:[<0x20000000ae8/comment-26.xml v2288>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.282+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000020d1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-1.xml auth{0=1} v1995 ap=1 s=26235 n(v0 rc2024-03-27T07:26:05.993241+0000 b26235 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000020d1:[<0x20000000ae8/article-1.xml v1995>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x200000020d1:[<0x20000000ae8/article-1.xml v1995>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.282+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000af6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-12.xml auth{0=1} v257 ap=1 s=29968 n(v0 rc2024-03-27T07:25:32.531900+0000 b29968 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000af6:[<0x20000000ae8/article-12.xml v257>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000af6:[<0x20000000ae8/article-12.xml v257>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.282+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018aa [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-30.xml auth{0=1} v2290 ap=1 s=3154 n(v0 rc2024-03-27T07:27:19.822790+0000 b3154 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018aa:[<0x20000000ae8/comment-30.xml v2290>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018aa:[<0x20000000ae8/comment-30.xml v2290>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.315 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.282+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018de [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-3.xml auth{0=1} v2278 ap=1 s=3644 n(v0 rc2024-03-27T07:27:20.640774+0000 b3644 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018de:[<0x20000000ae8/comment-3.xml v2278>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018de:[<0x20000000ae8/comment-3.xml v2278>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.283+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018c3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-18.xml auth{0=1} v2284 ap=1 s=5112 n(v0 rc2024-03-27T07:27:20.384779+0000 b5112 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac7c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018c3:[<0x20000000ae8/comment-18.xml v2284>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018c3:[<0x20000000ae8/comment-18.xml v2284>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.283+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018c9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-12.xml auth{0=1} v2280 ap=1 s=2307 n(v0 rc2024-03-27T07:27:20.437778+0000 b2307 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade6e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018c9:[<0x20000000ae8/comment-12.xml v2280>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018c9:[<0x20000000ae8/comment-12.xml v2280>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.283+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001880 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-49.xml auth{0=1} v2294 ap=1 s=5521 n(v0 rc2024-03-27T07:27:19.444797+0000 b5521 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade6eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001880:[<0x20000000ae8/comment-49.xml v2294>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001880:[<0x20000000ae8/comment-49.xml v2294>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.283+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001812 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-87.xml auth{0=1} v2300 ap=1 s=3348 n(v0 rc2024-03-27T07:27:18.238821+0000 b3348 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade6f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001812:[<0x20000000ae8/comment-87.xml v2300>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001812:[<0x20000000ae8/comment-87.xml v2300>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.283+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000188c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-42.xml auth{0=1} v2292 ap=1 s=5393 n(v0 rc2024-03-27T07:27:19.567795+0000 b5393 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade70100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000188c:[<0x20000000ae8/comment-42.xml v2292>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000188c:[<0x20000000ae8/comment-42.xml v2292>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.283+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001845 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-65.xml auth{0=1} v2298 ap=1 s=3323 n(v0 rc2024-03-27T07:27:18.628813+0000 b3323 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade70c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001845:[<0x20000000ae8/comment-65.xml v2298>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001845:[<0x20000000ae8/comment-65.xml v2298>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.284+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002146 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-100.xml auth{0=1} v1997 ap=1 s=9389 n(v0 rc2024-03-27T07:26:06.687227+0000 b9389 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade71180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002146:[<0x20000000ae8/comment-100.xml v1997>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002146:[<0x20000000ae8/comment-100.xml v1997>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.284+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001876 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-51.xml auth{0=1} v2296 ap=1 s=5218 n(v0 rc2024-03-27T07:27:19.380798+0000 b5218 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad980000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001876:[<0x20000000ae8/comment-51.xml v2296>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001876:[<0x20000000ae8/comment-51.xml v2296>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.284+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018bd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-22.xml auth{0=1} v2278 ap=1 s=2502 n(v0 rc2024-03-27T07:27:20.060785+0000 b2502 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad055180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018bd:[<0x20000000ae8/comment-22.xml v2278>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018bd:[<0x20000000ae8/comment-22.xml v2278>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.284+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018df [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-2.xml auth{0=1} v2268 ap=1 s=6144 n(v0 rc2024-03-27T07:27:20.653773+0000 b6144 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac1ae000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018df:[<0x20000000ae8/comment-2.xml v2268>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018df:[<0x20000000ae8/comment-2.xml v2268>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.284+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001889 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-44.xml auth{0=1} v2284 ap=1 s=5312 n(v0 rc2024-03-27T07:27:19.550795+0000 b5312 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac1aeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001889:[<0x20000000ae8/comment-44.xml v2284>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001889:[<0x20000000ae8/comment-44.xml v2284>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.316 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.285+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000180c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-93.xml auth{0=1} v2296 ap=1 s=4781 n(v0 rc2024-03-27T07:27:18.193822+0000 b4781 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac1af600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000180c:[<0x20000000ae8/comment-93.xml v2296>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000180c:[<0x20000000ae8/comment-93.xml v2296>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.285+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b4c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-5.jpg auth{0=1} v299 ap=1 s=10281 n(v0 rc2024-03-27T07:25:32.824894+0000 b10281 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac1afb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b4c:[<0x20000000ae8/picture-5.jpg v299>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000000b4c:[<0x20000000ae8/picture-5.jpg v299>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.285+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-27.xml auth{0=1} v2280 ap=1 s=7796 n(v0 rc2024-03-27T07:27:19.954787+0000 b7796 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac1b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b3:[<0x20000000ae8/comment-27.xml v2280>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018b3:[<0x20000000ae8/comment-27.xml v2280>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.285+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-76.xml auth{0=1} v2292 ap=1 s=7281 n(v0 rc2024-03-27T07:27:18.501815+0000 b7281 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac1b1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182a:[<0x20000000ae8/comment-76.xml v2292>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000182a:[<0x20000000ae8/comment-76.xml v2292>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.285+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001874 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-52.xml auth{0=1} v2288 ap=1 s=8768 n(v0 rc2024-03-27T07:27:19.349799+0000 b8768 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad394000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001874:[<0x20000000ae8/comment-52.xml v2288>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001874:[<0x20000000ae8/comment-52.xml v2288>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.285+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001841 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-66.xml auth{0=1} v2290 ap=1 s=4446 n(v0 rc2024-03-27T07:27:18.620813+0000 b4446 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad394b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001841:[<0x20000000ae8/comment-66.xml v2290>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001841:[<0x20000000ae8/comment-66.xml v2290>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.286+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018d1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-7.xml auth{0=1} v2270 ap=1 s=4562 n(v0 rc2024-03-27T07:27:20.553775+0000 b4562 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad395600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018d1:[<0x20000000ae8/comment-7.xml v2270>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018d1:[<0x20000000ae8/comment-7.xml v2270>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.286+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018c6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-15.xml auth{0=1} v2274 ap=1 s=5196 n(v0 rc2024-03-27T07:27:20.412778+0000 b5196 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad396100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018c6:[<0x20000000ae8/comment-15.xml v2274>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018c6:[<0x20000000ae8/comment-15.xml v2274>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.286+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d43 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-53.xml auth v2034 ap=1 s=16682 n(v0 rc2024-03-27T07:26:45.357466+0000 b16682 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad396680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d43:[<0x20000000ae8/article-53.xml v2034>,<0x10000000399/blog-18 v114248>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d43:[<0x20000000ae8/article-53.xml v2034>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.286+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000188b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-43.xml auth{0=1} v2282 ap=1 s=9488 n(v0 rc2024-03-27T07:27:19.559795+0000 b9488 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad397180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000188b:[<0x20000000ae8/comment-43.xml v2282>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000188b:[<0x20000000ae8/comment-43.xml v2282>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.286+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018c4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-17.xml auth{0=1} v2276 ap=1 s=4559 n(v0 rc2024-03-27T07:27:20.397778+0000 b4559 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade0a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018c4:[<0x20000000ae8/comment-17.xml v2276>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018c4:[<0x20000000ae8/comment-17.xml v2276>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.286+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018ce [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-9.xml auth{0=1} v2272 ap=1 s=4883 n(v0 rc2024-03-27T07:27:20.472777+0000 b4883 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade0ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018ce:[<0x20000000ae8/comment-9.xml v2272>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018ce:[<0x20000000ae8/comment-9.xml v2272>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.287+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000214b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-99.xml auth{0=1} v2011 ap=1 s=10058 n(v0 rc2024-03-27T07:26:06.717227+0000 b10058 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade0b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000214b:[<0x20000000ae8/comment-99.xml v2011>,<0x10000000399/blog-18 v95616>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000214b:[<0x20000000ae8/comment-99.xml v2011>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.317 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.287+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001888 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-45.xml auth{0=1} v2286 ap=1 s=9711 n(v0 rc2024-03-27T07:27:19.533795+0000 b9711 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade0bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001888:[<0x20000000ae8/comment-45.xml v2286>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001888:[<0x20000000ae8/comment-45.xml v2286>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.318 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.287+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001815 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-84.xml auth{0=1} v2294 ap=1 s=4447 n(v0 rc2024-03-27T07:27:18.255820+0000 b4447 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade0c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001815:[<0x20000000ae8/comment-84.xml v2294>,<0x10000000399/blog-18 v117604>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001815:[<0x20000000ae8/comment-84.xml v2294>,<0x10000000399/blog-18 v118354>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.510 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.247+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a1b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-66.xml auth{0=1} v1139 ap=1 s=13495 n(v0 rc2024-03-27T07:25:31.899912+0000 b13495 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661babfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a1b:[<0x20000000a14/article-66.xml v1139>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a1b:[<0x20000000a14/article-66.xml v1139>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.680 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.248+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cab [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml auth{0=1} v1352 ap=1 s=9587 n(v0 rc2024-03-27T07:26:29.420779+0000 b9587 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a44b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cab:[<0x20000000a14/comment-12.xml v1334>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cab:[<0x20000000a14/comment-12.xml v1352>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.681 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.249+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b7d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg auth{0=1} v1153 ap=1 s=61884 n(v0 rc2024-03-27T07:25:32.978891+0000 b61884 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661babeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b7d:[<0x20000000a14/picture-16.jpg v684>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b7d:[<0x20000000a14/picture-16.jpg v1153>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.681 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.250+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fd3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg auth v1367 ap=1 s=52072 n(v0 rc2024-03-27T07:27:02.583127+0000 b52072 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661a44a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fd3:[<0x20000000a14/picture-74.jpg v1357>,<0x10000000399/blog-16 v116871>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000fd3:[<0x20000000a14/picture-74.jpg v1367>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.681 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.250+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c24 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml auth{0=1} v1282 ap=1 s=5556 n(v0 rc2024-03-27T07:26:17.247019+0000 b5556 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a449b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c24:[<0x20000000a14/comment-49.xml v1282>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c24:[<0x20000000a14/comment-49.xml v1282>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.681 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.251+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c2b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml auth{0=1} v1284 ap=1 s=5697 n(v0 rc2024-03-27T07:26:17.326018+0000 b5697 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a449080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c2b:[<0x20000000a14/comment-42.xml v1284>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c2b:[<0x20000000a14/comment-42.xml v1284>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.681 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.251+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml auth{0=1} v1161 ap=1 s=2124 n(v0 rc2024-03-27T07:25:50.159553+0000 b2124 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a448000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084a:[<0x20000000a14/comment-65.xml v740>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000084a:[<0x20000000a14/comment-65.xml v1161>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.681 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.252+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ade [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml auth{0=1} v1149 ap=1 s=8852 n(v0 rc2024-03-27T07:25:32.466901+0000 b8852 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a42c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ade:[<0x20000000a14/article-23.xml v1149>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ade:[<0x20000000a14/article-23.xml v1149>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.681 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.253+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000aff [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml auth{0=1} v1143 ap=1 s=18490 n(v0 rc2024-03-27T07:25:32.564899+0000 b18490 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a42b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000aff:[<0x20000000a14/article-17.xml v1143>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000aff:[<0x20000000a14/article-17.xml v1143>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.681 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.253+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a27 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml auth{0=1} v1145 ap=1 s=2891 n(v0 rc2024-03-27T07:25:31.951911+0000 b2891 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a42a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a27:[<0x20000000a14/article-63.xml v1145>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a27:[<0x20000000a14/article-63.xml v1145>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.682 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.254+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c22 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml auth{0=1} v1286 ap=1 s=5504 n(v0 rc2024-03-27T07:26:17.223020+0000 b5504 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5566188ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c22:[<0x20000000a14/comment-51.xml v1286>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c22:[<0x20000000a14/comment-51.xml v1286>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.682 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.255+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a4b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml auth{0=1} v1130 ap=1 s=28197 n(v0 rc2024-03-27T07:25:32.099908+0000 b28197 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619bd3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a4b:[<0x20000000a14/article-55.xml v1130>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a4b:[<0x20000000a14/article-55.xml v1130>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.682 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.255+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b57 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg auth{0=1} v1142 ap=1 s=37130 n(v0 rc2024-03-27T07:25:32.862893+0000 b37130 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619bd2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b57:[<0x20000000a14/picture-25.jpg v627>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b57:[<0x20000000a14/picture-25.jpg v1142>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.682 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.256+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b2c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml auth{0=1} v1140 ap=1 s=24583 n(v0 rc2024-03-27T07:25:32.692897+0000 b24583 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619bd1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b2c:[<0x20000000a14/article-8.xml v628>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b2c:[<0x20000000a14/article-8.xml v1140>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.682 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.256+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c26 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml auth{0=1} v1277 ap=1 s=7028 n(v0 rc2024-03-27T07:26:17.271019+0000 b7028 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a327080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c26:[<0x20000000a14/comment-47.xml v1277>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c26:[<0x20000000a14/comment-47.xml v1277>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.682 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.257+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c27 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml auth{0=1} v1275 ap=1 s=5549 n(v0 rc2024-03-27T07:26:17.281019+0000 b5549 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0cf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c27:[<0x20000000a14/comment-46.xml v1275>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c27:[<0x20000000a14/comment-46.xml v1275>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.682 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.257+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000845 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml auth{0=1} v1163 ap=1 s=2485 n(v0 rc2024-03-27T07:25:50.050555+0000 b2485 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0cec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000845:[<0x20000000a14/comment-70.xml v710>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000845:[<0x20000000a14/comment-70.xml v1163>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.682 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.258+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b9d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg auth{0=1} v1136 ap=1 s=53511 n(v0 rc2024-03-27T07:25:33.077889+0000 b53511 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b0ce100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b9d:[<0x20000000a14/picture-8.jpg v1136>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b9d:[<0x20000000a14/picture-8.jpg v1136>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.682 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.258+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018e1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg auth v1366 ap=1 s=28389 n(v0 rc2024-03-27T07:27:20.726772+0000 b28389 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661b0cd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018e1:[<0x20000000a14/picture-88.jpg v1362>,<0x10000000399/blog-16 v116871>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018e1:[<0x20000000a14/picture-88.jpg v1366>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.693 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.259+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b54 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg auth{0=1} v1120 ap=1 s=59925 n(v0 rc2024-03-27T07:25:32.848894+0000 b59925 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b304b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b54:[<0x20000000a14/picture-26.jpg v1120>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b54:[<0x20000000a14/picture-26.jpg v1120>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.694 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.259+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000aaa [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml auth{0=1} v1132 ap=1 s=16271 n(v0 rc2024-03-27T07:25:32.327904+0000 b16271 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca42000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000aaa:[<0x20000000a14/article-32.xml v1132>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000aaa:[<0x20000000a14/article-32.xml v1132>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.694 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.259+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000846 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml auth{0=1} v1152 ap=1 s=3238 n(v0 rc2024-03-27T07:25:50.059555+0000 b3238 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca42580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000846:[<0x20000000a14/comment-69.xml v716>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000846:[<0x20000000a14/comment-69.xml v1152>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.694 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.260+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ae9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml auth{0=1} v1126 ap=1 s=18848 n(v0 rc2024-03-27T07:25:32.501900+0000 b18848 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca42b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ae9:[<0x20000000a14/article-21.xml v1126>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ae9:[<0x20000000a14/article-21.xml v1126>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.694 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.260+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ab4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml auth{0=1} v1128 ap=1 s=20343 n(v0 rc2024-03-27T07:25:32.347904+0000 b20343 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca43080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ab4:[<0x20000000a14/article-30.xml v1128>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ab4:[<0x20000000a14/article-30.xml v1128>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.694 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.261+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c31 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml auth{0=1} v1281 ap=1 s=6189 n(v0 rc2024-03-27T07:26:17.391016+0000 b6189 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca43600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c31:[<0x20000000a14/comment-36.xml v1281>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c31:[<0x20000000a14/comment-36.xml v1281>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.694 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.261+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b13 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml auth{0=1} v1118 ap=1 s=8974 n(v0 rc2024-03-27T07:25:32.628898+0000 b8974 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca43b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b13:[<0x20000000a14/article-13.xml v1118>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b13:[<0x20000000a14/article-13.xml v1118>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.694 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.262+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml auth{0=1} v1154 ap=1 s=5466 n(v0 rc2024-03-27T07:25:50.170553+0000 b5466 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca44100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084b:[<0x20000000a14/comment-64.xml v746>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000084b:[<0x20000000a14/comment-64.xml v1154>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.694 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.262+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000843 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml auth{0=1} v1158 ap=1 s=8961 n(v0 rc2024-03-27T07:25:50.024556+0000 b8961 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca44680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000843:[<0x20000000a14/comment-72.xml v698>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000843:[<0x20000000a14/comment-72.xml v1158>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.694 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.263+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml auth{0=1} v1343 ap=1 s=4915 n(v0 rc2024-03-27T07:26:29.487778+0000 b4915 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca44c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb3:[<0x20000000a14/comment-4.xml v1332>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb3:[<0x20000000a14/comment-4.xml v1343>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.694 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.263+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000925 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml auth{0=1} v1271 ap=1 s=9303 n(v0 rc2024-03-27T07:25:59.708365+0000 b9303 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca45180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000925:[<0x20000000a14/article-50.xml v1169>,<0x10000000399/blog-16 v63051>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x10000000925:[<0x20000000a14/article-50.xml v1271>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.264+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b34 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml auth{0=1} v1124 ap=1 s=31966 n(v0 rc2024-03-27T07:25:32.715896+0000 b31966 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca45700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b34:[<0x20000000a14/article-6.xml v1124>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b34:[<0x20000000a14/article-6.xml v1124>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.264+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b43 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml auth{0=1} v1122 ap=1 s=4973 n(v0 rc2024-03-27T07:25:32.785895+0000 b4973 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b43:[<0x20000000a14/article-2.xml v1122>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b43:[<0x20000000a14/article-2.xml v1122>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.265+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml auth{0=1} v1341 ap=1 s=7442 n(v0 rc2024-03-27T07:26:29.392780+0000 b7442 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df7c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca9:[<0x20000000a14/comment-14.xml v1312>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ca9:[<0x20000000a14/comment-14.xml v1341>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.266+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000848 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml auth{0=1} v1146 ap=1 s=9685 n(v0 rc2024-03-27T07:25:50.086554+0000 b9685 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df7cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000848:[<0x20000000a14/comment-67.xml v728>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000848:[<0x20000000a14/comment-67.xml v1146>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.266+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c9f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml auth{0=1} v1339 ap=1 s=6999 n(v0 rc2024-03-27T07:26:28.725793+0000 b6999 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df7d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c9f:[<0x20000000a14/comment-19.xml v1309>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000c9f:[<0x20000000a14/comment-19.xml v1339>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.267+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a47 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml auth{0=1} v1116 ap=1 s=13526 n(v0 rc2024-03-27T07:25:32.086909+0000 b13526 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df7d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a47:[<0x20000000a14/article-56.xml v1116>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a47:[<0x20000000a14/article-56.xml v1116>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.289+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c9a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml auth{0=1} v1359 ap=1 s=9928 n(v0 rc2024-03-27T07:26:28.295802+0000 b9928 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf86680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c9a:[<0x20000000a14/comment-22.xml v1300>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000c9a:[<0x20000000a14/comment-22.xml v1359>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.290+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml auth{0=1} v1353 ap=1 s=5859 n(v0 rc2024-03-27T07:26:29.505778+0000 b5859 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf86c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb5:[<0x20000000a14/comment-2.xml v1336>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb5:[<0x20000000a14/comment-2.xml v1353>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.290+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c29 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml auth{0=1} v1283 ap=1 s=4591 n(v0 rc2024-03-27T07:26:17.308018+0000 b4591 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf87180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c29:[<0x20000000a14/comment-44.xml v1283>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c29:[<0x20000000a14/comment-44.xml v1283>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.290+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d00 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-100.xml auth v1363 ap=1 s=17792 n(v0 rc2024-03-27T07:26:42.144529+0000 b17792 1=1+0) | authpin=1 scrubqueue=0 0x55661e21fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d00:[<0x20000000a14/article-100.xml v1363>,<0x10000000399/blog-16 v113439>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d00:[<0x20000000a14/article-100.xml v1363>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.290+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a7b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml auth{0=1} v1129 ap=1 s=13687 n(v0 rc2024-03-27T07:25:32.222906+0000 b13687 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf87700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a7b:[<0x20000000a14/article-43.xml v1129>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a7b:[<0x20000000a14/article-43.xml v1129>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.695 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.291+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000aa5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml auth{0=1} v1131 ap=1 s=2698 n(v0 rc2024-03-27T07:25:32.318904+0000 b2698 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000aa5:[<0x20000000a14/article-33.xml v1131>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000aa5:[<0x20000000a14/article-33.xml v1131>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.291+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bad [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg auth{0=1} v1133 ap=1 s=33003 n(v0 rc2024-03-27T07:25:33.138888+0000 b33003 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bad:[<0x20000000a14/picture-5.jpg v1133>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bad:[<0x20000000a14/picture-5.jpg v1133>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.291+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c3a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml auth{0=1} v1279 ap=1 s=3277 n(v0 rc2024-03-27T07:26:17.482015+0000 b3277 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c3a:[<0x20000000a14/comment-27.xml v1279>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c3a:[<0x20000000a14/comment-27.xml v1279>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.292+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a40 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml auth{0=1} v1135 ap=1 s=4349 n(v0 rc2024-03-27T07:25:32.070909+0000 b4349 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a40:[<0x20000000a14/article-57.xml v1135>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a40:[<0x20000000a14/article-57.xml v1135>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.292+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c21 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml auth{0=1} v1291 ap=1 s=9079 n(v0 rc2024-03-27T07:26:17.204020+0000 b9079 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c21:[<0x20000000a14/comment-52.xml v1291>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c21:[<0x20000000a14/comment-52.xml v1291>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.293+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000849 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml auth{0=1} v1139 ap=1 s=9685 n(v0 rc2024-03-27T07:25:50.123554+0000 b9685 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000849:[<0x20000000a14/comment-66.xml v734>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000849:[<0x20000000a14/comment-66.xml v1139>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.294+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml auth{0=1} v1355 ap=1 s=9836 n(v0 rc2024-03-27T07:26:29.465779+0000 b9836 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb0:[<0x20000000a14/comment-7.xml v1328>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb0:[<0x20000000a14/comment-7.xml v1355>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.294+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml auth{0=1} v1357 ap=1 s=8870 n(v0 rc2024-03-27T07:26:29.310782+0000 b8870 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca7:[<0x20000000a14/comment-15.xml v1306>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ca7:[<0x20000000a14/comment-15.xml v1357>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.295+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a3b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml auth{0=1} v1121 ap=1 s=25506 n(v0 rc2024-03-27T07:25:32.041910+0000 b25506 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a3b:[<0x20000000a14/article-58.xml v1121>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a3b:[<0x20000000a14/article-58.xml v1121>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.295+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a53 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml auth{0=1} v1127 ap=1 s=17345 n(v0 rc2024-03-27T07:25:32.120908+0000 b17345 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a53:[<0x20000000a14/article-53.xml v1127>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a53:[<0x20000000a14/article-53.xml v1127>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.296+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c2a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml auth{0=1} v1289 ap=1 s=3449 n(v0 rc2024-03-27T07:26:17.317018+0000 b3449 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b92f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c2a:[<0x20000000a14/comment-43.xml v1289>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c2a:[<0x20000000a14/comment-43.xml v1289>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.297+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ca3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml auth{0=1} v1361 ap=1 s=3779 n(v0 rc2024-03-27T07:26:28.959789+0000 b3779 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ca3:[<0x20000000a14/comment-17.xml v1303>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ca3:[<0x20000000a14/comment-17.xml v1361>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.696 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.298+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a57 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml auth{0=1} v1123 ap=1 s=29861 n(v0 rc2024-03-27T07:25:32.130908+0000 b29861 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a57:[<0x20000000a14/article-52.xml v1123>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a57:[<0x20000000a14/article-52.xml v1123>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.298+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cae [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml auth{0=1} v1351 ap=1 s=8710 n(v0 rc2024-03-27T07:26:29.450779+0000 b8710 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cae:[<0x20000000a14/comment-9.xml v1313>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cae:[<0x20000000a14/comment-9.xml v1351>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.299+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c28 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml auth{0=1} v1285 ap=1 s=9853 n(v0 rc2024-03-27T07:26:17.296018+0000 b9853 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b5a5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c28:[<0x20000000a14/comment-45.xml v1285>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c28:[<0x20000000a14/comment-45.xml v1285>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.337+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cad [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml auth{0=1} v1333 ap=1 s=8183 n(v0 rc2024-03-27T07:26:29.446779+0000 b8183 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf92b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cad:[<0x20000000a14/comment-10.xml v1283>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cad:[<0x20000000a14/comment-10.xml v1333>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.337+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bb8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg auth{0=1} v1112 ap=1 s=51767 n(v0 rc2024-03-27T07:25:33.189887+0000 b51767 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf93080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bb8:[<0x20000000a14/picture-3.jpg v1112>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bb8:[<0x20000000a14/picture-3.jpg v1112>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.337+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000856 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml auth{0=1} v1132 ap=1 s=7842 n(v0 rc2024-03-27T07:25:50.540545+0000 b7842 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf93600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000856:[<0x20000000a14/comment-53.xml v814>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000856:[<0x20000000a14/comment-53.xml v1132>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.337+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cb1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml auth{0=1} v1331 ap=1 s=4170 n(v0 rc2024-03-27T07:26:29.474778+0000 b4170 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf93b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cb1:[<0x20000000a14/comment-6.xml v1316>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cb1:[<0x20000000a14/comment-6.xml v1331>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.338+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b90 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg auth{0=1} v1118 ap=1 s=34435 n(v0 rc2024-03-27T07:25:33.043890+0000 b34435 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf94100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b90:[<0x20000000a14/picture-11.jpg v1118>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b90:[<0x20000000a14/picture-11.jpg v1118>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.338+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg auth v1379 ap=1 s=51555 n(v0 rc2024-03-27T07:27:41.051374+0000 b51555 1=1+0) | replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661cf94680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed4:[<0x20000000a14/picture-70.jpg v1371>,<0x10000000399/blog-16 v125151>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ed4:[<0x20000000a14/picture-70.jpg v1379>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.338+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b37 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml auth{0=1} v1108 ap=1 s=32517 n(v0 rc2024-03-27T07:25:32.733896+0000 b32517 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf94c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b37:[<0x20000000a14/article-5.xml v1108>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b37:[<0x20000000a14/article-5.xml v1108>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.339+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a9f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml auth{0=1} v1114 ap=1 s=26849 n(v0 rc2024-03-27T07:25:32.310904+0000 b26849 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf95180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a9f:[<0x20000000a14/article-34.xml v1114>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a9f:[<0x20000000a14/article-34.xml v1114>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.339+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c32 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml auth{0=1} v1266 ap=1 s=7665 n(v0 rc2024-03-27T07:26:17.399016+0000 b7665 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf95700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c32:[<0x20000000a14/comment-35.xml v1266>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c32:[<0x20000000a14/comment-35.xml v1266>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.697 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.339+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c39 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml auth{0=1} v1262 ap=1 s=3662 n(v0 rc2024-03-27T07:26:17.474015+0000 b3662 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb6c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c39:[<0x20000000a14/comment-28.xml v1262>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c39:[<0x20000000a14/comment-28.xml v1262>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.339+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000852 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml auth{0=1} v1124 ap=1 s=3471 n(v0 rc2024-03-27T07:25:50.449547+0000 b3471 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb6c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000852:[<0x20000000a14/comment-57.xml v790>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000852:[<0x20000000a14/comment-57.xml v1124>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.340+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000869 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg auth v1145 ap=1 s=54156 n(v0 rc2024-03-27T07:25:50.756541+0000 b54156 1=1+0) | authpin=1 scrubqueue=0 0x55661e220100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000869:[<0x20000000a14/picture-99.jpg v882>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000869:[<0x20000000a14/picture-99.jpg v1145>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.340+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cff [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg auth v1335 ap=1 s=51749 n(v0 rc2024-03-27T07:26:42.134529+0000 b51749 1=1+0) | authpin=1 scrubqueue=0 0x55661e220680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cff:[<0x20000000a14/picture-71.jpg v1335>,<0x10000000399/blog-16 v113439>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000cff:[<0x20000000a14/picture-71.jpg v1335>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.340+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000abb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml auth{0=1} v1120 ap=1 s=28682 n(v0 rc2024-03-27T07:25:32.357903+0000 b28682 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb6cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000abb:[<0x20000000a14/article-29.xml v1120>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000abb:[<0x20000000a14/article-29.xml v1120>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.340+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a33 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml auth{0=1} v1110 ap=1 s=17554 n(v0 rc2024-03-27T07:25:32.007910+0000 b17554 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb6d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a33:[<0x20000000a14/article-60.xml v1110>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a33:[<0x20000000a14/article-60.xml v1110>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.341+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml auth{0=1} v1139 ap=1 s=4249 n(v0 rc2024-03-27T07:25:50.187552+0000 b4249 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb6d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084e:[<0x20000000a14/comment-61.xml v764>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000084e:[<0x20000000a14/comment-61.xml v1139>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.341+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ae5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml auth{0=1} v1116 ap=1 s=23835 n(v0 rc2024-03-27T07:25:32.483901+0000 b23835 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb6db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ae5:[<0x20000000a14/article-22.xml v1116>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ae5:[<0x20000000a14/article-22.xml v1116>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.341+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c2f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml auth{0=1} v1270 ap=1 s=5040 n(v0 rc2024-03-27T07:26:17.369017+0000 b5040 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb6e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c2f:[<0x20000000a14/comment-38.xml v1270>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c2f:[<0x20000000a14/comment-38.xml v1270>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.342+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000847 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml auth{0=1} v1130 ap=1 s=3481 n(v0 rc2024-03-27T07:25:50.069555+0000 b3481 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb6e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000847:[<0x20000000a14/comment-68.xml v722>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000847:[<0x20000000a14/comment-68.xml v1130>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.342+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000070e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml auth{0=1} v1383 ap=1 s=14988 n(v0 rc2024-03-27T07:25:42.977694+0000 b14988 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x55661bb6ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000070e:[<0x20000000a14/article-49.xml v591>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000070e:[<0x20000000a14/article-49.xml v1383>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.698 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.342+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000caf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml auth{0=1} v1329 ap=1 s=4937 n(v0 rc2024-03-27T07:26:29.457779+0000 b4937 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661bb6f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000caf:[<0x20000000a14/comment-8.xml v1292>,<0x10000000399/blog-16 v111379>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000caf:[<0x20000000a14/comment-8.xml v1329>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.356+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d4f [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-22.xml auth{0=1} v1263 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.439701+0000 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d750b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d4f:[<0x20000001b03/comment-22.xml v1263>,<0x10000000399/blog-46 v142071>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d4f:[<0x20000001b03/comment-22.xml v1263>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.357+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x3000000165d [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-44.xml auth{0=1} v1156 ap=1 s=8029 n(v0 rc2024-03-27T07:28:06.219881+0000 b8029 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 freezing=0 frozen=0 exportingcaps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x55661df7db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x3000000165d:[<0x20000001b03/comment-44.xml v1156>,<0x10000000399/blog-46 v142071>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x3000000165d:[<0x20000001b03/comment-44.xml v1156>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.357+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001bba [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-43.xml auth{1=1} v876 ap=1 s=6411 n(v0 rc2024-03-27T07:25:50.344549+0000 b6411 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d751600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001bba:[<0x20000001b03/article-43.xml v876>,<0x10000000399/blog-46 v125307>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000001bba:[<0x20000001b03/article-43.xml v876>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.357+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x300000006ba [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-100.xml auth v919 ap=1 s=12729 n(v0 rc2024-03-27T07:26:46.432444+0000 b12729 1=1+0) caps={15291=pAsLsXsFsc/-@1} | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 freezing=0 frozen=0 exportingcaps=0 dirtyparent=0 replicated=0 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x55661a4de580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x300000006ba:[<0x20000001b03/article-100.xml v919>,<0x10000000399/blog-46 v125307>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x300000006ba:[<0x20000001b03/article-100.xml v919>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.358+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001be0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-33.xml auth{1=1} v892 ap=1 s=10529 n(v0 rc2024-03-27T07:25:50.631544+0000 b10529 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d751b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001be0:[<0x20000001b03/article-33.xml v892>,<0x10000000399/blog-46 v125307>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000001be0:[<0x20000001b03/article-33.xml v892>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.358+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d11 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-5.jpg auth{1=1} v882 ap=1 s=17943 n(v0 rc2024-03-27T07:25:51.711522+0000 b17943 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d752100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d11:[<0x20000001b03/picture-5.jpg v882>,<0x10000000399/blog-46 v125307>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000001d11:[<0x20000001b03/picture-5.jpg v882>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.358+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c80 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-27.xml auth{0=1} v1230 ap=1 s=9331 n(v0 rc2024-03-27T07:28:13.037748+0000 b9331 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d752680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002c80:[<0x20000001b03/comment-27.xml v1230>,<0x10000000399/blog-46 v142071>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002c80:[<0x20000001b03/comment-27.xml v1230>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.359+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x3000000120d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-76.xml auth{0=1} v1046 ap=1 s=2234 n(v0 rc2024-03-27T07:27:52.060158+0000 b2234 1=1+0) caps={15291=pAsLsXsFscr/pFscr@2},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 frozen=0 exportingcaps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x55661cf43b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x3000000120d:[<0x20000001b03/comment-76.xml v994>,<0x10000000399/blog-46 v137463>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x3000000120d:[<0x20000001b03/comment-76.xml v1046>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.359+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000282f [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-57.xml auth{1=1} v1194 ap=1 s=11635 n(v0 rc2024-03-27T07:28:05.217901+0000 b11635 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1} mcw={1=Fscr} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d753180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000282f:[<0x20000001b03/article-57.xml v1194>,<0x10000000399/blog-46 v142071>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x1000000282f:[<0x20000001b03/article-57.xml v1194>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.359+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000274c [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-52.xml auth v1110 pv1302 ap=2 s=0 n(v0 rc2024-03-27T07:28:03.436935+0000 1=1+0)->n(v0 rc2024-03-27T07:28:03.436935+0000 b5375 1=1+0) (ifile excl w=1) cr={15291=0-4194304@6} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | ptrwaiter=1 request=0 lock=1 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d764000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000274c:[<0x20000001b03/comment-52.xml v1110>,<0x10000000399/blog-46 v142071>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x1000000274c:[<0x20000001b03/comment-52.xml v1110>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.360+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000024b6 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-66.xml auth v1069 ap=1 s=6404 n(v0 rc2024-03-27T07:27:54.619108+0000 b6404 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | request=0 lock=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d764b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000024b6:[<0x20000001b03/comment-66.xml v1027>,<0x10000000399/blog-46 v137463>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x100000024b6:[<0x20000001b03/comment-66.xml v1069>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.699 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.361+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b80 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-58.xml auth{1=1} v888 ap=1 s=3612 n(v0 rc2024-03-27T07:25:49.974557+0000 b3612 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d765b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b80:[<0x20000001b03/article-58.xml v888>,<0x10000000399/blog-46 v125307>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000001b80:[<0x20000001b03/article-58.xml v888>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.362+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b30 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-79.xml auth{1=1} v74 ap=1 s=10618 n(v0 rc2024-03-27T07:25:49.541565+0000 b10618 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d765080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b30:[<0x20000001b03/article-79.xml v74>,<0x10000000399/blog-46 v125307>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000001b30:[<0x20000001b03/article-79.xml v74>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.362+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x3000000165e [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-43.xml auth{0=1} v1161 ap=1 s=6154 n(v0 rc2024-03-27T07:28:06.484876+0000 b6154 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 freezing=0 frozen=0 exportingcaps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x55661dacd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x3000000165e:[<0x20000001b03/comment-43.xml v1161>,<0x10000000399/blog-46 v142071>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x3000000165e:[<0x20000001b03/comment-43.xml v1161>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.362+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b92 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-53.xml auth{1=1} v880 ap=1 s=9234 n(v0 rc2024-03-27T07:25:50.058555+0000 b9234 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d766100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b92:[<0x20000001b03/article-53.xml v880>,<0x10000000399/blog-46 v125307>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000001b92:[<0x20000001b03/article-53.xml v880>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.363+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001bf0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-28.xml auth{1=1} v886 ap=1 s=31774 n(v0 rc2024-03-27T07:25:50.703542+0000 b31774 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d766680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001bf0:[<0x20000001b03/article-28.xml v886>,<0x10000000399/blog-46 v125307>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000001bf0:[<0x20000001b03/article-28.xml v886>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.363+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b96 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-52.xml auth{1=1} v884 ap=1 s=1793 n(v0 rc2024-03-27T07:25:50.067555+0000 b1793 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d767180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b96:[<0x20000001b03/article-52.xml v884>,<0x10000000399/blog-46 v125307>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000001b96:[<0x20000001b03/article-52.xml v884>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.364+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x3000000160a [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-45.xml auth{0=1} v1138 ap=1 s=3504 n(v0 rc2024-03-27T07:28:05.918887+0000 b3504 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 freezing=0 frozen=0 exportingcaps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x556619fd2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x3000000160a:[<0x20000001b03/comment-45.xml v1138>,<0x10000000399/blog-46 v142071>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x3000000160a:[<0x20000001b03/comment-45.xml v1138>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.364+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c4f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-46.jpg auth{1=1} v890 ap=1 s=12624 n(v0 rc2024-03-27T07:25:50.969537+0000 b12624 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d76e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c4f:[<0x20000001b03/picture-46.jpg v890>,<0x10000000399/blog-46 v125307>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000001c4f:[<0x20000001b03/picture-46.jpg v890>,<0x10000000399/blog-46 v143954>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.423+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b60 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg auth{0=1} v1087 ap=1 s=48894 n(v0 rc2024-03-27T07:25:32.884893+0000 b48894 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdb2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b60:[<0x20000000a14/picture-23.jpg v1087>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b60:[<0x20000000a14/picture-23.jpg v1087>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.423+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b0f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml auth{0=1} v1091 ap=1 s=2315 n(v0 rc2024-03-27T07:25:32.616898+0000 b2315 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a965180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b0f:[<0x20000000a14/article-14.xml v1091>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b0f:[<0x20000000a14/article-14.xml v1091>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.423+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml auth{0=1} v1111 ap=1 s=7780 n(v0 rc2024-03-27T07:25:50.181552+0000 b7780 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b17d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084d:[<0x20000000a14/comment-62.xml v758>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000084d:[<0x20000000a14/comment-62.xml v1111>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.423+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a6f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml auth{0=1} v1079 ap=1 s=17417 n(v0 rc2024-03-27T07:25:32.191907+0000 b17417 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c107600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a6f:[<0x20000000a14/article-46.xml v1079>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a6f:[<0x20000000a14/article-46.xml v1079>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.700 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.424+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fde [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-91.xml auth v1266 ap=1 s=19779 n(v0 rc2024-03-27T07:27:02.651126+0000 b19779 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x556618d5e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fde:[<0x20000000a14/article-91.xml v1258>,<0x10000000399/blog-16 v116871>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000fde:[<0x20000000a14/article-91.xml v1266>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.424+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a6b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml auth{0=1} v1095 ap=1 s=16173 n(v0 rc2024-03-27T07:25:32.180907+0000 b16173 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca22000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a6b:[<0x20000000a14/article-47.xml v1095>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a6b:[<0x20000000a14/article-47.xml v1095>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.424+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b64 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg auth{0=1} v1089 ap=1 s=60008 n(v0 rc2024-03-27T07:25:32.898893+0000 b60008 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca22580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b64:[<0x20000000a14/picture-22.jpg v1089>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b64:[<0x20000000a14/picture-22.jpg v1089>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.425+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b1e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml auth{0=1} v1109 ap=1 s=24276 n(v0 rc2024-03-27T07:25:32.653897+0000 b24276 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca22b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b1e:[<0x20000000a14/article-11.xml v659>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b1e:[<0x20000000a14/article-11.xml v1109>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.425+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000850 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml auth{0=1} v1120 ap=1 s=7600 n(v0 rc2024-03-27T07:25:50.205552+0000 b7600 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca23080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000850:[<0x20000000a14/comment-59.xml v776>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x10000000850:[<0x20000000a14/comment-59.xml v1120>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.425+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b05 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml auth{0=1} v1083 ap=1 s=28872 n(v0 rc2024-03-27T07:25:32.582899+0000 b28872 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca23600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b05:[<0x20000000a14/article-16.xml v1083>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b05:[<0x20000000a14/article-16.xml v1083>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.425+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a4f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml auth{0=1} v1081 ap=1 s=9148 n(v0 rc2024-03-27T07:25:32.109908+0000 b9148 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca23b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a4f:[<0x20000000a14/article-54.xml v1081>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a4f:[<0x20000000a14/article-54.xml v1081>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.426+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000acd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml auth{0=1} v1103 ap=1 s=29333 n(v0 rc2024-03-27T07:25:32.410902+0000 b29333 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca24100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000acd:[<0x20000000a14/article-26.xml v1103>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000acd:[<0x20000000a14/article-26.xml v1103>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.426+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b81 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg auth{0=1} v1097 ap=1 s=34918 n(v0 rc2024-03-27T07:25:32.994891+0000 b34918 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca24680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b81:[<0x20000000a14/picture-15.jpg v1097>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b81:[<0x20000000a14/picture-15.jpg v1097>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.426+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-93.xml auth v1124 ap=1 s=23468 n(v0 rc2024-03-27T07:25:50.782541+0000 b23468 1=1+0) | authpin=1 scrubqueue=0 0x55661e23a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086d:[<0x20000000a14/article-93.xml v894>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000086d:[<0x20000000a14/article-93.xml v1124>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.427+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b22 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml auth{0=1} v1093 ap=1 s=30102 n(v0 rc2024-03-27T07:25:32.666897+0000 b30102 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca24c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b22:[<0x20000000a14/article-10.xml v1093>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b22:[<0x20000000a14/article-10.xml v1093>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.701 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.427+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000070b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg auth{0=1} v1122 ap=1 s=21087 n(v0 rc2024-03-27T07:25:42.739699+0000 b21087 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca25180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000070b:[<0x20000000a14/picture-12.jpg v580>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x1000000070b:[<0x20000000a14/picture-12.jpg v1122>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.702 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.427+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c23 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml auth{0=1} v1236 ap=1 s=2964 n(v0 rc2024-03-27T07:26:17.237019+0000 b2964 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ca25700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c23:[<0x20000000a14/comment-50.xml v1236>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c23:[<0x20000000a14/comment-50.xml v1236>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.702 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.428+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a67 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml auth{0=1} v1085 ap=1 s=2898 n(v0 rc2024-03-27T07:25:32.168907+0000 b2898 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e03e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a67:[<0x20000000a14/article-48.xml v1085>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a67:[<0x20000000a14/article-48.xml v1085>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.702 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.428+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c25 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml auth{0=1} v1240 ap=1 s=2626 n(v0 rc2024-03-27T07:26:17.259019+0000 b2626 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e03e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c25:[<0x20000000a14/comment-48.xml v1240>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c25:[<0x20000000a14/comment-48.xml v1240>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.702 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.428+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b3b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml auth{0=1} v1105 ap=1 s=11977 n(v0 rc2024-03-27T07:25:32.749896+0000 b11977 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e03eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b3b:[<0x20000000a14/article-4.xml v1105>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b3b:[<0x20000000a14/article-4.xml v1105>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.702 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.428+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ad2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml auth{0=1} v1101 ap=1 s=24408 n(v0 rc2024-03-27T07:25:32.431902+0000 b24408 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e03f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ad2:[<0x20000000a14/article-25.xml v1101>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ad2:[<0x20000000a14/article-25.xml v1101>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.702 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.429+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a8f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml auth{0=1} v1099 ap=1 s=6841 n(v0 rc2024-03-27T07:25:32.269905+0000 b6841 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e03f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a8f:[<0x20000000a14/article-38.xml v1099>,<0x10000000399/blog-16 v50916>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000a8f:[<0x20000000a14/article-38.xml v1099>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.702 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.429+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c36 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml auth{0=1} v1238 ap=1 s=8363 n(v0 rc2024-03-27T07:26:17.439015+0000 b8363 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e03fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c36:[<0x20000000a14/comment-31.xml v1238>,<0x10000000399/blog-16 v94486>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c36:[<0x20000000a14/comment-31.xml v1238>,<0x10000000399/blog-16 v133549>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.714 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.337+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000086c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-64.jpg auth{0=1} v1854 ap=1 s=50886 n(v0 rc2024-03-27T07:25:30.065948+0000 b50886 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5a4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000086c:[<0x2000000066f/picture-64.jpg v1854>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000086c:[<0x2000000066f/picture-64.jpg v1854>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.337+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aed [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-37.xml auth{0=1} v1888 ap=1 s=3862 n(v0 rc2024-03-27T07:25:49.024575+0000 b3862 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001aed:[<0x2000000066f/comment-37.xml v1888>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001aed:[<0x2000000066f/comment-37.xml v1888>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.337+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000010a0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-71.xml auth{0=1} v1860 ap=1 s=3039 n(v0 rc2024-03-27T07:25:38.222788+0000 b3039 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5a5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000010a0:[<0x2000000066f/comment-71.xml v1860>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000010a0:[<0x2000000066f/comment-71.xml v1860>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.338+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000009ec [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg auth{0=1} v1876 ap=1 s=60177 n(v0 rc2024-03-27T07:25:31.739915+0000 b60177 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad5a5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000009ec:[<0x2000000066f/picture-10.jpg v1876>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000009ec:[<0x2000000066f/picture-10.jpg v1876>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.338+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001620 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg auth{0=1} v1884 ap=1 s=18502 n(v0 rc2024-03-27T07:25:44.187670+0000 b18502 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd86580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001620:[<0x2000000066f/picture-1.jpg v1884>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001620:[<0x2000000066f/picture-1.jpg v1884>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.338+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f05 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-95.xml auth{0=1} v1894 ap=1 s=8417 n(v0 rc2024-03-27T07:25:36.331825+0000 b8417 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd86000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f05:[<0x2000000066f/comment-95.xml v1894>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000f05:[<0x2000000066f/comment-95.xml v1894>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.338+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ba0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-16.xml auth{0=1} v1896 ap=1 s=4477 n(v0 rc2024-03-27T07:25:50.124554+0000 b4477 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd86b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ba0:[<0x2000000066f/comment-16.xml v1896>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ba0:[<0x2000000066f/comment-16.xml v1896>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.338+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000081c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml auth{0=1} v1864 ap=1 s=24847 n(v0 rc2024-03-27T07:25:29.751955+0000 b24847 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd87080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000081c:[<0x2000000066f/article-9.xml v1864>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000081c:[<0x2000000066f/article-9.xml v1864>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.339+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000006d4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-44.xml auth{0=1} v581 ap=1 s=11776 n(v0 rc2024-03-27T07:25:26.916010+0000 b11776 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd87600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000006d4:[<0x2000000066f/article-44.xml v581>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000006d4:[<0x2000000066f/article-44.xml v581>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.339+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000009fc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg auth{0=1} v1850 ap=1 s=53148 n(v0 rc2024-03-27T07:25:31.791914+0000 b53148 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd87b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000009fc:[<0x2000000066f/picture-6.jpg v1850>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000009fc:[<0x2000000066f/picture-6.jpg v1850>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.339+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000671 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-65.xml auth{0=1} v615 ap=1 s=21880 n(v0 rc2024-03-27T07:25:26.473019+0000 b21880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd88100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000671:[<0x2000000066f/article-65.xml v615>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000671:[<0x2000000066f/article-65.xml v615>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.715 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.339+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000112d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-58.xml auth{0=1} v1900 ap=1 s=4076 n(v0 rc2024-03-27T07:25:38.871775+0000 b4076 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd88680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000112d:[<0x2000000066f/comment-58.xml v1900>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000112d:[<0x2000000066f/comment-58.xml v1900>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.339+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000067c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-62.xml auth{0=1} v641 ap=1 s=2848 n(v0 rc2024-03-27T07:25:26.498019+0000 b2848 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd88c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000067c:[<0x2000000066f/article-62.xml v641>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000067c:[<0x2000000066f/article-62.xml v641>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.339+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001149 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-55.xml auth{0=1} v1878 ap=1 s=3346 n(v0 rc2024-03-27T07:25:39.016772+0000 b3346 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd89180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001149:[<0x2000000066f/comment-55.xml v1878>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001149:[<0x2000000066f/comment-55.xml v1878>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.340+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000079c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-24.xml auth{0=1} v557 ap=1 s=16296 n(v0 rc2024-03-27T07:25:27.652996+0000 b16296 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd89700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000079c:[<0x2000000066f/article-24.xml v557>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000079c:[<0x2000000066f/article-24.xml v557>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.340+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b12 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-34.xml auth{0=1} v1890 ap=1 s=5954 n(v0 rc2024-03-27T07:25:49.292570+0000 b5954 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b12:[<0x2000000066f/comment-34.xml v1890>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b12:[<0x2000000066f/comment-34.xml v1890>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.340+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b77 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-25.xml auth{0=1} v1898 ap=1 s=8137 n(v0 rc2024-03-27T07:25:49.957557+0000 b8137 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b77:[<0x2000000066f/comment-25.xml v1898>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b77:[<0x2000000066f/comment-25.xml v1898>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.340+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000994 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-28.jpg auth{0=1} v1882 ap=1 s=25997 n(v0 rc2024-03-27T07:25:31.375923+0000 b25997 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000994:[<0x2000000066f/picture-28.jpg v1882>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000994:[<0x2000000066f/picture-28.jpg v1882>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.340+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000940 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-88.xml auth v1872 ap=1 s=5507 n(v0 rc2024-03-27T07:25:31.159927+0000 b5507 1=1+0) | authpin=1 scrubqueue=0 0x5607aea38100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000940:[<0x2000000066f/article-88.xml v1872>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000940:[<0x2000000066f/article-88.xml v1872>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.340+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001aba [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-41.xml auth{0=1} v1892 ap=1 s=3764 n(v0 rc2024-03-27T07:25:48.784580+0000 b3764 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001aba:[<0x2000000066f/comment-41.xml v1892>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001aba:[<0x2000000066f/comment-41.xml v1892>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.341+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000107b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-75.xml auth{0=1} v1880 ap=1 s=9294 n(v0 rc2024-03-27T07:25:38.033792+0000 b9294 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000107b:[<0x2000000066f/comment-75.xml v1880>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000107b:[<0x2000000066f/comment-75.xml v1880>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.341+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000956 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-37.jpg auth{0=1} v1862 ap=1 s=63274 n(v0 rc2024-03-27T07:25:31.201926+0000 b63274 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000956:[<0x2000000066f/picture-37.jpg v1862>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000956:[<0x2000000066f/picture-37.jpg v1862>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.716 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.341+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000009c5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg auth{0=1} v1848 ap=1 s=45204 n(v0 rc2024-03-27T07:25:31.574919+0000 b45204 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000009c5:[<0x2000000066f/picture-17.jpg v1848>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000009c5:[<0x2000000066f/picture-17.jpg v1848>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.341+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000083f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml auth{0=1} v1856 ap=1 s=2402 n(v0 rc2024-03-27T07:25:29.864952+0000 b2402 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000083f:[<0x2000000066f/article-3.xml v1856>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000083f:[<0x2000000066f/article-3.xml v1856>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.341+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000970 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-33.jpg auth{0=1} v1874 ap=1 s=24969 n(v0 rc2024-03-27T07:25:31.261925+0000 b24969 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000970:[<0x2000000066f/picture-33.jpg v1874>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000970:[<0x2000000066f/picture-33.jpg v1874>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.341+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000099e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-24.jpg auth{0=1} v1868 ap=1 s=24219 n(v0 rc2024-03-27T07:25:31.423922+0000 b24219 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000099e:[<0x2000000066f/picture-24.jpg v1868>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000099e:[<0x2000000066f/picture-24.jpg v1868>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.342+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000892 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-57.jpg auth{0=1} v1866 ap=1 s=32699 n(v0 rc2024-03-27T07:25:30.239945+0000 b32699 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfe9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000892:[<0x2000000066f/picture-57.jpg v1866>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000892:[<0x2000000066f/picture-57.jpg v1866>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.342+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000826 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-7.xml auth{0=1} v1846 ap=1 s=10772 n(v0 rc2024-03-27T07:25:29.787954+0000 b10772 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab744000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000826:[<0x2000000066f/article-7.xml v1846>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000826:[<0x2000000066f/article-7.xml v1846>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.342+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008f4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-42.jpg auth{0=1} v1858 ap=1 s=28348 n(v0 rc2024-03-27T07:25:31.008930+0000 b28348 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab744580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008f4:[<0x2000000066f/picture-42.jpg v1858>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000008f4:[<0x2000000066f/picture-42.jpg v1858>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.342+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000857 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-68.jpg auth v1870 ap=1 s=17556 n(v0 rc2024-03-27T07:25:29.981950+0000 b17556 1=1+0) | authpin=1 scrubqueue=0 0x5607aea37b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000857:[<0x2000000066f/picture-68.jpg v1870>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000857:[<0x2000000066f/picture-68.jpg v1870>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.342+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b82 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-23.xml auth{0=1} v1886 ap=1 s=7746 n(v0 rc2024-03-27T07:25:49.994556+0000 b7746 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab745080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b82:[<0x2000000066f/comment-23.xml v1886>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b82:[<0x2000000066f/comment-23.xml v1886>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.342+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000093b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-39.jpg auth{0=1} v1852 ap=1 s=48984 n(v0 rc2024-03-27T07:25:31.150927+0000 b48984 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab744b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000093b:[<0x2000000066f/picture-39.jpg v1852>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000093b:[<0x2000000066f/picture-39.jpg v1852>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.343+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b88 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-22.xml auth{0=1} v1885 ap=1 s=6756 n(v0 rc2024-03-27T07:25:50.011556+0000 b6756 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac29c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b88:[<0x2000000066f/comment-22.xml v1885>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b88:[<0x2000000066f/comment-22.xml v1885>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.717 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.343+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b7d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-24.xml auth{0=1} v1902 ap=1 s=6456 n(v0 rc2024-03-27T07:25:49.973557+0000 b6456 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab745600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b7d:[<0x2000000066f/comment-24.xml v1902>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b7d:[<0x2000000066f/comment-24.xml v1902>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.343+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004b4d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-2.xml auth{0=1} v1933 ap=1 s=8079 n(v0 rc2024-03-27T07:27:05.362073+0000 b8079 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac29d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004b4d:[<0x2000000066f/comment-2.xml v1933>,<0x10000000399/blog-12 v115708>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000004b4d:[<0x2000000066f/comment-2.xml v1933>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.343+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000011d2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-44.xml auth{0=1} v1877 ap=1 s=6656 n(v0 rc2024-03-27T07:25:39.650760+0000 b6656 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac29d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000011d2:[<0x2000000066f/comment-44.xml v1877>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000011d2:[<0x2000000066f/comment-44.xml v1877>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.343+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000006dc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-43.xml auth{0=1} v633 ap=1 s=5202 n(v0 rc2024-03-27T07:25:26.956010+0000 b5202 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6aa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000006dc:[<0x2000000066f/article-43.xml v633>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000006dc:[<0x2000000066f/article-43.xml v633>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.343+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000073d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-33.xml auth{0=1} v639 ap=1 s=2074 n(v0 rc2024-03-27T07:25:27.380001+0000 b2074 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6aa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000073d:[<0x2000000066f/article-33.xml v639>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000073d:[<0x2000000066f/article-33.xml v639>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.343+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f10 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-93.xml auth{0=1} v1889 ap=1 s=10186 n(v0 rc2024-03-27T07:25:36.374824+0000 b10186 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f10:[<0x2000000066f/comment-93.xml v1889>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000f10:[<0x2000000066f/comment-93.xml v1889>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.344+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000a00 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg auth{0=1} v1861 ap=1 s=47125 n(v0 rc2024-03-27T07:25:31.803914+0000 b47125 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6ab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000a00:[<0x2000000066f/picture-5.jpg v1861>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000a00:[<0x2000000066f/picture-5.jpg v1861>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.344+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b61 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-27.xml auth{0=1} v1897 ap=1 s=3549 n(v0 rc2024-03-27T07:25:49.873558+0000 b3549 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6ab600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b61:[<0x2000000066f/comment-27.xml v1897>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b61:[<0x2000000066f/comment-27.xml v1897>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.344+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001070 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-76.xml auth{0=1} v1879 ap=1 s=5439 n(v0 rc2024-03-27T07:25:37.971793+0000 b5439 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6ac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001070:[<0x2000000066f/comment-76.xml v1879>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001070:[<0x2000000066f/comment-76.xml v1879>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.344+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008c3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-50.jpg auth{0=1} v1863 ap=1 s=22551 n(v0 rc2024-03-27T07:25:30.439941+0000 b22551 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6abb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008c3:[<0x2000000066f/picture-50.jpg v1863>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000008c3:[<0x2000000066f/picture-50.jpg v1863>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.344+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000088a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-58.jpg auth{0=1} v1859 ap=1 s=40702 n(v0 rc2024-03-27T07:25:30.201946+0000 b40702 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6ac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000088a:[<0x2000000066f/picture-58.jpg v1859>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000088a:[<0x2000000066f/picture-58.jpg v1859>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.718 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.344+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000068d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-57.xml auth{0=1} v535 ap=1 s=15005 n(v0 rc2024-03-27T07:25:26.562017+0000 b15005 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6acc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000068d:[<0x2000000066f/article-57.xml v535>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000068d:[<0x2000000066f/article-57.xml v535>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.345+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001167 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-52.xml auth{0=1} v1883 ap=1 s=2110 n(v0 rc2024-03-27T07:25:39.161769+0000 b2110 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6ad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001167:[<0x2000000066f/comment-52.xml v1883>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001167:[<0x2000000066f/comment-52.xml v1883>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.345+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000010cd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-66.xml auth{0=1} v1865 ap=1 s=4646 n(v0 rc2024-03-27T07:25:38.461783+0000 b4646 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac6ad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000010cd:[<0x2000000066f/comment-66.xml v1865>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000010cd:[<0x2000000066f/comment-66.xml v1865>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.345+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000866 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-65.jpg auth{0=1} v1853 ap=1 s=20085 n(v0 rc2024-03-27T07:25:30.047949+0000 b20085 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad31e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000866:[<0x2000000066f/picture-65.jpg v1853>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000866:[<0x2000000066f/picture-65.jpg v1853>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.345+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ba4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-15.xml auth{0=1} v1891 ap=1 s=9458 n(v0 rc2024-03-27T07:25:50.154553+0000 b9458 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad31f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ba4:[<0x2000000066f/comment-15.xml v1891>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ba4:[<0x2000000066f/comment-15.xml v1891>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.345+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f2b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-7.xml auth{0=1} v1938 ap=1 s=6387 n(v0 rc2024-03-27T07:26:58.563206+0000 b6387 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad31f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f2b:[<0x2000000066f/comment-7.xml v1920>,<0x10000000399/blog-12 v115708>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000f2b:[<0x2000000066f/comment-7.xml v1938>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.345+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000068b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-58.xml auth{0=1} v619 ap=1 s=7045 n(v0 rc2024-03-27T07:25:26.553018+0000 b7045 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad31fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000068b:[<0x2000000066f/article-58.xml v619>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000068b:[<0x2000000066f/article-58.xml v619>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.346+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000698 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-53.xml auth{0=1} v525 ap=1 s=8261 n(v0 rc2024-03-27T07:25:26.603017+0000 b8261 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad320100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000698:[<0x2000000066f/article-53.xml v525>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000698:[<0x2000000066f/article-53.xml v525>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.346+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000011d9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-43.xml auth{0=1} v1893 ap=1 s=4903 n(v0 rc2024-03-27T07:25:39.683759+0000 b4903 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad320680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000011d9:[<0x2000000066f/comment-43.xml v1893>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000011d9:[<0x2000000066f/comment-43.xml v1893>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.346+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b9c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-17.xml auth{0=1} v1881 ap=1 s=2276 n(v0 rc2024-03-27T07:25:50.096554+0000 b2276 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad320c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b9c:[<0x2000000066f/comment-17.xml v1881>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b9c:[<0x2000000066f/comment-17.xml v1881>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.346+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000778 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-28.xml auth{0=1} v539 ap=1 s=23555 n(v0 rc2024-03-27T07:25:27.572997+0000 b23555 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad321180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000778:[<0x2000000066f/article-28.xml v539>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000778:[<0x2000000066f/article-28.xml v539>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.719 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.346+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000481a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-9.xml auth{0=1} v1915 ap=1 s=7127 n(v0 rc2024-03-27T07:26:57.732222+0000 b7127 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab988000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000481a:[<0x2000000066f/comment-9.xml v1915>,<0x10000000399/blog-12 v115708>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x2000000481a:[<0x2000000066f/comment-9.xml v1915>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.720 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.346+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000699 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-52.xml auth{0=1} v655 ap=1 s=11321 n(v0 rc2024-03-27T07:25:26.616016+0000 b11321 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab988580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000699:[<0x2000000066f/article-52.xml v655>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000699:[<0x2000000066f/article-52.xml v655>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.720 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.347+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000850 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-69.jpg auth v1851 ap=1 s=19561 n(v0 rc2024-03-27T07:25:29.937951+0000 b19561 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab988b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000850:[<0x2000000066f/picture-69.jpg v1851>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000850:[<0x2000000066f/picture-69.jpg v1851>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.720 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.347+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000eef [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-99.xml auth{0=1} v1871 ap=1 s=6923 n(v0 rc2024-03-27T07:25:36.246827+0000 b6923 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab989080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000eef:[<0x2000000066f/comment-99.xml v1871>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000eef:[<0x2000000066f/comment-99.xml v1871>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.720 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.347+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008bb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-51.jpg auth{0=1} v1855 ap=1 s=24314 n(v0 rc2024-03-27T07:25:30.411942+0000 b24314 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab989600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008bb:[<0x2000000066f/picture-51.jpg v1855>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000008bb:[<0x2000000066f/picture-51.jpg v1855>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.720 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.347+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000011c7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-45.xml auth{0=1} v1873 ap=1 s=4582 n(v0 rc2024-03-27T07:25:39.597761+0000 b4582 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab989b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000011c7:[<0x2000000066f/comment-45.xml v1873>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000011c7:[<0x2000000066f/comment-45.xml v1873>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.720 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.347+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000933 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-62.jpg auth{0=1} v1867 ap=1 s=11371 n(v0 rc2024-03-27T07:25:31.142927+0000 b11371 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab98a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000933:[<0x2000000066f/picture-62.jpg v1867>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000933:[<0x2000000066f/picture-62.jpg v1867>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.720 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.347+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001016 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-84.xml auth{0=1} v1869 ap=1 s=9186 n(v0 rc2024-03-27T07:25:37.534801+0000 b9186 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab98a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001016:[<0x2000000066f/comment-84.xml v1869>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001016:[<0x2000000066f/comment-84.xml v1869>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.720 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.347+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008df [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-46.jpg auth{0=1} v1857 ap=1 s=57635 n(v0 rc2024-03-27T07:25:30.653937+0000 b57635 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab98ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008df:[<0x2000000066f/picture-46.jpg v1857>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000008df:[<0x2000000066f/picture-46.jpg v1857>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.720 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.353+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000674 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-64.xml auth{0=1} v617 ap=1 s=8724 n(v0 rc2024-03-27T07:25:26.482019+0000 b8724 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac265180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000674:[<0x2000000066f/article-64.xml v617>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000674:[<0x2000000066f/article-64.xml v617>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.720 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.353+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b8c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-21.xml auth{0=1} v1891 ap=1 s=6178 n(v0 rc2024-03-27T07:25:50.028555+0000 b6178 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac706000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b8c:[<0x2000000066f/comment-21.xml v1891>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b8c:[<0x2000000066f/comment-21.xml v1891>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.354+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001bac [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-13.xml auth{0=1} v1903 ap=1 s=7219 n(v0 rc2024-03-27T07:25:50.225552+0000 b7219 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac265700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001bac:[<0x2000000066f/comment-13.xml v1903>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001bac:[<0x2000000066f/comment-13.xml v1903>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.354+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b6d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-26.xml auth{0=1} v1895 ap=1 s=3530 n(v0 rc2024-03-27T07:25:49.929557+0000 b3530 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac706580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b6d:[<0x2000000066f/comment-26.xml v1895>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b6d:[<0x2000000066f/comment-26.xml v1895>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.354+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000712 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-37.xml auth{0=1} v669 ap=1 s=3099 n(v0 rc2024-03-27T07:25:27.193005+0000 b3099 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac706b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000712:[<0x2000000066f/article-37.xml v669>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000712:[<0x2000000066f/article-37.xml v669>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.354+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000998 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-27.jpg auth{0=1} v1871 ap=1 s=31227 n(v0 rc2024-03-27T07:25:31.399922+0000 b31227 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac707080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000998:[<0x2000000066f/picture-27.jpg v1871>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000998:[<0x2000000066f/picture-27.jpg v1871>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.354+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000006ff [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-39.xml auth{0=1} v585 ap=1 s=15079 n(v0 rc2024-03-27T07:25:27.122006+0000 b15079 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac707600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000006ff:[<0x2000000066f/article-39.xml v585>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000006ff:[<0x2000000066f/article-39.xml v585>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.354+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000071b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-36.xml auth{0=1} v577 ap=1 s=17171 n(v0 rc2024-03-27T07:25:27.234004+0000 b17171 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac707b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000071b:[<0x2000000066f/article-36.xml v577>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000071b:[<0x2000000066f/article-36.xml v577>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.355+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000080c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml auth{0=1} v1863 ap=1 s=6753 n(v0 rc2024-03-27T07:25:29.693956+0000 b6753 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac708100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000080c:[<0x2000000066f/article-12.xml v1863>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000080c:[<0x2000000066f/article-12.xml v1863>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.355+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008b5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-52.jpg auth{0=1} v1865 ap=1 s=18833 n(v0 rc2024-03-27T07:25:30.392942+0000 b18833 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac708680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008b5:[<0x2000000066f/picture-52.jpg v1865>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000008b5:[<0x2000000066f/picture-52.jpg v1865>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.355+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b40 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-30.xml auth{0=1} v1893 ap=1 s=7294 n(v0 rc2024-03-27T07:25:49.678562+0000 b7294 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac709180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b40:[<0x2000000066f/comment-30.xml v1893>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b40:[<0x2000000066f/comment-30.xml v1893>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.355+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000084b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml auth{0=1} v1875 ap=1 s=1791 n(v0 rc2024-03-27T07:25:29.916951+0000 b1791 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac708c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000084b:[<0x2000000066f/article-1.xml v1875>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000084b:[<0x2000000066f/article-1.xml v1875>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.355+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000096a [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-34.jpg auth{0=1} v1859 ap=1 s=62087 n(v0 rc2024-03-27T07:25:31.242925+0000 b62087 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac709700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000096a:[<0x2000000066f/picture-34.jpg v1859>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000096a:[<0x2000000066f/picture-34.jpg v1859>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.721 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.356+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008ad [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-53.jpg auth{0=1} v1869 ap=1 s=40405 n(v0 rc2024-03-27T07:25:30.362943+0000 b40405 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7420000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008ad:[<0x2000000066f/picture-53.jpg v1869>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000008ad:[<0x2000000066f/picture-53.jpg v1869>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.356+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000085d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-67.jpg auth v1861 ap=1 s=32789 n(v0 rc2024-03-27T07:25:30.013949+0000 b32789 1=1+0) | authpin=1 scrubqueue=0 0x5607aea38680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000085d:[<0x2000000066f/picture-67.jpg v1861>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x2000000085d:[<0x2000000066f/picture-67.jpg v1861>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.356+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004a95 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-3.xml auth{0=1} v1920 ap=1 s=5069 n(v0 rc2024-03-27T07:27:03.930101+0000 b5069 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7420b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004a95:[<0x2000000066f/comment-3.xml v1920>,<0x10000000399/blog-12 v115708>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000004a95:[<0x2000000066f/comment-3.xml v1920>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.356+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001b98 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-18.xml auth{0=1} v1905 ap=1 s=7201 n(v0 rc2024-03-27T07:25:50.072555+0000 b7201 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7421080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001b98:[<0x2000000066f/comment-18.xml v1905>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001b98:[<0x2000000066f/comment-18.xml v1905>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.356+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000009cd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg auth{0=1} v1879 ap=1 s=11455 n(v0 rc2024-03-27T07:25:31.605918+0000 b11455 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7421600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000009cd:[<0x2000000066f/picture-16.jpg v1879>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000009cd:[<0x2000000066f/picture-16.jpg v1879>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.356+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001194 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-49.xml auth{0=1} v1885 ap=1 s=9888 n(v0 rc2024-03-27T07:25:39.346766+0000 b9888 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7422100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001194:[<0x2000000066f/comment-49.xml v1885>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001194:[<0x2000000066f/comment-49.xml v1885>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.357+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001bb0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-12.xml auth{0=1} v1897 ap=1 s=4385 n(v0 rc2024-03-27T07:25:50.249551+0000 b4385 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7421b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001bb0:[<0x2000000066f/comment-12.xml v1897>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001bb0:[<0x2000000066f/comment-12.xml v1897>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.357+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000f30 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-87.xml auth{0=1} v1883 ap=1 s=7568 n(v0 rc2024-03-27T07:25:36.519821+0000 b7568 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7422680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000f30:[<0x2000000066f/comment-87.xml v1883>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000f30:[<0x2000000066f/comment-87.xml v1883>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.357+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000011de [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-42.xml auth{0=1} v1889 ap=1 s=5382 n(v0 rc2024-03-27T07:25:39.712759+0000 b5382 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7422c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000011de:[<0x2000000066f/comment-42.xml v1889>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000011de:[<0x2000000066f/comment-42.xml v1889>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.357+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000010d7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-65.xml auth{0=1} v1887 ap=1 s=6913 n(v0 rc2024-03-27T07:25:38.530782+0000 b6913 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7423180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000010d7:[<0x2000000066f/comment-65.xml v1887>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000010d7:[<0x2000000066f/comment-65.xml v1887>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.357+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000007a6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml auth{0=1} v587 ap=1 s=4505 n(v0 rc2024-03-27T07:25:27.669996+0000 b4505 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a7423700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000007a6:[<0x2000000066f/article-23.xml v587>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000007a6:[<0x2000000066f/article-23.xml v587>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.722 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.357+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000eea [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-100.xml auth{0=1} v1881 ap=1 s=7584 n(v0 rc2024-03-27T07:25:36.222827+0000 b7584 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac54c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000eea:[<0x2000000066f/comment-100.xml v1881>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000eea:[<0x2000000066f/comment-100.xml v1881>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.357+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000007d9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml auth{0=1} v1867 ap=1 s=2105 n(v0 rc2024-03-27T07:25:27.894991+0000 b2105 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac54c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000007d9:[<0x2000000066f/article-17.xml v1867>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000007d9:[<0x2000000066f/article-17.xml v1867>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.358+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000978 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-32.jpg auth{0=1} v1873 ap=1 s=55690 n(v0 rc2024-03-27T07:25:31.270925+0000 b55690 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac54cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000978:[<0x2000000066f/picture-32.jpg v1873>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000978:[<0x2000000066f/picture-32.jpg v1873>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.358+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000679 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-63.xml auth{0=1} v663 ap=1 s=8936 n(v0 rc2024-03-27T07:25:26.490019+0000 b8936 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac54d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000679:[<0x2000000066f/article-63.xml v663>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000000679:[<0x2000000066f/article-63.xml v663>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.358+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x200000008ce [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-48.jpg auth{0=1} v1877 ap=1 s=23971 n(v0 rc2024-03-27T07:25:30.486940+0000 b23971 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac54d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000008ce:[<0x2000000066f/picture-48.jpg v1877>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x200000008ce:[<0x2000000066f/picture-48.jpg v1877>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.358+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001178 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-51.xml auth{0=1} v1901 ap=1 s=2462 n(v0 rc2024-03-27T07:25:39.228768+0000 b2462 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac54db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001178:[<0x2000000066f/comment-51.xml v1901>,<0x10000000399/blog-12 v61937>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001178:[<0x2000000066f/comment-51.xml v1901>,<0x10000000399/blog-12 v123178>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.440+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f0e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg auth{0=1} v873 ap=1 s=12490 n(v0 rc2024-03-27T07:26:22.663913+0000 b12490 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab741080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f0e:[<0x20000002db4/picture-13.jpg v600>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f0e:[<0x20000002db4/picture-13.jpg v873>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.440+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eff [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg auth{0=1} v877 ap=1 s=48661 n(v0 rc2024-03-27T07:26:22.599914+0000 b48661 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607adf7cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eff:[<0x20000002db4/picture-18.jpg v570>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eff:[<0x20000002db4/picture-18.jpg v877>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.440+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d9a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-74.xml auth v889 ap=1 s=15764 n(v0 rc2024-03-27T07:26:46.230448+0000 b15764 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607adf7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d9a:[<0x20000002db4/article-74.xml v889>,<0x10000000399/blog-83 v114258>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d9a:[<0x20000002db4/article-74.xml v889>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.440+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dc2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml auth{0=1} v747 ap=1 s=31445 n(v0 rc2024-03-27T07:26:18.506994+0000 b31445 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a9c3e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dc2:[<0x20000002db4/article-18.xml v714>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dc2:[<0x20000002db4/article-18.xml v747>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.440+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002efc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg auth{0=1} v879 ap=1 s=61814 n(v0 rc2024-03-27T07:26:22.587914+0000 b61814 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aaf9d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002efc:[<0x20000002db4/picture-19.jpg v564>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002efc:[<0x20000002db4/picture-19.jpg v879>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.441+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e27 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-82.jpg auth v749 ap=1 s=42049 n(v0 rc2024-03-27T07:26:18.918986+0000 b42049 1=1+0) | authpin=1 scrubqueue=0 0x5607a759d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e27:[<0x20000002db4/picture-82.jpg v694>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e27:[<0x20000002db4/picture-82.jpg v749>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.723 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.441+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg auth{0=1} v887 ap=1 s=59966 n(v0 rc2024-03-27T07:26:48.836397+0000 b59966 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad90f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb6:[<0x20000002db4/picture-4.jpg v887>,<0x10000000399/blog-83 v114258>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000eb6:[<0x20000002db4/picture-4.jpg v887>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.441+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ecb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg auth v881 ap=1 s=54880 n(v0 rc2024-03-27T07:26:22.393918+0000 b54880 1=1+0) | authpin=1 scrubqueue=0 0x5607a7582580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ecb:[<0x20000002db4/picture-35.jpg v468>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ecb:[<0x20000002db4/picture-35.jpg v881>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.441+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f36 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg auth{0=1} v867 ap=1 s=11058 n(v0 rc2024-03-27T07:26:23.037905+0000 b11058 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad90f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f36:[<0x20000002db4/picture-2.jpg v668>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f36:[<0x20000002db4/picture-2.jpg v867>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.441+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e35 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-78.jpg auth v865 ap=1 s=56406 n(v0 rc2024-03-27T07:26:21.813929+0000 b56406 1=1+0) | authpin=1 scrubqueue=0 0x5607a7585180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e35:[<0x20000002db4/picture-78.jpg v210>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e35:[<0x20000002db4/picture-78.jpg v865>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.441+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dba [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml auth{0=1} v754 ap=1 s=14109 n(v0 rc2024-03-27T07:26:18.476995+0000 b14109 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aac77080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dba:[<0x20000002db4/article-20.xml v696>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dba:[<0x20000002db4/article-20.xml v754>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.441+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f0b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg auth{0=1} v875 ap=1 s=13535 n(v0 rc2024-03-27T07:26:22.649913+0000 b13535 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8443180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f0b:[<0x20000002db4/picture-14.jpg v594>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f0b:[<0x20000002db4/picture-14.jpg v875>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.442+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e0e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-89.jpg auth v756 ap=1 s=48014 n(v0 rc2024-03-27T07:26:18.828988+0000 b48014 1=1+0) | authpin=1 scrubqueue=0 0x5607a759ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e0e:[<0x20000002db4/picture-89.jpg v718>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e0e:[<0x20000002db4/picture-89.jpg v756>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.442+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e6f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-61.jpg auth v883 ap=1 s=36617 n(v0 rc2024-03-27T07:26:22.118923+0000 b36617 1=1+0) | authpin=1 scrubqueue=0 0x5607a7583b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e6f:[<0x20000002db4/picture-61.jpg v312>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e6f:[<0x20000002db4/picture-61.jpg v883>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.442+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f23 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg auth{0=1} v869 ap=1 s=38091 n(v0 rc2024-03-27T07:26:22.893908+0000 b38091 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab1bdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f23:[<0x20000002db4/picture-7.jpg v636>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f23:[<0x20000002db4/picture-7.jpg v869>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.442+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f1a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg auth{0=1} v871 ap=1 s=10978 n(v0 rc2024-03-27T07:26:22.715912+0000 b10978 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa011700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f1a:[<0x20000002db4/picture-9.jpg v624>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f1a:[<0x20000002db4/picture-9.jpg v871>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.442+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e63 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg auth v865 ap=1 s=18920 n(v0 rc2024-03-27T07:26:22.035925+0000 b18920 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acd98580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e63:[<0x20000002db4/picture-64.jpg v294>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e63:[<0x20000002db4/picture-64.jpg v865>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.442+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f17 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg auth{0=1} v863 ap=1 s=50605 n(v0 rc2024-03-27T07:26:22.701912+0000 b50605 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd98b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f17:[<0x20000002db4/picture-10.jpg v618>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f17:[<0x20000002db4/picture-10.jpg v863>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.724 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.443+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f39 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg auth{0=1} v850 ap=1 s=12103 n(v0 rc2024-03-27T07:26:23.074904+0000 b12103 1=1+0) caps={15291=pAsLsXsFscr/pFscr@46},l=15291 | request=0 lock=0 importingcaps=0 caps=1 exportingcaps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x5607a88df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f39:[<0x20000002db4/picture-1.jpg v680>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f39:[<0x20000002db4/picture-1.jpg v850>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.443+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002de6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml auth{0=1} v762 ap=1 s=31829 n(v0 rc2024-03-27T07:26:18.633992+0000 b31829 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd99080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002de6:[<0x20000002db4/article-9.xml v698>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002de6:[<0x20000002db4/article-9.xml v762>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.443+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e23 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-83.jpg auth v763 ap=1 s=9980 n(v0 rc2024-03-27T07:26:18.907987+0000 b9980 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acd99600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e23:[<0x20000002db4/picture-83.jpg v728>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e23:[<0x20000002db4/picture-83.jpg v763>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.443+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f28 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg auth{0=1} v764 ap=1 s=17992 n(v0 rc2024-03-27T07:26:22.919908+0000 b17992 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd99b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f28:[<0x20000002db4/picture-6.jpg v644>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f28:[<0x20000002db4/picture-6.jpg v764>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.443+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ee0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg auth v871 ap=1 s=45594 n(v0 rc2024-03-27T07:26:22.462917+0000 b45594 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acd9a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ee0:[<0x20000002db4/picture-28.jpg v510>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ee0:[<0x20000002db4/picture-28.jpg v871>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.443+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ec5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg auth v873 ap=1 s=32212 n(v0 rc2024-03-27T07:26:22.383918+0000 b32212 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acd9a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ec5:[<0x20000002db4/picture-37.jpg v456>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ec5:[<0x20000002db4/picture-37.jpg v873>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.443+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f02 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg auth{0=1} v861 ap=1 s=49563 n(v0 rc2024-03-27T07:26:22.609914+0000 b49563 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd9ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f02:[<0x20000002db4/picture-17.jpg v576>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f02:[<0x20000002db4/picture-17.jpg v861>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.444+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e1c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-85.jpg auth v768 ap=1 s=65475 n(v0 rc2024-03-27T07:26:18.883987+0000 b65475 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acd9b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e1c:[<0x20000002db4/picture-85.jpg v730>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e1c:[<0x20000002db4/picture-85.jpg v768>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.444+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dfd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml auth{0=1} v684 ap=1 s=32681 n(v0 rc2024-03-27T07:26:18.685991+0000 b32681 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acd9b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dfd:[<0x20000002db4/article-3.xml v684>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dfd:[<0x20000002db4/article-3.xml v684>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.444+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eec [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg auth v877 ap=1 s=44365 n(v0 rc2024-03-27T07:26:22.508916+0000 b44365 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607abec0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eec:[<0x20000002db4/picture-24.jpg v534>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eec:[<0x20000002db4/picture-24.jpg v877>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.444+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ed1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg auth v867 ap=1 s=50144 n(v0 rc2024-03-27T07:26:22.409918+0000 b50144 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607abec0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ed1:[<0x20000002db4/picture-33.jpg v480>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ed1:[<0x20000002db4/picture-33.jpg v867>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.444+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e7d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-57.jpg auth v857 ap=1 s=37988 n(v0 rc2024-03-27T07:26:22.152923+0000 b37988 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607abec0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e7d:[<0x20000002db4/picture-57.jpg v336>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e7d:[<0x20000002db4/picture-57.jpg v857>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.725 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.444+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dee [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml auth{0=1} v772 ap=1 s=29265 n(v0 rc2024-03-27T07:26:18.650992+0000 b29265 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607abec1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dee:[<0x20000002db4/article-7.xml v700>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dee:[<0x20000002db4/article-7.xml v772>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.445+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eb6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg auth v875 ap=1 s=31000 n(v0 rc2024-03-27T07:26:22.348919+0000 b31000 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607abec1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eb6:[<0x20000002db4/picture-42.jpg v426>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eb6:[<0x20000002db4/picture-42.jpg v875>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.445+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e57 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-68.jpg auth v859 ap=1 s=17426 n(v0 rc2024-03-27T07:26:21.953927+0000 b17426 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607abec1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e57:[<0x20000002db4/picture-68.jpg v270>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e57:[<0x20000002db4/picture-68.jpg v859>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.445+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ebf [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg auth v869 ap=1 s=32154 n(v0 rc2024-03-27T07:26:22.372918+0000 b32154 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607abec2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ebf:[<0x20000002db4/picture-39.jpg v444>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ebf:[<0x20000002db4/picture-39.jpg v869>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.445+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ee9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg auth v864 ap=1 s=23470 n(v0 rc2024-03-27T07:26:22.486916+0000 b23470 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acef9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ee9:[<0x20000002db4/picture-25.jpg v528>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ee9:[<0x20000002db4/picture-25.jpg v864>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.445+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dea [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml auth{0=1} v777 ap=1 s=5989 n(v0 rc2024-03-27T07:26:18.642992+0000 b5989 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acef9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dea:[<0x20000002db4/article-8.xml v740>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dea:[<0x20000002db4/article-8.xml v777>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.445+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ed7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg auth v858 ap=1 s=8698 n(v0 rc2024-03-27T07:26:22.423917+0000 b8698 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acef9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ed7:[<0x20000002db4/picture-31.jpg v492>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ed7:[<0x20000002db4/picture-31.jpg v858>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.445+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e9a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-49.jpg auth v866 ap=1 s=60598 n(v0 rc2024-03-27T07:26:22.279920+0000 b60598 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acefa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e9a:[<0x20000002db4/picture-49.jpg v384>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e9a:[<0x20000002db4/picture-49.jpg v866>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.446+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000eb9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-76.xml auth v872 ap=1 s=12677 n(v0 rc2024-03-27T07:26:48.850397+0000 b12677 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acefa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000eb9:[<0x20000002db4/article-76.xml v872>,<0x10000000399/blog-83 v114258>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000eb9:[<0x20000002db4/article-76.xml v872>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.446+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f1e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg auth{0=1} v856 ap=1 s=12998 n(v0 rc2024-03-27T07:26:22.866909+0000 b12998 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acefac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f1e:[<0x20000002db4/picture-8.jpg v630>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f1e:[<0x20000002db4/picture-8.jpg v856>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.446+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e12 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-88.jpg auth v781 ap=1 s=26850 n(v0 rc2024-03-27T07:26:18.845988+0000 b26850 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acefb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e12:[<0x20000002db4/picture-88.jpg v706>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e12:[<0x20000002db4/picture-88.jpg v781>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.726 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.446+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ee6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg auth v868 ap=1 s=54505 n(v0 rc2024-03-27T07:26:22.478916+0000 b54505 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acefb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ee6:[<0x20000002db4/picture-26.jpg v522>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ee6:[<0x20000002db4/picture-26.jpg v868>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.446+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002db6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml auth{0=1} v783 ap=1 s=22326 n(v0 rc2024-03-27T07:26:18.461995+0000 b22326 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acefc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002db6:[<0x20000002db4/article-21.xml v716>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002db6:[<0x20000002db4/article-21.xml v783>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.446+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dd6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml auth{0=1} v784 ap=1 s=9164 n(v0 rc2024-03-27T07:26:18.582993+0000 b9164 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acefc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dd6:[<0x20000002db4/article-13.xml v710>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dd6:[<0x20000002db4/article-13.xml v784>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.447+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml auth{0=1} v890 ap=1 s=7254 n(v0 rc2024-03-27T07:27:41.015374+0000 b7254 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607acefcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed0:[<0x20000002db4/comment-4.xml v886>,<0x10000000399/blog-83 v118949>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ed0:[<0x20000002db4/comment-4.xml v890>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.447+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002df2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml auth{0=1} v690 ap=1 s=8594 n(v0 rc2024-03-27T07:26:18.658991+0000 b8594 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acefd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002df2:[<0x20000002db4/article-6.xml v690>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002df2:[<0x20000002db4/article-6.xml v690>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.447+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e00 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml auth{0=1} v682 ap=1 s=7449 n(v0 rc2024-03-27T07:26:18.707991+0000 b7449 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acefd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e00:[<0x20000002db4/article-2.xml v682>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e00:[<0x20000002db4/article-2.xml v682>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.447+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002edd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg auth v862 ap=1 s=47905 n(v0 rc2024-03-27T07:26:22.451917+0000 b47905 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acefe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002edd:[<0x20000002db4/picture-29.jpg v504>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002edd:[<0x20000002db4/picture-29.jpg v862>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.447+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e87 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-54.jpg auth v860 ap=1 s=64516 n(v0 rc2024-03-27T07:26:22.181922+0000 b64516 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acefdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e87:[<0x20000002db4/picture-54.jpg v354>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e87:[<0x20000002db4/picture-54.jpg v860>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.447+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001edd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml auth{0=1} v900 ap=1 s=3511 n(v0 rc2024-03-27T07:27:41.099373+0000 b3511 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ad3ba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001edd:[<0x20000002db4/comment-2.xml v896>,<0x10000000399/blog-83 v118949>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001edd:[<0x20000002db4/comment-2.xml v900>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.447+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e19 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-86.jpg auth v787 ap=1 s=36665 n(v0 rc2024-03-27T07:26:18.870987+0000 b36665 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad3ba580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e19:[<0x20000002db4/picture-86.jpg v738>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e19:[<0x20000002db4/picture-86.jpg v787>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.448+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e2a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-81.jpg auth v788 ap=1 s=17480 n(v0 rc2024-03-27T07:26:18.930986+0000 b17480 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad3bab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e2a:[<0x20000002db4/picture-81.jpg v724>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e2a:[<0x20000002db4/picture-81.jpg v788>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.448+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f2e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg auth{0=1} v859 ap=1 s=47968 n(v0 rc2024-03-27T07:26:22.956907+0000 b47968 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3bb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f2e:[<0x20000002db4/picture-5.jpg v650>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f2e:[<0x20000002db4/picture-5.jpg v859>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.727 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.448+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e96 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-50.jpg auth v869 ap=1 s=10718 n(v0 rc2024-03-27T07:26:22.266920+0000 b10718 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad3bb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e96:[<0x20000002db4/picture-50.jpg v378>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e96:[<0x20000002db4/picture-50.jpg v869>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.448+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e7a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-58.jpg auth v867 ap=1 s=59848 n(v0 rc2024-03-27T07:26:22.145923+0000 b59848 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad3bbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e7a:[<0x20000002db4/picture-58.jpg v330>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e7a:[<0x20000002db4/picture-58.jpg v867>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.448+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e60 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-65.jpg auth v863 ap=1 s=59622 n(v0 rc2024-03-27T07:26:21.989926+0000 b59622 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad3bc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e60:[<0x20000002db4/picture-65.jpg v288>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e60:[<0x20000002db4/picture-65.jpg v863>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.448+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e38 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-77.jpg auth v865 ap=1 s=18728 n(v0 rc2024-03-27T07:26:21.844929+0000 b18728 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad3bc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e38:[<0x20000002db4/picture-77.jpg v216>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e38:[<0x20000002db4/picture-77.jpg v865>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.449+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e54 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-69.jpg auth v861 ap=1 s=64234 n(v0 rc2024-03-27T07:26:21.945927+0000 b64234 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad3bcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e54:[<0x20000002db4/picture-69.jpg v264>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e54:[<0x20000002db4/picture-69.jpg v861>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.449+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e92 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-51.jpg auth v871 ap=1 s=14716 n(v0 rc2024-03-27T07:26:22.249921+0000 b14716 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad3bd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e92:[<0x20000002db4/picture-51.jpg v372>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e92:[<0x20000002db4/picture-51.jpg v871>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.449+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e6b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-62.jpg auth v857 ap=1 s=45707 n(v0 rc2024-03-27T07:26:22.091924+0000 b45707 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad3bd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e6b:[<0x20000002db4/picture-62.jpg v306>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e6b:[<0x20000002db4/picture-62.jpg v857>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.449+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ea6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg auth v873 ap=1 s=52027 n(v0 rc2024-03-27T07:26:22.309920+0000 b52027 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ae088000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ea6:[<0x20000002db4/picture-46.jpg v402>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ea6:[<0x20000002db4/picture-46.jpg v873>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.449+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f33 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg auth{0=1} v859 ap=1 s=58999 n(v0 rc2024-03-27T07:26:23.019906+0000 b58999 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac58b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f33:[<0x20000002db4/picture-3.jpg v662>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f33:[<0x20000002db4/picture-3.jpg v859>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.449+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e84 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-55.jpg auth v865 ap=1 s=55277 n(v0 rc2024-03-27T07:26:22.166922+0000 b55277 1=1+0) | authpin=1 scrubqueue=0 0x5607ae304b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e84:[<0x20000002db4/picture-55.jpg v348>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e84:[<0x20000002db4/picture-55.jpg v865>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.450+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f14 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg auth{0=1} v861 ap=1 s=25291 n(v0 rc2024-03-27T07:26:22.688912+0000 b25291 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac58b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f14:[<0x20000002db4/picture-11.jpg v612>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f14:[<0x20000002db4/picture-11.jpg v861>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.450+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e51 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-70.jpg auth v867 ap=1 s=47781 n(v0 rc2024-03-27T07:26:21.936927+0000 b47781 1=1+0) | authpin=1 scrubqueue=0 0x5607ae304000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e51:[<0x20000002db4/picture-70.jpg v258>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e51:[<0x20000002db4/picture-70.jpg v867>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.728 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.450+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002df6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml auth{0=1} v688 ap=1 s=16153 n(v0 rc2024-03-27T07:26:18.665991+0000 b16153 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac58bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002df6:[<0x20000002db4/article-5.xml v688>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002df6:[<0x20000002db4/article-5.xml v688>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.450+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e4d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-71.jpg auth v863 ap=1 s=10497 n(v0 rc2024-03-27T07:26:21.927927+0000 b10497 1=1+0) | authpin=1 scrubqueue=0 0x5607aea39700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e4d:[<0x20000002db4/picture-71.jpg v252>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e4d:[<0x20000002db4/picture-71.jpg v863>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.450+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e66 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-63.jpg auth v857 ap=1 s=37086 n(v0 rc2024-03-27T07:26:22.063924+0000 b37086 1=1+0) | authpin=1 scrubqueue=0 0x5607ae304580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e66:[<0x20000002db4/picture-63.jpg v300>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e66:[<0x20000002db4/picture-63.jpg v857>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.450+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ebc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg auth v869 ap=1 s=65171 n(v0 rc2024-03-27T07:26:22.367918+0000 b65171 1=1+0) | authpin=1 scrubqueue=0 0x5607ae305080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ebc:[<0x20000002db4/picture-40.jpg v438>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ebc:[<0x20000002db4/picture-40.jpg v869>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.450+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e20 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-84.jpg auth v806 ap=1 s=11307 n(v0 rc2024-03-27T07:26:18.894987+0000 b11307 1=1+0) | authpin=1 scrubqueue=0 0x5607aea39180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e20:[<0x20000002db4/picture-84.jpg v720>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e20:[<0x20000002db4/picture-84.jpg v806>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.451+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e15 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-87.jpg auth v805 ap=1 s=28855 n(v0 rc2024-03-27T07:26:18.859988+0000 b28855 1=1+0) | authpin=1 scrubqueue=0 0x5607aea38c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e15:[<0x20000002db4/picture-87.jpg v712>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e15:[<0x20000002db4/picture-87.jpg v805>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.451+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eef [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg auth v868 ap=1 s=29408 n(v0 rc2024-03-27T07:26:22.532915+0000 b29408 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aafdf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eef:[<0x20000002db4/picture-23.jpg v540>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eef:[<0x20000002db4/picture-23.jpg v868>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.451+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e31 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-79.jpg auth v860 ap=1 s=42721 n(v0 rc2024-03-27T07:26:19.161982+0000 b42721 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aafdf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e31:[<0x20000002db4/picture-79.jpg v204>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e31:[<0x20000002db4/picture-79.jpg v860>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.451+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dd2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml auth{0=1} v808 ap=1 s=17263 n(v0 rc2024-03-27T07:26:18.570993+0000 b17263 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aafdfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dd2:[<0x20000002db4/article-14.xml v734>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dd2:[<0x20000002db4/article-14.xml v808>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.451+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eaa [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg auth v882 ap=1 s=62048 n(v0 rc2024-03-27T07:26:22.317919+0000 b62048 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aafe0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eaa:[<0x20000002db4/picture-45.jpg v408>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eaa:[<0x20000002db4/picture-45.jpg v882>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.451+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d95 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-60.jpg auth v888 ap=1 s=39593 n(v0 rc2024-03-27T07:26:46.198449+0000 b39593 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aafe0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d95:[<0x20000002db4/picture-60.jpg v888>,<0x10000000399/blog-83 v114258>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d95:[<0x20000002db4/picture-60.jpg v888>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.451+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eb9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg auth v884 ap=1 s=8275 n(v0 rc2024-03-27T07:26:22.361919+0000 b8275 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aafe0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eb9:[<0x20000002db4/picture-41.jpg v432>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eb9:[<0x20000002db4/picture-41.jpg v884>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.729 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.451+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e5d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-66.jpg auth v878 ap=1 s=11972 n(v0 rc2024-03-27T07:26:21.977926+0000 b11972 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aafe1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e5d:[<0x20000002db4/picture-66.jpg v282>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e5d:[<0x20000002db4/picture-66.jpg v878>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.452+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e2e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-80.jpg auth v870 ap=1 s=59951 n(v0 rc2024-03-27T07:26:18.941986+0000 b59951 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aafe1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e2e:[<0x20000002db4/picture-80.jpg v196>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e2e:[<0x20000002db4/picture-80.jpg v870>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.452+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e07 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-91.jpg auth v814 ap=1 s=35067 n(v0 rc2024-03-27T07:26:18.775989+0000 b35067 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab7ae000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e07:[<0x20000002db4/picture-91.jpg v726>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e07:[<0x20000002db4/picture-91.jpg v814>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.452+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ef3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg auth{0=1} v866 ap=1 s=10173 n(v0 rc2024-03-27T07:26:22.548915+0000 b10173 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab7ae580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ef3:[<0x20000002db4/picture-22.jpg v546>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ef3:[<0x20000002db4/picture-22.jpg v866>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.452+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dde [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml auth{0=1} v816 ap=1 s=11391 n(v0 rc2024-03-27T07:26:18.605993+0000 b11391 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab7aeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dde:[<0x20000002db4/article-11.xml v736>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dde:[<0x20000002db4/article-11.xml v816>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.452+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dca [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml auth{0=1} v817 ap=1 s=12692 n(v0 rc2024-03-27T07:26:18.535994+0000 b12692 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab7af080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dca:[<0x20000002db4/article-16.xml v704>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dca:[<0x20000002db4/article-16.xml v817>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.452+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f08 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg auth{0=1} v864 ap=1 s=45298 n(v0 rc2024-03-27T07:26:22.635913+0000 b45298 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab7af600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f08:[<0x20000002db4/picture-15.jpg v588>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f08:[<0x20000002db4/picture-15.jpg v864>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.453+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e80 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-56.jpg auth v858 ap=1 s=39968 n(v0 rc2024-03-27T07:26:22.159923+0000 b39968 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab7afb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e80:[<0x20000002db4/picture-56.jpg v342>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e80:[<0x20000002db4/picture-56.jpg v858>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.453+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ea2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg auth v880 ap=1 s=31524 n(v0 rc2024-03-27T07:26:22.301920+0000 b31524 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab7b0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ea2:[<0x20000002db4/picture-47.jpg v396>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ea2:[<0x20000002db4/picture-47.jpg v880>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.453+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002de2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml auth{0=1} v821 ap=1 s=22306 n(v0 rc2024-03-27T07:26:18.621992+0000 b22306 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab7b0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002de2:[<0x20000002db4/article-10.xml v692>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002de2:[<0x20000002db4/article-10.xml v821>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.453+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f11 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg auth{0=1} v862 ap=1 s=8283 n(v0 rc2024-03-27T07:26:22.676912+0000 b8283 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab7b0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f11:[<0x20000002db4/picture-12.jpg v606>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f11:[<0x20000002db4/picture-12.jpg v862>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.453+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eae [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg auth v876 ap=1 s=10431 n(v0 rc2024-03-27T07:26:22.325919+0000 b10431 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab7b1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eae:[<0x20000002db4/picture-44.jpg v414>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eae:[<0x20000002db4/picture-44.jpg v876>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.730 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.453+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002df9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml auth{0=1} v686 ap=1 s=32049 n(v0 rc2024-03-27T07:26:18.673991+0000 b32049 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab7b1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002df9:[<0x20000002db4/article-4.xml v686>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002df9:[<0x20000002db4/article-4.xml v686>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.454+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e4b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-72.jpg auth v872 ap=1 s=61978 n(v0 rc2024-03-27T07:26:21.919927+0000 b61978 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad298000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e4b:[<0x20000002db4/picture-72.jpg v246>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e4b:[<0x20000002db4/picture-72.jpg v872>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.454+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e76 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-59.jpg auth v874 ap=1 s=13369 n(v0 rc2024-03-27T07:26:22.137923+0000 b13369 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ad298580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e76:[<0x20000002db4/picture-59.jpg v324>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e76:[<0x20000002db4/picture-59.jpg v874>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.454+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e46 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-73.jpg auth v859 ap=1 s=16307 n(v0 rc2024-03-27T07:26:21.911927+0000 b16307 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aba18580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e46:[<0x20000002db4/picture-73.jpg v240>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e46:[<0x20000002db4/picture-73.jpg v859>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.454+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e40 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-75.jpg auth v861 ap=1 s=65110 n(v0 rc2024-03-27T07:26:21.883928+0000 b65110 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab5d3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e40:[<0x20000002db4/picture-75.jpg v228>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e40:[<0x20000002db4/picture-75.jpg v861>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.454+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ef6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg auth{0=1} v855 ap=1 s=54785 n(v0 rc2024-03-27T07:26:22.560915+0000 b54785 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab5d2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ef6:[<0x20000002db4/picture-21.jpg v552>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ef6:[<0x20000002db4/picture-21.jpg v855>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.454+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ee3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml auth{0=1} v893 ap=1 s=7694 n(v0 rc2024-03-27T07:27:41.124372+0000 b7694 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607a6e68c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ee3:[<0x20000002db4/comment-1.xml v889>,<0x10000000399/blog-83 v118949>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ee3:[<0x20000002db4/comment-1.xml v893>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.454+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eda [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg auth v863 ap=1 s=42147 n(v0 rc2024-03-27T07:26:22.429917+0000 b42147 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aa00bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eda:[<0x20000002db4/picture-30.jpg v498>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eda:[<0x20000002db4/picture-30.jpg v863>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.455+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dce [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml auth{0=1} v830 ap=1 s=7578 n(v0 rc2024-03-27T07:26:18.554994+0000 b7578 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad460100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dce:[<0x20000002db4/article-15.xml v722>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dce:[<0x20000002db4/article-15.xml v830>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.455+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ec8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg auth v867 ap=1 s=40263 n(v0 rc2024-03-27T07:26:22.388918+0000 b40263 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607abfbeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ec8:[<0x20000002db4/picture-36.jpg v462>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ec8:[<0x20000002db4/picture-36.jpg v867>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.455+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002eb2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg auth v857 ap=1 s=12317 n(v0 rc2024-03-27T07:26:22.334919+0000 b12317 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607aa545180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002eb2:[<0x20000002db4/picture-43.jpg v420>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002eb2:[<0x20000002db4/picture-43.jpg v857>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.731 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.455+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dbe [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml auth{0=1} v833 ap=1 s=1356 n(v0 rc2024-03-27T07:26:18.491995+0000 b1356 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a78eb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dbe:[<0x20000002db4/article-19.xml v702>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dbe:[<0x20000002db4/article-19.xml v833>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.455+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ef9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg auth{0=1} v853 ap=1 s=24098 n(v0 rc2024-03-27T07:26:22.573914+0000 b24098 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab8d8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ef9:[<0x20000002db4/picture-20.jpg v558>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ef9:[<0x20000002db4/picture-20.jpg v853>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.455+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ec2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg auth v865 ap=1 s=37610 n(v0 rc2024-03-27T07:26:22.377918+0000 b37610 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab8d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ec2:[<0x20000002db4/picture-38.jpg v450>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ec2:[<0x20000002db4/picture-38.jpg v865>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.456+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ee3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg auth v865 ap=1 s=10639 n(v0 rc2024-03-27T07:26:22.471916+0000 b10639 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ace90580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ee3:[<0x20000002db4/picture-27.jpg v516>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ee3:[<0x20000002db4/picture-27.jpg v865>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.456+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013e7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-36.xml auth v883 ap=1 s=6587 n(v0 rc2024-03-27T07:27:09.458993+0000 b6587 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ace90b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013e7:[<0x20000002db4/article-36.xml v879>,<0x10000000399/blog-83 v114650>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000013e7:[<0x20000002db4/article-36.xml v883>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.456+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dda [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml auth{0=1} v837 ap=1 s=2378 n(v0 rc2024-03-27T07:26:18.593993+0000 b2378 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ace91080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dda:[<0x20000002db4/article-12.xml v708>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dda:[<0x20000002db4/article-12.xml v837>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.456+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e8e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-52.jpg auth v863 ap=1 s=45009 n(v0 rc2024-03-27T07:26:22.233921+0000 b45009 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ace91600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e8e:[<0x20000002db4/picture-52.jpg v366>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e8e:[<0x20000002db4/picture-52.jpg v863>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.456+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e04 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml auth{0=1} v678 ap=1 s=27311 n(v0 rc2024-03-27T07:26:18.740990+0000 b27311 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ace91b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e04:[<0x20000002db4/article-1.xml v678>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e04:[<0x20000002db4/article-1.xml v678>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.456+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ece [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg auth v855 ap=1 s=34500 n(v0 rc2024-03-27T07:26:22.402918+0000 b34500 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ace92100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ece:[<0x20000002db4/picture-34.jpg v474>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ece:[<0x20000002db4/picture-34.jpg v855>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.456+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e8b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-53.jpg auth v869 ap=1 s=25183 n(v0 rc2024-03-27T07:26:22.210921+0000 b25183 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ace92680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e8b:[<0x20000002db4/picture-53.jpg v360>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e8b:[<0x20000002db4/picture-53.jpg v869>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.457+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e5a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-67.jpg auth v859 ap=1 s=18025 n(v0 rc2024-03-27T07:26:21.963926+0000 b18025 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ace92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e5a:[<0x20000002db4/picture-67.jpg v276>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e5a:[<0x20000002db4/picture-67.jpg v859>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.457+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ed7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml auth{0=1} v894 ap=1 s=8566 n(v0 rc2024-03-27T07:27:41.065373+0000 b8566 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5607ace93700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ed7:[<0x20000002db4/comment-3.xml v886>,<0x10000000399/blog-83 v118949>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ed7:[<0x20000002db4/comment-3.xml v894>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.732 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.457+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e0b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-90.jpg auth v842 ap=1 s=43240 n(v0 rc2024-03-27T07:26:18.804989+0000 b43240 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ace93180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e0b:[<0x20000002db4/picture-90.jpg v742>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e0b:[<0x20000002db4/picture-90.jpg v842>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.457+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002f05 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg auth{0=1} v853 ap=1 s=17185 n(v0 rc2024-03-27T07:26:22.620913+0000 b17185 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab432000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002f05:[<0x20000002db4/picture-16.jpg v582>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002f05:[<0x20000002db4/picture-16.jpg v853>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.457+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e44 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-74.jpg auth v867 ap=1 s=10234 n(v0 rc2024-03-27T07:26:21.898928+0000 b10234 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab432580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e44:[<0x20000002db4/picture-74.jpg v234>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e44:[<0x20000002db4/picture-74.jpg v867>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.457+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002dc6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml auth{0=1} v845 ap=1 s=31675 n(v0 rc2024-03-27T07:26:18.521994+0000 b31675 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab432b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002dc6:[<0x20000002db4/article-17.xml v732>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002dc6:[<0x20000002db4/article-17.xml v845>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.458+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e3d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-76.jpg auth v871 ap=1 s=21178 n(v0 rc2024-03-27T07:26:21.860928+0000 b21178 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab433080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e3d:[<0x20000002db4/picture-76.jpg v222>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e3d:[<0x20000002db4/picture-76.jpg v871>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.458+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002ed4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg auth v857 ap=1 s=50579 n(v0 rc2024-03-27T07:26:22.415917+0000 b50579 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab433600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002ed4:[<0x20000002db4/picture-32.jpg v486>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002ed4:[<0x20000002db4/picture-32.jpg v857>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.458+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e9e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-48.jpg auth v861 ap=1 s=47937 n(v0 rc2024-03-27T07:26:22.290920+0000 b47937 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607ab433b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e9e:[<0x20000002db4/picture-48.jpg v390>,<0x10000000399/blog-83 v96518>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e9e:[<0x20000002db4/picture-48.jpg v861>,<0x10000000399/blog-83 v131417>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.482+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b8f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-35.xml auth{0=1} v1242 ap=1 s=17499 n(v0 rc2024-03-27T07:25:33.039890+0000 b17499 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf27600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b8f:[<0x20000000b61/article-35.xml v1242>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b8f:[<0x20000000b61/article-35.xml v1242>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.482+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c52 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-21.jpg auth{0=1} v1246 ap=1 s=18050 n(v0 rc2024-03-27T07:25:33.802875+0000 b18050 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf27080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c52:[<0x20000000b61/picture-21.jpg v1246>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c52:[<0x20000000b61/picture-21.jpg v1246>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.482+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-73.xml auth{0=1} v1471 ap=1 s=10097 n(v0 rc2024-03-27T07:27:18.516815+0000 b10097 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf27b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182c:[<0x20000000b61/comment-73.xml v1328>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000182c:[<0x20000000b61/comment-73.xml v1471>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.482+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001842 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-60.xml auth{0=1} v1467 ap=1 s=2962 n(v0 rc2024-03-27T07:27:18.623813+0000 b2962 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf28100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001842:[<0x20000000b61/comment-60.xml v1345>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001842:[<0x20000000b61/comment-60.xml v1467>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.483+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001820 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-78.xml auth{0=1} v1473 ap=1 s=5319 n(v0 rc2024-03-27T07:27:18.411817+0000 b5319 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acf28680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001820:[<0x20000000b61/comment-78.xml v1326>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001820:[<0x20000000b61/comment-78.xml v1473>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.733 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.483+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ae [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-86.xml auth v1479 ap=1 s=8248 n(v0 rc2024-03-27T07:27:09.167998+0000 b8248 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x5607acf29180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ae:[<0x20000000b61/article-86.xml v1312>,<0x10000000399/blog-19 v116859>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x100000013ae:[<0x20000000b61/article-86.xml v1479>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.483+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018ba [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-1.xml auth{0=1} v1455 ap=1 s=2657 n(v0 rc2024-03-27T07:27:20.021786+0000 b2657 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3fc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018ba:[<0x20000000b61/comment-1.xml v1455>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018ba:[<0x20000000b61/comment-1.xml v1455>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.483+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b7b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-40.xml auth{0=1} v1256 ap=1 s=4812 n(v0 rc2024-03-27T07:25:32.971891+0000 b4812 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3fc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b7b:[<0x20000000b61/article-40.xml v770>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b7b:[<0x20000000b61/article-40.xml v1256>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.483+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000222a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-15.xml auth{0=1} v1486 ap=1 s=24359 n(v0 rc2024-03-27T07:27:50.816182+0000 b24359 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3fd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000222a:[<0x20000000b61/article-15.xml v1486>,<0x10000000399/blog-19 v129118>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000222a:[<0x20000000b61/article-15.xml v1486>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.483+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001862 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-40.xml auth{0=1} v1463 ap=1 s=8815 n(v0 rc2024-03-27T07:27:19.133803+0000 b8815 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3fe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001862:[<0x20000000b61/comment-40.xml v1375>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001862:[<0x20000000b61/comment-40.xml v1463>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.484+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-79.xml auth{0=1} v1475 ap=1 s=2796 n(v0 rc2024-03-27T07:27:18.396818+0000 b2796 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3fd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181e:[<0x20000000b61/comment-79.xml v1324>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000181e:[<0x20000000b61/comment-79.xml v1475>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.484+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001872 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-33.xml auth{0=1} v1459 ap=1 s=2890 n(v0 rc2024-03-27T07:27:19.334799+0000 b2890 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3fec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001872:[<0x20000000b61/comment-33.xml v1387>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001872:[<0x20000000b61/comment-33.xml v1459>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.484+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001864 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-39.xml auth{0=1} v1461 ap=1 s=6095 n(v0 rc2024-03-27T07:27:19.162803+0000 b6095 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad3ff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001864:[<0x20000000b61/comment-39.xml v1379>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001864:[<0x20000000b61/comment-39.xml v1461>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.484+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bc3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml auth{0=1} v1252 ap=1 s=24481 n(v0 rc2024-03-27T07:25:33.230886+0000 b24481 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8e56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bc3:[<0x20000000b61/article-19.xml v772>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bc3:[<0x20000000b61/article-19.xml v1252>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.484+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c5b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-20.jpg auth{0=1} v1248 ap=1 s=23564 n(v0 rc2024-03-27T07:25:33.832874+0000 b23564 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8e56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c5b:[<0x20000000b61/picture-20.jpg v1248>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c5b:[<0x20000000b61/picture-20.jpg v1248>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.484+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-82.xml auth{0=1} v1477 ap=1 s=8099 n(v0 rc2024-03-27T07:27:18.379818+0000 b8099 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8e56b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181b:[<0x20000000b61/comment-82.xml v1321>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000181b:[<0x20000000b61/comment-82.xml v1477>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.485+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001873 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-32.xml auth{0=1} v1457 ap=1 s=6813 n(v0 rc2024-03-27T07:27:19.345799+0000 b6813 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8e57600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001873:[<0x20000000b61/comment-32.xml v1390>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001873:[<0x20000000b61/comment-32.xml v1457>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.734 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.485+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-63.xml auth{0=1} v1469 ap=1 s=7270 n(v0 rc2024-03-27T07:27:18.603813+0000 b7270 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8e57b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183d:[<0x20000000b61/comment-63.xml v1341>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000183d:[<0x20000000b61/comment-63.xml v1469>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.485+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001850 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-54.xml auth{0=1} v1465 ap=1 s=9728 n(v0 rc2024-03-27T07:27:18.659812+0000 b9728 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8e58680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001850:[<0x20000000b61/comment-54.xml v1349>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001850:[<0x20000000b61/comment-54.xml v1465>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.485+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-81.xml auth{0=1} v1461 ap=1 s=10229 n(v0 rc2024-03-27T07:27:18.385818+0000 b10229 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfdcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181c:[<0x20000000b61/comment-81.xml v1305>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000181c:[<0x20000000b61/comment-81.xml v1461>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.485+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-10.xml auth{0=1} v1443 ap=1 s=9562 n(v0 rc2024-03-27T07:27:19.770791+0000 b9562 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfdd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a3:[<0x20000000b61/comment-10.xml v1443>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018a3:[<0x20000000b61/comment-10.xml v1443>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.485+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b73 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-42.xml auth{0=1} v1250 ap=1 s=17456 n(v0 rc2024-03-27T07:25:32.940892+0000 b17456 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607a8e58c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b73:[<0x20000000b61/article-42.xml v774>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b73:[<0x20000000b61/article-42.xml v1250>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.486+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cd2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg auth{0=1} v1246 ap=1 s=56465 n(v0 rc2024-03-27T07:25:34.283865+0000 b56465 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfddb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cd2:[<0x20000000b61/picture-3.jpg v1246>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cd2:[<0x20000000b61/picture-3.jpg v1246>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.486+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001851 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-53.xml auth{0=1} v1451 ap=1 s=8837 n(v0 rc2024-03-27T07:27:18.666812+0000 b8837 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfde680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001851:[<0x20000000b61/comment-53.xml v1358>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001851:[<0x20000000b61/comment-53.xml v1451>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.486+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-6.xml auth{0=1} v1439 ap=1 s=2899 n(v0 rc2024-03-27T07:27:19.912788+0000 b2899 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfdf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b2:[<0x20000000b61/comment-6.xml v1439>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018b2:[<0x20000000b61/comment-6.xml v1439>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.486+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cae [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg auth{0=1} v1252 ap=1 s=59422 n(v0 rc2024-03-27T07:25:34.173868+0000 b59422 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607acfdf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cae:[<0x20000000b61/picture-11.jpg v1252>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cae:[<0x20000000b61/picture-11.jpg v1252>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.486+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b93 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-34.xml auth{0=1} v1244 ap=1 s=21672 n(v0 rc2024-03-27T07:25:33.050890+0000 b21672 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad878580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b93:[<0x20000000b61/article-34.xml v1244>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b93:[<0x20000000b61/article-34.xml v1244>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.486+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bfe [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml auth{0=1} v1248 ap=1 s=2967 n(v0 rc2024-03-27T07:25:33.457882+0000 b2967 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad878000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bfe:[<0x20000000b61/article-5.xml v1248>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bfe:[<0x20000000b61/article-5.xml v1248>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.487+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000186d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-35.xml auth{0=1} v1447 ap=1 s=6742 n(v0 rc2024-03-27T07:27:19.292800+0000 b6742 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad879080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000186d:[<0x20000000b61/comment-35.xml v1383>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000186d:[<0x20000000b61/comment-35.xml v1447>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.487+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000187c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-28.xml auth{0=1} v1445 ap=1 s=2381 n(v0 rc2024-03-27T07:27:19.410798+0000 b2381 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad879b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000187c:[<0x20000000b61/comment-28.xml v1391>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000187c:[<0x20000000b61/comment-28.xml v1445>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.735 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.487+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001849 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-57.xml auth{0=1} v1453 ap=1 s=5344 n(v0 rc2024-03-27T07:27:18.640813+0000 b5344 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad87a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001849:[<0x20000000b61/comment-57.xml v1347>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001849:[<0x20000000b61/comment-57.xml v1453>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.487+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000238c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-63.jpg auth v1484 ap=1 s=60362 n(v0 rc2024-03-27T07:27:52.643146+0000 b60362 1=1+0) | replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5607ad87ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000238c:[<0x20000000b61/picture-63.jpg v1478>,<0x10000000399/blog-19 v129118>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x1000000238c:[<0x20000000b61/picture-63.jpg v1484>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.487+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001840 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-61.xml auth{0=1} v1455 ap=1 s=9599 n(v0 rc2024-03-27T07:27:18.619813+0000 b9599 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad87b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001840:[<0x20000000b61/comment-61.xml v1345>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001840:[<0x20000000b61/comment-61.xml v1455>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.487+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ba6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml auth{0=1} v1250 ap=1 s=28640 n(v0 rc2024-03-27T07:25:33.107889+0000 b28640 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad87a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ba6:[<0x20000000b61/article-29.xml v1250>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ba6:[<0x20000000b61/article-29.xml v1250>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.487+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bb9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml auth{0=1} v1242 ap=1 s=31613 n(v0 rc2024-03-27T07:25:33.186887+0000 b31613 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ad87b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bb9:[<0x20000000b61/article-22.xml v1242>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bb9:[<0x20000000b61/article-22.xml v1242>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.488+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001865 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-38.xml auth{0=1} v1449 ap=1 s=2505 n(v0 rc2024-03-27T07:27:19.192802+0000 b2505 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade74580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001865:[<0x20000000b61/comment-38.xml v1373>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001865:[<0x20000000b61/comment-38.xml v1449>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.488+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001835 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-68.xml auth{0=1} v1457 ap=1 s=3442 n(v0 rc2024-03-27T07:27:18.569814+0000 b3442 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade74b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001835:[<0x20000000b61/comment-68.xml v1335>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001835:[<0x20000000b61/comment-68.xml v1457>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.488+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-8.xml auth{0=1} v1441 ap=1 s=9852 n(v0 rc2024-03-27T07:27:19.805790+0000 b9852 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade75600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a7:[<0x20000000b61/comment-8.xml v1441>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018a7:[<0x20000000b61/comment-8.xml v1441>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.488+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000181d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-80.xml auth{0=1} v1459 ap=1 s=9297 n(v0 rc2024-03-27T07:27:18.392818+0000 b9297 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade75b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000181d:[<0x20000000b61/comment-80.xml v1321>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000181d:[<0x20000000b61/comment-80.xml v1459>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.488+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000188a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-22.xml auth{0=1} v1460 ap=1 s=2236 n(v0 rc2024-03-27T07:27:19.556795+0000 b2236 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade40100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000188a:[<0x20000000b61/comment-22.xml v1411>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000188a:[<0x20000000b61/comment-22.xml v1460>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.489+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-2.xml auth{0=1} v1450 ap=1 s=3457 n(v0 rc2024-03-27T07:27:20.009786+0000 b3457 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade40c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b8:[<0x20000000b61/comment-2.xml v1450>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018b8:[<0x20000000b61/comment-2.xml v1450>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.489+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b6f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-43.xml auth{0=1} v1248 ap=1 s=5887 n(v0 rc2024-03-27T07:25:32.929892+0000 b5887 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab042000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b6f:[<0x20000000b61/article-43.xml v1248>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b6f:[<0x20000000b61/article-43.xml v1248>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.736 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.489+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ccc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-33.xml auth{0=1} v1302 ap=1 s=3672 n(v0 rc2024-03-27T07:26:33.275704+0000 b3672 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab042580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ccc:[<0x20000000b61/article-33.xml v1297>,<0x10000000399/blog-19 v112242>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ccc:[<0x20000000b61/article-33.xml v1302>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.489+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000185e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-44.xml auth{0=1} v1466 ap=1 s=9261 n(v0 rc2024-03-27T07:27:19.036805+0000 b9261 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ade41700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000185e:[<0x20000000b61/comment-44.xml v1368>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000185e:[<0x20000000b61/comment-44.xml v1466>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.489+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000187d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-27.xml auth{0=1} v1462 ap=1 s=2491 n(v0 rc2024-03-27T07:27:19.417798+0000 b2491 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab043600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000187d:[<0x20000000b61/comment-27.xml v1395>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000187d:[<0x20000000b61/comment-27.xml v1462>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.489+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cca [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg auth{0=1} v1242 ap=1 s=29765 n(v0 rc2024-03-27T07:25:34.262866+0000 b29765 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab042b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cca:[<0x20000000b61/picture-5.jpg v1242>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cca:[<0x20000000b61/picture-5.jpg v1242>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.490+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001822 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-76.xml auth{0=1} v1474 ap=1 s=8366 n(v0 rc2024-03-27T07:27:18.425817+0000 b8366 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab043b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001822:[<0x20000000b61/comment-76.xml v1329>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001822:[<0x20000000b61/comment-76.xml v1474>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.490+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001838 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-66.xml auth{0=1} v1472 ap=1 s=6069 n(v0 rc2024-03-27T07:27:18.585814+0000 b6069 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab044c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001838:[<0x20000000b61/comment-66.xml v1333>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001838:[<0x20000000b61/comment-66.xml v1472>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.490+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001853 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-52.xml auth{0=1} v1470 ap=1 s=9634 n(v0 rc2024-03-27T07:27:18.683812+0000 b9634 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab044680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001853:[<0x20000000b61/comment-52.xml v1362>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001853:[<0x20000000b61/comment-52.xml v1470>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.490+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018ae [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-7.xml auth{0=1} v1452 ap=1 s=4369 n(v0 rc2024-03-27T07:27:19.880788+0000 b4369 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab045700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018ae:[<0x20000000b61/comment-7.xml v1452>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018ae:[<0x20000000b61/comment-7.xml v1452>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.490+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000185f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-43.xml auth{0=1} v1464 ap=1 s=5650 n(v0 rc2024-03-27T07:27:19.049805+0000 b5650 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aec8d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000185f:[<0x20000000b61/comment-43.xml v1371>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000185f:[<0x20000000b61/comment-43.xml v1464>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.490+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001893 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-17.xml auth{0=1} v1458 ap=1 s=3799 n(v0 rc2024-03-27T07:27:19.624793+0000 b3799 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aec8db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001893:[<0x20000000b61/comment-17.xml v1418>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001893:[<0x20000000b61/comment-17.xml v1458>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.490+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001898 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-15.xml auth{0=1} v1456 ap=1 s=4452 n(v0 rc2024-03-27T07:27:19.678792+0000 b4452 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aec8c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001898:[<0x20000000b61/comment-15.xml v1421>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001898:[<0x20000000b61/comment-15.xml v1456>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.491+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ba9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml auth{0=1} v1244 ap=1 s=2105 n(v0 rc2024-03-27T07:25:33.119888+0000 b2105 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aec8e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ba9:[<0x20000000b61/article-28.xml v1244>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ba9:[<0x20000000b61/article-28.xml v1244>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.491+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-9.xml auth{0=1} v1454 ap=1 s=4668 n(v0 rc2024-03-27T07:27:19.783790+0000 b4668 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aec8ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a5:[<0x20000000b61/comment-9.xml v1454>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018a5:[<0x20000000b61/comment-9.xml v1454>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.737 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.491+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000185d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-45.xml auth{0=1} v1468 ap=1 s=2560 n(v0 rc2024-03-27T07:27:19.013805+0000 b2560 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aec8f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000185d:[<0x20000000b61/comment-45.xml v1365>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000185d:[<0x20000000b61/comment-45.xml v1468>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.491+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c29 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-25.jpg auth{0=1} v1254 ap=1 s=39648 n(v0 rc2024-03-27T07:25:33.635878+0000 b39648 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa377600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c29:[<0x20000000b61/picture-25.jpg v735>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c29:[<0x20000000b61/picture-25.jpg v1254>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.491+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bf2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml auth{0=1} v1242 ap=1 s=13503 n(v0 rc2024-03-27T07:25:33.414883+0000 b13503 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa377b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bf2:[<0x20000000b61/article-8.xml v1242>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bf2:[<0x20000000b61/article-8.xml v1242>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.492+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000185b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-47.xml auth{0=1} v1458 ap=1 s=6685 n(v0 rc2024-03-27T07:27:18.873808+0000 b6685 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa378680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000185b:[<0x20000000b61/comment-47.xml v1357>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000185b:[<0x20000000b61/comment-47.xml v1458>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.492+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000185c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-46.xml auth{0=1} v1456 ap=1 s=8391 n(v0 rc2024-03-27T07:27:18.924807+0000 b8391 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa379180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000185c:[<0x20000000b61/comment-46.xml v1362>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000185c:[<0x20000000b61/comment-46.xml v1456>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.492+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001832 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-70.xml auth{0=1} v1466 ap=1 s=8025 n(v0 rc2024-03-27T07:27:18.543815+0000 b8025 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9b4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001832:[<0x20000000b61/comment-70.xml v1333>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001832:[<0x20000000b61/comment-70.xml v1466>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.492+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000170d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-31.jpg auth{0=1} v1446 ap=1 s=58471 n(v0 rc2024-03-27T07:27:16.440856+0000 b58471 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607aa379700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000170d:[<0x20000000b61/picture-31.jpg v1446>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000170d:[<0x20000000b61/picture-31.jpg v1446>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.492+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cbd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg auth{0=1} v1252 ap=1 s=56617 n(v0 rc2024-03-27T07:25:34.222867+0000 b56617 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9b4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cbd:[<0x20000000b61/picture-8.jpg v1252>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cbd:[<0x20000000b61/picture-8.jpg v1252>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.492+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c21 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-26.jpg auth{0=1} v1256 ap=1 s=44401 n(v0 rc2024-03-27T07:25:33.602879+0000 b44401 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9b4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c21:[<0x20000000b61/picture-26.jpg v738>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c21:[<0x20000000b61/picture-26.jpg v1256>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.492+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b9b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-32.xml auth{0=1} v1244 ap=1 s=10179 n(v0 rc2024-03-27T07:25:33.073889+0000 b10179 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9b5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b9b:[<0x20000000b61/article-32.xml v1244>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b9b:[<0x20000000b61/article-32.xml v1244>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.493+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001833 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-69.xml auth{0=1} v1464 ap=1 s=2964 n(v0 rc2024-03-27T07:27:18.555814+0000 b2964 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9b5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001833:[<0x20000000b61/comment-69.xml v1337>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001833:[<0x20000000b61/comment-69.xml v1464>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.493+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ba3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml auth{0=1} v1258 ap=1 s=20546 n(v0 rc2024-03-27T07:25:33.096889+0000 b20546 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9b6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ba3:[<0x20000000b61/article-30.xml v741>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ba3:[<0x20000000b61/article-30.xml v1258>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.738 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.493+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bbd [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml auth{0=1} v1250 ap=1 s=29886 n(v0 rc2024-03-27T07:25:33.197887+0000 b29886 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9b5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bbd:[<0x20000000b61/article-21.xml v1250>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bbd:[<0x20000000b61/article-21.xml v1250>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.493+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001829 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-74.xml auth{0=1} v1470 ap=1 s=5717 n(v0 rc2024-03-27T07:27:18.507815+0000 b5717 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9b6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001829:[<0x20000000b61/comment-74.xml v1319>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001829:[<0x20000000b61/comment-74.xml v1470>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.493+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000186a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-36.xml auth{0=1} v1454 ap=1 s=3829 n(v0 rc2024-03-27T07:27:19.253801+0000 b3829 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9b7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000186a:[<0x20000000b61/comment-36.xml v1380>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000186a:[<0x20000000b61/comment-36.xml v1454>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.494+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-64.xml auth{0=1} v1460 ap=1 s=7707 n(v0 rc2024-03-27T07:27:18.598814+0000 b7707 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac266000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183b:[<0x20000000b61/comment-64.xml v1341>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000183b:[<0x20000000b61/comment-64.xml v1460>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.494+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bdf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml auth{0=1} v1262 ap=1 s=6305 n(v0 rc2024-03-27T07:25:33.343884+0000 b6305 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ab9b7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bdf:[<0x20000000b61/article-13.xml v742>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bdf:[<0x20000000b61/article-13.xml v1262>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.494+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000182e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-72.xml auth{0=1} v1468 ap=1 s=9366 n(v0 rc2024-03-27T07:27:18.522815+0000 b9366 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac266580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000182e:[<0x20000000b61/comment-72.xml v1331>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000182e:[<0x20000000b61/comment-72.xml v1468>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.494+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-4.xml auth{0=1} v1448 ap=1 s=6699 n(v0 rc2024-03-27T07:27:19.989786+0000 b6699 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac267080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b6:[<0x20000000b61/comment-4.xml v1448>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018b6:[<0x20000000b61/comment-4.xml v1448>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.494+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bfa [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml auth{0=1} v1246 ap=1 s=27664 n(v0 rc2024-03-27T07:25:33.443882+0000 b27664 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac267600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bfa:[<0x20000000b61/article-6.xml v1246>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bfa:[<0x20000000b61/article-6.xml v1246>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.494+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c09 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml auth{0=1} v1248 ap=1 s=8659 n(v0 rc2024-03-27T07:25:33.504881+0000 b8659 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac267b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c09:[<0x20000000b61/article-2.xml v1248>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c09:[<0x20000000b61/article-2.xml v1248>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.495+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000189d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-14.xml auth{0=1} v1450 ap=1 s=5002 n(v0 rc2024-03-27T07:27:19.736791+0000 b5002 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac268680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000189d:[<0x20000000b61/comment-14.xml v1425>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000189d:[<0x20000000b61/comment-14.xml v1450>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.495+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001837 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-67.xml auth{0=1} v1462 ap=1 s=3182 n(v0 rc2024-03-27T07:27:18.578814+0000 b3182 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac268c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001837:[<0x20000000b61/comment-67.xml v1339>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001837:[<0x20000000b61/comment-67.xml v1462>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.739 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:28:25.495+0000 7f11283af700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001891 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-19.xml auth{0=1} v1452 ap=1 s=9165 n(v0 rc2024-03-27T07:27:19.605794+0000 b9165 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x5607ac269700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001891:[<0x20000000b61/comment-19.xml v1422>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001891:[<0x20000000b61/comment-19.xml v1452>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2302>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.912 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.912 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001000 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.912 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.912 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ff1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.912 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000daf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.912 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000083d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.912 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.912 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-82.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001023 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fa4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000102b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-78.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000daa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ffd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f1d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001017 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.913 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000100f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000837 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000082e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ef5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000812 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000100b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000102f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000832 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.914 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000101b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000da1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000081a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000080a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ff4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000df6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-85.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000de9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.915 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ddb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ec7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000082b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000082a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cf9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000006f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000800 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.916 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.917 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.917 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000705 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.917 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.574+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cbb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-55.xml auth{0=1} v1040 ap=1 s=18383 n(v0 rc2024-03-27T07:25:51.283531+0000 b18383 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc5d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cbb:[<0x20000001c64/article-55.xml v1040>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cbb:[<0x20000001c64/article-55.xml v1040>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.917 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.574+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dc6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-25.jpg auth{0=1} v988 ap=1 s=63907 n(v0 rc2024-03-27T07:25:52.484507+0000 b63907 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc5d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dc6:[<0x20000001c64/picture-25.jpg v988>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dc6:[<0x20000001c64/picture-25.jpg v988>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.917 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.575+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d33 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-8.xml auth{0=1} v1018 ap=1 s=11940 n(v0 rc2024-03-27T07:25:51.993517+0000 b11940 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d33:[<0x20000001c64/article-8.xml v1018>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d33:[<0x20000001c64/article-8.xml v1018>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.917 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.575+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000428b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-47.xml auth{0=1} v1256 ap=1 s=8486 n(v0 rc2024-03-27T07:26:46.145450+0000 b8486 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000428b:[<0x20000001c64/comment-47.xml v1256>,<0x10000000399/blog-48 v113443>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x2000000428b:[<0x20000001c64/comment-47.xml v1256>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.917 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.575+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004526 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-46.xml auth{0=1} v1254 ap=1 s=8363 n(v0 rc2024-03-27T07:26:48.555403+0000 b8363 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004526:[<0x20000001c64/comment-46.xml v1254>,<0x10000000399/blog-48 v113443>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x20000004526:[<0x20000001c64/comment-46.xml v1254>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.917 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.575+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001da6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-31.jpg auth{0=1} v1030 ap=1 s=59721 n(v0 rc2024-03-27T07:25:52.377509+0000 b59721 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001da6:[<0x20000001c64/picture-31.jpg v1030>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001da6:[<0x20000001c64/picture-31.jpg v1030>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.918 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.575+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d5b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-49.jpg auth{0=1} v1044 ap=1 s=13638 n(v0 rc2024-03-27T07:25:52.146514+0000 b13638 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfc0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d5b:[<0x20000001c64/picture-49.jpg v1044>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d5b:[<0x20000001c64/picture-49.jpg v1044>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.918 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.576+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000302e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-70.xml auth{0=1} v1242 ap=1 s=2261 n(v0 rc2024-03-27T07:26:24.246881+0000 b2261 1=1+0) caps={15291=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000302e:[<0x20000001c64/comment-70.xml v1131>,<0x10000000399/blog-48 v94498>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x2000000302e:[<0x20000001c64/comment-70.xml v1242>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.918 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.576+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c87 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-76.xml auth{0=1} v974 ap=1 s=8756 n(v0 rc2024-03-27T07:25:51.121534+0000 b8756 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfc0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c87:[<0x20000001c64/article-76.xml v974>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c87:[<0x20000001c64/article-76.xml v974>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.918 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000011e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.918 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fcf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.918 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.918 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.918 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000da8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.918 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000814 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000083e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ddf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000834 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.919 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000082f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cf4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000082c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000840 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000805 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000006f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-96.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-81.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000101f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.920 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ced (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ee7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000083b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000833 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ce9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000807 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000831 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000839 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-77.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.921 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ebc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f59 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000802 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f0c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f70 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000838 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001027 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000083c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001007 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000eb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000de3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000140c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.922 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000817 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.923 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000825 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.923 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.923 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000eab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.923 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.923 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000011ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.923 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.576+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c9b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-68.xml auth{0=1} v912 ap=1 s=20109 n(v0 rc2024-03-27T07:25:51.172533+0000 b20109 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfbf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c9b:[<0x20000001c64/article-68.xml v912>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c9b:[<0x20000001c64/article-68.xml v912>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.923 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.576+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e34 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-8.jpg auth{0=1} v1038 ap=1 s=55709 n(v0 rc2024-03-27T07:25:52.856500+0000 b55709 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfc0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e34:[<0x20000001c64/picture-8.jpg v1038>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e34:[<0x20000001c64/picture-8.jpg v1038>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.923 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.576+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dc1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-26.jpg auth{0=1} v1002 ap=1 s=64281 n(v0 rc2024-03-27T07:25:52.468507+0000 b64281 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfc1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dc1:[<0x20000001c64/picture-26.jpg v1002>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dc1:[<0x20000001c64/picture-26.jpg v1002>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.924 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.577+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004674 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-32.xml auth{0=1} v1258 ap=1 s=8405 n(v0 rc2024-03-27T07:26:53.493306+0000 b8405 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d6d0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004674:[<0x20000001c64/article-32.xml v1258>,<0x10000000399/blog-48 v115395>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000004674:[<0x20000001c64/article-32.xml v1258>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.924 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.577+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000305a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-69.xml auth{0=1} v1244 ap=1 s=6707 n(v0 rc2024-03-27T07:26:27.797811+0000 b6707 1=1+0) caps={15291=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d6d0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000305a:[<0x20000001c64/comment-69.xml v1143>,<0x10000000399/blog-48 v112246>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x2000000305a:[<0x20000001c64/comment-69.xml v1244>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.924 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.577+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d10 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-21.xml auth{0=1} v928 ap=1 s=13909 n(v0 rc2024-03-27T07:25:51.659523+0000 b13909 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d6d0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d10:[<0x20000001c64/article-21.xml v928>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d10:[<0x20000001c64/article-21.xml v928>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.924 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.577+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cf9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-30.xml auth{0=1} v1032 ap=1 s=18993 n(v0 rc2024-03-27T07:25:51.479527+0000 b18993 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d6d1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cf9:[<0x20000001c64/article-30.xml v1032>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cf9:[<0x20000001c64/article-30.xml v1032>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.924 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.577+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000c55 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-74.xml auth{0=1} v1240 ap=1 s=8200 n(v0 rc2024-03-27T07:26:21.907927+0000 b8200 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d6d1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000c55:[<0x20000001c64/comment-74.xml v1119>,<0x10000000399/blog-48 v94498>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000c55:[<0x20000001c64/comment-74.xml v1240>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.924 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.578+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000049d3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-36.xml auth{0=1} v1266 ap=1 s=6497 n(v0 rc2024-03-27T07:26:59.850181+0000 b6497 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d6d1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000049d3:[<0x20000001c64/comment-36.xml v1266>,<0x10000000399/blog-48 v115395>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x200000049d3:[<0x20000001c64/comment-36.xml v1266>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.924 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.924 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000da5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000080f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-84.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000083a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028c1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000284d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001996 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000196b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.925 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000289f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000198e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000197d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001961 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ca9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cfa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.926 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001985 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.927 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000285f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.927 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.927 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.928 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.578+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d26 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-13.xml auth{0=1} v1028 ap=1 s=32093 n(v0 rc2024-03-27T07:25:51.897519+0000 b32093 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d6d2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d26:[<0x20000001c64/article-13.xml v1028>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d26:[<0x20000001c64/article-13.xml v1028>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.928 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.578+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000382e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-64.xml auth{0=1} v1248 ap=1 s=4805 n(v0 rc2024-03-27T07:26:32.930710+0000 b4805 1=1+0) caps={15291=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d6d2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000382e:[<0x20000001c64/comment-64.xml v1154>,<0x10000000399/blog-48 v112246>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x2000000382e:[<0x20000001c64/comment-64.xml v1248>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.928 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.578+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000002e4f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-72.xml auth{0=1} v1238 ap=1 s=8639 n(v0 rc2024-03-27T07:26:22.899908+0000 b8639 1=1+0) caps={15291=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d6d2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000002e4f:[<0x20000001c64/comment-72.xml v1129>,<0x10000000399/blog-48 v94498>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x20000002e4f:[<0x20000001c64/comment-72.xml v1238>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.928 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.578+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cc8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-50.xml auth{0=1} v1036 ap=1 s=2294 n(v0 rc2024-03-27T07:25:51.322530+0000 b2294 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d6d3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cc8:[<0x20000001c64/article-50.xml v1036>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cc8:[<0x20000001c64/article-50.xml v1036>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.928 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.579+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d39 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-6.xml auth{0=1} v1042 ap=1 s=13742 n(v0 rc2024-03-27T07:25:52.030516+0000 b13742 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c4f0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d39:[<0x20000001c64/article-6.xml v1042>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d39:[<0x20000001c64/article-6.xml v1042>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.928 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.579+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d45 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-2.xml auth{0=1,1=1} v1048 ap=1 s=13122 n(v0 rc2024-03-27T07:25:52.090515+0000 b13122 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1} mcw={1=Fscr} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c4f0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d45:[<0x20000001c64/article-2.xml v1048>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d45:[<0x20000001c64/article-2.xml v1048>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.928 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.579+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cbd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-67.xml auth{0=1} v1250 ap=1 s=5622 n(v0 rc2024-03-27T07:26:30.651755+0000 b5622 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c4f1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cbd:[<0x20000001c64/comment-67.xml v1152>,<0x10000000399/blog-48 v112246>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000cbd:[<0x20000001c64/comment-67.xml v1250>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.928 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.579+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d4b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-54.jpg auth{0=1} v906 ap=1 s=56463 n(v0 rc2024-03-27T07:25:52.106515+0000 b56463 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c4f1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d4b:[<0x20000001c64/picture-54.jpg v906>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d4b:[<0x20000001c64/picture-54.jpg v906>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.928 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.580+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001db2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-29.jpg auth{0=1} v970 ap=1 s=37531 n(v0 rc2024-03-27T07:25:52.407509+0000 b37531 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c4f2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001db2:[<0x20000001c64/picture-29.jpg v970>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001db2:[<0x20000001c64/picture-29.jpg v970>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.580+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cb9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-56.xml auth{0=1} v1034 ap=1 s=12434 n(v0 rc2024-03-27T07:25:51.272531+0000 b12434 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c4f3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cb9:[<0x20000001c64/article-56.xml v1034>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cb9:[<0x20000001c64/article-56.xml v1034>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.594+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ca5 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-64.xml auth{0=1} v934 ap=1 s=18419 n(v0 rc2024-03-27T07:25:51.202532+0000 b18419 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ca5:[<0x20000001c64/article-64.xml v934>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ca5:[<0x20000001c64/article-64.xml v934>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.594+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c6b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-87.xml auth{0=1} v1034 ap=1 s=12862 n(v0 rc2024-03-27T07:25:51.035536+0000 b12862 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c6b:[<0x20000001c64/article-87.xml v1034>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c6b:[<0x20000001c64/article-87.xml v1034>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.594+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c89 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-75.xml auth{0=1} v956 ap=1 s=12885 n(v0 rc2024-03-27T07:25:51.127534+0000 b12885 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5b5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c89:[<0x20000001c64/article-75.xml v956>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c89:[<0x20000001c64/article-75.xml v956>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.595+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001dbc [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-27.jpg auth{0=1} v972 ap=1 s=11819 n(v0 rc2024-03-27T07:25:52.453508+0000 b11819 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5b5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001dbc:[<0x20000001c64/picture-27.jpg v972>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001dbc:[<0x20000001c64/picture-27.jpg v972>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.595+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ce8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-37.xml auth{0=1} v1032 ap=1 s=2143 n(v0 rc2024-03-27T07:25:51.424528+0000 b2143 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5b5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ce8:[<0x20000001c64/article-37.xml v1032>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ce8:[<0x20000001c64/article-37.xml v1032>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.595+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c8e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-73.xml auth{0=1} v1054 ap=1 s=24874 n(v0 rc2024-03-27T07:25:51.140534+0000 b24874 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5b6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c8e:[<0x20000001c64/article-73.xml v1054>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c8e:[<0x20000001c64/article-73.xml v1054>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.595+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d28 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-12.xml auth{0=1} v1050 ap=1 s=10752 n(v0 rc2024-03-27T07:25:51.914518+0000 b10752 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5b7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d28:[<0x20000001c64/article-12.xml v1050>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d28:[<0x20000001c64/article-12.xml v1050>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.595+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ce3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-39.xml auth{0=1} v1044 ap=1 s=17701 n(v0 rc2024-03-27T07:25:51.405528+0000 b17701 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5b6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ce3:[<0x20000001c64/article-39.xml v1044>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ce3:[<0x20000001c64/article-39.xml v1044>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.595+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001cea [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-36.xml auth{0=1} v936 ap=1 s=22657 n(v0 rc2024-03-27T07:25:51.434528+0000 b22657 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5b6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001cea:[<0x20000001c64/article-36.xml v936>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001cea:[<0x20000001c64/article-36.xml v936>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.929 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.595+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d51 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-52.jpg auth{0=1} v908 ap=1 s=22427 n(v0 rc2024-03-27T07:25:52.126514+0000 b22427 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d5b7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d51:[<0x20000001c64/picture-52.jpg v908>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d51:[<0x20000001c64/picture-52.jpg v908>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.930 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.596+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d48 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-1.xml auth{0=1,1=1} v1058 ap=1 s=15624 n(v0 rc2024-03-27T07:25:52.098515+0000 b15624 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1} mcw={1=Fscr} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d078000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d48:[<0x20000001c64/article-1.xml v1058>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d48:[<0x20000001c64/article-1.xml v1058>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.930 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.596+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d4e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-53.jpg auth{0=1} v1048 ap=1 s=32043 n(v0 rc2024-03-27T07:25:52.118514+0000 b32043 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d079600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d4e:[<0x20000001c64/picture-53.jpg v1048>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d4e:[<0x20000001c64/picture-53.jpg v1048>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.930 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.596+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d97 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-34.jpg auth{0=1} v1012 ap=1 s=32054 n(v0 rc2024-03-27T07:25:52.334510+0000 b32054 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d079080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d97:[<0x20000001c64/picture-34.jpg v1012>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d97:[<0x20000001c64/picture-34.jpg v1012>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.930 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.596+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004a50 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-30.xml auth{0=1} v1281 ap=1 s=9016 n(v0 rc2024-03-27T07:27:02.266134+0000 b9016 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d078b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004a50:[<0x20000001c64/comment-30.xml v1281>,<0x10000000399/blog-48 v115395>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000004a50:[<0x20000001c64/comment-30.xml v1281>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.930 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.596+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ca0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-66.xml auth{0=1} v1036 ap=1 s=5122 n(v0 rc2024-03-27T07:25:51.189533+0000 b5122 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d07b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ca0:[<0x20000001c64/article-66.xml v1036>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ca0:[<0x20000001c64/article-66.xml v1036>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.930 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.597+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001e05 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-16.jpg auth{0=1} v1046 ap=1 s=14374 n(v0 rc2024-03-27T07:25:52.674503+0000 b14374 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d07c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001e05:[<0x20000001c64/picture-16.jpg v1046>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001e05:[<0x20000001c64/picture-16.jpg v1046>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.930 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.597+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001c84 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-77.xml auth{0=1} v1042 ap=1 s=7022 n(v0 rc2024-03-27T07:25:51.114534+0000 b7022 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d07c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001c84:[<0x20000001c64/article-77.xml v1042>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001c84:[<0x20000001c64/article-77.xml v1042>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.930 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.597+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d10 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-49.xml auth{0=1} v1243 ap=1 s=6479 n(v0 rc2024-03-27T07:26:45.171469+0000 b6479 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d07d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d10:[<0x20000001c64/comment-49.xml v1243>,<0x10000000399/blog-48 v113443>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d10:[<0x20000001c64/comment-49.xml v1243>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.930 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.597+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004920 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-42.xml auth{0=1} v1253 ap=1 s=7262 n(v0 rc2024-03-27T07:26:59.025197+0000 b7262 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@4} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d07db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004920:[<0x20000001c64/comment-42.xml v1253>,<0x10000000399/blog-48 v115395>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x20000004920:[<0x20000001c64/comment-42.xml v1253>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000193c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001965 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001975 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001956 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000289b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000286b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002873 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.931 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002863 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.932 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002891 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.932 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002897 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.932 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001979 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.932 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001977 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.932 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.597+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x30000001414 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-98.xml auth{0=1} v1355 ap=1 s=22026 n(v0 rc2024-03-27T07:27:55.408092+0000 b22026 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=15291 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 freezing=0 frozen=0 exportingcaps=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 tempexporting=0 scrubqueue=0 0x55661d385180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000001414:[<0x20000001c64/article-98.xml v1355>,<0x10000000399/blog-48 v125139>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x30000001414:[<0x20000001c64/article-98.xml v1355>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.932 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.598+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000037d6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-65.xml auth{0=1} v1241 ap=1 s=2714 n(v0 rc2024-03-27T07:26:32.508719+0000 b2714 1=1+0) caps={15291=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d07e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000037d6:[<0x20000001c64/comment-65.xml v1165>,<0x10000000399/blog-48 v112246>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x200000037d6:[<0x20000001c64/comment-65.xml v1241>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-95.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ada (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001948 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001949 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002883 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cf6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.933 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001962 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.934 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002857 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.934 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.934 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.598+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d0b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-23.xml auth{0=1} v1028 ap=1 s=17820 n(v0 rc2024-03-27T07:25:51.589525+0000 b17820 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d07e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d0b:[<0x20000001c64/article-23.xml v1028>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d0b:[<0x20000001c64/article-23.xml v1028>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.934 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.598+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001da1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-32.jpg auth{0=1} v1040 ap=1 s=24244 n(v0 rc2024-03-27T07:25:52.361509+0000 b24244 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d07f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001da1:[<0x20000001c64/picture-32.jpg v1040>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001da1:[<0x20000001c64/picture-32.jpg v1040>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.934 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.598+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d1c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-17.xml auth{0=1} v1038 ap=1 s=22915 n(v0 rc2024-03-27T07:25:51.815520+0000 b22915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d07ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d1c:[<0x20000001c64/article-17.xml v1038>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d1c:[<0x20000001c64/article-17.xml v1038>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.934 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.598+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001d5e [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-48.jpg auth{0=1} v1056 ap=1 s=19322 n(v0 rc2024-03-27T07:25:52.152514+0000 b19322 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf56000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001d5e:[<0x20000001c64/picture-48.jpg v1056>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001d5e:[<0x20000001c64/picture-48.jpg v1056>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.934 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.599+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000001ca7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-63.xml auth{0=1} v1030 ap=1 s=26848 n(v0 rc2024-03-27T07:25:51.211532+0000 b26848 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@3} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d07f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000001ca7:[<0x20000001c64/article-63.xml v1030>,<0x10000000399/blog-48 v62609>,<0x10000000208/blogtest_in v667>,<0x10000000201/src v2005>,<0x10000000006/blogbench-1.0 v1765>,<0x10000000005/tmp v45>,<0x100000001fb/client.0 v44>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v58>,<0x10000000001/sv_1 v82>,<0x10000000000/qa v72>,<0x1/volumes v64>]//[]","memoryvalue":"(3)0x20000001ca7:[<0x20000001c64/article-63.xml v1030>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.935 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.935 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001998 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.935 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002865 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.935 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.935 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001989 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.935 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.935 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002879 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.935 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028ab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.935 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000197f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.935 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000197a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.936 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000199b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.936 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000194c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.936 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.936 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000196e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.936 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002881 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.936 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.936 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002871 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.936 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.599+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d02 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-51.xml auth{0=1} v1239 ap=1 s=3923 n(v0 rc2024-03-27T07:26:43.050511+0000 b3923 1=1+0) caps={15291=pAsLsXsFscr/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d02:[<0x20000001c64/comment-51.xml v1239>,<0x10000000399/blog-48 v113443>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d02:[<0x20000001c64/comment-51.xml v1239>,<0x10000000399/blog-48 v133547>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.937 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.761+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001869 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-37.xml auth{0=1} v1458 ap=1 s=2198 n(v0 rc2024-03-27T07:27:19.222801+0000 b2198 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8e8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001869:[<0x20000000b61/comment-37.xml v1376>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001869:[<0x20000000b61/comment-37.xml v1458>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.937 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.761+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001830 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-71.xml auth{0=1} v1466 ap=1 s=2234 n(v0 rc2024-03-27T07:27:18.531815+0000 b2234 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8e8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001830:[<0x20000000b61/comment-71.xml v1334>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001830:[<0x20000000b61/comment-71.xml v1466>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.937 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.762+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cb3 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-10.jpg auth{0=1} v1268 ap=1 s=27504 n(v0 rc2024-03-27T07:25:34.191867+0000 b27504 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8e8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cb3:[<0x20000000b61/picture-10.jpg v724>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cb3:[<0x20000000b61/picture-10.jpg v1268>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.937 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.762+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cda [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg auth{0=1} v1260 ap=1 s=16050 n(v0 rc2024-03-27T07:25:34.306865+0000 b16050 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8e9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cda:[<0x20000000b61/picture-1.jpg v725>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cda:[<0x20000000b61/picture-1.jpg v1260>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.937 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000193f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e3f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001993 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001986 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000194f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001983 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001990 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000287f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000194a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002889 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-81.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000198f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.938 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000193e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.939 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001994 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.939 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002877 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.939 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.762+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001896 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-16.xml auth{0=1} v1448 ap=1 s=8471 n(v0 rc2024-03-27T07:27:19.644793+0000 b8471 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c6ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001896:[<0x20000000b61/comment-16.xml v1433>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001896:[<0x20000000b61/comment-16.xml v1448>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.939 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.762+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fad [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml auth{0=1} v1446 ap=1 s=13068 n(v0 rc2024-03-27T07:27:02.301133+0000 b13068 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c6ceb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fad:[<0x20000000b61/article-9.xml v1306>,<0x10000000399/blog-19 v116859>,<0x10000000208/blogtest_in v1706>,<0x10000000201/src v2023>,<0x10000000006/blogbench-1.0 v1784>,<0x10000000005/tmp v63>,<0x100000001fb/client.0 v62>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v76>,<0x10000000001/sv_1 v100>,<0x10000000000/qa v90>,<0x1/volumes v82>]//[]","memoryvalue":"(3)0x10000000fad:[<0x20000000b61/article-9.xml v1446>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.939 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.762+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b6b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-44.xml auth{0=1} v1250 ap=1 s=25398 n(v0 rc2024-03-27T07:25:32.916892+0000 b25398 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c6cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b6b:[<0x20000000b61/article-44.xml v1250>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b6b:[<0x20000000b61/article-44.xml v1250>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.939 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.762+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001712 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-99.xml auth v1470 ap=1 s=25573 n(v0 rc2024-03-27T07:27:16.484855+0000 b25573 1=1+0) | replicated=0 authpin=1 scrubqueue=0 0x55661c6cfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001712:[<0x20000000b61/article-99.xml v1318>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001712:[<0x20000000b61/article-99.xml v1470>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.939 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.763+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cc6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg auth{0=1} v1266 ap=1 s=51871 n(v0 rc2024-03-27T07:25:34.251866+0000 b51871 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c6cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cc6:[<0x20000000b61/picture-6.jpg v728>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cc6:[<0x20000000b61/picture-6.jpg v1266>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002867 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001963 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000196d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002895 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000195f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001991 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.940 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-80.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.941 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.941 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002855 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.941 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000288b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.941 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cf5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.941 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.941 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.763+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001846 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-58.xml auth{0=1} v1464 ap=1 s=9735 n(v0 rc2024-03-27T07:27:18.635813+0000 b9735 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c6d0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001846:[<0x20000000b61/comment-58.xml v1349>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001846:[<0x20000000b61/comment-58.xml v1464>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.941 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.763+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000184e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-55.xml auth{0=1} v1462 ap=1 s=4089 n(v0 rc2024-03-27T07:27:18.656812+0000 b4089 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c6d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000184e:[<0x20000000b61/comment-55.xml v1355>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000184e:[<0x20000000b61/comment-55.xml v1462>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.941 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.763+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bb4 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml auth{0=1} v1244 ap=1 s=18046 n(v0 rc2024-03-27T07:25:33.163887+0000 b18046 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c6d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bb4:[<0x20000000b61/article-24.xml v1244>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bb4:[<0x20000000b61/article-24.xml v1244>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.942 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.763+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000187f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-25.xml auth{0=1} v1454 ap=1 s=5692 n(v0 rc2024-03-27T07:27:19.441797+0000 b5692 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df18580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000187f:[<0x20000000b61/comment-25.xml v1403>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000187f:[<0x20000000b61/comment-25.xml v1454>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.942 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000013be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.942 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.942 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000285b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.942 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.942 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002851 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.942 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.942 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.942 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002875 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.942 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002887 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.943 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000285d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.943 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.943 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000288d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.943 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001942 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.943 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001947 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.943 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002869 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.943 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001968 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.943 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.943 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.764+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000186f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-34.xml auth{0=1} v1456 ap=1 s=4511 n(v0 rc2024-03-27T07:27:19.324799+0000 b4511 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661c6d1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000186f:[<0x20000000b61/comment-34.xml v1385>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000186f:[<0x20000000b61/comment-34.xml v1456>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.943 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.764+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c11 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-28.jpg auth{0=1} v1262 ap=1 s=33453 n(v0 rc2024-03-27T07:25:33.540880+0000 b33453 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df18b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c11:[<0x20000000b61/picture-28.jpg v730>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c11:[<0x20000000b61/picture-28.jpg v1262>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.944 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.764+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c78 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg auth{0=1} v1258 ap=1 s=50095 n(v0 rc2024-03-27T07:25:33.959872+0000 b50095 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df1a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c78:[<0x20000000b61/picture-17.jpg v731>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c78:[<0x20000000b61/picture-17.jpg v1258>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.944 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.944 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.944 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-78.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.944 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000199d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.944 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028a9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.944 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002853 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.944 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-79.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.944 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001959 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.944 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001966 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.945 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000195b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.945 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000289d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.945 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000288f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.945 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.945 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001967 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.945 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.945 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000193d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.945 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.764+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001827 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-75.xml auth{0=1} v1468 ap=1 s=2450 n(v0 rc2024-03-27T07:27:18.497816+0000 b2450 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df19b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001827:[<0x20000000b61/comment-75.xml v1332>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001827:[<0x20000000b61/comment-75.xml v1468>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.945 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.764+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001861 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-41.xml auth{0=1} v1460 ap=1 s=9926 n(v0 rc2024-03-27T07:27:19.094804+0000 b9926 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df19600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001861:[<0x20000000b61/comment-41.xml v1369>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001861:[<0x20000000b61/comment-41.xml v1460>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.946 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.764+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c05 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml auth{0=1} v1252 ap=1 s=5412 n(v0 rc2024-03-27T07:25:33.489881+0000 b5412 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df1a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c05:[<0x20000000b61/article-3.xml v1252>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c05:[<0x20000000b61/article-3.xml v1252>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.946 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.765+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c33 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-24.jpg auth{0=1} v1248 ap=1 s=64459 n(v0 rc2024-03-27T07:25:33.696877+0000 b64459 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df1ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c33:[<0x20000000b61/picture-24.jpg v1248>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c33:[<0x20000000b61/picture-24.jpg v1248>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.946 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.765+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bf6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml auth{0=1} v1246 ap=1 s=8539 n(v0 rc2024-03-27T07:25:33.428882+0000 b8539 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661df1b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bf6:[<0x20000000b61/article-7.xml v1246>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bf6:[<0x20000000b61/article-7.xml v1246>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.946 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002899 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.946 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000198b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.946 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000197c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.946 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001973 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.946 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.946 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002859 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000287d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000286f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000196a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000287b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ad8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-90.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000199a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001981 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000198d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.947 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001945 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.948 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.765+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001886 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-23.xml auth{0=1} v1450 ap=1 s=5522 n(v0 rc2024-03-27T07:27:19.523795+0000 b5522 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf74000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001886:[<0x20000000b61/comment-23.xml v1410>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001886:[<0x20000000b61/comment-23.xml v1450>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.948 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.765+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001882 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-24.xml auth{0=1} v1452 ap=1 s=7444 n(v0 rc2024-03-27T07:27:19.469797+0000 b7444 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf74b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001882:[<0x20000000b61/comment-24.xml v1407>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001882:[<0x20000000b61/comment-24.xml v1452>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.948 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001952 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.948 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000e42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.948 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000284f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.948 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000028a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.948 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002885 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.948 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.948 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.949 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-79.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.949 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001208 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.949 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.949 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.949 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.949 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.949 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.949 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ede (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.949 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.949 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.765+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ca0 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg auth{0=1} v1254 ap=1 s=34148 n(v0 rc2024-03-27T07:25:34.124869+0000 b34148 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc40580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ca0:[<0x20000000b61/picture-13.jpg v1254>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ca0:[<0x20000000b61/picture-13.jpg v1254>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.950 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.765+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c6d [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-18.jpg auth{0=1} v1258 ap=1 s=61328 n(v0 rc2024-03-27T07:25:33.919873+0000 b61328 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc41080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c6d:[<0x20000000b61/picture-18.jpg v1258>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c6d:[<0x20000000b61/picture-18.jpg v1258>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.950 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.766+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000184c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-56.xml auth{0=1} v1458 ap=1 s=3712 n(v0 rc2024-03-27T07:27:18.650813+0000 b3712 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc40b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000184c:[<0x20000000b61/comment-56.xml v1352>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000184c:[<0x20000000b61/comment-56.xml v1458>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.950 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.766+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bca [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml auth{0=1} v1252 ap=1 s=14733 n(v0 rc2024-03-27T07:25:33.250886+0000 b14733 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc41600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bca:[<0x20000000b61/article-18.xml v1252>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bca:[<0x20000000b61/article-18.xml v1252>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.950 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.766+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-5.xml auth{0=1} v1450 ap=1 s=7057 n(v0 rc2024-03-27T07:27:19.971787+0000 b7057 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc42100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b4:[<0x20000000b61/comment-5.xml v1450>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018b4:[<0x20000000b61/comment-5.xml v1450>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.950 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.766+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c64 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-19.jpg auth{0=1} v1246 ap=1 s=9525 n(v0 rc2024-03-27T07:25:33.869874+0000 b9525 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cc42680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c64:[<0x20000000b61/picture-19.jpg v1246>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c64:[<0x20000000b61/picture-19.jpg v1246>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.950 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.766+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002450 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-51.xml auth v1483 ap=1 s=28242 n(v0 rc2024-03-27T07:27:53.687126+0000 b28242 1=1+0) | replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661cc43180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002450:[<0x20000000b61/article-51.xml v1474>,<0x10000000399/blog-19 v129118>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002450:[<0x20000000b61/article-51.xml v1483>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fe2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-97.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000db8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ffa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000726 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.951 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.952 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.952 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.952 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001003 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.952 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.952 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.953 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.767+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001878 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-29.xml auth{0=1} v1456 ap=1 s=2918 n(v0 rc2024-03-27T07:27:19.396798+0000 b2918 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdfa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001878:[<0x20000000b61/comment-29.xml v1402>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001878:[<0x20000000b61/comment-29.xml v1456>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.953 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.767+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bab [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml auth{0=1} v1260 ap=1 s=15249 n(v0 rc2024-03-27T07:25:33.130888+0000 b15249 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdfa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bab:[<0x20000000b61/article-27.xml v1260>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bab:[<0x20000000b61/article-27.xml v1260>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.953 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.767+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cd6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg auth{0=1} v1264 ap=1 s=12644 n(v0 rc2024-03-27T07:25:34.294865+0000 b12644 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdfb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cd6:[<0x20000000b61/picture-2.jpg v1264>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cd6:[<0x20000000b61/picture-2.jpg v1264>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.953 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.767+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cce [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg auth{0=1} v1256 ap=1 s=37934 n(v0 rc2024-03-27T07:25:34.272866+0000 b37934 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdfab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cce:[<0x20000000b61/picture-4.jpg v1256>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cce:[<0x20000000b61/picture-4.jpg v1256>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.953 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.767+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c95 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg auth{0=1} v1262 ap=1 s=21262 n(v0 rc2024-03-27T07:25:34.087869+0000 b21262 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdfc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c95:[<0x20000000b61/picture-14.jpg v1262>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c95:[<0x20000000b61/picture-14.jpg v1262>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.953 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000de6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000820 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001309 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fe7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.954 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.955 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.955 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-78.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.955 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.768+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002387 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml auth{0=1} v1478 ap=1 s=17633 n(v0 rc2024-03-27T07:27:52.621147+0000 b17633 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@5} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdfbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002387:[<0x20000000b61/article-20.xml v1478>,<0x10000000399/blog-19 v129118>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002387:[<0x20000000b61/article-20.xml v1478>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.955 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.768+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b77 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-41.xml auth{0=1} v1250 ap=1 s=17702 n(v0 rc2024-03-27T07:25:32.955892+0000 b17702 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdfc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b77:[<0x20000000b61/article-41.xml v1250>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b77:[<0x20000000b61/article-41.xml v1250>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.956 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000841 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.956 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.956 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fbc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.956 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.956 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000080b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.956 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000081c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.956 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000080d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.956 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.956 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.956 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.957 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000feb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.957 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-89.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.957 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000081e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.957 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.957 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.957 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.957 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.958 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.768+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b67 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-45.xml auth{0=1} v1248 ap=1 s=7545 n(v0 rc2024-03-27T07:25:32.905893+0000 b7545 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdfcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b67:[<0x20000000b61/article-45.xml v1248>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b67:[<0x20000000b61/article-45.xml v1248>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.958 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.768+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cc2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg auth{0=1} v1268 ap=1 s=41542 n(v0 rc2024-03-27T07:25:34.239866+0000 b41542 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdfd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cc2:[<0x20000000b61/picture-7.jpg v721>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cc2:[<0x20000000b61/picture-7.jpg v1268>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.958 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.768+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b9f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-31.xml auth{0=1} v1272 ap=1 s=8368 n(v0 rc2024-03-27T07:25:33.085889+0000 b8368 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cdfd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b9f:[<0x20000000b61/article-31.xml v722>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b9f:[<0x20000000b61/article-31.xml v1272>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.958 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.768+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000cb8 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg auth{0=1} v1244 ap=1 s=31021 n(v0 rc2024-03-27T07:25:34.207867+0000 b31021 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1e4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000cb8:[<0x20000000b61/picture-9.jpg v1244>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000cb8:[<0x20000000b61/picture-9.jpg v1244>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.958 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.769+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-11.xml auth{0=1} v1452 ap=1 s=2312 n(v0 rc2024-03-27T07:27:19.760791+0000 b2312 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1e4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a2:[<0x20000000b61/comment-11.xml v1452>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018a2:[<0x20000000b61/comment-11.xml v1452>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.959 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.959 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000082d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.959 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000828 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.959 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000a1b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.959 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.959 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fcb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000d65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000df1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000821 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fa9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ed2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000083f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000830 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ff7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000836 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.960 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000808 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000db3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000e67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000fb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000007f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002589 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000257a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.961 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002577 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000177f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000025a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002544 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000025a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002586 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001406 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002500 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000259b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002595 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.962 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000175d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002592 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000025a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017ac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000259d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001768 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000178f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001401 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001745 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000253e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.963 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000257d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002508 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002566 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000254a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000252f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002538 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001795 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001792 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002563 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001723 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001728 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002550 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.964 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000251a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.965 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002598 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.965 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002560 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.965 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.965 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001761 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.965 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.769+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000188f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-20.xml auth{0=1} v1454 ap=1 s=2200 n(v0 rc2024-03-27T07:27:19.590794+0000 b2200 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1e5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000188f:[<0x20000000b61/comment-20.xml v1418>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000188f:[<0x20000000b61/comment-20.xml v1454>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.965 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.794+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c3c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-23.jpg auth{0=1} v1252 ap=1 s=14218 n(v0 rc2024-03-27T07:25:33.729876+0000 b14218 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d629700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c3c:[<0x20000000b61/picture-23.jpg v1252>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c3c:[<0x20000000b61/picture-23.jpg v1252>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.965 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.794+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bdb [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml auth{0=1} v1244 ap=1 s=19161 n(v0 rc2024-03-27T07:25:33.327884+0000 b19161 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b534000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bdb:[<0x20000000b61/article-14.xml v1244>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bdb:[<0x20000000b61/article-14.xml v1244>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.966 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.794+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000183e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-62.xml auth{0=1} v1419 ap=1 s=9543 n(v0 rc2024-03-27T07:27:18.609813+0000 b9543 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b534580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000183e:[<0x20000000b61/comment-62.xml v1334>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000183e:[<0x20000000b61/comment-62.xml v1419>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.966 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.794+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ccb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-60.jpg auth v1300 ap=1 s=64272 n(v0 rc2024-03-27T07:26:33.267704+0000 b64272 1=1+0) | authpin=1 scrubqueue=0 0x55661e23b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ccb:[<0x20000000b61/picture-60.jpg v1294>,<0x10000000399/blog-19 v112242>,<0x10000000208/blogtest_in v1229>,<0x10000000201/src v2017>,<0x10000000006/blogbench-1.0 v1778>,<0x10000000005/tmp v57>,<0x100000001fb/client.0 v56>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v70>,<0x10000000001/sv_1 v94>,<0x10000000000/qa v84>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x10000000ccb:[<0x20000000b61/picture-60.jpg v1300>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.966 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.794+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b63 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-46.xml auth{0=1} v1262 ap=1 s=23517 n(v0 rc2024-03-27T07:25:32.893893+0000 b23517 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b534b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b63:[<0x20000000b61/article-46.xml v1262>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b63:[<0x20000000b61/article-46.xml v1262>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.966 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.794+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d76 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-80.jpg auth v1304 ap=1 s=44557 n(v0 rc2024-03-27T07:26:45.806457+0000 b44557 1=1+0) | authpin=1 scrubqueue=0 0x55661e23ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d76:[<0x20000000b61/picture-80.jpg v1304>,<0x10000000399/blog-19 v114553>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d76:[<0x20000000b61/picture-80.jpg v1304>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.966 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.795+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c47 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-22.jpg auth{0=1} v1248 ap=1 s=37294 n(v0 rc2024-03-27T07:25:33.773875+0000 b37294 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b535080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c47:[<0x20000000b61/picture-22.jpg v1248>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c47:[<0x20000000b61/picture-22.jpg v1248>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.966 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.795+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000be6 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml auth{0=1} v1256 ap=1 s=5119 n(v0 rc2024-03-27T07:25:33.374883+0000 b5119 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b535600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000be6:[<0x20000000b61/article-11.xml v1256>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000be6:[<0x20000000b61/article-11.xml v1256>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.966 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.795+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001844 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-59.xml auth{0=1} v1417 ap=1 s=9913 n(v0 rc2024-03-27T07:27:18.628813+0000 b9913 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b535b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001844:[<0x20000000b61/comment-59.xml v1336>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001844:[<0x20000000b61/comment-59.xml v1417>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.967 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.967 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.967 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.967 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.967 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.967 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000250e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.967 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002557 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.967 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000179b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.967 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001796 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.967 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001732 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000259f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001787 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002517 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002506 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000170a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001736 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ed7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.968 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002514 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002272 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000205e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000215c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000172d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000173d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002131 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002523 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.969 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002072 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000025a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002152 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000229c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001704 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020f9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000250c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000258f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002078 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.970 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.971 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.971 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002120 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.971 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001765 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.971 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.971 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001783 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.971 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.971 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.971 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.971 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.971 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.972 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.972 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000218a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.972 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001938 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.972 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.795+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001821 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-77.xml auth{0=1} v1421 ap=1 s=2566 n(v0 rc2024-03-27T07:27:18.418817+0000 b2566 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b536680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001821:[<0x20000000b61/comment-77.xml v1328>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001821:[<0x20000000b61/comment-77.xml v1421>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.972 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.795+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bd2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml auth{0=1} v1242 ap=1 s=18561 n(v0 rc2024-03-27T07:25:33.284885+0000 b18561 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b536100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bd2:[<0x20000000b61/article-16.xml v1242>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bd2:[<0x20000000b61/article-16.xml v1242>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.972 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.795+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000baf [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml auth{0=1} v1254 ap=1 s=18333 n(v0 rc2024-03-27T07:25:33.139888+0000 b18333 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b536c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000baf:[<0x20000000b61/article-26.xml v1254>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000baf:[<0x20000000b61/article-26.xml v1254>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.972 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.796+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c8c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg auth{0=1} v1264 ap=1 s=25335 n(v0 rc2024-03-27T07:25:34.046870+0000 b25335 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b537180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c8c:[<0x20000000b61/picture-15.jpg v1264>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c8c:[<0x20000000b61/picture-15.jpg v1264>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.972 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.796+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002392 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-93.xml auth v1480 ap=1 s=3473 n(v0 rc2024-03-27T07:27:52.689146+0000 b3473 1=1+0) | replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55661b537700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002392:[<0x20000000b61/article-93.xml v1474>,<0x10000000399/blog-19 v129118>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002392:[<0x20000000b61/article-93.xml v1480>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.973 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.796+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000b8c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-56.jpg auth v1290 ap=1 s=59286 n(v0 rc2024-03-27T07:26:14.788068+0000 b59286 1=1+0) | authpin=1 scrubqueue=0 0x55661e23b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000b8c:[<0x20000000b61/picture-56.jpg v1290>,<0x10000000399/blog-19 v94522>,<0x10000000208/blogtest_in v1075>,<0x10000000201/src v2013>,<0x10000000006/blogbench-1.0 v1773>,<0x10000000005/tmp v51>,<0x100000001fb/client.0 v50>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v64>,<0x10000000001/sv_1 v88>,<0x10000000000/qa v78>,<0x1/volumes v70>]//[]","memoryvalue":"(3)0x10000000b8c:[<0x20000000b61/picture-56.jpg v1290>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.973 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.796+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bea [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml auth{0=1} v1250 ap=1 s=29568 n(v0 rc2024-03-27T07:25:33.388883+0000 b29568 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e08e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bea:[<0x20000000b61/article-10.xml v1250>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bea:[<0x20000000b61/article-10.xml v1250>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.973 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.796+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000ca9 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg auth{0=1} v1260 ap=1 s=44487 n(v0 rc2024-03-27T07:25:34.154868+0000 b44487 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e08e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000ca9:[<0x20000000b61/picture-12.jpg v1260>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000ca9:[<0x20000000b61/picture-12.jpg v1260>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.973 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.796+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001857 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-50.xml auth{0=1} v1415 ap=1 s=3946 n(v0 rc2024-03-27T07:27:18.826809+0000 b3946 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e08f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001857:[<0x20000000b61/comment-50.xml v1353>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001857:[<0x20000000b61/comment-50.xml v1415>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.973 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.797+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000185a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-48.xml auth{0=1} v1413 ap=1 s=8202 n(v0 rc2024-03-27T07:27:18.856809+0000 b8202 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e08fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000185a:[<0x20000000b61/comment-48.xml v1356>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000185a:[<0x20000000b61/comment-48.xml v1413>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002535 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000208c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001742 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000213f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001757 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002208 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.974 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.975 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002082 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.975 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.975 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.975 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002569 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.976 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.798+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c02 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml auth{0=1} v1246 ap=1 s=9404 n(v0 rc2024-03-27T07:25:33.473881+0000 b9404 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e090100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c02:[<0x20000000b61/article-4.xml v1246>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c02:[<0x20000000b61/article-4.xml v1246>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.976 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.798+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bb1 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml auth{0=1} v1268 ap=1 s=21961 n(v0 rc2024-03-27T07:25:33.151888+0000 b21961 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e090680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bb1:[<0x20000000b61/article-25.xml v766>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bb1:[<0x20000000b61/article-25.xml v1268>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.976 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.798+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b83 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-38.xml auth{0=1} v1258 ap=1 s=1520 n(v0 rc2024-03-27T07:25:33.001891+0000 b1520 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e090c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b83:[<0x20000000b61/article-38.xml v1258>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b83:[<0x20000000b61/article-38.xml v1258>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.976 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.798+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001875 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-31.xml auth{0=1} v1411 ap=1 s=7492 n(v0 rc2024-03-27T07:27:19.372798+0000 b7492 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661e091700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001875:[<0x20000000b61/comment-31.xml v1394>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001875:[<0x20000000b61/comment-31.xml v1411>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.976 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.812+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000189f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-13.xml auth{0=1} v1459 ap=1 s=6728 n(v0 rc2024-03-27T07:27:19.743791+0000 b6728 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d158c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000189f:[<0x20000000b61/comment-13.xml v1438>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000189f:[<0x20000000b61/comment-13.xml v1459>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.976 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.813+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000188d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-21.xml auth{0=1} v1463 ap=1 s=2277 n(v0 rc2024-03-27T07:27:19.569795+0000 b2277 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d159700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000188d:[<0x20000000b61/comment-21.xml v1414>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000188d:[<0x20000000b61/comment-21.xml v1463>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.976 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.813+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b87 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-37.xml auth{0=1} v1242 ap=1 s=26646 n(v0 rc2024-03-27T07:25:33.015890+0000 b26646 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a420c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b87:[<0x20000000b61/article-37.xml v1242>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b87:[<0x20000000b61/article-37.xml v1242>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.813+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000187e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-26.xml auth{0=1} v1465 ap=1 s=3757 n(v0 rc2024-03-27T07:27:19.425797+0000 b3757 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556618f3a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000187e:[<0x20000000b61/comment-26.xml v1405>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x1000000187e:[<0x20000000b61/comment-26.xml v1465>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.813+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b7f [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-39.xml auth{0=1} v1246 ap=1 s=3531 n(v0 rc2024-03-27T07:25:32.990891+0000 b3531 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619bd1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b7f:[<0x20000000b61/article-39.xml v1246>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b7f:[<0x20000000b61/article-39.xml v1246>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.813+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c18 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-27.jpg auth{0=1} v1258 ap=1 s=53453 n(v0 rc2024-03-27T07:25:33.567879+0000 b53453 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfcc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c18:[<0x20000000b61/picture-27.jpg v1258>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c18:[<0x20000000b61/picture-27.jpg v1258>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.813+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000b8b [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-36.xml auth{0=1} v1254 ap=1 s=25204 n(v0 rc2024-03-27T07:25:33.026890+0000 b25204 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556619bd0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000b8b:[<0x20000000b61/article-36.xml v1254>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000b8b:[<0x20000000b61/article-36.xml v1254>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.814+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000be2 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml auth{0=1} v1248 ap=1 s=5588 n(v0 rc2024-03-27T07:25:33.360884+0000 b5588 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b147080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000be2:[<0x20000000b61/article-12.xml v1248>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000be2:[<0x20000000b61/article-12.xml v1248>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.814+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c0c [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml auth{0=1} v1252 ap=1 s=17944 n(v0 rc2024-03-27T07:25:33.519880+0000 b17944 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b3ad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c0c:[<0x20000000b61/article-1.xml v1252>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c0c:[<0x20000000b61/article-1.xml v1252>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.814+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001877 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-30.xml auth{0=1} v1467 ap=1 s=8502 n(v0 rc2024-03-27T07:27:19.384798+0000 b8502 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ce30580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001877:[<0x20000000b61/comment-30.xml v1398>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001877:[<0x20000000b61/comment-30.xml v1467>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.814+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018b7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-3.xml auth{0=1} v1455 ap=1 s=4838 n(v0 rc2024-03-27T07:27:20.001786+0000 b4838 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a41fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018b7:[<0x20000000b61/comment-3.xml v1455>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018b7:[<0x20000000b61/comment-3.xml v1455>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.814+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001892 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-18.xml auth{0=1} v1461 ap=1 s=2635 n(v0 rc2024-03-27T07:27:19.612794+0000 b2635 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a41ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001892:[<0x20000000b61/comment-18.xml v1427>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001892:[<0x20000000b61/comment-18.xml v1461>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.815+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000c81 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg auth{0=1} v1256 ap=1 s=50080 n(v0 rc2024-03-27T07:25:34.008871+0000 b50080 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a419b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000c81:[<0x20000000b61/picture-16.jpg v1256>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000c81:[<0x20000000b61/picture-16.jpg v1256>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.815+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000018a1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-12.xml auth{0=1} v1457 ap=1 s=5657 n(v0 rc2024-03-27T07:27:19.752791+0000 b5657 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a413180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000018a1:[<0x20000000b61/comment-12.xml v1457>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x100000018a1:[<0x20000000b61/comment-12.xml v1457>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.977 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.815+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001859 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-49.xml auth{0=1} v1471 ap=1 s=5569 n(v0 rc2024-03-27T07:27:18.848809+0000 b5569 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cde6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001859:[<0x20000000b61/comment-49.xml v1357>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001859:[<0x20000000b61/comment-49.xml v1471>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.815+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001860 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-42.xml auth{0=1} v1469 ap=1 s=7843 n(v0 rc2024-03-27T07:27:19.065804+0000 b7843 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b278c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001860:[<0x20000000b61/comment-42.xml v1366>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001860:[<0x20000000b61/comment-42.xml v1469>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.978 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.815+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001839 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-65.xml auth{0=1} v1475 ap=1 s=9224 n(v0 rc2024-03-27T07:27:18.589814+0000 b9224 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cf5f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001839:[<0x20000000b61/comment-65.xml v1338>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001839:[<0x20000000b61/comment-65.xml v1475>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.978 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000227d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.978 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.978 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.978 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002230 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.978 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.978 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002526 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002196 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002532 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002225 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002502 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002190 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000256c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000207c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.979 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.980 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.816+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000bb7 [4,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml auth{0=1} v1244 ap=1 s=23652 n(v0 rc2024-03-27T07:25:33.173887+0000 b23652 1=1+0) (ifile excl) cr={15291=0-4194304@3} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661a483700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000000bb7:[<0x20000000b61/article-23.xml v1244>,<0x10000000399/blog-19 v50920>,<0x10000000208/blogtest_in v427>,<0x10000000201/src v2003>,<0x10000000006/blogbench-1.0 v1763>,<0x10000000005/tmp v43>,<0x100000001fb/client.0 v42>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v56>,<0x10000000001/sv_1 v80>,<0x10000000000/qa v70>,<0x1/volumes v62>]//[]","memoryvalue":"(3)0x20000000bb7:[<0x20000000b61/article-23.xml v1244>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.980 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.816+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d77 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml auth{0=1} v1311 ap=1 s=4834 n(v0 rc2024-03-27T07:26:45.813457+0000 b4834 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x556618983600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d77:[<0x20000000b61/article-17.xml v1311>,<0x10000000399/blog-19 v114553>,<0x10000000208/blogtest_in v1549>,<0x10000000201/src v2019>,<0x10000000006/blogbench-1.0 v1780>,<0x10000000005/tmp v59>,<0x100000001fb/client.0 v58>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v72>,<0x10000000001/sv_1 v96>,<0x10000000000/qa v86>,<0x1/volumes v78>]//[]","memoryvalue":"(3)0x10000000d77:[<0x20000000b61/article-17.xml v1311>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002056 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000221c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000211c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019f1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000214d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.981 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002124 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.982 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.982 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002583 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.982 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.982 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000250a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.983 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.816+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001856 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-51.xml auth{0=1} v1473 ap=1 s=8111 n(v0 rc2024-03-27T07:27:18.716811+0000 b8111 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@1},l=15291 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cda8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001856:[<0x20000000b61/comment-51.xml v1352>,<0x10000000399/blog-19 v122057>,<0x10000000208/blogtest_in v1869>,<0x10000000201/src v2027>,<0x10000000006/blogbench-1.0 v1788>,<0x10000000005/tmp v67>,<0x100000001fb/client.0 v66>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v80>,<0x10000000001/sv_1 v104>,<0x10000000000/qa v94>,<0x1/volumes v86>]//[]","memoryvalue":"(3)0x10000001856:[<0x20000000b61/comment-51.xml v1473>,<0x10000000399/blog-19 v132543>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.983 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.905+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d55 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-55.jpg auth v592 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.437701+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@39},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d76eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d55:[<0x10000002cc6/picture-55.jpg v592>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d55:[<0x10000002cc6/picture-55.jpg v592>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.983 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.905+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002dc7 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-11.jpg auth v856 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.926692+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d76f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002dc7:[<0x10000002cc6/picture-11.jpg v856>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002dc7:[<0x10000002cc6/picture-11.jpg v856>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.983 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.905+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002dd7 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-3.jpg auth v904 ap=1 s=0 n(v0 rc2024-03-27T07:28:16.011690+0000 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d76e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002dd7:[<0x10000002cc6/picture-3.jpg v904>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002dd7:[<0x10000002cc6/picture-3.jpg v904>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.983 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.906+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d2b [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-5.xml auth v502 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.201706+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d76f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d2b:[<0x10000002cc6/article-5.xml v502>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d2b:[<0x10000002cc6/article-5.xml v502>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.983 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.906+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cff [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-34.xml auth v328 ap=1 s=0 n(v0 rc2024-03-27T07:28:14.967710+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d76fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cff:[<0x10000002cc6/article-34.xml v328>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002cff:[<0x10000002cc6/article-34.xml v328>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.984 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.906+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cce [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-81.xml auth v46 ap=1 s=0 n(v0 rc2024-03-27T07:28:14.709715+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d770100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cce:[<0x10000002cc6/article-81.xml v46>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002cce:[<0x10000002cc6/article-81.xml v46>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.984 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.984 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002520 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.984 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002175 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.984 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.984 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.984 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.984 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000258c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.984 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.985 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002529 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.985 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000219c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.985 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001715 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.985 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.985 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000171e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.985 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019f3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.985 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.985 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.985 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.986 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.906+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd1 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-78.xml auth v64 ap=1 s=0 n(v0 rc2024-03-27T07:28:14.716715+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d770680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cd1:[<0x10000002cc6/article-78.xml v64>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002cd1:[<0x10000002cc6/article-78.xml v64>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.986 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.906+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d04 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-29.xml auth v358 ap=1 s=0 n(v0 rc2024-03-27T07:28:14.999710+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d770c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d04:[<0x10000002cc6/article-29.xml v358>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d04:[<0x10000002cc6/article-29.xml v358>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.986 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.907+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ce3 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-60.xml auth v172 ap=1 s=0 n(v0 rc2024-03-27T07:28:14.770714+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d771180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002ce3:[<0x10000002cc6/article-60.xml v172>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002ce3:[<0x10000002cc6/article-60.xml v172>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:25.986 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002504 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001776 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002570 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020f1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002554 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000174b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.987 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.988 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:25.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001000 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ff1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000daf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000083d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.989 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-82.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001023 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fa4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000102b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-78.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000daa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ffd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f1d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001017 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000100f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.990 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000837 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000082e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ef5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000812 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000100b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000102f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000832 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000101b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.991 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000da1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000081a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000080a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ff4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000df6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-85.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000de9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ddb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.992 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ec7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000082b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000082a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cf9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000006f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000800 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000705 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.993 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000011e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fcf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000da8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000814 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000083e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ddf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.994 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000834 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000082f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cf4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000082c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000840 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000805 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000006f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-96.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-81.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000101f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.995 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ced (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ee7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000083b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000833 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ce9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000807 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000831 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.996 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000839 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-77.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ebc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f59 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000802 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f0c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f70 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000838 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001027 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000083c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001007 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.997 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000eb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000de3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000140c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000817 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000825 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000eab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000011ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000da5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000080f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.998 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-84.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000083a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028c1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000284d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001996 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000196b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000289f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:25.999 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000198e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000197d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001961 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ca9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cfa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001985 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000285f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.000 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000193c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001965 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001975 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001956 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000289b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000286b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002873 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002863 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002891 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002897 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001979 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001977 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-95.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ada (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001948 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001949 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002883 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cf6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.002 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001962 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002857 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001998 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002865 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001989 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002879 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028ab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000197f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000197a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000199b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000194c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000196e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002881 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002871 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000193f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e3f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001993 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001986 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000194f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001983 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001990 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000287f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000194a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002889 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-81.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000198f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000193e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001994 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002877 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002867 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001963 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000196d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002895 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000195f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001991 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-80.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002855 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000288b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cf5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.006 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000013be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000285b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002851 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002875 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002887 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000285d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000288d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001942 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001947 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.007 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002869 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001968 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-78.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000199d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028a9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002853 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-79.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001959 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001966 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000195b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000289d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000288f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.008 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001967 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000193d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002899 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000198b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000197c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001973 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002859 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000287d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000286f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000196a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.009 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000287b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ad8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-90.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000199a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001981 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000198d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001945 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001952 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000e42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000284f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000028a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002885 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.010 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-79.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001208 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ede (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fe2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-97.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000db8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ffa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000726 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001003 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000de6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.012 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000820 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001309 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fe7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-78.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000841 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.013 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fbc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000080b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000081c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000080d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000feb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-89.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000081e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.014 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000082d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000828 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000a1b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fcb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000d65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000df1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000821 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fa9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.015 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ed2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000083f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000830 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ff7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000836 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000808 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000db3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000e67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000fb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.016 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000007f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002589 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000257a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002577 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000177f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000025a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002544 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000025a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002586 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001406 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002500 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000259b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002595 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000175d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002592 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000025a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017ac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000259d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.018 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001768 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000178f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001401 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001745 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000253e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000257d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002508 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002566 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000254a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000252f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.019 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002538 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001795 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001792 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002563 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001723 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001728 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002550 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000251a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002598 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002560 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001761 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.020 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000250e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002557 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000179b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001796 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001732 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000259f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001787 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002517 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002506 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000170a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001736 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ed7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002514 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002272 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000205e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000215c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000172d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000173d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002131 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002523 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002072 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000025a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002152 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000229c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001704 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020f9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000250c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000258f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002078 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002120 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001765 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001783 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000218a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001938 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002535 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000208c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001742 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.025 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000213f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001757 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002208 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002082 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002569 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000227d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002230 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.026 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002526 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002196 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002532 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002225 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002502 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002190 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000256c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000207c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002056 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.027 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000221c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000211c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019f1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000214d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002124 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002583 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000250a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.028 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002520 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002175 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000258c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002529 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000219c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001715 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000171e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019f3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.029 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.030 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.030 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.030 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002504 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.031 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001776 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002570 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020f1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002554 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000174b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.032 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000176d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.033 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002541 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000252c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000212c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002574 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001771 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000016fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000253b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ed6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021a2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002114 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019fd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000204c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002128 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019f9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002148 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.035 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000223b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000206d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002246 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000217f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002165 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020c1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cd9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002293 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002184 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000022b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000213b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002105 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002068 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002251 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002110 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000014de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.037 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000216a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002157 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000225c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001a00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.038 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002090 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002059 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002109 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002213 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002063 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002100 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000210c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000217a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.039 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002085 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002288 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002051 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000019f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002143 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002161 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000021e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002095 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.040 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000178c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000255d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002512 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000177a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002547 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002510 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cfe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.041 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002580 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000017c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001719 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000173c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000024df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000254d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000251d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001710 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-92.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ef6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000afb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.043 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.043 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b71 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.043 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.043 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.043 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ac6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.043 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.043 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.043 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000af0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.043 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.043 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ba0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000aaf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b99 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000844 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ca5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ba7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000851 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000854 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000929 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c3c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000bcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-85.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ad9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.045 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.046 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.046 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.046 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.046 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:25 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.046 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.907+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d3a [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-63.jpg auth v544 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.290704+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d771700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d3a:[<0x10000002cc6/picture-63.jpg v544>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d3a:[<0x10000002cc6/picture-63.jpg v544>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.046 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.907+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d0e [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-22.xml auth v400 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.039709+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d77c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d0e:[<0x10000002cc6/article-22.xml v400>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d0e:[<0x10000002cc6/article-22.xml v400>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.046 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.907+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d8c [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-40.jpg auth v682 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.681696+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@24},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d77c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d8c:[<0x10000002cc6/picture-40.jpg v682>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d8c:[<0x10000002cc6/picture-40.jpg v682>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.046 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.907+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cee [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-49.xml auth v238 ap=1 s=0 n(v0 rc2024-03-27T07:28:14.852712+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d77cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cee:[<0x10000002cc6/article-49.xml v238>,<0x10000000399/blog-244 v142469>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002cee:[<0x10000002cc6/article-49.xml v238>,<0x10000000399/blog-244 v143952>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.047 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.916+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d58 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-13.jpg auth v208 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.453701+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661a038100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d58:[<0x10000002d19/picture-13.jpg v208>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d58:[<0x10000002d19/picture-13.jpg v208>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.047 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.916+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d4e [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-18.jpg auth v178 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.410702+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661a038680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d4e:[<0x10000002d19/picture-18.jpg v178>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d4e:[<0x10000002d19/picture-18.jpg v178>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.047 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.917+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d4d [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-19.jpg auth v172 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.405702+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661a038c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d4d:[<0x10000002d19/picture-19.jpg v172>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d4d:[<0x10000002d19/picture-19.jpg v172>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.047 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.917+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d64 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-4.jpg auth v262 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.506700+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661a039180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d64:[<0x10000002d19/picture-4.jpg v262>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d64:[<0x10000002d19/picture-4.jpg v262>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.047 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.917+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d34 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-35.jpg auth v76 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.257705+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661a039700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d34:[<0x10000002d19/picture-35.jpg v76>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d34:[<0x10000002d19/picture-35.jpg v76>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000176d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002541 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000252c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000212c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002574 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001771 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000016fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.049 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.917+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d66 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-2.jpg auth v274 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.517699+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df78000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d66:[<0x10000002d19/picture-2.jpg v274>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d66:[<0x10000002d19/picture-2.jpg v274>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.049 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.917+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d57 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-14.jpg auth v202 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.443701+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df78580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d57:[<0x10000002d19/picture-14.jpg v202>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d57:[<0x10000002d19/picture-14.jpg v202>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.049 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.917+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d5d [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-9.jpg auth v232 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.485700+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df79080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d5d:[<0x10000002d19/picture-9.jpg v232>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d5d:[<0x10000002d19/picture-9.jpg v232>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.049 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.918+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d60 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-7.jpg auth v244 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.493700+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df78b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d60:[<0x10000002d19/picture-7.jpg v244>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d60:[<0x10000002d19/picture-7.jpg v244>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.049 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.918+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d5c [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-10.jpg auth v226 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.477700+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df79600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d5c:[<0x10000002d19/picture-10.jpg v226>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d5c:[<0x10000002d19/picture-10.jpg v226>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000253b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ed6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021a2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002114 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019fd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000204c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002128 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019f9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002148 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000223b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.052 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.918+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d68 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-1.jpg auth v280 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.523699+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df79b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d68:[<0x10000002d19/picture-1.jpg v280>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d68:[<0x10000002d19/picture-1.jpg v280>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.052 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.918+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d61 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-6.jpg auth v250 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.498700+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df7a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d61:[<0x10000002d19/picture-6.jpg v250>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d61:[<0x10000002d19/picture-6.jpg v250>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.052 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.919+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d30 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-37.jpg auth v64 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.240705+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df7ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d30:[<0x10000002d19/picture-37.jpg v64>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d30:[<0x10000002d19/picture-37.jpg v64>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.052 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.919+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d40 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-28.jpg auth v118 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.319703+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df7a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d40:[<0x10000002d19/picture-28.jpg v118>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d40:[<0x10000002d19/picture-28.jpg v118>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.052 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.919+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d52 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-17.jpg auth v184 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.419701+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df7b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d52:[<0x10000002d19/picture-17.jpg v184>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d52:[<0x10000002d19/picture-17.jpg v184>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.052 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.919+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d24 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-3.xml auth v28 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.170706+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661df7b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d24:[<0x10000002d19/article-3.xml v28>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d24:[<0x10000002d19/article-3.xml v28>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.052 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.919+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d45 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-24.jpg auth v142 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.343703+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c92e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d45:[<0x10000002d19/picture-24.jpg v142>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d45:[<0x10000002d19/picture-24.jpg v142>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000206d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002246 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000217f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002165 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020c1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cd9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002293 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002184 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000022b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.055 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.919+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d37 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-33.jpg auth v88 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.272704+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c92e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d37:[<0x10000002d19/picture-33.jpg v88>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d37:[<0x10000002d19/picture-33.jpg v88>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.055 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.920+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d1b [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-7.xml auth v4 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.129707+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c92eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d1b:[<0x10000002d19/article-7.xml v4>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d1b:[<0x10000002d19/article-7.xml v4>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.055 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.920+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d2c [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-39.jpg auth v52 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.205706+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c92f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d2c:[<0x10000002d19/picture-39.jpg v52>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d2c:[<0x10000002d19/picture-39.jpg v52>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.055 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.920+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d44 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-25.jpg auth v136 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.336703+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c92f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d44:[<0x10000002d19/picture-25.jpg v136>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d44:[<0x10000002d19/picture-25.jpg v136>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000213b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002105 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002068 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002251 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002110 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000014de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000216a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002157 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.058 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.920+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d3b [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-31.jpg auth v100 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.301704+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c92fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d3b:[<0x10000002d19/picture-31.jpg v100>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d3b:[<0x10000002d19/picture-31.jpg v100>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.058 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.920+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d5f [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-8.jpg auth v238 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.489700+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c930100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d5f:[<0x10000002d19/picture-8.jpg v238>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d5f:[<0x10000002d19/picture-8.jpg v238>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.058 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.920+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d43 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-26.jpg auth v130 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.331703+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c930680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d43:[<0x10000002d19/picture-26.jpg v130>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d43:[<0x10000002d19/picture-26.jpg v130>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.058 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.921+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d1d [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-6.xml auth v10 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.143707+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c930c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d1d:[<0x10000002d19/article-6.xml v10>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d1d:[<0x10000002d19/article-6.xml v10>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.059 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.921+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d3e [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-29.jpg auth v112 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.314703+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c931700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d3e:[<0x10000002d19/picture-29.jpg v112>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d3e:[<0x10000002d19/picture-29.jpg v112>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000225c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001a00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002090 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002059 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002109 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002213 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002063 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002100 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000210c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000217a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.061 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.921+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d26 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-2.xml auth v34 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.177706+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661c931180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d26:[<0x10000002d19/article-2.xml v34>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d26:[<0x10000002d19/article-2.xml v34>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.061 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.922+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d62 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-5.jpg auth v256 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.502700+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d8a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d62:[<0x10000002d19/picture-5.jpg v256>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d62:[<0x10000002d19/picture-5.jpg v256>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.061 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.922+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d65 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-3.jpg auth v268 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.513700+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d8a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d65:[<0x10000002d19/picture-3.jpg v268>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d65:[<0x10000002d19/picture-3.jpg v268>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.061 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.922+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d20 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-5.xml auth v16 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.156707+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d8a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d20:[<0x10000002d19/article-5.xml v16>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d20:[<0x10000002d19/article-5.xml v16>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.062 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.922+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d5b [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-11.jpg auth v220 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.470700+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d8a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d5b:[<0x10000002d19/picture-11.jpg v220>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d5b:[<0x10000002d19/picture-11.jpg v220>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002085 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002288 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002051 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000019f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002143 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002161 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000021e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002095 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000178c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000255d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002512 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000177a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.064 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.922+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d2a [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-40.jpg auth v46 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.192706+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d8a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d2a:[<0x10000002d19/picture-40.jpg v46>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d2a:[<0x10000002d19/picture-40.jpg v46>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.065 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.923+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d47 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-23.jpg auth v148 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.353703+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d8a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d47:[<0x10000002d19/picture-23.jpg v148>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d47:[<0x10000002d19/picture-23.jpg v148>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.065 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.923+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d48 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-22.jpg auth v154 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.364702+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d8aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d48:[<0x10000002d19/picture-22.jpg v154>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d48:[<0x10000002d19/picture-22.jpg v154>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.065 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.923+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d56 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-15.jpg auth v196 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.436701+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d8aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d56:[<0x10000002d19/picture-15.jpg v196>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d56:[<0x10000002d19/picture-15.jpg v196>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.065 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.923+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d5a [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-12.jpg auth v214 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.463701+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d8ab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d5a:[<0x10000002d19/picture-12.jpg v214>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d5a:[<0x10000002d19/picture-12.jpg v214>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002547 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002510 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cfe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002580 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000017c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001719 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000173c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000024df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000254d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000251d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001710 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-92.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ef6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000afb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b71 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ac6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000af0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ba0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000aaf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b99 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000844 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ca5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ba7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000851 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000854 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000929 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c3c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000bcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-85.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.070 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.071 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.071 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ad9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.071 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.071 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.071 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.071 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.071 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.071 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.071 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001000 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.074 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ff1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000daf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000083d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-82.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001023 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fa4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000102b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-78.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000daa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ffd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.075 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f1d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001017 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000100f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000837 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000082e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ef5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000812 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000100b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000102f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000832 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dd5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.076 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000101b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000da1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000081a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000080a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ff4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.077 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000df6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-85.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000de9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fd8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ddb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ec7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f91 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000082b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000082a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cf9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.078 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000006f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000800 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000705 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000011e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fcf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000da8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.079 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000814 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000083e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ddf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000834 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000082f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cf4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000082c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.080 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000840 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000805 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000006f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-96.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-81.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000101f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ced (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.081 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ee7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000083b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000833 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ce9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000807 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000831 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000839 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.082 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-77.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ebc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f59 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000802 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f0c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f70 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000838 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001027 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000083c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001007 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000eb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000de3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.083 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000140c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000817 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000825 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000eab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000011ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000da5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000080f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-84.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.084 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000083a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028c1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000284d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001996 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000196b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000289f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000198e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.085 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000197d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001961 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ca9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cfa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001985 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000285f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000193c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001965 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.086 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001975 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001956 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000289b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000286b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002873 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002863 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002891 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002897 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001979 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.087 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001977 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cfb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-95.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ada (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001948 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001949 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002883 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cf6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001962 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.088 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002857 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001998 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002865 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001989 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002879 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028ab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000197f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000197a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000199b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000194c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000196e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002881 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002871 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000193f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e3f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001993 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001986 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000194f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001983 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001990 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000287f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000194a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002889 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-81.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000198f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000193e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001994 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002877 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002867 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001963 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000196d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002895 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000195f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001991 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-80.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002855 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000288b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cf5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000013be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000285b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002851 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002875 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002887 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000285d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000288d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001942 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001947 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002869 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001968 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-78.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000199d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028a9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002853 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-79.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001959 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001966 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000195b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000289d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000288f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001967 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000193d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002899 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000198b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000197c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001973 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002859 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000287d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000286f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000196a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000287b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ad8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-90.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000199a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001981 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000198d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001945 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001952 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000e42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000284f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000028a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002885 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001941 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fdd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c85 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-79.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001208 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ede (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fe2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-97.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000db8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ffa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000726 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001003 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f79 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000de6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000820 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001309 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fe7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e75 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-78.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000841 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fbc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000080b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000081c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000080d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f7e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000feb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-89.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000081e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000835 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000082d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000828 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000a1b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fcb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000d65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000df1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000821 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fa9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ed2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000083f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000830 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ff7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000836 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000808 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c86 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000db3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000e67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000fb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000007f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002589 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000257a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002577 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000177f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000025a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002544 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000025a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002586 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001406 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002500 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000259b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002595 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001798 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000175d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002592 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000025a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017ac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000259d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001768 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000178f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001401 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001745 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000253e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000257d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002508 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002566 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000254a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000252f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002538 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001795 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001792 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002563 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001723 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001728 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002550 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000251a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002598 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002560 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001761 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000250e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002557 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000179b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001796 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001732 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000259f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001787 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002517 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002506 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000170a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001736 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ed7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002514 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002272 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000205e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000215c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000172d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000173d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002131 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002523 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002072 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000025a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002152 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000229c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001704 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020f9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000250c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000258f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002078 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002120 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001765 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001783 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000218a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001938 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002535 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000208c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001742 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000213f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001757 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002208 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002082 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002569 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000227d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002230 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002526 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002196 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002532 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002225 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002502 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002190 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000256c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000207c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019f0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002056 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000221c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000211c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019f1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000214d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002124 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002583 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000250a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002520 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002175 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019f6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000258c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002529 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000219c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001715 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000171e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019f3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002504 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001776 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002570 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020f1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002554 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024e3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000174b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000176d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001751 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002541 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000252c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000212c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002574 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001771 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000016fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000253b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019db (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ed6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021a2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002114 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019fd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000204c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002128 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019f9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002148 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000223b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019f8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020e5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000206d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002246 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000217f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002165 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020c1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cd9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002293 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002184 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000022b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000213b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002105 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002068 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002251 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002110 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000014de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020fe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000216a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002157 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000225c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001a00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002090 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002059 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002109 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002213 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002063 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002100 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000210c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000217a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002085 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002288 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002051 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000019f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002143 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002161 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000021e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002095 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001797 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000178c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000255d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024e9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002512 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000177a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024fa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002547 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002510 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cfe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002580 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000017c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001719 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000173c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000024df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000254d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000251d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001710 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001edb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-92.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ef6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000afb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b71 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ac6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000af0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ba0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000aaf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b99 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000844 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ca5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ba7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000851 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000854 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000929 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c3c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000bcc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-85.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ad9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:25 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.258 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.923+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d22 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-4.xml auth v22 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.163706+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d8ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d22:[<0x10000002d19/article-4.xml v22>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d22:[<0x10000002d19/article-4.xml v22>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.258 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.923+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d4a [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-21.jpg auth v160 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.378702+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d810000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d4a:[<0x10000002d19/picture-21.jpg v160>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d4a:[<0x10000002d19/picture-21.jpg v160>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.258 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.924+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d3d [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-30.jpg auth v106 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.307704+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d810b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d3d:[<0x10000002d19/picture-30.jpg v106>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d3d:[<0x10000002d19/picture-30.jpg v106>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.258 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.924+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d32 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-36.jpg auth v70 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.249705+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d811080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d32:[<0x10000002d19/picture-36.jpg v70>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d32:[<0x10000002d19/picture-36.jpg v70>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.258 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.924+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d2e [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-38.jpg auth v58 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.227705+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d811b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d2e:[<0x10000002d19/picture-38.jpg v58>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d2e:[<0x10000002d19/picture-38.jpg v58>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.258 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.924+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d4b [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-20.jpg auth v166 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.397702+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d811600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d4b:[<0x10000002d19/picture-20.jpg v166>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d4b:[<0x10000002d19/picture-20.jpg v166>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.258 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.925+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d28 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-1.xml auth v40 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.184706+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d812680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d28:[<0x10000002d19/article-1.xml v40>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d28:[<0x10000002d19/article-1.xml v40>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.258 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.925+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d41 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-27.jpg auth v124 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.326703+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d812100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d41:[<0x10000002d19/picture-27.jpg v124>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d41:[<0x10000002d19/picture-27.jpg v124>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.925+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d35 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-34.jpg auth v82 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.263704+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d812c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d35:[<0x10000002d19/picture-34.jpg v82>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d35:[<0x10000002d19/picture-34.jpg v82>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.925+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d53 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-16.jpg auth v190 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.428701+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d813180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d53:[<0x10000002d19/picture-16.jpg v190>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d53:[<0x10000002d19/picture-16.jpg v190>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.925+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002d39 [7,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-32.jpg auth v94 ap=1 s=0 n(v0 rc2024-03-27T07:28:15.286704+0000 1=1+0)/n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={15291=0-4194304@6} caps={15291=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@1},l=15291 | importingcaps=0 caps=1 dirtyrstat=1 replicated=0 authpin=1 scrubqueue=0 0x55661d813700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002d39:[<0x10000002d19/picture-32.jpg v94>,<0x10000000399/blog-246 v142155>,<0x10000000208/blogtest_in v2243>,<0x10000000201/src v2037>,<0x10000000006/blogbench-1.0 v1798>,<0x10000000005/tmp v77>,<0x100000001fb/client.0 v76>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v90>,<0x10000000001/sv_1 v114>,<0x10000000000/qa v104>,<0x1/volumes v96>]//[]","memoryvalue":"(3)0x10000002d39:[<0x10000002d19/picture-32.jpg v94>,<0x10000000399/blog-246 v143958>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.951+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c94 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-18.jpg auth v771 ap=1 s=64948 n(v0 rc2024-03-27T07:27:37.507443+0000 b64948 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661d1c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c94:[<0x10000001b0d/picture-18.jpg v490>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c94:[<0x10000001b0d/picture-18.jpg v771>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.951+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ca8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-13.jpg auth v691 ap=1 s=62922 n(v0 rc2024-03-27T07:27:37.628441+0000 b62922 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dfcf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ca8:[<0x10000001b0d/picture-13.jpg v520>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ca8:[<0x10000001b0d/picture-13.jpg v691>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.951+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c8f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-19.jpg auth v729 ap=1 s=29407 n(v0 rc2024-03-27T07:27:37.469444+0000 b29407 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661d1c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c8f:[<0x10000001b0d/picture-19.jpg v484>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c8f:[<0x10000001b0d/picture-19.jpg v729>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.951+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b65 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-82.jpg auth v753 ap=1 s=64878 n(v0 rc2024-03-27T07:27:35.720478+0000 b64878 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661d1c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b65:[<0x10000001b0d/picture-82.jpg v106>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b65:[<0x10000001b0d/picture-82.jpg v753>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.952+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cd2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-4.jpg auth v627 ap=1 s=22543 n(v0 rc2024-03-27T07:27:37.815437+0000 b22543 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d1c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cd2:[<0x10000001b0d/picture-4.jpg v574>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001cd2:[<0x10000001b0d/picture-4.jpg v627>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.952+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c45 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-35.jpg auth v655 ap=1 s=40924 n(v0 rc2024-03-27T07:27:36.991453+0000 b40924 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d1c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c45:[<0x10000001b0d/picture-35.jpg v388>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c45:[<0x10000001b0d/picture-35.jpg v655>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.952+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cdc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-2.jpg auth v619 ap=1 s=30125 n(v0 rc2024-03-27T07:27:37.855436+0000 b30125 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d1c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cdc:[<0x10000001b0d/picture-2.jpg v586>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001cdc:[<0x10000001b0d/picture-2.jpg v619>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.952+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b74 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-78.jpg auth v657 ap=1 s=51635 n(v0 rc2024-03-27T07:27:35.857475+0000 b51635 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d1c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b74:[<0x10000001b0d/picture-78.jpg v130>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b74:[<0x10000001b0d/picture-78.jpg v657>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.259 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.952+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ca4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-14.jpg auth v663 ap=1 s=31735 n(v0 rc2024-03-27T07:27:37.592441+0000 b31735 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d1c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ca4:[<0x10000001b0d/picture-14.jpg v514>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ca4:[<0x10000001b0d/picture-14.jpg v663>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.952+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b42 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-89.jpg auth v665 ap=1 s=44434 n(v0 rc2024-03-27T07:27:35.530482+0000 b44434 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d1c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b42:[<0x10000001b0d/picture-89.jpg v64>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b42:[<0x10000001b0d/picture-89.jpg v665>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.953+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bc0 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-61.jpg auth v671 ap=1 s=54963 n(v0 rc2024-03-27T07:27:36.257468+0000 b54963 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d1c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bc0:[<0x10000001b0d/picture-61.jpg v232>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bc0:[<0x10000001b0d/picture-61.jpg v671>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.953+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cc4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-7.jpg auth v639 ap=1 s=43748 n(v0 rc2024-03-27T07:27:37.753438+0000 b43748 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661d1c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cc4:[<0x10000001b0d/picture-7.jpg v556>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001cc4:[<0x10000001b0d/picture-7.jpg v639>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.953+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cba [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-9.jpg auth v645 ap=1 s=18644 n(v0 rc2024-03-27T07:27:37.713439+0000 b18644 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dda6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cba:[<0x10000001b0d/picture-9.jpg v544>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001cba:[<0x10000001b0d/picture-9.jpg v645>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.953+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bb2 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-64.jpg auth v739 ap=1 s=52460 n(v0 rc2024-03-27T07:27:36.161469+0000 b52460 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dda6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bb2:[<0x10000001b0d/picture-64.jpg v214>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bb2:[<0x10000001b0d/picture-64.jpg v739>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.953+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cb5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-10.jpg auth v647 ap=1 s=26974 n(v0 rc2024-03-27T07:27:37.697439+0000 b26974 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dda6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cb5:[<0x10000001b0d/picture-10.jpg v538>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001cb5:[<0x10000001b0d/picture-10.jpg v647>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.954+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ce1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-1.jpg auth{0=1} v823 ap=1 s=59377 n(v0 rc2024-03-27T07:27:37.879436+0000 b59377 1=1+0) caps={15291=pAsLsXsFscr/pFscr@2} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55661dda7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ce1:[<0x10000001b0d/picture-1.jpg v592>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ce1:[<0x10000001b0d/picture-1.jpg v823>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.954+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b0e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-9.xml auth v613 ap=1 s=14281 n(v0 rc2024-03-27T07:27:35.137490+0000 b14281 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dda7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b0e:[<0x10000001b0d/article-9.xml v4>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b0e:[<0x10000001b0d/article-9.xml v613>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.954+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b62 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-83.jpg auth v693 ap=1 s=62207 n(v0 rc2024-03-27T07:27:35.697479+0000 b62207 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dda7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b62:[<0x10000001b0d/picture-83.jpg v100>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b62:[<0x10000001b0d/picture-83.jpg v693>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.954+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cc8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-6.jpg auth v635 ap=1 s=11189 n(v0 rc2024-03-27T07:27:37.785438+0000 b11189 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dda8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cc8:[<0x10000001b0d/picture-6.jpg v562>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001cc8:[<0x10000001b0d/picture-6.jpg v635>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.954+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c6a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-28.jpg auth v751 ap=1 s=16155 n(v0 rc2024-03-27T07:27:37.236448+0000 b16155 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dda8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c6a:[<0x10000001b0d/picture-28.jpg v430>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c6a:[<0x10000001b0d/picture-28.jpg v751>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.260 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.955+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c39 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-37.jpg auth v723 ap=1 s=20528 n(v0 rc2024-03-27T07:27:36.930454+0000 b20528 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dda8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c39:[<0x10000001b0d/picture-37.jpg v376>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c39:[<0x10000001b0d/picture-37.jpg v723>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.261 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.955+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c98 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-17.jpg auth v711 ap=1 s=44036 n(v0 rc2024-03-27T07:27:37.533443+0000 b44036 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dda9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c98:[<0x10000001b0d/picture-17.jpg v496>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c98:[<0x10000001b0d/picture-17.jpg v711>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.261 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.955+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b5c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-85.jpg auth v669 ap=1 s=54623 n(v0 rc2024-03-27T07:27:35.656479+0000 b54623 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dda9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b5c:[<0x10000001b0d/picture-85.jpg v88>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b5c:[<0x10000001b0d/picture-85.jpg v669>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.261 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.955+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b2c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-3.xml auth v625 ap=1 s=18253 n(v0 rc2024-03-27T07:27:35.408484+0000 b18253 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661ddac000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b2c:[<0x10000001b0d/article-3.xml v40>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b2c:[<0x10000001b0d/article-3.xml v625>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.261 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.955+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c7b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-24.jpg auth v811 ap=1 s=18108 n(v0 rc2024-03-27T07:27:37.363446+0000 b18108 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddac580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c7b:[<0x10000001b0d/picture-24.jpg v454>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c7b:[<0x10000001b0d/picture-24.jpg v811>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.261 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.955+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c51 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-33.jpg auth v717 ap=1 s=47741 n(v0 rc2024-03-27T07:27:37.060452+0000 b47741 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddacb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c51:[<0x10000001b0d/picture-33.jpg v400>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c51:[<0x10000001b0d/picture-33.jpg v717>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.261 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.955+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b16 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-7.xml auth v641 ap=1 s=28048 n(v0 rc2024-03-27T07:27:35.218488+0000 b28048 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661ddad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b16:[<0x10000001b0d/article-7.xml v16>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b16:[<0x10000001b0d/article-7.xml v641>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.261 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.956+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c1c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-42.jpg auth v697 ap=1 s=33442 n(v0 rc2024-03-27T07:27:36.762458+0000 b33442 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661ddadb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c1c:[<0x10000001b0d/picture-42.jpg v346>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c1c:[<0x10000001b0d/picture-42.jpg v697>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.261 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.956+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-57.jpg auth v819 ap=1 s=27723 n(v0 rc2024-03-27T07:27:36.350466+0000 b27723 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddad080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd3:[<0x10000001b0d/picture-57.jpg v256>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bd3:[<0x10000001b0d/picture-57.jpg v819>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.270 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.956+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ba1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-68.jpg auth v679 ap=1 s=56296 n(v0 rc2024-03-27T07:27:36.063471+0000 b56296 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661ddae100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ba1:[<0x10000001b0d/picture-68.jpg v190>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ba1:[<0x10000001b0d/picture-68.jpg v679>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.270 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.956+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c2e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-39.jpg auth v727 ap=1 s=63944 n(v0 rc2024-03-27T07:27:36.877455+0000 b63944 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddae680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c2e:[<0x10000001b0d/picture-39.jpg v364>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c2e:[<0x10000001b0d/picture-39.jpg v727>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.270 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.957+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c78 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-25.jpg auth v713 ap=1 s=26823 n(v0 rc2024-03-27T07:27:37.339446+0000 b26823 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddaec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c78:[<0x10000001b0d/picture-25.jpg v448>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c78:[<0x10000001b0d/picture-25.jpg v713>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.270 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.957+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b12 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-8.xml auth v611 ap=1 s=26715 n(v0 rc2024-03-27T07:27:35.184489+0000 b26715 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661ddaf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b12:[<0x10000001b0d/article-8.xml v10>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b12:[<0x10000001b0d/article-8.xml v611>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.271 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.957+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c5c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-31.jpg auth v731 ap=1 s=50846 n(v0 rc2024-03-27T07:27:37.131450+0000 b50846 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddaf700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c5c:[<0x10000001b0d/picture-31.jpg v412>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c5c:[<0x10000001b0d/picture-31.jpg v731>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.271 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.957+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b4d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-88.jpg auth v683 ap=1 s=63180 n(v0 rc2024-03-27T07:27:35.589481+0000 b63180 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661ddb6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b4d:[<0x10000001b0d/picture-88.jpg v70>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b4d:[<0x10000001b0d/picture-88.jpg v683>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.271 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.957+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bfc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-49.jpg auth v707 ap=1 s=48632 n(v0 rc2024-03-27T07:27:36.573461+0000 b48632 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddb6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bfc:[<0x10000001b0d/picture-49.jpg v304>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bfc:[<0x10000001b0d/picture-49.jpg v707>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.271 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.957+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cbe [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-8.jpg auth v643 ap=1 s=12823 n(v0 rc2024-03-27T07:27:37.737439+0000 b12823 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661ddb6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cbe:[<0x10000001b0d/picture-8.jpg v550>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001cbe:[<0x10000001b0d/picture-8.jpg v643>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.271 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.958+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002191 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-26.jpg auth v795 ap=1 s=50503 n(v0 rc2024-03-27T07:27:49.892200+0000 b50503 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddb7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002191:[<0x10000001b0d/picture-26.jpg v600>,<0x10000000399/blog-182 v130499>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002191:[<0x10000001b0d/picture-26.jpg v795>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.271 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.958+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b1a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-6.xml auth v637 ap=1 s=7989 n(v0 rc2024-03-27T07:27:35.238488+0000 b7989 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661ddb7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b1a:[<0x10000001b0d/article-6.xml v22>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b1a:[<0x10000001b0d/article-6.xml v637>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.271 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.958+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b32 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-2.xml auth v621 ap=1 s=20303 n(v0 rc2024-03-27T07:27:35.430484+0000 b20303 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661ddb7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b32:[<0x10000001b0d/article-2.xml v46>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b32:[<0x10000001b0d/article-2.xml v621>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.271 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.958+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001be4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-54.jpg auth v791 ap=1 s=38582 n(v0 rc2024-03-27T07:27:36.456464+0000 b38582 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddb8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001be4:[<0x10000001b0d/picture-54.jpg v274>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001be4:[<0x10000001b0d/picture-54.jpg v791>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.271 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.958+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c66 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-29.jpg auth v737 ap=1 s=40762 n(v0 rc2024-03-27T07:27:37.208449+0000 b40762 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddb8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c66:[<0x10000001b0d/picture-29.jpg v424>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c66:[<0x10000001b0d/picture-29.jpg v737>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.271 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.958+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b59 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-86.jpg auth v769 ap=1 s=43918 n(v0 rc2024-03-27T07:27:35.643480+0000 b43918 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddb8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b59:[<0x10000001b0d/picture-86.jpg v82>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b59:[<0x10000001b0d/picture-86.jpg v769>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.272 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.959+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b69 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-81.jpg auth v755 ap=1 s=23987 n(v0 rc2024-03-27T07:27:35.748478+0000 b23987 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661ddb9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b69:[<0x10000001b0d/picture-81.jpg v112>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b69:[<0x10000001b0d/picture-81.jpg v755>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.272 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.959+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ccd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-5.jpg auth v631 ap=1 s=23752 n(v0 rc2024-03-27T07:27:37.796437+0000 b23752 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661ddb9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ccd:[<0x10000001b0d/picture-5.jpg v568>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ccd:[<0x10000001b0d/picture-5.jpg v631>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.272 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.959+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bf8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-50.jpg auth v747 ap=1 s=55440 n(v0 rc2024-03-27T07:27:36.557462+0000 b55440 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd62000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bf8:[<0x10000001b0d/picture-50.jpg v298>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bf8:[<0x10000001b0d/picture-50.jpg v747>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.272 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.959+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bcd [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-58.jpg auth v689 ap=1 s=31346 n(v0 rc2024-03-27T07:27:36.317466+0000 b31346 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dd62580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bcd:[<0x10000001b0d/picture-58.jpg v250>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bcd:[<0x10000001b0d/picture-58.jpg v689>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.272 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.959+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bae [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-65.jpg auth v783 ap=1 s=9209 n(v0 rc2024-03-27T07:27:36.144470+0000 b9209 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd62b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bae:[<0x10000001b0d/picture-65.jpg v208>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bae:[<0x10000001b0d/picture-65.jpg v783>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.272 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.959+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b78 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-77.jpg auth v681 ap=1 s=48318 n(v0 rc2024-03-27T07:27:35.874475+0000 b48318 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dd63600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b78:[<0x10000001b0d/picture-77.jpg v136>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b78:[<0x10000001b0d/picture-77.jpg v681>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.272 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.960+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b9b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-69.jpg auth v701 ap=1 s=57217 n(v0 rc2024-03-27T07:27:36.036472+0000 b57217 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd63b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b9b:[<0x10000001b0d/picture-69.jpg v184>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b9b:[<0x10000001b0d/picture-69.jpg v701>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.272 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.960+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002195 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-58.xml auth v789 ap=1 s=26881 n(v0 rc2024-03-27T07:27:49.901200+0000 b26881 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd63080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002195:[<0x10000001b0d/article-58.xml v607>,<0x10000000399/blog-182 v130499>,<0x10000000208/blogtest_in v2151>,<0x10000000201/src v2033>,<0x10000000006/blogbench-1.0 v1794>,<0x10000000005/tmp v73>,<0x100000001fb/client.0 v72>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v86>,<0x10000000001/sv_1 v110>,<0x10000000000/qa v100>,<0x1/volumes v92>]//[]","memoryvalue":"(3)0x10000002195:[<0x10000001b0d/article-58.xml v789>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.272 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.960+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bf3 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-51.jpg auth v817 ap=1 s=15002 n(v0 rc2024-03-27T07:27:36.522462+0000 b15002 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd64100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bf3:[<0x10000001b0d/picture-51.jpg v292>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bf3:[<0x10000001b0d/picture-51.jpg v817>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.272 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.960+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bba [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-62.jpg auth v749 ap=1 s=53213 n(v0 rc2024-03-27T07:27:36.233468+0000 b53213 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd64680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bba:[<0x10000001b0d/picture-62.jpg v226>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bba:[<0x10000001b0d/picture-62.jpg v749>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.960+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cd6 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-3.jpg auth v623 ap=1 s=8400 n(v0 rc2024-03-27T07:27:37.834437+0000 b8400 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dd65180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cd6:[<0x10000001b0d/picture-3.jpg v580>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001cd6:[<0x10000001b0d/picture-3.jpg v623>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.960+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c0a [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-46.jpg auth v815 ap=1 s=19806 n(v0 rc2024-03-27T07:27:36.666460+0000 b19806 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd64c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c0a:[<0x10000001b0d/picture-46.jpg v322>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c0a:[<0x10000001b0d/picture-46.jpg v815>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.961+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bdc [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-55.jpg auth v767 ap=1 s=20265 n(v0 rc2024-03-27T07:27:36.421464+0000 b20265 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd65700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bdc:[<0x10000001b0d/picture-55.jpg v268>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bdc:[<0x10000001b0d/picture-55.jpg v767>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.961+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cb1 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-11.jpg auth v781 ap=1 s=18761 n(v0 rc2024-03-27T07:27:37.677440+0000 b18761 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcfe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cb1:[<0x10000001b0d/picture-11.jpg v532>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001cb1:[<0x10000001b0d/picture-11.jpg v781>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.961+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b92 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-71.jpg auth v775 ap=1 s=23171 n(v0 rc2024-03-27T07:27:36.003473+0000 b23171 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b92:[<0x10000001b0d/picture-71.jpg v172>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b92:[<0x10000001b0d/picture-71.jpg v775>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.961+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b20 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-5.xml auth v633 ap=1 s=30212 n(v0 rc2024-03-27T07:27:35.277487+0000 b30212 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dcfeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b20:[<0x10000001b0d/article-5.xml v28>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b20:[<0x10000001b0d/article-5.xml v633>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.961+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bb7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-63.jpg auth v659 ap=1 s=9407 n(v0 rc2024-03-27T07:27:36.206469+0000 b9407 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dcff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bb7:[<0x10000001b0d/picture-63.jpg v220>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bb7:[<0x10000001b0d/picture-63.jpg v659>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.961+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b97 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-70.jpg auth v649 ap=1 s=10542 n(v0 rc2024-03-27T07:27:36.017472+0000 b10542 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dcfe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b97:[<0x10000001b0d/picture-70.jpg v178>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b97:[<0x10000001b0d/picture-70.jpg v649>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.962+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c29 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-40.jpg auth v765 ap=1 s=15944 n(v0 rc2024-03-27T07:27:36.851456+0000 b15944 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c29:[<0x10000001b0d/picture-40.jpg v358>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c29:[<0x10000001b0d/picture-40.jpg v765>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.962+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b54 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-87.jpg auth v719 ap=1 s=27863 n(v0 rc2024-03-27T07:27:35.630480+0000 b27863 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd00100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b54:[<0x10000001b0d/picture-87.jpg v76>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b54:[<0x10000001b0d/picture-87.jpg v719>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.273 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.962+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b70 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-79.jpg auth v721 ap=1 s=64064 n(v0 rc2024-03-27T07:27:35.822476+0000 b64064 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd01180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b70:[<0x10000001b0d/picture-79.jpg v124>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b70:[<0x10000001b0d/picture-79.jpg v721>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.274 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.962+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b5f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-84.jpg auth v675 ap=1 s=43756 n(v0 rc2024-03-27T07:27:35.673479+0000 b43756 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dd00680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b5f:[<0x10000001b0d/picture-84.jpg v94>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b5f:[<0x10000001b0d/picture-84.jpg v675>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.274 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.962+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c80 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-23.jpg auth v785 ap=1 s=34713 n(v0 rc2024-03-27T07:27:37.384445+0000 b34713 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd00c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c80:[<0x10000001b0d/picture-23.jpg v460>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c80:[<0x10000001b0d/picture-23.jpg v785>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.274 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.962+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c0f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-45.jpg auth v687 ap=1 s=13609 n(v0 rc2024-03-27T07:27:36.685459+0000 b13609 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dd01700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c0f:[<0x10000001b0d/picture-45.jpg v328>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c0f:[<0x10000001b0d/picture-45.jpg v687>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.274 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.963+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bc5 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-60.jpg auth v695 ap=1 s=34149 n(v0 rc2024-03-27T07:27:36.276467+0000 b34149 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dd06580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bc5:[<0x10000001b0d/picture-60.jpg v238>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bc5:[<0x10000001b0d/picture-60.jpg v695>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.274 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.963+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ba9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-66.jpg auth v651 ap=1 s=61499 n(v0 rc2024-03-27T07:27:36.123470+0000 b61499 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dd06b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ba9:[<0x10000001b0d/picture-66.jpg v202>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ba9:[<0x10000001b0d/picture-66.jpg v651>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.274 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.963+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c22 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-41.jpg auth v725 ap=1 s=38399 n(v0 rc2024-03-27T07:27:36.798457+0000 b38399 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd06000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c22:[<0x10000001b0d/picture-41.jpg v352>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c22:[<0x10000001b0d/picture-41.jpg v725>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.274 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.963+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c83 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-22.jpg auth v741 ap=1 s=60825 n(v0 rc2024-03-27T07:27:37.403445+0000 b60825 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd07600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c83:[<0x10000001b0d/picture-22.jpg v466>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c83:[<0x10000001b0d/picture-22.jpg v741>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.274 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.963+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b6e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-80.jpg auth v821 ap=1 s=57251 n(v0 rc2024-03-27T07:27:35.791477+0000 b57251 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd07080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b6e:[<0x10000001b0d/picture-80.jpg v118>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b6e:[<0x10000001b0d/picture-80.jpg v821>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.274 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.963+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c07 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-47.jpg auth v677 ap=1 s=9113 n(v0 rc2024-03-27T07:27:36.626460+0000 b9113 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dd08680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c07:[<0x10000001b0d/picture-47.jpg v316>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c07:[<0x10000001b0d/picture-47.jpg v677>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.963+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c9f [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-15.jpg auth v793 ap=1 s=49523 n(v0 rc2024-03-27T07:27:37.571442+0000 b49523 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd07b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c9f:[<0x10000001b0d/picture-15.jpg v508>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c9f:[<0x10000001b0d/picture-15.jpg v793>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.963+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bd7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-56.jpg auth v787 ap=1 s=48311 n(v0 rc2024-03-27T07:27:36.376465+0000 b48311 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd08100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bd7:[<0x10000001b0d/picture-56.jpg v262>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bd7:[<0x10000001b0d/picture-56.jpg v787>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.964+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001cad [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-12.jpg auth v743 ap=1 s=12951 n(v0 rc2024-03-27T07:27:37.651440+0000 b12951 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd08c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001cad:[<0x10000001b0d/picture-12.jpg v526>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001cad:[<0x10000001b0d/picture-12.jpg v743>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.964+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b25 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-4.xml auth v629 ap=1 s=31712 n(v0 rc2024-03-27T07:27:35.303486+0000 b31712 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dd09700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b25:[<0x10000001b0d/article-4.xml v34>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b25:[<0x10000001b0d/article-4.xml v629>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.964+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c14 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-44.jpg auth v733 ap=1 s=14648 n(v0 rc2024-03-27T07:27:36.716459+0000 b14648 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dd09180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c14:[<0x10000001b0d/picture-44.jpg v334>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c14:[<0x10000001b0d/picture-44.jpg v733>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.964+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b8d [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-72.jpg auth v757 ap=1 s=42196 n(v0 rc2024-03-27T07:27:35.985473+0000 b42196 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcf4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b8d:[<0x10000001b0d/picture-72.jpg v166>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b8d:[<0x10000001b0d/picture-72.jpg v757>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.964+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bc8 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-59.jpg auth v761 ap=1 s=19930 n(v0 rc2024-03-27T07:27:36.290467+0000 b19930 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcf4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bc8:[<0x10000001b0d/picture-59.jpg v244>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bc8:[<0x10000001b0d/picture-59.jpg v761>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.965+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c88 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-21.jpg auth v797 ap=1 s=55444 n(v0 rc2024-03-27T07:27:37.420445+0000 b55444 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcf5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c88:[<0x10000001b0d/picture-21.jpg v472>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c88:[<0x10000001b0d/picture-21.jpg v797>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.965+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b89 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-73.jpg auth v685 ap=1 s=58494 n(v0 rc2024-03-27T07:27:35.968473+0000 b58494 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dcf4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b89:[<0x10000001b0d/picture-73.jpg v160>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b89:[<0x10000001b0d/picture-73.jpg v685>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.965+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b80 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-75.jpg auth v703 ap=1 s=13159 n(v0 rc2024-03-27T07:27:35.930474+0000 b13159 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcf5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b80:[<0x10000001b0d/picture-75.jpg v148>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b80:[<0x10000001b0d/picture-75.jpg v703>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.275 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.965+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c61 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-30.jpg auth v735 ap=1 s=49798 n(v0 rc2024-03-27T07:27:37.161450+0000 b49798 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcf5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c61:[<0x10000001b0d/picture-30.jpg v418>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c61:[<0x10000001b0d/picture-30.jpg v735>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.965+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c19 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-43.jpg auth v661 ap=1 s=10409 n(v0 rc2024-03-27T07:27:36.738458+0000 b10409 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dcf6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c19:[<0x10000001b0d/picture-43.jpg v340>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c19:[<0x10000001b0d/picture-43.jpg v661>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.965+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c8c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-20.jpg auth v759 ap=1 s=57595 n(v0 rc2024-03-27T07:27:37.436444+0000 b57595 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcf6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c8c:[<0x10000001b0d/picture-20.jpg v478>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c8c:[<0x10000001b0d/picture-20.jpg v759>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.965+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c34 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-38.jpg auth v773 ap=1 s=47515 n(v0 rc2024-03-27T07:27:36.902455+0000 b47515 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcf7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c34:[<0x10000001b0d/picture-38.jpg v370>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c34:[<0x10000001b0d/picture-38.jpg v773>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.966+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c40 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-36.jpg auth v715 ap=1 s=34898 n(v0 rc2024-03-27T07:27:36.960454+0000 b34898 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcf6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c40:[<0x10000001b0d/picture-36.jpg v382>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c40:[<0x10000001b0d/picture-36.jpg v715>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.966+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001bed [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-52.jpg auth v779 ap=1 s=19611 n(v0 rc2024-03-27T07:27:36.499463+0000 b19611 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dc9a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001bed:[<0x10000001b0d/picture-52.jpg v286>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001bed:[<0x10000001b0d/picture-52.jpg v779>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.966+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b36 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-1.xml auth v617 ap=1 s=31786 n(v0 rc2024-03-27T07:27:35.461483+0000 b31786 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dc9a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b36:[<0x10000001b0d/article-1.xml v52>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b36:[<0x10000001b0d/article-1.xml v617>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.966+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c6e [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-27.jpg auth v813 ap=1 s=58545 n(v0 rc2024-03-27T07:27:37.261448+0000 b58545 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dcf7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c6e:[<0x10000001b0d/picture-27.jpg v436>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c6e:[<0x10000001b0d/picture-27.jpg v813>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.966+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c4b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-34.jpg auth v667 ap=1 s=24247 n(v0 rc2024-03-27T07:27:37.028452+0000 b24247 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dc9ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c4b:[<0x10000001b0d/picture-34.jpg v394>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c4b:[<0x10000001b0d/picture-34.jpg v667>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.967+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001be9 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-53.jpg auth v705 ap=1 s=39881 n(v0 rc2024-03-27T07:27:36.478463+0000 b39881 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dc9b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001be9:[<0x10000001b0d/picture-53.jpg v280>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001be9:[<0x10000001b0d/picture-53.jpg v705>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.967+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001ba4 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-67.jpg auth v777 ap=1 s=41970 n(v0 rc2024-03-27T07:27:36.097471+0000 b41970 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dc9b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001ba4:[<0x10000001b0d/picture-67.jpg v196>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001ba4:[<0x10000001b0d/picture-67.jpg v777>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.967+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b3b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-90.jpg auth v745 ap=1 s=25826 n(v0 rc2024-03-27T07:27:35.478483+0000 b25826 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dc9bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b3b:[<0x10000001b0d/picture-90.jpg v58>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b3b:[<0x10000001b0d/picture-90.jpg v745>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.276 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.967+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c9b [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-16.jpg auth v673 ap=1 s=27474 n(v0 rc2024-03-27T07:27:37.553442+0000 b27474 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dc9c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c9b:[<0x10000001b0d/picture-16.jpg v502>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c9b:[<0x10000001b0d/picture-16.jpg v673>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.967+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b84 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-74.jpg auth v709 ap=1 s=18196 n(v0 rc2024-03-27T07:27:35.950474+0000 b18196 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dc9c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b84:[<0x10000001b0d/picture-74.jpg v154>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b84:[<0x10000001b0d/picture-74.jpg v709>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.967+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001b7c [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-76.jpg auth v699 ap=1 s=60082 n(v0 rc2024-03-27T07:27:35.902475+0000 b60082 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dc9cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001b7c:[<0x10000001b0d/picture-76.jpg v142>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001b7c:[<0x10000001b0d/picture-76.jpg v699>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.971+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c57 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-32.jpg auth v763 ap=1 s=11091 n(v0 rc2024-03-27T07:27:37.091451+0000 b11091 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x55661dc9d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c57:[<0x10000001b0d/picture-32.jpg v406>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c57:[<0x10000001b0d/picture-32.jpg v763>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:25.972+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001c01 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-48.jpg auth v653 ap=1 s=24904 n(v0 rc2024-03-27T07:27:36.592461+0000 b24904 1=1+0) caps={15291=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55661dc9d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001c01:[<0x10000001b0d/picture-48.jpg v310>,<0x10000000399/blog-182 v125732>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x10000001c01:[<0x10000001b0d/picture-48.jpg v653>,<0x10000000399/blog-182 v136327>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.064+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004373 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-39.xml auth{1=1} v474 ap=1 s=28180 n(v0 rc2024-03-27T07:26:46.671440+0000 b28180 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@6},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d631600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004373:[<0x20000004327/article-39.xml v474>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004373:[<0x20000004327/article-39.xml v474>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.064+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000437c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-36.xml auth{1=1} v428 ap=1 s=19317 n(v0 rc2024-03-27T07:26:46.688439+0000 b19317 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d631b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000437c:[<0x20000004327/article-36.xml v428>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000437c:[<0x20000004327/article-36.xml v428>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.064+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043ce [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-12.xml auth{1=1} v498 ap=1 s=31296 n(v0 rc2024-03-27T07:26:46.891435+0000 b31296 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d632100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043ce:[<0x20000004327/article-12.xml v498>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043ce:[<0x20000004327/article-12.xml v498>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.065+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043e8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-1.xml auth{1=1} v476 ap=1 s=8542 n(v0 rc2024-03-27T07:26:46.944434+0000 b8542 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d632680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043e8:[<0x20000004327/article-1.xml v476>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043e8:[<0x20000004327/article-1.xml v476>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.066+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043ae [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-23.xml auth{1=1} v544 ap=1 s=6560 n(v0 rc2024-03-27T07:26:46.802437+0000 b6560 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d61b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043ae:[<0x20000004327/article-23.xml v544>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043ae:[<0x20000004327/article-23.xml v544>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.066+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043c0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-17.xml auth{1=1} v536 ap=1 s=1336 n(v0 rc2024-03-27T07:26:46.848436+0000 b1336 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d61b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043c0:[<0x20000004327/article-17.xml v536>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043c0:[<0x20000004327/article-17.xml v536>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.067+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000437e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-35.xml auth{1=1} v438 ap=1 s=14432 n(v0 rc2024-03-27T07:26:46.692439+0000 b14432 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@6},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d71b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000437e:[<0x20000004327/article-35.xml v438>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000437e:[<0x20000004327/article-35.xml v438>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.277 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.068+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004370 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-40.xml auth{1=1} v452 ap=1 s=26081 n(v0 rc2024-03-27T07:26:46.665440+0000 b26081 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@11},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d70eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004370:[<0x20000004327/article-40.xml v452>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004370:[<0x20000004327/article-40.xml v452>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.068+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043c6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-15.xml auth{1=1} v460 ap=1 s=17610 n(v0 rc2024-03-27T07:26:46.866436+0000 b17610 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d70f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043c6:[<0x20000004327/article-15.xml v460>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043c6:[<0x20000004327/article-15.xml v460>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.069+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043ba [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-19.xml auth{1=1} v538 ap=1 s=29008 n(v0 rc2024-03-27T07:26:46.833436+0000 b29008 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d710680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043ba:[<0x20000004327/article-19.xml v538>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043ba:[<0x20000004327/article-19.xml v538>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.070+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000436a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-42.xml auth{1=1} v444 ap=1 s=21442 n(v0 rc2024-03-27T07:26:46.654440+0000 b21442 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@7},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d711700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000436a:[<0x20000004327/article-42.xml v444>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000436a:[<0x20000004327/article-42.xml v444>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.070+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043c9 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-14.xml auth{1=1} v418 ap=1 s=19572 n(v0 rc2024-03-27T07:26:46.875436+0000 b19572 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d50d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043c9:[<0x20000004327/article-14.xml v418>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043c9:[<0x20000004327/article-14.xml v418>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.071+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000435e [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-46.xml auth{1=1} v488 ap=1 s=5312 n(v0 rc2024-03-27T07:26:46.630440+0000 b5312 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d50db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000435e:[<0x20000004327/article-46.xml v488>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000435e:[<0x20000004327/article-46.xml v488>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.071+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000435b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-47.xml auth{1=1} v482 ap=1 s=22198 n(v0 rc2024-03-27T07:26:46.624441+0000 b22198 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d50e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000435b:[<0x20000004327/article-47.xml v482>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000435b:[<0x20000004327/article-47.xml v482>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.071+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043d0 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-11.xml auth{1=1} v430 ap=1 s=26876 n(v0 rc2024-03-27T07:26:46.897435+0000 b26876 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d50e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043d0:[<0x20000004327/article-11.xml v430>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043d0:[<0x20000004327/article-11.xml v430>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.071+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043c3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-16.xml auth{1=1} v462 ap=1 s=30626 n(v0 rc2024-03-27T07:26:46.858436+0000 b30626 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d50f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043c3:[<0x20000004327/article-16.xml v462>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043c3:[<0x20000004327/article-16.xml v462>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.072+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004346 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-54.xml auth{1=1} v514 ap=1 s=22968 n(v0 rc2024-03-27T07:26:46.583441+0000 b22968 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d50f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004346:[<0x20000004327/article-54.xml v514>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004346:[<0x20000004327/article-54.xml v514>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.072+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043a5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-26.xml auth{1=1} v528 ap=1 s=31719 n(v0 rc2024-03-27T07:26:46.777438+0000 b31719 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d718000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043a5:[<0x20000004327/article-26.xml v528>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043a5:[<0x20000004327/article-26.xml v528>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.072+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043d3 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-10.xml auth{1=1} v504 ap=1 s=31654 n(v0 rc2024-03-27T07:26:46.903435+0000 b31654 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d718580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043d3:[<0x20000004327/article-10.xml v504>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043d3:[<0x20000004327/article-10.xml v504>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.278 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.073+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043e1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-4.xml auth{1=1} v490 ap=1 s=3241 n(v0 rc2024-03-27T07:26:46.931435+0000 b3241 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d719b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043e1:[<0x20000004327/article-4.xml v490>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043e1:[<0x20000004327/article-4.xml v490>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.073+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000058e7 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-59.jpg auth{1=1} v584 ap=1 s=61329 n(v0 rc2024-03-27T07:27:20.620774+0000 b61329 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d71a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000058e7:[<0x20000004327/picture-59.jpg v584>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000058e7:[<0x20000004327/picture-59.jpg v584>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.073+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043a8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-25.xml auth{1=1} v480 ap=1 s=32199 n(v0 rc2024-03-27T07:26:46.786437+0000 b32199 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d71a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043a8:[<0x20000004327/article-25.xml v480>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043a8:[<0x20000004327/article-25.xml v480>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.073+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004358 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-48.xml auth{1=1} v466 ap=1 s=28534 n(v0 rc2024-03-27T07:26:46.619441+0000 b28534 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@5},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d719080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004358:[<0x20000004327/article-48.xml v466>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004358:[<0x20000004327/article-48.xml v466>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.074+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004376 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-38.xml auth{1=1} v484 ap=1 s=3448 n(v0 rc2024-03-27T07:26:46.676440+0000 b3448 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@8},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d71ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004376:[<0x20000004327/article-38.xml v484>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004376:[<0x20000004327/article-38.xml v484>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.074+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043f5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-3.jpg auth{1=1} v542 ap=1 s=61976 n(v0 rc2024-03-27T07:26:46.969434+0000 b61976 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043f5:[<0x20000004327/picture-3.jpg v542>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043f5:[<0x20000004327/picture-3.jpg v542>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.075+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043df [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-5.xml auth{1=1} v552 ap=1 s=31682 n(v0 rc2024-03-27T07:26:46.926435+0000 b31682 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8dd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043df:[<0x20000004327/article-5.xml v552>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043df:[<0x20000004327/article-5.xml v552>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.075+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004381 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-34.xml auth{1=1} v448 ap=1 s=14080 n(v0 rc2024-03-27T07:26:46.697439+0000 b14080 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8dd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004381:[<0x20000004327/article-34.xml v448>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004381:[<0x20000004327/article-34.xml v448>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.077+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004390 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-29.xml auth{1=1} v464 ap=1 s=20106 n(v0 rc2024-03-27T07:26:46.727439+0000 b20106 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8dec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004390:[<0x20000004327/article-29.xml v464>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004390:[<0x20000004327/article-29.xml v464>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.077+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004330 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-60.xml auth{1=1} v416 ap=1 s=12337 n(v0 rc2024-03-27T07:26:46.539442+0000 b12337 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@7},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004330:[<0x20000004327/article-60.xml v416>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004330:[<0x20000004327/article-60.xml v416>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.077+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000005830 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-40.jpg auth{1=1} v580 ap=1 s=36436 n(v0 rc2024-03-27T07:27:19.769791+0000 b36436 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@7},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d8df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000005830:[<0x20000004327/picture-40.jpg v580>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000005830:[<0x20000004327/picture-40.jpg v580>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.078+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043b1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-22.xml auth{1=1} v506 ap=1 s=16211 n(v0 rc2024-03-27T07:26:46.811437+0000 b16211 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@5},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d50c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043b1:[<0x20000004327/article-22.xml v506>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043b1:[<0x20000004327/article-22.xml v506>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.279 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.078+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004355 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-49.xml auth{1=1} v442 ap=1 s=9210 n(v0 rc2024-03-27T07:26:46.613441+0000 b9210 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@8},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d50cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004355:[<0x20000004327/article-49.xml v442>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004355:[<0x20000004327/article-49.xml v442>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.081+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000058ef [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-43.xml auth{1=1} v582 ap=1 s=18477 n(v0 rc2024-03-27T07:27:20.641774+0000 b18477 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@11},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000058ef:[<0x20000004327/article-43.xml v582>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000058ef:[<0x20000004327/article-43.xml v582>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.081+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004384 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-33.xml auth{1=1} v546 ap=1 s=20289 n(v0 rc2024-03-27T07:26:46.702439+0000 b20289 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004384:[<0x20000004327/article-33.xml v546>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004384:[<0x20000004327/article-33.xml v546>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.081+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043ef [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-5.jpg auth{1=1} v548 ap=1 s=64418 n(v0 rc2024-03-27T07:26:46.958434+0000 b64418 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043ef:[<0x20000004327/picture-5.jpg v548>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043ef:[<0x20000004327/picture-5.jpg v548>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.081+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000433b [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-57.xml auth{1=1} v518 ap=1 s=18578 n(v0 rc2024-03-27T07:26:46.565442+0000 b18578 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@5},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000433b:[<0x20000004327/article-57.xml v518>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000433b:[<0x20000004327/article-57.xml v518>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.082+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004338 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-58.xml auth{1=1} v534 ap=1 s=22799 n(v0 rc2024-03-27T07:26:46.555442+0000 b22799 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004338:[<0x20000004327/article-58.xml v534>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004338:[<0x20000004327/article-58.xml v534>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.083+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004349 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-53.xml auth{1=1} v434 ap=1 s=5623 n(v0 rc2024-03-27T07:26:46.589441+0000 b5623 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@7},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004349:[<0x20000004327/article-53.xml v434>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004349:[<0x20000004327/article-53.xml v434>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.084+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004393 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-28.xml auth{1=1} v508 ap=1 s=7673 n(v0 rc2024-03-27T07:26:46.732438+0000 b7673 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004393:[<0x20000004327/article-28.xml v508>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004393:[<0x20000004327/article-28.xml v508>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.084+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000434c [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-52.xml auth{1=1} v472 ap=1 s=16798 n(v0 rc2024-03-27T07:26:46.595441+0000 b16798 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@7},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000434c:[<0x20000004327/article-52.xml v472>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000434c:[<0x20000004327/article-52.xml v472>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.085+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004343 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-55.xml auth{1=1} v510 ap=1 s=26024 n(v0 rc2024-03-27T07:26:46.577442+0000 b26024 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da24100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004343:[<0x20000004327/article-55.xml v510>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004343:[<0x20000004327/article-55.xml v510>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.085+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043d8 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-8.xml auth{1=1} v522 ap=1 s=9227 n(v0 rc2024-03-27T07:26:46.913435+0000 b9227 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da24680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043d8:[<0x20000004327/article-8.xml v522>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043d8:[<0x20000004327/article-8.xml v522>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.086+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004387 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-32.xml auth{1=1} v478 ap=1 s=15104 n(v0 rc2024-03-27T07:26:46.707439+0000 b15104 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@5},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da25700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004387:[<0x20000004327/article-32.xml v478>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004387:[<0x20000004327/article-32.xml v478>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.086+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043b4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-21.xml auth{1=1} v456 ap=1 s=31841 n(v0 rc2024-03-27T07:26:46.819437+0000 b31841 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@6},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043b4:[<0x20000004327/article-21.xml v456>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043b4:[<0x20000004327/article-21.xml v456>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.280 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.086+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000438d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-30.xml auth{1=1} v424 ap=1 s=1736 n(v0 rc2024-03-27T07:26:46.720439+0000 b1736 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@6},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000438d:[<0x20000004327/article-30.xml v424>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000438d:[<0x20000004327/article-30.xml v424>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.088+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043cc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-13.xml auth{1=1} v468 ap=1 s=8501 n(v0 rc2024-03-27T07:26:46.883435+0000 b8501 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043cc:[<0x20000004327/article-13.xml v468>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043cc:[<0x20000004327/article-13.xml v468>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.088+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004352 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-50.xml auth{1=1} v486 ap=1 s=2191 n(v0 rc2024-03-27T07:26:46.607441+0000 b2191 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@5},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004352:[<0x20000004327/article-50.xml v486>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004352:[<0x20000004327/article-50.xml v486>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.088+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043dc [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-6.xml auth{1=1} v432 ap=1 s=23395 n(v0 rc2024-03-27T07:26:46.922435+0000 b23395 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043dc:[<0x20000004327/article-6.xml v432>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043dc:[<0x20000004327/article-6.xml v432>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.088+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043e6 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-2.xml auth{1=1} v422 ap=1 s=31415 n(v0 rc2024-03-27T07:26:46.939434+0000 b31415 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043e6:[<0x20000004327/article-2.xml v422>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043e6:[<0x20000004327/article-2.xml v422>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.089+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004340 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-56.xml auth{1=1} v426 ap=1 s=27602 n(v0 rc2024-03-27T07:26:46.571442+0000 b27602 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d9c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004340:[<0x20000004327/article-56.xml v426>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004340:[<0x20000004327/article-56.xml v426>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.090+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043fb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-1.jpg auth{0=1,1=1} v954 ap=1 s=9753 n(v0 rc2024-03-27T07:26:46.986433+0000 b9753 1=1+0) caps={15291=pAsLsXsFscr/pFscr@2} mcw={0=Fscr} | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55661b55a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043fb:[<0x20000004327/picture-1.jpg v502>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043fb:[<0x20000004327/picture-1.jpg v954>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.090+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043d5 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-9.xml auth{1=1} v420 ap=1 s=29576 n(v0 rc2024-03-27T07:26:46.907435+0000 b29576 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b55b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043d5:[<0x20000004327/article-9.xml v420>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043d5:[<0x20000004327/article-9.xml v420>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.090+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004364 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-44.xml auth{1=1} v436 ap=1 s=18337 n(v0 rc2024-03-27T07:26:46.641440+0000 b18337 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@3},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b55b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004364:[<0x20000004327/article-44.xml v436>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004364:[<0x20000004327/article-44.xml v436>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.090+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043ed [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-6.jpg auth{1=1} v540 ap=1 s=43417 n(v0 rc2024-03-27T07:26:46.953434+0000 b43417 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b55bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043ed:[<0x20000004327/picture-6.jpg v540>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043ed:[<0x20000004327/picture-6.jpg v540>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.091+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004329 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-62.xml auth{1=1} v500 ap=1 s=13215 n(v0 rc2024-03-27T07:26:46.523443+0000 b13215 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b55c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004329:[<0x20000004327/article-62.xml v500>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004329:[<0x20000004327/article-62.xml v500>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.091+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043ab [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-24.xml auth{1=1} v530 ap=1 s=30390 n(v0 rc2024-03-27T07:26:46.795437+0000 b30390 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@7},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661b55d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043ab:[<0x20000004327/article-24.xml v530>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043ab:[<0x20000004327/article-24.xml v530>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.092+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043e4 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-3.xml auth{1=1} v524 ap=1 s=3137 n(v0 rc2024-03-27T07:26:46.935434+0000 b3137 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da22b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043e4:[<0x20000004327/article-3.xml v524>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043e4:[<0x20000004327/article-3.xml v524>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.092+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043da [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-7.xml auth{1=1} v550 ap=1 s=26997 n(v0 rc2024-03-27T07:26:46.918435+0000 b26997 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661da23080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043da:[<0x20000004327/article-7.xml v550>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043da:[<0x20000004327/article-7.xml v550>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.281 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.093+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004334 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-59.xml auth{1=1} v440 ap=1 s=7975 n(v0 rc2024-03-27T07:26:46.546442+0000 b7975 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@5},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661dfcec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004334:[<0x20000004327/article-59.xml v440>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004334:[<0x20000004327/article-59.xml v440>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.093+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043bd [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-18.xml auth{1=1} v458 ap=1 s=22873 n(v0 rc2024-03-27T07:26:46.840436+0000 b22873 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1fe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043bd:[<0x20000004327/article-18.xml v458>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043bd:[<0x20000004327/article-18.xml v458>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.093+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000434f [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-51.xml auth{1=1} v454 ap=1 s=5214 n(v0 rc2024-03-27T07:26:46.601441+0000 b5214 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@6},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1fec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000434f:[<0x20000004327/article-51.xml v454>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000434f:[<0x20000004327/article-51.xml v454>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.093+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043a1 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-27.xml auth{1=1} v450 ap=1 s=19166 n(v0 rc2024-03-27T07:26:46.770438+0000 b19166 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661d1ff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043a1:[<0x20000004327/article-27.xml v450>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043a1:[<0x20000004327/article-27.xml v450>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.094+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043f2 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-4.jpg auth{1=1} v492 ap=1 s=45098 n(v0 rc2024-03-27T07:26:46.964434+0000 b45098 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ceda000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043f2:[<0x20000004327/picture-4.jpg v492>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043f2:[<0x20000004327/picture-4.jpg v492>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.094+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043f7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-2.jpg auth{1=1} v470 ap=1 s=14161 n(v0 rc2024-03-27T07:26:46.977434+0000 b14161 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661ceda580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043f7:[<0x20000004327/picture-2.jpg v470>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043f7:[<0x20000004327/picture-2.jpg v470>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.094+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043b7 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-20.xml auth{1=1} v520 ap=1 s=15207 n(v0 rc2024-03-27T07:26:46.828437+0000 b15207 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@5},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cedab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043b7:[<0x20000004327/article-20.xml v520>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043b7:[<0x20000004327/article-20.xml v520>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.095+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000005835 [6,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-61.xml auth{1=1} v586 ap=1 s=26602 n(v0 rc2024-03-27T07:27:19.788790+0000 b26602 1=1+0) (ifile excl) cr={15291=0-4194304@5} caps={15291=pAsLsXsFsxcrwb/pFscr@7},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cedb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000005835:[<0x20000004327/article-61.xml v586>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000005835:[<0x20000004327/article-61.xml v586>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.095+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000436d [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-41.xml auth{1=1} v494 ap=1 s=7785 n(v0 rc2024-03-27T07:26:46.660440+0000 b7785 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cedbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000436d:[<0x20000004327/article-41.xml v494>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000436d:[<0x20000004327/article-41.xml v494>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.095+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000004361 [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-45.xml auth{1=1} v446 ap=1 s=1557 n(v0 rc2024-03-27T07:26:46.636440+0000 b1557 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@4},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cedc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x20000004361:[<0x20000004327/article-45.xml v446>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x20000004361:[<0x20000004327/article-45.xml v446>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.095+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x2000000438a [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-31.xml auth{1=1} v496 ap=1 s=15650 n(v0 rc2024-03-27T07:26:46.712439+0000 b15650 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@7},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cedcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x2000000438a:[<0x20000004327/article-31.xml v496>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x2000000438a:[<0x20000004327/article-31.xml v496>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.282 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:28:26.096+0000 7fc1e9e19700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x200000043eb [5,head] /volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-7.jpg auth{1=1} v512 ap=1 s=24277 n(v0 rc2024-03-27T07:26:46.949434+0000 b24277 1=1+0) (ifile excl) cr={15291=0-4194304@4} caps={15291=pAsLsXsFsxcrwb/pFscr@2},l=15291 | request=0 lock=0 importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55661cedc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x200000043eb:[<0x20000004327/picture-7.jpg v512>,<0x10000000399/blog-128 v125203>,<0x10000000208/blogtest_in v2032>,<0x10000000201/src v2031>,<0x10000000006/blogbench-1.0 v1792>,<0x10000000005/tmp v71>,<0x100000001fb/client.0 v70>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v84>,<0x10000000001/sv_1 v108>,<0x10000000000/qa v98>,<0x1/volumes v90>]//[]","memoryvalue":"(3)0x200000043eb:[<0x20000004327/picture-7.jpg v512>,<0x10000000399/blog-128 v138988>,<0x10000000208/blogtest_in v2292>,<0x10000000201/src v2041>,<0x10000000006/blogbench-1.0 v1756>,<0x10000000005/tmp v53>,<0x100000001fb/client.0 v22>,<0x100000001fa/1c32081e-6c02-49bb-a07b-4168376546c5 v46>,<0x10000000001/sv_1 v65>,<0x10000000000/qa v68>,<0x1/volumes v55>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T07:28:26.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: pgmap v148: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 838 op/s 2024-03-27T07:28:26.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000842 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000084f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000091b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-82.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.643 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000af4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000084c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000855 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000caa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.644 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ca1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a1b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.645 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000fd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000084a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ade (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000aff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.647 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000845 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000aaa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000846 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ae9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ab4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.648 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000084b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000843 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000925 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000186c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000180d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ca9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.649 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002163 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b3c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000848 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001899 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001834 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000215f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-95.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.650 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001866 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000186e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000188e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000189e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000182b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002155 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-97.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.651 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001884 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001885 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001836 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001817 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002150 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-98.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000183a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ecf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001810 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000182d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000180f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000189a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000af2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001847 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001831 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000183f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001819 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001871 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.653 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001814 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000189b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000186b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001852 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001895 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000183c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000181f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000aeb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.654 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000184f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000afc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001863 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001828 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001f0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001881 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000187a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000dcb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000182f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001854 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.655 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001824 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000215a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-96.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001811 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001823 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001890 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001894 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001813 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001818 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018a4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000184b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001870 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000180e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.656 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000020d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000af6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001880 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001812 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000188c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001845 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002146 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-100.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001876 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.657 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001889 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000180c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000182a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001874 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001841 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000188b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.658 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000214b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-99.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.659 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001888 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001815 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-100.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000aa5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000849 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ca7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ca3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.663 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000086c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001aed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000010a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000009ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000856 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001620 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-95.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.664 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ba0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000081c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000006d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000009fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000671 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000112d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000067c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001149 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000079c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000852 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000994 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000940 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000869 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001aba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000107b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000956 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000abb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000009c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000083f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000970 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000084e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000099e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ae5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000892 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000826 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000857 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000847 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000093b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000070e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000caf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004b4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000011d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000006dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000073d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001070 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000088a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.668 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000068d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001167 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000010cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000866 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ba4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000f2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000068b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000698 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000011d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000778 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000481a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000699 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000850 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.669 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000eef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-99.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000011c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000933 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001016 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000674 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001bac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000712 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000998 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000006ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000071b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000080c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000084b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000096a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000085d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004a95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000009cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001194 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001bb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000f30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000011de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000010d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000007a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000eea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-100.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000007d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x3000000165d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.672 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000978 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000679 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001bba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000008ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x300000006ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-100.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001178 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001be0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002c80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x3000000120d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000282f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000274c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000024b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-79.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.673 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x3000000165e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001bf0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001b96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x3000000160a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000084d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-91.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.674 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000850 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000acd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000086d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000070b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ad2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000a8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.675 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002efc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-82.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000eb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ecb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-89.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002de6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-83.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ee0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ec5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-85.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.677 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dfd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ed1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ebf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ee9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ed7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000eb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-88.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ee6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002db6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ed0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002df2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002edd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001edd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-86.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ea6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002df6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ebc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-84.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-87.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eaa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-91.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ef3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dde (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.681 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f08 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ea2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002de2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002df9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e76 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ef6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ee3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.682 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ec8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002eb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ef9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ec2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ee3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000013e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ece (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-90.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002f05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002dc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002ed4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000182c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001842 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001820 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000013ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000222a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001862 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000181e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001872 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001864 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000181b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001873 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000183d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001850 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000181c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b73 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001851 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bfe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000186d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000187c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001849 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000238c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001840 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ba6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001865 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001835 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000181d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000188a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ccc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000185e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000187d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001822 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001838 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001853 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000185f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001893 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001898 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ba9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000185d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000185b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000185c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001832 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000170d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001833 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ba3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001829 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000186a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000183b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000182e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bfa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000189d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001837 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001891 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000428b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004526 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001da6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000302e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004674 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000305a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cf9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000c55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000049d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000382e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000002e4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000cbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001db2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ca5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-87.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001dbc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ce8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001cea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004a50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ca0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001e05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001c84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004920 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x30000001414 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-98.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000037d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001da1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001d5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000001ca7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] up:active 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001869 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001830 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001896 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000fad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001712 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-99.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001846 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000184e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000187f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000186f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001861 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bf6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001886 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001882 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ca0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000184c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002450 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001878 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002387 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000cb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018a2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000188f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c3c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bdb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000183e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000ccb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d76 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000be6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001844 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001821 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000baf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002392 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000b8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000ca9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001857 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000185a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.701 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001875 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000189f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000188d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x1000000187e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000b8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000be2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c0c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001877 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001892 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000c81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x100000018a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001859 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001860 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001839 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000000bb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000000d77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001856 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002dc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002dd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002cff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002cce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-81.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002cd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-78.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002cee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d1b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d1d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002d39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ca8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-82.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001cd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001cdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-78.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ca4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-89.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001cc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001cba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001cb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ce1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001cc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-85.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ba1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-88.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bfc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001cbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002191 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001be4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b59 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-86.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-81.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ccd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bcd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-77.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000002195 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bf3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001cd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.711 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001cb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-87.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b70 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-79.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-84.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ba9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001cad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001bed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001be9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001ba4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-90.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001b7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x10000001c01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004373 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000437c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000437e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004370 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000436a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000435e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000435b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.715 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004346 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000058e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004358 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004376 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004381 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004390 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.716 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004330 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000005830 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004355 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000058ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004384 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000433b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004338 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004349 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004393 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000434c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004343 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004387 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.717 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000438d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004352 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004340 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004364 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004329 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043ab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.718 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004334 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000434f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000005835 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000436d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x20000004361 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x2000000438a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:26.719 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:26 smithi082 ceph-mon[32178]: Scrub error on inode 0x200000043eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: pgmap v148: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 838 op/s 2024-03-27T07:28:27.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000842 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000084f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000091b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-82.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000af4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.007 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000084c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000855 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000caa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.008 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ca1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a1b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.009 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000fd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000084a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ade (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000aff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.010 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000845 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000aaa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000846 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ae9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.011 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ab4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000084b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000843 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000925 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000186c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.012 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000180d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ca9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002163 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b3c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000848 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001899 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.013 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001834 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000215f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-95.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001866 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000186e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000188e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000189e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.014 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000182b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002155 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-97.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001884 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001885 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001836 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001817 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002150 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-98.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000183a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.015 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ecf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001810 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000182d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000180f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000189a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000af2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001847 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001831 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000183f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.016 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001819 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001871 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001814 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000189b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000186b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001852 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001895 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.017 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000183c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000181f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000aeb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000184f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000afc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001863 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001828 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001f0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001881 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000187a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.018 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000dcb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000182f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001854 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001824 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000215a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-96.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001811 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001823 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001890 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001894 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001813 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001818 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018a4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.019 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000184b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001870 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000180e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000020d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000af6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001880 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001812 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.020 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000188c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001845 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002146 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-100.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001876 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.021 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001889 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000180c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000182a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001874 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001841 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.026 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000188b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000214b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-99.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001888 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001815 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-100.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000aa5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.027 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000849 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ca7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ca3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000086c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.028 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001aed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000010a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000009ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000856 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001620 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-95.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ba0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000081c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000006d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.029 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000009fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000671 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000112d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000067c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001149 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000079c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000852 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000994 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.030 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000940 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000869 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001aba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000107b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000956 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000abb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000009c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000083f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000970 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000084e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000099e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ae5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.031 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000892 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000826 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000857 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000847 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000093b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000070e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000caf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004b4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000011d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000006dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.032 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000073d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001070 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000088a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000068d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001167 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000010cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000866 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ba4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000f2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000068b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.033 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000698 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000011d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000778 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000481a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000699 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000850 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000eef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-99.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000011c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000933 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001016 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000674 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.034 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001bac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000712 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000998 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000006ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000071b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000080c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000084b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000096a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000085d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.035 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004a95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000009cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001194 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001bb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000f30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000011de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000010d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000007a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000eea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-100.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000007d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x3000000165d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.036 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000978 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000679 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001bba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000008ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x300000006ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-100.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001178 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001be0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002c80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x3000000120d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000282f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000274c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000024b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.037 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-79.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x3000000165e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001bf0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001b96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x3000000160a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000084d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-91.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.038 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000850 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000acd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000086d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000070b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.039 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ad2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000a8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002efc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-82.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000eb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ecb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.040 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-89.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002de6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-83.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ee0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ec5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.041 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-85.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dfd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ed1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ebf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ee9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ed7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000eb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.042 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-88.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ee6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002db6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ed0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002df2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002edd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001edd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-86.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.043 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ea6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002df6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.044 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ebc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-84.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-87.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eaa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-91.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ef3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.045 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dde (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f08 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ea2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002de2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002df9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e76 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ef6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.046 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ee3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ec8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002eb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ef9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ec2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ee3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000013e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ece (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.047 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-90.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002f05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002dc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002ed4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000182c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001842 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001820 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.048 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000013ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000222a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001862 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000181e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001872 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001864 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000181b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001873 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000183d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001850 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.049 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000181c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b73 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001851 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bfe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000186d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000187c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001849 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000238c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001840 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.050 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ba6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001865 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001835 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000181d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000188a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ccc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000185e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000187d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001822 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.051 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001838 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001853 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000185f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001893 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001898 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ba9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000185d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000185b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000185c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001832 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.052 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000170d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001833 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ba3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001829 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000186a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000183b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000182e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bfa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.053 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000189d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001837 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001891 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000428b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004526 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001da6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000302e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.054 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004674 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000305a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cf9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000c55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000049d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000382e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000002e4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.055 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000cbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001db2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ca5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-87.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001dbc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ce8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001cea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004a50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ca0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001e05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001c84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004920 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x30000001414 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-98.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000037d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001da1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001d5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000001ca7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] up:active 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001869 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001830 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001896 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000fad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001712 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-99.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001846 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.058 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000184e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000187f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000186f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001861 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bf6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.059 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001886 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001882 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ca0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000184c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002450 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001878 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.060 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002387 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000cb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018a2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000188f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c3c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bdb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000183e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000ccb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d76 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.061 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000be6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001844 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001821 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000baf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002392 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000b8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000ca9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001857 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000185a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.062 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001875 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000189f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000188d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x1000000187e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000b8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000be2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c0c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001877 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001892 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000c81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.063 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x100000018a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001859 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001860 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001839 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000000bb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000000d77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001856 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002dc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002dd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002cff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002cce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-81.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002cd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-78.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.064 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002cee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.065 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d1b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.066 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d1d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.067 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002d39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ca8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.068 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-82.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001cd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001cdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-78.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ca4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-89.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001cc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001cba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.069 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.072 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001cb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.072 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ce1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.072 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.072 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001cc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-85.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ba1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.073 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-88.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bfc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001cbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002191 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001be4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b59 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-86.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-81.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.074 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ccd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bcd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-77.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000002195 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bf3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001cd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001cb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.075 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-87.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b70 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-79.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-84.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ba9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.076 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001cad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.077 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001bed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001be9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001ba4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-90.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001b7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x10000001c01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004373 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.078 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000437c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000437e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004370 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000436a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000435e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000435b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.079 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004346 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000058e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004358 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004376 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004381 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004390 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004330 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.080 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000005830 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004355 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000058ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004384 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000433b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004338 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004349 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004393 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000434c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004343 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004387 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.081 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000438d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004352 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004340 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004364 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004329 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043ab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.082 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004334 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000434f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000005835 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000436d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x20000004361 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x2000000438a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.083 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:26 smithi149 ceph-mon[36065]: Scrub error on inode 0x200000043eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: pgmap v148: 97 pgs: 97 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 838 op/s 2024-03-27T07:28:27.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000842 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000084f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000091b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018e2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-82.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c2d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000af4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000084c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000855 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.090 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000caa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001efa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ca1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a1b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000fd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000084a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ade (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000aff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000845 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b9d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.092 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000aaa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000846 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ae9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ab4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b13 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000084b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000843 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000925 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000186c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-56.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.093 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018af (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cd0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000180d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-92.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ca9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002163 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-94.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b3c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018cb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000848 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.094 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018bf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001899 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001834 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000215f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-95.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b49 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001866 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000186e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b06 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000188e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018b9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.095 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000189e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000182b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018bc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002155 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-97.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001884 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001885 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001836 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001817 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-83.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002150 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-98.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.096 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000183a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ecf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001810 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-89.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000182d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000180f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-90.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000189a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000af2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001847 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001831 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018dd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000183f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.097 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018c2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001819 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001871 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001814 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-85.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000189b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000186b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001852 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cd4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.098 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001895 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000183c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018cf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000181f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000aeb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000184f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000afc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001863 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-59.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001828 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-77.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001f0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001881 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-48.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000187a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-50.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b1f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.099 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-31.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000dcb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000182f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001854 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001824 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018e0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000215a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-96.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001811 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001823 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001890 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001894 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001813 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001818 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.100 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018a4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000184b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001870 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000180e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-91.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018be (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018c8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000020d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000af6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018aa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001880 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.101 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001812 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000188c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001845 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002146 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-100.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001876 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001889 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000180c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b4c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018b3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000182a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001874 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.102 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001841 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018d1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000188b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018c4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000214b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-99.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001888 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001815 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-100.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.103 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000aa5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000849 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ca7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ca3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.104 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000086c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001aed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000010a0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-71.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000009ec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000856 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001620 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-95.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b90 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.105 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ba0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000081c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ed4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000006d4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000009fc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000671 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000112d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000067c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-62.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001149 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-55.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000079c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.106 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-25.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000852 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000994 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000940 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-88.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000869 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001aba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-41.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000107b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-75.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000956 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000abb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000009c5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.107 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000083f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000970 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000084e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000099e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ae5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000892 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000826 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c2f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008f4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000857 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000847 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b82 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000093b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.108 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000070e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-24.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000caf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004b4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000011d2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000006dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000073d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-93.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001070 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000088a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000068d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.109 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001167 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000010cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000866 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ba4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000f2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000068b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-58.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000698 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000011d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b9c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000778 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000481a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000699 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000850 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.110 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000eef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-99.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008bb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000011c7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000933 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001016 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-84.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000674 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001bac (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-26.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000712 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-37.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000998 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000006ff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000071b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.111 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000080c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008b5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000084b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000096a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008ad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000085d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004a95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000009cd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001194 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-49.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001bb0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000f30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-87.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000011de (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.112 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000010d7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-65.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000007a6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000eea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-100.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000007d9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x3000000165d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000978 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000679 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001bba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000008ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x300000006ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-100.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001178 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-51.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001be0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.113 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002c80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x3000000120d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000282f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000274c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000024b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-79.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x3000000165e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001bf0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001b96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x3000000160a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.114 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000084d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000fde (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-91.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000850 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000acd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000086d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.115 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000070b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ad2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000a8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002efc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.116 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e27 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-82.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000eb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ecb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-78.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-89.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-61.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f17 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002de6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e23 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-83.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.117 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ee0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ec5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-85.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dfd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eec (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ed1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e7d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-57.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eb6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-68.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ebf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ee9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.118 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ed7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e9a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-49.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000eb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f1e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-88.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ee6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002db6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ed0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002df2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e00 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002edd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-54.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001edd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.119 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-86.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-81.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e96 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-50.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e7a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-58.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-65.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e38 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-77.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-69.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-51.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-62.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ea6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-55.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.120 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-70.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002df6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-71.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ebc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-84.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e15 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-87.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e31 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-79.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eaa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-60.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-66.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-80.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.121 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-91.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ef3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dde (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f08 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-56.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ea2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002de2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002df9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-72.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e76 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-59.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e46 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-73.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.122 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-75.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ef6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ee3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ec8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002eb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ef9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ec2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ee3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000013e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-52.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.123 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ece (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-53.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-67.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ed7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-90.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002f05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-74.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002dc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-76.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002ed4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e9e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-48.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-21.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.124 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000182c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-73.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001842 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-60.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001820 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-78.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000013ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-86.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-1.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000222a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001862 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-40.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000181e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-79.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001872 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001864 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-39.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bc3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-20.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000181b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-82.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001873 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.125 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000183d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-63.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001850 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-54.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000181c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-81.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018a3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-10.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b73 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-42.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001851 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-53.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018b2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b93 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-34.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bfe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000186d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-35.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000187c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001849 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-57.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000238c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-63.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.126 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001840 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-61.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ba6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001865 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-38.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001835 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-68.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018a7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000181d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-80.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000188a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-22.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018b8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b6f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ccc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-33.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000185e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-44.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000187d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-27.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.127 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001822 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-76.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001838 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-66.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001853 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-52.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-7.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000185f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-43.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001893 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-17.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001898 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-15.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ba9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-9.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000185d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-45.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-25.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bf2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000185b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-47.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000185c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-46.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001832 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-70.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.128 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000170d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-31.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c21 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-26.jpg) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-32.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001833 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-69.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ba3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001829 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-74.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000186a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-36.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000183b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-64.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bdf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000182e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-72.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018b6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-4.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bfa (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.129 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c09 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000189d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-14.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001837 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-67.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001891 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-19.xml) see mds.i log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cbb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000428b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004526 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001da6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000302e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-70.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-76.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.130 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-68.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dc1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004674 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000305a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-69.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cf9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000c55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-74.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000049d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000382e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000002e4f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-72.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.131 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000cbd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-67.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001db2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cb9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ca5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-64.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-87.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001dbc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ce8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c8e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-73.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001cea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.132 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004a50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ca0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-66.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001e05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001c84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d10 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004920 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x30000001414 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-98.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000037d6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d0b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001da1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.133 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001d5e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000001ca7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-63.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] up:active 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001869 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001830 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-71.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cb3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cda (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001896 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000fad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.134 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b6b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001712 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-99.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cc6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001846 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000184e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bb4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000187f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000186f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c11 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-75.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001861 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c05 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c33 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.135 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bf6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001886 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001882 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ca0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c6d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000184c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bca (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002450 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001878 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c95 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.136 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002387 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b67 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cc2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000cb8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018a2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000188f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c3c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bdb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000183e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000ccb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b63 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d76 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.137 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000be6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001844 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001821 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-77.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000baf (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002392 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-93.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000b8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bea (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000ca9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001857 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000185a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c02 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.138 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001875 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000189f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000188d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b87 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-37.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x1000000187e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b7f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c18 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000b8b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000be2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c0c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001877 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001892 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.139 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000c81 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x100000018a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001859 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001860 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001839 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-65.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000000bb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000000d77 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001856 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d55 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002dc7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002dd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d2b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002cff (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002cce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-81.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.140 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002cd1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-78.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d04 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002ce3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d3a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002cee (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d58 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d4e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d64 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.141 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d5d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d60 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d68 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d30 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d52 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d24 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d37 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d1b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.142 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d44 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d43 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d1d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d3e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d26 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d5b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.143 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d2a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d47 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d48 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d56 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d5a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d4a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d3d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d28 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d41 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.146 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d35 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d53 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002d39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c94 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-18.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ca8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-13.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c8f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-19.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b65 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-82.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001cd2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c45 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-35.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001cdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b74 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-78.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ca4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-14.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b42 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-89.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.147 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bc0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-61.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001cc4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001cba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-9.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bb2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-64.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001cb5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-10.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ce1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b0e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b62 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-83.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001cc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c6a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-28.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c39 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-37.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c98 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-17.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-85.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b2c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.148 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c7b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-24.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c51 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-33.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b16 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c1c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-42.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bd3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-57.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ba1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-68.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c2e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-39.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-25.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b12 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c5c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-31.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b4d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-88.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bfc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-49.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001cbe (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-8.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002191 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-26.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.149 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b1a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b32 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001be4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-54.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c66 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-29.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b59 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-86.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b69 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-81.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ccd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bf8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-50.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bcd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-58.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-65.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b78 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-77.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-69.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000002195 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bf3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-51.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.150 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-62.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001cd6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c0a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-46.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bdc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-55.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001cb1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-11.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b92 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-71.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b20 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bb7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-63.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b97 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-70.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c29 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b54 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-87.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b70 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-79.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b5f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-84.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.151 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-23.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c0f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-45.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bc5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-60.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ba9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-66.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c22 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-41.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c83 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-22.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-80.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c07 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-47.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c9f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-15.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bd7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-56.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001cad (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-12.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b25 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c14 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-44.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b8d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-72.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.152 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bc8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c88 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-21.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b89 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-73.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b80 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-75.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c61 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-30.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c19 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-43.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c8c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-20.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c34 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-38.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c40 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-36.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001bed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-52.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b36 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c6e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-27.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c4b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-34.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001be9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-53.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001ba4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-67.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.153 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b3b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-90.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c9b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-16.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b84 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-74.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001b7c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-76.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c57 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-32.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x10000001c01 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-48.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004373 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-39.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000437c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-36.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043ce (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-12.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043e8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-1.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043ae (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-23.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043c0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-17.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000437e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-35.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004370 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-40.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.154 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043c6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-15.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043ba (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-19.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000436a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-42.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043c9 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-14.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000435e (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-46.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000435b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-47.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043d0 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-11.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043c3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-16.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004346 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-54.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043a5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-26.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043d3 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-10.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043e1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-4.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000058e7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-59.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043a8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-25.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.155 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004358 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-48.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004376 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-38.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043f5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-3.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043df (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-5.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004381 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-34.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004390 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-29.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004330 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-60.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000005830 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-40.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043b1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-22.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004355 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-49.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000058ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-43.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004384 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-33.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043ef (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-5.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000433b (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-57.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004338 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-58.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.156 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004349 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-53.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004393 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-28.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000434c (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-52.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004343 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-55.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043d8 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-8.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004387 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-32.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043b4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-21.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000438d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-30.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043cc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-13.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004352 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-50.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043dc (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-6.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043e6 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-2.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004340 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-56.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043fb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-1.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.157 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043d5 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-9.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004364 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-44.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043ed (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-6.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004329 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-62.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043ab (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-24.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043e4 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-3.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043da (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-7.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004334 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-59.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043bd (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-18.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000434f (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-51.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043a1 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-27.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043f2 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-4.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043f7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-2.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043b7 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-20.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.158 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000005835 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-61.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.159 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000436d (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-41.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.159 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x20000004361 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-45.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.159 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x2000000438a (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-31.xml) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.159 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:26 smithi153 ceph-mon[36179]: Scrub error on inode 0x200000043eb (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-7.jpg) see mds.h log and `damage ls` output for details 2024-03-27T07:28:27.166 INFO:tasks.workunit.client.0.smithi082.stdout: 252 1167991 443 813982 268 424710 667 2024-03-27T07:28:27.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:27 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:28.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:27 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:28.041 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:27 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:28.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:28 smithi082 ceph-mon[32178]: pgmap v149: 97 pgs: 97 active+clean; 1019 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 1.50k op/s 2024-03-27T07:28:29.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:28 smithi149 ceph-mon[36065]: pgmap v149: 97 pgs: 97 active+clean; 1019 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 1.50k op/s 2024-03-27T07:28:29.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:28 smithi153 ceph-mon[36179]: pgmap v149: 97 pgs: 97 active+clean; 1019 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 8.2 MiB/s wr, 1.50k op/s 2024-03-27T07:28:30.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:30 smithi082 ceph-mon[32178]: pgmap v150: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.7 MiB/s wr, 1.59k op/s 2024-03-27T07:28:31.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:30 smithi149 ceph-mon[36065]: pgmap v150: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.7 MiB/s wr, 1.59k op/s 2024-03-27T07:28:31.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:30 smithi153 ceph-mon[36179]: pgmap v150: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.7 MiB/s wr, 1.59k op/s 2024-03-27T07:28:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.115+0000 7f1324b5e640 1 -- 172.21.15.82:0/2508516234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13201036e0 msgr2=0x7f132010bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.115+0000 7f1324b5e640 1 --2- 172.21.15.82:0/2508516234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13201036e0 0x7f132010bbc0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1308009900 tx=0x7f130802bd60 comp rx=0 tx=0).stop 2024-03-27T07:28:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.115+0000 7f1324b5e640 1 -- 172.21.15.82:0/2508516234 shutdown_connections 2024-03-27T07:28:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.115+0000 7f1324b5e640 1 --2- 172.21.15.82:0/2508516234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13201036e0 0x7f132010bbc0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.115+0000 7f1324b5e640 1 --2- 172.21.15.82:0/2508516234 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f132010c100 0x7f132010e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.115+0000 7f1324b5e640 1 --2- 172.21.15.82:0/2508516234 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1320102dc0 0x7f13201031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.115+0000 7f1324b5e640 1 -- 172.21.15.82:0/2508516234 >> 172.21.15.82:0/2508516234 conn(0x7f1320077b70 msgr2=0x7f1320077f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:31.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.115+0000 7f1324b5e640 1 -- 172.21.15.82:0/2508516234 shutdown_connections 2024-03-27T07:28:31.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.115+0000 7f1324b5e640 1 -- 172.21.15.82:0/2508516234 wait complete. 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1324b5e640 1 Processor -- start 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1324b5e640 1 -- start start 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1324b5e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1320102dc0 0x7f1320198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1324b5e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13201036e0 0x7f13201988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1324b5e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132010c100 0x7f132019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1324b5e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1320111f50 con 0x7f13201036e0 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1324b5e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1320111dd0 con 0x7f1320102dc0 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1324b5e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13201120d0 con 0x7f132010c100 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1317fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13201036e0 0x7f13201988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1317fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13201036e0 0x7f13201988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49500/0 (socket says 172.21.15.82:49500) 2024-03-27T07:28:31.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f1317fff640 1 -- 172.21.15.82:0/4152812704 learned_addr learned my addr 172.21.15.82:0/4152812704 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f131e59c640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1320102dc0 0x7f1320198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.116+0000 7f131ed9d640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132010c100 0x7f132019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f1317fff640 1 -- 172.21.15.82:0/4152812704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132010c100 msgr2=0x7f132019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f1317fff640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132010c100 0x7f132019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f1317fff640 1 -- 172.21.15.82:0/4152812704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1320102dc0 msgr2=0x7f1320198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f1317fff640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1320102dc0 0x7f1320198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f1317fff640 1 -- 172.21.15.82:0/4152812704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132019d360 con 0x7f13201036e0 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f1317fff640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13201036e0 0x7f13201988b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1308009a20 tx=0x7f130802dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f13177fe640 1 -- 172.21.15.82:0/4152812704 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308043020 con 0x7f13201036e0 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f1324b5e640 1 -- 172.21.15.82:0/4152812704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132019d5f0 con 0x7f13201036e0 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f13177fe640 1 -- 172.21.15.82:0/4152812704 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13080054e0 con 0x7f13201036e0 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f13177fe640 1 -- 172.21.15.82:0/4152812704 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1308003b50 con 0x7f13201036e0 2024-03-27T07:28:31.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.117+0000 7f1324b5e640 1 -- 172.21.15.82:0/4152812704 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13201a4ee0 con 0x7f13201036e0 2024-03-27T07:28:31.127 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.119+0000 7f13177fe640 1 -- 172.21.15.82:0/4152812704 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f1308046020 con 0x7f13201036e0 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.119+0000 7f1327821740 1 Processor -- start 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f1327821740 1 -- start start 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f1327821740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c37b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f1327821740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 0x55791c3842a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f13177fe640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f130c0a3820 0x7f130c0a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f1327821740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 0x55791c386bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f1327821740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55791c341cd0 con 0x55791c3847e0 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f1327821740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55791c286950 con 0x55791c37ba10 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f1327821740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55791c2dee50 con 0x55791c37b0f0 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c37b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f1317fff640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f130c0a3820 0x7f130c0a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131e59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 0x55791c3842a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c37b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42822/0 (socket says 172.21.15.82:42822) 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131ed9d640 1 -- 172.21.15.82:0/3821444581 learned_addr learned my addr 172.21.15.82:0/3821444581 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f13177fe640 1 -- 172.21.15.82:0/4152812704 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f13080f2020 con 0x7f13201036e0 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131ed9d640 1 --2- 172.21.15.82:0/3821444581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 0x55791c386bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131ed9d640 1 -- 172.21.15.82:0/3821444581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 msgr2=0x55791c3842a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131ed9d640 1 --2- 172.21.15.82:0/3821444581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 0x55791c3842a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131ed9d640 1 -- 172.21.15.82:0/3821444581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 msgr2=0x55791c386bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131ed9d640 1 --2- 172.21.15.82:0/3821444581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 0x55791c386bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131ed9d640 1 -- 172.21.15.82:0/3821444581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55791bff3210 con 0x55791c37b0f0 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f131e59c640 1 --2- 172.21.15.82:0/3821444581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 0x55791c3842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.120+0000 7f1317fff640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f130c0a3820 0x7f130c0a5ce0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13080ef980 tx=0x7f13080b37a0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.121+0000 7f131ed9d640 1 --2- 172.21.15.82:0/3821444581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c37b4d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1318005c40 tx=0x7f1318005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91e6f909de367c18 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.121+0000 7f1314ff9640 1 -- 172.21.15.82:0/3821444581 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318011130 con 0x55791c37b0f0 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.121+0000 7f1314ff9640 1 -- 172.21.15.82:0/3821444581 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13180112d0 con 0x55791c37b0f0 2024-03-27T07:28:31.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.121+0000 7f1314ff9640 1 -- 172.21.15.82:0/3821444581 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131800fbb0 con 0x55791c37b0f0 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 -- 172.21.15.82:0/3821444581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 msgr2=0x55791c37b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 --2- 172.21.15.82:0/3821444581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c37b4d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1318005c40 tx=0x7f1318005bd0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 -- 172.21.15.82:0/3821444581 shutdown_connections 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 --2- 172.21.15.82:0/3821444581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 0x55791c386bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 --2- 172.21.15.82:0/3821444581 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 0x55791c3842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 --2- 172.21.15.82:0/3821444581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c37b4d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 -- 172.21.15.82:0/3821444581 >> 172.21.15.82:0/3821444581 conn(0x55791c375a10 msgr2=0x55791c375df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 -- 172.21.15.82:0/3821444581 shutdown_connections 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 -- 172.21.15.82:0/3821444581 wait complete. 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 -- start start 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 Processor -- start 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c3817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37ba10 0x55791c381d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.130 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c3847e0 0x55791c382240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55791c2dae00 con 0x55791c37ba10 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55791c287520 con 0x55791c3847e0 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55791c29a8e0 con 0x55791c37b0f0 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.122+0000 7f1327821740 10 client.0 _ll_register_callbacks cb 0x55791c2d5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37ba10 0x55791c381d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c3817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131e59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37ba10 0x55791c381d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49520/0 (socket says 172.21.15.82:49520) 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131e59c640 1 -- 172.21.15.82:0/3934460999 learned_addr learned my addr 172.21.15.82:0/3934460999 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131ed9d640 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c3847e0 0x55791c382240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131e59c640 1 -- 172.21.15.82:0/3934460999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 msgr2=0x55791c3817c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131e59c640 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c3817c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131e59c640 1 -- 172.21.15.82:0/3934460999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c3847e0 msgr2=0x55791c382240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131e59c640 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c3847e0 0x55791c382240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131e59c640 1 -- 172.21.15.82:0/3934460999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55791c0bf620 con 0x55791c37ba10 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131ed9d640 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c3817c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f131e59c640 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37ba10 0x55791c381d00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1310012710 tx=0x7f1310012bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58230286e46b3107 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f1305ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f1305ffb640 1 -- 172.21.15.82:0/3934460999 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310004030 con 0x55791c37ba10 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f1305ffb640 1 -- 172.21.15.82:0/3934460999 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f13100041d0 con 0x55791c37ba10 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f1327821740 1 -- 172.21.15.82:0/3934460999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13180112d0 con 0x55791c37ba10 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f1305ffb640 1 -- 172.21.15.82:0/3934460999 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f13100043d0 con 0x55791c37ba10 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f1327821740 10 client.16689 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.123+0000 7f1327821740 1 -- 172.21.15.82:0/3934460999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55791c3977d0 con 0x55791c37ba10 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f1305ffb640 1 -- 172.21.15.82:0/3934460999 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13180112d0 con 0x55791c37ba10 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f1305ffb640 1 -- 172.21.15.82:0/3934460999 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f1310003c30 con 0x55791c37ba10 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f1327821740 10 client.16689 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f1327821740 10 client.16689 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:31.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f1327821740 20 client.16689 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f1327821740 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55791c398d50 0x55791c39b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f1327821740 4 client.16689 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f1327821740 1 -- 172.21.15.82:0/3934460999 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55791c2ec390 con 0x55791c398d50 2024-03-27T07:28:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f131ed9d640 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55791c398d50 0x55791c39b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f131ed9d640 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55791c398d50 0x55791c39b140 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b198ab7075f7400 server_cookie=54276fe681aaa90c in_seq=0 out_seq=0 2024-03-27T07:28:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.124+0000 7f1305ffb640 10 client.16689 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1305ffb640 1 -- 172.21.15.82:0/3934460999 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55791c2ec390 con 0x55791c398d50 2024-03-27T07:28:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1305ffb640 10 client.16689 handle_command_reply: tid=0 2024-03-27T07:28:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1327821740 1 client.16689 shutdown 2024-03-27T07:28:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1327821740 1 -- 172.21.15.82:0/3934460999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37ba10 msgr2=0x55791c381d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1327821740 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37ba10 0x55791c381d00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1310012710 tx=0x7f1310012bd0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1327821740 1 -- 172.21.15.82:0/3934460999 shutdown_connections 2024-03-27T07:28:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1327821740 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55791c398d50 0x55791c39b140 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1327821740 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37ba10 0x55791c381d00 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1327821740 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c3847e0 0x55791c382240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1305ffb640 0 client.16689 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1327821740 1 --2- 172.21.15.82:0/3934460999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37b0f0 0x55791c3817c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.127+0000 7f1327821740 1 -- 172.21.15.82:0/3934460999 >> 172.21.15.82:0/3934460999 conn(0x55791c375a10 msgr2=0x55791c377760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.128+0000 7f1327821740 1 -- 172.21.15.82:0/3934460999 shutdown_connections 2024-03-27T07:28:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.128+0000 7f1327821740 1 -- 172.21.15.82:0/3934460999 wait complete. 2024-03-27T07:28:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.128+0000 7f1327821740 20 client.16689 trim_cache size 0 max 16384 2024-03-27T07:28:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f1327821740 1 Processor -- start 2024-03-27T07:28:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f1327821740 1 -- start start 2024-03-27T07:28:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f1327821740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37b0f0 0x55791c3942c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f1327821740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37ba10 0x55791c382060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f1327821740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 0x55791c3a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f1327821740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f13201adde0 con 0x55791c3847e0 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f1327821740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13201ab650 con 0x55791c37b0f0 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f1327821740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13201a94a0 con 0x55791c37ba10 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f131e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37ba10 0x55791c382060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f131e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37ba10 0x55791c382060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:42844/0 (socket says 172.21.15.82:42844) 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f131e59c640 1 -- 172.21.15.82:0/648489944 learned_addr learned my addr 172.21.15.82:0/648489944 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.144+0000 7f131ed9d640 1 --2- 172.21.15.82:0/648489944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37b0f0 0x55791c3942c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f131e59c640 1 -- 172.21.15.82:0/648489944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37b0f0 msgr2=0x55791c3942c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f131e59c640 1 --2- 172.21.15.82:0/648489944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37b0f0 0x55791c3942c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f131e59c640 1 -- 172.21.15.82:0/648489944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 msgr2=0x55791c3a09f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f131ed9d640 1 --2- 172.21.15.82:0/648489944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 0x55791c3a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f131e59c640 1 --2- 172.21.15.82:0/648489944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 0x55791c3a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f131e59c640 1 -- 172.21.15.82:0/648489944 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55791c39b4b0 con 0x55791c37ba10 2024-03-27T07:28:31.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f131ed9d640 1 --2- 172.21.15.82:0/648489944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 0x55791c3a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:28:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f131e59c640 1 --2- 172.21.15.82:0/648489944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37ba10 0x55791c382060 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1310026640 tx=0x7f13100096e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a0505dcf7751b68 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f1307fff640 1 -- 172.21.15.82:0/648489944 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310005600 con 0x55791c37ba10 2024-03-27T07:28:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f1307fff640 1 -- 172.21.15.82:0/648489944 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f131000fe00 con 0x55791c37ba10 2024-03-27T07:28:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.145+0000 7f1307fff640 1 -- 172.21.15.82:0/648489944 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1310026ce0 con 0x55791c37ba10 2024-03-27T07:28:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.146+0000 7f1327821740 1 -- 172.21.15.82:0/648489944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37ba10 msgr2=0x55791c382060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.146+0000 7f1327821740 1 --2- 172.21.15.82:0/648489944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37ba10 0x55791c382060 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1310026640 tx=0x7f13100096e0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.147+0000 7f1327821740 1 -- 172.21.15.82:0/648489944 shutdown_connections 2024-03-27T07:28:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.147+0000 7f1327821740 1 --2- 172.21.15.82:0/648489944 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c3847e0 0x55791c3a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.147+0000 7f1327821740 1 --2- 172.21.15.82:0/648489944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c37ba10 0x55791c382060 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.147+0000 7f1327821740 1 --2- 172.21.15.82:0/648489944 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37b0f0 0x55791c3942c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.147+0000 7f1327821740 1 -- 172.21.15.82:0/648489944 >> 172.21.15.82:0/648489944 conn(0x55791c375a10 msgr2=0x55791c374a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.147+0000 7f1327821740 1 -- 172.21.15.82:0/648489944 shutdown_connections 2024-03-27T07:28:31.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.147+0000 7f1327821740 1 -- 172.21.15.82:0/648489944 wait complete. 2024-03-27T07:28:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.147+0000 7f1327821740 1 -- start start 2024-03-27T07:28:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.147+0000 7f1327821740 1 Processor -- start 2024-03-27T07:28:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.148+0000 7f1327821740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37b0f0 0x55791c37e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.148+0000 7f131ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37b0f0 0x55791c37e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.148+0000 7f131ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37b0f0 0x55791c37e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49540/0 (socket says 172.21.15.82:49540) 2024-03-27T07:28:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.148+0000 7f1327821740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 0x55791c37ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.148+0000 7f131ed9d640 1 -- 172.21.15.82:0/1165497620 learned_addr learned my addr 172.21.15.82:0/1165497620 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.148+0000 7f1327821740 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c3847e0 0x55791c3fe020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.148+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f13201a9b10 con 0x55791c37b0f0 2024-03-27T07:28:31.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.148+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f13201aaf80 con 0x55791c37ba10 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.148+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f13201aa1e0 con 0x55791c3847e0 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.148+0000 7f1327821740 10 client.0 _ll_register_callbacks cb 0x7f1310009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f131e59c640 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 0x55791c37ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f131ed9d640 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c3847e0 0x55791c3fe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f131ed9d640 1 -- 172.21.15.82:0/1165497620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c3847e0 msgr2=0x55791c3fe020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f131ed9d640 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c3847e0 0x55791c3fe020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f131ed9d640 1 -- 172.21.15.82:0/1165497620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 msgr2=0x55791c37ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f131ed9d640 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 0x55791c37ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f131ed9d640 1 -- 172.21.15.82:0/1165497620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55791c37f470 con 0x55791c37b0f0 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f131e59c640 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 0x55791c37ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f131ed9d640 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37b0f0 0x55791c37e690 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1318003e70 tx=0x7f1310009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adc76cc1487255c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f1305ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:31.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f1305ffb640 1 -- 172.21.15.82:0/1165497620 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318011250 con 0x55791c37b0f0 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f1305ffb640 1 -- 172.21.15.82:0/1165497620 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f1318031370 con 0x55791c37b0f0 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.149+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f131000fe00 con 0x55791c37b0f0 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1305ffb640 1 -- 172.21.15.82:0/1165497620 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1318031570 con 0x55791c37b0f0 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1327821740 10 client.16692 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55791c3ff5b0 con 0x55791c37b0f0 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1305ffb640 1 -- 172.21.15.82:0/1165497620 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f131000fe00 con 0x55791c37b0f0 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1305ffb640 1 -- 172.21.15.82:0/1165497620 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f131802d030 con 0x55791c37b0f0 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1327821740 10 client.16692 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1327821740 10 client.16692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1327821740 20 client.16692 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1327821740 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55791c3ffbf0 0x55791c402010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1327821740 4 client.16692 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.150+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55791c2e66e0 con 0x55791c3ffbf0 2024-03-27T07:28:31.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.151+0000 7f131e59c640 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55791c3ffbf0 0x55791c402010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.152+0000 7f1305ffb640 10 client.16692 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:31.156 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:31.152+0000 7f131e59c640 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55791c3ffbf0 0x55791c402010 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0ddcf60213fdaf4 server_cookie=367e808a7c5b11a in_seq=0 out_seq=0 2024-03-27T07:28:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.009+0000 7f1305ffb640 1 -- 172.21.15.82:0/1165497620 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55791c2e66e0 con 0x55791c3ffbf0 2024-03-27T07:28:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.009+0000 7f1305ffb640 10 client.16692 handle_command_reply: tid=0 2024-03-27T07:28:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.009+0000 7f1327821740 1 client.16692 shutdown 2024-03-27T07:28:32.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37b0f0 msgr2=0x55791c37e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37b0f0 0x55791c37e690 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1318003e70 tx=0x7f1310009e30 comp rx=0 tx=0).stop 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 shutdown_connections 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55791c3847e0 0x55791c3fe020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55791c37ba10 0x55791c37ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55791c3ffbf0 0x55791c402010 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 1 --2- 172.21.15.82:0/1165497620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55791c37b0f0 0x55791c37e690 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 >> 172.21.15.82:0/1165497620 conn(0x55791c375a10 msgr2=0x55791c374a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1305ffb640 0 client.16692 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 shutdown_connections 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 1 -- 172.21.15.82:0/1165497620 wait complete. 2024-03-27T07:28:32.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.010+0000 7f1327821740 20 client.16692 trim_cache size 0 max 16384 2024-03-27T07:28:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:28:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:28:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:28:32.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:28:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 -- 172.21.15.82:0/4152812704 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f130c0a3820 msgr2=0x7f130c0a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f130c0a3820 0x7f130c0a5ce0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f13080ef980 tx=0x7f13080b37a0 comp rx=0 tx=0).stop 2024-03-27T07:28:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 -- 172.21.15.82:0/4152812704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13201036e0 msgr2=0x7f13201988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13201036e0 0x7f13201988b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f1308009a20 tx=0x7f130802dc60 comp rx=0 tx=0).stop 2024-03-27T07:28:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 -- 172.21.15.82:0/4152812704 shutdown_connections 2024-03-27T07:28:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f130c0a3820 0x7f130c0a5ce0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13201036e0 0x7f13201988b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f132010c100 0x7f132019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 --2- 172.21.15.82:0/4152812704 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1320102dc0 0x7f1320198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:32.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 -- 172.21.15.82:0/4152812704 >> 172.21.15.82:0/4152812704 conn(0x7f1320077b70 msgr2=0x7f13200fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 -- 172.21.15.82:0/4152812704 shutdown_connections 2024-03-27T07:28:32.017 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:32.011+0000 7f1324b5e640 1 -- 172.21.15.82:0/4152812704 wait complete. 2024-03-27T07:28:32.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:32 smithi082 ceph-mon[32178]: pgmap v151: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.0 MiB/s wr, 1.53k op/s 2024-03-27T07:28:32.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[32174]: 2024-03-27T07:28:32.739+0000 7fbafc1bf700 -1 log_channel(cluster) log [ERR] : Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T07:28:33.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:32 smithi149 ceph-mon[36065]: pgmap v151: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.0 MiB/s wr, 1.53k op/s 2024-03-27T07:28:33.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:32 smithi153 ceph-mon[36179]: pgmap v151: 97 pgs: 97 active+clean; 1.0 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.0 MiB/s wr, 1.53k op/s 2024-03-27T07:28:33.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:33 smithi082 ceph-mon[32178]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T07:28:34.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:33 smithi149 ceph-mon[36065]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T07:28:34.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:33 smithi153 ceph-mon[36179]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T07:28:34.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:34 smithi082 ceph-mon[32178]: pgmap v152: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 14 MiB/s wr, 2.09k op/s 2024-03-27T07:28:35.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:34 smithi149 ceph-mon[36065]: pgmap v152: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 14 MiB/s wr, 2.09k op/s 2024-03-27T07:28:35.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:34 smithi153 ceph-mon[36179]: pgmap v152: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 14 MiB/s wr, 2.09k op/s 2024-03-27T07:28:35.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:35 smithi082 ceph-mon[32178]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:36.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:35 smithi149 ceph-mon[36065]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:36.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:35 smithi153 ceph-mon[36179]: scrub summary: idle+waiting paths [/] 2024-03-27T07:28:36.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:36 smithi082 ceph-mon[32178]: pgmap v153: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.68k op/s 2024-03-27T07:28:37.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:36 smithi149 ceph-mon[36065]: pgmap v153: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.68k op/s 2024-03-27T07:28:37.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:36 smithi153 ceph-mon[36179]: pgmap v153: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 1.68k op/s 2024-03-27T07:28:37.166 INFO:tasks.workunit.client.0.smithi082.stdout: 264 1512843 705 1047462 710 560843 985 2024-03-27T07:28:38.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:38 smithi082 ceph-mon[32178]: pgmap v154: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 14 MiB/s wr, 2.04k op/s 2024-03-27T07:28:39.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:38 smithi149 ceph-mon[36065]: pgmap v154: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 14 MiB/s wr, 2.04k op/s 2024-03-27T07:28:39.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:38 smithi153 ceph-mon[36179]: pgmap v154: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 14 MiB/s wr, 2.04k op/s 2024-03-27T07:28:39.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:39 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:28:39.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:39 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:28:39.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:39 smithi082 ceph-mon[32178]: scrub summary: idle 2024-03-27T07:28:40.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:39 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:28:40.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:39 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:28:40.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:39 smithi149 ceph-mon[36065]: scrub summary: idle 2024-03-27T07:28:40.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:39 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:28:40.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:39 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:28:40.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:39 smithi153 ceph-mon[36179]: scrub summary: idle 2024-03-27T07:28:40.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:40 smithi082 ceph-mon[32178]: pgmap v155: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.0 MiB/s wr, 1.42k op/s 2024-03-27T07:28:41.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:40 smithi149 ceph-mon[36065]: pgmap v155: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.0 MiB/s wr, 1.42k op/s 2024-03-27T07:28:41.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:40 smithi153 ceph-mon[36179]: pgmap v155: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 9.0 MiB/s wr, 1.42k op/s 2024-03-27T07:28:42.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:42 smithi082 ceph-mon[32178]: pgmap v156: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.3 MiB/s wr, 1.21k op/s 2024-03-27T07:28:43.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:42 smithi149 ceph-mon[36065]: pgmap v156: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.3 MiB/s wr, 1.21k op/s 2024-03-27T07:28:43.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:42 smithi153 ceph-mon[36179]: pgmap v156: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.3 MiB/s wr, 1.21k op/s 2024-03-27T07:28:45.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:44 smithi149 ceph-mon[36065]: pgmap v157: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.2 MiB/s wr, 1.29k op/s 2024-03-27T07:28:45.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:44 smithi153 ceph-mon[36179]: pgmap v157: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.2 MiB/s wr, 1.29k op/s 2024-03-27T07:28:45.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:44 smithi082 ceph-mon[32178]: pgmap v157: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 8.2 MiB/s wr, 1.29k op/s 2024-03-27T07:28:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.686+0000 7fc1f4d35640 1 -- 172.21.15.82:0/2703498974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f010e8a0 msgr2=0x7fc1f010cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.686+0000 7fc1f4d35640 1 --2- 172.21.15.82:0/2703498974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f010e8a0 0x7fc1f010cc00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009cb0 tx=0x7fc1e402bfd0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.686+0000 7fc1f4d35640 1 -- 172.21.15.82:0/2703498974 shutdown_connections 2024-03-27T07:28:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.686+0000 7fc1f4d35640 1 --2- 172.21.15.82:0/2703498974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f010d2e0 0x7fc1f0079dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.686+0000 7fc1f4d35640 1 --2- 172.21.15.82:0/2703498974 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f010e8a0 0x7fc1f010cc00 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009cb0 tx=0x7fc1e402bfd0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.686+0000 7fc1f4d35640 1 --2- 172.21.15.82:0/2703498974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1f010def0 0x7fc1f010e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.686+0000 7fc1f4d35640 1 -- 172.21.15.82:0/2703498974 >> 172.21.15.82:0/2703498974 conn(0x7fc1f006cad0 msgr2=0x7fc1f006cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:46.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.698+0000 7fc1f4d35640 1 -- 172.21.15.82:0/2703498974 shutdown_connections 2024-03-27T07:28:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.699+0000 7fc1f4d35640 1 -- 172.21.15.82:0/2703498974 wait complete. 2024-03-27T07:28:46.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.700+0000 7fc1f4d35640 1 Processor -- start 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.700+0000 7fc1f4d35640 1 -- start start 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.700+0000 7fc1f4d35640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1f010d2e0 0x7fc1f0076f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.700+0000 7fc1f4d35640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f010def0 0x7fc1f0077490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.700+0000 7fc1f4d35640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f0079eb0 0x7fc1f00779d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.700+0000 7fc1f4d35640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f007d380 con 0x7fc1f010d2e0 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.700+0000 7fc1f4d35640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f007d200 con 0x7fc1f010def0 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.700+0000 7fc1f4d35640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f007d500 con 0x7fc1f0079eb0 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.701+0000 7fc1ee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1f010d2e0 0x7fc1f0076f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.701+0000 7fc1eed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f0079eb0 0x7fc1f00779d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.701+0000 7fc1eed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f0079eb0 0x7fc1f00779d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:45268/0 (socket says 172.21.15.82:45268) 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.701+0000 7fc1eed9d640 1 -- 172.21.15.82:0/78159372 learned_addr learned my addr 172.21.15.82:0/78159372 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.701+0000 7fc1ee59c640 1 -- 172.21.15.82:0/78159372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f0079eb0 msgr2=0x7fc1f00779d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:46.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.701+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f0079eb0 0x7fc1f00779d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.701+0000 7fc1ee59c640 1 -- 172.21.15.82:0/78159372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f010def0 msgr2=0x7fc1f0077490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:28:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.701+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f010def0 0x7fc1f0077490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.701+0000 7fc1ee59c640 1 -- 172.21.15.82:0/78159372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f01bc170 con 0x7fc1f010d2e0 2024-03-27T07:28:46.708 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.702+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1f010d2e0 0x7fc1f0076f50 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000e9e0 tx=0x7fc1e000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:46.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.722+0000 7fc1df7fe640 1 -- 172.21.15.82:0/78159372 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000cba0 con 0x7fc1f010d2e0 2024-03-27T07:28:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.722+0000 7fc1df7fe640 1 -- 172.21.15.82:0/78159372 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1e000cd40 con 0x7fc1f010d2e0 2024-03-27T07:28:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.722+0000 7fc1df7fe640 1 -- 172.21.15.82:0/78159372 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0018840 con 0x7fc1f010d2e0 2024-03-27T07:28:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.722+0000 7fc1f4d35640 1 -- 172.21.15.82:0/78159372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f01bc460 con 0x7fc1f010d2e0 2024-03-27T07:28:46.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.722+0000 7fc1f4d35640 1 -- 172.21.15.82:0/78159372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f01bc930 con 0x7fc1f010d2e0 2024-03-27T07:28:46.731 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.728+0000 7fc1df7fe640 1 -- 172.21.15.82:0/78159372 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fc1e00189e0 con 0x7fc1f010d2e0 2024-03-27T07:28:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.741+0000 7fc1f79f5740 1 Processor -- start 2024-03-27T07:28:46.744 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1f79f5740 1 -- start start 2024-03-27T07:28:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60c3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3bb0 0x55e9d60cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.745 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60cc980 0x55e9d60ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1f79f5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e9d6089cd0 con 0x55e9d60c3290 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1f79f5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5fce950 con 0x55e9d60c3bb0 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1f79f5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e9d6026e50 con 0x55e9d60cc980 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1edd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60cc980 0x55e9d60ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1edd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60cc980 0x55e9d60ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:45276/0 (socket says 172.21.15.82:45276) 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1edd9b640 1 -- 172.21.15.82:0/1696720606 learned_addr learned my addr 172.21.15.82:0/1696720606 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.742+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/1696720606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3bb0 0x55e9d60cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.743+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/1696720606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.743+0000 7fc1edd9b640 1 -- 172.21.15.82:0/1696720606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3bb0 msgr2=0x55e9d60cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.743+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/1696720606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3bb0 0x55e9d60cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.743+0000 7fc1edd9b640 1 -- 172.21.15.82:0/1696720606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 msgr2=0x55e9d60c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:46.746 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.743+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/1696720606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.743+0000 7fc1edd9b640 1 -- 172.21.15.82:0/1696720606 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9d5d3b210 con 0x55e9d60cc980 2024-03-27T07:28:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.743+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/1696720606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.743+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/1696720606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60cc980 0x55e9d60ced70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009780 tx=0x7fc1e4005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9b83421f1ef4385 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.744+0000 7fc1df7fe640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc1d80a3980 0x7fc1d80a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.744+0000 7fc1dcff9640 1 -- 172.21.15.82:0/1696720606 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4039040 con 0x55e9d60cc980 2024-03-27T07:28:46.747 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.745+0000 7fc1dcff9640 1 -- 172.21.15.82:0/1696720606 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1e4009b00 con 0x55e9d60cc980 2024-03-27T07:28:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.746+0000 7fc1f79f5740 1 -- 172.21.15.82:0/1696720606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60cc980 msgr2=0x55e9d60ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:46.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.746+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/1696720606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60cc980 0x55e9d60ced70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009780 tx=0x7fc1e4005c90 comp rx=0 tx=0).stop 2024-03-27T07:28:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.748+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc1d80a3980 0x7fc1d80a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.749+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc1d80a3980 0x7fc1d80a5e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009fd0 tx=0x7fc1e8009500 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.751+0000 7fc1df7fe640 1 -- 172.21.15.82:0/78159372 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fc1e00d0170 con 0x7fc1f010d2e0 2024-03-27T07:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.796+0000 7fc1f79f5740 1 -- 172.21.15.82:0/1696720606 shutdown_connections 2024-03-27T07:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.796+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/1696720606 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60cc980 0x55e9d60ced70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.797+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/1696720606 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3bb0 0x55e9d60cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.797+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/1696720606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.797+0000 7fc1f79f5740 1 -- 172.21.15.82:0/1696720606 >> 172.21.15.82:0/1696720606 conn(0x55e9d60bdbb0 msgr2=0x55e9d60bdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.798+0000 7fc1f79f5740 1 -- 172.21.15.82:0/1696720606 shutdown_connections 2024-03-27T07:28:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.798+0000 7fc1f79f5740 1 -- 172.21.15.82:0/1696720606 wait complete. 2024-03-27T07:28:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.798+0000 7fc1f79f5740 1 -- start start 2024-03-27T07:28:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.798+0000 7fc1f79f5740 1 Processor -- start 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3290 0x55e9d60c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60cc980 0x55e9d60ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1f79f5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e9d6022e00 con 0x55e9d60cc980 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1f79f5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5fcf520 con 0x55e9d60c3290 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1f79f5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e9d5fe28e0 con 0x55e9d60c3bb0 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1f79f5740 10 client.0 _ll_register_callbacks cb 0x55e9d601da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1ee59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3290 0x55e9d60c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1ee59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3290 0x55e9d60c98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:36158/0 (socket says 172.21.15.82:36158) 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1ee59c640 1 -- 172.21.15.82:0/3994155268 learned_addr learned my addr 172.21.15.82:0/3994155268 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60cc980 0x55e9d60ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1ee59c640 1 -- 172.21.15.82:0/3994155268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 msgr2=0x55e9d60c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.799+0000 7fc1ee59c640 1 -- 172.21.15.82:0/3994155268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60cc980 msgr2=0x55e9d60ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.800+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60cc980 0x55e9d60ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.800+0000 7fc1ee59c640 1 -- 172.21.15.82:0/3994155268 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9d5e07620 con 0x55e9d60c3290 2024-03-27T07:28:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.800+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:28:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.800+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60cc980 0x55e9d60ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.800+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3290 0x55e9d60c98d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc1e009bff0 tx=0x7fc1e0098680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aec26bf20172ca67 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.840+0000 7fc1d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:28:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.840+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/3994155268 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0096e60 con 0x55e9d60c3290 2024-03-27T07:28:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.840+0000 7fc1f79f5740 1 -- 172.21.15.82:0/3994155268 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1e4009b00 con 0x55e9d60c3290 2024-03-27T07:28:46.843 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.840+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/3994155268 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fc1e00d2110 con 0x55e9d60c3290 2024-03-27T07:28:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.841+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/3994155268 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc1e009c9f0 con 0x55e9d60c3290 2024-03-27T07:28:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.841+0000 7fc1f79f5740 10 client.26540 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:46.844 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.842+0000 7fc1f79f5740 1 -- 172.21.15.82:0/3994155268 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e9d60db4f0 con 0x55e9d60c3290 2024-03-27T07:28:46.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.845+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/3994155268 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1e4009b00 con 0x55e9d60c3290 2024-03-27T07:28:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.846+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/3994155268 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc1e009b740 con 0x55e9d60c3290 2024-03-27T07:28:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.846+0000 7fc1f79f5740 10 client.26540 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.847+0000 7fc1f79f5740 10 client.26540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.847+0000 7fc1f79f5740 20 client.26540 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.847+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e9d60dced0 0x55e9d60df370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.847+0000 7fc1f79f5740 4 client.26540 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.847+0000 7fc1f79f5740 1 -- 172.21.15.82:0/3994155268 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9d6034390 con 0x55e9d60dced0 2024-03-27T07:28:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.847+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e9d60dced0 0x55e9d60df370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.847+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e9d60dced0 0x55e9d60df370 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83ac637446bb6e23 server_cookie=33fb8ccd3fc49486 in_seq=0 out_seq=0 2024-03-27T07:28:46.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.848+0000 7fc1d5ffb640 10 client.26540 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:46.859 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.857+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/3994155268 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e9d6034390 con 0x55e9d60dced0 2024-03-27T07:28:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.857+0000 7fc1d5ffb640 10 client.26540 handle_command_reply: tid=0 2024-03-27T07:28:46.860 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.857+0000 7fc1f79f5740 1 client.26540 shutdown 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.857+0000 7fc1f79f5740 1 -- 172.21.15.82:0/3994155268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3290 msgr2=0x55e9d60c98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.857+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3290 0x55e9d60c98d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc1e009bff0 tx=0x7fc1e0098680 comp rx=0 tx=0).stop 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.858+0000 7fc1f79f5740 1 -- 172.21.15.82:0/3994155268 shutdown_connections 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.858+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e9d60dced0 0x55e9d60df370 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.858+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60cc980 0x55e9d60ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.858+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.858+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/3994155268 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60c3290 0x55e9d60c98d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.858+0000 7fc1f79f5740 1 -- 172.21.15.82:0/3994155268 >> 172.21.15.82:0/3994155268 conn(0x55e9d60bdbb0 msgr2=0x55e9d60bf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.858+0000 7fc1d5ffb640 0 client.26540 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.858+0000 7fc1f79f5740 1 -- 172.21.15.82:0/3994155268 shutdown_connections 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.858+0000 7fc1f79f5740 1 -- 172.21.15.82:0/3994155268 wait complete. 2024-03-27T07:28:46.861 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.858+0000 7fc1f79f5740 20 client.26540 trim_cache size 0 max 16384 2024-03-27T07:28:46.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.952+0000 7fc1f79f5740 1 Processor -- start 2024-03-27T07:28:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.952+0000 7fc1f79f5740 1 -- start start 2024-03-27T07:28:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.952+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60d80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.953+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.953+0000 7fc1ee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60d80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.953+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 0x55e9d60bf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.953+0000 7fc1ee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60d80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55992/0 (socket says 172.21.15.82:55992) 2024-03-27T07:28:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.953+0000 7fc1f79f5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d0010f40 con 0x55e9d60c3290 2024-03-27T07:28:46.956 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.953+0000 7fc1f79f5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d000e7b0 con 0x55e9d60cc980 2024-03-27T07:28:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.953+0000 7fc1ee59c640 1 -- 172.21.15.82:0/4095924182 learned_addr learned my addr 172.21.15.82:0/4095924182 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.953+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/4095924182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.953+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4095924182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d000c6b0 con 0x55e9d60c3bb0 2024-03-27T07:28:46.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.953+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/4095924182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 0x55e9d60bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.954+0000 7fc1eed9d640 1 -- 172.21.15.82:0/4095924182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 msgr2=0x55e9d60ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.954+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/4095924182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.954+0000 7fc1eed9d640 1 -- 172.21.15.82:0/4095924182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 msgr2=0x55e9d60d80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.954+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/4095924182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60d80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.954+0000 7fc1eed9d640 1 -- 172.21.15.82:0/4095924182 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9d60c2570 con 0x55e9d60cc980 2024-03-27T07:28:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.954+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/4095924182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60d80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:46.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.954+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/4095924182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 0x55e9d60bf710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc1f010c7d0 tx=0x7fc1e8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e384587ffd8ed083 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:46.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.958+0000 7fc1d7fff640 1 -- 172.21.15.82:0/4095924182 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e801c610 con 0x55e9d60cc980 2024-03-27T07:28:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.958+0000 7fc1d7fff640 1 -- 172.21.15.82:0/4095924182 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1e802c070 con 0x55e9d60cc980 2024-03-27T07:28:46.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.958+0000 7fc1d7fff640 1 -- 172.21.15.82:0/4095924182 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8027ae0 con 0x55e9d60cc980 2024-03-27T07:28:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.959+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4095924182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 msgr2=0x55e9d60bf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:46.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.959+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4095924182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 0x55e9d60bf710 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc1f010c7d0 tx=0x7fc1e8016000 comp rx=0 tx=0).stop 2024-03-27T07:28:46.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.962+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4095924182 shutdown_connections 2024-03-27T07:28:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.962+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4095924182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 0x55e9d60bf710 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.962+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4095924182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.962+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4095924182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60d80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.962+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4095924182 >> 172.21.15.82:0/4095924182 conn(0x55e9d60bdbb0 msgr2=0x55e9d60bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.964+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4095924182 shutdown_connections 2024-03-27T07:28:46.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.965+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4095924182 wait complete. 2024-03-27T07:28:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.965+0000 7fc1f79f5740 1 -- start start 2024-03-27T07:28:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.966+0000 7fc1f79f5740 1 Processor -- start 2024-03-27T07:28:46.968 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.966+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.966+0000 7fc1f79f5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.967+0000 7fc1ee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.967+0000 7fc1ee59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55994/0 (socket says 172.21.15.82:55994) 2024-03-27T07:28:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.967+0000 7fc1ee59c640 1 -- 172.21.15.82:0/4064022789 learned_addr learned my addr 172.21.15.82:0/4064022789 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.967+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 0x55e9d613b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.967+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.967+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d000cc70 con 0x55e9d60c3290 2024-03-27T07:28:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.967+0000 7fc1eed9d640 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 0x55e9d613b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.967+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d000e0e0 con 0x55e9d60cc980 2024-03-27T07:28:46.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.967+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d000d340 con 0x55e9d60c3bb0 2024-03-27T07:28:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.968+0000 7fc1ee59c640 1 -- 172.21.15.82:0/4064022789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 msgr2=0x55e9d60cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.968+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.968+0000 7fc1ee59c640 1 -- 172.21.15.82:0/4064022789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 msgr2=0x55e9d613b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.968+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 0x55e9d613b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.968+0000 7fc1ee59c640 1 -- 172.21.15.82:0/4064022789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9d613b830 con 0x55e9d60c3290 2024-03-27T07:28:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.968+0000 7fc1ee59c640 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60cf8b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000efd0 tx=0x7fc1e00a50c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ed11857281ba8d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.968+0000 7fc1f79f5740 10 client.0 _ll_register_callbacks cb 0x7fc1e0005b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:46.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.969+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1e802c070 con 0x55e9d60c3290 2024-03-27T07:28:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.970+0000 7fc1d5ffb640 10 client.16710 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.971+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/4064022789 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0096e60 con 0x55e9d60c3290 2024-03-27T07:28:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.971+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/4064022789 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fc1e00d2110 con 0x55e9d60c3290 2024-03-27T07:28:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.971+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/4064022789 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc1e009b950 con 0x55e9d60c3290 2024-03-27T07:28:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.971+0000 7fc1f79f5740 10 client.16710 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:46.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.971+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55e9d6142a70 con 0x55e9d60c3290 2024-03-27T07:28:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.975+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/4064022789 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fc1e00b0ba0 con 0x55e9d60c3290 2024-03-27T07:28:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.975+0000 7fc1f79f5740 10 client.16710 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.975+0000 7fc1f79f5740 10 client.16710 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.975+0000 7fc1f79f5740 20 client.16710 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:46.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.975+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e9d61430a0 0x55e9d61454c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.976+0000 7fc1f79f5740 4 client.16710 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:28:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.976+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fc1e802c070 con 0x55e9d61430a0 2024-03-27T07:28:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.976+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e9d61430a0 0x55e9d61454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.976+0000 7fc1d5ffb640 10 client.16710 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:46.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:46.976+0000 7fc1edd9b640 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e9d61430a0 0x55e9d61454c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5417578040bb783 server_cookie=51b9da783a862ac3 in_seq=0 out_seq=0 2024-03-27T07:28:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:46 smithi149 ceph-mon[36065]: pgmap v158: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 682 op/s 2024-03-27T07:28:47.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:46 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:28:47.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:46 smithi153 ceph-mon[36179]: pgmap v158: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 682 op/s 2024-03-27T07:28:47.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:46 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:28:47.166 INFO:tasks.workunit.client.0.smithi082.stdout: 282 2687538 1165 1863812 1024 1005707 1666 2024-03-27T07:28:47.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:46 smithi082 ceph-mon[32178]: pgmap v158: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.9 MiB/s wr, 682 op/s 2024-03-27T07:28:47.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:46 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:28:49.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:48 smithi149 ceph-mon[36065]: pgmap v159: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 725 op/s 2024-03-27T07:28:49.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:48 smithi153 ceph-mon[36179]: pgmap v159: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 725 op/s 2024-03-27T07:28:49.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:48 smithi082 ceph-mon[32178]: pgmap v159: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.7 MiB/s wr, 725 op/s 2024-03-27T07:28:50.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T07:28:50.671 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T07:28:51.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:50 smithi149 ceph-mon[36065]: pgmap v160: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 329 op/s 2024-03-27T07:28:51.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:50 smithi153 ceph-mon[36179]: pgmap v160: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 329 op/s 2024-03-27T07:28:51.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:50 smithi082 ceph-mon[32178]: pgmap v160: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.5 MiB/s wr, 329 op/s 2024-03-27T07:28:51.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.632+0000 7f93d098a640 1 -- 172.21.15.82:0/3353609411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93cc10e7e0 msgr2=0x7f93cc11d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:51.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.632+0000 7f93d098a640 1 --2- 172.21.15.82:0/3353609411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93cc10e7e0 0x7f93cc11d340 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93c401ace0 tx=0x7f93c403d150 comp rx=0 tx=0).stop 2024-03-27T07:28:51.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.633+0000 7f93d098a640 1 -- 172.21.15.82:0/3353609411 shutdown_connections 2024-03-27T07:28:51.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.633+0000 7f93d098a640 1 --2- 172.21.15.82:0/3353609411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93cc10e7e0 0x7f93cc11d340 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.633+0000 7f93d098a640 1 --2- 172.21.15.82:0/3353609411 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93cc10dc30 0x7f93cc10e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.633+0000 7f93d098a640 1 --2- 172.21.15.82:0/3353609411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93cc110160 0x7f93cc110540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.633+0000 7f93d098a640 1 -- 172.21.15.82:0/3353609411 >> 172.21.15.82:0/3353609411 conn(0x7f93cc06ca30 msgr2=0x7f93cc06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:51.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.637+0000 7f93d098a640 1 -- 172.21.15.82:0/3353609411 shutdown_connections 2024-03-27T07:28:51.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.637+0000 7f93d098a640 1 -- 172.21.15.82:0/3353609411 wait complete. 2024-03-27T07:28:51.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.638+0000 7f93d098a640 1 Processor -- start 2024-03-27T07:28:51.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.638+0000 7f93d098a640 1 -- start start 2024-03-27T07:28:51.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.638+0000 7f93d098a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93cc10dc30 0x7f93cc11cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.638+0000 7f93d098a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93cc10e7e0 0x7f93cc119030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.638+0000 7f93d098a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93cc110160 0x7f93cc119570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.638+0000 7f93d098a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1134e0 con 0x7f93cc10e7e0 2024-03-27T07:28:51.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.638+0000 7f93d098a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc113360 con 0x7f93cc10dc30 2024-03-27T07:28:51.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.638+0000 7f93d098a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc113660 con 0x7f93cc110160 2024-03-27T07:28:51.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.639+0000 7f93cad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93cc110160 0x7f93cc119570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:51.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.639+0000 7f93cad9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93cc110160 0x7f93cc119570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:35574/0 (socket says 172.21.15.82:35574) 2024-03-27T07:28:51.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.639+0000 7f93cad9d640 1 -- 172.21.15.82:0/2535900694 learned_addr learned my addr 172.21.15.82:0/2535900694 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:51.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.639+0000 7f93ca59c640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93cc10dc30 0x7f93cc11cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:51.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.639+0000 7f93cad9d640 1 -- 172.21.15.82:0/2535900694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93cc10dc30 msgr2=0x7f93cc11cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:51.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.639+0000 7f93cad9d640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93cc10dc30 0x7f93cc11cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.639+0000 7f93cad9d640 1 -- 172.21.15.82:0/2535900694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93cc10e7e0 msgr2=0x7f93cc119030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:28:51.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.640+0000 7f93cad9d640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93cc10e7e0 0x7f93cc119030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.640+0000 7f93cad9d640 1 -- 172.21.15.82:0/2535900694 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93cc119c70 con 0x7f93cc110160 2024-03-27T07:28:51.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.641+0000 7f93cad9d640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93cc110160 0x7f93cc119570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f93c401ac00 tx=0x7f93c40438c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:51.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.650+0000 7f93c37fe640 1 -- 172.21.15.82:0/2535900694 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c4052020 con 0x7f93cc110160 2024-03-27T07:28:51.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.651+0000 7f93d098a640 1 -- 172.21.15.82:0/2535900694 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93cc1aaef0 con 0x7f93cc110160 2024-03-27T07:28:51.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.651+0000 7f93d098a640 1 -- 172.21.15.82:0/2535900694 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93cc1ab2a0 con 0x7f93cc110160 2024-03-27T07:28:51.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.651+0000 7f93c37fe640 1 -- 172.21.15.82:0/2535900694 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93c40459a0 con 0x7f93cc110160 2024-03-27T07:28:51.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.651+0000 7f93c37fe640 1 -- 172.21.15.82:0/2535900694 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c404a040 con 0x7f93cc110160 2024-03-27T07:28:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.657+0000 7f93d3574740 1 Processor -- start 2024-03-27T07:28:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.658+0000 7f93d3574740 1 -- start start 2024-03-27T07:28:51.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.658+0000 7f93d3574740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644d9470 0x5633644d9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.659+0000 7f93d3574740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644e2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.659+0000 7f93d3574740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644e2970 0x5633644e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.659+0000 7f93ca59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644e2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:51.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.659+0000 7f93ca59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644e2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:35578/0 (socket says 172.21.15.82:35578) 2024-03-27T07:28:51.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.659+0000 7f93ca59c640 1 -- 172.21.15.82:0/3387510709 learned_addr learned my addr 172.21.15.82:0/3387510709 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:51.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.659+0000 7f93d3574740 1 -- 172.21.15.82:0/3387510709 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56336443d860 con 0x5633644d9470 2024-03-27T07:28:51.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.659+0000 7f93d3574740 1 -- 172.21.15.82:0/3387510709 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5633643e58d0 con 0x5633644e2970 2024-03-27T07:28:51.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.659+0000 7f93d3574740 1 -- 172.21.15.82:0/3387510709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563364439810 con 0x5633644d9d90 2024-03-27T07:28:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.660+0000 7f93ca59c640 1 -- 172.21.15.82:0/3387510709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644e2970 msgr2=0x5633644e4d60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:28:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.660+0000 7f93ca59c640 1 --2- 172.21.15.82:0/3387510709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644e2970 0x5633644e4d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.660+0000 7f93ca59c640 1 -- 172.21.15.82:0/3387510709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644d9470 msgr2=0x5633644d9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.660+0000 7f93ca59c640 1 --2- 172.21.15.82:0/3387510709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644d9470 0x5633644d9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.660+0000 7f93ca59c640 1 -- 172.21.15.82:0/3387510709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633643f0120 con 0x5633644d9d90 2024-03-27T07:28:51.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.660+0000 7f93ca59c640 1 --2- 172.21.15.82:0/3387510709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644e2430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00bd10 tx=0x7f93bc0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36437862b61c3094 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:51.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.660+0000 7f93c37fe640 1 -- 172.21.15.82:0/2535900694 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f93c4055020 con 0x7f93cc110160 2024-03-27T07:28:51.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.661+0000 7f93c37fe640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93b80a3980 0x7f93b80a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.662+0000 7f93c37fe640 1 -- 172.21.15.82:0/2535900694 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f93c4103b80 con 0x7f93cc110160 2024-03-27T07:28:51.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.667+0000 7f93c3fff640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93b80a3980 0x7f93b80a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:51.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.670+0000 7f93c3fff640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93b80a3980 0x7f93b80a5e40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5633644d4d30 tx=0x7f93b4006cb0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:51.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.673+0000 7f93c0ff9640 1 -- 172.21.15.82:0/3387510709 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc004030 con 0x5633644d9d90 2024-03-27T07:28:51.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.673+0000 7f93c0ff9640 1 -- 172.21.15.82:0/3387510709 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93bc0041d0 con 0x5633644d9d90 2024-03-27T07:28:51.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.675+0000 7f93d3574740 1 -- 172.21.15.82:0/3387510709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 msgr2=0x5633644e2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:51.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.675+0000 7f93d3574740 1 --2- 172.21.15.82:0/3387510709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644e2430 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00bd10 tx=0x7f93bc0107a0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.677+0000 7f93d3574740 1 -- 172.21.15.82:0/3387510709 shutdown_connections 2024-03-27T07:28:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.677+0000 7f93d3574740 1 --2- 172.21.15.82:0/3387510709 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644e2970 0x5633644e4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.677+0000 7f93d3574740 1 --2- 172.21.15.82:0/3387510709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644e2430 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.677+0000 7f93d3574740 1 --2- 172.21.15.82:0/3387510709 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644d9470 0x5633644d9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.677+0000 7f93d3574740 1 -- 172.21.15.82:0/3387510709 >> 172.21.15.82:0/3387510709 conn(0x5633644d3ba0 msgr2=0x5633644d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.677+0000 7f93d3574740 1 -- 172.21.15.82:0/3387510709 shutdown_connections 2024-03-27T07:28:51.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.678+0000 7f93d3574740 1 -- 172.21.15.82:0/3387510709 wait complete. 2024-03-27T07:28:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.678+0000 7f93d3574740 1 -- start start 2024-03-27T07:28:51.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.678+0000 7f93d3574740 1 Processor -- start 2024-03-27T07:28:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.678+0000 7f93d3574740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9470 0x5633644dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.679+0000 7f93d3574740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9d90 0x5633644e0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.679+0000 7f93d3574740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644e2970 0x5633644e0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.679+0000 7f93d3574740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5633644e57b0 con 0x5633644e2970 2024-03-27T07:28:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.679+0000 7f93d3574740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5633643f8cd0 con 0x5633644d9d90 2024-03-27T07:28:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.679+0000 7f93d3574740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5633644e5930 con 0x5633644d9470 2024-03-27T07:28:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.679+0000 7f93d3574740 10 client.0 _ll_register_callbacks cb 0x5633643eaee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.679+0000 7f93ca59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9470 0x5633644dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.679+0000 7f93ca59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9470 0x5633644dfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:35592/0 (socket says 172.21.15.82:35592) 2024-03-27T07:28:51.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.679+0000 7f93ca59c640 1 -- 172.21.15.82:0/3582492074 learned_addr learned my addr 172.21.15.82:0/3582492074 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:51.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.684+0000 7f93cad9d640 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644e2970 0x5633644e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.684+0000 7f93ca59c640 1 -- 172.21.15.82:0/3582492074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9d90 msgr2=0x5633644e0000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T07:28:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.684+0000 7f93ca59c640 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9d90 0x5633644e0000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.684+0000 7f93ca59c640 1 -- 172.21.15.82:0/3582492074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644e2970 msgr2=0x5633644e0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.684+0000 7f93ca59c640 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644e2970 0x5633644e0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.684+0000 7f93ca59c640 1 -- 172.21.15.82:0/3582492074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56336421b7d0 con 0x5633644d9470 2024-03-27T07:28:51.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.685+0000 7f93ca59c640 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9470 0x5633644dfac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00ba20 tx=0x7f93bc00ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2774e05e3699a0f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:51.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.701+0000 7f93b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:28:51.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.701+0000 7f93b1ffb640 1 -- 172.21.15.82:0/3582492074 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc029060 con 0x5633644d9470 2024-03-27T07:28:51.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.701+0000 7f93d3574740 1 -- 172.21.15.82:0/3582492074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93bc0041d0 con 0x5633644d9470 2024-03-27T07:28:51.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.701+0000 7f93b1ffb640 1 -- 172.21.15.82:0/3582492074 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f93bc011a40 con 0x5633644d9470 2024-03-27T07:28:51.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.702+0000 7f93b1ffb640 1 -- 172.21.15.82:0/3582492074 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f93bc005600 con 0x5633644d9470 2024-03-27T07:28:51.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.703+0000 7f93d3574740 10 client.26569 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:51.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.703+0000 7f93d3574740 1 -- 172.21.15.82:0/3582492074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5633641513f0 con 0x5633644d9470 2024-03-27T07:28:51.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.704+0000 7f93b1ffb640 1 -- 172.21.15.82:0/3582492074 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93bc0041d0 con 0x5633644d9470 2024-03-27T07:28:51.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.704+0000 7f93b1ffb640 1 -- 172.21.15.82:0/3582492074 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f93bc01b760 con 0x5633644d9470 2024-03-27T07:28:51.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.704+0000 7f93d3574740 10 client.26569 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:51.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.704+0000 7f93d3574740 10 client.26569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:51.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.704+0000 7f93d3574740 20 client.26569 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:51.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.704+0000 7f93d3574740 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5633644f31e0 0x5633644f5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:51.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.704+0000 7f93d3574740 4 client.26569 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:51.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.704+0000 7f93d3574740 1 -- 172.21.15.82:0/3582492074 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56336444ada0 con 0x5633644f31e0 2024-03-27T07:28:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.705+0000 7f93c3fff640 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5633644f31e0 0x5633644f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.705+0000 7f93b1ffb640 10 client.26569 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:51.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:51.706+0000 7f93c3fff640 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5633644f31e0 0x5633644f5680 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99f012b5d8faf40e server_cookie=d02f6876f02c7d6f in_seq=0 out_seq=0 2024-03-27T07:28:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93b1ffb640 1 -- 172.21.15.82:0/3582492074 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56336444ada0 con 0x5633644f31e0 2024-03-27T07:28:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93b1ffb640 10 client.26569 handle_command_reply: tid=0 2024-03-27T07:28:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93d3574740 1 client.26569 shutdown 2024-03-27T07:28:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93d3574740 1 -- 172.21.15.82:0/3582492074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9470 msgr2=0x5633644dfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93d3574740 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9470 0x5633644dfac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00ba20 tx=0x7f93bc00ba50 comp rx=0 tx=0).stop 2024-03-27T07:28:52.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93d3574740 1 -- 172.21.15.82:0/3582492074 shutdown_connections 2024-03-27T07:28:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93d3574740 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5633644f31e0 0x5633644f5680 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93d3574740 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644e2970 0x5633644e0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93d3574740 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9d90 0x5633644e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93d3574740 1 --2- 172.21.15.82:0/3582492074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9470 0x5633644dfac0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93d3574740 1 -- 172.21.15.82:0/3582492074 >> 172.21.15.82:0/3582492074 conn(0x5633644d3ba0 msgr2=0x5633644d58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.193+0000 7f93b1ffb640 0 client.26569 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.194+0000 7f93d3574740 1 -- 172.21.15.82:0/3582492074 shutdown_connections 2024-03-27T07:28:52.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.194+0000 7f93d3574740 1 -- 172.21.15.82:0/3582492074 wait complete. 2024-03-27T07:28:52.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.194+0000 7f93d3574740 20 client.26569 trim_cache size 0 max 16384 2024-03-27T07:28:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.299+0000 7fc1d5ffb640 1 -- 172.21.15.82:0/4064022789 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fc1e802c070 con 0x55e9d61430a0 2024-03-27T07:28:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.299+0000 7fc1d5ffb640 10 client.16710 handle_command_reply: tid=0 2024-03-27T07:28:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.304+0000 7fc1f79f5740 1 client.16710 shutdown 2024-03-27T07:28:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.304+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 msgr2=0x55e9d60cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.304+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60cf8b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000efd0 tx=0x7fc1e00a50c0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.304+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 shutdown_connections 2024-03-27T07:28:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.304+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9d60cc980 0x55e9d613b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.304+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9d60c3bb0 0x55e9d60cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.304+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55e9d61430a0 0x55e9d61454c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.304+0000 7fc1f79f5740 1 --2- 172.21.15.82:0/4064022789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9d60c3290 0x55e9d60cf8b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.304+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 >> 172.21.15.82:0/4064022789 conn(0x55e9d60bdbb0 msgr2=0x55e9d60bcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.305+0000 7fc1d5ffb640 0 client.16710 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.315+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 shutdown_connections 2024-03-27T07:28:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.315+0000 7fc1f79f5740 1 -- 172.21.15.82:0/4064022789 wait complete. 2024-03-27T07:28:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.315+0000 7fc1f79f5740 20 client.16710 trim_cache size 0 max 16384 2024-03-27T07:28:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:28:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:28:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:28:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:28:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.328+0000 7fc1f4d35640 1 -- 172.21.15.82:0/78159372 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc1d80a3980 msgr2=0x7fc1d80a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.328+0000 7fc1f4d35640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc1d80a3980 0x7fc1d80a5e40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009fd0 tx=0x7fc1e8009500 comp rx=0 tx=0).stop 2024-03-27T07:28:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.328+0000 7fc1f4d35640 1 -- 172.21.15.82:0/78159372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1f010d2e0 msgr2=0x7fc1f0076f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.328+0000 7fc1f4d35640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1f010d2e0 0x7fc1f0076f50 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000e9e0 tx=0x7fc1e000eea0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.335+0000 7fc1f4d35640 1 -- 172.21.15.82:0/78159372 shutdown_connections 2024-03-27T07:28:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.335+0000 7fc1f4d35640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc1d80a3980 0x7fc1d80a5e40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.335+0000 7fc1f4d35640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1f0079eb0 0x7fc1f00779d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.336+0000 7fc1f4d35640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc1f010def0 0x7fc1f0077490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.336+0000 7fc1f4d35640 1 --2- 172.21.15.82:0/78159372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1f010d2e0 0x7fc1f0076f50 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.336+0000 7fc1f4d35640 1 -- 172.21.15.82:0/78159372 >> 172.21.15.82:0/78159372 conn(0x7fc1f006cad0 msgr2=0x7fc1f0072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.358+0000 7fc1f4d35640 1 -- 172.21.15.82:0/78159372 shutdown_connections 2024-03-27T07:28:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:28:52.359+0000 7fc1f4d35640 1 -- 172.21.15.82:0/78159372 wait complete. 2024-03-27T07:28:52.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.599+0000 7f93d3574740 1 Processor -- start 2024-03-27T07:28:52.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.599+0000 7f93d3574740 1 -- start start 2024-03-27T07:28:52.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.600+0000 7f93d3574740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9470 0x5633644e21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:52.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.600+0000 7f93d3574740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644ee680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:52.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.600+0000 7f93d3574740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644e2970 0x5633644ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:52.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.600+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:52.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.600+0000 7f93ca59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9470 0x5633644e21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:52.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.600+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644ee680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:35594/0 (socket says 172.21.15.82:35594) 2024-03-27T07:28:52.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.600+0000 7f93ca59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9470 0x5633644e21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:41408/0 (socket says 172.21.15.82:41408) 2024-03-27T07:28:52.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93c3fff640 1 -- 172.21.15.82:0/3798166189 learned_addr learned my addr 172.21.15.82:0/3798166189 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:52.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93d3574740 1 -- 172.21.15.82:0/3798166189 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1b6660 con 0x5633644e2970 2024-03-27T07:28:52.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93d3574740 1 -- 172.21.15.82:0/3798166189 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1b3ed0 con 0x5633644d9470 2024-03-27T07:28:52.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93d3574740 1 -- 172.21.15.82:0/3798166189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1b1d20 con 0x5633644d9d90 2024-03-27T07:28:52.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93cad9d640 1 --2- 172.21.15.82:0/3798166189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644e2970 0x5633644ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:52.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93c3fff640 1 -- 172.21.15.82:0/3798166189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9470 msgr2=0x5633644e21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:52.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93c3fff640 1 --2- 172.21.15.82:0/3798166189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9470 0x5633644e21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93c3fff640 1 -- 172.21.15.82:0/3798166189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644e2970 msgr2=0x5633644ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:52.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93c3fff640 1 --2- 172.21.15.82:0/3798166189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644e2970 0x5633644ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93c3fff640 1 -- 172.21.15.82:0/3798166189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633644dea70 con 0x5633644d9d90 2024-03-27T07:28:52.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.601+0000 7f93ca59c640 1 --2- 172.21.15.82:0/3798166189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9470 0x5633644e21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:52.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.602+0000 7f93c3fff640 1 --2- 172.21.15.82:0/3798166189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644ee680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5633644df320 tx=0x7f93b4012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=264b59a720a909da server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:52.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.645+0000 7f93b3fff640 1 -- 172.21.15.82:0/3798166189 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4012a60 con 0x5633644d9d90 2024-03-27T07:28:52.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.645+0000 7f93b3fff640 1 -- 172.21.15.82:0/3798166189 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93b40215d0 con 0x5633644d9d90 2024-03-27T07:28:52.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.645+0000 7f93b3fff640 1 -- 172.21.15.82:0/3798166189 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b401f860 con 0x5633644d9d90 2024-03-27T07:28:52.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.646+0000 7f93d3574740 1 -- 172.21.15.82:0/3798166189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 msgr2=0x5633644ee680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:52.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.647+0000 7f93d3574740 1 --2- 172.21.15.82:0/3798166189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644ee680 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5633644df320 tx=0x7f93b4012000 comp rx=0 tx=0).stop 2024-03-27T07:28:52.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.647+0000 7f93d3574740 1 -- 172.21.15.82:0/3798166189 shutdown_connections 2024-03-27T07:28:52.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.647+0000 7f93d3574740 1 --2- 172.21.15.82:0/3798166189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644e2970 0x5633644ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.647+0000 7f93d3574740 1 --2- 172.21.15.82:0/3798166189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644ee680 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.647+0000 7f93d3574740 1 --2- 172.21.15.82:0/3798166189 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644d9470 0x5633644e21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.647+0000 7f93d3574740 1 -- 172.21.15.82:0/3798166189 >> 172.21.15.82:0/3798166189 conn(0x5633644d3ba0 msgr2=0x5633644d4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:52.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.647+0000 7f93d3574740 1 -- 172.21.15.82:0/3798166189 shutdown_connections 2024-03-27T07:28:52.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.647+0000 7f93d3574740 1 -- 172.21.15.82:0/3798166189 wait complete. 2024-03-27T07:28:52.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.648+0000 7f93d3574740 1 -- start start 2024-03-27T07:28:52.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.648+0000 7f93d3574740 1 Processor -- start 2024-03-27T07:28:52.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.649+0000 7f93d3574740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644d9470 0x5633644eb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:52.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.649+0000 7f93d3574740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644dc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:52.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.649+0000 7f93d3574740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644e2970 0x5633644dcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:52.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.649+0000 7f93d3574740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1b2390 con 0x5633644d9470 2024-03-27T07:28:52.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.649+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644dc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:52.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93d3574740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1b3800 con 0x5633644e2970 2024-03-27T07:28:52.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93d3574740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f93cc1b2a60 con 0x5633644d9d90 2024-03-27T07:28:52.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93c3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644dc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:35606/0 (socket says 172.21.15.82:35606) 2024-03-27T07:28:52.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93c3fff640 1 -- 172.21.15.82:0/1980758612 learned_addr learned my addr 172.21.15.82:0/1980758612 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:52.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93d3574740 10 client.0 _ll_register_callbacks cb 0x7f93bc00bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:52.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93cad9d640 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644e2970 0x5633644dcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:52.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93ca59c640 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644d9470 0x5633644eb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:52.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93c3fff640 1 -- 172.21.15.82:0/1980758612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644e2970 msgr2=0x5633644dcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:52.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93c3fff640 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644e2970 0x5633644dcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93c3fff640 1 -- 172.21.15.82:0/1980758612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644d9470 msgr2=0x5633644eb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:52.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93c3fff640 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644d9470 0x5633644eb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93c3fff640 1 -- 172.21.15.82:0/1980758612 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633644cf280 con 0x5633644d9d90 2024-03-27T07:28:52.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93ca59c640 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644d9470 0x5633644eb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:28:52.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.650+0000 7f93c3fff640 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644dc4d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5633644df5f0 tx=0x7f93b4012a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d789a3d23ca17fed server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:52.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.678+0000 7f93b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:28:52.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.679+0000 7f93b1ffb640 1 -- 172.21.15.82:0/1980758612 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4032430 con 0x5633644d9d90 2024-03-27T07:28:52.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.679+0000 7f93b1ffb640 1 -- 172.21.15.82:0/1980758612 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f93b40325d0 con 0x5633644d9d90 2024-03-27T07:28:52.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.679+0000 7f93d3574740 1 -- 172.21.15.82:0/1980758612 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93b40215d0 con 0x5633644d9d90 2024-03-27T07:28:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.689+0000 7f93b1ffb640 1 -- 172.21.15.82:0/1980758612 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f93b4005a50 con 0x5633644d9d90 2024-03-27T07:28:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.689+0000 7f93d3574740 10 client.26575 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.689+0000 7f93d3574740 1 -- 172.21.15.82:0/1980758612 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5633644e50d0 con 0x5633644d9d90 2024-03-27T07:28:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.690+0000 7f93b1ffb640 1 -- 172.21.15.82:0/1980758612 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93b4032cf0 con 0x5633644d9d90 2024-03-27T07:28:52.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.690+0000 7f93b1ffb640 1 -- 172.21.15.82:0/1980758612 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f93b4012070 con 0x5633644d9d90 2024-03-27T07:28:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.691+0000 7f93d3574740 10 client.26575 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.691+0000 7f93d3574740 10 client.26575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.691+0000 7f93d3574740 20 client.26575 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.691+0000 7f93d3574740 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563364559900 0x56336455bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.692+0000 7f93d3574740 4 client.26575 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T07:28:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.692+0000 7f93d3574740 1 -- 172.21.15.82:0/1980758612 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f93b40215d0 con 0x563364559900 2024-03-27T07:28:52.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.692+0000 7f93ca59c640 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563364559900 0x56336455bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:52.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.692+0000 7f93ca59c640 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563364559900 0x56336455bd20 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=493dde35d498edb0 server_cookie=80a6a9c1790d244b in_seq=0 out_seq=0 2024-03-27T07:28:52.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.692+0000 7f93b1ffb640 10 client.26575 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:52.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.700+0000 7f93b1ffb640 1 -- 172.21.15.82:0/1980758612 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f93b40215d0 con 0x563364559900 2024-03-27T07:28:52.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.700+0000 7f93b1ffb640 10 client.26575 handle_command_reply: tid=0 2024-03-27T07:28:52.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.700+0000 7f93d3574740 1 client.26575 shutdown 2024-03-27T07:28:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.700+0000 7f93d3574740 1 -- 172.21.15.82:0/1980758612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 msgr2=0x5633644dc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.700+0000 7f93d3574740 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644dc4d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5633644df5f0 tx=0x7f93b4012a90 comp rx=0 tx=0).stop 2024-03-27T07:28:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.700+0000 7f93d3574740 1 -- 172.21.15.82:0/1980758612 shutdown_connections 2024-03-27T07:28:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.701+0000 7f93d3574740 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5633644e2970 0x5633644dcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.701+0000 7f93d3574740 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5633644d9d90 0x5633644dc4d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.701+0000 7f93d3574740 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563364559900 0x56336455bd20 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.701+0000 7f93d3574740 1 --2- 172.21.15.82:0/1980758612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633644d9470 0x5633644eb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.701+0000 7f93d3574740 1 -- 172.21.15.82:0/1980758612 >> 172.21.15.82:0/1980758612 conn(0x5633644d3ba0 msgr2=0x5633644d5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.701+0000 7f93b1ffb640 0 client.26575 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.701+0000 7f93d3574740 1 -- 172.21.15.82:0/1980758612 shutdown_connections 2024-03-27T07:28:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.701+0000 7f93d3574740 1 -- 172.21.15.82:0/1980758612 wait complete. 2024-03-27T07:28:52.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.701+0000 7f93d3574740 20 client.26575 trim_cache size 0 max 16384 2024-03-27T07:28:52.706 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:28:52.706 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-03-27T07:28:52.706 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-03-27T07:28:52.706 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:28:52.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.725+0000 7f93d098a640 1 -- 172.21.15.82:0/2535900694 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93b80a3980 msgr2=0x7f93b80a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:52.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.725+0000 7f93d098a640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93b80a3980 0x7f93b80a5e40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5633644d4d30 tx=0x7f93b4006cb0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.728+0000 7f93d098a640 1 -- 172.21.15.82:0/2535900694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93cc110160 msgr2=0x7f93cc119570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:52.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.729+0000 7f93d098a640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93cc110160 0x7f93cc119570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f93c401ac00 tx=0x7f93c40438c0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.729+0000 7f93d098a640 1 -- 172.21.15.82:0/2535900694 shutdown_connections 2024-03-27T07:28:52.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.729+0000 7f93d098a640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f93b80a3980 0x7f93b80a5e40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.729+0000 7f93d098a640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93cc10e7e0 0x7f93cc119030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.729+0000 7f93d098a640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93cc110160 0x7f93cc119570 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.729+0000 7f93d098a640 1 --2- 172.21.15.82:0/2535900694 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f93cc10dc30 0x7f93cc11cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:52.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.729+0000 7f93d098a640 1 -- 172.21.15.82:0/2535900694 >> 172.21.15.82:0/2535900694 conn(0x7f93cc06ca30 msgr2=0x7f93cc070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:52.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.729+0000 7f93d098a640 1 -- 172.21.15.82:0/2535900694 shutdown_connections 2024-03-27T07:28:52.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:52.729+0000 7f93d098a640 1 -- 172.21.15.82:0/2535900694 wait complete. 2024-03-27T07:28:52.871 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T07:28:52.872 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:28:53.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:52 smithi149 ceph-mon[36065]: pgmap v161: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 339 op/s 2024-03-27T07:28:53.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:52 smithi153 ceph-mon[36179]: pgmap v161: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 339 op/s 2024-03-27T07:28:53.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:52 smithi082 ceph-mon[32178]: pgmap v161: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 339 op/s 2024-03-27T07:28:54.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:53 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:28:54.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:53 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:28:54.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:53 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:28:54.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:53 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:28:54.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:53 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:28:54.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:53 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:28:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:53 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:28:54.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:53 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:28:54.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:53 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:28:54.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.822+0000 7f338719a640 1 -- 172.21.15.82:0/4171218702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338010dc30 msgr2=0x7f338010e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:54.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.822+0000 7f338719a640 1 --2- 172.21.15.82:0/4171218702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338010dc30 0x7f338010e0b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3370009860 tx=0x7f337002bb90 comp rx=0 tx=0).stop 2024-03-27T07:28:54.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.829+0000 7f338719a640 1 -- 172.21.15.82:0/4171218702 shutdown_connections 2024-03-27T07:28:54.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.829+0000 7f338719a640 1 --2- 172.21.15.82:0/4171218702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f338010e750 0x7f338011d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:54.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.829+0000 7f338719a640 1 --2- 172.21.15.82:0/4171218702 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338010dc30 0x7f338010e0b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:54.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.829+0000 7f338719a640 1 --2- 172.21.15.82:0/4171218702 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f33801100d0 0x7f33801104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:54.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.829+0000 7f338719a640 1 -- 172.21.15.82:0/4171218702 >> 172.21.15.82:0/4171218702 conn(0x7f338006ca60 msgr2=0x7f338006ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.833+0000 7f338719a640 1 -- 172.21.15.82:0/4171218702 shutdown_connections 2024-03-27T07:28:54.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.833+0000 7f338719a640 1 -- 172.21.15.82:0/4171218702 wait complete. 2024-03-27T07:28:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f338719a640 1 Processor -- start 2024-03-27T07:28:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f338719a640 1 -- start start 2024-03-27T07:28:54.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f338719a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338010dc30 0x7f33801a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f338719a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f338010e750 0x7f33801a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f338719a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33801100d0 0x7f33801ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f338719a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3380120b90 con 0x7f33801100d0 2024-03-27T07:28:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f338719a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3380120a10 con 0x7f338010e750 2024-03-27T07:28:54.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f338719a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3380120d10 con 0x7f338010dc30 2024-03-27T07:28:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f3384f36640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338010dc30 0x7f33801a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f3384f36640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338010dc30 0x7f33801a7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:35626/0 (socket says 172.21.15.82:35626) 2024-03-27T07:28:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f3384f36640 1 -- 172.21.15.82:0/2680568551 learned_addr learned my addr 172.21.15.82:0/2680568551 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f3385737640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33801100d0 0x7f33801ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.834+0000 7f337ffff640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f338010e750 0x7f33801a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.835+0000 7f3384f36640 1 -- 172.21.15.82:0/2680568551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f338010e750 msgr2=0x7f33801a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.835+0000 7f3384f36640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f338010e750 0x7f33801a75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:54.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.835+0000 7f3384f36640 1 -- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33801100d0 msgr2=0x7f33801ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.835+0000 7f3384f36640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33801100d0 0x7f33801ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.835+0000 7f3384f36640 1 -- 172.21.15.82:0/2680568551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33801ac080 con 0x7f338010dc30 2024-03-27T07:28:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.835+0000 7f3385737640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33801100d0 0x7f33801ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:54.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.835+0000 7f3384f36640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338010dc30 0x7f33801a7090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f337400e9f0 tx=0x7f337400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:54.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.867+0000 7f337dffb640 1 -- 172.21.15.82:0/2680568551 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337400cd80 con 0x7f338010dc30 2024-03-27T07:28:54.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.867+0000 7f337dffb640 1 -- 172.21.15.82:0/2680568551 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3374010910 con 0x7f338010dc30 2024-03-27T07:28:54.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.867+0000 7f338719a640 1 -- 172.21.15.82:0/2680568551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33801ac370 con 0x7f338010dc30 2024-03-27T07:28:54.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.867+0000 7f337dffb640 1 -- 172.21.15.82:0/2680568551 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374018990 con 0x7f338010dc30 2024-03-27T07:28:54.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.868+0000 7f338719a640 1 -- 172.21.15.82:0/2680568551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33801b3c00 con 0x7f338010dc30 2024-03-27T07:28:54.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.876+0000 7f337dffb640 1 -- 172.21.15.82:0/2680568551 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f3374010ac0 con 0x7f338010dc30 2024-03-27T07:28:54.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.877+0000 7f337dffb640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33680a3980 0x7f33680a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:54.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.877+0000 7f337ffff640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33680a3980 0x7f33680a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:54.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.878+0000 7f337ffff640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33680a3980 0x7f33680a5e40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f337002c1a0 tx=0x7f3370000bc0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:54.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.879+0000 7f337dffb640 1 -- 172.21.15.82:0/2680568551 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f33740d02b0 con 0x7f338010dc30 2024-03-27T07:28:54.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.883+0000 7f338719a640 1 -- 172.21.15.82:0/2680568551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3380068860 con 0x7f338010dc30 2024-03-27T07:28:54.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:54.889+0000 7f337dffb640 1 -- 172.21.15.82:0/2680568551 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f337409c4e0 con 0x7f338010dc30 2024-03-27T07:28:55.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:54 smithi149 ceph-mon[36065]: pgmap v162: 97 pgs: 97 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-03-27T07:28:55.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:54 smithi153 ceph-mon[36179]: pgmap v162: 97 pgs: 97 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-03-27T07:28:55.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:54 smithi082 ceph-mon[32178]: pgmap v162: 97 pgs: 97 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-03-27T07:28:55.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.772+0000 7f338719a640 1 -- 172.21.15.82:0/2680568551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33801b3dd0 con 0x7f338010dc30 2024-03-27T07:28:55.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.772+0000 7f337dffb640 1 -- 172.21.15.82:0/2680568551 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11870 (secure 0 0 0) 0x7f33740d0070 con 0x7f338010dc30 2024-03-27T07:28:55.775 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:28:55.775 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:28:25.587725+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1290254754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1290254754},{"type":"v1","addr":"172.21.15.153:6837","nonce":1290254754}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":108,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":108,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:28:55.775 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2024-03-27T07:28:55.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 -- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33680a3980 msgr2=0x7f33680a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33680a3980 0x7f33680a5e40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f337002c1a0 tx=0x7f3370000bc0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 -- 172.21.15.82:0/2680568551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338010dc30 msgr2=0x7f33801a7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338010dc30 0x7f33801a7090 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f337400e9f0 tx=0x7f337400eeb0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 -- 172.21.15.82:0/2680568551 shutdown_connections 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f33680a3980 0x7f33680a5e40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33801100d0 0x7f33801ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f338010e750 0x7f33801a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 --2- 172.21.15.82:0/2680568551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f338010dc30 0x7f33801a7090 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 -- 172.21.15.82:0/2680568551 >> 172.21.15.82:0/2680568551 conn(0x7f338006ca60 msgr2=0x7f3380070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 -- 172.21.15.82:0/2680568551 shutdown_connections 2024-03-27T07:28:55.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.775+0000 7f338719a640 1 -- 172.21.15.82:0/2680568551 wait complete. 2024-03-27T07:28:55.790 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T07:28:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 -- 172.21.15.82:0/3218146337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f723c105a20 msgr2=0x7f723c105e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 --2- 172.21.15.82:0/3218146337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f723c105a20 0x7f723c105e00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f722c009900 tx=0x7f722c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:28:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 -- 172.21.15.82:0/3218146337 shutdown_connections 2024-03-27T07:28:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 --2- 172.21.15.82:0/3218146337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c101ac0 0x7f723c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 --2- 172.21.15.82:0/3218146337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c101100 0x7f723c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 --2- 172.21.15.82:0/3218146337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f723c105a20 0x7f723c105e00 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 -- 172.21.15.82:0/3218146337 >> 172.21.15.82:0/3218146337 conn(0x7f723c076f70 msgr2=0x7f723c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:55.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 -- 172.21.15.82:0/3218146337 shutdown_connections 2024-03-27T07:28:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 -- 172.21.15.82:0/3218146337 wait complete. 2024-03-27T07:28:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 Processor -- start 2024-03-27T07:28:55.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.904+0000 7f7242383640 1 -- start start 2024-03-27T07:28:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7242383640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f723c101100 0x7f723c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7242383640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c101ac0 0x7f723c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7242383640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c105a20 0x7f723c19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7242383640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f723c110dd0 con 0x7f723c101100 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7242383640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f723c110c50 con 0x7f723c101ac0 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7242383640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f723c110f50 con 0x7f723c105a20 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f723bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f723c101100 0x7f723c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7240920640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c105a20 0x7f723c19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f723bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f723c101100 0x7f723c198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48526/0 (socket says 172.21.15.82:48526) 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f723bfff640 1 -- 172.21.15.82:0/3758022999 learned_addr learned my addr 172.21.15.82:0/3758022999 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f723b7fe640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c101ac0 0x7f723c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7240920640 1 -- 172.21.15.82:0/3758022999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c101ac0 msgr2=0x7f723c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7240920640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c101ac0 0x7f723c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7240920640 1 -- 172.21.15.82:0/3758022999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f723c101100 msgr2=0x7f723c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:55.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7240920640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f723c101100 0x7f723c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.905+0000 7f7240920640 1 -- 172.21.15.82:0/3758022999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723c19d320 con 0x7f723c105a20 2024-03-27T07:28:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.906+0000 7f7240920640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c105a20 0x7f723c19cbf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7234009fd0 tx=0x7f723400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.906+0000 7f72397fa640 1 -- 172.21.15.82:0/3758022999 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723400ce20 con 0x7f723c105a20 2024-03-27T07:28:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.906+0000 7f7242383640 1 -- 172.21.15.82:0/3758022999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723c19d610 con 0x7f723c105a20 2024-03-27T07:28:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.906+0000 7f7242383640 1 -- 172.21.15.82:0/3758022999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723c1a4ea0 con 0x7f723c105a20 2024-03-27T07:28:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.906+0000 7f72397fa640 1 -- 172.21.15.82:0/3758022999 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7234010430 con 0x7f723c105a20 2024-03-27T07:28:55.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.906+0000 7f72397fa640 1 -- 172.21.15.82:0/3758022999 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f723400f620 con 0x7f723c105a20 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.908+0000 7f72397fa640 1 -- 172.21.15.82:0/3758022999 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f723400f7c0 con 0x7f723c105a20 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.908+0000 7f7244f68740 1 Processor -- start 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.908+0000 7f7244f68740 1 -- start start 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.908+0000 7f7244f68740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e930084b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.908+0000 7f7244f68740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e93008d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.908+0000 7f7244f68740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 0x55e9300900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.908+0000 7f7244f68740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e92ffe8710 con 0x55e93008dcb0 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.908+0000 7f7244f68740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e92ff90af0 con 0x55e9300847b0 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.908+0000 7f7244f68740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e92ffe46c0 con 0x55e9300850d0 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e93008d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 0x55e9300900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e93008d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:35640/0 (socket says 172.21.15.82:35640) 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723bfff640 1 -- 172.21.15.82:0/328100860 learned_addr learned my addr 172.21.15.82:0/328100860 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723b7fe640 1 --2- 172.21.15.82:0/328100860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e930084b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723bfff640 1 -- 172.21.15.82:0/328100860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 msgr2=0x55e930084b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723bfff640 1 --2- 172.21.15.82:0/328100860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e930084b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723bfff640 1 -- 172.21.15.82:0/328100860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 msgr2=0x55e9300900a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723bfff640 1 --2- 172.21.15.82:0/328100860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 0x55e9300900a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723bfff640 1 -- 172.21.15.82:0/328100860 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e92fcfc3f0 con 0x55e9300850d0 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723b7fe640 1 --2- 172.21.15.82:0/328100860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 0x55e9300900a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f72397fa640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f72240a3780 0x7f72240a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723b7fe640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f72240a3780 0x7f72240a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f723bfff640 1 --2- 172.21.15.82:0/328100860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e93008d770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f722c036040 tx=0x7f722c009560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20c9a39e2903ca9a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:55.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f72397fa640 1 -- 172.21.15.82:0/3758022999 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f72340d0410 con 0x7f723c105a20 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f72227fc640 1 -- 172.21.15.82:0/328100860 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c042070 con 0x55e9300850d0 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f72227fc640 1 -- 172.21.15.82:0/328100860 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722c02c8b0 con 0x55e9300850d0 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.909+0000 7f72227fc640 1 -- 172.21.15.82:0/328100860 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722c004ee0 con 0x55e9300850d0 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.910+0000 7f7244f68740 1 -- 172.21.15.82:0/328100860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 msgr2=0x55e93008d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.910+0000 7f7244f68740 1 --2- 172.21.15.82:0/328100860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e93008d770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f722c036040 tx=0x7f722c009560 comp rx=0 tx=0).stop 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.910+0000 7f723b7fe640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f72240a3780 0x7f72240a5c40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55e930080070 tx=0x7f72300096c0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.910+0000 7f7244f68740 1 -- 172.21.15.82:0/328100860 shutdown_connections 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.910+0000 7f7244f68740 1 --2- 172.21.15.82:0/328100860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 0x55e9300900a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.910+0000 7f7244f68740 1 --2- 172.21.15.82:0/328100860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e93008d770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.910+0000 7f7244f68740 1 --2- 172.21.15.82:0/328100860 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e930084b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.910+0000 7f7244f68740 1 -- 172.21.15.82:0/328100860 >> 172.21.15.82:0/328100860 conn(0x55e93007eee0 msgr2=0x55e93007f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.910+0000 7f7244f68740 1 -- 172.21.15.82:0/328100860 shutdown_connections 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.910+0000 7f7244f68740 1 -- 172.21.15.82:0/328100860 wait complete. 2024-03-27T07:28:55.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f7244f68740 1 -- start start 2024-03-27T07:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f7244f68740 1 Processor -- start 2024-03-27T07:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f7244f68740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e93008ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f7244f68740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300850d0 0x55e93008b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f7244f68740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 0x55e93008b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f7244f68740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e930090a40 con 0x55e9300850d0 2024-03-27T07:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f7244f68740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55e92ffa3eb0 con 0x55e9300847b0 2024-03-27T07:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f7244f68740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55e930090bc0 con 0x55e93008dcb0 2024-03-27T07:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f7244f68740 10 client.0 _ll_register_callbacks cb 0x55e92ffe06a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300850d0 0x55e93008b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300850d0 0x55e93008b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48544/0 (socket says 172.21.15.82:48544) 2024-03-27T07:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f723b7fe640 1 -- 172.21.15.82:0/1023736103 learned_addr learned my addr 172.21.15.82:0/1023736103 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f723bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e93008ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.911+0000 7f7240920640 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 0x55e93008b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f723b7fe640 1 -- 172.21.15.82:0/1023736103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 msgr2=0x55e93008b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f723b7fe640 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 0x55e93008b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f723b7fe640 1 -- 172.21.15.82:0/1023736103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 msgr2=0x55e93008ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f723b7fe640 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e93008ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f723b7fe640 1 -- 172.21.15.82:0/1023736103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e92fdc67d0 con 0x55e9300850d0 2024-03-27T07:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f723bfff640 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e93008ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f723b7fe640 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300850d0 0x55e93008b220 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7230011aa0 tx=0x7f7230004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6721d3e99f397007 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f721b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f721b7fe640 1 -- 172.21.15.82:0/1023736103 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230005020 con 0x55e9300850d0 2024-03-27T07:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f721b7fe640 1 -- 172.21.15.82:0/1023736103 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f72300051c0 con 0x55e9300850d0 2024-03-27T07:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f7244f68740 1 -- 172.21.15.82:0/1023736103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f722c02c8b0 con 0x55e9300850d0 2024-03-27T07:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f721b7fe640 1 -- 172.21.15.82:0/1023736103 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f72300053c0 con 0x55e9300850d0 2024-03-27T07:28:55.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f7244f68740 10 client.16737 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:55.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.912+0000 7f7244f68740 1 -- 172.21.15.82:0/1023736103 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e93009cd40 con 0x55e9300850d0 2024-03-27T07:28:55.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.913+0000 7f721b7fe640 1 -- 172.21.15.82:0/1023736103 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f722c02c8b0 con 0x55e9300850d0 2024-03-27T07:28:55.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.913+0000 7f721b7fe640 1 -- 172.21.15.82:0/1023736103 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7230027030 con 0x55e9300850d0 2024-03-27T07:28:55.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.913+0000 7f7244f68740 10 client.16737 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:55.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.913+0000 7f7244f68740 10 client.16737 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:28:55.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.913+0000 7f7244f68740 20 client.16737 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:55.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.913+0000 7f7244f68740 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e93009e2a0 0x55e9300a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.913+0000 7f7244f68740 4 client.16737 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:55.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.913+0000 7f7244f68740 1 -- 172.21.15.82:0/1023736103 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e92fff5c50 con 0x55e93009e2a0 2024-03-27T07:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.913+0000 7f723bfff640 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e93009e2a0 0x55e9300a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.914+0000 7f721b7fe640 10 client.16737 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:28:55.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.914+0000 7f723bfff640 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e93009e2a0 0x55e9300a06f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d3c5177a91ffe29f server_cookie=f568766164c9ea8c in_seq=0 out_seq=0 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f721b7fe640 1 -- 172.21.15.82:0/1023736103 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e92fff5c50 con 0x55e93009e2a0 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f721b7fe640 10 client.16737 handle_command_reply: tid=0 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 client.16737 shutdown 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 -- 172.21.15.82:0/1023736103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300850d0 msgr2=0x55e93008b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300850d0 0x55e93008b220 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7230011aa0 tx=0x7f7230004730 comp rx=0 tx=0).stop 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 -- 172.21.15.82:0/1023736103 shutdown_connections 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e93009e2a0 0x55e9300a06f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f721b7fe640 0 client.16737 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300850d0 0x55e93008b220 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 0x55e93008b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 --2- 172.21.15.82:0/1023736103 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e93008ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 -- 172.21.15.82:0/1023736103 >> 172.21.15.82:0/1023736103 conn(0x55e93007eee0 msgr2=0x55e930080c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:55.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 -- 172.21.15.82:0/1023736103 shutdown_connections 2024-03-27T07:28:55.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 1 -- 172.21.15.82:0/1023736103 wait complete. 2024-03-27T07:28:55.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.921+0000 7f7244f68740 20 client.16737 trim_cache size 0 max 16384 2024-03-27T07:28:55.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f7244f68740 1 Processor -- start 2024-03-27T07:28:55.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f7244f68740 1 -- start start 2024-03-27T07:28:55.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f7244f68740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300847b0 0x55e930099840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f7244f68740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300850d0 0x55e9300a6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f7244f68740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 0x55e9300895d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f7244f68740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1aff50 con 0x55e9300847b0 2024-03-27T07:28:55.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f7244f68740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1ad7c0 con 0x55e9300850d0 2024-03-27T07:28:55.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f7244f68740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1ab610 con 0x55e93008dcb0 2024-03-27T07:28:55.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f723bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300847b0 0x55e930099840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300850d0 0x55e9300a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300850d0 0x55e9300a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:41492/0 (socket says 172.21.15.82:41492) 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f723b7fe640 1 -- 172.21.15.82:0/2468650185 learned_addr learned my addr 172.21.15.82:0/2468650185 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.949+0000 7f7240920640 1 --2- 172.21.15.82:0/2468650185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 0x55e9300895d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.950+0000 7f7240920640 1 -- 172.21.15.82:0/2468650185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300850d0 msgr2=0x55e9300a6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.950+0000 7f7240920640 1 --2- 172.21.15.82:0/2468650185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300850d0 0x55e9300a6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.950+0000 7f7240920640 1 -- 172.21.15.82:0/2468650185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300847b0 msgr2=0x55e930099840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.950+0000 7f7240920640 1 --2- 172.21.15.82:0/2468650185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300847b0 0x55e930099840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.950+0000 7f7240920640 1 -- 172.21.15.82:0/2468650185 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e930099d80 con 0x55e93008dcb0 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.950+0000 7f723b7fe640 1 --2- 172.21.15.82:0/2468650185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300850d0 0x55e9300a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.950+0000 7f7240920640 1 --2- 172.21.15.82:0/2468650185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 0x55e9300895d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f72340cdbb0 tx=0x7f723409cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26dc42aaf1c97197 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.950+0000 7f7221ffb640 1 -- 172.21.15.82:0/2468650185 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72340b4030 con 0x55e93008dcb0 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.950+0000 7f7221ffb640 1 -- 172.21.15.82:0/2468650185 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72340a5260 con 0x55e93008dcb0 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.950+0000 7f7221ffb640 1 -- 172.21.15.82:0/2468650185 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7234010950 con 0x55e93008dcb0 2024-03-27T07:28:55.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.951+0000 7f7244f68740 1 -- 172.21.15.82:0/2468650185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 msgr2=0x55e9300895d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.951+0000 7f7244f68740 1 --2- 172.21.15.82:0/2468650185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 0x55e9300895d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f72340cdbb0 tx=0x7f723409cdb0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.951+0000 7f7244f68740 1 -- 172.21.15.82:0/2468650185 shutdown_connections 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.951+0000 7f7244f68740 1 --2- 172.21.15.82:0/2468650185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e93008dcb0 0x55e9300895d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.951+0000 7f7244f68740 1 --2- 172.21.15.82:0/2468650185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300850d0 0x55e9300a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.951+0000 7f7244f68740 1 --2- 172.21.15.82:0/2468650185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e9300847b0 0x55e930099840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.951+0000 7f7244f68740 1 -- 172.21.15.82:0/2468650185 >> 172.21.15.82:0/2468650185 conn(0x55e93007eee0 msgr2=0x55e930079e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.951+0000 7f7244f68740 1 -- 172.21.15.82:0/2468650185 shutdown_connections 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.951+0000 7f7244f68740 1 -- 172.21.15.82:0/2468650185 wait complete. 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.952+0000 7f7244f68740 1 -- start start 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.952+0000 7f7244f68740 1 Processor -- start 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f7244f68740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e930088550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f7244f68740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e930086f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f7244f68740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 0x55e9300874b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f7244f68740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1abc80 con 0x55e93008dcb0 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f7244f68740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1ad0f0 con 0x55e9300847b0 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f7244f68740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f723c1ac350 con 0x55e9300850d0 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f7244f68740 10 client.0 _ll_register_callbacks cb 0x7f7230003f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e930086f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f723bfff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e930088550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f723b7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e930086f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:35668/0 (socket says 172.21.15.82:35668) 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f723b7fe640 1 -- 172.21.15.82:0/3438526671 learned_addr learned my addr 172.21.15.82:0/3438526671 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f7240920640 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 0x55e9300874b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f723b7fe640 1 -- 172.21.15.82:0/3438526671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 msgr2=0x55e930088550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:55.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f723b7fe640 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e930088550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f723b7fe640 1 -- 172.21.15.82:0/3438526671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 msgr2=0x55e9300874b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:55.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f723b7fe640 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 0x55e9300874b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f723b7fe640 1 -- 172.21.15.82:0/3438526671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e930096340 con 0x55e9300850d0 2024-03-27T07:28:55.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.953+0000 7f723bfff640 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e930088550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:55.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f723b7fe640 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e930086f70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7230009730 tx=0x7f7230009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68de1a21f794a7a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:55.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f721b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:28:55.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f721b7fe640 1 -- 172.21.15.82:0/3438526671 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7230032670 con 0x55e9300850d0 2024-03-27T07:28:55.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f721b7fe640 1 -- 172.21.15.82:0/3438526671 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f7230032810 con 0x55e9300850d0 2024-03-27T07:28:55.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f7244f68740 1 -- 172.21.15.82:0/3438526671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72340a5260 con 0x55e9300850d0 2024-03-27T07:28:55.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f721b7fe640 1 -- 172.21.15.82:0/3438526671 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7230042050 con 0x55e9300850d0 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f7244f68740 10 client.26599 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f7244f68740 1 -- 172.21.15.82:0/3438526671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e930103e50 con 0x55e9300850d0 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f721b7fe640 1 -- 172.21.15.82:0/3438526671 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72340a5260 con 0x55e9300850d0 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f721b7fe640 1 -- 172.21.15.82:0/3438526671 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f7230039070 con 0x55e9300850d0 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f7244f68740 10 client.26599 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f7244f68740 10 client.26599 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f7244f68740 20 client.26599 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.954+0000 7f7244f68740 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e93009e2a0 0x55e9301065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.955+0000 7f7244f68740 4 client.26599 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.955+0000 7f7244f68740 1 -- 172.21.15.82:0/3438526671 --> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e92ffeffa0 con 0x55e93009e2a0 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.955+0000 7f723bfff640 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e93009e2a0 0x55e9301065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.955+0000 7f721b7fe640 10 client.26599 ms_handle_connect on v2:172.21.15.149:6836/4121570293 2024-03-27T07:28:55.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.956+0000 7f723bfff640 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e93009e2a0 0x55e9301065b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=efba840c3d801781 server_cookie=942592030c96215f in_seq=0 out_seq=0 2024-03-27T07:28:55.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.965+0000 7f721b7fe640 1 -- 172.21.15.82:0/3438526671 <== mds.2 v2:172.21.15.149:6836/4121570293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325590 (crc 0 0 0) 0x55e92ffeffa0 con 0x55e93009e2a0 2024-03-27T07:28:55.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.965+0000 7f721b7fe640 10 client.26599 handle_command_reply: tid=0 2024-03-27T07:28:55.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 client.26599 shutdown 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 -- 172.21.15.82:0/3438526671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 msgr2=0x55e930086f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e930086f70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7230009730 tx=0x7f7230009f30 comp rx=0 tx=0).stop 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 -- 172.21.15.82:0/3438526671 shutdown_connections 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.149:6836/4121570293,v1:172.21.15.149:6837/4121570293] conn(0x55e93009e2a0 0x55e9301065b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e93008dcb0 0x55e9300874b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f721b7fe640 0 client.26599 ms_handle_reset on v2:172.21.15.149:6836/4121570293 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55e9300850d0 0x55e930086f70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 --2- 172.21.15.82:0/3438526671 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55e9300847b0 0x55e930088550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 -- 172.21.15.82:0/3438526671 >> 172.21.15.82:0/3438526671 conn(0x55e93007eee0 msgr2=0x55e930089440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 -- 172.21.15.82:0/3438526671 shutdown_connections 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 1 -- 172.21.15.82:0/3438526671 wait complete. 2024-03-27T07:28:55.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.966+0000 7f7244f68740 20 client.26599 trim_cache size 0 max 16384 2024-03-27T07:28:55.975 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-03-27T07:28:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.975 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1854940, 2024-03-27T07:28:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629902, 2024-03-27T07:28:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml" 2024-03-27T07:28:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2448752, 2024-03-27T07:28:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629826, 2024-03-27T07:28:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-45.xml" 2024-03-27T07:28:55.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3549982, 2024-03-27T07:28:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631411, 2024-03-27T07:28:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-72.xml" 2024-03-27T07:28:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 13870685, 2024-03-27T07:28:55.977 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634317, 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-12.xml" 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 14042424, 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259392, 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-63.jpg" 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 14255934, 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636693, 2024-03-27T07:28:55.978 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-63.xml" 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 16900142, 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636834, 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-46.xml" 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 18037175, 2024-03-27T07:28:55.979 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634964, 2024-03-27T07:28:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-44.jpg" 2024-03-27T07:28:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 21816106, 2024-03-27T07:28:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634893, 2024-03-27T07:28:55.980 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-58.jpg" 2024-03-27T07:28:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 21948318, 2024-03-27T07:28:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265129, 2024-03-27T07:28:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-23.jpg" 2024-03-27T07:28:55.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 29402463, 2024-03-27T07:28:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265014, 2024-03-27T07:28:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml" 2024-03-27T07:28:55.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 29972078, 2024-03-27T07:28:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639397, 2024-03-27T07:28:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-3.jpg" 2024-03-27T07:28:55.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 31121105, 2024-03-27T07:28:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637030, 2024-03-27T07:28:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-14.xml" 2024-03-27T07:28:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 31138388, 2024-03-27T07:28:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636960, 2024-03-27T07:28:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-28.xml" 2024-03-27T07:28:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.985 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 31606311, 2024-03-27T07:28:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272839, 2024-03-27T07:28:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-32.xml" 2024-03-27T07:28:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.986 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 32029714, 2024-03-27T07:28:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633869, 2024-03-27T07:28:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-8.xml" 2024-03-27T07:28:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 32651201, 2024-03-27T07:28:55.987 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259223, 2024-03-27T07:28:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-77.jpg" 2024-03-27T07:28:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 33019408, 2024-03-27T07:28:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258499, 2024-03-27T07:28:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-38.xml" 2024-03-27T07:28:55.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 33139641, 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272813, 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-41.xml" 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 33837456, 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259571, 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg" 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.989 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 35115041, 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636782, 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-52.xml" 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 35845736, 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263027, 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-8.xml" 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 37273646, 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265104, 2024-03-27T07:28:55.990 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-31.jpg" 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 41958259, 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631021, 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml" 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 43172563, 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630903, 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml" 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 43365153, 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262799, 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-46.jpg" 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 44423291, 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259107, 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml" 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.992 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 47688314, 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633761, 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-36.xml" 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 55272236, 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633865, 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-10.xml" 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 55666945, 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639336, 2024-03-27T07:28:55.993 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-1.xml" 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 56107103, 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629906, 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml" 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 56395414, 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265012, 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml" 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 60706819, 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265879, 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-13.xml" 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 62769223, 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636808, 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-49.xml" 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.995 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 69105834, 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263070, 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-48.jpg" 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 70655445, 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272878, 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-23.xml" 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 70896572, 2024-03-27T07:28:55.996 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259687, 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg" 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 73381102, 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638980, 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-28.jpg" 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 79986599, 2024-03-27T07:28:55.997 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629799, 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-56.xml" 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 80673564, 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634808, 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-77.jpg" 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.998 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 83748444, 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638990, 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-18.jpg" 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 86013955, 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633878, 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-6.xml" 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 86317061, 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636683, 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-64.xml" 2024-03-27T07:28:55.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 88495274, 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265987, 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-17.jpg" 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 90030195, 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638992, 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-16.jpg" 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.000 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 91993894, 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634297, 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-23.xml" 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 92635904, 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265040, 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-53.jpg" 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 99515410, 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633888, 2024-03-27T07:28:56.001 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-3.xml" 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 101719698, 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272922, 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-7.xml" 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 103266668, 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272804, 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-44.xml" 2024-03-27T07:28:56.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 109681729, 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629606, 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-93.xml" 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 117603820, 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261380, 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-5.jpg" 2024-03-27T07:28:56.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 120001404, 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264985, 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-20.xml" 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 120803858, 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259010, 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-30.xml" 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 126513405, 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272943, 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-5.jpg" 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 127043328, 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258527, 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-31.xml" 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.005 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 127192570, 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630893, 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml" 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 132549350, 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259566, 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg" 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 132704248, 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258420, 2024-03-27T07:28:56.006 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml" 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 133479822, 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635099, 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-16.jpg" 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 136045900, 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635019, 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-34.jpg" 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 136280063, 2024-03-27T07:28:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634921, 2024-03-27T07:28:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-53.jpg" 2024-03-27T07:28:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.008 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 139034878, 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629819, 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-48.xml" 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 142216699, 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629868, 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-22.xml" 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.009 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 148358601, 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261372, 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-7.jpg" 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 149270225, 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265062, 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-45.jpg" 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 152263657, 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264977, 2024-03-27T07:28:56.010 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-24.xml" 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 156194393, 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630107, 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml" 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 169122764, 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639358, 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-29.jpg" 2024-03-27T07:28:56.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 169168329, 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259532, 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg" 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 170661757, 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258594, 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml" 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 172913390, 2024-03-27T07:28:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265149, 2024-03-27T07:28:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-17.jpg" 2024-03-27T07:28:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 173401127, 2024-03-27T07:28:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258724, 2024-03-27T07:28:56.013 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-19.jpg" 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 179042435, 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258891, 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-52.xml" 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 188641180, 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634145, 2024-03-27T07:28:56.014 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg" 2024-03-27T07:28:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 189382584, 2024-03-27T07:28:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634765, 2024-03-27T07:28:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-88.jpg" 2024-03-27T07:28:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.015 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 194077502, 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634237, 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-54.xml" 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 194533412, 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638943, 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-4.xml" 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 199175857, 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635075, 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-22.jpg" 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 215384670, 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637267, 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-6.xml" 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 216437578, 2024-03-27T07:28:56.017 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635008, 2024-03-27T07:28:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-36.jpg" 2024-03-27T07:28:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 219549996, 2024-03-27T07:28:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629893, 2024-03-27T07:28:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml" 2024-03-27T07:28:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.018 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 224254580, 2024-03-27T07:28:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634025, 2024-03-27T07:28:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-37.xml" 2024-03-27T07:28:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.019 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 224968649, 2024-03-27T07:28:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259481, 2024-03-27T07:28:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-51.jpg" 2024-03-27T07:28:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 226458242, 2024-03-27T07:28:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258255, 2024-03-27T07:28:56.020 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml" 2024-03-27T07:28:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 227110783, 2024-03-27T07:28:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265937, 2024-03-27T07:28:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-42.jpg" 2024-03-27T07:28:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.021 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 239319603, 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258497, 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg" 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 243096116, 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637023, 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-15.xml" 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.022 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 244422464, 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265050, 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-49.jpg" 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 246525902, 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258367, 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml" 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.023 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 246979575, 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258334, 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml" 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 247752798, 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265003, 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-10.xml" 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.024 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 252445469, 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259118, 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml" 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 252565531, 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631006, 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml" 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 258497833, 2024-03-27T07:28:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631426, 2024-03-27T07:28:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-65.xml" 2024-03-27T07:28:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 259985722, 2024-03-27T07:28:56.026 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635130, 2024-03-27T07:28:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-9.jpg" 2024-03-27T07:28:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 263294553, 2024-03-27T07:28:56.027 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638982, 2024-03-27T07:28:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-26.jpg" 2024-03-27T07:28:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 264730713, 2024-03-27T07:28:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259561, 2024-03-27T07:28:56.028 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg" 2024-03-27T07:28:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 266552720, 2024-03-27T07:28:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637257, 2024-03-27T07:28:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-9.xml" 2024-03-27T07:28:56.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 267370387, 2024-03-27T07:28:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638994, 2024-03-27T07:28:56.030 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-14.jpg" 2024-03-27T07:28:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 271498674, 2024-03-27T07:28:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631099, 2024-03-27T07:28:56.031 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-95.xml" 2024-03-27T07:28:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 278421875, 2024-03-27T07:28:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259457, 2024-03-27T07:28:56.032 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-55.jpg" 2024-03-27T07:28:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 278480798, 2024-03-27T07:28:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258187, 2024-03-27T07:28:56.033 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml" 2024-03-27T07:28:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 278501951, 2024-03-27T07:28:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265022, 2024-03-27T07:28:56.034 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-62.jpg" 2024-03-27T07:28:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 279598478, 2024-03-27T07:28:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631013, 2024-03-27T07:28:56.035 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml" 2024-03-27T07:28:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 283054651, 2024-03-27T07:28:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637378, 2024-03-27T07:28:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-17.jpg" 2024-03-27T07:28:56.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 289030700, 2024-03-27T07:28:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629898, 2024-03-27T07:28:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml" 2024-03-27T07:28:56.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 294602221, 2024-03-27T07:28:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637388, 2024-03-27T07:28:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-15.jpg" 2024-03-27T07:28:56.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 299757955, 2024-03-27T07:28:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262952, 2024-03-27T07:28:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-37.xml" 2024-03-27T07:28:56.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 300075776, 2024-03-27T07:28:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639373, 2024-03-27T07:28:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-19.jpg" 2024-03-27T07:28:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 303077605, 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263016, 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-12.xml" 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 303799171, 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634315, 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-13.xml" 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.041 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 304679956, 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023273588, 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-32.xml" 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 307766473, 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638966, 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-42.jpg" 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 313432287, 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630741, 2024-03-27T07:28:56.042 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml" 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 313793487, 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633851, 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-13.xml" 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 319542787, 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631414, 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-71.xml" 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 324523380, 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634702, 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-9.xml" 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 326259616, 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634888, 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-59.jpg" 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 326265549, 2024-03-27T07:28:56.044 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259093, 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml" 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 331191463, 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638972, 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-36.jpg" 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 332742741, 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633646, 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-56.xml" 2024-03-27T07:28:56.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 332903409, 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629888, 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-2.xml" 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 336520037, 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266015, 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-3.jpg" 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.046 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 338817597, 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259316, 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-70.jpg" 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 339950563, 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262875, 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-68.xml" 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 346366173, 2024-03-27T07:28:56.047 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265170, 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg" 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 351561582, 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639003, 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-5.jpg" 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 352588754, 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267407, 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-72.xml" 2024-03-27T07:28:56.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 361362519, 2024-03-27T07:28:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639354, 2024-03-27T07:28:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-63.jpg" 2024-03-27T07:28:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.049 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 364358612, 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258352, 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml" 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 367812413, 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634328, 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-4.xml" 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.050 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 370203979, 2024-03-27T07:28:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259584, 2024-03-27T07:28:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg" 2024-03-27T07:28:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.051 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 370584833, 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258773, 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg" 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 373820117, 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631028, 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml" 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 373979766, 2024-03-27T07:28:56.052 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258996, 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-33.xml" 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 375125072, 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636602, 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-73.xml" 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 377684139, 2024-03-27T07:28:56.053 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636841, 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-45.xml" 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 384615430, 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258507, 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-36.xml" 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 388133272, 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265071, 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-42.jpg" 2024-03-27T07:28:56.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 389744111, 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272912, 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-11.xml" 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 391807685, 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262650, 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-43.xml" 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.055 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 395660691, 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272946, 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-4.jpg" 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 396147944, 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262852, 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-77.xml" 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 401017765, 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265164, 2024-03-27T07:28:56.056 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg" 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 405148075, 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634742, 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-1.xml" 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 416487252, 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272910, 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-12.xml" 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.057 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 425055592, 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636882, 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-93.xml" 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 432781828, 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639361, 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-27.jpg" 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.058 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 435169702, 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265963, 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-29.jpg" 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 435723285, 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262704, 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-28.xml" 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 437068899, 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631051, 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-60.jpg" 2024-03-27T07:28:56.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 438999576, 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637312, 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-30.jpg" 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 439907749, 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259695, 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg" 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.060 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 440027151, 2024-03-27T07:28:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023269934, 2024-03-27T07:28:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-64.xml" 2024-03-27T07:28:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.061 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 443862273, 2024-03-27T07:28:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023278128, 2024-03-27T07:28:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-40.jpg" 2024-03-27T07:28:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 446913031, 2024-03-27T07:28:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629877, 2024-03-27T07:28:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-13.xml" 2024-03-27T07:28:56.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 451607482, 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633699, 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-47.xml" 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 458456921, 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630225, 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-32.jpg" 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.063 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 463206701, 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639002, 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-6.jpg" 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 465744375, 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258818, 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg" 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 466108402, 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272756, 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-59.xml" 2024-03-27T07:28:56.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 475453802, 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261285, 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-12.xml" 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 480941697, 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265006, 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml" 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.065 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 482556048, 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259546, 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg" 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 486329710, 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635087, 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-19.jpg" 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 491165430, 2024-03-27T07:28:56.066 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633616, 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-60.xml" 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 492144137, 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272941, 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-6.jpg" 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 492560184, 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631026, 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml" 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 493888942, 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636373, 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-58.xml" 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 493910422, 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634277, 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-34.xml" 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.068 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 498226071, 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265004, 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-9.xml" 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 500095073, 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634040, 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-29.xml" 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.069 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 503046469, 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632902, 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-45.xml" 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 505494033, 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634829, 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-72.jpg" 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.070 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 507744107, 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259103, 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml" 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 509800849, 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629769, 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-68.xml" 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 518907177, 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631104, 2024-03-27T07:28:56.071 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-100.xml" 2024-03-27T07:28:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 520282190, 2024-03-27T07:28:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635041, 2024-03-27T07:28:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-30.jpg" 2024-03-27T07:28:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 522571492, 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636594, 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-74.xml" 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 523931013, 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272869, 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-26.xml" 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 533710519, 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634945, 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-48.jpg" 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 538290165, 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631827, 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg" 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.074 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 539707410, 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265108, 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-30.jpg" 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 548066312, 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264995, 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-15.xml" 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 551025929, 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634285, 2024-03-27T07:28:56.075 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-28.xml" 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 564720011, 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629766, 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-69.xml" 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 569215387, 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259064, 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml" 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.076 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 582529260, 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258299, 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml" 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 584752254, 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633682, 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-99.xml" 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 585176400, 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638960, 2024-03-27T07:28:56.077 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-48.jpg" 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 590661320, 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630889, 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml" 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 591175704, 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635036, 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-31.jpg" 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 594312616, 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265891, 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-7.xml" 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 598583007, 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259088, 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml" 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.079 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 600322430, 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633685, 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-50.xml" 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 605823925, 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633674, 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-52.xml" 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 606979619, 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263154, 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-29.jpg" 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 607549394, 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262614, 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-52.xml" 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 608054887, 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258535, 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg" 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.081 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 609828127, 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639383, 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-14.jpg" 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 618551570, 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265155, 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-15.jpg" 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.082 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 621542226, 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258857, 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-58.xml" 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 624973820, 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259608, 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg" 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 625403592, 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265935, 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-43.jpg" 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 628072883, 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629831, 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-43.xml" 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.084 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 629400357, 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258363, 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml" 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 629834042, 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272786, 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-50.xml" 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 631111789, 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634079, 2024-03-27T07:28:56.085 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-13.xml" 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 633909925, 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258512, 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg" 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 646772302, 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637383, 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-16.jpg" 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 648763020, 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639381, 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-55.jpg" 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 649916561, 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634985, 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-40.jpg" 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 651278619, 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639374, 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-18.jpg" 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 651486889, 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265146, 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-18.jpg" 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.088 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 653661221, 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637276, 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-2.xml" 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 658532578, 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258267, 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml" 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 658550955, 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637321, 2024-03-27T07:28:56.089 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-28.jpg" 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 662407320, 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638954, 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-54.jpg" 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 664730132, 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272819, 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-39.xml" 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 665083067, 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637316, 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-29.jpg" 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 669490553, 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629801, 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-55.xml" 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 671194710, 2024-03-27T07:28:56.091 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265152, 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-16.jpg" 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 674681025, 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631094, 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-32.xml" 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 677535698, 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629859, 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-29.xml" 2024-03-27T07:28:56.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 678679265, 2024-03-27T07:28:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634291, 2024-03-27T07:28:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-26.xml" 2024-03-27T07:28:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.093 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 681581103, 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634238, 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-53.xml" 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 682514396, 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258310, 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml" 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.094 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 685974040, 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631398, 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-78.xml" 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 692601238, 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259099, 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml" 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 696126914, 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265871, 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-17.xml" 2024-03-27T07:28:56.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 697520232, 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634710, 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-7.xml" 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 698391000, 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258203, 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml" 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.096 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 702980237, 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636818, 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-48.xml" 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 708724921, 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259381, 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-64.jpg" 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 715542354, 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634323, 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-7.xml" 2024-03-27T07:28:56.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 717559830, 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635169, 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-1.jpg" 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 723469729, 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631030, 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml" 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 723595671, 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259659, 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg" 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 725349219, 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264981, 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-22.xml" 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.099 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 731975995, 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258567, 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg" 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 732533860, 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261340, 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-15.jpg" 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 732772714, 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636973, 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-25.xml" 2024-03-27T07:28:56.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 738165662, 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634940, 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-49.jpg" 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 738482043, 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637443, 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-4.jpg" 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.101 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 749240947, 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633609, 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-61.xml" 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 755264744, 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631029, 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml" 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 755836466, 2024-03-27T07:28:56.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631223, 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml" 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 760904189, 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265945, 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-38.jpg" 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 761064230, 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637283, 2024-03-27T07:28:56.103 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-36.jpg" 2024-03-27T07:28:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 764197725, 2024-03-27T07:28:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259499, 2024-03-27T07:28:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-47.jpg" 2024-03-27T07:28:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.104 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 768434326, 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639389, 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-9.jpg" 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 771144883, 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636998, 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-20.xml" 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 771544907, 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629929, 2024-03-27T07:28:56.105 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg" 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 772666331, 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639398, 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-2.jpg" 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 775971557, 2024-03-27T07:28:56.106 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631011, 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml" 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 778420291, 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272777, 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-53.xml" 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 780976548, 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265074, 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-41.jpg" 2024-03-27T07:28:56.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 785419155, 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258614, 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml" 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 785510006, 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258927, 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-46.xml" 2024-03-27T07:28:56.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 786299598, 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266011, 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-5.jpg" 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 792907794, 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638977, 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-31.jpg" 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 793405958, 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629933, 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-93.xml" 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 799945494, 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261384, 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-4.jpg" 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.110 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 802687909, 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258493, 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg" 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 805692838, 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631838, 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-91.xml" 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 812487633, 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634825, 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-73.jpg" 2024-03-27T07:28:56.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 814494391, 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633612, 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-84.xml" 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 819762425, 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633988, 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-59.xml" 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.112 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 823174069, 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631017, 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml" 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 823702305, 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631102, 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-77.xml" 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 826988079, 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630910, 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml" 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 827184059, 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272774, 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-54.xml" 2024-03-27T07:28:56.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 829448894, 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633804, 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-26.xml" 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 831557206, 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259041, 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml" 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 832734651, 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265158, 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-14.jpg" 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 833494789, 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258322, 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml" 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.116 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 840353354, 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638967, 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-41.jpg" 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 846463738, 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633680, 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-51.xml" 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 848843139, 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638951, 2024-03-27T07:28:56.117 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-57.jpg" 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 851158963, 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634295, 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-24.xml" 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 852284228, 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258551, 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml" 2024-03-27T07:28:56.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 852300661, 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629813, 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-50.xml" 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 854304087, 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637253, 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-10.xml" 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.119 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 860521629, 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634333, 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-1.xml" 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 860774535, 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637406, 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-11.jpg" 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.120 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 861842387, 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258199, 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml" 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 865216640, 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636773, 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-53.xml" 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.121 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 868610870, 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634777, 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-86.jpg" 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 872146660, 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633898, 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-1.xml" 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 873705272, 2024-03-27T07:28:56.122 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263142, 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-31.jpg" 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 874334487, 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634286, 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-27.xml" 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 875916908, 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632824, 2024-03-27T07:28:56.123 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-24.jpg" 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 878541955, 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258471, 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-45.xml" 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 883511115, 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638936, 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-11.xml" 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.124 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 886408711, 2024-03-27T07:28:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266520, 2024-03-27T07:28:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-90.jpg" 2024-03-27T07:28:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 892338677, 2024-03-27T07:28:56.125 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258460, 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg" 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 895090821, 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635096, 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-17.jpg" 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.126 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 906596011, 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638950, 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-58.jpg" 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 910107478, 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259031, 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml" 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 912792221, 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638995, 2024-03-27T07:28:56.127 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-13.jpg" 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 915664848, 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633959, 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-75.xml" 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 919460806, 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633862, 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-11.xml" 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.128 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 919473624, 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272902, 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-15.xml" 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 921251465, 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633757, 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-37.xml" 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.129 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 921406972, 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259541, 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg" 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 922394077, 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637004, 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-19.xml" 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.130 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 929860446, 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265993, 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-14.jpg" 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 932022973, 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258271, 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml" 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.131 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 932657421, 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272899, 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-16.xml" 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 939661638, 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638970, 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-38.jpg" 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 942310239, 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637263, 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-7.xml" 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 944518380, 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261376, 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-6.jpg" 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.133 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 945262111, 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637009, 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-18.xml" 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 952561554, 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633751, 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-38.xml" 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 955828179, 2024-03-27T07:28:56.134 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259633, 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg" 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 956472543, 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261297, 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-9.xml" 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.135 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 956799484, 2024-03-27T07:28:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631022, 2024-03-27T07:28:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml" 2024-03-27T07:28:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 957202727, 2024-03-27T07:28:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258235, 2024-03-27T07:28:56.136 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml" 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 962504006, 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634786, 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-83.jpg" 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 963062396, 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635067, 2024-03-27T07:28:56.137 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-24.jpg" 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 963224469, 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259045, 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml" 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 966014382, 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534889054, 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-43.xml" 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 972932430, 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639388, 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-10.jpg" 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 974407069, 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631422, 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-67.xml" 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.139 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 976125461, 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629784, 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-60.xml" 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 978044806, 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272851, 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-28.xml" 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 983137551, 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258398, 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml" 2024-03-27T07:28:56.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 984433890, 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259110, 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml" 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 988726502, 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258231, 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml" 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 990656277, 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632392, 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml" 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 991422127, 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259623, 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg" 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 999685848, 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258570, 2024-03-27T07:28:56.142 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml" 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1005466120, 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631405, 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-75.xml" 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1007905257, 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631025, 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml" 2024-03-27T07:28:56.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1008148370, 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636954, 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-30.xml" 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1010526836, 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630887, 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml" 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.144 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1014369221, 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636886, 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-40.xml" 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1014644911, 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262992, 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-21.xml" 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1017710505, 2024-03-27T07:28:56.145 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258541, 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg" 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1018808219, 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630883, 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml" 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1020859129, 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264999, 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-13.xml" 2024-03-27T07:28:56.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1022736996, 2024-03-27T07:28:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638988, 2024-03-27T07:28:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-20.jpg" 2024-03-27T07:28:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.147 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1023436554, 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636758, 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-55.xml" 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1028223954, 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636790, 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-51.xml" 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1037521792, 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265883, 2024-03-27T07:28:56.148 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-11.xml" 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1038965685, 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635702, 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg" 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1040060262, 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638953, 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-55.jpg" 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1042341410, 2024-03-27T07:28:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637137, 2024-03-27T07:28:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-1.xml" 2024-03-27T07:28:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1042579288, 2024-03-27T07:28:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259679, 2024-03-27T07:28:56.150 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg" 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1046084306, 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263045, 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-2.xml" 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1051678857, 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258838, 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg" 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1052800049, 2024-03-27T07:28:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266005, 2024-03-27T07:28:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-8.jpg" 2024-03-27T07:28:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1052904543, 2024-03-27T07:28:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635117, 2024-03-27T07:28:56.152 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-12.jpg" 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1057142133, 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259603, 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg" 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1059236140, 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634789, 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-82.jpg" 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1060386740, 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629822, 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-47.xml" 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1063014214, 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258808, 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg" 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.154 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1064837315, 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258408, 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml" 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1070481080, 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264983, 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-21.xml" 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1071402655, 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629878, 2024-03-27T07:28:56.155 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-12.xml" 2024-03-27T07:28:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1073710523, 2024-03-27T07:28:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266017, 2024-03-27T07:28:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-2.jpg" 2024-03-27T07:28:56.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1077651643, 2024-03-27T07:28:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265034, 2024-03-27T07:28:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-56.jpg" 2024-03-27T07:28:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.157 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1086121447, 2024-03-27T07:28:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272872, 2024-03-27T07:28:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-25.xml" 2024-03-27T07:28:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1086922842, 2024-03-27T07:28:56.158 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265181, 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg" 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1090265731, 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630885, 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml" 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1094365429, 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630906, 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml" 2024-03-27T07:28:56.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1096411837, 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262862, 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-73.xml" 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1098986637, 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638974, 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-34.jpg" 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.160 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1100808963, 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264971, 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-27.xml" 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1108616325, 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629771, 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-67.xml" 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1110548106, 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637394, 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-13.jpg" 2024-03-27T07:28:56.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1111395704, 2024-03-27T07:28:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629816, 2024-03-27T07:28:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-49.xml" 2024-03-27T07:28:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.162 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1116510611, 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258517, 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg" 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1117531995, 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023269846, 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-65.xml" 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1118008318, 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258163, 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml" 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1120307048, 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265036, 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-55.jpg" 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1123895107, 2024-03-27T07:28:56.164 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633799, 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-27.xml" 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1124522836, 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634016, 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-42.xml" 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1129118517, 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637836, 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-52.xml" 2024-03-27T07:28:56.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1129265879, 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634100, 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-5.xml" 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1130818213, 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272893, 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-18.xml" 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.166 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1134073679, 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633814, 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-22.xml" 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1135945523, 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265038, 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-54.jpg" 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1137611405, 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631018, 2024-03-27T07:28:56.167 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml" 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1138487014, 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258356, 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml" 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1141739808, 2024-03-27T07:28:56.168 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258440, 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml" 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1149363312, 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639349, 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-34.jpg" 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1150984328, 2024-03-27T07:28:56.169 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638987, 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-21.jpg" 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1152415582, 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259075, 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml" 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1155898683, 2024-03-27T07:28:56.170 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258387, 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml" 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1158033791, 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259006, 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-31.xml" 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1159140199, 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263137, 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-32.jpg" 2024-03-27T07:28:56.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1160250532, 2024-03-27T07:28:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639378, 2024-03-27T07:28:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-17.jpg" 2024-03-27T07:28:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1166350269, 2024-03-27T07:28:56.172 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634885, 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-60.jpg" 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1170885093, 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635025, 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-33.jpg" 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1176903050, 2024-03-27T07:28:56.173 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635668, 2024-03-27T07:28:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg" 2024-03-27T07:28:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1180207060, 2024-03-27T07:28:56.174 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634149, 2024-03-27T07:28:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-44.xml" 2024-03-27T07:28:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1180888048, 2024-03-27T07:28:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634936, 2024-03-27T07:28:56.175 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-50.jpg" 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1186096630, 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265030, 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-58.jpg" 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1186560457, 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634282, 2024-03-27T07:28:56.176 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-30.xml" 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1188264855, 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259404, 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-62.jpg" 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1200580877, 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258648, 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-27.jpg" 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1202785914, 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635064, 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-25.jpg" 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1202848144, 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258427, 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml" 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.178 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1204236126, 2024-03-27T07:28:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258167, 2024-03-27T07:28:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml" 2024-03-27T07:28:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1205628524, 2024-03-27T07:28:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638955, 2024-03-27T07:28:56.179 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-53.jpg" 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1207304243, 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634050, 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-24.xml" 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1207730937, 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634275, 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-35.xml" 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1214858371, 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633968, 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-71.xml" 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1215222522, 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634903, 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-56.jpg" 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.181 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1218744878, 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272875, 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-24.xml" 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1226462597, 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630896, 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml" 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1227604190, 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629874, 2024-03-27T07:28:56.182 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-16.xml" 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1231759011, 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258183, 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml" 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1233283087, 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635149, 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-5.jpg" 2024-03-27T07:28:56.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1233954626, 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259618, 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg" 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1239122692, 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272934, 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-2.xml" 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.184 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1240128096, 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259113, 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml" 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1247588398, 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259264, 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-74.jpg" 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1248006080, 2024-03-27T07:28:56.185 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631408, 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-74.xml" 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1248463570, 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639351, 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-33.jpg" 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1258534196, 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629885, 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-5.xml" 2024-03-27T07:28:56.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1258779195, 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258873, 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-55.xml" 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1262827250, 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632361, 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg" 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.187 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1274771581, 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265077, 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-40.jpg" 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1276150420, 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635134, 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-8.jpg" 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.188 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1277158866, 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259663, 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg" 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1278812019, 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259527, 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg" 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1279252522, 2024-03-27T07:28:56.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272763, 2024-03-27T07:28:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-57.xml" 2024-03-27T07:28:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1281338816, 2024-03-27T07:28:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634783, 2024-03-27T07:28:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-84.jpg" 2024-03-27T07:28:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.190 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1281722193, 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265915, 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-53.jpg" 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1282138699, 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638981, 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-27.jpg" 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.191 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1285571057, 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639310, 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-22.xml" 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1291932402, 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259556, 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg" 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1293343424, 2024-03-27T07:28:56.192 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258423, 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml" 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1294891180, 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258383, 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml" 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1295776325, 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631024, 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml" 2024-03-27T07:28:56.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1300744269, 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638938, 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-9.xml" 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1302073708, 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629895, 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml" 2024-03-27T07:28:56.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1308309645, 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265947, 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-37.jpg" 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1309236593, 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265905, 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-58.jpg" 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.195 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1311847719, 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261332, 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-1.xml" 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1312638519, 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265047, 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-50.jpg" 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1312884415, 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639267, 2024-03-27T07:28:56.196 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-60.xml" 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1313629992, 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629573, 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-76.xml" 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1313671374, 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637127, 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-5.xml" 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.197 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1321468403, 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629775, 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-63.xml" 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1321756894, 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265919, 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-51.jpg" 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1327706676, 2024-03-27T07:28:56.198 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259509, 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-45.jpg" 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1338895900, 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259518, 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-43.jpg" 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1339251779, 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258851, 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-59.xml" 2024-03-27T07:28:56.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1342106252, 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265010, 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml" 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1344719665, 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630897, 2024-03-27T07:28:56.200 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml" 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1345306311, 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638965, 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-43.jpg" 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1349306295, 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265979, 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-21.jpg" 2024-03-27T07:28:56.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1350789004, 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272896, 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-17.xml" 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1361245428, 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634047, 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-25.xml" 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1361345620, 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634972, 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-42.jpg" 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1364461878, 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259020, 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml" 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.203 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1366646759, 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637087, 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-9.xml" 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1369537224, 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265959, 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-31.jpg" 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1372026697, 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633018, 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-13.xml" 2024-03-27T07:28:56.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1375476011, 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630890, 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml" 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1375692644, 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265056, 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-47.jpg" 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.205 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1379571711, 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639365, 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-24.jpg" 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1384347123, 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631222, 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-80.jpg" 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1391082764, 2024-03-27T07:28:56.206 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263004, 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-17.xml" 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1393707042, 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630884, 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml" 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1394847431, 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629824, 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-46.xml" 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1401830931, 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258243, 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml" 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1403783762, 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634321, 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-8.xml" 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.208 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1418619884, 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634916, 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-54.jpg" 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1420559009, 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265991, 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-15.jpg" 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1420701363, 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272783, 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-51.xml" 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1421337878, 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632830, 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-46.xml" 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.210 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1424725534, 2024-03-27T07:28:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265887, 2024-03-27T07:28:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-9.xml" 2024-03-27T07:28:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1429899660, 2024-03-27T07:28:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265161, 2024-03-27T07:28:56.211 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg" 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1430279716, 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265957, 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-32.jpg" 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1433051573, 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265965, 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-28.jpg" 2024-03-27T07:28:56.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1437671789, 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265083, 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-38.jpg" 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1439482204, 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629751, 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-75.xml" 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1442965889, 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629844, 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-36.xml" 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1443039236, 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265092, 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-35.jpg" 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1446213196, 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636988, 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-22.xml" 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1450256121, 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633846, 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-14.xml" 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.215 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1456187108, 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265111, 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-29.jpg" 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1462463310, 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265183, 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg" 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1477806722, 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630981, 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-79.jpg" 2024-03-27T07:28:56.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1487014371, 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629865, 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-25.xml" 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1495058846, 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637437, 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-5.jpg" 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.217 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1496900034, 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265016, 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml" 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1497449742, 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636913, 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-37.xml" 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1499655889, 2024-03-27T07:28:56.218 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633856, 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-12.xml" 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1502062268, 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634310, 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-15.xml" 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1502990429, 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629764, 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-70.xml" 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1508541671, 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633786, 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-30.xml" 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1509133582, 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534888468, 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-98.xml" 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1509445563, 2024-03-27T07:28:56.220 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266013, 2024-03-27T07:28:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-4.jpg" 2024-03-27T07:28:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1510729748, 2024-03-27T07:28:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631410, 2024-03-27T07:28:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-73.xml" 2024-03-27T07:28:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.221 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1510847240, 2024-03-27T07:28:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637342, 2024-03-27T07:28:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-24.jpg" 2024-03-27T07:28:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1517975725, 2024-03-27T07:28:56.222 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639392, 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-7.jpg" 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1520038768, 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639364, 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-25.jpg" 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1520593547, 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639348, 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-35.jpg" 2024-03-27T07:28:56.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1527173546, 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265977, 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-22.jpg" 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1527568864, 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258966, 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-39.xml" 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.224 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1530360089, 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637292, 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-34.jpg" 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1531012978, 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262827, 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-87.xml" 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.225 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1533277607, 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263237, 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-16.jpg" 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1537565531, 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634857, 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-66.jpg" 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1542259256, 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258487, 2024-03-27T07:28:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-41.xml" 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1542565710, 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633638, 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-57.xml" 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1548425628, 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636742, 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-57.xml" 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1548562636, 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259691, 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg" 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1553251377, 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629850, 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-34.xml" 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.228 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1554055047, 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263067, 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-49.jpg" 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1556852980, 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634880, 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-61.jpg" 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1559299415, 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638969, 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-39.jpg" 2024-03-27T07:28:56.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1564332534, 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634793, 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-81.jpg" 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1564707742, 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639001, 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-7.jpg" 2024-03-27T07:28:56.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1565937402, 2024-03-27T07:28:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259026, 2024-03-27T07:28:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml" 2024-03-27T07:28:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1575167220, 2024-03-27T07:28:56.231 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259346, 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-67.jpg" 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1585845621, 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259595, 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg" 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.232 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1586602227, 2024-03-27T07:28:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633724, 2024-03-27T07:28:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-42.xml" 2024-03-27T07:28:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1586696979, 2024-03-27T07:28:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265913, 2024-03-27T07:28:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-54.jpg" 2024-03-27T07:28:56.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1588517064, 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259655, 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg" 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1590264234, 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259080, 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml" 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.234 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1591707502, 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258898, 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-51.xml" 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1595150429, 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630904, 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml" 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1599606058, 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637454, 2024-03-27T07:28:56.235 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-2.jpg" 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1600162733, 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272955, 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-1.jpg" 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1607590329, 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638999, 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-9.jpg" 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.236 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1609392269, 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258287, 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml" 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1614330349, 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265002, 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-11.xml" 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.237 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1614423466, 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259050, 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml" 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1621103134, 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264969, 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-28.xml" 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1622535845, 2024-03-27T07:28:56.238 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265897, 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-4.xml" 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1624395524, 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265173, 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg" 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1624611106, 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636868, 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-42.xml" 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1631148820, 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258345, 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml" 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1632621111, 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633773, 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-33.xml" 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.240 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1637644891, 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629894, 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml" 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1639756684, 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258753, 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg" 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1641108712, 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629579, 2024-03-27T07:28:56.241 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg" 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1645827685, 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258412, 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml" 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1649851807, 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265143, 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-19.jpg" 2024-03-27T07:28:56.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1652740294, 2024-03-27T07:28:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629760, 2024-03-27T07:28:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-71.xml" 2024-03-27T07:28:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1654021461, 2024-03-27T07:28:56.243 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634148, 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-97.jpg" 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1661998101, 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629795, 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-57.xml" 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1673536960, 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258578, 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml" 2024-03-27T07:28:56.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1673848946, 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258946, 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-43.xml" 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1674709920, 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634248, 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-47.xml" 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.245 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1675228858, 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634278, 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-33.xml" 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1675337187, 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272810, 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-42.xml" 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1678263439, 2024-03-27T07:28:56.246 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262855, 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-76.xml" 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1680062801, 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258784, 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg" 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1681083973, 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258477, 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg" 2024-03-27T07:28:56.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1681236760, 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637367, 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-19.jpg" 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1681474383, 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634307, 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-17.xml" 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.248 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1688792824, 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261302, 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-8.xml" 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1690925522, 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635144, 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-6.jpg" 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1691108873, 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258793, 2024-03-27T07:28:56.249 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg" 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1691175340, 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629832, 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-42.xml" 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1697769728, 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272798, 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-46.xml" 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1699766100, 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258629, 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml" 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1706955493, 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263164, 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-27.jpg" 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.251 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1707765785, 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634007, 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-50.xml" 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1709116627, 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272833, 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-34.xml" 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1721319769, 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631436, 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-59.xml" 2024-03-27T07:28:56.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1727113652, 2024-03-27T07:28:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258602, 2024-03-27T07:28:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml" 2024-03-27T07:28:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.253 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1732746259, 2024-03-27T07:28:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634313, 2024-03-27T07:28:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-14.xml" 2024-03-27T07:28:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1733146056, 2024-03-27T07:28:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265955, 2024-03-27T07:28:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-33.jpg" 2024-03-27T07:28:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1738468354, 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629774, 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-64.xml" 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1739114350, 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635092, 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-18.jpg" 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1741511710, 2024-03-27T07:28:56.255 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636968, 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-26.xml" 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1746151771, 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629867, 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-23.xml" 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1748932032, 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634738, 2024-03-27T07:28:56.256 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-2.xml" 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1750875282, 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630907, 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml" 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1752161087, 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636727, 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-59.xml" 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.257 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1755958340, 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265132, 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-22.jpg" 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1767854096, 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262993, 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-5.jpg" 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1768330547, 2024-03-27T07:28:56.258 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639386, 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-12.jpg" 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1769754916, 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638978, 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-30.jpg" 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1773221698, 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636307, 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-28.xml" 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1774154544, 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637095, 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-8.xml" 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1775157751, 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639384, 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-13.jpg" 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.260 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1776548752, 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258951, 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-42.xml" 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1778127899, 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631429, 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-64.xml" 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1780533396, 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265179, 2024-03-27T07:28:56.261 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg" 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1783460658, 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258481, 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg" 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1784101139, 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633953, 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-77.xml" 2024-03-27T07:28:56.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1787885840, 2024-03-27T07:28:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636630, 2024-03-27T07:28:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-70.xml" 2024-03-27T07:28:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.263 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1789470981, 2024-03-27T07:28:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638997, 2024-03-27T07:28:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-11.jpg" 2024-03-27T07:28:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1789521840, 2024-03-27T07:28:56.264 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258986, 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-35.xml" 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1792788781, 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629901, 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml" 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1795630877, 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265086, 2024-03-27T07:28:56.265 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-37.jpg" 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1796913431, 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629870, 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-20.xml" 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1797681462, 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633816, 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-20.xml" 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1800987271, 2024-03-27T07:28:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637072, 2024-03-27T07:28:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-51.xml" 2024-03-27T07:28:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.267 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1803017545, 2024-03-27T07:28:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631441, 2024-03-27T07:28:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-56.xml" 2024-03-27T07:28:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.268 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1806816252, 2024-03-27T07:28:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639342, 2024-03-27T07:28:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-38.jpg" 2024-03-27T07:28:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1807056296, 2024-03-27T07:28:56.269 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637134, 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-3.xml" 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1818356214, 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259126, 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-85.jpg" 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1819225931, 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633602, 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-62.xml" 2024-03-27T07:28:56.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1820451193, 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637275, 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-3.xml" 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1825707401, 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635072, 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-23.jpg" 2024-03-27T07:28:56.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1826044676, 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631015, 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml" 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1826948835, 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264967, 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-29.xml" 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.272 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1827831400, 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629866, 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-24.xml" 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1831023066, 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258475, 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-44.xml" 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.273 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1834338257, 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638979, 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-29.jpg" 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1837247706, 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637132, 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-4.xml" 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.274 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1847560405, 2024-03-27T07:28:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634324, 2024-03-27T07:28:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-6.xml" 2024-03-27T07:28:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1851564770, 2024-03-27T07:28:56.275 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631418, 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-69.xml" 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1853227624, 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633795, 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-28.xml" 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1853670153, 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258171, 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml" 2024-03-27T07:28:56.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1855348165, 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258415, 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml" 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1857582132, 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261392, 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-2.jpg" 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.277 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1858205408, 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258432, 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml" 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1861503086, 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265907, 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-57.jpg" 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1864320299, 2024-03-27T07:28:56.278 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639300, 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-29.xml" 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1871288876, 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266001, 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-10.jpg" 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1872400513, 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633709, 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-45.xml" 2024-03-27T07:28:56.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1878663283, 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265095, 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-34.jpg" 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1881495950, 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262857, 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-75.xml" 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.280 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1889732338, 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634267, 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-39.xml" 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1896795644, 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634283, 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-29.xml" 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1901741787, 2024-03-27T07:28:56.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258861, 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-57.xml" 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1907873747, 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636676, 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-65.xml" 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1907994302, 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272890, 2024-03-27T07:28:56.282 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-19.xml" 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1924514428, 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258528, 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg" 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1926568539, 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258468, 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg" 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1927598236, 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634009, 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-49.xml" 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1929036837, 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636621, 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-71.xml" 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1929051183, 2024-03-27T07:28:56.284 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633990, 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-58.xml" 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1933883343, 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634800, 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-79.jpg" 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1935456316, 2024-03-27T07:28:56.285 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637417, 2024-03-27T07:28:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-9.jpg" 2024-03-27T07:28:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1936542533, 2024-03-27T07:28:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272745, 2024-03-27T07:28:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-62.xml" 2024-03-27T07:28:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1940533403, 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634265, 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-40.xml" 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1954696621, 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634273, 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-37.xml" 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1954837629, 2024-03-27T07:28:56.287 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637040, 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-12.xml" 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1960928575, 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634780, 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-85.jpg" 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.288 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1961700234, 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272924, 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-6.xml" 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1967753030, 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265999, 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-11.jpg" 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1969900541, 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634319, 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-10.xml" 2024-03-27T07:28:56.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1970530301, 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265053, 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-48.jpg" 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1971188784, 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634017, 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-41.xml" 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1972806579, 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638942, 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-5.xml" 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1975459478, 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258159, 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml" 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1975981058, 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629745, 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-78.xml" 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1976382133, 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265923, 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-49.jpg" 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1981654663, 2024-03-27T07:28:56.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634252, 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-44.xml" 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1988197631, 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272848, 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-29.xml" 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1988956570, 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634747, 2024-03-27T07:28:56.293 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-90.jpg" 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1990343124, 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638945, 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-2.xml" 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1992165653, 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634061, 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-21.xml" 2024-03-27T07:28:56.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1992749170, 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637050, 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-10.xml" 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2003257017, 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634236, 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-55.xml" 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.295 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2003726161, 2024-03-27T07:28:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262987, 2024-03-27T07:28:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-23.xml" 2024-03-27T07:28:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2004123361, 2024-03-27T07:28:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633982, 2024-03-27T07:28:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-62.xml" 2024-03-27T07:28:56.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2004378287, 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639007, 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-1.jpg" 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2004551359, 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630363, 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-75.xml" 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.297 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2006523281, 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630895, 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml" 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2020298670, 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259580, 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg" 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.298 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2023494505, 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259121, 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml" 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2031122991, 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634714, 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-6.xml" 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2047455075, 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630888, 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml" 2024-03-27T07:28:56.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2048821537, 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631037, 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-67.xml" 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2049972450, 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638964, 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-44.jpg" 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.300 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2051001767, 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258239, 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml" 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2054237986, 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629884, 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-6.xml" 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2054260781, 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633777, 2024-03-27T07:28:56.301 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-32.xml" 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2063769781, 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629861, 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-28.xml" 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2068542185, 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629803, 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-54.xml" 2024-03-27T07:28:56.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2069677610, 2024-03-27T07:28:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634258, 2024-03-27T07:28:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-42.xml" 2024-03-27T07:28:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2069941802, 2024-03-27T07:28:56.303 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631002, 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml" 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2076948783, 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266522, 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-8.xml" 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2077772479, 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023278319, 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-43.xml" 2024-03-27T07:28:56.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2078393552, 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631789, 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml" 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2088935309, 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629842, 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-37.xml" 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.305 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2091407807, 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258560, 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg" 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2093674546, 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262947, 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-39.xml" 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.306 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2095089205, 2024-03-27T07:28:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259645, 2024-03-27T07:28:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg" 2024-03-27T07:28:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.307 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2102213120, 2024-03-27T07:28:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629835, 2024-03-27T07:28:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-40.xml" 2024-03-27T07:28:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2104804257, 2024-03-27T07:28:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638971, 2024-03-27T07:28:56.308 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-37.jpg" 2024-03-27T07:28:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2113466420, 2024-03-27T07:28:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265985, 2024-03-27T07:28:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-18.jpg" 2024-03-27T07:28:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.309 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2113615845, 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629897, 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml" 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2117512640, 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630236, 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-93.xml" 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.310 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2130649627, 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258223, 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml" 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2130773612, 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258525, 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg" 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2131322690, 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265032, 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-57.jpg" 2024-03-27T07:28:56.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2132179635, 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636639, 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-69.xml" 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2137880230, 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264993, 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-16.xml" 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.312 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2138986938, 2024-03-27T07:28:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633718, 2024-03-27T07:28:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-43.xml" 2024-03-27T07:28:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2141100536, 2024-03-27T07:28:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265024, 2024-03-27T07:28:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-61.jpg" 2024-03-27T07:28:56.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2143866306, 2024-03-27T07:28:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634834, 2024-03-27T07:28:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-71.jpg" 2024-03-27T07:28:56.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2145726513, 2024-03-27T07:28:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259490, 2024-03-27T07:28:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-49.jpg" 2024-03-27T07:28:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2148186066, 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638962, 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-46.jpg" 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2148808108, 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258151, 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml" 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2152756751, 2024-03-27T07:28:56.316 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259576, 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg" 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2155240065, 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259048, 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml" 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2155951747, 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023273254, 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-46.xml" 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2156422207, 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258195, 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml" 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2173308095, 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629880, 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-10.xml" 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.318 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2173575048, 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261336, 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-16.jpg" 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2178621113, 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637270, 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-5.xml" 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2182663519, 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259537, 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg" 2024-03-27T07:28:56.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2195883786, 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636847, 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-44.xml" 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2198873261, 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638958, 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-50.jpg" 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.320 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2199887974, 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638063, 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-57.xml" 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2202576386, 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634037, 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-31.xml" 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.321 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2203427720, 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263169, 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-26.jpg" 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2203518669, 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265117, 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-27.jpg" 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.322 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2205052623, 2024-03-27T07:28:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637271, 2024-03-27T07:28:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-4.xml" 2024-03-27T07:28:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2205685898, 2024-03-27T07:28:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262907, 2024-03-27T07:28:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-55.xml" 2024-03-27T07:28:56.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2206029330, 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634301, 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-20.xml" 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2209086457, 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258548, 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml" 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2213125960, 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629904, 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml" 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2215736255, 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637357, 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-21.jpg" 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.325 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2218019668, 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262512, 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-79.xml" 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2221818674, 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258733, 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-18.jpg" 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.326 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2224357387, 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634954, 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-46.jpg" 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2231773817, 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637018, 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-16.xml" 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2235437630, 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639368, 2024-03-27T07:28:56.327 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-22.jpg" 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2236343205, 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630901, 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml" 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2237100611, 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631438, 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-57.xml" 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.328 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2238878409, 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631106, 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-51.xml" 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2240020794, 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634772, 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-87.jpg" 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2240419111, 2024-03-27T07:28:56.329 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259523, 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg" 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2241522797, 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263014, 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-13.xml" 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2243294835, 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258587, 2024-03-27T07:28:56.330 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml" 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2243900709, 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264989, 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-18.xml" 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2243974160, 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258500, 2024-03-27T07:28:56.331 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg" 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2249541106, 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272842, 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-31.xml" 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2253662278, 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272936, 2024-03-27T07:28:56.332 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-1.xml" 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2254369783, 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636939, 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-34.xml" 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2255819060, 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258598, 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml" 2024-03-27T07:28:56.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2259435715, 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629812, 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-51.xml" 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2265584975, 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634754, 2024-03-27T07:28:56.334 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-89.jpg" 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2267509368, 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634241, 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-51.xml" 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2269259157, 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265120, 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-26.jpg" 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.335 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2274214374, 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258922, 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-47.xml" 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2274843725, 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629558, 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml" 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2278427338, 2024-03-27T07:28:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259627, 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg" 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2291634049, 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634006, 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-51.xml" 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2293402560, 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636950, 2024-03-27T07:28:56.337 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-31.xml" 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2295646365, 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259157, 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-89.xml" 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2300348072, 2024-03-27T07:28:56.338 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638952, 2024-03-27T07:28:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-56.jpg" 2024-03-27T07:28:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2302379170, 2024-03-27T07:28:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259208, 2024-03-27T07:28:56.339 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-78.jpg" 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2304141662, 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259642, 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg" 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2308247603, 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634732, 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-3.xml" 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2313923394, 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632897, 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-28.jpg" 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2326834473, 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634298, 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-22.xml" 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2330253214, 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629869, 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-21.xml" 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2337102427, 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633604, 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-48.jpg" 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2344936323, 2024-03-27T07:28:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265975, 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-23.jpg" 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2346663845, 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632364, 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-60.xml" 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2349015536, 2024-03-27T07:28:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534889053, 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-44.xml" 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2352317325, 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637302, 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-32.jpg" 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2371898284, 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265933, 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-44.jpg" 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2372977363, 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258626, 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml" 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2377526896, 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634146, 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-82.xml" 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2377665076, 2024-03-27T07:28:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259131, 2024-03-27T07:28:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-84.jpg" 2024-03-27T07:28:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2386334864, 2024-03-27T07:28:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262887, 2024-03-27T07:28:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-63.xml" 2024-03-27T07:28:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2387309203, 2024-03-27T07:28:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631004, 2024-03-27T07:28:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml" 2024-03-27T07:28:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2391815241, 2024-03-27T07:28:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258976, 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-37.xml" 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2395537840, 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265001, 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-12.xml" 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2396806502, 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638940, 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-7.xml" 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2397615702, 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635164, 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-2.jpg" 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2398389503, 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637135, 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-2.xml" 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2398747913, 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259495, 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-48.jpg" 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2401368302, 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258744, 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg" 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2401723095, 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265885, 2024-03-27T07:28:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-10.xml" 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2410510912, 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265961, 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-30.jpg" 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2413024113, 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262688, 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-33.xml" 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2413136726, 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259613, 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg" 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2414770996, 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639370, 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-21.jpg" 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2415071536, 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634300, 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-21.xml" 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2417394650, 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634874, 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-62.jpg" 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2422896312, 2024-03-27T07:28:56.353 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023274451, 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-36.xml" 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2433067125, 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629875, 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-15.xml" 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.354 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2433234716, 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638948, 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-60.jpg" 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2438301754, 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639353, 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-32.jpg" 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2455566601, 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265953, 2024-03-27T07:28:56.355 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-34.jpg" 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2457196979, 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261352, 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-12.jpg" 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2466500727, 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272768, 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-56.xml" 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2468348368, 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265140, 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-20.jpg" 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2469463700, 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265042, 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-52.jpg" 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2470714164, 2024-03-27T07:28:56.357 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264975, 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-25.xml" 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2470865279, 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634931, 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-51.jpg" 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2480764613, 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629889, 2024-03-27T07:28:56.358 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-1.xml" 2024-03-27T07:28:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.359 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2482649938, 2024-03-27T07:28:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639346, 2024-03-27T07:28:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-36.jpg" 2024-03-27T07:28:56.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2484672461, 2024-03-27T07:28:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634010, 2024-03-27T07:28:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-48.xml" 2024-03-27T07:28:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2485168700, 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258547, 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg" 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2485513604, 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629883, 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-7.xml" 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.363 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2486383942, 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636947, 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-32.xml" 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2486561435, 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638957, 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-51.jpg" 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.364 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2492415809, 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258842, 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg" 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2494392399, 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634925, 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-52.jpg" 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2496094191, 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630248, 2024-03-27T07:28:56.365 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-10.xml" 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2499490491, 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259451, 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-56.jpg" 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2501709938, 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629881, 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-9.xml" 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2505601885, 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534888970, 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-45.xml" 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2508141297, 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258636, 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml" 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.367 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2509149308, 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272845, 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-30.xml" 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2509775948, 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639511, 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-3.jpg" 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2511469673, 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636766, 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-54.xml" 2024-03-27T07:28:56.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2524764805, 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636878, 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-41.xml" 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2525211328, 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259475, 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-52.jpg" 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.369 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2526404579, 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638968, 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-40.jpg" 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2536253307, 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265028, 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-59.jpg" 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.370 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2539815334, 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264991, 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-17.xml" 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2543759078, 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629837, 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-39.xml" 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2547598342, 2024-03-27T07:28:56.371 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262954, 2024-03-27T07:28:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-36.xml" 2024-03-27T07:28:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2548137815, 2024-03-27T07:28:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634852, 2024-03-27T07:28:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-67.jpg" 2024-03-27T07:28:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2551727149, 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637260, 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-8.xml" 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2554982096, 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265911, 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-55.jpg" 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2557267311, 2024-03-27T07:28:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265943, 2024-03-27T07:28:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-39.jpg" 2024-03-27T07:28:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2558951610, 2024-03-27T07:28:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636658, 2024-03-27T07:28:56.374 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-67.xml" 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2569845321, 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635050, 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-28.jpg" 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2572500276, 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639339, 2024-03-27T07:28:56.375 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-5.xml" 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2575916480, 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635675, 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-92.xml" 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2577322541, 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634249, 2024-03-27T07:28:56.376 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-46.xml" 2024-03-27T07:28:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2582040042, 2024-03-27T07:28:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635084, 2024-03-27T07:28:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-20.jpg" 2024-03-27T07:28:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.377 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2584953015, 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259000, 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-32.xml" 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2585320891, 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636921, 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-36.xml" 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.378 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2585484900, 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629856, 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-31.xml" 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2585961893, 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633568, 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-2.xml" 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2586538170, 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634978, 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-41.jpg" 2024-03-27T07:28:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2593126717, 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634066, 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-18.xml" 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2595312098, 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272801, 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-45.xml" 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.380 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2596099655, 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633714, 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-44.xml" 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2599548640, 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259671, 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg" 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2600509629, 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629899, 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml" 2024-03-27T07:28:56.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2602128088, 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258880, 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-54.xml" 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2605829886, 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637426, 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-7.jpg" 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.382 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2610759455, 2024-03-27T07:28:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638989, 2024-03-27T07:28:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-19.jpg" 2024-03-27T07:28:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2612007315, 2024-03-27T07:28:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631393, 2024-03-27T07:28:56.383 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-80.xml" 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2612881169, 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629829, 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-44.xml" 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2612983900, 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634331, 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-2.xml" 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2618305571, 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636718, 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-60.xml" 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2623594235, 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259253, 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-75.jpg" 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2623795353, 2024-03-27T07:28:56.385 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261356, 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-11.jpg" 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2625800585, 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636710, 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-61.xml" 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2629886555, 2024-03-27T07:28:56.386 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259675, 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg" 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2633447474, 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272865, 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-27.xml" 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2635397469, 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637390, 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-14.jpg" 2024-03-27T07:28:56.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2641940086, 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633875, 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-7.xml" 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2648555527, 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259182, 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-80.jpg" 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.388 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2649073217, 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638983, 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-25.jpg" 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2649766049, 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261396, 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-1.jpg" 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2650424741, 2024-03-27T07:28:56.389 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635125, 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-10.jpg" 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2650508689, 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629890, 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml" 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2650779009, 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634255, 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-43.xml" 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2650915494, 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258822, 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg" 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2651055787, 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259150, 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-82.jpg" 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.391 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2652615605, 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259307, 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-71.jpg" 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2653115826, 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023274272, 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-42.xml" 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2658390510, 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637174, 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-66.xml" 2024-03-27T07:28:56.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2665042521, 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634242, 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-50.xml" 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2677811504, 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263057, 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-52.jpg" 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2680098498, 2024-03-27T07:28:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630908, 2024-03-27T07:28:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml" 2024-03-27T07:28:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2681225043, 2024-03-27T07:28:56.394 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638998, 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-10.jpg" 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2683615013, 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631400, 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-77.xml" 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2690245427, 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631390, 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-81.xml" 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2693600447, 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262610, 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-53.xml" 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2695809952, 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629773, 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-65.xml" 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2711152377, 2024-03-27T07:28:56.396 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265929, 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-46.jpg" 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2712919190, 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638941, 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-6.xml" 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2717816779, 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265068, 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-43.jpg" 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2717825197, 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258868, 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-56.xml" 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2719619433, 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265921, 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-50.jpg" 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.398 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2719963866, 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263284, 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-8.jpg" 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2725529523, 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629839, 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-38.xml" 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2728474760, 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258764, 2024-03-27T07:28:56.399 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg" 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2731902264, 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265949, 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-36.jpg" 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2744174988, 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629852, 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-33.xml" 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.400 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2745513322, 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631434, 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-61.xml" 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2748172787, 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637332, 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-26.jpg" 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2750657149, 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272951, 2024-03-27T07:28:56.401 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-2.jpg" 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2754459566, 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265997, 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-12.jpg" 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2757242553, 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272836, 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-33.xml" 2024-03-27T07:28:56.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2776117209, 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265185, 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg" 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2788732778, 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638984, 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-24.jpg" 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.403 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2794931228, 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265989, 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-16.jpg" 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2795430896, 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634843, 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-69.jpg" 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2798912566, 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637338, 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-25.jpg" 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2801619454, 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259084, 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml" 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2801810514, 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633655, 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-55.xml" 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2803258232, 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258910, 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-49.xml" 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.406 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2812669357, 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265895, 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-5.xml" 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2826880563, 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637045, 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-11.xml" 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2828701786, 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258135, 2024-03-27T07:28:56.407 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-67.xml" 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2830119873, 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639338, 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-40.jpg" 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2832547161, 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636906, 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-38.xml" 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.408 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2834697667, 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265981, 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-20.jpg" 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2848315848, 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631027, 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml" 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.409 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2849300422, 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023274576, 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-30.xml" 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2851095752, 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258448, 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg" 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2858542983, 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258495, 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-39.xml" 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2860839089, 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259639, 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg" 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2864803480, 2024-03-27T07:28:56.411 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263033, 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-6.xml" 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2872942492, 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633881, 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-5.xml" 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2875572773, 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634262, 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-41.xml" 2024-03-27T07:28:56.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2878842161, 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259636, 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg" 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2879349640, 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258455, 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg" 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.413 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2880944906, 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265909, 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-56.jpg" 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2881299461, 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261289, 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-11.xml" 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.414 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2883750412, 2024-03-27T07:28:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631040, 2024-03-27T07:28:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-81.xml" 2024-03-27T07:28:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2886206850, 2024-03-27T07:28:56.415 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272830, 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-35.xml" 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2889141497, 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631093, 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-41.jpg" 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2896243064, 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639278, 2024-03-27T07:28:56.416 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-49.xml" 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2906846931, 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634862, 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-65.jpg" 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2910822242, 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631419, 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-68.xml" 2024-03-27T07:28:56.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2912481311, 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631415, 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-70.xml" 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2912993666, 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634245, 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-49.xml" 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.418 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2913654039, 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272789, 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-49.xml" 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2917038185, 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272908, 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-13.xml" 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2922582150, 2024-03-27T07:28:56.419 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258960, 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-40.xml" 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2923313518, 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259683, 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg" 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2925198265, 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630117, 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml" 2024-03-27T07:28:56.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2930072577, 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631396, 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-79.xml" 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2931315787, 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634866, 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-64.jpg" 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.421 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2932371455, 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629757, 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-72.xml" 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2933121227, 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634280, 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-31.xml" 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2936282006, 2024-03-27T07:28:56.422 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634330, 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-3.xml" 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2937020225, 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638963, 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-45.jpg" 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2945635029, 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630892, 2024-03-27T07:28:56.423 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml" 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2946010005, 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272884, 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-21.xml" 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2946082025, 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629892, 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml" 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.424 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2946705573, 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258467, 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-46.xml" 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2956632928, 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636978, 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-24.xml" 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2964851482, 2024-03-27T07:28:56.425 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635080, 2024-03-27T07:28:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-21.jpg" 2024-03-27T07:28:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2964952727, 2024-03-27T07:28:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634839, 2024-03-27T07:28:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-70.jpg" 2024-03-27T07:28:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2966750365, 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259513, 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-44.jpg" 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2967191722, 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630899, 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml" 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.427 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2971607188, 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636871, 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml" 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2981536984, 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632649, 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-72.xml" 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2983195274, 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265893, 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-6.xml" 2024-03-27T07:28:56.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2986419565, 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258435, 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml" 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2987166200, 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630902, 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml" 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.429 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2993446607, 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534885050, 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-100.xml" 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3003161352, 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629907, 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml" 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3003451172, 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265098, 2024-03-27T07:28:56.430 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-33.jpg" 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3004158660, 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265191, 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg" 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3006065805, 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265089, 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-36.jpg" 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3013106347, 2024-03-27T07:28:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639004, 2024-03-27T07:28:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-4.jpg" 2024-03-27T07:28:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3013896703, 2024-03-27T07:28:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259599, 2024-03-27T07:28:56.432 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg" 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3014519064, 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258473, 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg" 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3016471721, 2024-03-27T07:28:56.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631039, 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-85.xml" 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3016887994, 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264997, 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-14.xml" 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3018250499, 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259279, 2024-03-27T07:28:56.434 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-73.jpg" 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3021305301, 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631023, 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml" 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3021365005, 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272828, 2024-03-27T07:28:56.435 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-36.xml" 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3028140414, 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272822, 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-38.xml" 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3030296442, 2024-03-27T07:28:56.436 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631431, 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-62.xml" 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3032287552, 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629753, 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-74.xml" 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3035556969, 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265005, 2024-03-27T07:28:56.437 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml" 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3036119284, 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258378, 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml" 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3037608198, 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636611, 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-72.xml" 2024-03-27T07:28:56.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3047338424, 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637422, 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-8.jpg" 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3048708426, 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633825, 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-18.xml" 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.439 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3051066599, 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265189, 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg" 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3052526286, 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259463, 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-54.jpg" 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3055273409, 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633704, 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-46.xml" 2024-03-27T07:28:56.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3059322163, 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629896, 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml" 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3066754093, 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634812, 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-76.jpg" 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.441 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3073648734, 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634250, 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-45.xml" 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3076821132, 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639334, 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-2.xml" 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.442 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3080588083, 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258373, 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml" 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3081315159, 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634279, 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-32.xml" 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3082277950, 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635031, 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-32.jpg" 2024-03-27T07:28:56.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3083208338, 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272816, 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-40.xml" 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3085174536, 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633782, 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-31.xml" 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.444 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3087803561, 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634081, 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-12.xml" 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3090901651, 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635706, 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml" 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3091620059, 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258464, 2024-03-27T07:28:56.445 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg" 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3093346529, 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633819, 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-19.xml" 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3093462991, 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259485, 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-50.jpg" 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3097882094, 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633733, 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-41.xml" 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3099512179, 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262880, 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-66.xml" 2024-03-27T07:28:56.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3100903906, 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639393, 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-6.jpg" 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3106395574, 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633689, 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-49.xml" 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.448 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3106775328, 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629847, 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-35.xml" 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3109146192, 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636957, 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-29.xml" 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3113948872, 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633765, 2024-03-27T07:28:56.449 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-35.xml" 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3114607588, 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259445, 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-57.jpg" 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3119220334, 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638947, 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-61.jpg" 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.450 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3123308148, 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258981, 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-36.xml" 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3126062832, 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634959, 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-45.jpg" 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3130134861, 2024-03-27T07:28:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630900, 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml" 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3136189857, 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265008, 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml" 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3137689767, 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629786, 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-59.xml" 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3141032041, 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258675, 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-24.jpg" 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3141254622, 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631120, 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-49.xml" 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.453 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3150939709, 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259367, 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-65.jpg" 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3153005559, 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638973, 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-35.jpg" 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3153455433, 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636943, 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-33.xml" 2024-03-27T07:28:56.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3154294180, 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630894, 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml" 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3157209156, 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639436, 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-40.jpg" 2024-03-27T07:28:56.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3159487088, 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259170, 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-81.jpg" 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3161407344, 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637460, 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-1.jpg" 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.456 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3162410684, 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629879, 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-11.xml" 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3165552513, 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629854, 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-32.xml" 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3173210424, 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023278311, 2024-03-27T07:28:56.457 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-59.jpg" 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3175072849, 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639394, 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-5.jpg" 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3178696406, 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266007, 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-7.jpg" 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3181166370, 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637296, 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-33.jpg" 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3184264832, 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265971, 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-25.jpg" 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.459 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3186782341, 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634274, 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-36.xml" 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3187343146, 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259630, 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg" 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.460 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3187463558, 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629910, 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml" 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3189308290, 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631009, 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml" 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3190020094, 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634990, 2024-03-27T07:28:56.461 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-39.jpg" 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3191460167, 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639344, 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-37.jpg" 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3194900180, 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265941, 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-40.jpg" 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.462 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3203025212, 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636963, 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-27.xml" 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3203885219, 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639325, 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-6.xml" 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.463 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3205647295, 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637348, 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-23.jpg" 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3207821361, 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263054, 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-53.jpg" 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3214875415, 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639006, 2024-03-27T07:28:56.464 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-2.jpg" 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3215966950, 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261321, 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-4.xml" 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3218166891, 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630898, 2024-03-27T07:28:56.465 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml" 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3227376682, 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634326, 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-5.xml" 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3228977945, 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258317, 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml" 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3230721180, 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629872, 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-18.xml" 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3232142320, 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634871, 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-63.jpg" 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.467 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3233963607, 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635054, 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-27.jpg" 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3235415383, 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629772, 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-66.xml" 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3237476105, 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272949, 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-3.jpg" 2024-03-27T07:28:56.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3237654215, 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636735, 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-58.xml" 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3238979936, 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265967, 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-27.jpg" 2024-03-27T07:28:56.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3239713308, 2024-03-27T07:28:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258545, 2024-03-27T07:28:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml" 2024-03-27T07:28:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3241993632, 2024-03-27T07:28:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272905, 2024-03-27T07:28:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-14.xml" 2024-03-27T07:28:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.471 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3242999985, 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258488, 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg" 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3252587740, 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634054, 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-23.xml" 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3253031575, 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258505, 2024-03-27T07:28:56.472 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg" 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3254552394, 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635103, 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-15.jpg" 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3255829781, 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635112, 2024-03-27T07:28:56.473 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-13.jpg" 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3260280431, 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265983, 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-19.jpg" 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3264757497, 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634816, 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-75.jpg" 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3265510999, 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265136, 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-21.jpg" 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3267354239, 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634804, 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-78.jpg" 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.475 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3276358913, 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261388, 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-3.jpg" 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3276935907, 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272881, 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-22.xml" 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3278503756, 2024-03-27T07:28:56.476 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258641, 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-28.jpg" 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3279346731, 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265877, 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-14.xml" 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3284483046, 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258259, 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml" 2024-03-27T07:28:56.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3289489743, 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634720, 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-5.xml" 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3293232770, 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633662, 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-54.xml" 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.478 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3299334503, 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636668, 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-66.xml" 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3301786444, 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639367, 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-23.jpg" 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3306056824, 2024-03-27T07:28:56.479 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638985, 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-23.jpg" 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3306204058, 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634969, 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-43.jpg" 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3308243618, 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633810, 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-24.xml" 2024-03-27T07:28:56.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3309232482, 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633977, 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-65.xml" 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3309491118, 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630732, 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-56.jpg" 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3316223024, 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272760, 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-58.xml" 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3318757270, 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637035, 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-13.xml" 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.482 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3320123691, 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639391, 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-8.jpg" 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3323587858, 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634798, 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-80.jpg" 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3330923988, 2024-03-27T07:28:56.483 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631020, 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml" 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3332562349, 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258282, 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml" 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3338112499, 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638996, 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-12.jpg" 2024-03-27T07:28:56.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3341001561, 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638959, 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-49.jpg" 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3343862705, 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631423, 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-66.xml" 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.485 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3350307214, 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261349, 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-13.jpg" 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3353713337, 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629778, 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-62.xml" 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3355800496, 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635013, 2024-03-27T07:28:56.486 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-35.jpg" 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3357721545, 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263048, 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-1.xml" 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3362530455, 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639295, 2024-03-27T07:28:56.487 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-34.xml" 2024-03-27T07:28:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3363219687, 2024-03-27T07:28:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639355, 2024-03-27T07:28:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-31.jpg" 2024-03-27T07:28:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.488 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3366825372, 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633739, 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-40.xml" 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3374520174, 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633624, 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-59.xml" 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3374971756, 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258684, 2024-03-27T07:28:56.489 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-23.jpg" 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3375668878, 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259067, 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml" 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3387173409, 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639360, 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-28.jpg" 2024-03-27T07:28:56.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3394355029, 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637362, 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-20.jpg" 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3397911024, 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634293, 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-25.xml" 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.491 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3398872265, 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272887, 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-20.xml" 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3403406855, 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635140, 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-7.jpg" 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3403738345, 2024-03-27T07:28:56.492 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266009, 2024-03-27T07:28:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-6.jpg" 2024-03-27T07:28:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3406138477, 2024-03-27T07:28:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258803, 2024-03-27T07:28:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-10.jpg" 2024-03-27T07:28:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3406628684, 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259651, 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg" 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3408176818, 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258191, 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml" 2024-03-27T07:28:56.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3410899358, 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633791, 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-29.xml" 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3413495232, 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265101, 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-32.jpg" 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.495 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3416002787, 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636857, 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-43.xml" 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3420594735, 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630796, 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-85.xml" 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3420815572, 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265873, 2024-03-27T07:28:56.496 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-16.xml" 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3421368978, 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635158, 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-3.jpg" 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3421626859, 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637111, 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-6.xml" 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3421974320, 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265126, 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-24.jpg" 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3425903872, 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259036, 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml" 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.498 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3431460211, 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258143, 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml" 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3438656109, 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639371, 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-20.jpg" 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3439425266, 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629886, 2024-03-27T07:28:56.499 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-4.xml" 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3441308411, 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636750, 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-56.xml" 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3443470125, 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630982, 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml" 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.500 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3443582438, 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638975, 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-33.jpg" 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3446148159, 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638991, 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-17.jpg" 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3448524094, 2024-03-27T07:28:56.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634082, 2024-03-27T07:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-11.xml" 2024-03-27T07:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3452294880, 2024-03-27T07:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636799, 2024-03-27T07:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-50.xml" 2024-03-27T07:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.502 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3457346628, 2024-03-27T07:28:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638937, 2024-03-27T07:28:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-10.xml" 2024-03-27T07:28:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.503 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3464648112, 2024-03-27T07:28:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638961, 2024-03-27T07:28:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-47.jpg" 2024-03-27T07:28:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.504 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3473962638, 2024-03-27T07:28:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272780, 2024-03-27T07:28:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-52.xml" 2024-03-27T07:28:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3477357591, 2024-03-27T07:28:56.505 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272939, 2024-03-27T07:28:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-7.jpg" 2024-03-27T07:28:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3481844761, 2024-03-27T07:28:56.506 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637372, 2024-03-27T07:28:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-18.jpg" 2024-03-27T07:28:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3488735277, 2024-03-27T07:28:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263174, 2024-03-27T07:28:56.507 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-25.jpg" 2024-03-27T07:28:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3490553196, 2024-03-27T07:28:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259053, 2024-03-27T07:28:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml" 2024-03-27T07:28:56.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3491595611, 2024-03-27T07:28:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534887949, 2024-03-27T07:28:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-76.xml" 2024-03-27T07:28:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3492667970, 2024-03-27T07:28:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639000, 2024-03-27T07:28:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-8.jpg" 2024-03-27T07:28:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.510 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3493743531, 2024-03-27T07:28:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629834, 2024-03-27T07:28:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-41.xml" 2024-03-27T07:28:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3501716388, 2024-03-27T07:28:56.511 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633836, 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-16.xml" 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3505166996, 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636649, 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-68.xml" 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.512 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3511855169, 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267930, 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-69.xml" 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3516922004, 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259335, 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-68.jpg" 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.513 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3519585875, 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629863, 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-27.xml" 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3519710099, 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637014, 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-17.xml" 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.514 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3519916462, 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629857, 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-30.xml" 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3526400437, 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259055, 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml" 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.515 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3528183686, 2024-03-27T07:28:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265080, 2024-03-27T07:28:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-39.jpg" 2024-03-27T07:28:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3531164511, 2024-03-27T07:28:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631403, 2024-03-27T07:28:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-76.xml" 2024-03-27T07:28:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3532741933, 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259421, 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-61.jpg" 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3533205926, 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639382, 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-15.jpg" 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.517 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3534167054, 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258277, 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml" 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3534323135, 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634055, 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-49.xml" 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.518 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3537604387, 2024-03-27T07:28:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639323, 2024-03-27T07:28:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-7.xml" 2024-03-27T07:28:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3544425930, 2024-03-27T07:28:56.519 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633630, 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-58.xml" 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3544428520, 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023278133, 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-61.xml" 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3545934383, 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637288, 2024-03-27T07:28:56.520 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-35.jpg" 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3546446167, 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631103, 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg" 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3552715131, 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631019, 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml" 2024-03-27T07:28:56.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3553263074, 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639340, 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-39.jpg" 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3553584912, 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258329, 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml" 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.522 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3559412529, 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635001, 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-37.jpg" 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3559452973, 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634046, 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-26.xml" 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3568583798, 2024-03-27T07:28:56.523 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261328, 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-2.xml" 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3570791893, 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262905, 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-56.xml" 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3571305299, 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633807, 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-25.xml" 2024-03-27T07:28:56.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3573288295, 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637400, 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-12.jpg" 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3574201200, 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258539, 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml" 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.525 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3575689107, 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634849, 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-68.jpg" 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3576721443, 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631435, 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-60.xml" 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3579086536, 2024-03-27T07:28:56.526 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267886, 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-70.xml" 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3581829421, 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633815, 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-21.xml" 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3584153348, 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634103, 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-3.xml" 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3587161307, 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638944, 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-3.xml" 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3604106058, 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259427, 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-60.jpg" 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.528 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3605971492, 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634820, 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-74.jpg" 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3610411121, 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629582, 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml" 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3622692219, 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266003, 2024-03-27T07:28:56.529 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-9.jpg" 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3627728145, 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258971, 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-38.xml" 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3629003741, 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272929, 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-4.xml" 2024-03-27T07:28:56.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3629329492, 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634303, 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-19.xml" 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3630790880, 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259239, 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-76.jpg" 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.531 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3630867809, 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638956, 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-52.jpg" 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3631388301, 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629871, 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-19.xml" 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.532 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3632048253, 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263051, 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-54.jpg" 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3633588427, 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261364, 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-9.jpg" 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.533 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3638848281, 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272932, 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-3.xml" 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3638864522, 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629882, 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-8.xml" 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.534 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3641740629, 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258443, 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg" 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3643033972, 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637279, 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-1.xml" 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3644053757, 2024-03-27T07:28:56.535 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634305, 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-18.xml" 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3649609109, 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272917, 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-9.xml" 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3650005412, 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639249, 2024-03-27T07:28:56.536 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-78.xml" 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3653846093, 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258452, 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg" 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3658050147, 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629876, 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-14.xml" 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3672970090, 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265026, 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-60.jpg" 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3674094240, 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636927, 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-35.xml" 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.538 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3677345536, 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637431, 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-6.jpg" 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3678946572, 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629887, 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-3.xml" 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3679312695, 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258695, 2024-03-27T07:28:56.539 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-22.jpg" 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3682367273, 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258552, 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg" 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3685748533, 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636369, 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-26.jpg" 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.540 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3695076006, 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637104, 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-7.xml" 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3696176409, 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272915, 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-10.xml" 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3700747013, 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258956, 2024-03-27T07:28:56.541 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-41.xml" 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3713573073, 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265044, 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-51.jpg" 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3714830220, 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633867, 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-9.xml" 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3716977556, 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634239, 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-52.xml" 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3719421532, 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629908, 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml" 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.543 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3724036308, 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264979, 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-23.xml" 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3725070736, 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265899, 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-3.xml" 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3734092505, 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259016, 2024-03-27T07:28:56.544 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml" 2024-03-27T07:28:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3740796730, 2024-03-27T07:28:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258503, 2024-03-27T07:28:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-37.xml" 2024-03-27T07:28:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.545 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3745762507, 2024-03-27T07:28:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262969, 2024-03-27T07:28:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-30.xml" 2024-03-27T07:28:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3750512616, 2024-03-27T07:28:56.546 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633694, 2024-03-27T07:28:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-48.xml" 2024-03-27T07:28:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3753606921, 2024-03-27T07:28:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265123, 2024-03-27T07:28:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-25.jpg" 2024-03-27T07:28:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3767593404, 2024-03-27T07:28:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630121, 2024-03-27T07:28:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml" 2024-03-27T07:28:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.548 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3770493125, 2024-03-27T07:28:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630891, 2024-03-27T07:28:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml" 2024-03-27T07:28:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3774177864, 2024-03-27T07:28:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265903, 2024-03-27T07:28:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-1.xml" 2024-03-27T07:28:56.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3774405438, 2024-03-27T07:28:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272771, 2024-03-27T07:28:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-55.xml" 2024-03-27T07:28:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.550 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3778785783, 2024-03-27T07:28:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265059, 2024-03-27T07:28:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-46.jpg" 2024-03-27T07:28:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3794076473, 2024-03-27T07:28:56.551 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636829, 2024-03-27T07:28:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-47.xml" 2024-03-27T07:28:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3794938576, 2024-03-27T07:28:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259433, 2024-03-27T07:28:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-59.jpg" 2024-03-27T07:28:56.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3812270718, 2024-03-27T07:28:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629789, 2024-03-27T07:28:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-58.xml" 2024-03-27T07:28:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.553 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3816417185, 2024-03-27T07:28:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258886, 2024-03-27T07:28:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-53.xml" 2024-03-27T07:28:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3819714123, 2024-03-27T07:28:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636702, 2024-03-27T07:28:56.554 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-62.xml" 2024-03-27T07:28:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3828755566, 2024-03-27T07:28:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634247, 2024-03-27T07:28:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-48.xml" 2024-03-27T07:28:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.555 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3838468366, 2024-03-27T07:28:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630881, 2024-03-27T07:28:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml" 2024-03-27T07:28:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3839368151, 2024-03-27T07:28:56.556 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262885, 2024-03-27T07:28:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-64.xml" 2024-03-27T07:28:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3846999803, 2024-03-27T07:28:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629903, 2024-03-27T07:28:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml" 2024-03-27T07:28:56.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3847762745, 2024-03-27T07:28:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633668, 2024-03-27T07:28:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-53.xml" 2024-03-27T07:28:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.558 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3849333105, 2024-03-27T07:28:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261317, 2024-03-27T07:28:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-5.xml" 2024-03-27T07:28:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3851779211, 2024-03-27T07:28:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639375, 2024-03-27T07:28:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-22.xml" 2024-03-27T07:28:56.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3853259139, 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259136, 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-83.jpg" 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3854087161, 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629905, 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml" 2024-03-27T07:28:56.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3863380686, 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629755, 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-73.xml" 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3863446285, 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629746, 2024-03-27T07:28:56.561 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-77.xml" 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3866984269, 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265187, 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg" 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3867352412, 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258215, 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml" 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3868611640, 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631007, 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml" 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3869677389, 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629749, 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-76.xml" 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.563 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3871375526, 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639332, 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-3.xml" 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3873365440, 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258263, 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml" 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3873801220, 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634951, 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-47.jpg" 2024-03-27T07:28:56.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3878274248, 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637352, 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-22.jpg" 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3878853634, 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261325, 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-3.xml" 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.565 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3882082058, 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635154, 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-4.jpg" 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3887738467, 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259059, 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml" 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3887933913, 2024-03-27T07:28:56.566 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639168, 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-27.xml" 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3888057940, 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636983, 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-23.xml" 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3889251971, 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265951, 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-35.jpg" 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3889991630, 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639495, 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-11.jpg" 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3891731715, 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634996, 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-38.jpg" 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3894072773, 2024-03-27T07:28:56.568 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261345, 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-14.jpg" 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3894114457, 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265931, 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-45.jpg" 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3902632050, 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265176, 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg" 2024-03-27T07:28:56.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3910541470, 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634039, 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-30.xml" 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3915252786, 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633831, 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-17.xml" 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.570 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3927418947, 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633768, 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-34.xml" 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3931022208, 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258934, 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-45.xml" 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3943372836, 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258341, 2024-03-27T07:28:56.571 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml" 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3948966563, 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638986, 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-22.jpg" 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3950850816, 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259439, 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-58.jpg" 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3955583929, 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258176, 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml" 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3959206203, 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634725, 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-4.xml" 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3964555038, 2024-03-27T07:28:56.573 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629864, 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-26.xml" 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3965693272, 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264973, 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-26.xml" 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.574 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3967297310, 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263127, 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-34.jpg" 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3968411765, 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638976, 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-32.jpg" 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3972724874, 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631430, 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-63.xml" 2024-03-27T07:28:56.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3974252302, 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634031, 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-34.xml" 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3986926719, 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638939, 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-8.xml" 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.576 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3987176575, 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265018, 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml" 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3988700537, 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633996, 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-56.xml" 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3988928265, 2024-03-27T07:28:56.577 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631098, 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-1.jpg" 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3991397021, 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636896, 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-39.xml" 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3996693824, 2024-03-27T07:28:56.578 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265917, 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-52.jpg" 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4001086176, 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261307, 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-7.xml" 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4007120864, 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638949, 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-59.jpg" 2024-03-27T07:28:56.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4013334174, 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634706, 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-8.xml" 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4016514180, 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632908, 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-34.xml" 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.580 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4016547585, 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258139, 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-66.xml" 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4019594613, 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629782, 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-61.xml" 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4023406284, 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261312, 2024-03-27T07:28:56.581 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-6.xml" 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4023942787, 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634318, 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-11.xml" 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4024172268, 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265869, 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-18.xml" 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4032566192, 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639246, 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-81.xml" 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4046832444, 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631437, 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-58.xml" 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4047168575, 2024-03-27T07:28:56.583 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265881, 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-12.xml" 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4047416297, 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634899, 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-57.jpg" 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4051580180, 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265167, 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg" 2024-03-27T07:28:56.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4056194723, 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635046, 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-29.jpg" 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4056203960, 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637307, 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-31.jpg" 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.585 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4057635371, 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265925, 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-48.jpg" 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4058454382, 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259590, 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg" 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4060356177, 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639357, 2024-03-27T07:28:56.586 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-30.jpg" 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4061526641, 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259324, 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-69.jpg" 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4064598006, 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634309, 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-16.xml" 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4069587206, 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633841, 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-15.xml" 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4074963652, 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636993, 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-21.xml" 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4078414544, 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638946, 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-1.xml" 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4080839385, 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259469, 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-53.jpg" 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4090280556, 2024-03-27T07:28:56.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639005, 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-3.jpg" 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4090442667, 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272752, 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-60.xml" 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4094696016, 2024-03-27T07:28:56.590 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629891, 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml" 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4094736771, 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630933, 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-74.xml" 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4097395113, 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259648, 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg" 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4100048590, 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511638993, 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-15.jpg" 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4101155184, 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635121, 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-11.jpg" 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.592 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4103535169, 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258392, 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml" 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4105979870, 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634070, 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-16.xml" 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4106925762, 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258915, 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-48.xml" 2024-03-27T07:28:56.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4110855201, 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629557, 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-96.jpg" 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4115995269, 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629909, 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml" 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4117171321, 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261360, 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-10.jpg" 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4127288098, 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258521, 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg" 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4128584600, 2024-03-27T07:28:56.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265875, 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-15.xml" 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4133418433, 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272792, 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-48.xml" 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4142673688, 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272795, 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-47.xml" 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4152154180, 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630882, 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml" 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4153265212, 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265969, 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-26.jpg" 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.597 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4160814116, 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629805, 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-53.xml" 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4162193033, 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265020, 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-63.jpg" 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4162744076, 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258292, 2024-03-27T07:28:56.598 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml" 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4163843480, 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639363, 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-26.jpg" 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4168982451, 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635108, 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-14.jpg" 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.599 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4169164274, 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258543, 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml" 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4172370911, 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633893, 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-2.xml" 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4178474496, 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265065, 2024-03-27T07:28:56.600 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-44.jpg" 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4179544092, 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634063, 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-20.xml" 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4180007428, 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258402, 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml" 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4183977790, 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633745, 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-39.xml" 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4188384420, 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637328, 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-27.jpg" 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.602 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4188744862, 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629808, 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-52.xml" 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4189998385, 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264987, 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-19.xml" 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4190517638, 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633813, 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-23.xml" 2024-03-27T07:28:56.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4192246579, 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634320, 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-9.xml" 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4192522591, 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259551, 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg" 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.604 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4196310662, 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629873, 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-17.xml" 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4201663718, 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634271, 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-38.xml" 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4202309272, 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262920, 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-50.xml" 2024-03-27T07:28:56.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4205451586, 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633998, 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-55.xml" 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4207654162, 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272587, 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-47.xml" 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.606 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4210437097, 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265927, 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-47.jpg" 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4215086247, 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258830, 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg" 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.607 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4215089007, 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630886, 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml" 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4218513589, 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259504, 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-46.jpg" 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4219479265, 2024-03-27T07:28:56.608 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258219, 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml" 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4219637153, 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639379, 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-16.jpg" 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4221860518, 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633885, 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-4.xml" 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4228952004, 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262592, 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-58.xml" 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4245713672, 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259293, 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-72.jpg" 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4246916498, 2024-03-27T07:28:56.610 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261368, 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-8.jpg" 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4247104696, 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639328, 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-5.xml" 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4247239402, 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629900, 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml" 2024-03-27T07:28:56.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4253704564, 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630905, 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml" 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4256145077, 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639396, 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-4.jpg" 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.612 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4263383292, 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259358, 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-66.jpg" 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4264685204, 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511637411, 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-10.jpg" 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4265962751, 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639400, 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-1.jpg" 2024-03-27T07:28:56.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4267844668, 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639387, 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-11.jpg" 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4270453021, 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272920, 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-8.xml" 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.614 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4271277156, 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634908, 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-55.jpg" 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4273305761, 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511639330, 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-4.xml" 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4275783209, 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023272927, 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-5.xml" 2024-03-27T07:28:56.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4275897708, 2024-03-27T07:28:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630909, 2024-03-27T07:28:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml" 2024-03-27T07:28:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.616 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4287197458, 2024-03-27T07:28:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263277, 2024-03-27T07:28:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-75.xml" 2024-03-27T07:28:56.617 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:28:56.617 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-03-27T07:28:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 -- 172.21.15.82:0/3758022999 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f72240a3780 msgr2=0x7f72240a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f72240a3780 0x7f72240a5c40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55e930080070 tx=0x7f72300096c0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 -- 172.21.15.82:0/3758022999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c105a20 msgr2=0x7f723c19cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c105a20 0x7f723c19cbf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7234009fd0 tx=0x7f723400ef10 comp rx=0 tx=0).stop 2024-03-27T07:28:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 -- 172.21.15.82:0/3758022999 shutdown_connections 2024-03-27T07:28:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f72240a3780 0x7f72240a5c40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f723c105a20 0x7f723c19cbf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f723c101ac0 0x7f723c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 --2- 172.21.15.82:0/3758022999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f723c101100 0x7f723c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 -- 172.21.15.82:0/3758022999 >> 172.21.15.82:0/3758022999 conn(0x7f723c076f70 msgr2=0x7f723c1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:56.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 -- 172.21.15.82:0/3758022999 shutdown_connections 2024-03-27T07:28:56.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:55.968+0000 7f7242383640 1 -- 172.21.15.82:0/3758022999 wait complete. 2024-03-27T07:28:56.622 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T07:28:56.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.730+0000 7f6c682b8640 1 -- 172.21.15.82:0/2313363547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c601009c0 msgr2=0x7f6c60100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:56.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.730+0000 7f6c682b8640 1 --2- 172.21.15.82:0/2313363547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c601009c0 0x7f6c60100e40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009930 tx=0x7f6c5002bc30 comp rx=0 tx=0).stop 2024-03-27T07:28:56.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.730+0000 7f6c682b8640 1 -- 172.21.15.82:0/2313363547 shutdown_connections 2024-03-27T07:28:56.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.730+0000 7f6c682b8640 1 --2- 172.21.15.82:0/2313363547 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c601009c0 0x7f6c60100e40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.730+0000 7f6c682b8640 1 --2- 172.21.15.82:0/2313363547 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c60101380 0x7f6c6010d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.730+0000 7f6c682b8640 1 --2- 172.21.15.82:0/2313363547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c601069d0 0x7f6c60106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.730+0000 7f6c682b8640 1 -- 172.21.15.82:0/2313363547 >> 172.21.15.82:0/2313363547 conn(0x7f6c60077b50 msgr2=0x7f6c60077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:56.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.730+0000 7f6c682b8640 1 -- 172.21.15.82:0/2313363547 shutdown_connections 2024-03-27T07:28:56.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.730+0000 7f6c682b8640 1 -- 172.21.15.82:0/2313363547 wait complete. 2024-03-27T07:28:56.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c682b8640 1 Processor -- start 2024-03-27T07:28:56.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c682b8640 1 -- start start 2024-03-27T07:28:56.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c682b8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c601009c0 0x7f6c60199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c682b8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c60101380 0x7f6c60199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c682b8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c601069d0 0x7f6c601a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c682b8640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c60110e30 con 0x7f6c601009c0 2024-03-27T07:28:56.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c682b8640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6c60110cb0 con 0x7f6c60101380 2024-03-27T07:28:56.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c682b8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c60110fb0 con 0x7f6c601069d0 2024-03-27T07:28:56.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c66054640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c601009c0 0x7f6c60199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c66054640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c601009c0 0x7f6c60199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48582/0 (socket says 172.21.15.82:48582) 2024-03-27T07:28:56.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c66054640 1 -- 172.21.15.82:0/1565787604 learned_addr learned my addr 172.21.15.82:0/1565787604 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c65853640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c60101380 0x7f6c60199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.731+0000 7f6c66855640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c601069d0 0x7f6c601a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c66054640 1 -- 172.21.15.82:0/1565787604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c601069d0 msgr2=0x7f6c601a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c66054640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c601069d0 0x7f6c601a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c66054640 1 -- 172.21.15.82:0/1565787604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c60101380 msgr2=0x7f6c60199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c66054640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c60101380 0x7f6c60199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c66054640 1 -- 172.21.15.82:0/1565787604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c601a4810 con 0x7f6c601009c0 2024-03-27T07:28:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c66054640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c601009c0 0x7f6c60199250 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00e9f0 tx=0x7f6c5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:56.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c577fe640 1 -- 172.21.15.82:0/1565787604 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00cd80 con 0x7f6c601009c0 2024-03-27T07:28:56.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c682b8640 1 -- 172.21.15.82:0/1565787604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c601a4a40 con 0x7f6c601009c0 2024-03-27T07:28:56.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c577fe640 1 -- 172.21.15.82:0/1565787604 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c5c005500 con 0x7f6c601009c0 2024-03-27T07:28:56.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c577fe640 1 -- 172.21.15.82:0/1565787604 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c010690 con 0x7f6c601009c0 2024-03-27T07:28:56.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.732+0000 7f6c682b8640 1 -- 172.21.15.82:0/1565787604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c601a4f60 con 0x7f6c601009c0 2024-03-27T07:28:56.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.734+0000 7f6c577fe640 1 -- 172.21.15.82:0/1565787604 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f6c5c0046c0 con 0x7f6c601009c0 2024-03-27T07:28:56.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c6af76740 1 Processor -- start 2024-03-27T07:28:56.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c6af76740 1 -- start start 2024-03-27T07:28:56.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc162840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 0x555cbc16fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc1724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c6af76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555cbc0c6710 con 0x555cbc1700c0 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c6af76740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555cbc06eaf0 con 0x555cbc162d80 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c6af76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555cbc0c26c0 con 0x555cbc162460 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c577fe640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6c4c0a3780 0x7f6c4c0a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c66054640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 0x555cbc16fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c66855640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6c4c0a3780 0x7f6c4c0a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c65853640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc1724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c65853640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc1724b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48586/0 (socket says 172.21.15.82:48586) 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c65853640 1 -- 172.21.15.82:0/3538602337 learned_addr learned my addr 172.21.15.82:0/3538602337 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c66855640 1 --2- 172.21.15.82:0/3538602337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc162840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.735+0000 7f6c577fe640 1 -- 172.21.15.82:0/1565787604 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f6c5c0d0470 con 0x7f6c601009c0 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c65853640 1 -- 172.21.15.82:0/3538602337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 msgr2=0x555cbc162840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c65853640 1 --2- 172.21.15.82:0/3538602337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc162840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c65853640 1 -- 172.21.15.82:0/3538602337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 msgr2=0x555cbc16fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c65853640 1 --2- 172.21.15.82:0/3538602337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 0x555cbc16fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c65853640 1 -- 172.21.15.82:0/3538602337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cbbdda3f0 con 0x555cbc1700c0 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c66054640 1 --2- 172.21.15.82:0/3538602337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 0x555cbc16fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c66855640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6c4c0a3780 0x7f6c4c0a5c40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c58005fd0 tx=0x7f6c58009de0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c65853640 1 --2- 172.21.15.82:0/3538602337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc1724b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6c50000c00 tx=0x7f6c500095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5ba69902c238d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c54bfe640 1 -- 172.21.15.82:0/3538602337 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c50045070 con 0x555cbc1700c0 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c54bfe640 1 -- 172.21.15.82:0/3538602337 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c5002c880 con 0x555cbc1700c0 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.736+0000 7f6c54bfe640 1 -- 172.21.15.82:0/3538602337 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c50004b80 con 0x555cbc1700c0 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 -- 172.21.15.82:0/3538602337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 msgr2=0x555cbc1724b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:56.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 --2- 172.21.15.82:0/3538602337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc1724b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6c50000c00 tx=0x7f6c500095e0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 -- 172.21.15.82:0/3538602337 shutdown_connections 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 --2- 172.21.15.82:0/3538602337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc1724b0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 --2- 172.21.15.82:0/3538602337 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 0x555cbc16fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 --2- 172.21.15.82:0/3538602337 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc162840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 -- 172.21.15.82:0/3538602337 >> 172.21.15.82:0/3538602337 conn(0x555cbc15cee0 msgr2=0x555cbc15d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 -- 172.21.15.82:0/3538602337 shutdown_connections 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 -- 172.21.15.82:0/3538602337 wait complete. 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 -- start start 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 Processor -- start 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc16d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 0x555cbc16d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc16db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555cbc172ea0 con 0x555cbc1700c0 2024-03-27T07:28:56.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555cbc081eb0 con 0x555cbc162d80 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555cbc173020 con 0x555cbc162460 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.737+0000 7f6c6af76740 10 client.0 _ll_register_callbacks cb 0x555cbc0be6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c66855640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc16db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c66855640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc16db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48592/0 (socket says 172.21.15.82:48592) 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c66855640 1 -- 172.21.15.82:0/3655374912 learned_addr learned my addr 172.21.15.82:0/3655374912 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c65853640 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 0x555cbc16d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c66054640 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc16d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c66855640 1 -- 172.21.15.82:0/3655374912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 msgr2=0x555cbc16d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c66855640 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc16d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c66855640 1 -- 172.21.15.82:0/3655374912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 msgr2=0x555cbc16d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c66855640 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 0x555cbc16d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c66855640 1 -- 172.21.15.82:0/3655374912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cbbea47d0 con 0x555cbc1700c0 2024-03-27T07:28:56.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c66855640 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc16db00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6c58010d30 tx=0x7f6c580096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f31b338b317d17 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c49ffb640 1 -- 172.21.15.82:0/3655374912 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5802a410 con 0x555cbc1700c0 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c49ffb640 1 -- 172.21.15.82:0/3655374912 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f6c5802a5b0 con 0x555cbc1700c0 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c6af76740 1 -- 172.21.15.82:0/3655374912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c5002c880 con 0x555cbc1700c0 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c49ffb640 1 -- 172.21.15.82:0/3655374912 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6c5802a7b0 con 0x555cbc1700c0 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c6af76740 10 client.16755 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.738+0000 7f6c6af76740 1 -- 172.21.15.82:0/3655374912 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555cbc17f1a0 con 0x555cbc1700c0 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c49ffb640 1 -- 172.21.15.82:0/3655374912 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c5002c880 con 0x555cbc1700c0 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c49ffb640 1 -- 172.21.15.82:0/3655374912 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f6c5801f070 con 0x555cbc1700c0 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c6af76740 10 client.16755 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c6af76740 10 client.16755 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c6af76740 20 client.16755 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c6af76740 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555cbc180670 0x555cbc182ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c6af76740 4 client.16755 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:56.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c6af76740 1 -- 172.21.15.82:0/3655374912 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cbc0d3c50 con 0x555cbc180670 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c66054640 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555cbc180670 0x555cbc182ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c49ffb640 10 client.16755 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.739+0000 7f6c66054640 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555cbc180670 0x555cbc182ad0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29d5de8e08b5ad42 server_cookie=a970c126ad71439f in_seq=0 out_seq=0 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c49ffb640 1 -- 172.21.15.82:0/3655374912 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x555cbc0d3c50 con 0x555cbc180670 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c49ffb640 10 client.16755 handle_command_reply: tid=0 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 client.16755 shutdown 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 -- 172.21.15.82:0/3655374912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 msgr2=0x555cbc16db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc16db00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6c58010d30 tx=0x7f6c580096a0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 -- 172.21.15.82:0/3655374912 shutdown_connections 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555cbc180670 0x555cbc182ad0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc1700c0 0x555cbc16db00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c49ffb640 0 client.16755 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:28:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc162d80 0x555cbc16d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 --2- 172.21.15.82:0/3655374912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc16d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 -- 172.21.15.82:0/3655374912 >> 172.21.15.82:0/3655374912 conn(0x555cbc15cee0 msgr2=0x555cbc15ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 -- 172.21.15.82:0/3655374912 shutdown_connections 2024-03-27T07:28:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 1 -- 172.21.15.82:0/3655374912 wait complete. 2024-03-27T07:28:56.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.740+0000 7f6c6af76740 20 client.16755 trim_cache size 0 max 16384 2024-03-27T07:28:56.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c6af76740 1 Processor -- start 2024-03-27T07:28:56.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c6af76740 1 -- start start 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc16f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162d80 0x555cbc17bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 0x555cbc1883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c6af76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c601add90 con 0x555cbc162d80 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c6af76740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6c601ab600 con 0x555cbc1700c0 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c6af76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c601a9470 con 0x555cbc162460 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c65853640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162d80 0x555cbc17bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c65853640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162d80 0x555cbc17bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48602/0 (socket says 172.21.15.82:48602) 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c66054640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc16f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c65853640 1 -- 172.21.15.82:0/1699349761 learned_addr learned my addr 172.21.15.82:0/1699349761 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:56.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c66855640 1 --2- 172.21.15.82:0/1699349761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 0x555cbc1883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c65853640 1 -- 172.21.15.82:0/1699349761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 msgr2=0x555cbc16f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c65853640 1 --2- 172.21.15.82:0/1699349761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc16f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c65853640 1 -- 172.21.15.82:0/1699349761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 msgr2=0x555cbc1883a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c65853640 1 --2- 172.21.15.82:0/1699349761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 0x555cbc1883a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c65853640 1 -- 172.21.15.82:0/1699349761 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cbc162bb0 con 0x555cbc162d80 2024-03-27T07:28:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.755+0000 7f6c66855640 1 --2- 172.21.15.82:0/1699349761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 0x555cbc1883a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.756+0000 7f6c65853640 1 --2- 172.21.15.82:0/1699349761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162d80 0x555cbc17bcb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6c5002c320 tx=0x7f6c50004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb43bc8bcb12f1bf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.756+0000 7f6c4bfff640 1 -- 172.21.15.82:0/1699349761 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c50045040 con 0x555cbc162d80 2024-03-27T07:28:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.756+0000 7f6c4bfff640 1 -- 172.21.15.82:0/1699349761 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c50004240 con 0x555cbc162d80 2024-03-27T07:28:56.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.756+0000 7f6c4bfff640 1 -- 172.21.15.82:0/1699349761 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c50004ee0 con 0x555cbc162d80 2024-03-27T07:28:56.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.756+0000 7f6c6af76740 1 -- 172.21.15.82:0/1699349761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162d80 msgr2=0x555cbc17bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:56.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.756+0000 7f6c6af76740 1 --2- 172.21.15.82:0/1699349761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162d80 0x555cbc17bcb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6c5002c320 tx=0x7f6c50004760 comp rx=0 tx=0).stop 2024-03-27T07:28:56.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.756+0000 7f6c6af76740 1 -- 172.21.15.82:0/1699349761 shutdown_connections 2024-03-27T07:28:56.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.756+0000 7f6c6af76740 1 --2- 172.21.15.82:0/1699349761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162d80 0x555cbc17bcb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.756+0000 7f6c6af76740 1 --2- 172.21.15.82:0/1699349761 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 0x555cbc1883a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.756+0000 7f6c6af76740 1 --2- 172.21.15.82:0/1699349761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162460 0x555cbc16f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 -- 172.21.15.82:0/1699349761 >> 172.21.15.82:0/1699349761 conn(0x555cbc15cee0 msgr2=0x555cbc15ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:56.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 -- 172.21.15.82:0/1699349761 shutdown_connections 2024-03-27T07:28:56.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 -- 172.21.15.82:0/1699349761 wait complete. 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 -- start start 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 Processor -- start 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162460 0x555cbc173dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162d80 0x555cbc174310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 0x555cbc174850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6c601a9ac0 con 0x555cbc162460 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6c601aaf30 con 0x555cbc1700c0 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6c601aa190 con 0x555cbc162d80 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c6af76740 10 client.0 _ll_register_callbacks cb 0x7f6c58009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c66054640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162460 0x555cbc173dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c66054640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162460 0x555cbc173dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48610/0 (socket says 172.21.15.82:48610) 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c66054640 1 -- 172.21.15.82:0/2515233923 learned_addr learned my addr 172.21.15.82:0/2515233923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c65853640 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162d80 0x555cbc174310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c66855640 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 0x555cbc174850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c66054640 1 -- 172.21.15.82:0/2515233923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162d80 msgr2=0x555cbc174310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c66054640 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162d80 0x555cbc174310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c66054640 1 -- 172.21.15.82:0/2515233923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 msgr2=0x555cbc174850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c66054640 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 0x555cbc174850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c66054640 1 -- 172.21.15.82:0/2515233923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cbc1e5bd0 con 0x555cbc162460 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.757+0000 7f6c66855640 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 0x555cbc174850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c66054640 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162460 0x555cbc173dd0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00e9c0 tx=0x7f6c5c098a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efdad6b45128504 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c49ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c49ffb640 1 -- 172.21.15.82:0/2515233923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c09cd50 con 0x555cbc162460 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c49ffb640 1 -- 172.21.15.82:0/2515233923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f6c5c0cde90 con 0x555cbc162460 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c6af76740 1 -- 172.21.15.82:0/2515233923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c50004240 con 0x555cbc162460 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c49ffb640 1 -- 172.21.15.82:0/2515233923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6c5c09c650 con 0x555cbc162460 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c6af76740 10 client.16761 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:56.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c6af76740 1 -- 172.21.15.82:0/2515233923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555cbc1e6e80 con 0x555cbc162460 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c49ffb640 1 -- 172.21.15.82:0/2515233923 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c50004240 con 0x555cbc162460 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c49ffb640 1 -- 172.21.15.82:0/2515233923 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f6c5c0b5be0 con 0x555cbc162460 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c6af76740 10 client.16761 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c6af76740 10 client.16761 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c6af76740 20 client.16761 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c6af76740 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555cbc1e7580 0x555cbc1e99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c6af76740 4 client.16761 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.758+0000 7f6c6af76740 1 -- 172.21.15.82:0/2515233923 --> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555cbc0cdfa0 con 0x555cbc1e7580 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.759+0000 7f6c65853640 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555cbc1e7580 0x555cbc1e99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.759+0000 7f6c49ffb640 10 client.16761 ms_handle_connect on v2:172.21.15.153:6838/1505538081 2024-03-27T07:28:56.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.759+0000 7f6c65853640 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555cbc1e7580 0x555cbc1e99a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fac6bf57b1612acf server_cookie=27c57fe90f8be072 in_seq=0 out_seq=0 2024-03-27T07:28:56.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c49ffb640 1 -- 172.21.15.82:0/2515233923 <== mds.1 v2:172.21.15.153:6838/1505538081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+449295 (crc 0 0 0) 0x555cbc0cdfa0 con 0x555cbc1e7580 2024-03-27T07:28:56.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c49ffb640 10 client.16761 handle_command_reply: tid=0 2024-03-27T07:28:56.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 client.16761 shutdown 2024-03-27T07:28:56.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 -- 172.21.15.82:0/2515233923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162460 msgr2=0x555cbc173dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:56.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162460 0x555cbc173dd0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00e9c0 tx=0x7f6c5c098a20 comp rx=0 tx=0).stop 2024-03-27T07:28:56.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 -- 172.21.15.82:0/2515233923 shutdown_connections 2024-03-27T07:28:56.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.153:6838/1505538081,v1:172.21.15.153:6839/1505538081] conn(0x555cbc1e7580 0x555cbc1e99a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555cbc1700c0 0x555cbc174850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555cbc162d80 0x555cbc174310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 --2- 172.21.15.82:0/2515233923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555cbc162460 0x555cbc173dd0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:56.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c49ffb640 0 client.16761 ms_handle_reset on v2:172.21.15.153:6838/1505538081 2024-03-27T07:28:56.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 -- 172.21.15.82:0/2515233923 >> 172.21.15.82:0/2515233923 conn(0x555cbc15cee0 msgr2=0x555cbc15e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:56.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 -- 172.21.15.82:0/2515233923 shutdown_connections 2024-03-27T07:28:56.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 1 -- 172.21.15.82:0/2515233923 wait complete. 2024-03-27T07:28:56.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.768+0000 7f6c6af76740 20 client.16761 trim_cache size 0 max 16384 2024-03-27T07:28:56.777 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-03-27T07:28:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2581179, 2024-03-27T07:28:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259371, 2024-03-27T07:28:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-44.xml" 2024-03-27T07:28:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 5960736, 2024-03-27T07:28:56.778 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633984, 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-61.xml" 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 6883223, 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633725, 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg" 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 7466658, 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260026, 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-13.xml" 2024-03-27T07:28:56.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 10446132, 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265966, 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-79.jpg" 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 11072526, 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633962, 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-76.xml" 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 13639018, 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259660, 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-32.jpg" 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 14118378, 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263100, 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-58.xml" 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.781 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 14214924, 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264070, 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-100.xml" 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 14606297, 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630180, 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-11.xml" 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.782 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 17918484, 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630232, 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-78.jpg" 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 21445240, 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267410, 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-37.jpg" 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.783 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 23149252, 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636053, 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-38.xml" 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 30368738, 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634379, 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-8.xml" 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 32175633, 2024-03-27T07:28:56.784 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259376, 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-43.xml" 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 36170590, 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267552, 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg" 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 37995467, 2024-03-27T07:28:56.785 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634090, 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-30.xml" 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 39060465, 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263058, 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-9.jpg" 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 43828544, 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629925, 2024-03-27T07:28:56.786 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-29.jpg" 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 45133368, 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267747, 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-69.jpg" 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 47523533, 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631409, 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-75.xml" 2024-03-27T07:28:56.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 49777070, 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267135, 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-35.xml" 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 51291479, 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263052, 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-11.jpg" 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.788 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 52536823, 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258424, 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-10.jpg" 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 52992313, 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259646, 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-36.jpg" 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 55296637, 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630127, 2024-03-27T07:28:56.789 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-37.xml" 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 56066957, 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635975, 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-61.xml" 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 58187362, 2024-03-27T07:28:56.790 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263044, 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-7.jpg" 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 58762609, 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634392, 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-88.xml" 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 60298571, 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630831, 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-4.jpg" 2024-03-27T07:28:56.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 61957045, 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259607, 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-47.jpg" 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 62556358, 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263264, 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-2.xml" 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.792 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 63631199, 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259423, 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml" 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 66140455, 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634401, 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-81.xml" 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.793 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 66471695, 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630125, 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-39.xml" 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 69446029, 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263397, 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-66.xml" 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 70555587, 2024-03-27T07:28:56.794 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633677, 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-31.jpg" 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 74922783, 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630352, 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-36.jpg" 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 76772073, 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267151, 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-31.xml" 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 76942593, 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267744, 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-70.jpg" 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 83252823, 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631231, 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-89.xml" 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.796 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 87061080, 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634067, 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-17.xml" 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 88358900, 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267147, 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-32.xml" 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 89126414, 2024-03-27T07:28:56.797 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262010, 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-74.xml" 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 89203700, 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263313, 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-93.xml" 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 89271642, 2024-03-27T07:28:56.798 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634427, 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-59.xml" 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 94299936, 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267701, 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-2.xml" 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 99430666, 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265952, 2024-03-27T07:28:56.799 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-5.xml" 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 101177436, 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633469, 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-31.xml" 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 104908372, 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631440, 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-68.xml" 2024-03-27T07:28:56.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 112783178, 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267490, 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg" 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 116639531, 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633511, 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-14.xml" 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.801 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 119433649, 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631033, 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-2.jpg" 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 119726236, 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263258, 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-4.xml" 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.802 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 120201404, 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264099, 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-94.xml" 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 121291247, 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631052, 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-33.xml" 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.803 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 121446066, 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262836, 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-6.xml" 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 123261384, 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630322, 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-61.jpg" 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.804 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 127029914, 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259403, 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-38.xml" 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 128931813, 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634693, 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-84.xml" 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.805 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 131991085, 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634060, 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-42.xml" 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 132489310, 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634019, 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-59.xml" 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 142658508, 2024-03-27T07:28:56.806 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630100, 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-50.xml" 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 144902060, 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263015, 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-24.jpg" 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 147207771, 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263071, 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-5.jpg" 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 147992844, 2024-03-27T07:28:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261985, 2024-03-27T07:28:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-80.xml" 2024-03-27T07:28:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 149830499, 2024-03-27T07:28:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634337, 2024-03-27T07:28:56.808 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-41.xml" 2024-03-27T07:28:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 155835028, 2024-03-27T07:28:56.809 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631732, 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-58.xml" 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 157705563, 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634633, 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-90.xml" 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 158771954, 2024-03-27T07:28:56.810 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267182, 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-23.xml" 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 158878253, 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257464, 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-28.xml" 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 163488956, 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634359, 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-26.xml" 2024-03-27T07:28:56.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 167047724, 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267704, 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-1.xml" 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 171231807, 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267339, 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-90.jpg" 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.812 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 176820013, 2024-03-27T07:28:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263055, 2024-03-27T07:28:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-10.jpg" 2024-03-27T07:28:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.813 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 190246417, 2024-03-27T07:28:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266075, 2024-03-27T07:28:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-25.jpg" 2024-03-27T07:28:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.814 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 190757515, 2024-03-27T07:28:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267274, 2024-03-27T07:28:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml" 2024-03-27T07:28:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.815 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 191281946, 2024-03-27T07:28:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267729, 2024-03-27T07:28:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-75.jpg" 2024-03-27T07:28:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.816 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 192938138, 2024-03-27T07:28:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267456, 2024-03-27T07:28:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-56.jpg" 2024-03-27T07:28:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.817 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 194977344, 2024-03-27T07:28:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267609, 2024-03-27T07:28:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-32.xml" 2024-03-27T07:28:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 202053483, 2024-03-27T07:28:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265942, 2024-03-27T07:28:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-10.xml" 2024-03-27T07:28:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 205216365, 2024-03-27T07:28:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267276, 2024-03-27T07:28:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-60.jpg" 2024-03-27T07:28:56.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 207629221, 2024-03-27T07:28:56.821 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633938, 2024-03-27T07:28:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-87.xml" 2024-03-27T07:28:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.822 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 221594828, 2024-03-27T07:28:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631224, 2024-03-27T07:28:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-94.xml" 2024-03-27T07:28:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.823 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 221866805, 2024-03-27T07:28:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634013, 2024-03-27T07:28:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-45.xml" 2024-03-27T07:28:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.824 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 222477616, 2024-03-27T07:28:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634049, 2024-03-27T07:28:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-48.xml" 2024-03-27T07:28:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 226720536, 2024-03-27T07:28:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267566, 2024-03-27T07:28:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-1.jpg" 2024-03-27T07:28:56.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 227871290, 2024-03-27T07:28:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261189, 2024-03-27T07:28:56.827 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-48.xml" 2024-03-27T07:28:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 228694023, 2024-03-27T07:28:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267448, 2024-03-27T07:28:56.828 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-32.jpg" 2024-03-27T07:28:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 231498145, 2024-03-27T07:28:56.829 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630149, 2024-03-27T07:28:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-28.xml" 2024-03-27T07:28:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 231750383, 2024-03-27T07:28:56.830 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262881, 2024-03-27T07:28:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-62.jpg" 2024-03-27T07:28:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 233564782, 2024-03-27T07:28:56.831 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267853, 2024-03-27T07:28:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-34.jpg" 2024-03-27T07:28:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 236878205, 2024-03-27T07:28:56.832 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259308, 2024-03-27T07:28:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-59.xml" 2024-03-27T07:28:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.833 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 238154396, 2024-03-27T07:28:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263394, 2024-03-27T07:28:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-67.xml" 2024-03-27T07:28:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 243047758, 2024-03-27T07:28:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262809, 2024-03-27T07:28:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-17.xml" 2024-03-27T07:28:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 243884495, 2024-03-27T07:28:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261446, 2024-03-27T07:28:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-53.jpg" 2024-03-27T07:28:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 244092475, 2024-03-27T07:28:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263933, 2024-03-27T07:28:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-55.xml" 2024-03-27T07:28:56.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 244886363, 2024-03-27T07:28:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267463, 2024-03-27T07:28:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-54.jpg" 2024-03-27T07:28:56.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.839 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.839 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 245212108, 2024-03-27T07:28:56.839 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634383, 2024-03-27T07:28:56.839 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-4.xml" 2024-03-27T07:28:56.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.840 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.840 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 251869776, 2024-03-27T07:28:56.840 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634105, 2024-03-27T07:28:56.840 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-25.xml" 2024-03-27T07:28:56.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.841 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.841 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.841 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 254650170, 2024-03-27T07:28:56.841 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257561, 2024-03-27T07:28:56.841 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml" 2024-03-27T07:28:56.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.842 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.842 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.842 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 259127520, 2024-03-27T07:28:56.842 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634018, 2024-03-27T07:28:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-40.xml" 2024-03-27T07:28:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.843 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 260259845, 2024-03-27T07:28:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267549, 2024-03-27T07:28:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg" 2024-03-27T07:28:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.844 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 260734156, 2024-03-27T07:28:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265940, 2024-03-27T07:28:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-11.xml" 2024-03-27T07:28:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.845 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 262818674, 2024-03-27T07:28:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631227, 2024-03-27T07:28:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg" 2024-03-27T07:28:56.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 263603712, 2024-03-27T07:28:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263012, 2024-03-27T07:28:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-1.xml" 2024-03-27T07:28:56.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 265403928, 2024-03-27T07:28:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259497, 2024-03-27T07:28:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml" 2024-03-27T07:28:56.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 265735203, 2024-03-27T07:28:56.849 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264255, 2024-03-27T07:28:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg" 2024-03-27T07:28:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 266485973, 2024-03-27T07:28:56.850 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634645, 2024-03-27T07:28:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-86.xml" 2024-03-27T07:28:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.851 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 269177654, 2024-03-27T07:28:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630211, 2024-03-27T07:28:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-80.jpg" 2024-03-27T07:28:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.852 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 271343112, 2024-03-27T07:28:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263951, 2024-03-27T07:28:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-51.xml" 2024-03-27T07:28:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.853 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 272505376, 2024-03-27T07:28:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263328, 2024-03-27T07:28:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-88.xml" 2024-03-27T07:28:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.854 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 274240479, 2024-03-27T07:28:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633969, 2024-03-27T07:28:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-72.xml" 2024-03-27T07:28:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 277726945, 2024-03-27T07:28:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633936, 2024-03-27T07:28:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-89.xml" 2024-03-27T07:28:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.856 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 280995822, 2024-03-27T07:28:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263346, 2024-03-27T07:28:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-82.xml" 2024-03-27T07:28:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 281239518, 2024-03-27T07:28:56.857 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634769, 2024-03-27T07:28:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-14.xml" 2024-03-27T07:28:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 283210041, 2024-03-27T07:28:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630340, 2024-03-27T07:28:56.858 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-45.jpg" 2024-03-27T07:28:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 284311634, 2024-03-27T07:28:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267470, 2024-03-27T07:28:56.859 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-52.jpg" 2024-03-27T07:28:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 284757603, 2024-03-27T07:28:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266038, 2024-03-27T07:28:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-43.jpg" 2024-03-27T07:28:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.860 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 285871132, 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262990, 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-20.jpg" 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 287631243, 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633523, 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-10.xml" 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.861 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 289315281, 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262017, 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-72.xml" 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 289953077, 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634276, 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-67.xml" 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.862 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 290720773, 2024-03-27T07:28:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259986, 2024-03-27T07:28:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-21.xml" 2024-03-27T07:28:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 297573646, 2024-03-27T07:28:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259643, 2024-03-27T07:28:56.863 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-37.jpg" 2024-03-27T07:28:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 298895800, 2024-03-27T07:28:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634390, 2024-03-27T07:28:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-90.xml" 2024-03-27T07:28:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.864 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 299735923, 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630354, 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-34.jpg" 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 299847761, 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634099, 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-27.xml" 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.865 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 303081811, 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630319, 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-64.jpg" 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 304447178, 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267531, 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg" 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 306295153, 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634364, 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-21.xml" 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 307063160, 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263064, 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-7.jpg" 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 307773486, 2024-03-27T07:28:56.867 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634526, 2024-03-27T07:28:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-34.xml" 2024-03-27T07:28:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 312539304, 2024-03-27T07:28:56.868 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263018, 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-15.jpg" 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 314257369, 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634378, 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-9.xml" 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 318254430, 2024-03-27T07:28:56.869 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259757, 2024-03-27T07:28:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg" 2024-03-27T07:28:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 318407441, 2024-03-27T07:28:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633730, 2024-03-27T07:28:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-62.xml" 2024-03-27T07:28:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.870 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 319323843, 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630811, 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-9.jpg" 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 319494926, 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631745, 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-53.xml" 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.871 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 321494117, 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259796, 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-65.xml" 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 321590280, 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259344, 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-50.xml" 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 323764221, 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267290, 2024-03-27T07:28:56.872 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml" 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 326433680, 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259397, 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-95.xml" 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 327816536, 2024-03-27T07:28:56.873 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634413, 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-73.xml" 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 328885993, 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630326, 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-57.jpg" 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 332992866, 2024-03-27T07:28:56.874 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263199, 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-21.xml" 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 336111467, 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634391, 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-89.xml" 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 336869927, 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257241, 2024-03-27T07:28:56.875 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-52.xml" 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 340419577, 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634141, 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-4.xml" 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 340846954, 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259578, 2024-03-27T07:28:56.876 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml" 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 343193734, 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633453, 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-36.xml" 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 347402927, 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267370, 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-81.jpg" 2024-03-27T07:28:56.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 349042962, 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257687, 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-68.jpg" 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 354860953, 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262604, 2024-03-27T07:28:56.878 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-21.xml" 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 354884883, 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263349, 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-81.xml" 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 356604149, 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267166, 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-27.xml" 2024-03-27T07:28:56.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 360794164, 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631853, 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-51.xml" 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 361597213, 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630312, 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-70.jpg" 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.880 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 364332397, 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262821, 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-12.xml" 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 364417465, 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262874, 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-65.jpg" 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.881 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 367989345, 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634234, 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-76.xml" 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 369422474, 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257915, 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-39.jpg" 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.882 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 373969127, 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261871, 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-91.xml" 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 376376058, 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262851, 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-74.jpg" 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.883 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 379896170, 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263352, 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-80.xml" 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 380842769, 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267460, 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-55.jpg" 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.884 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 388841996, 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258706, 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-21.jpg" 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 389606645, 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263002, 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-18.jpg" 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 392470006, 2024-03-27T07:28:56.885 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634147, 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-17.xml" 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 395323059, 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265960, 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-1.xml" 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.886 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 402436917, 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264304, 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg" 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 410777601, 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267643, 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-20.xml" 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 412102631, 2024-03-27T07:28:56.887 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634384, 2024-03-27T07:28:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-3.xml" 2024-03-27T07:28:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 412261084, 2024-03-27T07:28:56.888 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633940, 2024-03-27T07:28:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-85.xml" 2024-03-27T07:28:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 413673067, 2024-03-27T07:28:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263170, 2024-03-27T07:28:56.889 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-30.xml" 2024-03-27T07:28:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 414298418, 2024-03-27T07:28:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267502, 2024-03-27T07:28:56.890 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg" 2024-03-27T07:28:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 422075658, 2024-03-27T07:28:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267641, 2024-03-27T07:28:56.891 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg" 2024-03-27T07:28:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 423181954, 2024-03-27T07:28:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259328, 2024-03-27T07:28:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-54.xml" 2024-03-27T07:28:56.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 423385980, 2024-03-27T07:28:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267612, 2024-03-27T07:28:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-31.xml" 2024-03-27T07:28:56.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 423509821, 2024-03-27T07:28:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261221, 2024-03-27T07:28:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-39.xml" 2024-03-27T07:28:56.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 423908550, 2024-03-27T07:28:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264138, 2024-03-27T07:28:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-9.xml" 2024-03-27T07:28:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.895 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 424582679, 2024-03-27T07:28:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259398, 2024-03-27T07:28:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-39.xml" 2024-03-27T07:28:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 424765002, 2024-03-27T07:28:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634354, 2024-03-27T07:28:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-31.xml" 2024-03-27T07:28:56.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 425493546, 2024-03-27T07:28:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264127, 2024-03-27T07:28:56.898 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-11.xml" 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 431325378, 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636099, 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-28.xml" 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 432364297, 2024-03-27T07:28:56.899 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267224, 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-11.xml" 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 432863125, 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634366, 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-19.xml" 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 435797282, 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263441, 2024-03-27T07:28:56.900 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-52.xml" 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 440826561, 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263130, 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-46.xml" 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 440946009, 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634434, 2024-03-27T07:28:56.901 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-52.xml" 2024-03-27T07:28:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 447570411, 2024-03-27T07:28:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267723, 2024-03-27T07:28:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-77.jpg" 2024-03-27T07:28:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.902 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 451239205, 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634362, 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-23.xml" 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 451896321, 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630124, 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-40.xml" 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 453009978, 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267210, 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-15.xml" 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 456009049, 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262861, 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-70.jpg" 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 459504368, 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264478, 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg" 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 459807042, 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263838, 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-74.xml" 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.905 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 459828262, 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267266, 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml" 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 462913481, 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636072, 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-33.xml" 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.906 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 464447586, 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634369, 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-93.jpg" 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 472657614, 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634225, 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-78.xml" 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.907 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 477926100, 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633964, 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-73.xml" 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 483317144, 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267765, 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-63.jpg" 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 485598095, 2024-03-27T07:28:56.908 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634386, 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-1.xml" 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 487022670, 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023274645, 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-3.xml" 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 488623105, 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262948, 2024-03-27T07:28:56.909 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-35.jpg" 2024-03-27T07:28:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 491148637, 2024-03-27T07:28:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634374, 2024-03-27T07:28:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-13.xml" 2024-03-27T07:28:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.910 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 493346505, 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264174, 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-3.xml" 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 497593274, 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630286, 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-73.jpg" 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 498949553, 2024-03-27T07:28:56.911 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634306, 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-55.xml" 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 505629194, 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634343, 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-37.xml" 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 513988628, 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634106, 2024-03-27T07:28:56.912 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-1.xml" 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 514610423, 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265958, 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-2.xml" 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 514981727, 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259511, 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml" 2024-03-27T07:28:56.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 516403393, 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257209, 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-63.xml" 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 518496947, 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634356, 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-29.xml" 2024-03-27T07:28:56.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 519308449, 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267292, 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-56.jpg" 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 519991792, 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267288, 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-57.jpg" 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.915 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 525844346, 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263025, 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-20.jpg" 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 527660167, 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631901, 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-45.xml" 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.916 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 528783960, 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630785, 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-14.jpg" 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 530840565, 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259361, 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-46.xml" 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.917 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 533575235, 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259515, 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml" 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 540895569, 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262600, 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-22.xml" 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.918 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 545663309, 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258374, 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-9.xml" 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 551437172, 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261246, 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-32.xml" 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.919 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 552768615, 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258368, 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-10.xml" 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 552784867, 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259506, 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml" 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.920 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 553037509, 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633951, 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-80.xml" 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 554621074, 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266107, 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-9.jpg" 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.921 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 556222903, 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266073, 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-26.jpg" 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 556662457, 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634073, 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-37.xml" 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.922 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 557533785, 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267859, 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-32.jpg" 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 557705219, 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633915, 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-74.xml" 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.923 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 559964707, 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257229, 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-57.xml" 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 561940705, 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633497, 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-26.xml" 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.924 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 567151415, 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258384, 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-7.xml" 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 567407787, 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261280, 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-23.xml" 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.925 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 567974935, 2024-03-27T07:28:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534884755, 2024-03-27T07:28:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-66.xml" 2024-03-27T07:28:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 569073416, 2024-03-27T07:28:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630316, 2024-03-27T07:28:56.926 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-66.jpg" 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 574898502, 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267300, 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-54.jpg" 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 578110421, 2024-03-27T07:28:56.927 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261347, 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-11.xml" 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 578667978, 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267418, 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-67.jpg" 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 580457093, 2024-03-27T07:28:56.928 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261382, 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-2.xml" 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 582014713, 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267620, 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-28.xml" 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.929 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 582576947, 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263118, 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-51.xml" 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 585353716, 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266048, 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-38.jpg" 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.930 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 587023670, 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634368, 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-17.xml" 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 588027265, 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257692, 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-74.jpg" 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.931 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 596120564, 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264264, 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg" 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 597263934, 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262879, 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-63.jpg" 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 600634942, 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267306, 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml" 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 602972537, 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264275, 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg" 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.933 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 603373928, 2024-03-27T07:28:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267687, 2024-03-27T07:28:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-6.xml" 2024-03-27T07:28:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 603942188, 2024-03-27T07:28:56.934 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263155, 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-36.xml" 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 604891281, 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633945, 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-81.xml" 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.935 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 605158751, 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267344, 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-46.jpg" 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 608462304, 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264423, 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg" 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.936 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 610047100, 2024-03-27T07:28:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267589, 2024-03-27T07:28:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg" 2024-03-27T07:28:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 614283625, 2024-03-27T07:28:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258537, 2024-03-27T07:28:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml" 2024-03-27T07:28:56.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 617126589, 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630325, 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-58.jpg" 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 618150396, 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634382, 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-5.xml" 2024-03-27T07:28:56.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 618930676, 2024-03-27T07:28:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259664, 2024-03-27T07:28:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-31.jpg" 2024-03-27T07:28:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 619859053, 2024-03-27T07:28:56.939 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258453, 2024-03-27T07:28:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-3.jpg" 2024-03-27T07:28:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 620276020, 2024-03-27T07:28:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630969, 2024-03-27T07:28:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-11.xml" 2024-03-27T07:28:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.940 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 623522366, 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633711, 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-3.xml" 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 623905926, 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267328, 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml" 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 631203630, 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266077, 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-24.jpg" 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 631576980, 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264005, 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-38.xml" 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.942 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 632229106, 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267527, 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-14.jpg" 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 634269360, 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264456, 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg" 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 635126032, 2024-03-27T07:28:56.943 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633941, 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-84.xml" 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 636550499, 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267162, 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-28.xml" 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 637199386, 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258563, 2024-03-27T07:28:56.944 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml" 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 637626252, 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266058, 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-33.jpg" 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 638889729, 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263415, 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-60.xml" 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.945 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 641375063, 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264000, 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-39.xml" 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 647174750, 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634125, 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-10.xml" 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.946 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 648535374, 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633431, 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-44.xml" 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 649577161, 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634687, 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-85.xml" 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 652535753, 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258061, 2024-03-27T07:28:56.947 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg" 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 654757970, 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259705, 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-21.jpg" 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 655815095, 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267103, 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-44.xml" 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.948 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 657726890, 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633947, 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-82.xml" 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 669688632, 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265976, 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-74.jpg" 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.949 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 676397806, 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634011, 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-47.xml" 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 676704025, 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634292, 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-61.xml" 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.950 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 677001326, 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257371, 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-36.xml" 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 685035266, 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263954, 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-50.xml" 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 685715613, 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261288, 2024-03-27T07:28:56.951 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-21.xml" 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 686245306, 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631433, 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-69.xml" 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 687128725, 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630753, 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-19.jpg" 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.952 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 688940717, 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264326, 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg" 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 693510157, 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258456, 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-2.jpg" 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.953 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 696719705, 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258834, 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg" 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 700582153, 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259332, 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-53.xml" 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 710280335, 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258388, 2024-03-27T07:28:56.954 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-6.xml" 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 711132206, 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265954, 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-4.xml" 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 711664344, 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267052, 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-61.xml" 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 717042915, 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267586, 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg" 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 718090252, 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634341, 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-39.xml" 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.956 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 718352996, 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630991, 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-83.xml" 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 721724436, 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634266, 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-70.xml" 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.957 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 725902253, 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267405, 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-71.jpg" 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 726828505, 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631647, 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-1.xml" 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.958 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 728309033, 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633943, 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-83.xml" 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 729312832, 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261186, 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-49.xml" 2024-03-27T07:28:56.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 730963244, 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264032, 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-31.xml" 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 730985427, 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636183, 2024-03-27T07:28:56.960 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-8.xml" 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 731810387, 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263241, 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-9.xml" 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 734693371, 2024-03-27T07:28:56.961 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259349, 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-49.xml" 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 736243835, 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634281, 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-66.xml" 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.962 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 738331584, 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257968, 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-33.jpg" 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 740029924, 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634120, 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-13.xml" 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.963 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 742805303, 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264028, 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-32.xml" 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 745746792, 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631253, 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-60.jpg" 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.964 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 745748179, 2024-03-27T07:28:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630110, 2024-03-27T07:28:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-46.xml" 2024-03-27T07:28:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 747297004, 2024-03-27T07:28:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257826, 2024-03-27T07:28:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-27.jpg" 2024-03-27T07:28:56.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 747415602, 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634466, 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-45.xml" 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 747422981, 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265956, 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-3.xml" 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.966 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 747821075, 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257844, 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-42.jpg" 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 748394068, 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630999, 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-14.jpg" 2024-03-27T07:28:56.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 748823654, 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630188, 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-7.xml" 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 755415577, 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266109, 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-8.jpg" 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.968 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 758422056, 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267270, 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml" 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 760193445, 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634393, 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-87.xml" 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.969 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 760952233, 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266089, 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-18.jpg" 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 761734864, 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634095, 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-29.xml" 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.970 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 762490445, 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267627, 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-25.xml" 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 763031572, 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633507, 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-17.xml" 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.971 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 767697245, 2024-03-27T07:28:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631574, 2024-03-27T07:28:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-70.jpg" 2024-03-27T07:28:56.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.973 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 768693386, 2024-03-27T07:28:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634778, 2024-03-27T07:28:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-13.xml" 2024-03-27T07:28:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 768955177, 2024-03-27T07:28:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634415, 2024-03-27T07:28:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-71.xml" 2024-03-27T07:28:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.974 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 780029928, 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634069, 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-38.xml" 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 781867322, 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263020, 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-22.jpg" 2024-03-27T07:28:56.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 782519704, 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261210, 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-42.xml" 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 783999463, 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264434, 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg" 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 787466201, 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634078, 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-34.xml" 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 787531371, 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633528, 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-9.xml" 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.977 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 796095522, 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634214, 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-81.xml" 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 803659380, 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634529, 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-94.xml" 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 804148292, 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636173, 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-10.xml" 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 804354197, 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266040, 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-42.jpg" 2024-03-27T07:28:56.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 813264856, 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267043, 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-64.xml" 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 814867103, 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259553, 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml" 2024-03-27T07:28:56.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 816916852, 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630175, 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-13.xml" 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 817021029, 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264016, 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-35.xml" 2024-03-27T07:28:56.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 818523047, 2024-03-27T07:28:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262859, 2024-03-27T07:28:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-71.jpg" 2024-03-27T07:28:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.982 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 818728449, 2024-03-27T07:28:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634218, 2024-03-27T07:28:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-80.xml" 2024-03-27T07:28:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 818849822, 2024-03-27T07:28:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631151, 2024-03-27T07:28:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-77.jpg" 2024-03-27T07:28:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.983 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 821381543, 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631738, 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-56.xml" 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 824296164, 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634414, 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-72.xml" 2024-03-27T07:28:56.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 825050287, 2024-03-27T07:28:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259670, 2024-03-27T07:28:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-84.xml" 2024-03-27T07:28:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 826982088, 2024-03-27T07:28:56.985 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267681, 2024-03-27T07:28:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-8.xml" 2024-03-27T07:28:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 828395705, 2024-03-27T07:28:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259617, 2024-03-27T07:28:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-45.jpg" 2024-03-27T07:28:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.986 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 831916316, 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633949, 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-80.xml" 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 833453625, 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264067, 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-23.xml" 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.987 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 833833838, 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633939, 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-86.xml" 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 839441169, 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263300, 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-3.jpg" 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.988 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 847857497, 2024-03-27T07:28:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267522, 2024-03-27T07:28:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg" 2024-03-27T07:28:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 849988947, 2024-03-27T07:28:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634632, 2024-03-27T07:28:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-29.xml" 2024-03-27T07:28:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.989 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 854020984, 2024-03-27T07:28:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263206, 2024-03-27T07:28:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-19.xml" 2024-03-27T07:28:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 854754590, 2024-03-27T07:28:56.990 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633437, 2024-03-27T07:28:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-42.xml" 2024-03-27T07:28:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 857917409, 2024-03-27T07:28:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267482, 2024-03-27T07:28:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-49.jpg" 2024-03-27T07:28:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.991 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 859734975, 2024-03-27T07:28:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634532, 2024-03-27T07:28:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-33.xml" 2024-03-27T07:28:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 860690251, 2024-03-27T07:28:56.992 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264095, 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-95.xml" 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 862145662, 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257708, 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-64.jpg" 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.993 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 862825402, 2024-03-27T07:28:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266085, 2024-03-27T07:28:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-20.jpg" 2024-03-27T07:28:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 865397590, 2024-03-27T07:28:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261548, 2024-03-27T07:28:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-27.jpg" 2024-03-27T07:28:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.994 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 871797115, 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257638, 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-7.xml" 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 872635944, 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263286, 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-7.jpg" 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.995 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 877507315, 2024-03-27T07:28:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631717, 2024-03-27T07:28:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-62.xml" 2024-03-27T07:28:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 880474775, 2024-03-27T07:28:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634787, 2024-03-27T07:28:56.996 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-12.xml" 2024-03-27T07:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 882223025, 2024-03-27T07:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634878, 2024-03-27T07:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-6.xml" 2024-03-27T07:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.997 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 884150863, 2024-03-27T07:28:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634109, 2024-03-27T07:28:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-22.xml" 2024-03-27T07:28:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 886367193, 2024-03-27T07:28:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257770, 2024-03-27T07:28:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-48.jpg" 2024-03-27T07:28:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.998 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 886419817, 2024-03-27T07:28:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630823, 2024-03-27T07:28:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-6.jpg" 2024-03-27T07:28:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 886564276, 2024-03-27T07:28:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261296, 2024-03-27T07:28:56.999 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-19.xml" 2024-03-27T07:28:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 890000910, 2024-03-27T07:28:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267492, 2024-03-27T07:28:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-24.jpg" 2024-03-27T07:28:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.000 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 892174993, 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634370, 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-16.xml" 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 894677584, 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267813, 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-47.jpg" 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.001 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 895599592, 2024-03-27T07:28:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264080, 2024-03-27T07:28:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-98.xml" 2024-03-27T07:28:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 896408635, 2024-03-27T07:28:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631235, 2024-03-27T07:28:57.002 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-85.xml" 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 899885780, 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262906, 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-52.jpg" 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 902238638, 2024-03-27T07:28:57.003 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261583, 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-22.jpg" 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 904366825, 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634431, 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-55.xml" 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 906703312, 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264059, 2024-03-27T07:28:57.004 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-25.xml" 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 907006235, 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634097, 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-28.xml" 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 911348531, 2024-03-27T07:28:57.005 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267412, 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-69.jpg" 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 916557552, 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263053, 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-4.jpg" 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 919870641, 2024-03-27T07:28:57.006 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257628, 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml" 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 921547211, 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634395, 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-85.xml" 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 922196817, 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630789, 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-13.jpg" 2024-03-27T07:28:57.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 923507827, 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267435, 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-62.jpg" 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 925467413, 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267558, 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg" 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.008 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 927047207, 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259735, 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg" 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 927345509, 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262953, 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-33.jpg" 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 928910296, 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258403, 2024-03-27T07:28:57.009 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-3.xml" 2024-03-27T07:28:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 930155225, 2024-03-27T07:28:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634256, 2024-03-27T07:28:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-72.xml" 2024-03-27T07:28:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.010 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 931059392, 2024-03-27T07:28:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634329, 2024-03-27T07:28:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-46.xml" 2024-03-27T07:28:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 939586062, 2024-03-27T07:28:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630992, 2024-03-27T07:28:57.011 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-21.jpg" 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 939613972, 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258354, 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-13.xml" 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 940849539, 2024-03-27T07:28:57.012 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267067, 2024-03-27T07:28:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-56.xml" 2024-03-27T07:28:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 941408484, 2024-03-27T07:28:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262864, 2024-03-27T07:28:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-69.jpg" 2024-03-27T07:28:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.013 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 944814351, 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263172, 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-29.xml" 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 946565112, 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263358, 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-78.xml" 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.014 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 947594641, 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630721, 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-60.jpg" 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 949561298, 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263125, 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-48.xml" 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.015 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 951023882, 2024-03-27T07:28:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267484, 2024-03-27T07:28:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-26.jpg" 2024-03-27T07:28:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 951069301, 2024-03-27T07:28:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267478, 2024-03-27T07:28:57.016 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-50.jpg" 2024-03-27T07:28:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 951509618, 2024-03-27T07:28:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264009, 2024-03-27T07:28:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-37.xml" 2024-03-27T07:28:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.017 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 953012414, 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267667, 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-13.xml" 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 953357486, 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259883, 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-42.xml" 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.018 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 957238550, 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265998, 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-63.jpg" 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 958545124, 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267789, 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-55.jpg" 2024-03-27T07:28:57.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 963317683, 2024-03-27T07:28:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633963, 2024-03-27T07:28:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-75.xml" 2024-03-27T07:28:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.020 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 972110751, 2024-03-27T07:28:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634428, 2024-03-27T07:28:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-58.xml" 2024-03-27T07:28:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 976728592, 2024-03-27T07:28:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634012, 2024-03-27T07:28:57.021 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-46.xml" 2024-03-27T07:28:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 980635171, 2024-03-27T07:28:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263103, 2024-03-27T07:28:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-57.xml" 2024-03-27T07:28:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.022 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 981640111, 2024-03-27T07:28:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266067, 2024-03-27T07:28:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-29.jpg" 2024-03-27T07:28:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.023 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 984594044, 2024-03-27T07:28:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635984, 2024-03-27T07:28:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-60.xml" 2024-03-27T07:28:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 984752105, 2024-03-27T07:28:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267372, 2024-03-27T07:28:57.024 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-42.jpg" 2024-03-27T07:28:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 985042237, 2024-03-27T07:28:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264370, 2024-03-27T07:28:57.025 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg" 2024-03-27T07:28:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 985819405, 2024-03-27T07:28:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267196, 2024-03-27T07:28:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-19.xml" 2024-03-27T07:28:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.026 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 986975001, 2024-03-27T07:28:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634005, 2024-03-27T07:28:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-45.jpg" 2024-03-27T07:28:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.027 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 987064798, 2024-03-27T07:28:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267251, 2024-03-27T07:28:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-3.xml" 2024-03-27T07:28:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 989082323, 2024-03-27T07:28:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259534, 2024-03-27T07:28:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml" 2024-03-27T07:28:57.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 989383441, 2024-03-27T07:28:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263026, 2024-03-27T07:28:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-13.jpg" 2024-03-27T07:28:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 998346887, 2024-03-27T07:28:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261590, 2024-03-27T07:28:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-21.jpg" 2024-03-27T07:28:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.030 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 999138041, 2024-03-27T07:28:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630143, 2024-03-27T07:28:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-31.xml" 2024-03-27T07:28:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.031 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1006754288, 2024-03-27T07:28:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267401, 2024-03-27T07:28:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-38.jpg" 2024-03-27T07:28:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1008271818, 2024-03-27T07:28:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633036, 2024-03-27T07:28:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-25.xml" 2024-03-27T07:28:57.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1010530493, 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630356, 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-32.jpg" 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1012869386, 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630162, 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-20.xml" 2024-03-27T07:28:57.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1013624958, 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261520, 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-34.jpg" 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1014245444, 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261216, 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg" 2024-03-27T07:28:57.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1018429737, 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634086, 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-31.xml" 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1030072059, 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634116, 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-17.xml" 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.035 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1030872656, 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263439, 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-32.xml" 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1037329597, 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634014, 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-44.xml" 2024-03-27T07:28:57.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1039390612, 2024-03-27T07:28:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634351, 2024-03-27T07:28:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-32.xml" 2024-03-27T07:28:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1044851865, 2024-03-27T07:28:57.037 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257813, 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-32.jpg" 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1045710874, 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633948, 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-81.xml" 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1048210844, 2024-03-27T07:28:57.038 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634312, 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-52.xml" 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1051569655, 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634403, 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-80.xml" 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1053156918, 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630313, 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-69.jpg" 2024-03-27T07:28:57.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1055874772, 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633537, 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-7.xml" 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1057237207, 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261573, 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-23.jpg" 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.040 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1060849531, 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267389, 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-76.jpg" 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1060948141, 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264044, 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-28.xml" 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1061975150, 2024-03-27T07:28:57.041 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634508, 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-37.xml" 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1062132259, 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262919, 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-47.jpg" 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1064559480, 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267582, 2024-03-27T07:28:57.042 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-41.xml" 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1072968571, 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263375, 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-73.xml" 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1075202419, 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263418, 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-59.xml" 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.043 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1081410950, 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261284, 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-22.xml" 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1084268297, 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267597, 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-36.xml" 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.044 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1088191585, 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266046, 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-39.jpg" 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1088801136, 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634350, 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-33.xml" 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1088891108, 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633989, 2024-03-27T07:28:57.045 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-65.xml" 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1090024477, 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263203, 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-20.xml" 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1092884271, 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634334, 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-44.xml" 2024-03-27T07:28:57.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1092908129, 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267316, 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-50.jpg" 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1106139760, 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259713, 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg" 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.047 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1110587415, 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634058, 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-22.xml" 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1111021064, 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630168, 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-17.xml" 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.048 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1111219074, 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634110, 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-21.xml" 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1115056454, 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634048, 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-49.xml" 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.049 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1116117588, 2024-03-27T07:28:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267244, 2024-03-27T07:28:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-5.xml" 2024-03-27T07:28:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1118291018, 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258444, 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-5.jpg" 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1118980096, 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631065, 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-26.xml" 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.051 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1121099517, 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634022, 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-58.xml" 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1124689469, 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630744, 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-35.xml" 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1126108076, 2024-03-27T07:28:57.052 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259649, 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-35.jpg" 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1127729373, 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633978, 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-69.xml" 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.053 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1134884206, 2024-03-27T07:28:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634087, 2024-03-27T07:28:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-8.xml" 2024-03-27T07:28:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1135591284, 2024-03-27T07:28:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262968, 2024-03-27T07:28:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-27.jpg" 2024-03-27T07:28:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.054 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1135883166, 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267200, 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-18.xml" 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1136965049, 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631926, 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-42.xml" 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.055 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1137542159, 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267801, 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-51.jpg" 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1141530028, 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264150, 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-7.xml" 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.056 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1143687237, 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266014, 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-55.jpg" 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1143895867, 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633576, 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-3.xml" 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.057 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1144180733, 2024-03-27T07:28:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634199, 2024-03-27T07:28:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-87.xml" 2024-03-27T07:28:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1145347879, 2024-03-27T07:28:57.058 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261532, 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-31.jpg" 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1146994158, 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263274, 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-10.jpg" 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.059 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1148377609, 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634083, 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-10.xml" 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1149693191, 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634483, 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-42.xml" 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1150043087, 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631391, 2024-03-27T07:28:57.060 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-77.xml" 2024-03-27T07:28:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1150239067, 2024-03-27T07:28:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267795, 2024-03-27T07:28:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-53.jpg" 2024-03-27T07:28:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.061 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1150989205, 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267525, 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg" 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1152740349, 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266044, 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-40.jpg" 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1156009940, 2024-03-27T07:28:57.062 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266111, 2024-03-27T07:28:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-7.jpg" 2024-03-27T07:28:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1157816969, 2024-03-27T07:28:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259339, 2024-03-27T07:28:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-51.xml" 2024-03-27T07:28:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.063 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1166786490, 2024-03-27T07:28:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262946, 2024-03-27T07:28:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-36.jpg" 2024-03-27T07:28:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1168566447, 2024-03-27T07:28:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630335, 2024-03-27T07:28:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-49.jpg" 2024-03-27T07:28:57.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1170036842, 2024-03-27T07:28:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263387, 2024-03-27T07:28:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-69.xml" 2024-03-27T07:28:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.065 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1170449142, 2024-03-27T07:28:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259676, 2024-03-27T07:28:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-28.jpg" 2024-03-27T07:28:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1170591575, 2024-03-27T07:28:57.066 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261466, 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-48.jpg" 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1171286879, 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267867, 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-29.jpg" 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1171301419, 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267548, 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-7.jpg" 2024-03-27T07:28:57.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1173338256, 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264020, 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-34.xml" 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1178581924, 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264117, 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-13.xml" 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.068 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1180054714, 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262978, 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-23.jpg" 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1180887630, 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264245, 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg" 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.069 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1182149868, 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259317, 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-57.xml" 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1183895700, 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634064, 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-40.xml" 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.070 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1185431613, 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266034, 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-45.jpg" 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1188210997, 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631799, 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-27.jpg" 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1188632554, 2024-03-27T07:28:57.071 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263115, 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-52.xml" 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1190573922, 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259447, 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml" 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.072 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1192787566, 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267649, 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-18.xml" 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1195418135, 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633515, 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-12.xml" 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1197647535, 2024-03-27T07:28:57.073 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260103, 2024-03-27T07:28:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-45.xml" 2024-03-27T07:28:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1202623151, 2024-03-27T07:28:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634422, 2024-03-27T07:28:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-64.xml" 2024-03-27T07:28:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.074 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1217165055, 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634139, 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-15.xml" 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1218672831, 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631053, 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-34.xml" 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.075 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1223090512, 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267367, 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-82.jpg" 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1225346595, 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261418, 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-60.jpg" 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1225692500, 2024-03-27T07:28:57.076 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263147, 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-39.xml" 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1228756387, 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634107, 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-24.xml" 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1232589915, 2024-03-27T07:28:57.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264486, 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg" 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1235356725, 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633118, 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-86.xml" 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1238600441, 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634419, 2024-03-27T07:28:57.078 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-67.xml" 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1239247609, 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262394, 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-41.xml" 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1241476023, 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264381, 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg" 2024-03-27T07:28:57.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1243885476, 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259961, 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-26.xml" 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1247405475, 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262795, 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-22.xml" 2024-03-27T07:28:57.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1247584700, 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267876, 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-26.jpg" 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1255591642, 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633418, 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-48.xml" 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1258753134, 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262807, 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-18.xml" 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1259503481, 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267494, 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg" 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.082 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1261427505, 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259501, 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml" 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1262194073, 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267421, 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-66.jpg" 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.083 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1262308982, 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257920, 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-88.xml" 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1269498633, 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267844, 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-37.jpg" 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.084 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1274250303, 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634336, 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-42.xml" 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1274318175, 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633503, 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-21.xml" 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1286093299, 2024-03-27T07:28:57.085 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263059, 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-2.jpg" 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1288360650, 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631060, 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-22.xml" 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1291338076, 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631248, 2024-03-27T07:28:57.086 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-2.xml" 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1291719252, 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631734, 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-57.xml" 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1292744682, 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630988, 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-23.jpg" 2024-03-27T07:28:57.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1293140904, 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264192, 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml" 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1293600356, 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267213, 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-14.xml" 2024-03-27T07:28:57.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1293978537, 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630736, 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-94.xml" 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1295637890, 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267786, 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-56.jpg" 2024-03-27T07:28:57.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1298102487, 2024-03-27T07:28:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258557, 2024-03-27T07:28:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml" 2024-03-27T07:28:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1298513431, 2024-03-27T07:28:57.090 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261597, 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-20.jpg" 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1300662669, 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634077, 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-14.xml" 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1302201467, 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267783, 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-57.jpg" 2024-03-27T07:28:57.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1308127949, 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633458, 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-34.xml" 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1310692968, 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263043, 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-14.jpg" 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1312686333, 2024-03-27T07:28:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267332, 2024-03-27T07:28:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml" 2024-03-27T07:28:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1317678833, 2024-03-27T07:28:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634221, 2024-03-27T07:28:57.093 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-79.xml" 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1318082863, 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267518, 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-17.jpg" 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1318403084, 2024-03-27T07:28:57.094 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267302, 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml" 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1325539969, 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263213, 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-17.xml" 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1327419962, 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259692, 2024-03-27T07:28:57.095 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-24.jpg" 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1334406948, 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636089, 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-30.xml" 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1337477102, 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264483, 2024-03-27T07:28:57.096 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg" 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1340137850, 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263391, 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-68.xml" 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1340860229, 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634635, 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-89.xml" 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1342234856, 2024-03-27T07:28:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634117, 2024-03-27T07:28:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-16.xml" 2024-03-27T07:28:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1344537949, 2024-03-27T07:28:57.098 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634121, 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-12.xml" 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1345429254, 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257300, 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-44.xml" 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1347035533, 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631171, 2024-03-27T07:28:57.099 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-53.xml" 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1348083823, 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267542, 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-9.jpg" 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1350246779, 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631003, 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-11.jpg" 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.100 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1353522394, 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634015, 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-43.xml" 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1353928641, 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259689, 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-25.jpg" 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.101 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1355038539, 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267117, 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-40.xml" 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1357238282, 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262956, 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-32.jpg" 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.102 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1357573894, 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267675, 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-10.xml" 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1359551065, 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267780, 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-58.jpg" 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1360401899, 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631226, 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-92.xml" 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1363321650, 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630339, 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-46.jpg" 2024-03-27T07:28:57.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1364499684, 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634000, 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-54.xml" 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1365910206, 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267346, 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-88.jpg" 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.105 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1366091493, 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267254, 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml" 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1367146836, 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259773, 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg" 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.106 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1367962457, 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263093, 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-61.xml" 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1370001666, 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633500, 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-24.xml" 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.107 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1370257887, 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263248, 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-7.xml" 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1373230392, 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257201, 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-65.xml" 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.108 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1374782276, 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630772, 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-15.jpg" 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1376118967, 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631824, 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-54.xml" 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1389031820, 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267577, 2024-03-27T07:28:57.109 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg" 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1390747681, 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631032, 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-3.jpg" 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1392148546, 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267822, 2024-03-27T07:28:57.110 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-44.jpg" 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1393791780, 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266000, 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-62.jpg" 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1394929457, 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263937, 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-54.xml" 2024-03-27T07:28:57.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1396961719, 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630163, 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-19.xml" 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1397096837, 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267342, 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-89.jpg" 2024-03-27T07:28:57.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1397846241, 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633502, 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-22.xml" 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1398915064, 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266008, 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-58.jpg" 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.113 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1399176821, 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634042, 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-50.xml" 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1407597842, 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263848, 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-72.xml" 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1411455748, 2024-03-27T07:28:57.114 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259078, 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-8.jpg" 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1414224427, 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631012, 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-7.jpg" 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1415163253, 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263267, 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-1.xml" 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.115 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1416216704, 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634429, 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-57.xml" 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1417730080, 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258798, 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg" 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.116 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1420893326, 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633427, 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-45.xml" 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1425820508, 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266079, 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-23.jpg" 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1428724714, 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631293, 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-10.xml" 2024-03-27T07:28:57.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1429840290, 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262482, 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-34.xml" 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1431355274, 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630102, 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-49.xml" 2024-03-27T07:28:57.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1439815953, 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266060, 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-32.jpg" 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1440152249, 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259387, 2024-03-27T07:28:57.119 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-41.xml" 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1441238228, 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262854, 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-73.jpg" 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1443869534, 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631042, 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-83.jpg" 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.120 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1445337781, 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634417, 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-69.xml" 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1446926753, 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258618, 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml" 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1447100327, 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263877, 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-66.xml" 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1456156072, 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267186, 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-22.xml" 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.122 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1457533018, 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261422, 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-59.jpg" 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1462701513, 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634101, 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-26.xml" 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.123 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1463806932, 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267762, 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-64.jpg" 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1464641389, 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267363, 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-83.jpg" 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.124 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1466219070, 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630343, 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-34.jpg" 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1474851822, 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259370, 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-100.xml" 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1478251919, 2024-03-27T07:28:57.125 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634637, 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-88.xml" 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1478464952, 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633967, 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-73.xml" 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.126 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1484144621, 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633966, 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-72.xml" 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1492220986, 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261257, 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-29.xml" 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1494814248, 2024-03-27T07:28:57.127 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267588, 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-39.xml" 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1494890172, 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630135, 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-33.xml" 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1495075043, 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267082, 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-51.xml" 2024-03-27T07:28:57.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1500670503, 2024-03-27T07:28:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267573, 2024-03-27T07:28:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-44.xml" 2024-03-27T07:28:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1502044782, 2024-03-27T07:28:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634394, 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-86.xml" 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1502089443, 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266024, 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-50.jpg" 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1505365029, 2024-03-27T07:28:57.130 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267496, 2024-03-27T07:28:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-23.jpg" 2024-03-27T07:28:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1505938371, 2024-03-27T07:28:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634322, 2024-03-27T07:28:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-49.xml" 2024-03-27T07:28:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.131 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1507730114, 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259164, 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-87.xml" 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1508478794, 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264162, 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-5.xml" 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.132 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1508575567, 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267561, 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg" 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1508954670, 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630338, 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-47.jpg" 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1511402963, 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263893, 2024-03-27T07:28:57.133 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-63.xml" 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1512434225, 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257962, 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-34.jpg" 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1515073789, 2024-03-27T07:28:57.134 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634052, 2024-03-27T07:28:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-47.xml" 2024-03-27T07:28:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.135 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1519954602, 2024-03-27T07:28:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634360, 2024-03-27T07:28:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-25.xml" 2024-03-27T07:28:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.136 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1520417085, 2024-03-27T07:28:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259762, 2024-03-27T07:28:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg" 2024-03-27T07:28:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.137 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.138 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1521082204, 2024-03-27T07:28:57.138 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262958, 2024-03-27T07:28:57.138 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-31.jpg" 2024-03-27T07:28:57.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.138 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1523341015, 2024-03-27T07:28:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267131, 2024-03-27T07:28:57.139 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-36.xml" 2024-03-27T07:28:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1526569332, 2024-03-27T07:28:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263023, 2024-03-27T07:28:57.140 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-14.jpg" 2024-03-27T07:28:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1527166657, 2024-03-27T07:28:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262031, 2024-03-27T07:28:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-69.xml" 2024-03-27T07:28:57.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1527688278, 2024-03-27T07:28:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267732, 2024-03-27T07:28:57.142 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-74.jpg" 2024-03-27T07:28:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1528231719, 2024-03-27T07:28:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262924, 2024-03-27T07:28:57.143 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-45.jpg" 2024-03-27T07:28:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1530461230, 2024-03-27T07:28:57.144 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259760, 2024-03-27T07:28:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-76.xml" 2024-03-27T07:28:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.145 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1532356026, 2024-03-27T07:28:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634809, 2024-03-27T07:28:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-10.xml" 2024-03-27T07:28:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1537527055, 2024-03-27T07:28:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264036, 2024-03-27T07:28:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-30.xml" 2024-03-27T07:28:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1538087126, 2024-03-27T07:28:57.147 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262973, 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-25.jpg" 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1542059656, 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264090, 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-96.xml" 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1548881699, 2024-03-27T07:28:57.148 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267446, 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-59.jpg" 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1549340710, 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634708, 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-20.xml" 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1549366568, 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634380, 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-7.xml" 2024-03-27T07:28:57.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1552008097, 2024-03-27T07:28:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261406, 2024-03-27T07:28:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-63.jpg" 2024-03-27T07:28:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.150 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1558224768, 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630314, 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-68.jpg" 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1559040134, 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262931, 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-42.jpg" 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1559853779, 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632958, 2024-03-27T07:28:57.151 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-29.xml" 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1560691801, 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267672, 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-11.xml" 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1564664961, 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267107, 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-43.xml" 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1565620179, 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262916, 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-48.jpg" 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1569049513, 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260121, 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-43.xml" 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.153 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1570216583, 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264132, 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-10.xml" 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1570976518, 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263278, 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-9.jpg" 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.154 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1572226587, 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633954, 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-76.xml" 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1574149607, 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267574, 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg" 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.155 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1575671694, 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263503, 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-93.xml" 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1578674641, 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267856, 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-33.jpg" 2024-03-27T07:28:57.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1579598976, 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634944, 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-2.xml" 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1584083258, 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633956, 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-78.xml" 2024-03-27T07:28:57.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1587611863, 2024-03-27T07:28:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631696, 2024-03-27T07:28:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-67.xml" 2024-03-27T07:28:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1587864110, 2024-03-27T07:28:57.158 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633970, 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-70.xml" 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1590922142, 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634712, 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-81.xml" 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1591218494, 2024-03-27T07:28:57.159 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267070, 2024-03-27T07:28:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-55.xml" 2024-03-27T07:28:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1593780264, 2024-03-27T07:28:57.160 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267632, 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-23.xml" 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1599922436, 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263095, 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-60.xml" 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.161 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1605136432, 2024-03-27T07:28:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257362, 2024-03-27T07:28:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-37.xml" 2024-03-27T07:28:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1605496009, 2024-03-27T07:28:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630150, 2024-03-27T07:28:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-27.xml" 2024-03-27T07:28:57.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1608806564, 2024-03-27T07:28:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263231, 2024-03-27T07:28:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-12.xml" 2024-03-27T07:28:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1610705424, 2024-03-27T07:28:57.163 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266028, 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-48.jpg" 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1611563173, 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264466, 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg" 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.164 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1611649168, 2024-03-27T07:28:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267434, 2024-03-27T07:28:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-34.jpg" 2024-03-27T07:28:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1615950212, 2024-03-27T07:28:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634332, 2024-03-27T07:28:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-45.xml" 2024-03-27T07:28:57.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1622552008, 2024-03-27T07:28:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259520, 2024-03-27T07:28:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml" 2024-03-27T07:28:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1622653349, 2024-03-27T07:28:57.166 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634626, 2024-03-27T07:28:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-31.xml" 2024-03-27T07:28:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1626483293, 2024-03-27T07:28:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633518, 2024-03-27T07:28:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-11.xml" 2024-03-27T07:28:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.167 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1628275865, 2024-03-27T07:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267248, 2024-03-27T07:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-4.xml" 2024-03-27T07:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1629671822, 2024-03-27T07:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264471, 2024-03-27T07:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg" 2024-03-27T07:28:57.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1632722913, 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634448, 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-48.xml" 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1635726992, 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263269, 2024-03-27T07:28:57.169 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-12.jpg" 2024-03-27T07:28:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1642417473, 2024-03-27T07:28:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634004, 2024-03-27T07:28:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-60.xml" 2024-03-27T07:28:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.170 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1648190184, 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634207, 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-84.xml" 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1648292271, 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259558, 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml" 2024-03-27T07:28:57.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1649681049, 2024-03-27T07:28:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634430, 2024-03-27T07:28:57.172 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-56.xml" 2024-03-27T07:28:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1652430941, 2024-03-27T07:28:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630120, 2024-03-27T07:28:57.173 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-42.xml" 2024-03-27T07:28:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1654343479, 2024-03-27T07:28:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630763, 2024-03-27T07:28:57.174 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-17.jpg" 2024-03-27T07:28:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.177 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1658812626, 2024-03-27T07:28:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267579, 2024-03-27T07:28:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-42.xml" 2024-03-27T07:28:57.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1658968051, 2024-03-27T07:28:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261183, 2024-03-27T07:28:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-50.xml" 2024-03-27T07:28:57.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1659399416, 2024-03-27T07:28:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634057, 2024-03-27T07:28:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-44.xml" 2024-03-27T07:28:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.180 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1660083917, 2024-03-27T07:28:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630155, 2024-03-27T07:28:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-24.xml" 2024-03-27T07:28:57.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1660534034, 2024-03-27T07:28:57.182 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263108, 2024-03-27T07:28:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-55.xml" 2024-03-27T07:28:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.183 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1662325300, 2024-03-27T07:28:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259441, 2024-03-27T07:28:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml" 2024-03-27T07:28:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.184 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1666903878, 2024-03-27T07:28:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267603, 2024-03-27T07:28:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-34.xml" 2024-03-27T07:28:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.185 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1667740507, 2024-03-27T07:28:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263090, 2024-03-27T07:28:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-62.xml" 2024-03-27T07:28:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.186 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1669810502, 2024-03-27T07:28:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267804, 2024-03-27T07:28:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-50.jpg" 2024-03-27T07:28:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.187 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1672504545, 2024-03-27T07:28:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259435, 2024-03-27T07:28:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml" 2024-03-27T07:28:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1673622443, 2024-03-27T07:28:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257227, 2024-03-27T07:28:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-58.xml" 2024-03-27T07:28:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1677005515, 2024-03-27T07:28:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633569, 2024-03-27T07:28:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-4.xml" 2024-03-27T07:28:57.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1677385170, 2024-03-27T07:28:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267058, 2024-03-27T07:28:57.191 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-59.xml" 2024-03-27T07:28:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1681682555, 2024-03-27T07:28:57.192 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264315, 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg" 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1686131005, 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633447, 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-38.xml" 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.193 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1694652247, 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634126, 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-9.xml" 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1701183665, 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259320, 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-56.xml" 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.194 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1703214371, 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634038, 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-51.xml" 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1703487083, 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631230, 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-90.xml" 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.195 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1711096024, 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634002, 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-61.xml" 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1711960023, 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261981, 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-81.xml" 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.196 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1712256491, 2024-03-27T07:28:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634915, 2024-03-27T07:28:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-4.xml" 2024-03-27T07:28:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1714134393, 2024-03-27T07:28:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630834, 2024-03-27T07:28:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-3.jpg" 2024-03-27T07:28:57.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1715015512, 2024-03-27T07:28:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633422, 2024-03-27T07:28:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-47.xml" 2024-03-27T07:28:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1722703661, 2024-03-27T07:28:57.198 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261390, 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-67.jpg" 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1723832299, 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259598, 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-49.jpg" 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1723914581, 2024-03-27T07:28:57.199 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267365, 2024-03-27T07:28:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-43.jpg" 2024-03-27T07:28:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1726500557, 2024-03-27T07:28:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634118, 2024-03-27T07:28:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-15.xml" 2024-03-27T07:28:57.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1727737540, 2024-03-27T07:28:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262966, 2024-03-27T07:28:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-28.jpg" 2024-03-27T07:28:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.201 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1734341423, 2024-03-27T07:28:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267637, 2024-03-27T07:28:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-22.xml" 2024-03-27T07:28:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1735535695, 2024-03-27T07:28:57.202 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634388, 2024-03-27T07:28:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-92.xml" 2024-03-27T07:28:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1737382744, 2024-03-27T07:28:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258409, 2024-03-27T07:28:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-2.xml" 2024-03-27T07:28:57.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1737978446, 2024-03-27T07:28:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263830, 2024-03-27T07:28:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-76.xml" 2024-03-27T07:28:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.204 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1739927925, 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261540, 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-29.jpg" 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1741580073, 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264412, 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg" 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.205 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1754252597, 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262024, 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-70.xml" 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1763245242, 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634327, 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-47.xml" 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.206 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1772971479, 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258347, 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-14.xml" 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1773421994, 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263378, 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-72.xml" 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.207 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1774532777, 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258633, 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml" 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1777740795, 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259681, 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-27.jpg" 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.208 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1787573154, 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267011, 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-75.xml" 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1788680852, 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264495, 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg" 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.209 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1790745288, 2024-03-27T07:28:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267545, 2024-03-27T07:28:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-8.jpg" 2024-03-27T07:28:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1791327031, 2024-03-27T07:28:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634627, 2024-03-27T07:28:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-92.xml" 2024-03-27T07:28:57.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1793867114, 2024-03-27T07:28:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634385, 2024-03-27T07:28:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-2.xml" 2024-03-27T07:28:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.211 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1794101028, 2024-03-27T07:28:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630321, 2024-03-27T07:28:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-62.jpg" 2024-03-27T07:28:57.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1797154427, 2024-03-27T07:28:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267296, 2024-03-27T07:28:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-55.jpg" 2024-03-27T07:28:57.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.214 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1797265763, 2024-03-27T07:28:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633583, 2024-03-27T07:28:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-2.xml" 2024-03-27T07:28:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1802384501, 2024-03-27T07:28:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263135, 2024-03-27T07:28:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-44.xml" 2024-03-27T07:28:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.215 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1802846810, 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631684, 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-83.xml" 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1803087893, 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264481, 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg" 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.216 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1803228782, 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267600, 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-35.xml" 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1804425867, 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633499, 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-25.xml" 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1805125337, 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267753, 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-67.jpg" 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1806444463, 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262866, 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-68.jpg" 2024-03-27T07:28:57.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1808754636, 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633408, 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-50.xml" 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1811228072, 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263182, 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-26.xml" 2024-03-27T07:28:57.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1812271456, 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263412, 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-61.xml" 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1815465639, 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259543, 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml" 2024-03-27T07:28:57.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1816673375, 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634420, 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-66.xml" 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1817191643, 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630993, 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-20.jpg" 2024-03-27T07:28:57.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1817732216, 2024-03-27T07:28:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257738, 2024-03-27T07:28:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-58.jpg" 2024-03-27T07:28:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.222 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1822848821, 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630133, 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-34.xml" 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1823636224, 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259641, 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-38.jpg" 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1828473851, 2024-03-27T07:28:57.223 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262891, 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-58.jpg" 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1831373749, 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260001, 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-18.xml" 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1837670725, 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259731, 2024-03-27T07:28:57.224 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg" 2024-03-27T07:28:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1839925705, 2024-03-27T07:28:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266063, 2024-03-27T07:28:57.225 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-31.jpg" 2024-03-27T07:28:57.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.226 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.226 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.226 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1840362307, 2024-03-27T07:28:57.226 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631242, 2024-03-27T07:28:57.227 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-52.jpg" 2024-03-27T07:28:57.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.227 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.227 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.228 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1843920270, 2024-03-27T07:28:57.228 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261883, 2024-03-27T07:28:57.228 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-88.xml" 2024-03-27T07:28:57.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.229 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.229 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.229 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1848023634, 2024-03-27T07:28:57.229 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257907, 2024-03-27T07:28:57.230 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-62.jpg" 2024-03-27T07:28:57.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.230 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.230 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.231 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1848817319, 2024-03-27T07:28:57.231 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634104, 2024-03-27T07:28:57.231 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-2.xml" 2024-03-27T07:28:57.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1852420920, 2024-03-27T07:28:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631031, 2024-03-27T07:28:57.232 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-4.jpg" 2024-03-27T07:28:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1853619753, 2024-03-27T07:28:57.233 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630361, 2024-03-27T07:28:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-27.jpg" 2024-03-27T07:28:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.234 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1854002433, 2024-03-27T07:28:57.235 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630145, 2024-03-27T07:28:57.235 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-30.xml" 2024-03-27T07:28:57.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.235 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1854350863, 2024-03-27T07:28:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257746, 2024-03-27T07:28:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-57.jpg" 2024-03-27T07:28:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.236 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1855506598, 2024-03-27T07:28:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634302, 2024-03-27T07:28:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-57.xml" 2024-03-27T07:28:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.237 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.238 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.238 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1855936965, 2024-03-27T07:28:57.238 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630194, 2024-03-27T07:28:57.238 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-5.xml" 2024-03-27T07:28:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1856786038, 2024-03-27T07:28:57.239 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634683, 2024-03-27T07:28:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-24.xml" 2024-03-27T07:28:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1859645570, 2024-03-27T07:28:57.240 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630331, 2024-03-27T07:28:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-52.jpg" 2024-03-27T07:28:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.241 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1861378671, 2024-03-27T07:28:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258092, 2024-03-27T07:28:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg" 2024-03-27T07:28:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.242 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1861408694, 2024-03-27T07:28:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263220, 2024-03-27T07:28:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-15.xml" 2024-03-27T07:28:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.243 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1861510181, 2024-03-27T07:28:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633505, 2024-03-27T07:28:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-19.xml" 2024-03-27T07:28:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.244 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1868631893, 2024-03-27T07:28:57.245 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631909, 2024-03-27T07:28:57.245 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-44.xml" 2024-03-27T07:28:57.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.245 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1874934500, 2024-03-27T07:28:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266056, 2024-03-27T07:28:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-34.jpg" 2024-03-27T07:28:57.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.247 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.247 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.247 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1877799351, 2024-03-27T07:28:57.247 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267097, 2024-03-27T07:28:57.247 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-46.xml" 2024-03-27T07:28:57.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.248 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.248 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1878053107, 2024-03-27T07:28:57.249 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259632, 2024-03-27T07:28:57.249 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-41.jpg" 2024-03-27T07:28:57.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.249 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.249 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.249 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1881528081, 2024-03-27T07:28:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267284, 2024-03-27T07:28:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-58.jpg" 2024-03-27T07:28:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.250 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1882174889, 2024-03-27T07:28:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633455, 2024-03-27T07:28:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-35.xml" 2024-03-27T07:28:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.251 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1883463501, 2024-03-27T07:28:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267337, 2024-03-27T07:28:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-47.jpg" 2024-03-27T07:28:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.252 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1883615737, 2024-03-27T07:28:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267282, 2024-03-27T07:28:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml" 2024-03-27T07:28:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1883774001, 2024-03-27T07:28:57.253 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259352, 2024-03-27T07:28:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-48.xml" 2024-03-27T07:28:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.254 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1884843748, 2024-03-27T07:28:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631236, 2024-03-27T07:28:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-84.xml" 2024-03-27T07:28:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.255 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1885230274, 2024-03-27T07:28:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264087, 2024-03-27T07:28:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-19.xml" 2024-03-27T07:28:57.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1888345293, 2024-03-27T07:28:57.257 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267838, 2024-03-27T07:28:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-39.jpg" 2024-03-27T07:28:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.258 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1888486391, 2024-03-27T07:28:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259668, 2024-03-27T07:28:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-30.jpg" 2024-03-27T07:28:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.259 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1888953228, 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267055, 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-60.xml" 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1892188378, 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631016, 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-5.jpg" 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1893589580, 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630355, 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-33.jpg" 2024-03-27T07:28:57.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1896177770, 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534887110, 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-79.jpg" 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1897895585, 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630837, 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-2.jpg" 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.261 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1901951158, 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262640, 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-12.xml" 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1901974943, 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631712, 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-63.xml" 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.262 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1902863331, 2024-03-27T07:28:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634030, 2024-03-27T07:28:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-55.xml" 2024-03-27T07:28:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1903226493, 2024-03-27T07:28:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634638, 2024-03-27T07:28:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-26.xml" 2024-03-27T07:28:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.263 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1905896928, 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262856, 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-72.jpg" 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1910000332, 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262528, 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-30.xml" 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1912183074, 2024-03-27T07:28:57.264 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263056, 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-3.jpg" 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1913503439, 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634136, 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-6.xml" 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1913774923, 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261907, 2024-03-27T07:28:57.265 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-82.xml" 2024-03-27T07:28:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1916267192, 2024-03-27T07:28:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267439, 2024-03-27T07:28:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-61.jpg" 2024-03-27T07:28:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.266 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1916394960, 2024-03-27T07:28:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258053, 2024-03-27T07:28:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg" 2024-03-27T07:28:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1916538232, 2024-03-27T07:28:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266071, 2024-03-27T07:28:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-27.jpg" 2024-03-27T07:28:57.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1916768282, 2024-03-27T07:28:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267395, 2024-03-27T07:28:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-39.jpg" 2024-03-27T07:28:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1919650403, 2024-03-27T07:28:57.268 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261904, 2024-03-27T07:28:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-83.xml" 2024-03-27T07:28:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1920359647, 2024-03-27T07:28:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262589, 2024-03-27T07:28:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-24.xml" 2024-03-27T07:28:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.269 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1930168569, 2024-03-27T07:28:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263340, 2024-03-27T07:28:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-84.xml" 2024-03-27T07:28:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1931229573, 2024-03-27T07:28:57.270 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267430, 2024-03-27T07:28:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-63.jpg" 2024-03-27T07:28:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1932853158, 2024-03-27T07:28:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634289, 2024-03-27T07:28:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-22.xml" 2024-03-27T07:28:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.271 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1936271992, 2024-03-27T07:28:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263251, 2024-03-27T07:28:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-6.xml" 2024-03-27T07:28:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1937618047, 2024-03-27T07:28:57.272 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267537, 2024-03-27T07:28:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg" 2024-03-27T07:28:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1940539287, 2024-03-27T07:28:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630759, 2024-03-27T07:28:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-18.jpg" 2024-03-27T07:28:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.273 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1946622474, 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263978, 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-45.xml" 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1947352470, 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630346, 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-42.jpg" 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.274 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1951558267, 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634344, 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-36.xml" 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1952258091, 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258715, 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-20.jpg" 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.275 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1955128491, 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263960, 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-49.xml" 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1955900899, 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267088, 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-49.xml" 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.276 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1957991467, 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259366, 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-45.xml" 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1958340329, 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258379, 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-8.xml" 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.277 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1961569915, 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267398, 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-73.jpg" 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1962095817, 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631234, 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-86.xml" 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.278 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1964016883, 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261159, 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-56.xml" 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1964457450, 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259582, 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml" 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1972134862, 2024-03-27T07:28:57.279 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262841, 2024-03-27T07:28:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-4.xml" 2024-03-27T07:28:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1975498924, 2024-03-27T07:28:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633666, 2024-03-27T07:28:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-41.xml" 2024-03-27T07:28:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.280 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1976192487, 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263128, 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-47.xml" 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1976873492, 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634724, 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-80.xml" 2024-03-27T07:28:57.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1983371215, 2024-03-27T07:28:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261478, 2024-03-27T07:28:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-45.jpg" 2024-03-27T07:28:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1983577909, 2024-03-27T07:28:57.282 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634033, 2024-03-27T07:28:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-53.xml" 2024-03-27T07:28:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1984970542, 2024-03-27T07:28:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259492, 2024-03-27T07:28:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml" 2024-03-27T07:28:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.283 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1985362218, 2024-03-27T07:28:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634001, 2024-03-27T07:28:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-53.xml" 2024-03-27T07:28:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1990923488, 2024-03-27T07:28:57.284 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267298, 2024-03-27T07:28:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml" 2024-03-27T07:28:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1995546046, 2024-03-27T07:28:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259941, 2024-03-27T07:28:57.285 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-30.xml" 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1999113339, 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634261, 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-71.xml" 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 1999504992, 2024-03-27T07:28:57.286 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259312, 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-58.xml" 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2002294582, 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262869, 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-67.jpg" 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2005236469, 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631380, 2024-03-27T07:28:57.287 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-80.xml" 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2005253488, 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264144, 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-8.xml" 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2008783074, 2024-03-27T07:28:57.288 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631096, 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-91.xml" 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2008960064, 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262894, 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-57.jpg" 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2011781541, 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258108, 2024-03-27T07:28:57.289 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg" 2024-03-27T07:28:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2013294398, 2024-03-27T07:28:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259856, 2024-03-27T07:28:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-49.xml" 2024-03-27T07:28:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.290 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2018755381, 2024-03-27T07:28:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630336, 2024-03-27T07:28:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-75.xml" 2024-03-27T07:28:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2020324229, 2024-03-27T07:28:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262839, 2024-03-27T07:28:57.291 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-5.xml" 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2022367586, 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634407, 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-78.xml" 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2024180480, 2024-03-27T07:28:57.292 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267085, 2024-03-27T07:28:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-50.xml" 2024-03-27T07:28:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2024264896, 2024-03-27T07:28:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263427, 2024-03-27T07:28:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-56.xml" 2024-03-27T07:28:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.293 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2025711154, 2024-03-27T07:28:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635683, 2024-03-27T07:28:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml" 2024-03-27T07:28:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2029237872, 2024-03-27T07:28:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262971, 2024-03-27T07:28:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-26.jpg" 2024-03-27T07:28:57.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2029935058, 2024-03-27T07:28:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630985, 2024-03-27T07:28:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-24.jpg" 2024-03-27T07:28:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.295 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2032803543, 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261677, 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-91.xml" 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2034464986, 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267278, 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml" 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.296 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2038041213, 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630320, 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-63.jpg" 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2039540523, 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633433, 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-43.xml" 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.297 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2040685892, 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634098, 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-6.xml" 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2043031432, 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534887191, 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-59.xml" 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.298 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2043512542, 2024-03-27T07:28:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630348, 2024-03-27T07:28:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-40.jpg" 2024-03-27T07:28:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2043878554, 2024-03-27T07:28:57.299 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634699, 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-21.xml" 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2046125148, 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267308, 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-52.jpg" 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.300 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2046197076, 2024-03-27T07:28:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267864, 2024-03-27T07:28:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-30.jpg" 2024-03-27T07:28:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.301 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2046921931, 2024-03-27T07:28:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634432, 2024-03-27T07:28:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-54.xml" 2024-03-27T07:28:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2047032093, 2024-03-27T07:28:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633461, 2024-03-27T07:28:57.302 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-33.xml" 2024-03-27T07:28:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2051933554, 2024-03-27T07:28:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630994, 2024-03-27T07:28:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-19.jpg" 2024-03-27T07:28:57.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2052119061, 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634636, 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-27.xml" 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2054461469, 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261225, 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-38.xml" 2024-03-27T07:28:57.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2056477775, 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631877, 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-48.xml" 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2057803816, 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633932, 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-93.xml" 2024-03-27T07:28:57.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2060213908, 2024-03-27T07:28:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633950, 2024-03-27T07:28:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-79.xml" 2024-03-27T07:28:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2060706530, 2024-03-27T07:28:57.306 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263843, 2024-03-27T07:28:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-73.xml" 2024-03-27T07:28:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2060913607, 2024-03-27T07:28:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261316, 2024-03-27T07:28:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-15.xml" 2024-03-27T07:28:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.307 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2064234772, 2024-03-27T07:28:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267349, 2024-03-27T07:28:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-87.jpg" 2024-03-27T07:28:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.308 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2071770874, 2024-03-27T07:28:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634519, 2024-03-27T07:28:57.309 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-35.xml" 2024-03-27T07:28:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.310 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2079834179, 2024-03-27T07:28:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259539, 2024-03-27T07:28:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml" 2024-03-27T07:28:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2080870425, 2024-03-27T07:28:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265980, 2024-03-27T07:28:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-72.jpg" 2024-03-27T07:28:57.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2081504260, 2024-03-27T07:28:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633985, 2024-03-27T07:28:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-66.xml" 2024-03-27T07:28:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2082579633, 2024-03-27T07:28:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630358, 2024-03-27T07:28:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-30.jpg" 2024-03-27T07:28:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2084774151, 2024-03-27T07:28:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258826, 2024-03-27T07:28:57.313 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg" 2024-03-27T07:28:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2092260726, 2024-03-27T07:28:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534886129, 2024-03-27T07:28:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-10.xml" 2024-03-27T07:28:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.314 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2095869560, 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267314, 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml" 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2100864012, 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630112, 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-22.xml" 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2101753990, 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261128, 2024-03-27T07:28:57.315 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-64.xml" 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2108044934, 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266010, 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-57.jpg" 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2110181650, 2024-03-27T07:28:57.316 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267585, 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-40.xml" 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2110204439, 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261370, 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-5.xml" 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2114175614, 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267179, 2024-03-27T07:28:57.317 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-24.xml" 2024-03-27T07:28:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2118433881, 2024-03-27T07:28:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263331, 2024-03-27T07:28:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-87.xml" 2024-03-27T07:28:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.318 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2118837336, 2024-03-27T07:28:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258813, 2024-03-27T07:28:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg" 2024-03-27T07:28:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2120226218, 2024-03-27T07:28:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260126, 2024-03-27T07:28:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-42.xml" 2024-03-27T07:28:57.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2120712817, 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262636, 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-13.xml" 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2120805459, 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630351, 2024-03-27T07:28:57.320 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-37.jpg" 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2120854446, 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633029, 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-79.jpg" 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2122162556, 2024-03-27T07:28:57.321 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263143, 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-41.xml" 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2123501958, 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262789, 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-24.xml" 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.322 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2126872728, 2024-03-27T07:28:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257823, 2024-03-27T07:28:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-46.jpg" 2024-03-27T07:28:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2128336258, 2024-03-27T07:28:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633531, 2024-03-27T07:28:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-8.xml" 2024-03-27T07:28:57.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2129874069, 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633873, 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-93.jpg" 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2137005288, 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265968, 2024-03-27T07:28:57.324 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-78.jpg" 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2145659593, 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263189, 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-24.xml" 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2148789002, 2024-03-27T07:28:57.325 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534884602, 2024-03-27T07:28:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-54.jpg" 2024-03-27T07:28:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2149049098, 2024-03-27T07:28:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267617, 2024-03-27T07:28:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-29.xml" 2024-03-27T07:28:57.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2154211619, 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258112, 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg" 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2156505972, 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634625, 2024-03-27T07:28:57.327 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-32.xml" 2024-03-27T07:28:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2156684660, 2024-03-27T07:28:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267353, 2024-03-27T07:28:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-86.jpg" 2024-03-27T07:28:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.328 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2158711651, 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634287, 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-64.xml" 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2160158908, 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631043, 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml" 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.329 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2161085560, 2024-03-27T07:28:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634210, 2024-03-27T07:28:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-83.xml" 2024-03-27T07:28:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2162643479, 2024-03-27T07:28:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634346, 2024-03-27T07:28:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-35.xml" 2024-03-27T07:28:57.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2164296333, 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630258, 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-76.jpg" 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2167548043, 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261559, 2024-03-27T07:28:57.331 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-25.jpg" 2024-03-27T07:28:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2171479404, 2024-03-27T07:28:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630330, 2024-03-27T07:28:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-53.jpg" 2024-03-27T07:28:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.332 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2175544265, 2024-03-27T07:28:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263050, 2024-03-27T07:28:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-5.jpg" 2024-03-27T07:28:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2177857216, 2024-03-27T07:28:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259720, 2024-03-27T07:28:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg" 2024-03-27T07:28:57.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2180234742, 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631049, 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-4.xml" 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2181662513, 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630840, 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-1.jpg" 2024-03-27T07:28:57.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2182399156, 2024-03-27T07:28:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267294, 2024-03-27T07:28:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml" 2024-03-27T07:28:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.335 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2184082102, 2024-03-27T07:28:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267533, 2024-03-27T07:28:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-12.jpg" 2024-03-27T07:28:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2186513657, 2024-03-27T07:28:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267356, 2024-03-27T07:28:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-85.jpg" 2024-03-27T07:28:57.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2191598036, 2024-03-27T07:28:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633554, 2024-03-27T07:28:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-6.xml" 2024-03-27T07:28:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.337 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2198268357, 2024-03-27T07:28:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262929, 2024-03-27T07:28:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-43.jpg" 2024-03-27T07:28:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2202298992, 2024-03-27T07:28:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634314, 2024-03-27T07:28:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-51.xml" 2024-03-27T07:28:57.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2205254452, 2024-03-27T07:28:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262594, 2024-03-27T07:28:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-23.xml" 2024-03-27T07:28:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.339 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2205258493, 2024-03-27T07:28:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263038, 2024-03-27T07:28:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-9.jpg" 2024-03-27T07:28:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2205410960, 2024-03-27T07:28:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634760, 2024-03-27T07:28:57.340 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-15.xml" 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2207066749, 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262801, 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-20.xml" 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2207812980, 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634072, 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-15.xml" 2024-03-27T07:28:57.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2208676595, 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265982, 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-71.jpg" 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2211663701, 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259487, 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml" 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.342 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2212558159, 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267614, 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg" 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2215917019, 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262901, 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-54.jpg" 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.343 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2216644031, 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267792, 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-54.jpg" 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2218302434, 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634357, 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-28.xml" 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2218555387, 2024-03-27T07:28:57.344 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634284, 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-65.xml" 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2219284442, 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267571, 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg" 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2219765619, 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634504, 2024-03-27T07:28:57.345 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-38.xml" 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2219871723, 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259769, 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg" 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2219991053, 2024-03-27T07:28:57.346 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634029, 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-35.xml" 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2223224537, 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263436, 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-53.xml" 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2224431233, 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633973, 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-68.xml" 2024-03-27T07:28:57.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2225316564, 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267034, 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-67.xml" 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2228187993, 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631001, 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-12.jpg" 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.348 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2229204717, 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259568, 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml" 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2229380204, 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267409, 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-70.jpg" 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2230466781, 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259112, 2024-03-27T07:28:57.349 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-16.jpg" 2024-03-27T07:28:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2233788851, 2024-03-27T07:28:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634376, 2024-03-27T07:28:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-11.xml" 2024-03-27T07:28:57.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2236734221, 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263162, 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-33.xml" 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2238087191, 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259453, 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml" 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.351 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2238741105, 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263113, 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-53.xml" 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2239562021, 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630767, 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-16.jpg" 2024-03-27T07:28:57.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2240524130, 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261892, 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-86.xml" 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2240957014, 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267020, 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-72.xml" 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.353 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2246620581, 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263062, 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-1.jpg" 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2247490025, 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263985, 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-43.xml" 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.354 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2251069190, 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267264, 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-63.jpg" 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2252877182, 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266097, 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-14.jpg" 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2258951102, 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259863, 2024-03-27T07:28:57.355 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-65.xml" 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2264157356, 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259393, 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-40.xml" 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2264867247, 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633961, 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-74.xml" 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.356 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2265771356, 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634423, 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-63.xml" 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2266815950, 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259629, 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-42.jpg" 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.357 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2267228311, 2024-03-27T07:28:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263178, 2024-03-27T07:28:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-27.xml" 2024-03-27T07:28:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2268396964, 2024-03-27T07:28:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266069, 2024-03-27T07:28:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-28.jpg" 2024-03-27T07:28:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.358 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2272980160, 2024-03-27T07:28:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636876, 2024-03-27T07:28:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-63.jpg" 2024-03-27T07:28:57.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2273184146, 2024-03-27T07:28:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267619, 2024-03-27T07:28:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg" 2024-03-27T07:28:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.360 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2273472498, 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259573, 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml" 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2275305456, 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263133, 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-45.xml" 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2277690262, 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265974, 2024-03-27T07:28:57.361 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-75.jpg" 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2278206913, 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264222, 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg" 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2282184913, 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260074, 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-3.xml" 2024-03-27T07:28:57.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2284673469, 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267064, 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-57.xml" 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2286708350, 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258008, 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-27.jpg" 2024-03-27T07:28:57.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2286762329, 2024-03-27T07:28:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259728, 2024-03-27T07:28:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg" 2024-03-27T07:28:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2293092246, 2024-03-27T07:28:57.364 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267154, 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-30.xml" 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2293510163, 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263160, 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-34.xml" 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2298392904, 2024-03-27T07:28:57.365 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634412, 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-74.xml" 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2302146090, 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263028, 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-19.jpg" 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.366 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2302488265, 2024-03-27T07:28:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259808, 2024-03-27T07:28:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-71.xml" 2024-03-27T07:28:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2302777029, 2024-03-27T07:28:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634044, 2024-03-27T07:28:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-28.xml" 2024-03-27T07:28:57.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2304845785, 2024-03-27T07:28:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266123, 2024-03-27T07:28:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-1.jpg" 2024-03-27T07:28:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.368 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2310932465, 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259777, 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg" 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2316851350, 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267170, 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-26.xml" 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.369 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2320825410, 2024-03-27T07:28:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634361, 2024-03-27T07:28:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-24.xml" 2024-03-27T07:28:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2321063512, 2024-03-27T07:28:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630173, 2024-03-27T07:28:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-14.xml" 2024-03-27T07:28:57.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2322001758, 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631401, 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-76.xml" 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2326224678, 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267358, 2024-03-27T07:28:57.371 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-44.jpg" 2024-03-27T07:28:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2326260048, 2024-03-27T07:28:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631680, 2024-03-27T07:28:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-81.jpg" 2024-03-27T07:28:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.372 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2326947202, 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264492, 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg" 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2327459084, 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634454, 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-47.xml" 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.373 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2329583750, 2024-03-27T07:28:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630315, 2024-03-27T07:28:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-67.jpg" 2024-03-27T07:28:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2330311255, 2024-03-27T07:28:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631834, 2024-03-27T07:28:57.374 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-53.xml" 2024-03-27T07:28:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2330545218, 2024-03-27T07:28:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263046, 2024-03-27T07:28:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-13.jpg" 2024-03-27T07:28:57.375 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2330571316, 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263007, 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-17.jpg" 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2331702494, 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631575, 2024-03-27T07:28:57.376 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-59.xml" 2024-03-27T07:28:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2331907606, 2024-03-27T07:28:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263272, 2024-03-27T07:28:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-11.jpg" 2024-03-27T07:28:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.377 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2336483421, 2024-03-27T07:28:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262826, 2024-03-27T07:28:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-10.xml" 2024-03-27T07:28:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2339305099, 2024-03-27T07:28:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634373, 2024-03-27T07:28:57.378 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-14.xml" 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2344734166, 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267807, 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-49.jpg" 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2350150127, 2024-03-27T07:28:57.379 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263409, 2024-03-27T07:28:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-62.xml" 2024-03-27T07:28:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2351266269, 2024-03-27T07:28:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265986, 2024-03-27T07:28:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-69.jpg" 2024-03-27T07:28:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.380 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2356111361, 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263105, 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-56.xml" 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2356895502, 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630179, 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-12.xml" 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2359984118, 2024-03-27T07:28:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267591, 2024-03-27T07:28:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-38.xml" 2024-03-27T07:28:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2360115491, 2024-03-27T07:28:57.382 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262816, 2024-03-27T07:28:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-14.xml" 2024-03-27T07:28:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.383 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2374600408, 2024-03-27T07:28:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265996, 2024-03-27T07:28:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-64.jpg" 2024-03-27T07:28:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2381013626, 2024-03-27T07:28:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262943, 2024-03-27T07:28:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-37.jpg" 2024-03-27T07:28:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.384 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2381541763, 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630108, 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-47.xml" 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2381906275, 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267615, 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-30.xml" 2024-03-27T07:28:57.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2383722391, 2024-03-27T07:28:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630998, 2024-03-27T07:28:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-15.jpg" 2024-03-27T07:28:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2387637264, 2024-03-27T07:28:57.386 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631286, 2024-03-27T07:28:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-28.jpg" 2024-03-27T07:28:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2387895802, 2024-03-27T07:28:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265994, 2024-03-27T07:28:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-65.jpg" 2024-03-27T07:28:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.387 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2389533024, 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630138, 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-69.xml" 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2394891273, 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023274010, 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-9.xml" 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2395515091, 2024-03-27T07:28:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634027, 2024-03-27T07:28:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-57.xml" 2024-03-27T07:28:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2396042642, 2024-03-27T07:28:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259083, 2024-03-27T07:28:57.389 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-35.xml" 2024-03-27T07:28:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2399099136, 2024-03-27T07:28:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630816, 2024-03-27T07:28:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-7.jpg" 2024-03-27T07:28:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.390 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2407173106, 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631005, 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-10.jpg" 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2412559883, 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634021, 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-38.xml" 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.391 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2412651360, 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634144, 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-1.xml" 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2412844789, 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257612, 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml" 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.392 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2413154525, 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267438, 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-12.xml" 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2413563809, 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263969, 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-47.xml" 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2419787923, 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267474, 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-51.jpg" 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2423551144, 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260007, 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-52.xml" 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.394 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2425439011, 2024-03-27T07:28:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263035, 2024-03-27T07:28:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-10.jpg" 2024-03-27T07:28:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2427079592, 2024-03-27T07:28:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263185, 2024-03-27T07:28:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-25.xml" 2024-03-27T07:28:57.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2431720530, 2024-03-27T07:28:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634498, 2024-03-27T07:28:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-39.xml" 2024-03-27T07:28:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.396 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2433629483, 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266050, 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-37.jpg" 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2435053100, 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267158, 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-29.xml" 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.397 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2436361126, 2024-03-27T07:28:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630730, 2024-03-27T07:28:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-24.jpg" 2024-03-27T07:28:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.398 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2440060753, 2024-03-27T07:28:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267100, 2024-03-27T07:28:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-45.xml" 2024-03-27T07:28:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2441074601, 2024-03-27T07:28:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631244, 2024-03-27T07:28:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-82.xml" 2024-03-27T07:28:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.399 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2446584391, 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261434, 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-56.jpg" 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2448813766, 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263087, 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-63.xml" 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.400 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2451996739, 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629927, 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-36.xml" 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2452592165, 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267640, 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-21.xml" 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.401 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2463866855, 2024-03-27T07:28:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266004, 2024-03-27T07:28:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-60.jpg" 2024-03-27T07:28:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2466213917, 2024-03-27T07:28:57.402 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261218, 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-40.xml" 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2467721444, 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267091, 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-48.xml" 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.403 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2470396360, 2024-03-27T07:28:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267193, 2024-03-27T07:28:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-20.xml" 2024-03-27T07:28:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2476854260, 2024-03-27T07:28:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634034, 2024-03-27T07:28:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-33.xml" 2024-03-27T07:28:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.404 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2477856622, 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634288, 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-63.xml" 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2479603171, 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631228, 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-91.xml" 2024-03-27T07:28:57.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2481483869, 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257675, 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml" 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2481516130, 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263022, 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-21.jpg" 2024-03-27T07:28:57.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2488371400, 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267551, 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-6.jpg" 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2492548044, 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258534, 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml" 2024-03-27T07:28:57.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2492784326, 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635326, 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-30.xml" 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2494524533, 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267416, 2024-03-27T07:28:57.408 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-36.jpg" 2024-03-27T07:28:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2494899100, 2024-03-27T07:28:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633934, 2024-03-27T07:28:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-91.xml" 2024-03-27T07:28:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.409 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2496715063, 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260030, 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-12.xml" 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2497015371, 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263973, 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-46.xml" 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.410 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2497773396, 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263303, 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-2.jpg" 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2500683434, 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258358, 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-12.xml" 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.411 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2503582034, 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263369, 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-75.xml" 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2504299519, 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634460, 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-46.xml" 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.412 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2504476297, 2024-03-27T07:28:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630357, 2024-03-27T07:28:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-31.jpg" 2024-03-27T07:28:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2505902898, 2024-03-27T07:28:57.413 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633508, 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-16.xml" 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2506616429, 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630799, 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-11.jpg" 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2510733378, 2024-03-27T07:28:57.414 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262811, 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-16.xml" 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2512574386, 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634629, 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-91.xml" 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2516176939, 2024-03-27T07:28:57.415 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262951, 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-34.jpg" 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2519709593, 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257781, 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-52.jpg" 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2520103373, 2024-03-27T07:28:57.416 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634232, 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-44.xml" 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2520503058, 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263282, 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-8.jpg" 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2520823651, 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267508, 2024-03-27T07:28:57.417 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-20.jpg" 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2526795930, 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634304, 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-56.xml" 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2535955269, 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267635, 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg" 2024-03-27T07:28:57.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2537303396, 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634639, 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-87.xml" 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2537526517, 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263152, 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-37.xml" 2024-03-27T07:28:57.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2537989386, 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262624, 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-16.xml" 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2538601878, 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263297, 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-4.jpg" 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.420 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2540146432, 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634358, 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-27.xml" 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2541770206, 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267870, 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-28.jpg" 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2543901763, 2024-03-27T07:28:57.421 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633965, 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-74.xml" 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2546194221, 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633983, 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-67.xml" 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2551786911, 2024-03-27T07:28:57.422 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630725, 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-96.xml" 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2554224875, 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263322, 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-90.xml" 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2554268068, 2024-03-27T07:28:57.423 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634372, 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-15.xml" 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2555573760, 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267014, 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-74.xml" 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2556655469, 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265962, 2024-03-27T07:28:57.424 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-81.jpg" 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2556685861, 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631893, 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-46.xml" 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2559445309, 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634008, 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-24.xml" 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.425 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2561739575, 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259750, 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg" 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2563520844, 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634426, 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-60.xml" 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.426 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2563895977, 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633402, 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-51.xml" 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2566049749, 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262921, 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-46.jpg" 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.427 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2568180769, 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262926, 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-44.jpg" 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2568769119, 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262996, 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-19.jpg" 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2569275242, 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630990, 2024-03-27T07:28:57.428 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-22.jpg" 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2569652618, 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633509, 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-15.xml" 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2569841620, 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259853, 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-66.xml" 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.429 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2573581906, 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265990, 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-67.jpg" 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2573787344, 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633999, 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-62.xml" 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.430 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2574329618, 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630727, 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-25.jpg" 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2576801547, 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632814, 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-86.xml" 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2577333528, 2024-03-27T07:28:57.431 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263234, 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-11.xml" 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2579052033, 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267515, 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-18.jpg" 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2581617632, 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267521, 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-16.jpg" 2024-03-27T07:28:57.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2582355877, 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267258, 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml" 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2587079364, 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267510, 2024-03-27T07:28:57.433 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg" 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2587299603, 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633111, 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-9.xml" 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2593773128, 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267662, 2024-03-27T07:28:57.434 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-14.xml" 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2593982890, 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631861, 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-50.xml" 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2595341366, 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267504, 2024-03-27T07:28:57.435 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-21.jpg" 2024-03-27T07:28:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2598097601, 2024-03-27T07:28:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267646, 2024-03-27T07:28:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-19.xml" 2024-03-27T07:28:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.436 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2599064970, 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634053, 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-46.xml" 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2599095516, 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262899, 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-55.jpg" 2024-03-27T07:28:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2600840866, 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634251, 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-73.xml" 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2601112873, 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633424, 2024-03-27T07:28:57.438 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-46.xml" 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2603592921, 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261311, 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-16.xml" 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2605387679, 2024-03-27T07:28:57.439 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634838, 2024-03-27T07:28:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-8.xml" 2024-03-27T07:28:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2611614037, 2024-03-27T07:28:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263245, 2024-03-27T07:28:57.440 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-8.xml" 2024-03-27T07:28:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2617839585, 2024-03-27T07:28:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262886, 2024-03-27T07:28:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-60.jpg" 2024-03-27T07:28:57.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2622222842, 2024-03-27T07:28:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257680, 2024-03-27T07:28:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-69.jpg" 2024-03-27T07:28:57.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2622995520, 2024-03-27T07:28:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633986, 2024-03-27T07:28:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-60.xml" 2024-03-27T07:28:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.443 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2625333443, 2024-03-27T07:28:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630284, 2024-03-27T07:28:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-74.jpg" 2024-03-27T07:28:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.444 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2630602954, 2024-03-27T07:28:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267835, 2024-03-27T07:28:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-40.jpg" 2024-03-27T07:28:57.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2632789133, 2024-03-27T07:28:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263400, 2024-03-27T07:28:57.446 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-65.xml" 2024-03-27T07:28:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2638611156, 2024-03-27T07:28:57.447 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630997, 2024-03-27T07:28:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-16.jpg" 2024-03-27T07:28:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2638874840, 2024-03-27T07:28:57.448 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630115, 2024-03-27T07:28:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-44.xml" 2024-03-27T07:28:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2640971222, 2024-03-27T07:28:57.449 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634140, 2024-03-27T07:28:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-5.xml" 2024-03-27T07:28:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2641032984, 2024-03-27T07:28:57.450 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263833, 2024-03-27T07:28:57.451 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-75.xml" 2024-03-27T07:28:57.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.451 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.452 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2642936990, 2024-03-27T07:28:57.452 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262876, 2024-03-27T07:28:57.452 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-64.jpg" 2024-03-27T07:28:57.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.452 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.452 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.452 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2643955744, 2024-03-27T07:28:57.452 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633053, 2024-03-27T07:28:57.453 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-12.jpg" 2024-03-27T07:28:57.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.453 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.453 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2652791033, 2024-03-27T07:28:57.453 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258441, 2024-03-27T07:28:57.453 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-6.jpg" 2024-03-27T07:28:57.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2653288889, 2024-03-27T07:28:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634859, 2024-03-27T07:28:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-7.xml" 2024-03-27T07:28:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2653556640, 2024-03-27T07:28:57.454 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634138, 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-79.jpg" 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2655114431, 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257806, 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-48.jpg" 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.455 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2655328327, 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631886, 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-47.xml" 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2657473382, 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631742, 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-54.xml" 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2658880563, 2024-03-27T07:28:57.456 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631057, 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-20.xml" 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2659875628, 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261482, 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-44.jpg" 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2665737869, 2024-03-27T07:28:57.457 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263853, 2024-03-27T07:28:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-71.xml" 2024-03-27T07:28:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2667842227, 2024-03-27T07:28:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267312, 2024-03-27T07:28:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-51.jpg" 2024-03-27T07:28:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.458 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2668862708, 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261232, 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-36.xml" 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2670489341, 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267472, 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-29.jpg" 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2672796304, 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259716, 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg" 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2672816905, 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633993, 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-57.xml" 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2673767185, 2024-03-27T07:28:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265948, 2024-03-27T07:28:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-7.xml" 2024-03-27T07:28:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2675973204, 2024-03-27T07:28:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634377, 2024-03-27T07:28:57.461 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-10.xml" 2024-03-27T07:28:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2681279548, 2024-03-27T07:28:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266006, 2024-03-27T07:28:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-59.jpg" 2024-03-27T07:28:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.462 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2681414350, 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267567, 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg" 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2681863939, 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265984, 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-70.jpg" 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2686050408, 2024-03-27T07:28:57.463 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634308, 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-54.xml" 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2688375986, 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259742, 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg" 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2689753591, 2024-03-27T07:28:57.464 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631111, 2024-03-27T07:28:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-57.xml" 2024-03-27T07:28:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2692940149, 2024-03-27T07:28:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267831, 2024-03-27T07:28:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-41.jpg" 2024-03-27T07:28:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.465 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2697246448, 2024-03-27T07:28:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267625, 2024-03-27T07:28:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-26.xml" 2024-03-27T07:28:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2700000468, 2024-03-27T07:28:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634416, 2024-03-27T07:28:57.466 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-70.xml" 2024-03-27T07:28:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2702397393, 2024-03-27T07:28:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258421, 2024-03-27T07:28:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-11.jpg" 2024-03-27T07:28:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.467 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2703213615, 2024-03-27T07:28:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259589, 2024-03-27T07:28:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml" 2024-03-27T07:28:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2704940707, 2024-03-27T07:28:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633944, 2024-03-27T07:28:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-82.xml" 2024-03-27T07:28:57.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2705918712, 2024-03-27T07:28:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636083, 2024-03-27T07:28:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-31.xml" 2024-03-27T07:28:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.469 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2707190805, 2024-03-27T07:28:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258436, 2024-03-27T07:28:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-7.jpg" 2024-03-27T07:28:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2707650234, 2024-03-27T07:28:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634355, 2024-03-27T07:28:57.470 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-30.xml" 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2709836107, 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630353, 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-35.jpg" 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2712720697, 2024-03-27T07:28:57.471 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267467, 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-53.jpg" 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2726513940, 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631522, 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-79.xml" 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.472 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2726576547, 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262013, 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-73.xml" 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2726889688, 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633117, 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg" 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.473 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2727051753, 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262804, 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-19.xml" 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2727523942, 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266099, 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-13.jpg" 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.474 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2728928363, 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636035, 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-41.xml" 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2729661656, 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258657, 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-26.jpg" 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2731447477, 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261112, 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-68.xml" 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2731845954, 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264106, 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-15.xml" 2024-03-27T07:28:57.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2732116642, 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266103, 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-11.jpg" 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2734411860, 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633952, 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-78.xml" 2024-03-27T07:28:57.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2735530989, 2024-03-27T07:28:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633442, 2024-03-27T07:28:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-40.xml" 2024-03-27T07:28:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2736854919, 2024-03-27T07:28:57.478 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631723, 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-60.xml" 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2740449341, 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262583, 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-25.xml" 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.479 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2740676119, 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263909, 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-60.xml" 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2740893040, 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634114, 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-19.xml" 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.480 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2745220587, 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267442, 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-33.jpg" 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2745311330, 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261450, 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-52.jpg" 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.481 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2749383846, 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633513, 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-13.xml" 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2749699867, 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630299, 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-72.jpg" 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.482 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2749723774, 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257773, 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-53.jpg" 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2752441289, 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634367, 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-18.xml" 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.483 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2752970692, 2024-03-27T07:28:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267049, 2024-03-27T07:28:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-62.xml" 2024-03-27T07:28:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2759082333, 2024-03-27T07:28:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267488, 2024-03-27T07:28:57.484 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-25.jpg" 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2760409897, 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633974, 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-70.xml" 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2762158499, 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267377, 2024-03-27T07:28:57.485 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-79.jpg" 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2762933687, 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267142, 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-33.xml" 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2763551805, 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634642, 2024-03-27T07:28:57.486 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-25.xml" 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2765919011, 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630349, 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-39.jpg" 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2767551702, 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264012, 2024-03-27T07:28:57.487 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-36.xml" 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2767557787, 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267825, 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-43.jpg" 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2767866342, 2024-03-27T07:28:57.488 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630344, 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-43.jpg" 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2768150246, 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264489, 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg" 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2775935623, 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263192, 2024-03-27T07:28:57.489 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-23.xml" 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2777063553, 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257787, 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-51.jpg" 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2778056437, 2024-03-27T07:28:57.490 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631056, 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-4.jpg" 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2781837078, 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263306, 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-1.jpg" 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.491 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2788387401, 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636061, 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-36.xml" 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2788688499, 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267524, 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-15.jpg" 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.492 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2792156773, 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267453, 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-57.jpg" 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2793640741, 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636064, 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-35.xml" 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.493 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2793667699, 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267607, 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg" 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2797038217, 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261269, 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-26.xml" 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2799930312, 2024-03-27T07:28:57.494 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267237, 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-7.xml" 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2800385315, 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631034, 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-1.jpg" 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2802794820, 2024-03-27T07:28:57.495 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266081, 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-22.jpg" 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2803232188, 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631233, 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-87.xml" 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2804234542, 2024-03-27T07:28:57.496 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263998, 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-40.xml" 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2807676638, 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634339, 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-40.xml" 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.497 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2809816274, 2024-03-27T07:28:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633477, 2024-03-27T07:28:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-29.xml" 2024-03-27T07:28:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2813548943, 2024-03-27T07:28:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634514, 2024-03-27T07:28:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-36.xml" 2024-03-27T07:28:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.498 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2815140258, 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262792, 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-23.xml" 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2817428954, 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263037, 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-16.jpg" 2024-03-27T07:28:57.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2820616179, 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634409, 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-77.xml" 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2823099119, 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262834, 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-7.xml" 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.500 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2827169565, 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630170, 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-16.xml" 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2828534747, 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267580, 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg" 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.501 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2828652915, 2024-03-27T07:28:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634524, 2024-03-27T07:28:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-95.xml" 2024-03-27T07:28:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2831078078, 2024-03-27T07:28:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264228, 2024-03-27T07:28:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg" 2024-03-27T07:28:57.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2842876520, 2024-03-27T07:28:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267423, 2024-03-27T07:28:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-35.jpg" 2024-03-27T07:28:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2844237509, 2024-03-27T07:28:57.503 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632871, 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-36.xml" 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2846354048, 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261358, 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-8.xml" 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.504 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2846731520, 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261619, 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-16.jpg" 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2846773697, 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631413, 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-74.xml" 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.505 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2849174248, 2024-03-27T07:28:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633981, 2024-03-27T07:28:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-63.xml" 2024-03-27T07:28:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2850418334, 2024-03-27T07:28:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263110, 2024-03-27T07:28:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-54.xml" 2024-03-27T07:28:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2851140350, 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258004, 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-28.jpg" 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2853144772, 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267719, 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-78.jpg" 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.507 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2853341632, 2024-03-27T07:28:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267396, 2024-03-27T07:28:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-74.jpg" 2024-03-27T07:28:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2853564492, 2024-03-27T07:28:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634689, 2024-03-27T07:28:57.508 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-23.xml" 2024-03-27T07:28:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2858621082, 2024-03-27T07:28:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264075, 2024-03-27T07:28:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-99.xml" 2024-03-27T07:28:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.509 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2861428098, 2024-03-27T07:28:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267310, 2024-03-27T07:28:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml" 2024-03-27T07:28:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2862604869, 2024-03-27T07:28:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263868, 2024-03-27T07:28:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-68.xml" 2024-03-27T07:28:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.510 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2866526837, 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634400, 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-82.xml" 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2868192637, 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634123, 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-11.xml" 2024-03-27T07:28:57.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2874945562, 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267023, 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-71.xml" 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2877264652, 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630246, 2024-03-27T07:28:57.512 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-77.jpg" 2024-03-27T07:28:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2877810705, 2024-03-27T07:28:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263858, 2024-03-27T07:28:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-70.xml" 2024-03-27T07:28:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.513 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2879788012, 2024-03-27T07:28:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633473, 2024-03-27T07:28:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-30.xml" 2024-03-27T07:28:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2882946741, 2024-03-27T07:28:57.514 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634246, 2024-03-27T07:28:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-74.xml" 2024-03-27T07:28:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2883699573, 2024-03-27T07:28:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633506, 2024-03-27T07:28:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-18.xml" 2024-03-27T07:28:57.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2884619099, 2024-03-27T07:28:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258511, 2024-03-27T07:28:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-35.xml" 2024-03-27T07:28:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.516 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2885502337, 2024-03-27T07:28:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263825, 2024-03-27T07:28:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-77.xml" 2024-03-27T07:28:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.517 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2887169566, 2024-03-27T07:28:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266095, 2024-03-27T07:28:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-15.jpg" 2024-03-27T07:28:57.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2887572309, 2024-03-27T07:28:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257942, 2024-03-27T07:28:57.519 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-37.jpg" 2024-03-27T07:28:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2890141316, 2024-03-27T07:28:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263175, 2024-03-27T07:28:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-28.xml" 2024-03-27T07:28:57.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2891533783, 2024-03-27T07:28:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261192, 2024-03-27T07:28:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-47.xml" 2024-03-27T07:28:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.521 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2893525076, 2024-03-27T07:28:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267678, 2024-03-27T07:28:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-9.xml" 2024-03-27T07:28:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.522 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2898027340, 2024-03-27T07:28:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261132, 2024-03-27T07:28:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-63.xml" 2024-03-27T07:28:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2908427561, 2024-03-27T07:28:57.523 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262783, 2024-03-27T07:28:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-26.xml" 2024-03-27T07:28:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2911869699, 2024-03-27T07:28:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267450, 2024-03-27T07:28:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-58.jpg" 2024-03-27T07:28:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2912488310, 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267128, 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-37.xml" 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2915184582, 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267759, 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-65.jpg" 2024-03-27T07:28:57.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2915302588, 2024-03-27T07:28:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263294, 2024-03-27T07:28:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-5.jpg" 2024-03-27T07:28:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2921479703, 2024-03-27T07:28:57.526 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630733, 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-23.jpg" 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2922580306, 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267885, 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-25.jpg" 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.527 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2926168897, 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634349, 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-34.xml" 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2927186989, 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264063, 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-24.xml" 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2929997378, 2024-03-27T07:28:57.528 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259323, 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-55.xml" 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2933349643, 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634212, 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-82.xml" 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2934258045, 2024-03-27T07:28:57.529 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264392, 2024-03-27T07:28:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg" 2024-03-27T07:28:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2934522806, 2024-03-27T07:28:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267610, 2024-03-27T07:28:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg" 2024-03-27T07:28:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.530 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2934710496, 2024-03-27T07:28:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262573, 2024-03-27T07:28:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-26.xml" 2024-03-27T07:28:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.531 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2935891337, 2024-03-27T07:28:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630996, 2024-03-27T07:28:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-17.jpg" 2024-03-27T07:28:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.532 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2942349576, 2024-03-27T07:28:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631749, 2024-03-27T07:28:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-52.xml" 2024-03-27T07:28:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2942350607, 2024-03-27T07:28:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261631, 2024-03-27T07:28:57.533 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-12.jpg" 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2944670475, 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267695, 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-4.xml" 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2944854435, 2024-03-27T07:28:57.534 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263928, 2024-03-27T07:28:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-56.xml" 2024-03-27T07:28:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2946305965, 2024-03-27T07:28:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266101, 2024-03-27T07:28:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-12.jpg" 2024-03-27T07:28:57.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2949276934, 2024-03-27T07:28:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634402, 2024-03-27T07:28:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-80.xml" 2024-03-27T07:28:57.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2951020433, 2024-03-27T07:28:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267768, 2024-03-27T07:28:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-62.jpg" 2024-03-27T07:28:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.537 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2951732637, 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631917, 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-43.xml" 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2953057995, 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263227, 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-13.xml" 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.538 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2955737348, 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263040, 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-15.jpg" 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2959797672, 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267506, 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg" 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.539 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2960626896, 2024-03-27T07:28:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257663, 2024-03-27T07:28:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml" 2024-03-27T07:28:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2961632497, 2024-03-27T07:28:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263120, 2024-03-27T07:28:57.540 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-50.xml" 2024-03-27T07:28:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2975914929, 2024-03-27T07:28:57.541 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630337, 2024-03-27T07:28:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-48.jpg" 2024-03-27T07:28:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.542 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2976141397, 2024-03-27T07:28:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631654, 2024-03-27T07:28:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-42.xml" 2024-03-27T07:28:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.543 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2978698595, 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258399, 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-4.xml" 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2978790946, 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636077, 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-32.xml" 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2981234693, 2024-03-27T07:28:57.544 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264077, 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-21.xml" 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2983387838, 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267262, 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml" 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2983710497, 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258491, 2024-03-27T07:28:57.545 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-40.xml" 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2984941080, 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266032, 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-46.jpg" 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2986934838, 2024-03-27T07:28:57.546 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259848, 2024-03-27T07:28:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-51.xml" 2024-03-27T07:28:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2987255326, 2024-03-27T07:28:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263820, 2024-03-27T07:28:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-78.xml" 2024-03-27T07:28:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.547 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2987584383, 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261496, 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-40.jpg" 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2989214651, 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263083, 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-1.jpg" 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.548 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2989379873, 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630334, 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-33.jpg" 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2992796980, 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263077, 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-3.jpg" 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.549 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2993968823, 2024-03-27T07:28:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634896, 2024-03-27T07:28:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-5.xml" 2024-03-27T07:28:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2994174373, 2024-03-27T07:28:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267351, 2024-03-27T07:28:57.550 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-45.jpg" 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2996660721, 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264293, 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg" 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2997719991, 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266026, 2024-03-27T07:28:57.551 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-49.jpg" 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 2997840151, 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262904, 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-53.jpg" 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3007123496, 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267189, 2024-03-27T07:28:57.552 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-21.xml" 2024-03-27T07:28:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3007605651, 2024-03-27T07:28:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267381, 2024-03-27T07:28:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-78.jpg" 2024-03-27T07:28:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.553 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3008643281, 2024-03-27T07:28:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267771, 2024-03-27T07:28:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-61.jpg" 2024-03-27T07:28:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3008951572, 2024-03-27T07:28:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264216, 2024-03-27T07:28:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg" 2024-03-27T07:28:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.554 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3015677975, 2024-03-27T07:28:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511629615, 2024-03-27T07:28:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-85.xml" 2024-03-27T07:28:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3016097380, 2024-03-27T07:28:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263884, 2024-03-27T07:28:57.555 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-65.xml" 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3018192717, 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259638, 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-39.jpg" 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3024330822, 2024-03-27T07:28:57.556 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267037, 2024-03-27T07:28:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-66.xml" 2024-03-27T07:28:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3025524705, 2024-03-27T07:28:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264092, 2024-03-27T07:28:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-18.xml" 2024-03-27T07:28:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.557 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3032377871, 2024-03-27T07:28:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634375, 2024-03-27T07:28:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-12.xml" 2024-03-27T07:28:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3034688094, 2024-03-27T07:28:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267046, 2024-03-27T07:28:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-63.xml" 2024-03-27T07:28:57.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3036180387, 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634143, 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-2.xml" 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3037086145, 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631000, 2024-03-27T07:28:57.559 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-13.jpg" 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3041224925, 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267741, 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-71.jpg" 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3041405631, 2024-03-27T07:28:57.560 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264082, 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-20.xml" 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3041736886, 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636036, 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-40.xml" 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.561 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3049412404, 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267427, 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg" 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3051498313, 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259612, 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-46.jpg" 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.562 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3052855613, 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633935, 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-90.xml" 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3053526389, 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267554, 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-5.jpg" 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.563 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3054657146, 2024-03-27T07:28:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632800, 2024-03-27T07:28:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-8.jpg" 2024-03-27T07:28:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3061334530, 2024-03-27T07:28:57.564 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267539, 2024-03-27T07:28:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-10.jpg" 2024-03-27T07:28:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3066642328, 2024-03-27T07:28:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267862, 2024-03-27T07:28:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-31.jpg" 2024-03-27T07:28:57.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3067787219, 2024-03-27T07:28:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631518, 2024-03-27T07:28:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-60.jpg" 2024-03-27T07:28:57.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3069734160, 2024-03-27T07:28:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634316, 2024-03-27T07:28:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-50.xml" 2024-03-27T07:28:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3070588638, 2024-03-27T07:28:57.567 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259408, 2024-03-27T07:28:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-93.xml" 2024-03-27T07:28:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3072540755, 2024-03-27T07:28:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262798, 2024-03-27T07:28:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-21.xml" 2024-03-27T07:28:57.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3075929075, 2024-03-27T07:28:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631384, 2024-03-27T07:28:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-79.xml" 2024-03-27T07:28:57.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3079863780, 2024-03-27T07:28:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630160, 2024-03-27T07:28:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-22.xml" 2024-03-27T07:28:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3081410535, 2024-03-27T07:28:57.570 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633413, 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-49.xml" 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3081764736, 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631258, 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-74.xml" 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.571 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3082209538, 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632557, 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-89.xml" 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3082503649, 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634119, 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-14.xml" 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.572 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3083022236, 2024-03-27T07:28:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263140, 2024-03-27T07:28:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-42.xml" 2024-03-27T07:28:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3085788294, 2024-03-27T07:28:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634634, 2024-03-27T07:28:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-28.xml" 2024-03-27T07:28:57.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3092115540, 2024-03-27T07:28:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267798, 2024-03-27T07:28:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-52.jpg" 2024-03-27T07:28:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.574 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3092347262, 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267323, 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-49.jpg" 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3093121893, 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631727, 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-59.xml" 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.575 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3093539113, 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634796, 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-11.xml" 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3095732871, 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259459, 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml" 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3096562965, 2024-03-27T07:28:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267557, 2024-03-27T07:28:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-4.jpg" 2024-03-27T07:28:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3098790746, 2024-03-27T07:28:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634418, 2024-03-27T07:28:57.577 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-68.xml" 2024-03-27T07:28:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3101871324, 2024-03-27T07:28:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634035, 2024-03-27T07:28:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-32.xml" 2024-03-27T07:28:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.578 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3102459880, 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267528, 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg" 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3107556758, 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633501, 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-23.xml" 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.579 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3107695130, 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261235, 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-35.xml" 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3107955310, 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634068, 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-39.xml" 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.580 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3109065591, 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634421, 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-65.xml" 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3109131356, 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264204, 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg" 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.581 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3113166746, 2024-03-27T07:28:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267325, 2024-03-27T07:28:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml" 2024-03-27T07:28:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3114395959, 2024-03-27T07:28:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631844, 2024-03-27T07:28:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-52.xml" 2024-03-27T07:28:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.582 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3116848791, 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266036, 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-44.jpg" 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3121350147, 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259585, 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml" 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.583 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3126945055, 2024-03-27T07:28:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264072, 2024-03-27T07:28:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-22.xml" 2024-03-27T07:28:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3128033196, 2024-03-27T07:28:57.584 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634085, 2024-03-27T07:28:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-9.xml" 2024-03-27T07:28:57.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3128780934, 2024-03-27T07:28:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633933, 2024-03-27T07:28:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-92.xml" 2024-03-27T07:28:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3130402115, 2024-03-27T07:28:57.586 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262976, 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-24.jpg" 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3130990436, 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264085, 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-97.xml" 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3143934491, 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264040, 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-29.xml" 2024-03-27T07:28:57.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3143936270, 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267040, 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-65.xml" 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3148829310, 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263138, 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-43.xml" 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.588 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3150606356, 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634694, 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-22.xml" 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3151771931, 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633972, 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-71.xml" 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.589 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3153845732, 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266121, 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-2.jpg" 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3157917883, 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257240, 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-53.xml" 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.590 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3160160929, 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631008, 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-9.jpg" 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3161135814, 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261552, 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-26.jpg" 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.591 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3166191696, 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634196, 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-88.xml" 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3166948832, 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634363, 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-22.xml" 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.592 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3173072461, 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633116, 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-45.xml" 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3174081706, 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634229, 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-77.xml" 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.593 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3174124266, 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267652, 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-17.xml" 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3175310344, 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631010, 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-8.jpg" 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3185135632, 2024-03-27T07:28:57.594 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634299, 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-58.xml" 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3187870857, 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263355, 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-79.xml" 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3189798930, 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259708, 2024-03-27T07:28:57.595 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-20.jpg" 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3196257062, 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259477, 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml" 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3197626864, 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267536, 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-11.jpg" 2024-03-27T07:28:57.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3199047375, 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263421, 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-58.xml" 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3199529832, 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265950, 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-6.xml" 2024-03-27T07:28:57.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3201441589, 2024-03-27T07:28:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259739, 2024-03-27T07:28:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg" 2024-03-27T07:28:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.598 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3202579025, 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630804, 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-10.jpg" 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3202837473, 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634717, 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-19.xml" 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.599 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3208834303, 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261875, 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-90.xml" 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3211652788, 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630126, 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-38.xml" 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.600 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3215138748, 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634294, 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-60.xml" 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3216936583, 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636522, 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-15.xml" 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.601 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3220200633, 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257714, 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-67.jpg" 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3220613668, 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257693, 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-67.jpg" 2024-03-27T07:28:57.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3220696434, 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261462, 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-49.jpg" 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3222392887, 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266042, 2024-03-27T07:28:57.603 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-41.jpg" 2024-03-27T07:28:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3223050424, 2024-03-27T07:28:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630217, 2024-03-27T07:28:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-79.jpg" 2024-03-27T07:28:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.604 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3224113065, 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259724, 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg" 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3225251128, 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257795, 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-50.jpg" 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.605 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3226628132, 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634129, 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-7.xml" 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3226708777, 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631425, 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-71.xml" 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.606 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3231132269, 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630737, 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-22.jpg" 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3233908106, 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267028, 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-69.xml" 2024-03-27T07:28:57.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3234520366, 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259949, 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-58.xml" 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3237427869, 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267384, 2024-03-27T07:28:57.608 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-77.jpg" 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3240193225, 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634335, 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-43.xml" 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3240806970, 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263343, 2024-03-27T07:28:57.609 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-83.xml" 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3242718771, 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262884, 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-61.jpg" 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3251361180, 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264348, 2024-03-27T07:28:57.610 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg" 2024-03-27T07:28:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3253114176, 2024-03-27T07:28:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633955, 2024-03-27T07:28:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-79.xml" 2024-03-27T07:28:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.611 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3254432330, 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634003, 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-52.xml" 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3257683648, 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264097, 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-17.xml" 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.612 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3260102318, 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634290, 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-62.xml" 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3262841084, 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633563, 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-5.xml" 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.613 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3265210726, 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263165, 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-32.xml" 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3265394021, 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267094, 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-47.xml" 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.614 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3265758544, 2024-03-27T07:28:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634628, 2024-03-27T07:28:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-30.xml" 2024-03-27T07:28:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3266137709, 2024-03-27T07:28:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631545, 2024-03-27T07:28:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-76.xml" 2024-03-27T07:28:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3268370160, 2024-03-27T07:28:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267286, 2024-03-27T07:28:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml" 2024-03-27T07:28:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.616 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3268817656, 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267595, 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg" 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3268882759, 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633493, 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-27.xml" 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.617 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3271646065, 2024-03-27T07:28:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257976, 2024-03-27T07:28:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-32.jpg" 2024-03-27T07:28:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3272874602, 2024-03-27T07:28:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266115, 2024-03-27T07:28:57.618 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-5.jpg" 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3273418185, 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267017, 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-73.xml" 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3273568821, 2024-03-27T07:28:57.619 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266093, 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-16.jpg" 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3283030543, 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634056, 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-45.xml" 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3285355416, 2024-03-27T07:28:57.620 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267576, 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-43.xml" 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3285706819, 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267403, 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-72.jpg" 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3295873817, 2024-03-27T07:28:57.621 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266065, 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-30.jpg" 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3298265909, 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632953, 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-55.xml" 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.622 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3299644144, 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634698, 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-83.xml" 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3299963248, 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266052, 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-36.jpg" 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.623 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3300122032, 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267079, 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-52.xml" 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3301346577, 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023274829, 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-2.xml" 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.624 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3303198740, 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632801, 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-18.xml" 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3303312470, 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262819, 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-13.xml" 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.625 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3304640554, 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265992, 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-66.jpg" 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3306231469, 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267519, 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg" 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.626 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3312900638, 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630350, 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-38.jpg" 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3313459173, 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634026, 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-36.xml" 2024-03-27T07:28:57.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3316167259, 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267756, 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-66.jpg" 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3317707666, 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262871, 2024-03-27T07:28:57.628 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-66.jpg" 2024-03-27T07:28:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3318248619, 2024-03-27T07:28:57.629 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262628, 2024-03-27T07:28:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-15.xml" 2024-03-27T07:28:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.630 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3318354524, 2024-03-27T07:28:57.631 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263238, 2024-03-27T07:28:57.631 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-10.xml" 2024-03-27T07:28:57.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.631 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.631 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.632 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3318677441, 2024-03-27T07:28:57.632 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261486, 2024-03-27T07:28:57.632 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-43.jpg" 2024-03-27T07:28:57.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.633 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.633 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.633 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3322471199, 2024-03-27T07:28:57.633 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633057, 2024-03-27T07:28:57.633 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-89.xml" 2024-03-27T07:28:57.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.634 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.634 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3323269959, 2024-03-27T07:28:57.634 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631740, 2024-03-27T07:28:57.635 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-55.xml" 2024-03-27T07:28:57.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.635 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.635 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.635 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3324479296, 2024-03-27T07:28:57.636 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633971, 2024-03-27T07:28:57.636 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-69.xml" 2024-03-27T07:28:57.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.636 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.637 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.637 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3326136571, 2024-03-27T07:28:57.637 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263433, 2024-03-27T07:28:57.637 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-54.xml" 2024-03-27T07:28:57.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.638 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.638 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.638 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3329614038, 2024-03-27T07:28:57.638 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261990, 2024-03-27T07:28:57.639 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-79.xml" 2024-03-27T07:28:57.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.639 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.639 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.639 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3337900060, 2024-03-27T07:28:57.639 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266018, 2024-03-27T07:28:57.640 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-53.jpg" 2024-03-27T07:28:57.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.640 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.640 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3338187820, 2024-03-27T07:28:57.641 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267415, 2024-03-27T07:28:57.641 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-68.jpg" 2024-03-27T07:28:57.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.641 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.642 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.642 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3340547491, 2024-03-27T07:28:57.642 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265978, 2024-03-27T07:28:57.642 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-73.jpg" 2024-03-27T07:28:57.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.643 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.643 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.643 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3341556102, 2024-03-27T07:28:57.644 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259429, 2024-03-27T07:28:57.644 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml" 2024-03-27T07:28:57.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.644 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.645 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3351425669, 2024-03-27T07:28:57.645 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267516, 2024-03-27T07:28:57.645 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg" 2024-03-27T07:28:57.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.646 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.646 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.646 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3351953371, 2024-03-27T07:28:57.647 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634084, 2024-03-27T07:28:57.647 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-32.xml" 2024-03-27T07:28:57.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.647 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.647 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.648 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3352102683, 2024-03-27T07:28:57.648 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630989, 2024-03-27T07:28:57.648 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-19.jpg" 2024-03-27T07:28:57.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.649 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.649 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3356501705, 2024-03-27T07:28:57.649 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634074, 2024-03-27T07:28:57.649 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-36.xml" 2024-03-27T07:28:57.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.650 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.650 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.650 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3357814532, 2024-03-27T07:28:57.651 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263196, 2024-03-27T07:28:57.651 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-22.xml" 2024-03-27T07:28:57.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.651 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.651 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.652 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3359132552, 2024-03-27T07:28:57.652 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263917, 2024-03-27T07:28:57.652 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-58.xml" 2024-03-27T07:28:57.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.653 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.653 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.653 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3361399201, 2024-03-27T07:28:57.653 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630185, 2024-03-27T07:28:57.653 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-9.xml" 2024-03-27T07:28:57.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.654 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.654 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3361666787, 2024-03-27T07:28:57.654 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633980, 2024-03-27T07:28:57.654 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-68.xml" 2024-03-27T07:28:57.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.655 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.655 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.655 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3363785461, 2024-03-27T07:28:57.656 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634240, 2024-03-27T07:28:57.656 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-75.xml" 2024-03-27T07:28:57.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.656 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.656 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.657 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3367777481, 2024-03-27T07:28:57.657 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262445, 2024-03-27T07:28:57.657 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-37.xml" 2024-03-27T07:28:57.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.658 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.658 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.658 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3367980056, 2024-03-27T07:28:57.658 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262034, 2024-03-27T07:28:57.658 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-68.xml" 2024-03-27T07:28:57.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.659 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.659 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.659 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3369805122, 2024-03-27T07:28:57.660 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630318, 2024-03-27T07:28:57.660 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-65.jpg" 2024-03-27T07:28:57.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.660 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.660 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.660 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3375825773, 2024-03-27T07:28:57.660 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631417, 2024-03-27T07:28:57.661 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-73.xml" 2024-03-27T07:28:57.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.661 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.661 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3386412348, 2024-03-27T07:28:57.661 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263098, 2024-03-27T07:28:57.661 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-59.xml" 2024-03-27T07:28:57.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.662 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.662 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.662 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3394985404, 2024-03-27T07:28:57.662 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264210, 2024-03-27T07:28:57.662 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg" 2024-03-27T07:28:57.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.663 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.663 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.663 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3396815126, 2024-03-27T07:28:57.663 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264181, 2024-03-27T07:28:57.664 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-2.xml" 2024-03-27T07:28:57.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.664 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.664 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.664 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3397531691, 2024-03-27T07:28:57.664 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267124, 2024-03-27T07:28:57.664 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-38.xml" 2024-03-27T07:28:57.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3404361960, 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635736, 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-64.xml" 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3404455165, 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261643, 2024-03-27T07:28:57.665 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-8.jpg" 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3406227409, 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631155, 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-48.xml" 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3407339356, 2024-03-27T07:28:57.666 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258531, 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml" 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3407529470, 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263874, 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-67.xml" 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3409749033, 2024-03-27T07:28:57.667 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634473, 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-44.xml" 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3415624255, 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262620, 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-17.xml" 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3416941346, 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630154, 2024-03-27T07:28:57.668 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-25.xml" 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3417749278, 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263966, 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-48.xml" 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3418154414, 2024-03-27T07:28:57.669 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262985, 2024-03-27T07:28:57.670 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-21.jpg" 2024-03-27T07:28:57.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.670 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.670 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.670 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3420383713, 2024-03-27T07:28:57.670 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261386, 2024-03-27T07:28:57.670 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-1.xml" 2024-03-27T07:28:57.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3422492951, 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267638, 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg" 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3422510411, 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262844, 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-3.xml" 2024-03-27T07:28:57.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.672 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.672 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3426114206, 2024-03-27T07:28:57.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267847, 2024-03-27T07:28:57.672 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-36.jpg" 2024-03-27T07:28:57.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.672 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.672 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3427634270, 2024-03-27T07:28:57.672 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267604, 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg" 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3434452838, 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267850, 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-35.jpg" 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3434830909, 2024-03-27T07:28:57.673 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261273, 2024-03-27T07:28:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-25.xml" 2024-03-27T07:28:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3436174511, 2024-03-27T07:28:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634404, 2024-03-27T07:28:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-79.xml" 2024-03-27T07:28:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.674 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3436381835, 2024-03-27T07:28:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633590, 2024-03-27T07:28:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-1.xml" 2024-03-27T07:28:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3438085034, 2024-03-27T07:28:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261163, 2024-03-27T07:28:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-55.xml" 2024-03-27T07:28:57.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3440496058, 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267707, 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-82.jpg" 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3441229142, 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267380, 2024-03-27T07:28:57.676 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-41.jpg" 2024-03-27T07:28:57.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.677 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.677 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3443141157, 2024-03-27T07:28:57.677 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631238, 2024-03-27T07:28:57.677 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-83.xml" 2024-03-27T07:28:57.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.677 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.677 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.677 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3451302869, 2024-03-27T07:28:57.678 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258014, 2024-03-27T07:28:57.678 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-24.jpg" 2024-03-27T07:28:57.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.678 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.678 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3453695634, 2024-03-27T07:28:57.678 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634296, 2024-03-27T07:28:57.678 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-59.xml" 2024-03-27T07:28:57.678 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3454701494, 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534887183, 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-62.xml" 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3455105640, 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261167, 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-54.xml" 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3458601702, 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263032, 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-11.jpg" 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3460007380, 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259440, 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-87.xml" 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.680 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3460244901, 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261470, 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-47.jpg" 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3460969016, 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262824, 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-11.xml" 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.681 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.682 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3463647303, 2024-03-27T07:28:57.682 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634094, 2024-03-27T07:28:57.682 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-7.xml" 2024-03-27T07:28:57.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.682 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.682 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.682 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3471041599, 2024-03-27T07:28:57.682 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630132, 2024-03-27T07:28:57.682 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-86.xml" 2024-03-27T07:28:57.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.683 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.683 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3472250777, 2024-03-27T07:28:57.683 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266091, 2024-03-27T07:28:57.683 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-17.jpg" 2024-03-27T07:28:57.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.684 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.684 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3475073122, 2024-03-27T07:28:57.684 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259465, 2024-03-27T07:28:57.684 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml" 2024-03-27T07:28:57.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.685 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.685 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.685 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3476948778, 2024-03-27T07:28:57.685 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263262, 2024-03-27T07:28:57.685 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-3.xml" 2024-03-27T07:28:57.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.686 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.686 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3489063652, 2024-03-27T07:28:57.686 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267713, 2024-03-27T07:28:57.686 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-80.jpg" 2024-03-27T07:28:57.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.686 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.686 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.686 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3495995434, 2024-03-27T07:28:57.687 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265944, 2024-03-27T07:28:57.687 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-9.xml" 2024-03-27T07:28:57.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.687 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.688 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.688 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3501026619, 2024-03-27T07:28:57.688 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261993, 2024-03-27T07:28:57.688 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-78.xml" 2024-03-27T07:28:57.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.689 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.689 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.689 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3501134448, 2024-03-27T07:28:57.689 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630113, 2024-03-27T07:28:57.689 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-45.xml" 2024-03-27T07:28:57.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.690 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.690 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.690 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3507512896, 2024-03-27T07:28:57.690 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257686, 2024-03-27T07:28:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-76.jpg" 2024-03-27T07:28:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3512257350, 2024-03-27T07:28:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263384, 2024-03-27T07:28:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-70.xml" 2024-03-27T07:28:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.692 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3519946268, 2024-03-27T07:28:57.692 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634325, 2024-03-27T07:28:57.692 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-48.xml" 2024-03-27T07:28:57.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.692 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.692 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.693 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3522368043, 2024-03-27T07:28:57.693 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631225, 2024-03-27T07:28:57.693 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-93.xml" 2024-03-27T07:28:57.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.693 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.693 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.693 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3523902990, 2024-03-27T07:28:57.693 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630186, 2024-03-27T07:28:57.693 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-8.xml" 2024-03-27T07:28:57.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3525985888, 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261492, 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-41.jpg" 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3527366181, 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263013, 2024-03-27T07:28:57.694 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-16.jpg" 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3529272318, 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633995, 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-63.xml" 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3529840581, 2024-03-27T07:28:57.695 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258364, 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-11.xml" 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3531412706, 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634494, 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-40.xml" 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.696 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3538024475, 2024-03-27T07:28:57.697 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267241, 2024-03-27T07:28:57.697 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-6.xml" 2024-03-27T07:28:57.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.697 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.697 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3539688110, 2024-03-27T07:28:57.697 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636048, 2024-03-27T07:28:57.697 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-39.xml" 2024-03-27T07:28:57.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.697 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3540238003, 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267386, 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-40.jpg" 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3541047918, 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636057, 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-37.xml" 2024-03-27T07:28:57.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.699 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.699 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3545028271, 2024-03-27T07:28:57.699 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267234, 2024-03-27T07:28:57.699 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-8.xml" 2024-03-27T07:28:57.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.699 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.699 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.699 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3545783393, 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262963, 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-29.jpg" 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3551295657, 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257756, 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-53.jpg" 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.700 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3554634540, 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266105, 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-10.jpg" 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3558065008, 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267841, 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-38.jpg" 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.701 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3558095754, 2024-03-27T07:28:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260052, 2024-03-27T07:28:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-49.xml" 2024-03-27T07:28:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3558503302, 2024-03-27T07:28:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262831, 2024-03-27T07:28:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-8.xml" 2024-03-27T07:28:57.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3559496619, 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631428, 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-70.xml" 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3562104863, 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511632547, 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-93.jpg" 2024-03-27T07:28:57.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3573172501, 2024-03-27T07:28:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263150, 2024-03-27T07:28:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-38.xml" 2024-03-27T07:28:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3576566703, 2024-03-27T07:28:57.704 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259765, 2024-03-27T07:28:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg" 2024-03-27T07:28:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3576952544, 2024-03-27T07:28:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259602, 2024-03-27T07:28:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-48.jpg" 2024-03-27T07:28:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.705 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3577848310, 2024-03-27T07:28:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636193, 2024-03-27T07:28:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-6.xml" 2024-03-27T07:28:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3577878801, 2024-03-27T07:28:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267513, 2024-03-27T07:28:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg" 2024-03-27T07:28:57.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3578718617, 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267321, 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml" 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3579256525, 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634478, 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-43.xml" 2024-03-27T07:28:57.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3579299518, 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630742, 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-21.jpg" 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3579817211, 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635677, 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml" 2024-03-27T07:28:57.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3582039840, 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267563, 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-2.jpg" 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3582120818, 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259471, 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml" 2024-03-27T07:28:57.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3585663798, 2024-03-27T07:28:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266030, 2024-03-27T07:28:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-47.jpg" 2024-03-27T07:28:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3591421664, 2024-03-27T07:28:57.710 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263316, 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-92.xml" 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3592831919, 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267272, 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-61.jpg" 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3605443329, 2024-03-27T07:28:57.711 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263424, 2024-03-27T07:28:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-57.xml" 2024-03-27T07:28:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3605970836, 2024-03-27T07:28:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261622, 2024-03-27T07:28:57.712 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-15.jpg" 2024-03-27T07:28:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3611144420, 2024-03-27T07:28:57.713 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262933, 2024-03-27T07:28:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-41.jpg" 2024-03-27T07:28:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3613100128, 2024-03-27T07:28:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267031, 2024-03-27T07:28:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-68.xml" 2024-03-27T07:28:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.715 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3613125007, 2024-03-27T07:28:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258515, 2024-03-27T07:28:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-34.xml" 2024-03-27T07:28:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.716 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3613834797, 2024-03-27T07:28:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630114, 2024-03-27T07:28:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-77.xml" 2024-03-27T07:28:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.717 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3614912915, 2024-03-27T07:28:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259529, 2024-03-27T07:28:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml" 2024-03-27T07:28:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3622384277, 2024-03-27T07:28:57.718 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630309, 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-71.jpg" 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3624883057, 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262941, 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-38.jpg" 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.719 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3628661006, 2024-03-27T07:28:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633445, 2024-03-27T07:28:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-39.xml" 2024-03-27T07:28:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.720 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3630499283, 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634930, 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-3.xml" 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3634849733, 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634059, 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-43.xml" 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.721 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3635233269, 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631806, 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-2.xml" 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3635543119, 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630332, 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-51.jpg" 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.722 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3646335413, 2024-03-27T07:28:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263337, 2024-03-27T07:28:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-85.xml" 2024-03-27T07:28:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.723 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3647402747, 2024-03-27T07:28:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263381, 2024-03-27T07:28:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-71.xml" 2024-03-27T07:28:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.724 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3651085019, 2024-03-27T07:28:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261512, 2024-03-27T07:28:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-36.jpg" 2024-03-27T07:28:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.725 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3653482199, 2024-03-27T07:28:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266054, 2024-03-27T07:28:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-35.jpg" 2024-03-27T07:28:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.726 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3653668319, 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267374, 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-80.jpg" 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3656243151, 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634111, 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-20.xml" 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.727 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3656992514, 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263993, 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-41.xml" 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3663094625, 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630360, 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-28.jpg" 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.728 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3667927009, 2024-03-27T07:28:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631662, 2024-03-27T07:28:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-36.xml" 2024-03-27T07:28:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3670419339, 2024-03-27T07:28:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634399, 2024-03-27T07:28:57.729 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-83.xml" 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3673597424, 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265988, 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-68.jpg" 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3673776483, 2024-03-27T07:28:57.730 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634036, 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-52.xml" 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3674427144, 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267655, 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-16.xml" 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3676642327, 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630182, 2024-03-27T07:28:57.731 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-10.xml" 2024-03-27T07:28:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3684388467, 2024-03-27T07:28:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263017, 2024-03-27T07:28:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-23.jpg" 2024-03-27T07:28:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.732 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3691736905, 2024-03-27T07:28:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264168, 2024-03-27T07:28:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-4.xml" 2024-03-27T07:28:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3692537365, 2024-03-27T07:28:57.733 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635656, 2024-03-27T07:28:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-63.xml" 2024-03-27T07:28:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.734 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3694127551, 2024-03-27T07:28:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259525, 2024-03-27T07:28:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml" 2024-03-27T07:28:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.735 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3704118613, 2024-03-27T07:28:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257405, 2024-03-27T07:28:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-33.xml" 2024-03-27T07:28:57.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3706477715, 2024-03-27T07:28:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263406, 2024-03-27T07:28:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-63.xml" 2024-03-27T07:28:57.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3706692247, 2024-03-27T07:28:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534887160, 2024-03-27T07:28:57.738 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-65.xml" 2024-03-27T07:28:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3707277668, 2024-03-27T07:28:57.739 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258393, 2024-03-27T07:28:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-5.xml" 2024-03-27T07:28:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.740 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3708243167, 2024-03-27T07:28:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267498, 2024-03-27T07:28:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg" 2024-03-27T07:28:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.741 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3709555321, 2024-03-27T07:28:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263210, 2024-03-27T07:28:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-18.xml" 2024-03-27T07:28:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.742 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3709726648, 2024-03-27T07:28:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263365, 2024-03-27T07:28:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-76.xml" 2024-03-27T07:28:57.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3710209247, 2024-03-27T07:28:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634032, 2024-03-27T07:28:57.744 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-54.xml" 2024-03-27T07:28:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3717411159, 2024-03-27T07:28:57.745 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263167, 2024-03-27T07:28:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-31.xml" 2024-03-27T07:28:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.746 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3717673276, 2024-03-27T07:28:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261228, 2024-03-27T07:28:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-37.xml" 2024-03-27T07:28:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.747 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3718061143, 2024-03-27T07:28:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257808, 2024-03-27T07:28:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-34.jpg" 2024-03-27T07:28:57.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3719838845, 2024-03-27T07:28:57.749 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633975, 2024-03-27T07:28:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-67.xml" 2024-03-27T07:28:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.750 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3723010738, 2024-03-27T07:28:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630190, 2024-03-27T07:28:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-6.xml" 2024-03-27T07:28:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.751 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3726995907, 2024-03-27T07:28:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259594, 2024-03-27T07:28:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml" 2024-03-27T07:28:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3727049716, 2024-03-27T07:28:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263923, 2024-03-27T07:28:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-57.xml" 2024-03-27T07:28:57.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3729563706, 2024-03-27T07:28:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258591, 2024-03-27T07:28:57.754 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml" 2024-03-27T07:28:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3730378155, 2024-03-27T07:28:57.755 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267121, 2024-03-27T07:28:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-39.xml" 2024-03-27T07:28:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.756 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3733589813, 2024-03-27T07:28:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267738, 2024-03-27T07:28:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-72.jpg" 2024-03-27T07:28:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.757 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3734330627, 2024-03-27T07:28:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631250, 2024-03-27T07:28:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-81.xml" 2024-03-27T07:28:57.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3734478363, 2024-03-27T07:28:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262039, 2024-03-27T07:28:57.759 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-67.xml" 2024-03-27T07:28:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.760 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3736550045, 2024-03-27T07:28:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266002, 2024-03-27T07:28:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-61.jpg" 2024-03-27T07:28:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.761 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3737129648, 2024-03-27T07:28:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257204, 2024-03-27T07:28:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-64.xml" 2024-03-27T07:28:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.762 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3740392276, 2024-03-27T07:28:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631707, 2024-03-27T07:28:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-64.xml" 2024-03-27T07:28:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3742980380, 2024-03-27T07:28:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266087, 2024-03-27T07:28:57.764 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-19.jpg" 2024-03-27T07:28:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3744617684, 2024-03-27T07:28:57.765 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257510, 2024-03-27T07:28:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml" 2024-03-27T07:28:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.766 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3745306263, 2024-03-27T07:28:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267624, 2024-03-27T07:28:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg" 2024-03-27T07:28:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.767 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3745965187, 2024-03-27T07:28:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634075, 2024-03-27T07:28:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-35.xml" 2024-03-27T07:28:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.768 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3748457334, 2024-03-27T07:28:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257500, 2024-03-27T07:28:57.769 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-24.xml" 2024-03-27T07:28:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.770 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3748946987, 2024-03-27T07:28:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267207, 2024-03-27T07:28:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-16.xml" 2024-03-27T07:28:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.771 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3751946717, 2024-03-27T07:28:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267777, 2024-03-27T07:28:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-59.jpg" 2024-03-27T07:28:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.772 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3752445333, 2024-03-27T07:28:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263943, 2024-03-27T07:28:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-53.xml" 2024-03-27T07:28:57.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3753385123, 2024-03-27T07:28:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263034, 2024-03-27T07:28:57.774 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-17.jpg" 2024-03-27T07:28:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3754734842, 2024-03-27T07:28:57.775 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263372, 2024-03-27T07:28:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-74.xml" 2024-03-27T07:28:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.776 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3754777596, 2024-03-27T07:28:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634517, 2024-03-27T07:28:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-96.xml" 2024-03-27T07:28:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.777 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3755237293, 2024-03-27T07:28:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267174, 2024-03-27T07:28:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-25.xml" 2024-03-27T07:28:57.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3757407189, 2024-03-27T07:28:57.779 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259622, 2024-03-27T07:28:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-44.jpg" 2024-03-27T07:28:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3758420652, 2024-03-27T07:28:57.780 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631421, 2024-03-27T07:28:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-72.xml" 2024-03-27T07:28:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.781 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3758939564, 2024-03-27T07:28:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259412, 2024-03-27T07:28:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-37.xml" 2024-03-27T07:28:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.782 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3759104273, 2024-03-27T07:28:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267392, 2024-03-27T07:28:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-75.jpg" 2024-03-27T07:28:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.783 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3759352267, 2024-03-27T07:28:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257343, 2024-03-27T07:28:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-39.xml" 2024-03-27T07:28:57.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3761631630, 2024-03-27T07:28:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261306, 2024-03-27T07:28:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-17.xml" 2024-03-27T07:28:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.785 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3774039513, 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265972, 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-76.jpg" 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3774062909, 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634115, 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-18.xml" 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.786 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3774830763, 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267630, 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg" 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3776502426, 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634741, 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-17.xml" 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.787 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3785479753, 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267335, 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-91.jpg" 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3790837311, 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267629, 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-24.xml" 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.788 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3791751949, 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630748, 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-20.jpg" 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3792658180, 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633937, 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-88.xml" 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.789 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3792956575, 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259336, 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-52.xml" 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3794360189, 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630328, 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-55.jpg" 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.790 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3798836436, 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634108, 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-23.xml" 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3803977311, 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630347, 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-41.jpg" 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.791 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3804904271, 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259747, 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg" 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3806491185, 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258483, 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-42.xml" 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.792 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3811539837, 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262829, 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-9.xml" 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3812183548, 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634424, 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-62.xml" 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3814905214, 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631659, 2024-03-27T07:28:57.793 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-7.xml" 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3816250200, 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631388, 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-78.xml" 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3816626169, 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630341, 2024-03-27T07:28:57.794 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-44.jpg" 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3817608064, 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263290, 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-6.jpg" 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3820181242, 2024-03-27T07:28:57.795 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631542, 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg" 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3821513990, 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634411, 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-75.xml" 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3822233823, 2024-03-27T07:28:57.796 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267203, 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-17.xml" 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3825050772, 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263319, 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-91.xml" 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3826420128, 2024-03-27T07:28:57.797 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262849, 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-1.xml" 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3826719249, 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023265964, 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-80.jpg" 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3840590374, 2024-03-27T07:28:57.798 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630275, 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-75.jpg" 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3843165113, 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267873, 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-27.jpg" 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3848851516, 2024-03-27T07:28:57.799 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634624, 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-93.xml" 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3857974484, 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259635, 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-40.jpg" 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3859750699, 2024-03-27T07:28:57.800 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263224, 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-14.xml" 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3861238423, 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634342, 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-38.xml" 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3863415388, 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267073, 2024-03-27T07:28:57.801 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-54.xml" 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3863422253, 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262889, 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-59.jpg" 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3863838399, 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267810, 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-48.jpg" 2024-03-27T07:28:57.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3866163713, 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266119, 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-3.jpg" 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3867484055, 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634822, 2024-03-27T07:28:57.803 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-9.xml" 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3871331982, 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267486, 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-48.jpg" 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3871597805, 2024-03-27T07:28:57.804 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263074, 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-4.jpg" 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3873595217, 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261998, 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-77.xml" 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3874589895, 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634729, 2024-03-27T07:28:57.805 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-18.xml" 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3880564900, 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259626, 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-43.jpg" 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3884589628, 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259685, 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-26.jpg" 2024-03-27T07:28:57.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3886256627, 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258937, 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-75.xml" 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3889975467, 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258553, 2024-03-27T07:28:57.807 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml" 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3890235790, 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267583, 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg" 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3891925912, 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259771, 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-75.xml" 2024-03-27T07:28:57.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3894700725, 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634268, 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-69.xml" 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3897152808, 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631232, 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-88.xml" 2024-03-27T07:28:57.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3900204846, 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630208, 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-1.xml" 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3901248921, 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263217, 2024-03-27T07:28:57.810 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-16.xml" 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3903060277, 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267684, 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-7.xml" 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3905509817, 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262561, 2024-03-27T07:28:57.811 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-27.xml" 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3907264915, 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261323, 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-14.xml" 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3907529769, 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634958, 2024-03-27T07:28:57.812 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-1.xml" 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3908816344, 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634142, 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-3.xml" 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3909692717, 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261528, 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-32.jpg" 2024-03-27T07:28:57.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3910030279, 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634410, 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-76.xml" 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3910665523, 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631699, 2024-03-27T07:28:57.814 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-66.xml" 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3911090247, 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264156, 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-6.xml" 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3911708672, 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634381, 2024-03-27T07:28:57.815 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-6.xml" 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3911737458, 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267816, 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-46.jpg" 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3912876836, 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634705, 2024-03-27T07:28:57.816 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-82.xml" 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3915010925, 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261880, 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-89.xml" 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3918842840, 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630159, 2024-03-27T07:28:57.817 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-23.xml" 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3920807764, 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634389, 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-91.xml" 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3923733558, 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259977, 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-55.xml" 2024-03-27T07:28:57.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3925798261, 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634028, 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-56.xml" 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3926226393, 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263450, 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-51.xml" 2024-03-27T07:28:57.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3929100854, 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262914, 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-49.jpg" 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3929442916, 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263061, 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-8.jpg" 2024-03-27T07:28:57.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3929928162, 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258461, 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-1.jpg" 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3929968330, 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262961, 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-30.jpg" 2024-03-27T07:28:57.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.822 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.822 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3931275541, 2024-03-27T07:28:57.822 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267424, 2024-03-27T07:28:57.822 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-65.jpg" 2024-03-27T07:28:57.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.822 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.822 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.822 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3933415051, 2024-03-27T07:28:57.822 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630105, 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-48.xml" 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3936499156, 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266113, 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-6.jpg" 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3939114758, 2024-03-27T07:28:57.823 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258428, 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-9.jpg" 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3942695090, 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635671, 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml" 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.824 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3943052069, 2024-03-27T07:28:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257702, 2024-03-27T07:28:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-65.jpg" 2024-03-27T07:28:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3947929089, 2024-03-27T07:28:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634204, 2024-03-27T07:28:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-85.xml" 2024-03-27T07:28:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.825 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3949164589, 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264101, 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-16.xml" 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3949321585, 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633464, 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-32.xml" 2024-03-27T07:28:57.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3949446900, 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262909, 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-51.jpg" 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3952080081, 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267458, 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-31.jpg" 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.827 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3952624329, 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263049, 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-12.jpg" 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3954181374, 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261888, 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-87.xml" 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.828 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3954235360, 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258610, 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml" 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3954848763, 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263047, 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-6.jpg" 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.829 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3955061240, 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259357, 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-47.xml" 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3960667120, 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267726, 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-76.jpg" 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.830 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3961502712, 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261143, 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-60.xml" 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3961642274, 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267543, 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg" 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.831 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3962769264, 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267710, 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-81.jpg" 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3967858658, 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267622, 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-27.xml" 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.832 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3977647676, 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267330, 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-48.jpg" 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3979192788, 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263068, 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-6.jpg" 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.833 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3984165007, 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261895, 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-85.xml" 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3988686044, 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267026, 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-70.xml" 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.834 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3989270756, 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267598, 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg" 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3989673851, 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634489, 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-41.xml" 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.835 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3993567008, 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636068, 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-34.xml" 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3996000438, 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634020, 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-39.xml" 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.836 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 3999592823, 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634102, 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-4.xml" 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4001431570, 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264337, 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg" 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4001955855, 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634709, 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-36.xml" 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4002171708, 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633450, 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-37.xml" 2024-03-27T07:28:57.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4002841686, 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262814, 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-15.xml" 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4004328063, 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266012, 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-56.jpg" 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4005530544, 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263953, 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-1.xml" 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4006864094, 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264198, 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg" 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.840 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4008519070, 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259697, 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-23.jpg" 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4012006882, 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630142, 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-32.xml" 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4012098267, 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634062, 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-41.xml" 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4012626410, 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267750, 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-68.jpg" 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.842 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4015530477, 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634433, 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-53.xml" 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4019546056, 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259754, 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg" 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.843 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4020864137, 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259563, 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml" 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4021048503, 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634226, 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-43.xml" 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.844 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4021223055, 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258523, 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-32.xml" 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4023042460, 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630825, 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-5.jpg" 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.845 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4025481713, 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630152, 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-26.xml" 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4026937136, 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630171, 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-15.xml" 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.846 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4032399129, 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264122, 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-12.xml" 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4034669700, 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267592, 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg" 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.847 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4035860367, 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267601, 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg" 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4039970842, 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261438, 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-55.jpg" 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.848 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4050565386, 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263145, 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-40.xml" 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4052545941, 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634371, 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-8.xml" 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.849 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4053152003, 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267500, 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-22.jpg" 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4054819470, 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267061, 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-58.xml" 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4055807187, 2024-03-27T07:28:57.850 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267691, 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-5.xml" 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4056007968, 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262911, 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-50.jpg" 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4056064346, 2024-03-27T07:28:57.851 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267564, 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg" 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4057813731, 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267360, 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-84.jpg" 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4063669545, 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263362, 2024-03-27T07:28:57.852 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-77.xml" 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4064106986, 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3298534884749, 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-38.jpg" 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4066274981, 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266022, 2024-03-27T07:28:57.853 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-51.jpg" 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4069493725, 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630327, 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-56.jpg" 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4070917394, 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260114, 2024-03-27T07:28:57.854 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-44.xml" 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4072401667, 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634045, 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-27.xml" 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4078930295, 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634127, 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-8.xml" 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4079220447, 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634202, 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-86.xml" 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4080479979, 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267534, 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg" 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.856 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4081375444, 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267280, 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-59.jpg" 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4083962607, 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634080, 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-33.xml" 2024-03-27T07:28:57.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4085545374, 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634365, 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-20.xml" 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4089349434, 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630359, 2024-03-27T07:28:57.858 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-29.jpg" 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4091212764, 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257759, 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-52.jpg" 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4094365856, 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261366, 2024-03-27T07:28:57.859 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-6.xml" 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4096001894, 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261195, 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-46.xml" 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4096992108, 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630206, 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-2.xml" 2024-03-27T07:28:57.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4098056908, 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259701, 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-22.jpg" 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4098728642, 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634398, 2024-03-27T07:28:57.861 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-84.xml" 2024-03-27T07:28:57.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.862 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.862 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.862 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4102813652, 2024-03-27T07:28:57.862 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634065, 2024-03-27T07:28:57.862 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-19.xml" 2024-03-27T07:28:57.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.862 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.862 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.863 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4102856741, 2024-03-27T07:28:57.863 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263255, 2024-03-27T07:28:57.863 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-5.xml" 2024-03-27T07:28:57.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.863 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.863 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.863 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4103283139, 2024-03-27T07:28:57.863 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257212, 2024-03-27T07:28:57.863 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-62.xml" 2024-03-27T07:28:57.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.864 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.864 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.864 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4104071788, 2024-03-27T07:28:57.864 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630723, 2024-03-27T07:28:57.864 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-26.jpg" 2024-03-27T07:28:57.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.864 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.865 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.865 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4105776598, 2024-03-27T07:28:57.865 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264049, 2024-03-27T07:28:57.865 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-27.xml" 2024-03-27T07:28:57.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.865 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.865 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.865 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4107821171, 2024-03-27T07:28:57.866 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266020, 2024-03-27T07:28:57.866 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-52.jpg" 2024-03-27T07:28:57.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.866 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.866 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.866 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4112119374, 2024-03-27T07:28:57.866 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630333, 2024-03-27T07:28:57.866 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-50.jpg" 2024-03-27T07:28:57.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.867 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.867 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.867 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4117602404, 2024-03-27T07:28:57.867 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259548, 2024-03-27T07:28:57.867 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml" 2024-03-27T07:28:57.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.868 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.868 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.868 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4118002611, 2024-03-27T07:28:57.868 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267268, 2024-03-27T07:28:57.868 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-62.jpg" 2024-03-27T07:28:57.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.868 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.868 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4118665103, 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634272, 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-68.xml" 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4119118070, 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267669, 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-12.xml" 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.869 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4119395177, 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259375, 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-99.xml" 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4120842776, 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262616, 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-18.xml" 2024-03-27T07:28:57.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.871 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.871 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.871 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4122406440, 2024-03-27T07:28:57.871 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267819, 2024-03-27T07:28:57.871 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-45.jpg" 2024-03-27T07:28:57.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.871 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.871 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.871 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4124575237, 2024-03-27T07:28:57.871 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630200, 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-4.xml" 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4126841752, 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267318, 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml" 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.872 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4128328556, 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631869, 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-49.xml" 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4130961743, 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258665, 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-25.jpg" 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.873 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4132003565, 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263031, 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-18.jpg" 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4141157969, 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023266016, 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-54.jpg" 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.874 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4142940968, 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633487, 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-28.xml" 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4148891154, 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262981, 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-22.jpg" 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.875 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4150797472, 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267138, 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-34.xml" 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4151691166, 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263947, 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-52.xml" 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.876 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4154863021, 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631229, 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-33.xml" 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4155567583, 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263080, 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-2.jpg" 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.877 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4156681396, 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264403, 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg" 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4157488626, 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264445, 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg" 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.878 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4160196840, 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267560, 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-3.jpg" 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4160715996, 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267110, 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-42.xml" 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.879 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4167183597, 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630161, 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-21.xml" 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4168639458, 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635640, 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-64.xml" 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.880 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4171705876, 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511635664, 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml" 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4175934793, 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633504, 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-20.xml" 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.881 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4180037823, 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261661, 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-3.jpg" 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4182265194, 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267555, 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg" 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.882 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4182404388, 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262936, 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-40.jpg" 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4183056279, 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267606, 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-33.xml" 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.883 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4185377691, 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634193, 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-89.xml" 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4194104124, 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267304, 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-53.jpg" 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.884 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4195273345, 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258479, 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-43.xml" 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4199437632, 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634311, 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-53.xml" 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.885 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4207131790, 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261394, 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-66.jpg" 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4210562902, 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263888, 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-64.xml" 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.886 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4210654212, 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267698, 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-3.xml" 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4211421435, 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263123, 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-49.xml" 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.887 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4211648051, 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631720, 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-61.xml" 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4212520520, 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263029, 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-12.jpg" 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.888 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4216822259, 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634750, 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-16.xml" 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4217446057, 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263864, 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-69.xml" 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.889 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4217562495, 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267466, 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-30.jpg" 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4221067100, 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267530, 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-13.jpg" 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.890 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4224753711, 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023260024, 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-51.xml" 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4226529715, 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630324, 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-59.jpg" 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.891 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4227529650, 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633960, 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-77.xml" 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4227574149, 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258622, 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml" 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.892 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4227908272, 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630122, 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-41.xml" 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4236668646, 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630329, 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-54.jpg" 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.893 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4237270096, 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511634425, 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-61.xml" 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4241807136, 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267735, 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-73.jpg" 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.894 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4243787206, 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267220, 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-12.xml" 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4245170872, 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263157, 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-35.xml" 2024-03-27T07:28:57.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4253107843, 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631703, 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-65.xml" 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4253510271, 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023259382, 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-42.xml" 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.896 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4254956381, 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511631014, 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-6.jpg" 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4256699990, 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633979, 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-64.xml" 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.897 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4259271806, 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023257308, 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-43.xml" 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4261301830, 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023262938, 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-39.jpg" 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.898 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4261531604, 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511630995, 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-18.jpg" 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4268523134, 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267546, 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg" 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.899 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4272764744, 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023263041, 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-8.jpg" 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4272828164, 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633439, 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-41.xml" 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.900 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4274747131, 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633991, 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-64.xml" 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4276032086, 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511636093, 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-29.xml" 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.901 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4277772513, 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023267540, 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg" 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4280256495, 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261536, 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-30.jpg" 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.902 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4283225970, 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023258416, 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-12.jpg" 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4287797950, 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023264284, 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg" 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.903 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4289843588, 2024-03-27T07:28:57.904 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 2199023261335, 2024-03-27T07:28:57.904 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-13.xml" 2024-03-27T07:28:57.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:28:57.904 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:28:57.904 INFO:teuthology.orchestra.run.smithi082.stdout: "damage_type": "backtrace", 2024-03-27T07:28:57.904 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 4294440192, 2024-03-27T07:28:57.904 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 1099511633976, 2024-03-27T07:28:57.904 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-66.xml" 2024-03-27T07:28:57.904 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:28:57.904 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-03-27T07:28:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 -- 172.21.15.82:0/1565787604 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6c4c0a3780 msgr2=0x7f6c4c0a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6c4c0a3780 0x7f6c4c0a5c40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c58005fd0 tx=0x7f6c58009de0 comp rx=0 tx=0).stop 2024-03-27T07:28:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 -- 172.21.15.82:0/1565787604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c601009c0 msgr2=0x7f6c60199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c601009c0 0x7f6c60199250 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00e9f0 tx=0x7f6c5c00edf0 comp rx=0 tx=0).stop 2024-03-27T07:28:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 -- 172.21.15.82:0/1565787604 shutdown_connections 2024-03-27T07:28:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6c4c0a3780 0x7f6c4c0a5c40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c601069d0 0x7f6c601a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:57.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6c60101380 0x7f6c60199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 --2- 172.21.15.82:0/1565787604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6c601009c0 0x7f6c60199250 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 -- 172.21.15.82:0/1565787604 >> 172.21.15.82:0/1565787604 conn(0x7f6c60077b50 msgr2=0x7f6c60103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 -- 172.21.15.82:0/1565787604 shutdown_connections 2024-03-27T07:28:57.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:56.770+0000 7f6c682b8640 1 -- 172.21.15.82:0/1565787604 wait complete. 2024-03-27T07:28:57.910 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T07:28:57.911 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:56 smithi082 ceph-mon[32178]: pgmap v163: 97 pgs: 97 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-03-27T07:28:57.911 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:56 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2680568551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:28:57.912 INFO:tasks.workunit.client.0.smithi082.stdout: 289 1618502 466 1127544 436 632625 890 2024-03-27T07:28:57.912 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:56 smithi153 ceph-mon[36179]: pgmap v163: 97 pgs: 97 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-03-27T07:28:57.912 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:56 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2680568551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:28:57.912 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:56 smithi149 ceph-mon[36065]: pgmap v163: 97 pgs: 97 active+clean; 1.2 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 1.11k op/s 2024-03-27T07:28:57.912 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:56 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2680568551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:28:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.020+0000 7f9d30eed640 1 -- 172.21.15.82:0/23118072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c101ac0 msgr2=0x7f9d2c10d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.020+0000 7f9d30eed640 1 --2- 172.21.15.82:0/23118072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c101ac0 0x7f9d2c10d8b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009ca0 tx=0x7f9d2402c0f0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.020+0000 7f9d30eed640 1 -- 172.21.15.82:0/23118072 shutdown_connections 2024-03-27T07:28:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.020+0000 7f9d30eed640 1 --2- 172.21.15.82:0/23118072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c101ac0 0x7f9d2c10d8b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.020+0000 7f9d30eed640 1 --2- 172.21.15.82:0/23118072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d2c101100 0x7f9d2c101580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.020+0000 7f9d30eed640 1 --2- 172.21.15.82:0/23118072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d2c105a20 0x7f9d2c105e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.020+0000 7f9d30eed640 1 -- 172.21.15.82:0/23118072 >> 172.21.15.82:0/23118072 conn(0x7f9d2c076f70 msgr2=0x7f9d2c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.020+0000 7f9d30eed640 1 -- 172.21.15.82:0/23118072 shutdown_connections 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.020+0000 7f9d30eed640 1 -- 172.21.15.82:0/23118072 wait complete. 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.021+0000 7f9d30eed640 1 Processor -- start 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.021+0000 7f9d30eed640 1 -- start start 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.021+0000 7f9d30eed640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d2c101100 0x7f9d2c197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.021+0000 7f9d30eed640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d2c101ac0 0x7f9d2c197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.021+0000 7f9d30eed640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c105a20 0x7f9d2c19bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.021+0000 7f9d30eed640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c110e00 con 0x7f9d2c105a20 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.021+0000 7f9d30eed640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c110c80 con 0x7f9d2c101ac0 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.021+0000 7f9d30eed640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c110f80 con 0x7f9d2c101100 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c105a20 0x7f9d2c19bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d2c101100 0x7f9d2c197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d2c101ac0 0x7f9d2c197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c105a20 0x7f9d2c19bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40236/0 (socket says 172.21.15.82:40236) 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2ad9d640 1 -- 172.21.15.82:0/948414848 learned_addr learned my addr 172.21.15.82:0/948414848 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d2c101ac0 0x7f9d2c197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42160/0 (socket says 172.21.15.82:42160) 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2a59c640 1 -- 172.21.15.82:0/948414848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d2c101ac0 msgr2=0x7f9d2c197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d2c101ac0 0x7f9d2c197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2a59c640 1 -- 172.21.15.82:0/948414848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c105a20 msgr2=0x7f9d2c19bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c105a20 0x7f9d2c19bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2a59c640 1 -- 172.21.15.82:0/948414848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c19c210 con 0x7f9d2c101100 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2ad9d640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c105a20 0x7f9d2c19bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d2c101100 0x7f9d2c197220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00e9f0 tx=0x7f9d1c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d237fe640 1 -- 172.21.15.82:0/948414848 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c00ccc0 con 0x7f9d2c101100 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d30eed640 1 -- 172.21.15.82:0/948414848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c19c500 con 0x7f9d2c101100 2024-03-27T07:28:58.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d237fe640 1 -- 172.21.15.82:0/948414848 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d1c010910 con 0x7f9d2c101100 2024-03-27T07:28:58.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d237fe640 1 -- 172.21.15.82:0/948414848 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c018960 con 0x7f9d2c101100 2024-03-27T07:28:58.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.022+0000 7f9d30eed640 1 -- 172.21.15.82:0/948414848 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c1a3d90 con 0x7f9d2c101100 2024-03-27T07:28:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.024+0000 7f9d237fe640 1 -- 172.21.15.82:0/948414848 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f9d1c010ac0 con 0x7f9d2c101100 2024-03-27T07:28:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d33bb5740 1 Processor -- start 2024-03-27T07:28:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d33bb5740 1 -- start start 2024-03-27T07:28:58.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d237fe640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9d180a3780 0x7f9d180a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x5637673054a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 0x563767312d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 0x5637673156a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563767269710 con 0x5637673132b0 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563767211af0 con 0x5637673050c0 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5637672656c0 con 0x5637673059e0 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d237fe640 1 -- 172.21.15.82:0/948414848 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9d1c0d0470 con 0x7f9d2c101100 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x5637673054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d2ad9d640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9d180a3780 0x7f9d180a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x5637673054a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42176/0 (socket says 172.21.15.82:42176) 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d2a59c640 1 -- 172.21.15.82:0/3442444937 learned_addr learned my addr 172.21.15.82:0/3442444937 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.025+0000 7f9d2ad9d640 1 --2- 172.21.15.82:0/3442444937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 0x5637673156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d23fff640 1 --2- 172.21.15.82:0/3442444937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 0x563767312d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d2a59c640 1 -- 172.21.15.82:0/3442444937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 msgr2=0x563767312d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/3442444937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 0x563767312d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d2a59c640 1 -- 172.21.15.82:0/3442444937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 msgr2=0x5637673156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/3442444937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 0x5637673156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d2a59c640 1 -- 172.21.15.82:0/3442444937 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563766f7d3f0 con 0x5637673050c0 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d2ad9d640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9d180a3780 0x7f9d180a5c40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9d24035fd0 tx=0x7f9d24009950 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/3442444937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x5637673054a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0a4d30 tx=0x7f9d1c09c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8601d9a7af26f11 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d20ff9640 1 -- 172.21.15.82:0/3442444937 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0a09a0 con 0x5637673050c0 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d20ff9640 1 -- 172.21.15.82:0/3442444937 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d1c0a5260 con 0x5637673050c0 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.026+0000 7f9d20ff9640 1 -- 172.21.15.82:0/3442444937 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c09bd30 con 0x5637673050c0 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.027+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3442444937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 msgr2=0x5637673054a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.027+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3442444937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x5637673054a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0a4d30 tx=0x7f9d1c09c310 comp rx=0 tx=0).stop 2024-03-27T07:28:58.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.027+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3442444937 shutdown_connections 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.027+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3442444937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 0x5637673156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.027+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3442444937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 0x563767312d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.027+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3442444937 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x5637673054a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.027+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3442444937 >> 172.21.15.82:0/3442444937 conn(0x5637672ffee0 msgr2=0x5637673002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.027+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3442444937 shutdown_connections 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.027+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3442444937 wait complete. 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d33bb5740 1 -- start start 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d33bb5740 1 Processor -- start 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x563767310370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 0x5637673108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 0x563767310df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563767315e20 con 0x5637673132b0 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x563767224eb0 con 0x5637673050c0 2024-03-27T07:28:58.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x563767315fa0 con 0x5637673059e0 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d33bb5740 10 client.0 _ll_register_callbacks cb 0x5637672616a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d2ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 0x563767310df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x563767310370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d2ad9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 0x563767310df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40250/0 (socket says 172.21.15.82:40250) 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d2ad9d640 1 -- 172.21.15.82:0/3636295398 learned_addr learned my addr 172.21.15.82:0/3636295398 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.028+0000 7f9d23fff640 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 0x5637673108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d2ad9d640 1 -- 172.21.15.82:0/3636295398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 msgr2=0x5637673108b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d2ad9d640 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 0x5637673108b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d2ad9d640 1 -- 172.21.15.82:0/3636295398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 msgr2=0x563767310370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d2ad9d640 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x563767310370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d2ad9d640 1 -- 172.21.15.82:0/3636295398 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637670477d0 con 0x5637673132b0 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d23fff640 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 0x5637673108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:58.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x563767310370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d2ad9d640 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 0x563767310df0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9d2402efd0 tx=0x7f9d24005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7f7e66c68c5d54 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d11ffb640 1 -- 172.21.15.82:0/3636295398 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24039040 con 0x5637673132b0 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d11ffb640 1 -- 172.21.15.82:0/3636295398 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9d24003970 con 0x5637673132b0 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3636295398 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d1c0a5260 con 0x5637673132b0 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d11ffb640 1 -- 172.21.15.82:0/3636295398 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9d24059050 con 0x5637673132b0 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d33bb5740 10 client.16773 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3636295398 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5637673221e0 con 0x5637673132b0 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.029+0000 7f9d11ffb640 1 -- 172.21.15.82:0/3636295398 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d1c0a5260 con 0x5637673132b0 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.030+0000 7f9d11ffb640 1 -- 172.21.15.82:0/3636295398 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f9d240040d0 con 0x5637673132b0 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.030+0000 7f9d33bb5740 10 client.16773 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.030+0000 7f9d33bb5740 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.030+0000 7f9d33bb5740 20 client.16773 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:58.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.030+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563767323760 0x563767325ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.030+0000 7f9d33bb5740 4 client.16773 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:28:58.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.030+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3636295398 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563767276c50 con 0x563767323760 2024-03-27T07:28:58.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.030+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563767323760 0x563767325ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.030+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563767323760 0x563767325ba0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=392507fff7cd0dea server_cookie=b40308e0166df696 in_seq=0 out_seq=0 2024-03-27T07:28:58.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.030+0000 7f9d11ffb640 10 client.16773 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:58.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.031+0000 7f9d11ffb640 1 -- 172.21.15.82:0/3636295398 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x563767276c50 con 0x563767323760 2024-03-27T07:28:58.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.031+0000 7f9d11ffb640 10 client.16773 handle_command_reply: tid=0 2024-03-27T07:28:58.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.031+0000 7f9d33bb5740 1 client.16773 shutdown 2024-03-27T07:28:58.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3636295398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 msgr2=0x563767310df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:58.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 0x563767310df0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9d2402efd0 tx=0x7f9d24005d80 comp rx=0 tx=0).stop 2024-03-27T07:28:58.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3636295398 shutdown_connections 2024-03-27T07:28:58.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x563767323760 0x563767325ba0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673132b0 0x563767310df0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673059e0 0x5637673108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3636295398 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x563767310370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3636295398 >> 172.21.15.82:0/3636295398 conn(0x5637672ffee0 msgr2=0x563767301c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:58.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d11ffb640 0 client.16773 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:58.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3636295398 shutdown_connections 2024-03-27T07:28:58.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3636295398 wait complete. 2024-03-27T07:28:58.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.032+0000 7f9d33bb5740 20 client.16773 trim_cache size 0 max 16384 2024-03-27T07:28:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.045+0000 7f9d33bb5740 1 Processor -- start 2024-03-27T07:28:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.045+0000 7f9d33bb5740 1 -- start start 2024-03-27T07:28:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x563767312aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376731ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673132b0 0x56376730dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1adda0 con 0x5637673059e0 2024-03-27T07:28:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1ab610 con 0x5637673050c0 2024-03-27T07:28:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1a9460 con 0x5637673132b0 2024-03-27T07:28:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376731ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376731ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40252/0 (socket says 172.21.15.82:40252) 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x563767312aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d23fff640 1 -- 172.21.15.82:0/3773695728 learned_addr learned my addr 172.21.15.82:0/3773695728 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d2ad9d640 1 --2- 172.21.15.82:0/3773695728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673132b0 0x56376730dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d23fff640 1 -- 172.21.15.82:0/3773695728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673132b0 msgr2=0x56376730dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d23fff640 1 --2- 172.21.15.82:0/3773695728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673132b0 0x56376730dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d23fff640 1 -- 172.21.15.82:0/3773695728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 msgr2=0x563767312aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d23fff640 1 --2- 172.21.15.82:0/3773695728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x563767312aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d23fff640 1 -- 172.21.15.82:0/3773695728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563767305810 con 0x5637673059e0 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/3773695728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x563767312aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d23fff640 1 --2- 172.21.15.82:0/3773695728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376731ec00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9d14012580 tx=0x7f9d14005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de443ddf2b66b596 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d13fff640 1 -- 172.21.15.82:0/3773695728 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14022070 con 0x5637673059e0 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d13fff640 1 -- 172.21.15.82:0/3773695728 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d140035f0 con 0x5637673059e0 2024-03-27T07:28:58.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.046+0000 7f9d13fff640 1 -- 172.21.15.82:0/3773695728 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400f780 con 0x5637673059e0 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.047+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3773695728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 msgr2=0x56376731ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.047+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3773695728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376731ec00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f9d14012580 tx=0x7f9d14005f90 comp rx=0 tx=0).stop 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.047+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3773695728 shutdown_connections 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.047+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3773695728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376731ec00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.047+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3773695728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673132b0 0x56376730dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.047+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/3773695728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x563767312aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.047+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3773695728 >> 172.21.15.82:0/3773695728 conn(0x5637672ffee0 msgr2=0x5637672fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.047+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3773695728 shutdown_connections 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.047+0000 7f9d33bb5740 1 -- 172.21.15.82:0/3773695728 wait complete. 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d33bb5740 1 -- start start 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d33bb5740 1 Processor -- start 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x56376732a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376732add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d33bb5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673132b0 0x56376732b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1a9ad0 con 0x5637673059e0 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1aaf40 con 0x5637673050c0 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376732add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d33bb5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c1aa1a0 con 0x5637673132b0 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x56376732a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d23fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376732add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40268/0 (socket says 172.21.15.82:40268) 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d2a59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x56376732a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:42198/0 (socket says 172.21.15.82:42198) 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d23fff640 1 -- 172.21.15.82:0/2967657994 learned_addr learned my addr 172.21.15.82:0/2967657994 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d33bb5740 10 client.0 _ll_register_callbacks cb 0x7f9d14005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d2ad9d640 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673132b0 0x56376732b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d23fff640 1 -- 172.21.15.82:0/2967657994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673132b0 msgr2=0x56376732b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d23fff640 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673132b0 0x56376732b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d23fff640 1 -- 172.21.15.82:0/2967657994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 msgr2=0x56376732a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d23fff640 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x56376732a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d23fff640 1 -- 172.21.15.82:0/2967657994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563767388aa0 con 0x5637673059e0 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d23fff640 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376732add0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9d14012ed0 tx=0x7f9d14003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40ac421ed7d923b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.048+0000 7f9d11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d11ffb640 1 -- 172.21.15.82:0/2967657994 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d14022070 con 0x5637673059e0 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d11ffb640 1 -- 172.21.15.82:0/2967657994 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f9d14005050 con 0x5637673059e0 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d33bb5740 1 -- 172.21.15.82:0/2967657994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d140035f0 con 0x5637673059e0 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d11ffb640 1 -- 172.21.15.82:0/2967657994 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9d14036050 con 0x5637673059e0 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d33bb5740 10 client.16779 fetch_fsmap learned FSMap version 30 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d33bb5740 1 -- 172.21.15.82:0/2967657994 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563767389da0 con 0x5637673059e0 2024-03-27T07:28:58.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d11ffb640 1 -- 172.21.15.82:0/2967657994 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d140035f0 con 0x5637673059e0 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d11ffb640 1 -- 172.21.15.82:0/2967657994 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f9d1400f540 con 0x5637673059e0 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d33bb5740 10 client.16779 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d33bb5740 10 client.16779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d33bb5740 20 client.16779 populate_metadata read hostname 'smithi082' 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56376738a5b0 0x56376738c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d33bb5740 4 client.16779 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d33bb5740 1 -- 172.21.15.82:0/2967657994 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563767270fa0 con 0x56376738a5b0 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.049+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56376738a5b0 0x56376738c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d11ffb640 10 client.16779 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d2a59c640 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56376738a5b0 0x56376738c9d0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61bd9c22c7b675f9 server_cookie=c38c4f55d32b0849 in_seq=0 out_seq=0 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d11ffb640 1 -- 172.21.15.82:0/2967657994 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563767270fa0 con 0x56376738a5b0 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d11ffb640 10 client.16779 handle_command_reply: tid=0 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 client.16779 shutdown 2024-03-27T07:28:58.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 -- 172.21.15.82:0/2967657994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 msgr2=0x56376732add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376732add0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9d14012ed0 tx=0x7f9d14003bb0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 -- 172.21.15.82:0/2967657994 shutdown_connections 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56376738a5b0 0x56376738c9d0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637673059e0 0x56376732add0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5637673132b0 0x56376732b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d11ffb640 0 client.16779 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 --2- 172.21.15.82:0/2967657994 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5637673050c0 0x56376732a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 -- 172.21.15.82:0/2967657994 >> 172.21.15.82:0/2967657994 conn(0x5637672ffee0 msgr2=0x5637672ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 -- 172.21.15.82:0/2967657994 shutdown_connections 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 1 -- 172.21.15.82:0/2967657994 wait complete. 2024-03-27T07:28:58.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d33bb5740 20 client.16779 trim_cache size 0 max 16384 2024-03-27T07:28:58.061 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-03-27T07:28:58.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d30eed640 1 -- 172.21.15.82:0/948414848 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9d180a3780 msgr2=0x7f9d180a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:58.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d30eed640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9d180a3780 0x7f9d180a5c40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9d24035fd0 tx=0x7f9d24009950 comp rx=0 tx=0).stop 2024-03-27T07:28:58.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.050+0000 7f9d30eed640 1 -- 172.21.15.82:0/948414848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d2c101100 msgr2=0x7f9d2c197220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:28:58.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.051+0000 7f9d30eed640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d2c101100 0x7f9d2c197220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00e9f0 tx=0x7f9d1c00eeb0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.051+0000 7f9d30eed640 1 -- 172.21.15.82:0/948414848 shutdown_connections 2024-03-27T07:28:58.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.051+0000 7f9d30eed640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f9d180a3780 0x7f9d180a5c40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.051+0000 7f9d30eed640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d2c105a20 0x7f9d2c19bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.051+0000 7f9d30eed640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f9d2c101ac0 0x7f9d2c197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.051+0000 7f9d30eed640 1 --2- 172.21.15.82:0/948414848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9d2c101100 0x7f9d2c197220 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:28:58.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.051+0000 7f9d30eed640 1 -- 172.21.15.82:0/948414848 >> 172.21.15.82:0/948414848 conn(0x7f9d2c076f70 msgr2=0x7f9d2c103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:28:58.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.051+0000 7f9d30eed640 1 -- 172.21.15.82:0/948414848 shutdown_connections 2024-03-27T07:28:58.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:28:58.051+0000 7f9d30eed640 1 -- 172.21.15.82:0/948414848 wait complete. 2024-03-27T07:28:58.067 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 1854940, 'ino': 1099511629902, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 2448752, 'ino': 1099511629826, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 3549982, 'ino': 1099511631411, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 13870685, 'ino': 1099511634317, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 14042424, 'ino': 2199023259392, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 14255934, 'ino': 1099511636693, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 16900142, 'ino': 1099511636834, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 18037175, 'ino': 1099511634964, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 21816106, 'ino': 1099511634893, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 21948318, 'ino': 2199023265129, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 29402463, 'ino': 2199023265014, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-3.xml'}, {'damage_type': 'backtrace', 'id': 29972078, 'ino': 1099511639397, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 31121105, 'ino': 1099511637030, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 31138388, 'ino': 1099511636960, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 31606311, 'ino': 2199023272839, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-32.xml'}, {'damage_type': 'backtrace', 'id': 32029714, 'ino': 1099511633869, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 32651201, 'ino': 2199023259223, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 33019408, 'ino': 2199023258499, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-38.xml'}, {'damage_type': 'backtrace', 'id': 33139641, 'ino': 2199023272813, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-41.xml'}, {'damage_type': 'backtrace', 'id': 33837456, 'ino': 2199023259571, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 35115041, 'ino': 1099511636782, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 35845736, 'ino': 2199023263027, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-8.xml'}, {'damage_type': 'backtrace', 'id': 37273646, 'ino': 2199023265104, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 41958259, 'ino': 1099511631021, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 43172563, 'ino': 1099511630903, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 43365153, 'ino': 2199023262799, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 44423291, 'ino': 2199023259107, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-5.xml'}, {'damage_type': 'backtrace', 'id': 47688314, 'ino': 1099511633761, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 55272236, 'ino': 1099511633865, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 55666945, 'ino': 1099511639336, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-1.xml'}, {'damage_type': 'backtrace', 'id': 56107103, 'ino': 1099511629906, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 56395414, 'ino': 2199023265012, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-4.xml'}, {'damage_type': 'backtrace', 'id': 60706819, 'ino': 2199023265879, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-13.xml'}, {'damage_type': 'backtrace', 'id': 62769223, 'ino': 1099511636808, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 69105834, 'ino': 2199023263070, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 70655445, 'ino': 2199023272878, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-23.xml'}, {'damage_type': 'backtrace', 'id': 70896572, 'ino': 2199023259687, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 73381102, 'ino': 1099511638980, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 79986599, 'ino': 1099511629799, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 80673564, 'ino': 1099511634808, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 83748444, 'ino': 1099511638990, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 86013955, 'ino': 1099511633878, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 86317061, 'ino': 1099511636683, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 88495274, 'ino': 2199023265987, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 90030195, 'ino': 1099511638992, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 91993894, 'ino': 1099511634297, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 92635904, 'ino': 2199023265040, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 99515410, 'ino': 1099511633888, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 101719698, 'ino': 2199023272922, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-7.xml'}, {'damage_type': 'backtrace', 'id': 103266668, 'ino': 2199023272804, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-44.xml'}, {'damage_type': 'backtrace', 'id': 109681729, 'ino': 1099511629606, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-93.xml'}, {'damage_type': 'backtrace', 'id': 117603820, 'ino': 2199023261380, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 120001404, 'ino': 2199023264985, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-20.xml'}, {'damage_type': 'backtrace', 'id': 120803858, 'ino': 2199023259010, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-30.xml'}, {'damage_type': 'backtrace', 'id': 126513405, 'ino': 2199023272943, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 127043328, 'ino': 2199023258527, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-31.xml'}, {'damage_type': 'backtrace', 'id': 127192570, 'ino': 1099511630893, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 132549350, 'ino': 2199023259566, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 132704248, 'ino': 2199023258420, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-6.xml'}, {'damage_type': 'backtrace', 'id': 133479822, 'ino': 1099511635099, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 136045900, 'ino': 1099511635019, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 136280063, 'ino': 1099511634921, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 139034878, 'ino': 1099511629819, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 142216699, 'ino': 1099511629868, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 148358601, 'ino': 2199023261372, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 149270225, 'ino': 2199023265062, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 152263657, 'ino': 2199023264977, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-24.xml'}, {'damage_type': 'backtrace', 'id': 156194393, 'ino': 1099511630107, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-40.xml'}, {'damage_type': 'backtrace', 'id': 169122764, 'ino': 1099511639358, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 169168329, 'ino': 2199023259532, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 170661757, 'ino': 2199023258594, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-12.xml'}, {'damage_type': 'backtrace', 'id': 172913390, 'ino': 2199023265149, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 173401127, 'ino': 2199023258724, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 179042435, 'ino': 2199023258891, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-52.xml'}, {'damage_type': 'backtrace', 'id': 188641180, 'ino': 1099511634145, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-88.jpg'}, {'damage_type': 'backtrace', 'id': 189382584, 'ino': 1099511634765, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-88.jpg'}, {'damage_type': 'backtrace', 'id': 194077502, 'ino': 1099511634237, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 194533412, 'ino': 1099511638943, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-4.xml'}, {'damage_type': 'backtrace', 'id': 199175857, 'ino': 1099511635075, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 215384670, 'ino': 1099511637267, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-6.xml'}, {'damage_type': 'backtrace', 'id': 216437578, 'ino': 1099511635008, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 219549996, 'ino': 1099511629893, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 224254580, 'ino': 1099511634025, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 224968649, 'ino': 2199023259481, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 226458242, 'ino': 2199023258255, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-38.xml'}, {'damage_type': 'backtrace', 'id': 227110783, 'ino': 2199023265937, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 239319603, 'ino': 2199023258497, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 243096116, 'ino': 1099511637023, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 244422464, 'ino': 2199023265050, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 246525902, 'ino': 2199023258367, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-17.xml'}, {'damage_type': 'backtrace', 'id': 246979575, 'ino': 2199023258334, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-23.xml'}, {'damage_type': 'backtrace', 'id': 247752798, 'ino': 2199023265003, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-10.xml'}, {'damage_type': 'backtrace', 'id': 252445469, 'ino': 2199023259118, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-2.xml'}, {'damage_type': 'backtrace', 'id': 252565531, 'ino': 1099511631006, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 258497833, 'ino': 1099511631426, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 259985722, 'ino': 1099511635130, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 263294553, 'ino': 1099511638982, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 264730713, 'ino': 2199023259561, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 266552720, 'ino': 1099511637257, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-9.xml'}, {'damage_type': 'backtrace', 'id': 267370387, 'ino': 1099511638994, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 271498674, 'ino': 1099511631099, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-95.xml'}, {'damage_type': 'backtrace', 'id': 278421875, 'ino': 2199023259457, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 278480798, 'ino': 2199023258187, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-55.xml'}, {'damage_type': 'backtrace', 'id': 278501951, 'ino': 2199023265022, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 279598478, 'ino': 1099511631013, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 283054651, 'ino': 1099511637378, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 289030700, 'ino': 1099511629898, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 294602221, 'ino': 1099511637388, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 299757955, 'ino': 2199023262952, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-37.xml'}, {'damage_type': 'backtrace', 'id': 300075776, 'ino': 1099511639373, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 303077605, 'ino': 2199023263016, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-12.xml'}, {'damage_type': 'backtrace', 'id': 303799171, 'ino': 1099511634315, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 304679956, 'ino': 2199023273588, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-32.xml'}, {'damage_type': 'backtrace', 'id': 307766473, 'ino': 1099511638966, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 313432287, 'ino': 1099511630741, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-45.xml'}, {'damage_type': 'backtrace', 'id': 313793487, 'ino': 1099511633851, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 319542787, 'ino': 1099511631414, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 324523380, 'ino': 1099511634702, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-9.xml'}, {'damage_type': 'backtrace', 'id': 326259616, 'ino': 1099511634888, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 326265549, 'ino': 2199023259093, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-9.xml'}, {'damage_type': 'backtrace', 'id': 331191463, 'ino': 1099511638972, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 332742741, 'ino': 1099511633646, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 332903409, 'ino': 1099511629888, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 336520037, 'ino': 2199023266015, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 338817597, 'ino': 2199023259316, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 339950563, 'ino': 2199023262875, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-68.xml'}, {'damage_type': 'backtrace', 'id': 346366173, 'ino': 2199023265170, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 351561582, 'ino': 1099511639003, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 352588754, 'ino': 2199023267407, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 361362519, 'ino': 1099511639354, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 364358612, 'ino': 2199023258352, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-20.xml'}, {'damage_type': 'backtrace', 'id': 367812413, 'ino': 1099511634328, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 370203979, 'ino': 2199023259584, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 370584833, 'ino': 2199023258773, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 373820117, 'ino': 1099511631028, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 373979766, 'ino': 2199023258996, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-33.xml'}, {'damage_type': 'backtrace', 'id': 375125072, 'ino': 1099511636602, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 377684139, 'ino': 1099511636841, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 384615430, 'ino': 2199023258507, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-36.xml'}, {'damage_type': 'backtrace', 'id': 388133272, 'ino': 2199023265071, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 389744111, 'ino': 2199023272912, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-11.xml'}, {'damage_type': 'backtrace', 'id': 391807685, 'ino': 2199023262650, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-43.xml'}, {'damage_type': 'backtrace', 'id': 395660691, 'ino': 2199023272946, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 396147944, 'ino': 2199023262852, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-77.xml'}, {'damage_type': 'backtrace', 'id': 401017765, 'ino': 2199023265164, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 405148075, 'ino': 1099511634742, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-1.xml'}, {'damage_type': 'backtrace', 'id': 416487252, 'ino': 2199023272910, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-12.xml'}, {'damage_type': 'backtrace', 'id': 425055592, 'ino': 1099511636882, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-93.xml'}, {'damage_type': 'backtrace', 'id': 432781828, 'ino': 1099511639361, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 435169702, 'ino': 2199023265963, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 435723285, 'ino': 2199023262704, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-28.xml'}, {'damage_type': 'backtrace', 'id': 437068899, 'ino': 1099511631051, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 438999576, 'ino': 1099511637312, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 439907749, 'ino': 2199023259695, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 440027151, 'ino': 2199023269934, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 443862273, 'ino': 2199023278128, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 446913031, 'ino': 1099511629877, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 451607482, 'ino': 1099511633699, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 458456921, 'ino': 1099511630225, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 463206701, 'ino': 1099511639002, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 465744375, 'ino': 2199023258818, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 466108402, 'ino': 2199023272756, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-59.xml'}, {'damage_type': 'backtrace', 'id': 475453802, 'ino': 2199023261285, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-12.xml'}, {'damage_type': 'backtrace', 'id': 480941697, 'ino': 2199023265006, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-7.xml'}, {'damage_type': 'backtrace', 'id': 482556048, 'ino': 2199023259546, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 486329710, 'ino': 1099511635087, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 491165430, 'ino': 1099511633616, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 492144137, 'ino': 2199023272941, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 492560184, 'ino': 1099511631026, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 493888942, 'ino': 1099511636373, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-58.xml'}, {'damage_type': 'backtrace', 'id': 493910422, 'ino': 1099511634277, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 498226071, 'ino': 2199023265004, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-9.xml'}, {'damage_type': 'backtrace', 'id': 500095073, 'ino': 1099511634040, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 503046469, 'ino': 1099511632902, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-45.xml'}, {'damage_type': 'backtrace', 'id': 505494033, 'ino': 1099511634829, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 507744107, 'ino': 2199023259103, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-6.xml'}, {'damage_type': 'backtrace', 'id': 509800849, 'ino': 1099511629769, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 518907177, 'ino': 1099511631104, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-100.xml'}, {'damage_type': 'backtrace', 'id': 520282190, 'ino': 1099511635041, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 522571492, 'ino': 1099511636594, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 523931013, 'ino': 2199023272869, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-26.xml'}, {'damage_type': 'backtrace', 'id': 533710519, 'ino': 1099511634945, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 538290165, 'ino': 1099511631827, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 539707410, 'ino': 2199023265108, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 548066312, 'ino': 2199023264995, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-15.xml'}, {'damage_type': 'backtrace', 'id': 551025929, 'ino': 1099511634285, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 564720011, 'ino': 1099511629766, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 569215387, 'ino': 2199023259064, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-16.xml'}, {'damage_type': 'backtrace', 'id': 582529260, 'ino': 2199023258299, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-29.xml'}, {'damage_type': 'backtrace', 'id': 584752254, 'ino': 1099511633682, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-99.xml'}, {'damage_type': 'backtrace', 'id': 585176400, 'ino': 1099511638960, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 590661320, 'ino': 1099511630889, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 591175704, 'ino': 1099511635036, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 594312616, 'ino': 2199023265891, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-7.xml'}, {'damage_type': 'backtrace', 'id': 598583007, 'ino': 2199023259088, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-10.xml'}, {'damage_type': 'backtrace', 'id': 600322430, 'ino': 1099511633685, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 605823925, 'ino': 1099511633674, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 606979619, 'ino': 2199023263154, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 607549394, 'ino': 2199023262614, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-52.xml'}, {'damage_type': 'backtrace', 'id': 608054887, 'ino': 2199023258535, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 609828127, 'ino': 1099511639383, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 618551570, 'ino': 2199023265155, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 621542226, 'ino': 2199023258857, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-58.xml'}, {'damage_type': 'backtrace', 'id': 624973820, 'ino': 2199023259608, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 625403592, 'ino': 2199023265935, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 628072883, 'ino': 1099511629831, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 629400357, 'ino': 2199023258363, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-18.xml'}, {'damage_type': 'backtrace', 'id': 629834042, 'ino': 2199023272786, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-50.xml'}, {'damage_type': 'backtrace', 'id': 631111789, 'ino': 1099511634079, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 633909925, 'ino': 2199023258512, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 646772302, 'ino': 1099511637383, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 648763020, 'ino': 1099511639381, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 649916561, 'ino': 1099511634985, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 651278619, 'ino': 1099511639374, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 651486889, 'ino': 2199023265146, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 653661221, 'ino': 1099511637276, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-2.xml'}, {'damage_type': 'backtrace', 'id': 658532578, 'ino': 2199023258267, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-35.xml'}, {'damage_type': 'backtrace', 'id': 658550955, 'ino': 1099511637321, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 662407320, 'ino': 1099511638954, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 664730132, 'ino': 2199023272819, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-39.xml'}, {'damage_type': 'backtrace', 'id': 665083067, 'ino': 1099511637316, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 669490553, 'ino': 1099511629801, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 671194710, 'ino': 2199023265152, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 674681025, 'ino': 1099511631094, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-32.xml'}, {'damage_type': 'backtrace', 'id': 677535698, 'ino': 1099511629859, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 678679265, 'ino': 1099511634291, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 681581103, 'ino': 1099511634238, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 682514396, 'ino': 2199023258310, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-27.xml'}, {'damage_type': 'backtrace', 'id': 685974040, 'ino': 1099511631398, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 692601238, 'ino': 2199023259099, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-7.xml'}, {'damage_type': 'backtrace', 'id': 696126914, 'ino': 2199023265871, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-17.xml'}, {'damage_type': 'backtrace', 'id': 697520232, 'ino': 1099511634710, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-7.xml'}, {'damage_type': 'backtrace', 'id': 698391000, 'ino': 2199023258203, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-51.xml'}, {'damage_type': 'backtrace', 'id': 702980237, 'ino': 1099511636818, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 708724921, 'ino': 2199023259381, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 715542354, 'ino': 1099511634323, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 717559830, 'ino': 1099511635169, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 723469729, 'ino': 1099511631030, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 723595671, 'ino': 2199023259659, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 725349219, 'ino': 2199023264981, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-22.xml'}, {'damage_type': 'backtrace', 'id': 731975995, 'ino': 2199023258567, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 732533860, 'ino': 2199023261340, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 732772714, 'ino': 1099511636973, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 738165662, 'ino': 1099511634940, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 738482043, 'ino': 1099511637443, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 749240947, 'ino': 1099511633609, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 755264744, 'ino': 1099511631029, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 755836466, 'ino': 1099511631223, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-17.xml'}, {'damage_type': 'backtrace', 'id': 760904189, 'ino': 2199023265945, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 761064230, 'ino': 1099511637283, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 764197725, 'ino': 2199023259499, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 768434326, 'ino': 1099511639389, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 771144883, 'ino': 1099511636998, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 771544907, 'ino': 1099511629929, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-99.jpg'}, {'damage_type': 'backtrace', 'id': 772666331, 'ino': 1099511639398, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 775971557, 'ino': 1099511631011, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 778420291, 'ino': 2199023272777, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-53.xml'}, {'damage_type': 'backtrace', 'id': 780976548, 'ino': 2199023265074, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 785419155, 'ino': 2199023258614, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-7.xml'}, {'damage_type': 'backtrace', 'id': 785510006, 'ino': 2199023258927, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-46.xml'}, {'damage_type': 'backtrace', 'id': 786299598, 'ino': 2199023266011, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 792907794, 'ino': 1099511638977, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 793405958, 'ino': 1099511629933, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-93.xml'}, {'damage_type': 'backtrace', 'id': 799945494, 'ino': 2199023261384, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 802687909, 'ino': 2199023258493, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 805692838, 'ino': 1099511631838, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-91.xml'}, {'damage_type': 'backtrace', 'id': 812487633, 'ino': 1099511634825, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 814494391, 'ino': 1099511633612, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-84.xml'}, {'damage_type': 'backtrace', 'id': 819762425, 'ino': 1099511633988, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 823174069, 'ino': 1099511631017, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 823702305, 'ino': 1099511631102, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-77.xml'}, {'damage_type': 'backtrace', 'id': 826988079, 'ino': 1099511630910, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 827184059, 'ino': 2199023272774, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-54.xml'}, {'damage_type': 'backtrace', 'id': 829448894, 'ino': 1099511633804, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 831557206, 'ino': 2199023259041, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-24.xml'}, {'damage_type': 'backtrace', 'id': 832734651, 'ino': 2199023265158, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 833494789, 'ino': 2199023258322, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-25.xml'}, {'damage_type': 'backtrace', 'id': 840353354, 'ino': 1099511638967, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 846463738, 'ino': 1099511633680, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 848843139, 'ino': 1099511638951, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 851158963, 'ino': 1099511634295, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 852284228, 'ino': 2199023258551, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-23.xml'}, {'damage_type': 'backtrace', 'id': 852300661, 'ino': 1099511629813, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 854304087, 'ino': 1099511637253, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-10.xml'}, {'damage_type': 'backtrace', 'id': 860521629, 'ino': 1099511634333, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 860774535, 'ino': 1099511637406, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 861842387, 'ino': 2199023258199, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-52.xml'}, {'damage_type': 'backtrace', 'id': 865216640, 'ino': 1099511636773, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 868610870, 'ino': 1099511634777, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-86.jpg'}, {'damage_type': 'backtrace', 'id': 872146660, 'ino': 1099511633898, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 873705272, 'ino': 2199023263142, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 874334487, 'ino': 1099511634286, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 875916908, 'ino': 1099511632824, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 878541955, 'ino': 2199023258471, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-45.xml'}, {'damage_type': 'backtrace', 'id': 883511115, 'ino': 1099511638936, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-11.xml'}, {'damage_type': 'backtrace', 'id': 886408711, 'ino': 2199023266520, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-90.jpg'}, {'damage_type': 'backtrace', 'id': 892338677, 'ino': 2199023258460, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 895090821, 'ino': 1099511635096, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 906596011, 'ino': 1099511638950, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 910107478, 'ino': 2199023259031, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-26.xml'}, {'damage_type': 'backtrace', 'id': 912792221, 'ino': 1099511638995, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 915664848, 'ino': 1099511633959, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 919460806, 'ino': 1099511633862, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 919473624, 'ino': 2199023272902, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-15.xml'}, {'damage_type': 'backtrace', 'id': 921251465, 'ino': 1099511633757, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 921406972, 'ino': 2199023259541, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 922394077, 'ino': 1099511637004, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 929860446, 'ino': 2199023265993, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 932022973, 'ino': 2199023258271, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-34.xml'}, {'damage_type': 'backtrace', 'id': 932657421, 'ino': 2199023272899, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-16.xml'}, {'damage_type': 'backtrace', 'id': 939661638, 'ino': 1099511638970, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 942310239, 'ino': 1099511637263, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-7.xml'}, {'damage_type': 'backtrace', 'id': 944518380, 'ino': 2199023261376, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 945262111, 'ino': 1099511637009, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 952561554, 'ino': 1099511633751, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 955828179, 'ino': 2199023259633, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 956472543, 'ino': 2199023261297, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-9.xml'}, {'damage_type': 'backtrace', 'id': 956799484, 'ino': 1099511631022, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 957202727, 'ino': 2199023258235, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-43.xml'}, {'damage_type': 'backtrace', 'id': 962504006, 'ino': 1099511634786, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 963062396, 'ino': 1099511635067, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 963224469, 'ino': 2199023259045, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-22.xml'}, {'damage_type': 'backtrace', 'id': 966014382, 'ino': 3298534889054, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 972932430, 'ino': 1099511639388, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 974407069, 'ino': 1099511631422, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 976125461, 'ino': 1099511629784, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 978044806, 'ino': 2199023272851, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-28.xml'}, {'damage_type': 'backtrace', 'id': 983137551, 'ino': 2199023258398, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-11.xml'}, {'damage_type': 'backtrace', 'id': 984433890, 'ino': 2199023259110, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-4.xml'}, {'damage_type': 'backtrace', 'id': 988726502, 'ino': 2199023258231, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-44.xml'}, {'damage_type': 'backtrace', 'id': 990656277, 'ino': 1099511632392, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-14.xml'}, {'damage_type': 'backtrace', 'id': 991422127, 'ino': 2199023259623, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 999685848, 'ino': 2199023258570, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1005466120, 'ino': 1099511631405, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 1007905257, 'ino': 1099511631025, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 1008148370, 'ino': 1099511636954, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 1010526836, 'ino': 1099511630887, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 1014369221, 'ino': 1099511636886, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 1014644911, 'ino': 2199023262992, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1017710505, 'ino': 2199023258541, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1018808219, 'ino': 1099511630883, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 1020859129, 'ino': 2199023264999, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1022736996, 'ino': 1099511638988, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1023436554, 'ino': 1099511636758, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 1028223954, 'ino': 1099511636790, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 1037521792, 'ino': 2199023265883, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-11.xml'}, {'damage_type': 'backtrace', 'id': 1038965685, 'ino': 1099511635702, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1040060262, 'ino': 1099511638953, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 1042341410, 'ino': 1099511637137, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 1042579288, 'ino': 2199023259679, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1046084306, 'ino': 2199023263045, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1051678857, 'ino': 2199023258838, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1052800049, 'ino': 2199023266005, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1052904543, 'ino': 1099511635117, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1057142133, 'ino': 2199023259603, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1059236140, 'ino': 1099511634789, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 1060386740, 'ino': 1099511629822, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 1063014214, 'ino': 2199023258808, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1064837315, 'ino': 2199023258408, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1070481080, 'ino': 2199023264983, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1071402655, 'ino': 1099511629878, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1073710523, 'ino': 2199023266017, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1077651643, 'ino': 2199023265034, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1086121447, 'ino': 2199023272872, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1086922842, 'ino': 2199023265181, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1090265731, 'ino': 1099511630885, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 1094365429, 'ino': 1099511630906, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 1096411837, 'ino': 2199023262862, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-73.xml'}, {'damage_type': 'backtrace', 'id': 1098986637, 'ino': 1099511638974, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1100808963, 'ino': 2199023264971, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1108616325, 'ino': 1099511629771, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 1110548106, 'ino': 1099511637394, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1111395704, 'ino': 1099511629816, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 1116510611, 'ino': 2199023258517, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1117531995, 'ino': 2199023269846, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 1118008318, 'ino': 2199023258163, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-60.xml'}, {'damage_type': 'backtrace', 'id': 1120307048, 'ino': 2199023265036, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 1123895107, 'ino': 1099511633799, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 1124522836, 'ino': 1099511634016, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1129118517, 'ino': 1099511637836, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 1129265879, 'ino': 1099511634100, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 1130818213, 'ino': 2199023272893, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1134073679, 'ino': 1099511633814, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 1135945523, 'ino': 2199023265038, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 1137611405, 'ino': 1099511631018, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 1138487014, 'ino': 2199023258356, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1141739808, 'ino': 2199023258440, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1149363312, 'ino': 1099511639349, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1150984328, 'ino': 1099511638987, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1152415582, 'ino': 2199023259075, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1155898683, 'ino': 2199023258387, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1158033791, 'ino': 2199023259006, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-31.xml'}, {'damage_type': 'backtrace', 'id': 1159140199, 'ino': 2199023263137, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1160250532, 'ino': 1099511639378, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1166350269, 'ino': 1099511634885, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 1170885093, 'ino': 1099511635025, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1176903050, 'ino': 1099511635668, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 1180207060, 'ino': 1099511634149, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1180888048, 'ino': 1099511634936, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 1186096630, 'ino': 2199023265030, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 1186560457, 'ino': 1099511634282, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 1188264855, 'ino': 2199023259404, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 1200580877, 'ino': 2199023258648, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1202785914, 'ino': 1099511635064, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1202848144, 'ino': 2199023258427, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1204236126, 'ino': 2199023258167, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-59.xml'}, {'damage_type': 'backtrace', 'id': 1205628524, 'ino': 1099511638955, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 1207304243, 'ino': 1099511634050, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 1207730937, 'ino': 1099511634275, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 1214858371, 'ino': 1099511633968, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 1215222522, 'ino': 1099511634903, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1218744878, 'ino': 2199023272875, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1226462597, 'ino': 1099511630896, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 1227604190, 'ino': 1099511629874, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 1231759011, 'ino': 2199023258183, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-56.xml'}, {'damage_type': 'backtrace', 'id': 1233283087, 'ino': 1099511635149, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1233954626, 'ino': 2199023259618, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1239122692, 'ino': 2199023272934, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1240128096, 'ino': 2199023259113, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1247588398, 'ino': 2199023259264, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 1248006080, 'ino': 1099511631408, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 1248463570, 'ino': 1099511639351, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1258534196, 'ino': 1099511629885, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 1258779195, 'ino': 2199023258873, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1262827250, 'ino': 1099511632361, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1274771581, 'ino': 2199023265077, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 1276150420, 'ino': 1099511635134, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1277158866, 'ino': 2199023259663, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1278812019, 'ino': 2199023259527, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 1279252522, 'ino': 2199023272763, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-57.xml'}, {'damage_type': 'backtrace', 'id': 1281338816, 'ino': 1099511634783, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-84.jpg'}, {'damage_type': 'backtrace', 'id': 1281722193, 'ino': 2199023265915, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 1282138699, 'ino': 1099511638981, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1285571057, 'ino': 1099511639310, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1291932402, 'ino': 2199023259556, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1293343424, 'ino': 2199023258423, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1294891180, 'ino': 2199023258383, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1295776325, 'ino': 1099511631024, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 1300744269, 'ino': 1099511638938, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1302073708, 'ino': 1099511629895, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 1308309645, 'ino': 2199023265947, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 1309236593, 'ino': 2199023265905, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 1311847719, 'ino': 2199023261332, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1312638519, 'ino': 2199023265047, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 1312884415, 'ino': 1099511639267, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-60.xml'}, {'damage_type': 'backtrace', 'id': 1313629992, 'ino': 1099511629573, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-76.xml'}, {'damage_type': 'backtrace', 'id': 1313671374, 'ino': 1099511637127, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 1321468403, 'ino': 1099511629775, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 1321756894, 'ino': 2199023265919, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 1327706676, 'ino': 2199023259509, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 1338895900, 'ino': 2199023259518, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1339251779, 'ino': 2199023258851, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-59.xml'}, {'damage_type': 'backtrace', 'id': 1342106252, 'ino': 2199023265010, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1344719665, 'ino': 1099511630897, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 1345306311, 'ino': 1099511638965, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1349306295, 'ino': 2199023265979, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1350789004, 'ino': 2199023272896, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1361245428, 'ino': 1099511634047, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 1361345620, 'ino': 1099511634972, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 1364461878, 'ino': 2199023259020, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1366646759, 'ino': 1099511637087, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 1369537224, 'ino': 2199023265959, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1372026697, 'ino': 1099511633018, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1375476011, 'ino': 1099511630890, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 1375692644, 'ino': 2199023265056, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1379571711, 'ino': 1099511639365, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1384347123, 'ino': 1099511631222, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 1391082764, 'ino': 2199023263004, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1393707042, 'ino': 1099511630884, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 1394847431, 'ino': 1099511629824, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 1401830931, 'ino': 2199023258243, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-41.xml'}, {'damage_type': 'backtrace', 'id': 1403783762, 'ino': 1099511634321, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 1418619884, 'ino': 1099511634916, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 1420559009, 'ino': 2199023265991, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1420701363, 'ino': 2199023272783, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1421337878, 'ino': 1099511632830, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-46.xml'}, {'damage_type': 'backtrace', 'id': 1424725534, 'ino': 2199023265887, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1429899660, 'ino': 2199023265161, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1430279716, 'ino': 2199023265957, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1433051573, 'ino': 2199023265965, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1437671789, 'ino': 2199023265083, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 1439482204, 'ino': 1099511629751, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 1442965889, 'ino': 1099511629844, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 1443039236, 'ino': 2199023265092, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1446213196, 'ino': 1099511636988, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 1450256121, 'ino': 1099511633846, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 1456187108, 'ino': 2199023265111, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1462463310, 'ino': 2199023265183, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1477806722, 'ino': 1099511630981, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 1487014371, 'ino': 1099511629865, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 1495058846, 'ino': 1099511637437, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1496900034, 'ino': 2199023265016, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1497449742, 'ino': 1099511636913, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 1499655889, 'ino': 1099511633856, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1502062268, 'ino': 1099511634310, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 1502990429, 'ino': 1099511629764, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 1508541671, 'ino': 1099511633786, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 1509133582, 'ino': 3298534888468, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-98.xml'}, {'damage_type': 'backtrace', 'id': 1509445563, 'ino': 2199023266013, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1510729748, 'ino': 1099511631410, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 1510847240, 'ino': 1099511637342, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1517975725, 'ino': 1099511639392, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1520038768, 'ino': 1099511639364, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1520593547, 'ino': 1099511639348, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1527173546, 'ino': 2199023265977, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1527568864, 'ino': 2199023258966, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1530360089, 'ino': 1099511637292, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1531012978, 'ino': 2199023262827, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-87.xml'}, {'damage_type': 'backtrace', 'id': 1533277607, 'ino': 2199023263237, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1537565531, 'ino': 1099511634857, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 1542259256, 'ino': 2199023258487, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-41.xml'}, {'damage_type': 'backtrace', 'id': 1542565710, 'ino': 1099511633638, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 1548425628, 'ino': 1099511636742, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 1548562636, 'ino': 2199023259691, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1553251377, 'ino': 1099511629850, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 1554055047, 'ino': 2199023263067, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 1556852980, 'ino': 1099511634880, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 1559299415, 'ino': 1099511638969, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 1564332534, 'ino': 1099511634793, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 1564707742, 'ino': 1099511639001, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1565937402, 'ino': 2199023259026, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1575167220, 'ino': 2199023259346, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 1585845621, 'ino': 2199023259595, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1586602227, 'ino': 1099511633724, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1586696979, 'ino': 2199023265913, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 1588517064, 'ino': 2199023259655, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1590264234, 'ino': 2199023259080, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1591707502, 'ino': 2199023258898, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1595150429, 'ino': 1099511630904, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 1599606058, 'ino': 1099511637454, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1600162733, 'ino': 2199023272955, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1607590329, 'ino': 1099511638999, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1609392269, 'ino': 2199023258287, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-31.xml'}, {'damage_type': 'backtrace', 'id': 1614330349, 'ino': 2199023265002, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-11.xml'}, {'damage_type': 'backtrace', 'id': 1614423466, 'ino': 2199023259050, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1621103134, 'ino': 2199023264969, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1622535845, 'ino': 2199023265897, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1624395524, 'ino': 2199023265173, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1624611106, 'ino': 1099511636868, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1631148820, 'ino': 2199023258345, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1632621111, 'ino': 1099511633773, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 1637644891, 'ino': 1099511629894, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 1639756684, 'ino': 2199023258753, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 1641108712, 'ino': 1099511629579, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1645827685, 'ino': 2199023258412, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1649851807, 'ino': 2199023265143, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1652740294, 'ino': 1099511629760, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 1654021461, 'ino': 1099511634148, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-97.jpg'}, {'damage_type': 'backtrace', 'id': 1661998101, 'ino': 1099511629795, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 1673536960, 'ino': 2199023258578, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-16.xml'}, {'damage_type': 'backtrace', 'id': 1673848946, 'ino': 2199023258946, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-43.xml'}, {'damage_type': 'backtrace', 'id': 1674709920, 'ino': 1099511634248, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 1675228858, 'ino': 1099511634278, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 1675337187, 'ino': 2199023272810, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1678263439, 'ino': 2199023262855, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-76.xml'}, {'damage_type': 'backtrace', 'id': 1680062801, 'ino': 2199023258784, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1681083973, 'ino': 2199023258477, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1681236760, 'ino': 1099511637367, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1681474383, 'ino': 1099511634307, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 1688792824, 'ino': 2199023261302, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1690925522, 'ino': 1099511635144, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1691108873, 'ino': 2199023258793, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1691175340, 'ino': 1099511629832, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1697769728, 'ino': 2199023272798, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-46.xml'}, {'damage_type': 'backtrace', 'id': 1699766100, 'ino': 2199023258629, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1706955493, 'ino': 2199023263164, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1707765785, 'ino': 1099511634007, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 1709116627, 'ino': 2199023272833, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1721319769, 'ino': 1099511631436, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 1727113652, 'ino': 2199023258602, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1732746259, 'ino': 1099511634313, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 1733146056, 'ino': 2199023265955, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1738468354, 'ino': 1099511629774, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 1739114350, 'ino': 1099511635092, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1741511710, 'ino': 1099511636968, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 1746151771, 'ino': 1099511629867, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 1748932032, 'ino': 1099511634738, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1750875282, 'ino': 1099511630907, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 1752161087, 'ino': 1099511636727, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 1755958340, 'ino': 2199023265132, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1767854096, 'ino': 2199023262993, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1768330547, 'ino': 1099511639386, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1769754916, 'ino': 1099511638978, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 1773221698, 'ino': 1099511636307, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1774154544, 'ino': 1099511637095, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 1775157751, 'ino': 1099511639384, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 1776548752, 'ino': 2199023258951, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1778127899, 'ino': 1099511631429, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 1780533396, 'ino': 2199023265179, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1783460658, 'ino': 2199023258481, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1784101139, 'ino': 1099511633953, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 1787885840, 'ino': 1099511636630, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 1789470981, 'ino': 1099511638997, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1789521840, 'ino': 2199023258986, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-35.xml'}, {'damage_type': 'backtrace', 'id': 1792788781, 'ino': 1099511629901, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 1795630877, 'ino': 2199023265086, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 1796913431, 'ino': 1099511629870, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 1797681462, 'ino': 1099511633816, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 1800987271, 'ino': 1099511637072, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1803017545, 'ino': 1099511631441, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 1806816252, 'ino': 1099511639342, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 1807056296, 'ino': 1099511637134, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 1818356214, 'ino': 2199023259126, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-85.jpg'}, {'damage_type': 'backtrace', 'id': 1819225931, 'ino': 1099511633602, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 1820451193, 'ino': 1099511637275, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1825707401, 'ino': 1099511635072, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1826044676, 'ino': 1099511631015, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 1826948835, 'ino': 2199023264967, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1827831400, 'ino': 1099511629866, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 1831023066, 'ino': 2199023258475, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1834338257, 'ino': 1099511638979, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1837247706, 'ino': 1099511637132, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 1847560405, 'ino': 1099511634324, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 1851564770, 'ino': 1099511631418, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 1853227624, 'ino': 1099511633795, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 1853670153, 'ino': 2199023258171, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-58.xml'}, {'damage_type': 'backtrace', 'id': 1855348165, 'ino': 2199023258415, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1857582132, 'ino': 2199023261392, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1858205408, 'ino': 2199023258432, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-3.xml'}, {'damage_type': 'backtrace', 'id': 1861503086, 'ino': 2199023265907, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 1864320299, 'ino': 1099511639300, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1871288876, 'ino': 2199023266001, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1872400513, 'ino': 1099511633709, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 1878663283, 'ino': 2199023265095, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1881495950, 'ino': 2199023262857, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-75.xml'}, {'damage_type': 'backtrace', 'id': 1889732338, 'ino': 1099511634267, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 1896795644, 'ino': 1099511634283, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 1901741787, 'ino': 2199023258861, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-57.xml'}, {'damage_type': 'backtrace', 'id': 1907873747, 'ino': 1099511636676, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 1907994302, 'ino': 2199023272890, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1924514428, 'ino': 2199023258528, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1926568539, 'ino': 2199023258468, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 1927598236, 'ino': 1099511634009, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 1929036837, 'ino': 1099511636621, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 1929051183, 'ino': 1099511633990, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 1933883343, 'ino': 1099511634800, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 1935456316, 'ino': 1099511637417, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1936542533, 'ino': 2199023272745, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-62.xml'}, {'damage_type': 'backtrace', 'id': 1940533403, 'ino': 1099511634265, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 1954696621, 'ino': 1099511634273, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 1954837629, 'ino': 1099511637040, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1960928575, 'ino': 1099511634780, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-85.jpg'}, {'damage_type': 'backtrace', 'id': 1961700234, 'ino': 2199023272924, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1967753030, 'ino': 2199023265999, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1969900541, 'ino': 1099511634319, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 1970530301, 'ino': 2199023265053, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1971188784, 'ino': 1099511634017, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 1972806579, 'ino': 1099511638942, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1975459478, 'ino': 2199023258159, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-61.xml'}, {'damage_type': 'backtrace', 'id': 1975981058, 'ino': 1099511629745, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 1976382133, 'ino': 2199023265923, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 1981654663, 'ino': 1099511634252, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 1988197631, 'ino': 2199023272848, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1988956570, 'ino': 1099511634747, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-90.jpg'}, {'damage_type': 'backtrace', 'id': 1990343124, 'ino': 1099511638945, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1992165653, 'ino': 1099511634061, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 1992749170, 'ino': 1099511637050, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 2003257017, 'ino': 1099511634236, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 2003726161, 'ino': 2199023262987, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2004123361, 'ino': 1099511633982, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 2004378287, 'ino': 1099511639007, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2004551359, 'ino': 1099511630363, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-75.xml'}, {'damage_type': 'backtrace', 'id': 2006523281, 'ino': 1099511630895, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 2020298670, 'ino': 2199023259580, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2023494505, 'ino': 2199023259121, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2031122991, 'ino': 1099511634714, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2047455075, 'ino': 1099511630888, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 2048821537, 'ino': 1099511631037, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 2049972450, 'ino': 1099511638964, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2051001767, 'ino': 2199023258239, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-42.xml'}, {'damage_type': 'backtrace', 'id': 2054237986, 'ino': 1099511629884, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 2054260781, 'ino': 1099511633777, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 2063769781, 'ino': 1099511629861, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 2068542185, 'ino': 1099511629803, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 2069677610, 'ino': 1099511634258, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 2069941802, 'ino': 1099511631002, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 2076948783, 'ino': 2199023266522, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2077772479, 'ino': 2199023278319, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-43.xml'}, {'damage_type': 'backtrace', 'id': 2078393552, 'ino': 1099511631789, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2088935309, 'ino': 1099511629842, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 2091407807, 'ino': 2199023258560, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2093674546, 'ino': 2199023262947, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-39.xml'}, {'damage_type': 'backtrace', 'id': 2095089205, 'ino': 2199023259645, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2102213120, 'ino': 1099511629835, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 2104804257, 'ino': 1099511638971, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2113466420, 'ino': 2199023265985, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2113615845, 'ino': 1099511629897, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 2117512640, 'ino': 1099511630236, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-93.xml'}, {'damage_type': 'backtrace', 'id': 2130649627, 'ino': 2199023258223, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-46.xml'}, {'damage_type': 'backtrace', 'id': 2130773612, 'ino': 2199023258525, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2131322690, 'ino': 2199023265032, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 2132179635, 'ino': 1099511636639, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 2137880230, 'ino': 2199023264993, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2138986938, 'ino': 1099511633718, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 2141100536, 'ino': 2199023265024, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 2143866306, 'ino': 1099511634834, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 2145726513, 'ino': 2199023259490, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2148186066, 'ino': 1099511638962, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2148808108, 'ino': 2199023258151, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2152756751, 'ino': 2199023259576, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 2155240065, 'ino': 2199023259048, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2155951747, 'ino': 2199023273254, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 2156422207, 'ino': 2199023258195, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-53.xml'}, {'damage_type': 'backtrace', 'id': 2173308095, 'ino': 1099511629880, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 2173575048, 'ino': 2199023261336, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2178621113, 'ino': 1099511637270, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2182663519, 'ino': 2199023259537, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2195883786, 'ino': 1099511636847, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 2198873261, 'ino': 1099511638958, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 2199887974, 'ino': 1099511638063, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-57.xml'}, {'damage_type': 'backtrace', 'id': 2202576386, 'ino': 1099511634037, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 2203427720, 'ino': 2199023263169, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2203518669, 'ino': 2199023265117, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2205052623, 'ino': 1099511637271, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2205685898, 'ino': 2199023262907, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-55.xml'}, {'damage_type': 'backtrace', 'id': 2206029330, 'ino': 1099511634301, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 2209086457, 'ino': 2199023258548, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2213125960, 'ino': 1099511629904, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 2215736255, 'ino': 1099511637357, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2218019668, 'ino': 2199023262512, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-79.xml'}, {'damage_type': 'backtrace', 'id': 2221818674, 'ino': 2199023258733, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2224357387, 'ino': 1099511634954, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2231773817, 'ino': 1099511637018, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 2235437630, 'ino': 1099511639368, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2236343205, 'ino': 1099511630901, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 2237100611, 'ino': 1099511631438, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 2238878409, 'ino': 1099511631106, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 2240020794, 'ino': 1099511634772, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-87.jpg'}, {'damage_type': 'backtrace', 'id': 2240419111, 'ino': 2199023259523, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 2241522797, 'ino': 2199023263014, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2243294835, 'ino': 2199023258587, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2243900709, 'ino': 2199023264989, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-18.xml'}, {'damage_type': 'backtrace', 'id': 2243974160, 'ino': 2199023258500, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2249541106, 'ino': 2199023272842, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-31.xml'}, {'damage_type': 'backtrace', 'id': 2253662278, 'ino': 2199023272936, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2254369783, 'ino': 1099511636939, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 2255819060, 'ino': 2199023258598, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2259435715, 'ino': 1099511629812, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 2265584975, 'ino': 1099511634754, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-89.jpg'}, {'damage_type': 'backtrace', 'id': 2267509368, 'ino': 1099511634241, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 2269259157, 'ino': 2199023265120, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2274214374, 'ino': 2199023258922, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2274843725, 'ino': 1099511629558, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2278427338, 'ino': 2199023259627, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 2291634049, 'ino': 1099511634006, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 2293402560, 'ino': 1099511636950, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 2295646365, 'ino': 2199023259157, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-89.xml'}, {'damage_type': 'backtrace', 'id': 2300348072, 'ino': 1099511638952, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 2302379170, 'ino': 2199023259208, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 2304141662, 'ino': 2199023259642, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2308247603, 'ino': 1099511634732, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2313923394, 'ino': 1099511632897, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2326834473, 'ino': 1099511634298, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 2330253214, 'ino': 1099511629869, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 2337102427, 'ino': 1099511633604, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2344936323, 'ino': 2199023265975, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 2346663845, 'ino': 1099511632364, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2349015536, 'ino': 3298534889053, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 2352317325, 'ino': 1099511637302, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2371898284, 'ino': 2199023265933, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2372977363, 'ino': 2199023258626, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2377526896, 'ino': 1099511634146, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-82.xml'}, {'damage_type': 'backtrace', 'id': 2377665076, 'ino': 2199023259131, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-84.jpg'}, {'damage_type': 'backtrace', 'id': 2386334864, 'ino': 2199023262887, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2387309203, 'ino': 1099511631004, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 2391815241, 'ino': 2199023258976, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2395537840, 'ino': 2199023265001, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2396806502, 'ino': 1099511638940, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2397615702, 'ino': 1099511635164, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2398389503, 'ino': 1099511637135, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 2398747913, 'ino': 2199023259495, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2401368302, 'ino': 2199023258744, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2401723095, 'ino': 2199023265885, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2410510912, 'ino': 2199023265961, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2413024113, 'ino': 2199023262688, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-33.xml'}, {'damage_type': 'backtrace', 'id': 2413136726, 'ino': 2199023259613, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 2414770996, 'ino': 1099511639370, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2415071536, 'ino': 1099511634300, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 2417394650, 'ino': 1099511634874, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 2422896312, 'ino': 2199023274451, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 2433067125, 'ino': 1099511629875, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 2433234716, 'ino': 1099511638948, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 2438301754, 'ino': 1099511639353, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2455566601, 'ino': 2199023265953, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 2457196979, 'ino': 2199023261352, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2466500727, 'ino': 2199023272768, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2468348368, 'ino': 2199023265140, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 2469463700, 'ino': 2199023265042, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2470714164, 'ino': 2199023264975, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-25.xml'}, {'damage_type': 'backtrace', 'id': 2470865279, 'ino': 1099511634931, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 2480764613, 'ino': 1099511629889, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 2482649938, 'ino': 1099511639346, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2484672461, 'ino': 1099511634010, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 2485168700, 'ino': 2199023258547, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2485513604, 'ino': 1099511629883, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 2486383942, 'ino': 1099511636947, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 2486561435, 'ino': 1099511638957, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 2492415809, 'ino': 2199023258842, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2494392399, 'ino': 1099511634925, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2496094191, 'ino': 1099511630248, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2499490491, 'ino': 2199023259451, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 2501709938, 'ino': 1099511629881, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 2505601885, 'ino': 3298534888970, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 2508141297, 'ino': 2199023258636, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2509149308, 'ino': 2199023272845, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2509775948, 'ino': 1099511639511, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2511469673, 'ino': 1099511636766, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 2524764805, 'ino': 1099511636878, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 2525211328, 'ino': 2199023259475, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2526404579, 'ino': 1099511638968, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2536253307, 'ino': 2199023265028, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 2539815334, 'ino': 2199023264991, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-17.xml'}, {'damage_type': 'backtrace', 'id': 2543759078, 'ino': 1099511629837, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 2547598342, 'ino': 2199023262954, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2548137815, 'ino': 1099511634852, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 2551727149, 'ino': 1099511637260, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2554982096, 'ino': 2199023265911, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 2557267311, 'ino': 2199023265943, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2558951610, 'ino': 1099511636658, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 2569845321, 'ino': 1099511635050, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2572500276, 'ino': 1099511639339, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2575916480, 'ino': 1099511635675, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-92.xml'}, {'damage_type': 'backtrace', 'id': 2577322541, 'ino': 1099511634249, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 2582040042, 'ino': 1099511635084, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 2584953015, 'ino': 2199023259000, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-32.xml'}, {'damage_type': 'backtrace', 'id': 2585320891, 'ino': 1099511636921, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 2585484900, 'ino': 1099511629856, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 2585961893, 'ino': 1099511633568, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2586538170, 'ino': 1099511634978, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2593126717, 'ino': 1099511634066, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 2595312098, 'ino': 2199023272801, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2596099655, 'ino': 1099511633714, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 2599548640, 'ino': 2199023259671, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2600509629, 'ino': 1099511629899, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 2602128088, 'ino': 2199023258880, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-54.xml'}, {'damage_type': 'backtrace', 'id': 2605829886, 'ino': 1099511637426, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2610759455, 'ino': 1099511638989, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2612007315, 'ino': 1099511631393, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 2612881169, 'ino': 1099511629829, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 2612983900, 'ino': 1099511634331, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 2618305571, 'ino': 1099511636718, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 2623594235, 'ino': 2199023259253, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 2623795353, 'ino': 2199023261356, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2625800585, 'ino': 1099511636710, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 2629886555, 'ino': 2199023259675, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2633447474, 'ino': 2199023272865, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-27.xml'}, {'damage_type': 'backtrace', 'id': 2635397469, 'ino': 1099511637390, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2641940086, 'ino': 1099511633875, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 2648555527, 'ino': 2199023259182, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 2649073217, 'ino': 1099511638983, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2649766049, 'ino': 2199023261396, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2650424741, 'ino': 1099511635125, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2650508689, 'ino': 1099511629890, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 2650779009, 'ino': 1099511634255, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 2650915494, 'ino': 2199023258822, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2651055787, 'ino': 2199023259150, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 2652615605, 'ino': 2199023259307, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 2653115826, 'ino': 2199023274272, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 2658390510, 'ino': 1099511637174, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 2665042521, 'ino': 1099511634242, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 2677811504, 'ino': 2199023263057, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2680098498, 'ino': 1099511630908, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 2681225043, 'ino': 1099511638998, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2683615013, 'ino': 1099511631400, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 2690245427, 'ino': 1099511631390, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 2693600447, 'ino': 2199023262610, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-53.xml'}, {'damage_type': 'backtrace', 'id': 2695809952, 'ino': 1099511629773, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 2711152377, 'ino': 2199023265929, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2712919190, 'ino': 1099511638941, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2717816779, 'ino': 2199023265068, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 2717825197, 'ino': 2199023258868, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2719619433, 'ino': 2199023265921, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 2719963866, 'ino': 2199023263284, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2725529523, 'ino': 1099511629839, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 2728474760, 'ino': 2199023258764, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2731902264, 'ino': 2199023265949, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2744174988, 'ino': 1099511629852, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 2745513322, 'ino': 1099511631434, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 2748172787, 'ino': 1099511637332, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2750657149, 'ino': 2199023272951, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2754459566, 'ino': 2199023265997, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2757242553, 'ino': 2199023272836, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-33.xml'}, {'damage_type': 'backtrace', 'id': 2776117209, 'ino': 2199023265185, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2788732778, 'ino': 1099511638984, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2794931228, 'ino': 2199023265989, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2795430896, 'ino': 1099511634843, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 2798912566, 'ino': 1099511637338, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2801619454, 'ino': 2199023259084, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2801810514, 'ino': 1099511633655, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 2803258232, 'ino': 2199023258910, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-49.xml'}, {'damage_type': 'backtrace', 'id': 2812669357, 'ino': 2199023265895, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2826880563, 'ino': 1099511637045, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 2828701786, 'ino': 2199023258135, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-67.xml'}, {'damage_type': 'backtrace', 'id': 2830119873, 'ino': 1099511639338, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2832547161, 'ino': 1099511636906, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 2834697667, 'ino': 2199023265981, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 2848315848, 'ino': 1099511631027, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 2849300422, 'ino': 2199023274576, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 2851095752, 'ino': 2199023258448, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2858542983, 'ino': 2199023258495, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-39.xml'}, {'damage_type': 'backtrace', 'id': 2860839089, 'ino': 2199023259639, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2864803480, 'ino': 2199023263033, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2872942492, 'ino': 1099511633881, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 2875572773, 'ino': 1099511634262, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 2878842161, 'ino': 2199023259636, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2879349640, 'ino': 2199023258455, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2880944906, 'ino': 2199023265909, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 2881299461, 'ino': 2199023261289, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2883750412, 'ino': 1099511631040, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-81.xml'}, {'damage_type': 'backtrace', 'id': 2886206850, 'ino': 2199023272830, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-35.xml'}, {'damage_type': 'backtrace', 'id': 2889141497, 'ino': 1099511631093, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2896243064, 'ino': 1099511639278, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-49.xml'}, {'damage_type': 'backtrace', 'id': 2906846931, 'ino': 1099511634862, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 2910822242, 'ino': 1099511631419, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 2912481311, 'ino': 1099511631415, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 2912993666, 'ino': 1099511634245, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 2913654039, 'ino': 2199023272789, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-49.xml'}, {'damage_type': 'backtrace', 'id': 2917038185, 'ino': 2199023272908, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2922582150, 'ino': 2199023258960, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2923313518, 'ino': 2199023259683, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2925198265, 'ino': 1099511630117, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2930072577, 'ino': 1099511631396, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 2931315787, 'ino': 1099511634866, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 2932371455, 'ino': 1099511629757, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 2933121227, 'ino': 1099511634280, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 2936282006, 'ino': 1099511634330, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 2937020225, 'ino': 1099511638963, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2945635029, 'ino': 1099511630892, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 2946010005, 'ino': 2199023272884, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2946082025, 'ino': 1099511629892, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 2946705573, 'ino': 2199023258467, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-46.xml'}, {'damage_type': 'backtrace', 'id': 2956632928, 'ino': 1099511636978, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 2964851482, 'ino': 1099511635080, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2964952727, 'ino': 1099511634839, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 2966750365, 'ino': 2199023259513, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2967191722, 'ino': 1099511630899, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 2971607188, 'ino': 1099511636871, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-20.xml'}, {'damage_type': 'backtrace', 'id': 2981536984, 'ino': 1099511632649, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-72.xml'}, {'damage_type': 'backtrace', 'id': 2983195274, 'ino': 2199023265893, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2986419565, 'ino': 2199023258435, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2987166200, 'ino': 1099511630902, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 2993446607, 'ino': 3298534885050, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-100.xml'}, {'damage_type': 'backtrace', 'id': 3003161352, 'ino': 1099511629907, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 3003451172, 'ino': 2199023265098, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 3004158660, 'ino': 2199023265191, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3006065805, 'ino': 2199023265089, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 3013106347, 'ino': 1099511639004, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3013896703, 'ino': 2199023259599, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3014519064, 'ino': 2199023258473, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3016471721, 'ino': 1099511631039, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-85.xml'}, {'damage_type': 'backtrace', 'id': 3016887994, 'ino': 2199023264997, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3018250499, 'ino': 2199023259279, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 3021305301, 'ino': 1099511631023, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 3021365005, 'ino': 2199023272828, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-36.xml'}, {'damage_type': 'backtrace', 'id': 3028140414, 'ino': 2199023272822, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3030296442, 'ino': 1099511631431, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 3032287552, 'ino': 1099511629753, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 3035556969, 'ino': 2199023265005, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3036119284, 'ino': 2199023258378, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3037608198, 'ino': 1099511636611, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 3047338424, 'ino': 1099511637422, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3048708426, 'ino': 1099511633825, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 3051066599, 'ino': 2199023265189, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3052526286, 'ino': 2199023259463, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 3055273409, 'ino': 1099511633704, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 3059322163, 'ino': 1099511629896, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 3066754093, 'ino': 1099511634812, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 3073648734, 'ino': 1099511634250, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 3076821132, 'ino': 1099511639334, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3080588083, 'ino': 2199023258373, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3081315159, 'ino': 1099511634279, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 3082277950, 'ino': 1099511635031, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3083208338, 'ino': 2199023272816, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-40.xml'}, {'damage_type': 'backtrace', 'id': 3085174536, 'ino': 1099511633782, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 3087803561, 'ino': 1099511634081, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 3090901651, 'ino': 1099511635706, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-39.xml'}, {'damage_type': 'backtrace', 'id': 3091620059, 'ino': 2199023258464, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3093346529, 'ino': 1099511633819, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 3093462991, 'ino': 2199023259485, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 3097882094, 'ino': 1099511633733, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 3099512179, 'ino': 2199023262880, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-66.xml'}, {'damage_type': 'backtrace', 'id': 3100903906, 'ino': 1099511639393, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3106395574, 'ino': 1099511633689, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 3106775328, 'ino': 1099511629847, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 3109146192, 'ino': 1099511636957, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 3113948872, 'ino': 1099511633765, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 3114607588, 'ino': 2199023259445, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 3119220334, 'ino': 1099511638947, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 3123308148, 'ino': 2199023258981, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-36.xml'}, {'damage_type': 'backtrace', 'id': 3126062832, 'ino': 1099511634959, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 3130134861, 'ino': 1099511630900, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 3136189857, 'ino': 2199023265008, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3137689767, 'ino': 1099511629786, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 3141032041, 'ino': 2199023258675, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3141254622, 'ino': 1099511631120, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 3150939709, 'ino': 2199023259367, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 3153005559, 'ino': 1099511638973, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3153455433, 'ino': 1099511636943, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 3154294180, 'ino': 1099511630894, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 3157209156, 'ino': 1099511639436, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 3159487088, 'ino': 2199023259170, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 3161407344, 'ino': 1099511637460, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3162410684, 'ino': 1099511629879, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 3165552513, 'ino': 1099511629854, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 3173210424, 'ino': 2199023278311, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 3175072849, 'ino': 1099511639394, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3178696406, 'ino': 2199023266007, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3181166370, 'ino': 1099511637296, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 3184264832, 'ino': 2199023265971, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 3186782341, 'ino': 1099511634274, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 3187343146, 'ino': 2199023259630, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 3187463558, 'ino': 1099511629910, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 3189308290, 'ino': 1099511631009, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 3190020094, 'ino': 1099511634990, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3191460167, 'ino': 1099511639344, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 3194900180, 'ino': 2199023265941, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 3203025212, 'ino': 1099511636963, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 3203885219, 'ino': 1099511639325, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3205647295, 'ino': 1099511637348, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3207821361, 'ino': 2199023263054, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 3214875415, 'ino': 1099511639006, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3215966950, 'ino': 2199023261321, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3218166891, 'ino': 1099511630898, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 3227376682, 'ino': 1099511634326, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 3228977945, 'ino': 2199023258317, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3230721180, 'ino': 1099511629872, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 3232142320, 'ino': 1099511634871, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 3233963607, 'ino': 1099511635054, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 3235415383, 'ino': 1099511629772, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 3237476105, 'ino': 2199023272949, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3237654215, 'ino': 1099511636735, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 3238979936, 'ino': 2199023265967, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 3239713308, 'ino': 2199023258545, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3241993632, 'ino': 2199023272905, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3242999985, 'ino': 2199023258488, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3252587740, 'ino': 1099511634054, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 3253031575, 'ino': 2199023258505, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3254552394, 'ino': 1099511635103, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3255829781, 'ino': 1099511635112, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3260280431, 'ino': 2199023265983, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 3264757497, 'ino': 1099511634816, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 3265510999, 'ino': 2199023265136, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3267354239, 'ino': 1099511634804, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 3276358913, 'ino': 2199023261388, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3276935907, 'ino': 2199023272881, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3278503756, 'ino': 2199023258641, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3279346731, 'ino': 2199023265877, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3284483046, 'ino': 2199023258259, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3289489743, 'ino': 1099511634720, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3293232770, 'ino': 1099511633662, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 3299334503, 'ino': 1099511636668, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 3301786444, 'ino': 1099511639367, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3306056824, 'ino': 1099511638985, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3306204058, 'ino': 1099511634969, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 3308243618, 'ino': 1099511633810, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 3309232482, 'ino': 1099511633977, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 3309491118, 'ino': 1099511630732, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 3316223024, 'ino': 2199023272760, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3318757270, 'ino': 1099511637035, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 3320123691, 'ino': 1099511639391, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3323587858, 'ino': 1099511634798, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 3330923988, 'ino': 1099511631020, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 3332562349, 'ino': 2199023258282, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-32.xml'}, {'damage_type': 'backtrace', 'id': 3338112499, 'ino': 1099511638996, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 3341001561, 'ino': 1099511638959, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 3343862705, 'ino': 1099511631423, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 3350307214, 'ino': 2199023261349, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3353713337, 'ino': 1099511629778, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 3355800496, 'ino': 1099511635013, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3357721545, 'ino': 2199023263048, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3362530455, 'ino': 1099511639295, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-34.xml'}, {'damage_type': 'backtrace', 'id': 3363219687, 'ino': 1099511639355, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3366825372, 'ino': 1099511633739, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 3374520174, 'ino': 1099511633624, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 3374971756, 'ino': 2199023258684, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3375668878, 'ino': 2199023259067, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3387173409, 'ino': 1099511639360, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3394355029, 'ino': 1099511637362, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 3397911024, 'ino': 1099511634293, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 3398872265, 'ino': 2199023272887, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3403406855, 'ino': 1099511635140, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3403738345, 'ino': 2199023266009, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3406138477, 'ino': 2199023258803, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3406628684, 'ino': 2199023259651, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 3408176818, 'ino': 2199023258191, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3410899358, 'ino': 1099511633791, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 3413495232, 'ino': 2199023265101, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3416002787, 'ino': 1099511636857, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 3420594735, 'ino': 1099511630796, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-85.xml'}, {'damage_type': 'backtrace', 'id': 3420815572, 'ino': 2199023265873, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3421368978, 'ino': 1099511635158, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3421626859, 'ino': 1099511637111, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 3421974320, 'ino': 2199023265126, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3425903872, 'ino': 2199023259036, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3431460211, 'ino': 2199023258143, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-65.xml'}, {'damage_type': 'backtrace', 'id': 3438656109, 'ino': 1099511639371, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 3439425266, 'ino': 1099511629886, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 3441308411, 'ino': 1099511636750, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 3443470125, 'ino': 1099511630982, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3443582438, 'ino': 1099511638975, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 3446148159, 'ino': 1099511638991, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3448524094, 'ino': 1099511634082, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 3452294880, 'ino': 1099511636799, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 3457346628, 'ino': 1099511638937, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3464648112, 'ino': 1099511638961, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 3473962638, 'ino': 2199023272780, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-52.xml'}, {'damage_type': 'backtrace', 'id': 3477357591, 'ino': 2199023272939, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 3481844761, 'ino': 1099511637372, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 3488735277, 'ino': 2199023263174, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 3490553196, 'ino': 2199023259053, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-19.xml'}, {'damage_type': 'backtrace', 'id': 3491595611, 'ino': 3298534887949, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 3492667970, 'ino': 1099511639000, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3493743531, 'ino': 1099511629834, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 3501716388, 'ino': 1099511633836, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 3505166996, 'ino': 1099511636649, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 3511855169, 'ino': 2199023267930, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 3516922004, 'ino': 2199023259335, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 3519585875, 'ino': 1099511629863, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 3519710099, 'ino': 1099511637014, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 3519916462, 'ino': 1099511629857, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 3526400437, 'ino': 2199023259055, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3528183686, 'ino': 2199023265080, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3531164511, 'ino': 1099511631403, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 3532741933, 'ino': 2199023259421, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 3533205926, 'ino': 1099511639382, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3534167054, 'ino': 2199023258277, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3534323135, 'ino': 1099511634055, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-49.xml'}, {'damage_type': 'backtrace', 'id': 3537604387, 'ino': 1099511639323, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3544425930, 'ino': 1099511633630, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 3544428520, 'ino': 2199023278133, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-61.xml'}, {'damage_type': 'backtrace', 'id': 3545934383, 'ino': 1099511637288, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3546446167, 'ino': 1099511631103, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 3552715131, 'ino': 1099511631019, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 3553263074, 'ino': 1099511639340, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3553584912, 'ino': 2199023258329, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3559412529, 'ino': 1099511635001, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 3559452973, 'ino': 1099511634046, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 3568583798, 'ino': 2199023261328, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3570791893, 'ino': 2199023262905, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-56.xml'}, {'damage_type': 'backtrace', 'id': 3571305299, 'ino': 1099511633807, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 3573288295, 'ino': 1099511637400, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 3574201200, 'ino': 2199023258539, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3575689107, 'ino': 1099511634849, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 3576721443, 'ino': 1099511631435, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 3579086536, 'ino': 2199023267886, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 3581829421, 'ino': 1099511633815, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 3584153348, 'ino': 1099511634103, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 3587161307, 'ino': 1099511638944, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3604106058, 'ino': 2199023259427, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 3605971492, 'ino': 1099511634820, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 3610411121, 'ino': 1099511629582, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-49.xml'}, {'damage_type': 'backtrace', 'id': 3622692219, 'ino': 2199023266003, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3627728145, 'ino': 2199023258971, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3629003741, 'ino': 2199023272929, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3629329492, 'ino': 1099511634303, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 3630790880, 'ino': 2199023259239, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 3630867809, 'ino': 1099511638956, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 3631388301, 'ino': 1099511629871, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 3632048253, 'ino': 2199023263051, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 3633588427, 'ino': 2199023261364, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3638848281, 'ino': 2199023272932, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3638864522, 'ino': 1099511629882, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 3641740629, 'ino': 2199023258443, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3643033972, 'ino': 1099511637279, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3644053757, 'ino': 1099511634305, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 3649609109, 'ino': 2199023272917, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3650005412, 'ino': 1099511639249, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-78.xml'}, {'damage_type': 'backtrace', 'id': 3653846093, 'ino': 2199023258452, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3658050147, 'ino': 1099511629876, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 3672970090, 'ino': 2199023265026, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 3674094240, 'ino': 1099511636927, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 3677345536, 'ino': 1099511637431, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3678946572, 'ino': 1099511629887, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 3679312695, 'ino': 2199023258695, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3682367273, 'ino': 2199023258552, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3685748533, 'ino': 1099511636369, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3695076006, 'ino': 1099511637104, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 3696176409, 'ino': 2199023272915, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3700747013, 'ino': 2199023258956, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-41.xml'}, {'damage_type': 'backtrace', 'id': 3713573073, 'ino': 2199023265044, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 3714830220, 'ino': 1099511633867, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 3716977556, 'ino': 1099511634239, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 3719421532, 'ino': 1099511629908, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 3724036308, 'ino': 2199023264979, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3725070736, 'ino': 2199023265899, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3734092505, 'ino': 2199023259016, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3740796730, 'ino': 2199023258503, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3745762507, 'ino': 2199023262969, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3750512616, 'ino': 1099511633694, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 3753606921, 'ino': 2199023265123, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 3767593404, 'ino': 1099511630121, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-62.xml'}, {'damage_type': 'backtrace', 'id': 3770493125, 'ino': 1099511630891, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 3774177864, 'ino': 2199023265903, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3774405438, 'ino': 2199023272771, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-55.xml'}, {'damage_type': 'backtrace', 'id': 3778785783, 'ino': 2199023265059, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 3794076473, 'ino': 1099511636829, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 3794938576, 'ino': 2199023259433, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 3812270718, 'ino': 1099511629789, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 3816417185, 'ino': 2199023258886, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3819714123, 'ino': 1099511636702, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 3828755566, 'ino': 1099511634247, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 3838468366, 'ino': 1099511630881, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 3839368151, 'ino': 2199023262885, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-64.xml'}, {'damage_type': 'backtrace', 'id': 3846999803, 'ino': 1099511629903, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 3847762745, 'ino': 1099511633668, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 3849333105, 'ino': 2199023261317, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3851779211, 'ino': 1099511639375, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 3853259139, 'ino': 2199023259136, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 3854087161, 'ino': 1099511629905, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 3863380686, 'ino': 1099511629755, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 3863446285, 'ino': 1099511629746, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 3866984269, 'ino': 2199023265187, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3867352412, 'ino': 2199023258215, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-48.xml'}, {'damage_type': 'backtrace', 'id': 3868611640, 'ino': 1099511631007, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 3869677389, 'ino': 1099511629749, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 3871375526, 'ino': 1099511639332, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3873365440, 'ino': 2199023258263, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-36.xml'}, {'damage_type': 'backtrace', 'id': 3873801220, 'ino': 1099511634951, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 3878274248, 'ino': 1099511637352, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3878853634, 'ino': 2199023261325, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3882082058, 'ino': 1099511635154, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3887738467, 'ino': 2199023259059, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3887933913, 'ino': 1099511639168, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 3888057940, 'ino': 1099511636983, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 3889251971, 'ino': 2199023265951, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3889991630, 'ino': 1099511639495, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3891731715, 'ino': 1099511634996, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 3894072773, 'ino': 2199023261345, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3894114457, 'ino': 2199023265931, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 3902632050, 'ino': 2199023265176, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3910541470, 'ino': 1099511634039, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 3915252786, 'ino': 1099511633831, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 3927418947, 'ino': 1099511633768, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 3931022208, 'ino': 2199023258934, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3943372836, 'ino': 2199023258341, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3948966563, 'ino': 1099511638986, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3950850816, 'ino': 2199023259439, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 3955583929, 'ino': 2199023258176, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3959206203, 'ino': 1099511634725, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3964555038, 'ino': 1099511629864, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 3965693272, 'ino': 2199023264973, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3967297310, 'ino': 2199023263127, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3968411765, 'ino': 1099511638976, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3972724874, 'ino': 1099511631430, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 3974252302, 'ino': 1099511634031, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 3986926719, 'ino': 1099511638939, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3987176575, 'ino': 2199023265018, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3988700537, 'ino': 1099511633996, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 3988928265, 'ino': 1099511631098, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3991397021, 'ino': 1099511636896, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 3996693824, 'ino': 2199023265917, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 4001086176, 'ino': 2199023261307, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-7.xml'}, {'damage_type': 'backtrace', 'id': 4007120864, 'ino': 1099511638949, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 4013334174, 'ino': 1099511634706, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/article-8.xml'}, {'damage_type': 'backtrace', 'id': 4016514180, 'ino': 1099511632908, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-34.xml'}, {'damage_type': 'backtrace', 'id': 4016547585, 'ino': 2199023258139, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-66.xml'}, {'damage_type': 'backtrace', 'id': 4019594613, 'ino': 1099511629782, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 4023406284, 'ino': 2199023261312, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-6.xml'}, {'damage_type': 'backtrace', 'id': 4023942787, 'ino': 1099511634318, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 4024172268, 'ino': 2199023265869, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-18.xml'}, {'damage_type': 'backtrace', 'id': 4032566192, 'ino': 1099511639246, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-244/article-81.xml'}, {'damage_type': 'backtrace', 'id': 4046832444, 'ino': 1099511631437, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 4047168575, 'ino': 2199023265881, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-12.xml'}, {'damage_type': 'backtrace', 'id': 4047416297, 'ino': 1099511634899, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 4051580180, 'ino': 2199023265167, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 4056194723, 'ino': 1099511635046, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 4056203960, 'ino': 1099511637307, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 4057635371, 'ino': 2199023265925, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 4058454382, 'ino': 2199023259590, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 4060356177, 'ino': 1099511639357, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 4061526641, 'ino': 2199023259324, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 4064598006, 'ino': 1099511634309, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 4069587206, 'ino': 1099511633841, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 4074963652, 'ino': 1099511636993, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 4078414544, 'ino': 1099511638946, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/article-1.xml'}, {'damage_type': 'backtrace', 'id': 4080839385, 'ino': 2199023259469, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 4090280556, 'ino': 1099511639005, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 4090442667, 'ino': 2199023272752, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-60.xml'}, {'damage_type': 'backtrace', 'id': 4094696016, 'ino': 1099511629891, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 4094736771, 'ino': 1099511630933, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 4097395113, 'ino': 2199023259648, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 4100048590, 'ino': 1099511638993, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-234/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 4101155184, 'ino': 1099511635121, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 4103535169, 'ino': 2199023258392, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-12.xml'}, {'damage_type': 'backtrace', 'id': 4105979870, 'ino': 1099511634070, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 4106925762, 'ino': 2199023258915, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/article-48.xml'}, {'damage_type': 'backtrace', 'id': 4110855201, 'ino': 1099511629557, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-96.jpg'}, {'damage_type': 'backtrace', 'id': 4115995269, 'ino': 1099511629909, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 4117171321, 'ino': 2199023261360, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 4127288098, 'ino': 2199023258521, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 4128584600, 'ino': 2199023265875, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/article-15.xml'}, {'damage_type': 'backtrace', 'id': 4133418433, 'ino': 2199023272792, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-48.xml'}, {'damage_type': 'backtrace', 'id': 4142673688, 'ino': 2199023272795, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-47.xml'}, {'damage_type': 'backtrace', 'id': 4152154180, 'ino': 1099511630882, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 4153265212, 'ino': 2199023265969, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 4160814116, 'ino': 1099511629805, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 4162193033, 'ino': 2199023265020, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 4162744076, 'ino': 2199023258292, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-30.xml'}, {'damage_type': 'backtrace', 'id': 4163843480, 'ino': 1099511639363, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 4168982451, 'ino': 1099511635108, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 4169164274, 'ino': 2199023258543, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-26.xml'}, {'damage_type': 'backtrace', 'id': 4172370911, 'ino': 1099511633893, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 4178474496, 'ino': 2199023265065, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 4179544092, 'ino': 1099511634063, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 4180007428, 'ino': 2199023258402, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-10.xml'}, {'damage_type': 'backtrace', 'id': 4183977790, 'ino': 1099511633745, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 4188384420, 'ino': 1099511637328, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 4188744862, 'ino': 1099511629808, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 4189998385, 'ino': 2199023264987, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/article-19.xml'}, {'damage_type': 'backtrace', 'id': 4190517638, 'ino': 1099511633813, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 4192246579, 'ino': 1099511634320, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 4192522591, 'ino': 2199023259551, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 4196310662, 'ino': 1099511629873, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 4201663718, 'ino': 1099511634271, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 4202309272, 'ino': 2199023262920, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/article-50.xml'}, {'damage_type': 'backtrace', 'id': 4205451586, 'ino': 1099511633998, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 4207654162, 'ino': 2199023272587, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-48/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 4210437097, 'ino': 2199023265927, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-70/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 4215086247, 'ino': 2199023258830, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 4215089007, 'ino': 1099511630886, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 4218513589, 'ino': 2199023259504, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 4219479265, 'ino': 2199023258219, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/article-47.xml'}, {'damage_type': 'backtrace', 'id': 4219637153, 'ino': 1099511639379, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 4221860518, 'ino': 1099511633885, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-63/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 4228952004, 'ino': 2199023262592, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-46/article-58.xml'}, {'damage_type': 'backtrace', 'id': 4245713672, 'ino': 2199023259293, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 4246916498, 'ino': 2199023261368, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 4247104696, 'ino': 1099511639328, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-5.xml'}, {'damage_type': 'backtrace', 'id': 4247239402, 'ino': 1099511629900, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 4253704564, 'ino': 1099511630905, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 4256145077, 'ino': 1099511639396, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 4263383292, 'ino': 2199023259358, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-22/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 4264685204, 'ino': 1099511637411, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-211/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 4265962751, 'ino': 1099511639400, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 4267844668, 'ino': 1099511639387, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 4270453021, 'ino': 2199023272920, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-8.xml'}, {'damage_type': 'backtrace', 'id': 4271277156, 'ino': 1099511634908, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-182/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 4273305761, 'ino': 1099511639330, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-246/article-4.xml'}, {'damage_type': 'backtrace', 'id': 4275783209, 'ino': 2199023272927, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-128/article-5.xml'}, {'damage_type': 'backtrace', 'id': 4275897708, 'ino': 1099511630909, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-16/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 4287197458, 'ino': 2199023263277, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-36/article-75.xml'}] 2024-03-27T07:28:58.070 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 2581179, 'ino': 2199023259371, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-44.xml'}, {'damage_type': 'backtrace', 'id': 5960736, 'ino': 1099511633984, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 6883223, 'ino': 1099511633725, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 7466658, 'ino': 2199023260026, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 10446132, 'ino': 2199023265966, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 11072526, 'ino': 1099511633962, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 13639018, 'ino': 2199023259660, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 14118378, 'ino': 2199023263100, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-58.xml'}, {'damage_type': 'backtrace', 'id': 14214924, 'ino': 2199023264070, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-100.xml'}, {'damage_type': 'backtrace', 'id': 14606297, 'ino': 1099511630180, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-11.xml'}, {'damage_type': 'backtrace', 'id': 17918484, 'ino': 1099511630232, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 21445240, 'ino': 2199023267410, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 23149252, 'ino': 1099511636053, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 30368738, 'ino': 1099511634379, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 32175633, 'ino': 2199023259376, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-43.xml'}, {'damage_type': 'backtrace', 'id': 36170590, 'ino': 2199023267552, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 37995467, 'ino': 1099511634090, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 39060465, 'ino': 2199023263058, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 43828544, 'ino': 1099511629925, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 45133368, 'ino': 2199023267747, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 47523533, 'ino': 1099511631409, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 49777070, 'ino': 2199023267135, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-35.xml'}, {'damage_type': 'backtrace', 'id': 51291479, 'ino': 2199023263052, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 52536823, 'ino': 2199023258424, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 52992313, 'ino': 2199023259646, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 55296637, 'ino': 1099511630127, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-37.xml'}, {'damage_type': 'backtrace', 'id': 56066957, 'ino': 1099511635975, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 58187362, 'ino': 2199023263044, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 58762609, 'ino': 1099511634392, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-88.xml'}, {'damage_type': 'backtrace', 'id': 60298571, 'ino': 1099511630831, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 61957045, 'ino': 2199023259607, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 62556358, 'ino': 2199023263264, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-2.xml'}, {'damage_type': 'backtrace', 'id': 63631199, 'ino': 2199023259423, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-35.xml'}, {'damage_type': 'backtrace', 'id': 66140455, 'ino': 1099511634401, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 66471695, 'ino': 1099511630125, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-39.xml'}, {'damage_type': 'backtrace', 'id': 69446029, 'ino': 2199023263397, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-66.xml'}, {'damage_type': 'backtrace', 'id': 70555587, 'ino': 1099511633677, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 74922783, 'ino': 1099511630352, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 76772073, 'ino': 2199023267151, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-31.xml'}, {'damage_type': 'backtrace', 'id': 76942593, 'ino': 2199023267744, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 83252823, 'ino': 1099511631231, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 87061080, 'ino': 1099511634067, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 88358900, 'ino': 2199023267147, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-32.xml'}, {'damage_type': 'backtrace', 'id': 89126414, 'ino': 2199023262010, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 89203700, 'ino': 2199023263313, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-93.xml'}, {'damage_type': 'backtrace', 'id': 89271642, 'ino': 1099511634427, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 94299936, 'ino': 2199023267701, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-2.xml'}, {'damage_type': 'backtrace', 'id': 99430666, 'ino': 2199023265952, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-5.xml'}, {'damage_type': 'backtrace', 'id': 101177436, 'ino': 1099511633469, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 104908372, 'ino': 1099511631440, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 112783178, 'ino': 2199023267490, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 116639531, 'ino': 1099511633511, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 119433649, 'ino': 1099511631033, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 119726236, 'ino': 2199023263258, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-4.xml'}, {'damage_type': 'backtrace', 'id': 120201404, 'ino': 2199023264099, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-94.xml'}, {'damage_type': 'backtrace', 'id': 121291247, 'ino': 1099511631052, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-33.xml'}, {'damage_type': 'backtrace', 'id': 121446066, 'ino': 2199023262836, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-6.xml'}, {'damage_type': 'backtrace', 'id': 123261384, 'ino': 1099511630322, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 127029914, 'ino': 2199023259403, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-38.xml'}, {'damage_type': 'backtrace', 'id': 128931813, 'ino': 1099511634693, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-84.xml'}, {'damage_type': 'backtrace', 'id': 131991085, 'ino': 1099511634060, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 132489310, 'ino': 1099511634019, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 142658508, 'ino': 1099511630100, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-50.xml'}, {'damage_type': 'backtrace', 'id': 144902060, 'ino': 2199023263015, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 147207771, 'ino': 2199023263071, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 147992844, 'ino': 2199023261985, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 149830499, 'ino': 1099511634337, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 155835028, 'ino': 1099511631732, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 157705563, 'ino': 1099511634633, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-90.xml'}, {'damage_type': 'backtrace', 'id': 158771954, 'ino': 2199023267182, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-23.xml'}, {'damage_type': 'backtrace', 'id': 158878253, 'ino': 2199023257464, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-28.xml'}, {'damage_type': 'backtrace', 'id': 163488956, 'ino': 1099511634359, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 167047724, 'ino': 2199023267704, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-1.xml'}, {'damage_type': 'backtrace', 'id': 171231807, 'ino': 2199023267339, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-90.jpg'}, {'damage_type': 'backtrace', 'id': 176820013, 'ino': 2199023263055, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 190246417, 'ino': 2199023266075, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 190757515, 'ino': 2199023267274, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-16.xml'}, {'damage_type': 'backtrace', 'id': 191281946, 'ino': 2199023267729, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 192938138, 'ino': 2199023267456, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 194977344, 'ino': 2199023267609, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-32.xml'}, {'damage_type': 'backtrace', 'id': 202053483, 'ino': 2199023265942, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-10.xml'}, {'damage_type': 'backtrace', 'id': 205216365, 'ino': 2199023267276, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 207629221, 'ino': 1099511633938, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 221594828, 'ino': 1099511631224, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-94.xml'}, {'damage_type': 'backtrace', 'id': 221866805, 'ino': 1099511634013, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 222477616, 'ino': 1099511634049, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 226720536, 'ino': 2199023267566, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 227871290, 'ino': 2199023261189, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-48.xml'}, {'damage_type': 'backtrace', 'id': 228694023, 'ino': 2199023267448, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 231498145, 'ino': 1099511630149, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-28.xml'}, {'damage_type': 'backtrace', 'id': 231750383, 'ino': 2199023262881, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 233564782, 'ino': 2199023267853, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 236878205, 'ino': 2199023259308, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-59.xml'}, {'damage_type': 'backtrace', 'id': 238154396, 'ino': 2199023263394, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-67.xml'}, {'damage_type': 'backtrace', 'id': 243047758, 'ino': 2199023262809, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-17.xml'}, {'damage_type': 'backtrace', 'id': 243884495, 'ino': 2199023261446, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 244092475, 'ino': 2199023263933, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-55.xml'}, {'damage_type': 'backtrace', 'id': 244886363, 'ino': 2199023267463, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 245212108, 'ino': 1099511634383, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 251869776, 'ino': 1099511634105, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 254650170, 'ino': 2199023257561, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-17.xml'}, {'damage_type': 'backtrace', 'id': 259127520, 'ino': 1099511634018, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 260259845, 'ino': 2199023267549, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 260734156, 'ino': 2199023265940, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-11.xml'}, {'damage_type': 'backtrace', 'id': 262818674, 'ino': 1099511631227, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 263603712, 'ino': 2199023263012, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-1.xml'}, {'damage_type': 'backtrace', 'id': 265403928, 'ino': 2199023259497, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-22.xml'}, {'damage_type': 'backtrace', 'id': 265735203, 'ino': 2199023264255, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 266485973, 'ino': 1099511634645, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-86.xml'}, {'damage_type': 'backtrace', 'id': 269177654, 'ino': 1099511630211, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 271343112, 'ino': 2199023263951, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-51.xml'}, {'damage_type': 'backtrace', 'id': 272505376, 'ino': 2199023263328, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-88.xml'}, {'damage_type': 'backtrace', 'id': 274240479, 'ino': 1099511633969, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 277726945, 'ino': 1099511633936, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 280995822, 'ino': 2199023263346, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-82.xml'}, {'damage_type': 'backtrace', 'id': 281239518, 'ino': 1099511634769, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 283210041, 'ino': 1099511630340, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 284311634, 'ino': 2199023267470, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 284757603, 'ino': 2199023266038, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 285871132, 'ino': 2199023262990, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 287631243, 'ino': 1099511633523, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 289315281, 'ino': 2199023262017, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 289953077, 'ino': 1099511634276, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 290720773, 'ino': 2199023259986, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 297573646, 'ino': 2199023259643, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 298895800, 'ino': 1099511634390, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-90.xml'}, {'damage_type': 'backtrace', 'id': 299735923, 'ino': 1099511630354, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 299847761, 'ino': 1099511634099, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 303081811, 'ino': 1099511630319, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 304447178, 'ino': 2199023267531, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 306295153, 'ino': 1099511634364, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 307063160, 'ino': 2199023263064, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 307773486, 'ino': 1099511634526, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 312539304, 'ino': 2199023263018, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 314257369, 'ino': 1099511634378, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 318254430, 'ino': 2199023259757, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 318407441, 'ino': 1099511633730, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-62.xml'}, {'damage_type': 'backtrace', 'id': 319323843, 'ino': 1099511630811, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 319494926, 'ino': 1099511631745, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 321494117, 'ino': 2199023259796, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 321590280, 'ino': 2199023259344, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-50.xml'}, {'damage_type': 'backtrace', 'id': 323764221, 'ino': 2199023267290, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-12.xml'}, {'damage_type': 'backtrace', 'id': 326433680, 'ino': 2199023259397, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-95.xml'}, {'damage_type': 'backtrace', 'id': 327816536, 'ino': 1099511634413, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 328885993, 'ino': 1099511630326, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 332992866, 'ino': 2199023263199, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-21.xml'}, {'damage_type': 'backtrace', 'id': 336111467, 'ino': 1099511634391, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 336869927, 'ino': 2199023257241, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-52.xml'}, {'damage_type': 'backtrace', 'id': 340419577, 'ino': 1099511634141, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 340846954, 'ino': 2199023259578, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-5.xml'}, {'damage_type': 'backtrace', 'id': 343193734, 'ino': 1099511633453, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 347402927, 'ino': 2199023267370, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 349042962, 'ino': 2199023257687, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 354860953, 'ino': 2199023262604, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 354884883, 'ino': 2199023263349, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-81.xml'}, {'damage_type': 'backtrace', 'id': 356604149, 'ino': 2199023267166, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-27.xml'}, {'damage_type': 'backtrace', 'id': 360794164, 'ino': 1099511631853, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 361597213, 'ino': 1099511630312, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 364332397, 'ino': 2199023262821, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-12.xml'}, {'damage_type': 'backtrace', 'id': 364417465, 'ino': 2199023262874, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 367989345, 'ino': 1099511634234, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 369422474, 'ino': 2199023257915, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 373969127, 'ino': 2199023261871, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-91.xml'}, {'damage_type': 'backtrace', 'id': 376376058, 'ino': 2199023262851, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 379896170, 'ino': 2199023263352, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-80.xml'}, {'damage_type': 'backtrace', 'id': 380842769, 'ino': 2199023267460, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 388841996, 'ino': 2199023258706, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 389606645, 'ino': 2199023263002, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 392470006, 'ino': 1099511634147, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-17.xml'}, {'damage_type': 'backtrace', 'id': 395323059, 'ino': 2199023265960, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-1.xml'}, {'damage_type': 'backtrace', 'id': 402436917, 'ino': 2199023264304, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 410777601, 'ino': 2199023267643, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-20.xml'}, {'damage_type': 'backtrace', 'id': 412102631, 'ino': 1099511634384, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 412261084, 'ino': 1099511633940, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-85.xml'}, {'damage_type': 'backtrace', 'id': 413673067, 'ino': 2199023263170, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-30.xml'}, {'damage_type': 'backtrace', 'id': 414298418, 'ino': 2199023267502, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 422075658, 'ino': 2199023267641, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 423181954, 'ino': 2199023259328, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-54.xml'}, {'damage_type': 'backtrace', 'id': 423385980, 'ino': 2199023267612, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-31.xml'}, {'damage_type': 'backtrace', 'id': 423509821, 'ino': 2199023261221, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-39.xml'}, {'damage_type': 'backtrace', 'id': 423908550, 'ino': 2199023264138, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-9.xml'}, {'damage_type': 'backtrace', 'id': 424582679, 'ino': 2199023259398, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-39.xml'}, {'damage_type': 'backtrace', 'id': 424765002, 'ino': 1099511634354, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 425493546, 'ino': 2199023264127, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-11.xml'}, {'damage_type': 'backtrace', 'id': 431325378, 'ino': 1099511636099, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 432364297, 'ino': 2199023267224, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-11.xml'}, {'damage_type': 'backtrace', 'id': 432863125, 'ino': 1099511634366, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 435797282, 'ino': 2199023263441, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-52.xml'}, {'damage_type': 'backtrace', 'id': 440826561, 'ino': 2199023263130, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-46.xml'}, {'damage_type': 'backtrace', 'id': 440946009, 'ino': 1099511634434, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 447570411, 'ino': 2199023267723, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 451239205, 'ino': 1099511634362, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 451896321, 'ino': 1099511630124, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-40.xml'}, {'damage_type': 'backtrace', 'id': 453009978, 'ino': 2199023267210, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-15.xml'}, {'damage_type': 'backtrace', 'id': 456009049, 'ino': 2199023262861, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 459504368, 'ino': 2199023264478, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 459807042, 'ino': 2199023263838, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-74.xml'}, {'damage_type': 'backtrace', 'id': 459828262, 'ino': 2199023267266, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-18.xml'}, {'damage_type': 'backtrace', 'id': 462913481, 'ino': 1099511636072, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 464447586, 'ino': 1099511634369, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-93.jpg'}, {'damage_type': 'backtrace', 'id': 472657614, 'ino': 1099511634225, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 477926100, 'ino': 1099511633964, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 483317144, 'ino': 2199023267765, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 485598095, 'ino': 1099511634386, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 487022670, 'ino': 2199023274645, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 488623105, 'ino': 2199023262948, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 491148637, 'ino': 1099511634374, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 493346505, 'ino': 2199023264174, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-3.xml'}, {'damage_type': 'backtrace', 'id': 497593274, 'ino': 1099511630286, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 498949553, 'ino': 1099511634306, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 505629194, 'ino': 1099511634343, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 513988628, 'ino': 1099511634106, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 514610423, 'ino': 2199023265958, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-2.xml'}, {'damage_type': 'backtrace', 'id': 514981727, 'ino': 2199023259511, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-19.xml'}, {'damage_type': 'backtrace', 'id': 516403393, 'ino': 2199023257209, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-63.xml'}, {'damage_type': 'backtrace', 'id': 518496947, 'ino': 1099511634356, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 519308449, 'ino': 2199023267292, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 519991792, 'ino': 2199023267288, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 525844346, 'ino': 2199023263025, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 527660167, 'ino': 1099511631901, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 528783960, 'ino': 1099511630785, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 530840565, 'ino': 2199023259361, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-46.xml'}, {'damage_type': 'backtrace', 'id': 533575235, 'ino': 2199023259515, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-18.xml'}, {'damage_type': 'backtrace', 'id': 540895569, 'ino': 2199023262600, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 545663309, 'ino': 2199023258374, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-9.xml'}, {'damage_type': 'backtrace', 'id': 551437172, 'ino': 2199023261246, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-32.xml'}, {'damage_type': 'backtrace', 'id': 552768615, 'ino': 2199023258368, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-10.xml'}, {'damage_type': 'backtrace', 'id': 552784867, 'ino': 2199023259506, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-20.xml'}, {'damage_type': 'backtrace', 'id': 553037509, 'ino': 1099511633951, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 554621074, 'ino': 2199023266107, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 556222903, 'ino': 2199023266073, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 556662457, 'ino': 1099511634073, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 557533785, 'ino': 2199023267859, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 557705219, 'ino': 1099511633915, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-74.xml'}, {'damage_type': 'backtrace', 'id': 559964707, 'ino': 2199023257229, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-57.xml'}, {'damage_type': 'backtrace', 'id': 561940705, 'ino': 1099511633497, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 567151415, 'ino': 2199023258384, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-7.xml'}, {'damage_type': 'backtrace', 'id': 567407787, 'ino': 2199023261280, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-23.xml'}, {'damage_type': 'backtrace', 'id': 567974935, 'ino': 3298534884755, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-66.xml'}, {'damage_type': 'backtrace', 'id': 569073416, 'ino': 1099511630316, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 574898502, 'ino': 2199023267300, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 578110421, 'ino': 2199023261347, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-11.xml'}, {'damage_type': 'backtrace', 'id': 578667978, 'ino': 2199023267418, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 580457093, 'ino': 2199023261382, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-2.xml'}, {'damage_type': 'backtrace', 'id': 582014713, 'ino': 2199023267620, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-28.xml'}, {'damage_type': 'backtrace', 'id': 582576947, 'ino': 2199023263118, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-51.xml'}, {'damage_type': 'backtrace', 'id': 585353716, 'ino': 2199023266048, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 587023670, 'ino': 1099511634368, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 588027265, 'ino': 2199023257692, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 596120564, 'ino': 2199023264264, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 597263934, 'ino': 2199023262879, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 600634942, 'ino': 2199023267306, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-8.xml'}, {'damage_type': 'backtrace', 'id': 602972537, 'ino': 2199023264275, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 603373928, 'ino': 2199023267687, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-6.xml'}, {'damage_type': 'backtrace', 'id': 603942188, 'ino': 2199023263155, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-36.xml'}, {'damage_type': 'backtrace', 'id': 604891281, 'ino': 1099511633945, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 605158751, 'ino': 2199023267344, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 608462304, 'ino': 2199023264423, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 610047100, 'ino': 2199023267589, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 614283625, 'ino': 2199023258537, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-28.xml'}, {'damage_type': 'backtrace', 'id': 617126589, 'ino': 1099511630325, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 618150396, 'ino': 1099511634382, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 618930676, 'ino': 2199023259664, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 619859053, 'ino': 2199023258453, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 620276020, 'ino': 1099511630969, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-11.xml'}, {'damage_type': 'backtrace', 'id': 623522366, 'ino': 1099511633711, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-3.xml'}, {'damage_type': 'backtrace', 'id': 623905926, 'ino': 2199023267328, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-2.xml'}, {'damage_type': 'backtrace', 'id': 631203630, 'ino': 2199023266077, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 631576980, 'ino': 2199023264005, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-38.xml'}, {'damage_type': 'backtrace', 'id': 632229106, 'ino': 2199023267527, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 634269360, 'ino': 2199023264456, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 635126032, 'ino': 1099511633941, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-84.xml'}, {'damage_type': 'backtrace', 'id': 636550499, 'ino': 2199023267162, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-28.xml'}, {'damage_type': 'backtrace', 'id': 637199386, 'ino': 2199023258563, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-19.xml'}, {'damage_type': 'backtrace', 'id': 637626252, 'ino': 2199023266058, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 638889729, 'ino': 2199023263415, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-60.xml'}, {'damage_type': 'backtrace', 'id': 641375063, 'ino': 2199023264000, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-39.xml'}, {'damage_type': 'backtrace', 'id': 647174750, 'ino': 1099511634125, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 648535374, 'ino': 1099511633431, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 649577161, 'ino': 1099511634687, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-85.xml'}, {'damage_type': 'backtrace', 'id': 652535753, 'ino': 2199023258061, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 654757970, 'ino': 2199023259705, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 655815095, 'ino': 2199023267103, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-44.xml'}, {'damage_type': 'backtrace', 'id': 657726890, 'ino': 1099511633947, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 669688632, 'ino': 2199023265976, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 676397806, 'ino': 1099511634011, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 676704025, 'ino': 1099511634292, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 677001326, 'ino': 2199023257371, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-36.xml'}, {'damage_type': 'backtrace', 'id': 685035266, 'ino': 2199023263954, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-50.xml'}, {'damage_type': 'backtrace', 'id': 685715613, 'ino': 2199023261288, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-21.xml'}, {'damage_type': 'backtrace', 'id': 686245306, 'ino': 1099511631433, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 687128725, 'ino': 1099511630753, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 688940717, 'ino': 2199023264326, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 693510157, 'ino': 2199023258456, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 696719705, 'ino': 2199023258834, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 700582153, 'ino': 2199023259332, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-53.xml'}, {'damage_type': 'backtrace', 'id': 710280335, 'ino': 2199023258388, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-6.xml'}, {'damage_type': 'backtrace', 'id': 711132206, 'ino': 2199023265954, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-4.xml'}, {'damage_type': 'backtrace', 'id': 711664344, 'ino': 2199023267052, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-61.xml'}, {'damage_type': 'backtrace', 'id': 717042915, 'ino': 2199023267586, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 718090252, 'ino': 1099511634341, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 718352996, 'ino': 1099511630991, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-83.xml'}, {'damage_type': 'backtrace', 'id': 721724436, 'ino': 1099511634266, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 725902253, 'ino': 2199023267405, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 726828505, 'ino': 1099511631647, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-1.xml'}, {'damage_type': 'backtrace', 'id': 728309033, 'ino': 1099511633943, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 729312832, 'ino': 2199023261186, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-49.xml'}, {'damage_type': 'backtrace', 'id': 730963244, 'ino': 2199023264032, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-31.xml'}, {'damage_type': 'backtrace', 'id': 730985427, 'ino': 1099511636183, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 731810387, 'ino': 2199023263241, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-9.xml'}, {'damage_type': 'backtrace', 'id': 734693371, 'ino': 2199023259349, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-49.xml'}, {'damage_type': 'backtrace', 'id': 736243835, 'ino': 1099511634281, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 738331584, 'ino': 2199023257968, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 740029924, 'ino': 1099511634120, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 742805303, 'ino': 2199023264028, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-32.xml'}, {'damage_type': 'backtrace', 'id': 745746792, 'ino': 1099511631253, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 745748179, 'ino': 1099511630110, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-46.xml'}, {'damage_type': 'backtrace', 'id': 747297004, 'ino': 2199023257826, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 747415602, 'ino': 1099511634466, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 747422981, 'ino': 2199023265956, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-3.xml'}, {'damage_type': 'backtrace', 'id': 747821075, 'ino': 2199023257844, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 748394068, 'ino': 1099511630999, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 748823654, 'ino': 1099511630188, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-7.xml'}, {'damage_type': 'backtrace', 'id': 755415577, 'ino': 2199023266109, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 758422056, 'ino': 2199023267270, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-17.xml'}, {'damage_type': 'backtrace', 'id': 760193445, 'ino': 1099511634393, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 760952233, 'ino': 2199023266089, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 761734864, 'ino': 1099511634095, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 762490445, 'ino': 2199023267627, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-25.xml'}, {'damage_type': 'backtrace', 'id': 763031572, 'ino': 1099511633507, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 767697245, 'ino': 1099511631574, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 768693386, 'ino': 1099511634778, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 768955177, 'ino': 1099511634415, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 780029928, 'ino': 1099511634069, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 781867322, 'ino': 2199023263020, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 782519704, 'ino': 2199023261210, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-42.xml'}, {'damage_type': 'backtrace', 'id': 783999463, 'ino': 2199023264434, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 787466201, 'ino': 1099511634078, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 787531371, 'ino': 1099511633528, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 796095522, 'ino': 1099511634214, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 803659380, 'ino': 1099511634529, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-94.xml'}, {'damage_type': 'backtrace', 'id': 804148292, 'ino': 1099511636173, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 804354197, 'ino': 2199023266040, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 813264856, 'ino': 2199023267043, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-64.xml'}, {'damage_type': 'backtrace', 'id': 814867103, 'ino': 2199023259553, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-10.xml'}, {'damage_type': 'backtrace', 'id': 816916852, 'ino': 1099511630175, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-13.xml'}, {'damage_type': 'backtrace', 'id': 817021029, 'ino': 2199023264016, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-35.xml'}, {'damage_type': 'backtrace', 'id': 818523047, 'ino': 2199023262859, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 818728449, 'ino': 1099511634218, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 818849822, 'ino': 1099511631151, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 821381543, 'ino': 1099511631738, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 824296164, 'ino': 1099511634414, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 825050287, 'ino': 2199023259670, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-84.xml'}, {'damage_type': 'backtrace', 'id': 826982088, 'ino': 2199023267681, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-8.xml'}, {'damage_type': 'backtrace', 'id': 828395705, 'ino': 2199023259617, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 831916316, 'ino': 1099511633949, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 833453625, 'ino': 2199023264067, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-23.xml'}, {'damage_type': 'backtrace', 'id': 833833838, 'ino': 1099511633939, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-86.xml'}, {'damage_type': 'backtrace', 'id': 839441169, 'ino': 2199023263300, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 847857497, 'ino': 2199023267522, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 849988947, 'ino': 1099511634632, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 854020984, 'ino': 2199023263206, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-19.xml'}, {'damage_type': 'backtrace', 'id': 854754590, 'ino': 1099511633437, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 857917409, 'ino': 2199023267482, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 859734975, 'ino': 1099511634532, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 860690251, 'ino': 2199023264095, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-95.xml'}, {'damage_type': 'backtrace', 'id': 862145662, 'ino': 2199023257708, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 862825402, 'ino': 2199023266085, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 865397590, 'ino': 2199023261548, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 871797115, 'ino': 2199023257638, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-7.xml'}, {'damage_type': 'backtrace', 'id': 872635944, 'ino': 2199023263286, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 877507315, 'ino': 1099511631717, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 880474775, 'ino': 1099511634787, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 882223025, 'ino': 1099511634878, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 884150863, 'ino': 1099511634109, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 886367193, 'ino': 2199023257770, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 886419817, 'ino': 1099511630823, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 886564276, 'ino': 2199023261296, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-19.xml'}, {'damage_type': 'backtrace', 'id': 890000910, 'ino': 2199023267492, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 892174993, 'ino': 1099511634370, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 894677584, 'ino': 2199023267813, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 895599592, 'ino': 2199023264080, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-98.xml'}, {'damage_type': 'backtrace', 'id': 896408635, 'ino': 1099511631235, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-85.xml'}, {'damage_type': 'backtrace', 'id': 899885780, 'ino': 2199023262906, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 902238638, 'ino': 2199023261583, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 904366825, 'ino': 1099511634431, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 906703312, 'ino': 2199023264059, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-25.xml'}, {'damage_type': 'backtrace', 'id': 907006235, 'ino': 1099511634097, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 911348531, 'ino': 2199023267412, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 916557552, 'ino': 2199023263053, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 919870641, 'ino': 2199023257628, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-9.xml'}, {'damage_type': 'backtrace', 'id': 921547211, 'ino': 1099511634395, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-85.xml'}, {'damage_type': 'backtrace', 'id': 922196817, 'ino': 1099511630789, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 923507827, 'ino': 2199023267435, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 925467413, 'ino': 2199023267558, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 927047207, 'ino': 2199023259735, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 927345509, 'ino': 2199023262953, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 928910296, 'ino': 2199023258403, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-3.xml'}, {'damage_type': 'backtrace', 'id': 930155225, 'ino': 1099511634256, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 931059392, 'ino': 1099511634329, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 939586062, 'ino': 1099511630992, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 939613972, 'ino': 2199023258354, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-13.xml'}, {'damage_type': 'backtrace', 'id': 940849539, 'ino': 2199023267067, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-56.xml'}, {'damage_type': 'backtrace', 'id': 941408484, 'ino': 2199023262864, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 944814351, 'ino': 2199023263172, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-29.xml'}, {'damage_type': 'backtrace', 'id': 946565112, 'ino': 2199023263358, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-78.xml'}, {'damage_type': 'backtrace', 'id': 947594641, 'ino': 1099511630721, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 949561298, 'ino': 2199023263125, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-48.xml'}, {'damage_type': 'backtrace', 'id': 951023882, 'ino': 2199023267484, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 951069301, 'ino': 2199023267478, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 951509618, 'ino': 2199023264009, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-37.xml'}, {'damage_type': 'backtrace', 'id': 953012414, 'ino': 2199023267667, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-13.xml'}, {'damage_type': 'backtrace', 'id': 953357486, 'ino': 2199023259883, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 957238550, 'ino': 2199023265998, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 958545124, 'ino': 2199023267789, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 963317683, 'ino': 1099511633963, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 972110751, 'ino': 1099511634428, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 976728592, 'ino': 1099511634012, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 980635171, 'ino': 2199023263103, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-57.xml'}, {'damage_type': 'backtrace', 'id': 981640111, 'ino': 2199023266067, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 984594044, 'ino': 1099511635984, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 984752105, 'ino': 2199023267372, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 985042237, 'ino': 2199023264370, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 985819405, 'ino': 2199023267196, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-19.xml'}, {'damage_type': 'backtrace', 'id': 986975001, 'ino': 1099511634005, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 987064798, 'ino': 2199023267251, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-3.xml'}, {'damage_type': 'backtrace', 'id': 989082323, 'ino': 2199023259534, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-14.xml'}, {'damage_type': 'backtrace', 'id': 989383441, 'ino': 2199023263026, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 998346887, 'ino': 2199023261590, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 999138041, 'ino': 1099511630143, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-31.xml'}, {'damage_type': 'backtrace', 'id': 1006754288, 'ino': 2199023267401, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 1008271818, 'ino': 1099511633036, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-25.xml'}, {'damage_type': 'backtrace', 'id': 1010530493, 'ino': 1099511630356, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1012869386, 'ino': 1099511630162, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1013624958, 'ino': 2199023261520, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1014245444, 'ino': 2199023261216, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1018429737, 'ino': 1099511634086, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 1030072059, 'ino': 1099511634116, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 1030872656, 'ino': 2199023263439, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-32.xml'}, {'damage_type': 'backtrace', 'id': 1037329597, 'ino': 1099511634014, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 1039390612, 'ino': 1099511634351, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 1044851865, 'ino': 2199023257813, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1045710874, 'ino': 1099511633948, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 1048210844, 'ino': 1099511634312, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 1051569655, 'ino': 1099511634403, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-80.xml'}, {'damage_type': 'backtrace', 'id': 1053156918, 'ino': 1099511630313, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 1055874772, 'ino': 1099511633537, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 1057237207, 'ino': 2199023261573, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1060849531, 'ino': 2199023267389, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 1060948141, 'ino': 2199023264044, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-28.xml'}, {'damage_type': 'backtrace', 'id': 1061975150, 'ino': 1099511634508, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 1062132259, 'ino': 2199023262919, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1064559480, 'ino': 2199023267582, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-41.xml'}, {'damage_type': 'backtrace', 'id': 1072968571, 'ino': 2199023263375, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-73.xml'}, {'damage_type': 'backtrace', 'id': 1075202419, 'ino': 2199023263418, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-59.xml'}, {'damage_type': 'backtrace', 'id': 1081410950, 'ino': 2199023261284, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1084268297, 'ino': 2199023267597, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-36.xml'}, {'damage_type': 'backtrace', 'id': 1088191585, 'ino': 2199023266046, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 1088801136, 'ino': 1099511634350, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 1088891108, 'ino': 1099511633989, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 1090024477, 'ino': 2199023263203, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-20.xml'}, {'damage_type': 'backtrace', 'id': 1092884271, 'ino': 1099511634334, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 1092908129, 'ino': 2199023267316, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 1106139760, 'ino': 2199023259713, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 1110587415, 'ino': 1099511634058, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 1111021064, 'ino': 1099511630168, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1111219074, 'ino': 1099511634110, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 1115056454, 'ino': 1099511634048, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 1116117588, 'ino': 2199023267244, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1118291018, 'ino': 2199023258444, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1118980096, 'ino': 1099511631065, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-26.xml'}, {'damage_type': 'backtrace', 'id': 1121099517, 'ino': 1099511634022, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 1124689469, 'ino': 1099511630744, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-35.xml'}, {'damage_type': 'backtrace', 'id': 1126108076, 'ino': 2199023259649, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 1127729373, 'ino': 1099511633978, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 1134884206, 'ino': 1099511634087, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 1135591284, 'ino': 2199023262968, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1135883166, 'ino': 2199023267200, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1136965049, 'ino': 1099511631926, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1137542159, 'ino': 2199023267801, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 1141530028, 'ino': 2199023264150, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1143687237, 'ino': 2199023266014, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 1143895867, 'ino': 1099511633576, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 1144180733, 'ino': 1099511634199, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 1145347879, 'ino': 2199023261532, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1146994158, 'ino': 2199023263274, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1148377609, 'ino': 1099511634083, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 1149693191, 'ino': 1099511634483, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1150043087, 'ino': 1099511631391, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 1150239067, 'ino': 2199023267795, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 1150989205, 'ino': 2199023267525, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 1152740349, 'ino': 2199023266044, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 1156009940, 'ino': 2199023266111, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1157816969, 'ino': 2199023259339, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1166786490, 'ino': 2199023262946, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 1168566447, 'ino': 1099511630335, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 1170036842, 'ino': 2199023263387, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-69.xml'}, {'damage_type': 'backtrace', 'id': 1170449142, 'ino': 2199023259676, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1170591575, 'ino': 2199023261466, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1171286879, 'ino': 2199023267867, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1171301419, 'ino': 2199023267548, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1173338256, 'ino': 2199023264020, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1178581924, 'ino': 2199023264117, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-13.xml'}, {'damage_type': 'backtrace', 'id': 1180054714, 'ino': 2199023262978, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1180887630, 'ino': 2199023264245, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 1182149868, 'ino': 2199023259317, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-57.xml'}, {'damage_type': 'backtrace', 'id': 1183895700, 'ino': 1099511634064, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 1185431613, 'ino': 2199023266034, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 1188210997, 'ino': 1099511631799, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1188632554, 'ino': 2199023263115, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-52.xml'}, {'damage_type': 'backtrace', 'id': 1190573922, 'ino': 2199023259447, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-31.xml'}, {'damage_type': 'backtrace', 'id': 1192787566, 'ino': 2199023267649, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1195418135, 'ino': 1099511633515, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1197647535, 'ino': 2199023260103, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 1202623151, 'ino': 1099511634422, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 1217165055, 'ino': 1099511634139, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1218672831, 'ino': 1099511631053, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1223090512, 'ino': 2199023267367, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 1225346595, 'ino': 2199023261418, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 1225692500, 'ino': 2199023263147, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1228756387, 'ino': 1099511634107, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 1232589915, 'ino': 2199023264486, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1235356725, 'ino': 1099511633118, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-86.xml'}, {'damage_type': 'backtrace', 'id': 1238600441, 'ino': 1099511634419, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 1239247609, 'ino': 2199023262394, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 1241476023, 'ino': 2199023264381, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1243885476, 'ino': 2199023259961, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 1247405475, 'ino': 2199023262795, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1247584700, 'ino': 2199023267876, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 1255591642, 'ino': 1099511633418, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 1258753134, 'ino': 2199023262807, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-18.xml'}, {'damage_type': 'backtrace', 'id': 1259503481, 'ino': 2199023267494, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 1261427505, 'ino': 2199023259501, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1262194073, 'ino': 2199023267421, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 1262308982, 'ino': 2199023257920, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-88.xml'}, {'damage_type': 'backtrace', 'id': 1269498633, 'ino': 2199023267844, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 1274250303, 'ino': 1099511634336, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 1274318175, 'ino': 1099511633503, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 1286093299, 'ino': 2199023263059, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1288360650, 'ino': 1099511631060, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1291338076, 'ino': 1099511631248, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1291719252, 'ino': 1099511631734, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 1292744682, 'ino': 1099511630988, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1293140904, 'ino': 2199023264192, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1293600356, 'ino': 2199023267213, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1293978537, 'ino': 1099511630736, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-94.xml'}, {'damage_type': 'backtrace', 'id': 1295637890, 'ino': 2199023267786, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 1298102487, 'ino': 2199023258557, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1298513431, 'ino': 2199023261597, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1300662669, 'ino': 1099511634077, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 1302201467, 'ino': 2199023267783, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 1308127949, 'ino': 1099511633458, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 1310692968, 'ino': 2199023263043, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 1312686333, 'ino': 2199023267332, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1317678833, 'ino': 1099511634221, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 1318082863, 'ino': 2199023267518, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1318403084, 'ino': 2199023267302, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1325539969, 'ino': 2199023263213, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1327419962, 'ino': 2199023259692, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 1334406948, 'ino': 1099511636089, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 1337477102, 'ino': 2199023264483, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1340137850, 'ino': 2199023263391, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-68.xml'}, {'damage_type': 'backtrace', 'id': 1340860229, 'ino': 1099511634635, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 1342234856, 'ino': 1099511634117, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 1344537949, 'ino': 1099511634121, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1345429254, 'ino': 2199023257300, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1347035533, 'ino': 1099511631171, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-53.xml'}, {'damage_type': 'backtrace', 'id': 1348083823, 'ino': 2199023267542, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1350246779, 'ino': 1099511631003, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1353522394, 'ino': 1099511634015, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 1353928641, 'ino': 2199023259689, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1355038539, 'ino': 2199023267117, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-40.xml'}, {'damage_type': 'backtrace', 'id': 1357238282, 'ino': 2199023262956, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1357573894, 'ino': 2199023267675, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1359551065, 'ino': 2199023267780, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 1360401899, 'ino': 1099511631226, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-92.xml'}, {'damage_type': 'backtrace', 'id': 1363321650, 'ino': 1099511630339, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 1364499684, 'ino': 1099511634000, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 1365910206, 'ino': 2199023267346, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-88.jpg'}, {'damage_type': 'backtrace', 'id': 1366091493, 'ino': 2199023267254, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-21.xml'}, {'damage_type': 'backtrace', 'id': 1367146836, 'ino': 2199023259773, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1367962457, 'ino': 2199023263093, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-61.xml'}, {'damage_type': 'backtrace', 'id': 1370001666, 'ino': 1099511633500, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 1370257887, 'ino': 2199023263248, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-7.xml'}, {'damage_type': 'backtrace', 'id': 1373230392, 'ino': 2199023257201, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-65.xml'}, {'damage_type': 'backtrace', 'id': 1374782276, 'ino': 1099511630772, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 1376118967, 'ino': 1099511631824, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 1389031820, 'ino': 2199023267577, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1390747681, 'ino': 1099511631032, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1392148546, 'ino': 2199023267822, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 1393791780, 'ino': 2199023266000, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 1394929457, 'ino': 2199023263937, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-54.xml'}, {'damage_type': 'backtrace', 'id': 1396961719, 'ino': 1099511630163, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1397096837, 'ino': 2199023267342, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-89.jpg'}, {'damage_type': 'backtrace', 'id': 1397846241, 'ino': 1099511633502, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 1398915064, 'ino': 2199023266008, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 1399176821, 'ino': 1099511634042, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 1407597842, 'ino': 2199023263848, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-72.xml'}, {'damage_type': 'backtrace', 'id': 1411455748, 'ino': 2199023259078, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1414224427, 'ino': 1099511631012, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 1415163253, 'ino': 2199023263267, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-1.xml'}, {'damage_type': 'backtrace', 'id': 1416216704, 'ino': 1099511634429, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 1417730080, 'ino': 2199023258798, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 1420893326, 'ino': 1099511633427, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 1425820508, 'ino': 2199023266079, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1428724714, 'ino': 1099511631293, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1429840290, 'ino': 2199023262482, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 1431355274, 'ino': 1099511630102, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-49.xml'}, {'damage_type': 'backtrace', 'id': 1439815953, 'ino': 2199023266060, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 1440152249, 'ino': 2199023259387, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-41.xml'}, {'damage_type': 'backtrace', 'id': 1441238228, 'ino': 2199023262854, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 1443869534, 'ino': 1099511631042, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 1445337781, 'ino': 1099511634417, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 1446926753, 'ino': 2199023258618, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1447100327, 'ino': 2199023263877, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-66.xml'}, {'damage_type': 'backtrace', 'id': 1456156072, 'ino': 2199023267186, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1457533018, 'ino': 2199023261422, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 1462701513, 'ino': 1099511634101, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 1463806932, 'ino': 2199023267762, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 1464641389, 'ino': 2199023267363, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-83.jpg'}, {'damage_type': 'backtrace', 'id': 1466219070, 'ino': 1099511630343, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1474851822, 'ino': 2199023259370, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-100.xml'}, {'damage_type': 'backtrace', 'id': 1478251919, 'ino': 1099511634637, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-88.xml'}, {'damage_type': 'backtrace', 'id': 1478464952, 'ino': 1099511633967, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 1484144621, 'ino': 1099511633966, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 1492220986, 'ino': 2199023261257, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1494814248, 'ino': 2199023267588, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-39.xml'}, {'damage_type': 'backtrace', 'id': 1494890172, 'ino': 1099511630135, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1495075043, 'ino': 2199023267082, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-51.xml'}, {'damage_type': 'backtrace', 'id': 1500670503, 'ino': 2199023267573, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1502044782, 'ino': 1099511634394, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-86.xml'}, {'damage_type': 'backtrace', 'id': 1502089443, 'ino': 2199023266024, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 1505365029, 'ino': 2199023267496, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1505938371, 'ino': 1099511634322, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 1507730114, 'ino': 2199023259164, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 1508478794, 'ino': 2199023264162, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1508575567, 'ino': 2199023267561, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1508954670, 'ino': 1099511630338, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1511402963, 'ino': 2199023263893, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-63.xml'}, {'damage_type': 'backtrace', 'id': 1512434225, 'ino': 2199023257962, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1515073789, 'ino': 1099511634052, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 1519954602, 'ino': 1099511634360, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 1520417085, 'ino': 2199023259762, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1521082204, 'ino': 2199023262958, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1523341015, 'ino': 2199023267131, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-36.xml'}, {'damage_type': 'backtrace', 'id': 1526569332, 'ino': 2199023263023, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 1527166657, 'ino': 2199023262031, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 1527688278, 'ino': 2199023267732, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 1528231719, 'ino': 2199023262924, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 1530461230, 'ino': 2199023259760, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 1532356026, 'ino': 1099511634809, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 1537527055, 'ino': 2199023264036, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-30.xml'}, {'damage_type': 'backtrace', 'id': 1538087126, 'ino': 2199023262973, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 1542059656, 'ino': 2199023264090, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-96.xml'}, {'damage_type': 'backtrace', 'id': 1548881699, 'ino': 2199023267446, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 1549340710, 'ino': 1099511634708, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 1549366568, 'ino': 1099511634380, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 1552008097, 'ino': 2199023261406, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 1558224768, 'ino': 1099511630314, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 1559040134, 'ino': 2199023262931, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 1559853779, 'ino': 1099511632958, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-29.xml'}, {'damage_type': 'backtrace', 'id': 1560691801, 'ino': 2199023267672, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-11.xml'}, {'damage_type': 'backtrace', 'id': 1564664961, 'ino': 2199023267107, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-43.xml'}, {'damage_type': 'backtrace', 'id': 1565620179, 'ino': 2199023262916, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1569049513, 'ino': 2199023260121, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 1570216583, 'ino': 2199023264132, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1570976518, 'ino': 2199023263278, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1572226587, 'ino': 1099511633954, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 1574149607, 'ino': 2199023267574, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 1575671694, 'ino': 2199023263503, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-93.xml'}, {'damage_type': 'backtrace', 'id': 1578674641, 'ino': 2199023267856, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1579598976, 'ino': 1099511634944, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 1584083258, 'ino': 1099511633956, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 1587611863, 'ino': 1099511631696, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 1587864110, 'ino': 1099511633970, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 1590922142, 'ino': 1099511634712, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 1591218494, 'ino': 2199023267070, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1593780264, 'ino': 2199023267632, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1599922436, 'ino': 2199023263095, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-60.xml'}, {'damage_type': 'backtrace', 'id': 1605136432, 'ino': 2199023257362, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-37.xml'}, {'damage_type': 'backtrace', 'id': 1605496009, 'ino': 1099511630150, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-27.xml'}, {'damage_type': 'backtrace', 'id': 1608806564, 'ino': 2199023263231, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1610705424, 'ino': 2199023266028, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 1611563173, 'ino': 2199023264466, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 1611649168, 'ino': 2199023267434, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1615950212, 'ino': 1099511634332, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 1622552008, 'ino': 2199023259520, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-17.xml'}, {'damage_type': 'backtrace', 'id': 1622653349, 'ino': 1099511634626, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 1626483293, 'ino': 1099511633518, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 1628275865, 'ino': 2199023267248, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1629671822, 'ino': 2199023264471, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1632722913, 'ino': 1099511634448, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 1635726992, 'ino': 2199023263269, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 1642417473, 'ino': 1099511634004, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 1648190184, 'ino': 1099511634207, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-84.xml'}, {'damage_type': 'backtrace', 'id': 1648292271, 'ino': 2199023259558, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-9.xml'}, {'damage_type': 'backtrace', 'id': 1649681049, 'ino': 1099511634430, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 1652430941, 'ino': 1099511630120, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1654343479, 'ino': 1099511630763, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1658812626, 'ino': 2199023267579, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-42.xml'}, {'damage_type': 'backtrace', 'id': 1658968051, 'ino': 2199023261183, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-50.xml'}, {'damage_type': 'backtrace', 'id': 1659399416, 'ino': 1099511634057, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 1660083917, 'ino': 1099511630155, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-24.xml'}, {'damage_type': 'backtrace', 'id': 1660534034, 'ino': 2199023263108, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-55.xml'}, {'damage_type': 'backtrace', 'id': 1662325300, 'ino': 2199023259441, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-32.xml'}, {'damage_type': 'backtrace', 'id': 1666903878, 'ino': 2199023267603, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1667740507, 'ino': 2199023263090, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-62.xml'}, {'damage_type': 'backtrace', 'id': 1669810502, 'ino': 2199023267804, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 1672504545, 'ino': 2199023259435, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-33.xml'}, {'damage_type': 'backtrace', 'id': 1673622443, 'ino': 2199023257227, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-58.xml'}, {'damage_type': 'backtrace', 'id': 1677005515, 'ino': 1099511633569, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 1677385170, 'ino': 2199023267058, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-59.xml'}, {'damage_type': 'backtrace', 'id': 1681682555, 'ino': 2199023264315, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 1686131005, 'ino': 1099511633447, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 1694652247, 'ino': 1099511634126, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 1701183665, 'ino': 2199023259320, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-56.xml'}, {'damage_type': 'backtrace', 'id': 1703214371, 'ino': 1099511634038, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 1703487083, 'ino': 1099511631230, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-90.xml'}, {'damage_type': 'backtrace', 'id': 1711096024, 'ino': 1099511634002, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 1711960023, 'ino': 2199023261981, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 1712256491, 'ino': 1099511634915, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 1714134393, 'ino': 1099511630834, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1715015512, 'ino': 1099511633422, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 1722703661, 'ino': 2199023261390, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 1723832299, 'ino': 2199023259598, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 1723914581, 'ino': 2199023267365, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 1726500557, 'ino': 1099511634118, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 1727737540, 'ino': 2199023262966, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 1734341423, 'ino': 2199023267637, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1735535695, 'ino': 1099511634388, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-92.xml'}, {'damage_type': 'backtrace', 'id': 1737382744, 'ino': 2199023258409, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1737978446, 'ino': 2199023263830, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-76.xml'}, {'damage_type': 'backtrace', 'id': 1739927925, 'ino': 2199023261540, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 1741580073, 'ino': 2199023264412, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 1754252597, 'ino': 2199023262024, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 1763245242, 'ino': 1099511634327, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 1772971479, 'ino': 2199023258347, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1773421994, 'ino': 2199023263378, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-72.xml'}, {'damage_type': 'backtrace', 'id': 1774532777, 'ino': 2199023258633, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-2.xml'}, {'damage_type': 'backtrace', 'id': 1777740795, 'ino': 2199023259681, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1787573154, 'ino': 2199023267011, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-75.xml'}, {'damage_type': 'backtrace', 'id': 1788680852, 'ino': 2199023264495, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 1790745288, 'ino': 2199023267545, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 1791327031, 'ino': 1099511634627, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-92.xml'}, {'damage_type': 'backtrace', 'id': 1793867114, 'ino': 1099511634385, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 1794101028, 'ino': 1099511630321, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 1797154427, 'ino': 2199023267296, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 1797265763, 'ino': 1099511633583, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 1802384501, 'ino': 2199023263135, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-44.xml'}, {'damage_type': 'backtrace', 'id': 1802846810, 'ino': 1099511631684, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-83.xml'}, {'damage_type': 'backtrace', 'id': 1803087893, 'ino': 2199023264481, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 1803228782, 'ino': 2199023267600, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-35.xml'}, {'damage_type': 'backtrace', 'id': 1804425867, 'ino': 1099511633499, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 1805125337, 'ino': 2199023267753, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 1806444463, 'ino': 2199023262866, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 1808754636, 'ino': 1099511633408, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 1811228072, 'ino': 2199023263182, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-26.xml'}, {'damage_type': 'backtrace', 'id': 1812271456, 'ino': 2199023263412, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-61.xml'}, {'damage_type': 'backtrace', 'id': 1815465639, 'ino': 2199023259543, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-12.xml'}, {'damage_type': 'backtrace', 'id': 1816673375, 'ino': 1099511634420, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 1817191643, 'ino': 1099511630993, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1817732216, 'ino': 2199023257738, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 1822848821, 'ino': 1099511630133, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-34.xml'}, {'damage_type': 'backtrace', 'id': 1823636224, 'ino': 2199023259641, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 1828473851, 'ino': 2199023262891, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 1831373749, 'ino': 2199023260001, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 1837670725, 'ino': 2199023259731, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 1839925705, 'ino': 2199023266063, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 1840362307, 'ino': 1099511631242, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 1843920270, 'ino': 2199023261883, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-88.xml'}, {'damage_type': 'backtrace', 'id': 1848023634, 'ino': 2199023257907, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 1848817319, 'ino': 1099511634104, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 1852420920, 'ino': 1099511631031, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 1853619753, 'ino': 1099511630361, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1854002433, 'ino': 1099511630145, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-30.xml'}, {'damage_type': 'backtrace', 'id': 1854350863, 'ino': 2199023257746, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 1855506598, 'ino': 1099511634302, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 1855936965, 'ino': 1099511630194, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-5.xml'}, {'damage_type': 'backtrace', 'id': 1856786038, 'ino': 1099511634683, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 1859645570, 'ino': 1099511630331, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 1861378671, 'ino': 2199023258092, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 1861408694, 'ino': 2199023263220, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-15.xml'}, {'damage_type': 'backtrace', 'id': 1861510181, 'ino': 1099511633505, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 1868631893, 'ino': 1099511631909, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 1874934500, 'ino': 2199023266056, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 1877799351, 'ino': 2199023267097, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-46.xml'}, {'damage_type': 'backtrace', 'id': 1878053107, 'ino': 2199023259632, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 1881528081, 'ino': 2199023267284, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 1882174889, 'ino': 1099511633455, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 1883463501, 'ino': 2199023267337, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 1883615737, 'ino': 2199023267282, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-14.xml'}, {'damage_type': 'backtrace', 'id': 1883774001, 'ino': 2199023259352, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-48.xml'}, {'damage_type': 'backtrace', 'id': 1884843748, 'ino': 1099511631236, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-84.xml'}, {'damage_type': 'backtrace', 'id': 1885230274, 'ino': 2199023264087, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-19.xml'}, {'damage_type': 'backtrace', 'id': 1888345293, 'ino': 2199023267838, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 1888486391, 'ino': 2199023259668, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 1888953228, 'ino': 2199023267055, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-60.xml'}, {'damage_type': 'backtrace', 'id': 1892188378, 'ino': 1099511631016, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 1893589580, 'ino': 1099511630355, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1896177770, 'ino': 3298534887110, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 1897895585, 'ino': 1099511630837, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 1901951158, 'ino': 2199023262640, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 1901974943, 'ino': 1099511631712, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 1902863331, 'ino': 1099511634030, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 1903226493, 'ino': 1099511634638, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 1905896928, 'ino': 2199023262856, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 1910000332, 'ino': 2199023262528, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 1912183074, 'ino': 2199023263056, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 1913503439, 'ino': 1099511634136, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 1913774923, 'ino': 2199023261907, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 1916267192, 'ino': 2199023267439, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 1916394960, 'ino': 2199023258053, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 1916538232, 'ino': 2199023266071, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 1916768282, 'ino': 2199023267395, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 1919650403, 'ino': 2199023261904, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 1920359647, 'ino': 2199023262589, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 1930168569, 'ino': 2199023263340, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-84.xml'}, {'damage_type': 'backtrace', 'id': 1931229573, 'ino': 2199023267430, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 1932853158, 'ino': 1099511634289, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-22.xml'}, {'damage_type': 'backtrace', 'id': 1936271992, 'ino': 2199023263251, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-6.xml'}, {'damage_type': 'backtrace', 'id': 1937618047, 'ino': 2199023267537, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 1940539287, 'ino': 1099511630759, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 1946622474, 'ino': 2199023263978, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-45.xml'}, {'damage_type': 'backtrace', 'id': 1947352470, 'ino': 1099511630346, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 1951558267, 'ino': 1099511634344, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 1952258091, 'ino': 2199023258715, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 1955128491, 'ino': 2199023263960, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-49.xml'}, {'damage_type': 'backtrace', 'id': 1955900899, 'ino': 2199023267088, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-49.xml'}, {'damage_type': 'backtrace', 'id': 1957991467, 'ino': 2199023259366, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-45.xml'}, {'damage_type': 'backtrace', 'id': 1958340329, 'ino': 2199023258379, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-8.xml'}, {'damage_type': 'backtrace', 'id': 1961569915, 'ino': 2199023267398, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 1962095817, 'ino': 1099511631234, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-86.xml'}, {'damage_type': 'backtrace', 'id': 1964016883, 'ino': 2199023261159, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-56.xml'}, {'damage_type': 'backtrace', 'id': 1964457450, 'ino': 2199023259582, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1972134862, 'ino': 2199023262841, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-4.xml'}, {'damage_type': 'backtrace', 'id': 1975498924, 'ino': 1099511633666, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-41.xml'}, {'damage_type': 'backtrace', 'id': 1976192487, 'ino': 2199023263128, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-47.xml'}, {'damage_type': 'backtrace', 'id': 1976873492, 'ino': 1099511634724, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 1983371215, 'ino': 2199023261478, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 1983577909, 'ino': 1099511634033, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 1984970542, 'ino': 2199023259492, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-23.xml'}, {'damage_type': 'backtrace', 'id': 1985362218, 'ino': 1099511634001, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 1990923488, 'ino': 2199023267298, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-10.xml'}, {'damage_type': 'backtrace', 'id': 1995546046, 'ino': 2199023259941, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 1999113339, 'ino': 1099511634261, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 1999504992, 'ino': 2199023259312, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-58.xml'}, {'damage_type': 'backtrace', 'id': 2002294582, 'ino': 2199023262869, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 2005236469, 'ino': 1099511631380, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 2005253488, 'ino': 2199023264144, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2008783074, 'ino': 1099511631096, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-91.xml'}, {'damage_type': 'backtrace', 'id': 2008960064, 'ino': 2199023262894, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 2011781541, 'ino': 2199023258108, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2013294398, 'ino': 2199023259856, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 2018755381, 'ino': 1099511630336, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-75.xml'}, {'damage_type': 'backtrace', 'id': 2020324229, 'ino': 2199023262839, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2022367586, 'ino': 1099511634407, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 2024180480, 'ino': 2199023267085, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2024264896, 'ino': 2199023263427, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2025711154, 'ino': 1099511635683, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 2029237872, 'ino': 2199023262971, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2029935058, 'ino': 1099511630985, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2032803543, 'ino': 2199023261677, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-91.xml'}, {'damage_type': 'backtrace', 'id': 2034464986, 'ino': 2199023267278, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2038041213, 'ino': 1099511630320, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 2039540523, 'ino': 1099511633433, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 2040685892, 'ino': 1099511634098, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 2043031432, 'ino': 3298534887191, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 2043512542, 'ino': 1099511630348, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2043878554, 'ino': 1099511634699, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-21.xml'}, {'damage_type': 'backtrace', 'id': 2046125148, 'ino': 2199023267308, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2046197076, 'ino': 2199023267864, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2046921931, 'ino': 1099511634432, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 2047032093, 'ino': 1099511633461, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 2051933554, 'ino': 1099511630994, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2052119061, 'ino': 1099511634636, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 2054461469, 'ino': 2199023261225, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-38.xml'}, {'damage_type': 'backtrace', 'id': 2056477775, 'ino': 1099511631877, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 2057803816, 'ino': 1099511633932, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-93.xml'}, {'damage_type': 'backtrace', 'id': 2060213908, 'ino': 1099511633950, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 2060706530, 'ino': 2199023263843, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-73.xml'}, {'damage_type': 'backtrace', 'id': 2060913607, 'ino': 2199023261316, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2064234772, 'ino': 2199023267349, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-87.jpg'}, {'damage_type': 'backtrace', 'id': 2071770874, 'ino': 1099511634519, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 2079834179, 'ino': 2199023259539, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2080870425, 'ino': 2199023265980, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 2081504260, 'ino': 1099511633985, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 2082579633, 'ino': 1099511630358, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 2084774151, 'ino': 2199023258826, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2092260726, 'ino': 3298534886129, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2095869560, 'ino': 2199023267314, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2100864012, 'ino': 1099511630112, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-22.xml'}, {'damage_type': 'backtrace', 'id': 2101753990, 'ino': 2199023261128, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-64.xml'}, {'damage_type': 'backtrace', 'id': 2108044934, 'ino': 2199023266010, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 2110181650, 'ino': 2199023267585, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2110204439, 'ino': 2199023261370, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-5.xml'}, {'damage_type': 'backtrace', 'id': 2114175614, 'ino': 2199023267179, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2118433881, 'ino': 2199023263331, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-87.xml'}, {'damage_type': 'backtrace', 'id': 2118837336, 'ino': 2199023258813, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2120226218, 'ino': 2199023260126, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-42.xml'}, {'damage_type': 'backtrace', 'id': 2120712817, 'ino': 2199023262636, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 2120805459, 'ino': 1099511630351, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2120854446, 'ino': 1099511633029, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 2122162556, 'ino': 2199023263143, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-41.xml'}, {'damage_type': 'backtrace', 'id': 2123501958, 'ino': 2199023262789, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2126872728, 'ino': 2199023257823, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2128336258, 'ino': 1099511633531, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 2129874069, 'ino': 1099511633873, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-93.jpg'}, {'damage_type': 'backtrace', 'id': 2137005288, 'ino': 2199023265968, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 2145659593, 'ino': 2199023263189, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2148789002, 'ino': 3298534884602, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 2149049098, 'ino': 2199023267617, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2154211619, 'ino': 2199023258112, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2156505972, 'ino': 1099511634625, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 2156684660, 'ino': 2199023267353, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-86.jpg'}, {'damage_type': 'backtrace', 'id': 2158711651, 'ino': 1099511634287, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 2160158908, 'ino': 1099511631043, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-25.xml'}, {'damage_type': 'backtrace', 'id': 2161085560, 'ino': 1099511634210, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 2162643479, 'ino': 1099511634346, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 2164296333, 'ino': 1099511630258, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 2167548043, 'ino': 2199023261559, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2171479404, 'ino': 1099511630330, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 2175544265, 'ino': 2199023263050, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2177857216, 'ino': 2199023259720, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2180234742, 'ino': 1099511631049, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2181662513, 'ino': 1099511630840, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2182399156, 'ino': 2199023267294, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2184082102, 'ino': 2199023267533, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2186513657, 'ino': 2199023267356, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-85.jpg'}, {'damage_type': 'backtrace', 'id': 2191598036, 'ino': 1099511633554, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 2198268357, 'ino': 2199023262929, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 2202298992, 'ino': 1099511634314, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 2205254452, 'ino': 2199023262594, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 2205258493, 'ino': 2199023263038, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 2205410960, 'ino': 1099511634760, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 2207066749, 'ino': 2199023262801, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-20.xml'}, {'damage_type': 'backtrace', 'id': 2207812980, 'ino': 1099511634072, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 2208676595, 'ino': 2199023265982, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 2211663701, 'ino': 2199023259487, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2212558159, 'ino': 2199023267614, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2215917019, 'ino': 2199023262901, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 2216644031, 'ino': 2199023267792, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 2218302434, 'ino': 1099511634357, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 2218555387, 'ino': 1099511634284, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 2219284442, 'ino': 2199023267571, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2219765619, 'ino': 1099511634504, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 2219871723, 'ino': 2199023259769, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2219991053, 'ino': 1099511634029, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 2223224537, 'ino': 2199023263436, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-53.xml'}, {'damage_type': 'backtrace', 'id': 2224431233, 'ino': 1099511633973, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 2225316564, 'ino': 2199023267034, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-67.xml'}, {'damage_type': 'backtrace', 'id': 2228187993, 'ino': 1099511631001, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2229204717, 'ino': 2199023259568, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2229380204, 'ino': 2199023267409, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 2230466781, 'ino': 2199023259112, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2233788851, 'ino': 1099511634376, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 2236734221, 'ino': 2199023263162, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-33.xml'}, {'damage_type': 'backtrace', 'id': 2238087191, 'ino': 2199023259453, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2238741105, 'ino': 2199023263113, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-53.xml'}, {'damage_type': 'backtrace', 'id': 2239562021, 'ino': 1099511630767, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2240524130, 'ino': 2199023261892, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-86.xml'}, {'damage_type': 'backtrace', 'id': 2240957014, 'ino': 2199023267020, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-72.xml'}, {'damage_type': 'backtrace', 'id': 2246620581, 'ino': 2199023263062, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2247490025, 'ino': 2199023263985, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-43.xml'}, {'damage_type': 'backtrace', 'id': 2251069190, 'ino': 2199023267264, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 2252877182, 'ino': 2199023266097, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 2258951102, 'ino': 2199023259863, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 2264157356, 'ino': 2199023259393, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2264867247, 'ino': 1099511633961, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 2265771356, 'ino': 1099511634423, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 2266815950, 'ino': 2199023259629, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 2267228311, 'ino': 2199023263178, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-27.xml'}, {'damage_type': 'backtrace', 'id': 2268396964, 'ino': 2199023266069, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2272980160, 'ino': 1099511636876, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-63.jpg'}, {'damage_type': 'backtrace', 'id': 2273184146, 'ino': 2199023267619, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2273472498, 'ino': 2199023259573, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-6.xml'}, {'damage_type': 'backtrace', 'id': 2275305456, 'ino': 2199023263133, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2277690262, 'ino': 2199023265974, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 2278206913, 'ino': 2199023264222, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 2282184913, 'ino': 2199023260074, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 2284673469, 'ino': 2199023267064, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-57.xml'}, {'damage_type': 'backtrace', 'id': 2286708350, 'ino': 2199023258008, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 2286762329, 'ino': 2199023259728, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2293092246, 'ino': 2199023267154, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2293510163, 'ino': 2199023263160, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-34.xml'}, {'damage_type': 'backtrace', 'id': 2298392904, 'ino': 1099511634412, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 2302146090, 'ino': 2199023263028, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2302488265, 'ino': 2199023259808, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 2302777029, 'ino': 1099511634044, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 2304845785, 'ino': 2199023266123, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2310932465, 'ino': 2199023259777, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2316851350, 'ino': 2199023267170, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2320825410, 'ino': 1099511634361, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-24.xml'}, {'damage_type': 'backtrace', 'id': 2321063512, 'ino': 1099511630173, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2322001758, 'ino': 1099511631401, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 2326224678, 'ino': 2199023267358, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2326260048, 'ino': 1099511631680, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 2326947202, 'ino': 2199023264492, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2327459084, 'ino': 1099511634454, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 2329583750, 'ino': 1099511630315, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 2330311255, 'ino': 1099511631834, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 2330545218, 'ino': 2199023263046, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2330571316, 'ino': 2199023263007, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2331702494, 'ino': 1099511631575, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-59.xml'}, {'damage_type': 'backtrace', 'id': 2331907606, 'ino': 2199023263272, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2336483421, 'ino': 2199023262826, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-10.xml'}, {'damage_type': 'backtrace', 'id': 2339305099, 'ino': 1099511634373, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 2344734166, 'ino': 2199023267807, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2350150127, 'ino': 2199023263409, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-62.xml'}, {'damage_type': 'backtrace', 'id': 2351266269, 'ino': 2199023265986, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 2356111361, 'ino': 2199023263105, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2356895502, 'ino': 1099511630179, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2359984118, 'ino': 2199023267591, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-38.xml'}, {'damage_type': 'backtrace', 'id': 2360115491, 'ino': 2199023262816, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2374600408, 'ino': 2199023265996, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 2381013626, 'ino': 2199023262943, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2381541763, 'ino': 1099511630108, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2381906275, 'ino': 2199023267615, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2383722391, 'ino': 1099511630998, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2387637264, 'ino': 1099511631286, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2387895802, 'ino': 2199023265994, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 2389533024, 'ino': 1099511630138, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-69.xml'}, {'damage_type': 'backtrace', 'id': 2394891273, 'ino': 2199023274010, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 2395515091, 'ino': 1099511634027, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 2396042642, 'ino': 2199023259083, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-35.xml'}, {'damage_type': 'backtrace', 'id': 2399099136, 'ino': 1099511630816, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2407173106, 'ino': 1099511631005, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2412559883, 'ino': 1099511634021, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 2412651360, 'ino': 1099511634144, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 2412844789, 'ino': 2199023257612, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2413154525, 'ino': 2199023267438, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2413563809, 'ino': 2199023263969, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2419787923, 'ino': 2199023267474, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 2423551144, 'ino': 2199023260007, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 2425439011, 'ino': 2199023263035, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2427079592, 'ino': 2199023263185, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-25.xml'}, {'damage_type': 'backtrace', 'id': 2431720530, 'ino': 1099511634498, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 2433629483, 'ino': 2199023266050, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2435053100, 'ino': 2199023267158, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2436361126, 'ino': 1099511630730, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 2440060753, 'ino': 2199023267100, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-45.xml'}, {'damage_type': 'backtrace', 'id': 2441074601, 'ino': 1099511631244, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 2446584391, 'ino': 2199023261434, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 2448813766, 'ino': 2199023263087, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2451996739, 'ino': 1099511629927, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2452592165, 'ino': 2199023267640, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2463866855, 'ino': 2199023266004, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 2466213917, 'ino': 2199023261218, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2467721444, 'ino': 2199023267091, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-48.xml'}, {'damage_type': 'backtrace', 'id': 2470396360, 'ino': 2199023267193, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-20.xml'}, {'damage_type': 'backtrace', 'id': 2476854260, 'ino': 1099511634034, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 2477856622, 'ino': 1099511634288, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 2479603171, 'ino': 1099511631228, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-91.xml'}, {'damage_type': 'backtrace', 'id': 2481483869, 'ino': 2199023257675, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-1.xml'}, {'damage_type': 'backtrace', 'id': 2481516130, 'ino': 2199023263022, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2488371400, 'ino': 2199023267551, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2492548044, 'ino': 2199023258534, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-29.xml'}, {'damage_type': 'backtrace', 'id': 2492784326, 'ino': 1099511635326, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-30.xml'}, {'damage_type': 'backtrace', 'id': 2494524533, 'ino': 2199023267416, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 2494899100, 'ino': 1099511633934, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-91.xml'}, {'damage_type': 'backtrace', 'id': 2496715063, 'ino': 2199023260030, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 2497015371, 'ino': 2199023263973, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-46.xml'}, {'damage_type': 'backtrace', 'id': 2497773396, 'ino': 2199023263303, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 2500683434, 'ino': 2199023258358, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-12.xml'}, {'damage_type': 'backtrace', 'id': 2503582034, 'ino': 2199023263369, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-75.xml'}, {'damage_type': 'backtrace', 'id': 2504299519, 'ino': 1099511634460, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 2504476297, 'ino': 1099511630357, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 2505902898, 'ino': 1099511633508, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 2506616429, 'ino': 1099511630799, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2510733378, 'ino': 2199023262811, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2512574386, 'ino': 1099511634629, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-91.xml'}, {'damage_type': 'backtrace', 'id': 2516176939, 'ino': 2199023262951, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 2519709593, 'ino': 2199023257781, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2520103373, 'ino': 1099511634232, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2520503058, 'ino': 2199023263282, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 2520823651, 'ino': 2199023267508, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 2526795930, 'ino': 1099511634304, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 2535955269, 'ino': 2199023267635, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2537303396, 'ino': 1099511634639, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 2537526517, 'ino': 2199023263152, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2537989386, 'ino': 2199023262624, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 2538601878, 'ino': 2199023263297, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2540146432, 'ino': 1099511634358, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 2541770206, 'ino': 2199023267870, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2543901763, 'ino': 1099511633965, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 2546194221, 'ino': 1099511633983, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 2551786911, 'ino': 1099511630725, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-96.xml'}, {'damage_type': 'backtrace', 'id': 2554224875, 'ino': 2199023263322, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-90.xml'}, {'damage_type': 'backtrace', 'id': 2554268068, 'ino': 1099511634372, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 2555573760, 'ino': 2199023267014, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-74.xml'}, {'damage_type': 'backtrace', 'id': 2556655469, 'ino': 2199023265962, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 2556685861, 'ino': 1099511631893, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 2559445309, 'ino': 1099511634008, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2561739575, 'ino': 2199023259750, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 2563520844, 'ino': 1099511634426, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 2563895977, 'ino': 1099511633402, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 2566049749, 'ino': 2199023262921, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2568180769, 'ino': 2199023262926, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2568769119, 'ino': 2199023262996, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2569275242, 'ino': 1099511630990, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2569652618, 'ino': 1099511633509, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 2569841620, 'ino': 2199023259853, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 2573581906, 'ino': 2199023265990, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 2573787344, 'ino': 1099511633999, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 2574329618, 'ino': 1099511630727, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2576801547, 'ino': 1099511632814, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-86.xml'}, {'damage_type': 'backtrace', 'id': 2577333528, 'ino': 2199023263234, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-11.xml'}, {'damage_type': 'backtrace', 'id': 2579052033, 'ino': 2199023267515, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2581617632, 'ino': 2199023267521, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2582355877, 'ino': 2199023267258, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-20.xml'}, {'damage_type': 'backtrace', 'id': 2587079364, 'ino': 2199023267510, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-42.jpg'}, {'damage_type': 'backtrace', 'id': 2587299603, 'ino': 1099511633111, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2593773128, 'ino': 2199023267662, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-14.xml'}, {'damage_type': 'backtrace', 'id': 2593982890, 'ino': 1099511631861, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 2595341366, 'ino': 2199023267504, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 2598097601, 'ino': 2199023267646, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-19.xml'}, {'damage_type': 'backtrace', 'id': 2599064970, 'ino': 1099511634053, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 2599095516, 'ino': 2199023262899, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 2600840866, 'ino': 1099511634251, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 2601112873, 'ino': 1099511633424, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-46.xml'}, {'damage_type': 'backtrace', 'id': 2603592921, 'ino': 2199023261311, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2605387679, 'ino': 1099511634838, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 2611614037, 'ino': 2199023263245, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2617839585, 'ino': 2199023262886, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 2622222842, 'ino': 2199023257680, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-69.jpg'}, {'damage_type': 'backtrace', 'id': 2622995520, 'ino': 1099511633986, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 2625333443, 'ino': 1099511630284, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 2630602954, 'ino': 2199023267835, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2632789133, 'ino': 2199023263400, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-65.xml'}, {'damage_type': 'backtrace', 'id': 2638611156, 'ino': 1099511630997, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2638874840, 'ino': 1099511630115, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-44.xml'}, {'damage_type': 'backtrace', 'id': 2640971222, 'ino': 1099511634140, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 2641032984, 'ino': 2199023263833, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-75.xml'}, {'damage_type': 'backtrace', 'id': 2642936990, 'ino': 2199023262876, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 2643955744, 'ino': 1099511633053, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2652791033, 'ino': 2199023258441, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 2653288889, 'ino': 1099511634859, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 2653556640, 'ino': 1099511634138, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 2655114431, 'ino': 2199023257806, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2655328327, 'ino': 1099511631886, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-47.xml'}, {'damage_type': 'backtrace', 'id': 2657473382, 'ino': 1099511631742, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 2658880563, 'ino': 1099511631057, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-20.xml'}, {'damage_type': 'backtrace', 'id': 2659875628, 'ino': 2199023261482, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 2665737869, 'ino': 2199023263853, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-71.xml'}, {'damage_type': 'backtrace', 'id': 2667842227, 'ino': 2199023267312, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 2668862708, 'ino': 2199023261232, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2670489341, 'ino': 2199023267472, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 2672796304, 'ino': 2199023259716, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 2672816905, 'ino': 1099511633993, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-57.xml'}, {'damage_type': 'backtrace', 'id': 2673767185, 'ino': 2199023265948, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2675973204, 'ino': 1099511634377, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-10.xml'}, {'damage_type': 'backtrace', 'id': 2681279548, 'ino': 2199023266006, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 2681414350, 'ino': 2199023267567, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 2681863939, 'ino': 2199023265984, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-70.jpg'}, {'damage_type': 'backtrace', 'id': 2686050408, 'ino': 1099511634308, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 2688375986, 'ino': 2199023259742, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2689753591, 'ino': 1099511631111, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-57.xml'}, {'damage_type': 'backtrace', 'id': 2692940149, 'ino': 2199023267831, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 2697246448, 'ino': 2199023267625, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2700000468, 'ino': 1099511634416, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 2702397393, 'ino': 2199023258421, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2703213615, 'ino': 2199023259589, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-2.xml'}, {'damage_type': 'backtrace', 'id': 2704940707, 'ino': 1099511633944, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 2705918712, 'ino': 1099511636083, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-31.xml'}, {'damage_type': 'backtrace', 'id': 2707190805, 'ino': 2199023258436, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-7.jpg'}, {'damage_type': 'backtrace', 'id': 2707650234, 'ino': 1099511634355, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 2709836107, 'ino': 1099511630353, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 2712720697, 'ino': 2199023267467, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 2726513940, 'ino': 1099511631522, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-79.xml'}, {'damage_type': 'backtrace', 'id': 2726576547, 'ino': 2199023262013, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 2726889688, 'ino': 1099511633117, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 2727051753, 'ino': 2199023262804, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-19.xml'}, {'damage_type': 'backtrace', 'id': 2727523942, 'ino': 2199023266099, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 2728928363, 'ino': 1099511636035, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 2729661656, 'ino': 2199023258657, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 2731447477, 'ino': 2199023261112, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-68.xml'}, {'damage_type': 'backtrace', 'id': 2731845954, 'ino': 2199023264106, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-15.xml'}, {'damage_type': 'backtrace', 'id': 2732116642, 'ino': 2199023266103, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 2734411860, 'ino': 1099511633952, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 2735530989, 'ino': 1099511633442, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 2736854919, 'ino': 1099511631723, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 2740449341, 'ino': 2199023262583, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 2740676119, 'ino': 2199023263909, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-60.xml'}, {'damage_type': 'backtrace', 'id': 2740893040, 'ino': 1099511634114, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 2745220587, 'ino': 2199023267442, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 2745311330, 'ino': 2199023261450, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 2749383846, 'ino': 1099511633513, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-13.xml'}, {'damage_type': 'backtrace', 'id': 2749699867, 'ino': 1099511630299, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 2749723774, 'ino': 2199023257773, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 2752441289, 'ino': 1099511634367, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 2752970692, 'ino': 2199023267049, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-62.xml'}, {'damage_type': 'backtrace', 'id': 2759082333, 'ino': 2199023267488, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2760409897, 'ino': 1099511633974, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 2762158499, 'ino': 2199023267377, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 2762933687, 'ino': 2199023267142, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-33.xml'}, {'damage_type': 'backtrace', 'id': 2763551805, 'ino': 1099511634642, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-25.xml'}, {'damage_type': 'backtrace', 'id': 2765919011, 'ino': 1099511630349, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 2767551702, 'ino': 2199023264012, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2767557787, 'ino': 2199023267825, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 2767866342, 'ino': 1099511630344, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 2768150246, 'ino': 2199023264489, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2775935623, 'ino': 2199023263192, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2777063553, 'ino': 2199023257787, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 2778056437, 'ino': 1099511631056, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 2781837078, 'ino': 2199023263306, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2788387401, 'ino': 1099511636061, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 2788688499, 'ino': 2199023267524, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2792156773, 'ino': 2199023267453, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-57.jpg'}, {'damage_type': 'backtrace', 'id': 2793640741, 'ino': 1099511636064, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 2793667699, 'ino': 2199023267607, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 2797038217, 'ino': 2199023261269, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2799930312, 'ino': 2199023267237, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2800385315, 'ino': 1099511631034, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2802794820, 'ino': 2199023266081, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 2803232188, 'ino': 1099511631233, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 2804234542, 'ino': 2199023263998, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2807676638, 'ino': 1099511634339, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 2809816274, 'ino': 1099511633477, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 2813548943, 'ino': 1099511634514, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 2815140258, 'ino': 2199023262792, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-23.xml'}, {'damage_type': 'backtrace', 'id': 2817428954, 'ino': 2199023263037, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2820616179, 'ino': 1099511634409, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 2823099119, 'ino': 2199023262834, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2827169565, 'ino': 1099511630170, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-16.xml'}, {'damage_type': 'backtrace', 'id': 2828534747, 'ino': 2199023267580, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 2828652915, 'ino': 1099511634524, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-95.xml'}, {'damage_type': 'backtrace', 'id': 2831078078, 'ino': 2199023264228, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 2842876520, 'ino': 2199023267423, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 2844237509, 'ino': 1099511632871, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-36.xml'}, {'damage_type': 'backtrace', 'id': 2846354048, 'ino': 2199023261358, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-8.xml'}, {'damage_type': 'backtrace', 'id': 2846731520, 'ino': 2199023261619, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2846773697, 'ino': 1099511631413, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 2849174248, 'ino': 1099511633981, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 2850418334, 'ino': 2199023263110, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-54.xml'}, {'damage_type': 'backtrace', 'id': 2851140350, 'ino': 2199023258004, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 2853144772, 'ino': 2199023267719, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 2853341632, 'ino': 2199023267396, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-74.jpg'}, {'damage_type': 'backtrace', 'id': 2853564492, 'ino': 1099511634689, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 2858621082, 'ino': 2199023264075, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-99.xml'}, {'damage_type': 'backtrace', 'id': 2861428098, 'ino': 2199023267310, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-7.xml'}, {'damage_type': 'backtrace', 'id': 2862604869, 'ino': 2199023263868, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-68.xml'}, {'damage_type': 'backtrace', 'id': 2866526837, 'ino': 1099511634400, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 2868192637, 'ino': 1099511634123, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 2874945562, 'ino': 2199023267023, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-71.xml'}, {'damage_type': 'backtrace', 'id': 2877264652, 'ino': 1099511630246, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 2877810705, 'ino': 2199023263858, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-70.xml'}, {'damage_type': 'backtrace', 'id': 2879788012, 'ino': 1099511633473, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 2882946741, 'ino': 1099511634246, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-74.xml'}, {'damage_type': 'backtrace', 'id': 2883699573, 'ino': 1099511633506, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 2884619099, 'ino': 2199023258511, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-35.xml'}, {'damage_type': 'backtrace', 'id': 2885502337, 'ino': 2199023263825, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-77.xml'}, {'damage_type': 'backtrace', 'id': 2887169566, 'ino': 2199023266095, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2887572309, 'ino': 2199023257942, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 2890141316, 'ino': 2199023263175, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-28.xml'}, {'damage_type': 'backtrace', 'id': 2891533783, 'ino': 2199023261192, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-47.xml'}, {'damage_type': 'backtrace', 'id': 2893525076, 'ino': 2199023267678, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-9.xml'}, {'damage_type': 'backtrace', 'id': 2898027340, 'ino': 2199023261132, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-63.xml'}, {'damage_type': 'backtrace', 'id': 2908427561, 'ino': 2199023262783, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-26.xml'}, {'damage_type': 'backtrace', 'id': 2911869699, 'ino': 2199023267450, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-58.jpg'}, {'damage_type': 'backtrace', 'id': 2912488310, 'ino': 2199023267128, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-37.xml'}, {'damage_type': 'backtrace', 'id': 2915184582, 'ino': 2199023267759, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 2915302588, 'ino': 2199023263294, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 2921479703, 'ino': 1099511630733, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 2922580306, 'ino': 2199023267885, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2926168897, 'ino': 1099511634349, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 2927186989, 'ino': 2199023264063, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-24.xml'}, {'damage_type': 'backtrace', 'id': 2929997378, 'ino': 2199023259323, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-55.xml'}, {'damage_type': 'backtrace', 'id': 2933349643, 'ino': 1099511634212, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 2934258045, 'ino': 2199023264392, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 2934522806, 'ino': 2199023267610, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 2934710496, 'ino': 2199023262573, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-26.xml'}, {'damage_type': 'backtrace', 'id': 2935891337, 'ino': 1099511630996, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 2942349576, 'ino': 1099511631749, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 2942350607, 'ino': 2199023261631, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2944670475, 'ino': 2199023267695, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2944854435, 'ino': 2199023263928, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-56.xml'}, {'damage_type': 'backtrace', 'id': 2946305965, 'ino': 2199023266101, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 2949276934, 'ino': 1099511634402, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-80.xml'}, {'damage_type': 'backtrace', 'id': 2951020433, 'ino': 2199023267768, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 2951732637, 'ino': 1099511631917, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 2953057995, 'ino': 2199023263227, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-13.xml'}, {'damage_type': 'backtrace', 'id': 2955737348, 'ino': 2199023263040, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 2959797672, 'ino': 2199023267506, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 2960626896, 'ino': 2199023257663, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-3.xml'}, {'damage_type': 'backtrace', 'id': 2961632497, 'ino': 2199023263120, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-50.xml'}, {'damage_type': 'backtrace', 'id': 2975914929, 'ino': 1099511630337, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 2976141397, 'ino': 1099511631654, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-42.xml'}, {'damage_type': 'backtrace', 'id': 2978698595, 'ino': 2199023258399, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-4.xml'}, {'damage_type': 'backtrace', 'id': 2978790946, 'ino': 1099511636077, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 2981234693, 'ino': 2199023264077, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-21.xml'}, {'damage_type': 'backtrace', 'id': 2983387838, 'ino': 2199023267262, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-19.xml'}, {'damage_type': 'backtrace', 'id': 2983710497, 'ino': 2199023258491, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-40.xml'}, {'damage_type': 'backtrace', 'id': 2984941080, 'ino': 2199023266032, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 2986934838, 'ino': 2199023259848, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 2987255326, 'ino': 2199023263820, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-78.xml'}, {'damage_type': 'backtrace', 'id': 2987584383, 'ino': 2199023261496, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 2989214651, 'ino': 2199023263083, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 2989379873, 'ino': 1099511630334, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-33.jpg'}, {'damage_type': 'backtrace', 'id': 2992796980, 'ino': 2199023263077, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 2993968823, 'ino': 1099511634896, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 2994174373, 'ino': 2199023267351, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 2996660721, 'ino': 2199023264293, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 2997719991, 'ino': 2199023266026, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 2997840151, 'ino': 2199023262904, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 3007123496, 'ino': 2199023267189, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-21.xml'}, {'damage_type': 'backtrace', 'id': 3007605651, 'ino': 2199023267381, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-78.jpg'}, {'damage_type': 'backtrace', 'id': 3008643281, 'ino': 2199023267771, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 3008951572, 'ino': 2199023264216, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3015677975, 'ino': 1099511629615, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-85.xml'}, {'damage_type': 'backtrace', 'id': 3016097380, 'ino': 2199023263884, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-65.xml'}, {'damage_type': 'backtrace', 'id': 3018192717, 'ino': 2199023259638, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3024330822, 'ino': 2199023267037, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-66.xml'}, {'damage_type': 'backtrace', 'id': 3025524705, 'ino': 2199023264092, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3032377871, 'ino': 1099511634375, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-12.xml'}, {'damage_type': 'backtrace', 'id': 3034688094, 'ino': 2199023267046, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-63.xml'}, {'damage_type': 'backtrace', 'id': 3036180387, 'ino': 1099511634143, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 3037086145, 'ino': 1099511631000, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3041224925, 'ino': 2199023267741, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 3041405631, 'ino': 2199023264082, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-20.xml'}, {'damage_type': 'backtrace', 'id': 3041736886, 'ino': 1099511636036, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 3049412404, 'ino': 2199023267427, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-64.jpg'}, {'damage_type': 'backtrace', 'id': 3051498313, 'ino': 2199023259612, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 3052855613, 'ino': 1099511633935, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-90.xml'}, {'damage_type': 'backtrace', 'id': 3053526389, 'ino': 2199023267554, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3054657146, 'ino': 1099511632800, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3061334530, 'ino': 2199023267539, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3066642328, 'ino': 2199023267862, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3067787219, 'ino': 1099511631518, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-60.jpg'}, {'damage_type': 'backtrace', 'id': 3069734160, 'ino': 1099511634316, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-50.xml'}, {'damage_type': 'backtrace', 'id': 3070588638, 'ino': 2199023259408, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-93.xml'}, {'damage_type': 'backtrace', 'id': 3072540755, 'ino': 2199023262798, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-21.xml'}, {'damage_type': 'backtrace', 'id': 3075929075, 'ino': 1099511631384, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 3079863780, 'ino': 1099511630160, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3081410535, 'ino': 1099511633413, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 3081764736, 'ino': 1099511631258, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-74.xml'}, {'damage_type': 'backtrace', 'id': 3082209538, 'ino': 1099511632557, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-89.xml'}, {'damage_type': 'backtrace', 'id': 3082503649, 'ino': 1099511634119, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-14.xml'}, {'damage_type': 'backtrace', 'id': 3083022236, 'ino': 2199023263140, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-42.xml'}, {'damage_type': 'backtrace', 'id': 3085788294, 'ino': 1099511634634, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 3092115540, 'ino': 2199023267798, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 3092347262, 'ino': 2199023267323, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 3093121893, 'ino': 1099511631727, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 3093539113, 'ino': 1099511634796, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-11.xml'}, {'damage_type': 'backtrace', 'id': 3095732871, 'ino': 2199023259459, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3096562965, 'ino': 2199023267557, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3098790746, 'ino': 1099511634418, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 3101871324, 'ino': 1099511634035, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 3102459880, 'ino': 2199023267528, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 3107556758, 'ino': 1099511633501, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 3107695130, 'ino': 2199023261235, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-35.xml'}, {'damage_type': 'backtrace', 'id': 3107955310, 'ino': 1099511634068, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 3109065591, 'ino': 1099511634421, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 3109131356, 'ino': 2199023264204, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 3113166746, 'ino': 2199023267325, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3114395959, 'ino': 1099511631844, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 3116848791, 'ino': 2199023266036, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3121350147, 'ino': 2199023259585, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3126945055, 'ino': 2199023264072, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3128033196, 'ino': 1099511634085, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 3128780934, 'ino': 1099511633933, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-92.xml'}, {'damage_type': 'backtrace', 'id': 3130402115, 'ino': 2199023262976, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3130990436, 'ino': 2199023264085, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-97.xml'}, {'damage_type': 'backtrace', 'id': 3143934491, 'ino': 2199023264040, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-29.xml'}, {'damage_type': 'backtrace', 'id': 3143936270, 'ino': 2199023267040, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-65.xml'}, {'damage_type': 'backtrace', 'id': 3148829310, 'ino': 2199023263138, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3150606356, 'ino': 1099511634694, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 3151771931, 'ino': 1099511633972, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 3153845732, 'ino': 2199023266121, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3157917883, 'ino': 2199023257240, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3160160929, 'ino': 1099511631008, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3161135814, 'ino': 2199023261552, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3166191696, 'ino': 1099511634196, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-88.xml'}, {'damage_type': 'backtrace', 'id': 3166948832, 'ino': 1099511634363, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-22.xml'}, {'damage_type': 'backtrace', 'id': 3173072461, 'ino': 1099511633116, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3174081706, 'ino': 1099511634229, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 3174124266, 'ino': 2199023267652, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3175310344, 'ino': 1099511631010, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3185135632, 'ino': 1099511634299, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 3187870857, 'ino': 2199023263355, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-79.xml'}, {'damage_type': 'backtrace', 'id': 3189798930, 'ino': 2199023259708, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 3196257062, 'ino': 2199023259477, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-26.xml'}, {'damage_type': 'backtrace', 'id': 3197626864, 'ino': 2199023267536, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3199047375, 'ino': 2199023263421, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3199529832, 'ino': 2199023265950, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3201441589, 'ino': 2199023259739, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 3202579025, 'ino': 1099511630804, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3202837473, 'ino': 1099511634717, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 3208834303, 'ino': 2199023261875, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-90.xml'}, {'damage_type': 'backtrace', 'id': 3211652788, 'ino': 1099511630126, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3215138748, 'ino': 1099511634294, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-60.xml'}, {'damage_type': 'backtrace', 'id': 3216936583, 'ino': 1099511636522, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3220200633, 'ino': 2199023257714, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 3220613668, 'ino': 2199023257693, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-67.jpg'}, {'damage_type': 'backtrace', 'id': 3220696434, 'ino': 2199023261462, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 3222392887, 'ino': 2199023266042, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3223050424, 'ino': 1099511630217, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-79.jpg'}, {'damage_type': 'backtrace', 'id': 3224113065, 'ino': 2199023259724, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3225251128, 'ino': 2199023257795, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 3226628132, 'ino': 1099511634129, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 3226708777, 'ino': 1099511631425, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-71.xml'}, {'damage_type': 'backtrace', 'id': 3231132269, 'ino': 1099511630737, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 3233908106, 'ino': 2199023267028, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-69.xml'}, {'damage_type': 'backtrace', 'id': 3234520366, 'ino': 2199023259949, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-58.xml'}, {'damage_type': 'backtrace', 'id': 3237427869, 'ino': 2199023267384, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-77.jpg'}, {'damage_type': 'backtrace', 'id': 3240193225, 'ino': 1099511634335, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 3240806970, 'ino': 2199023263343, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-83.xml'}, {'damage_type': 'backtrace', 'id': 3242718771, 'ino': 2199023262884, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 3251361180, 'ino': 2199023264348, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 3253114176, 'ino': 1099511633955, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 3254432330, 'ino': 1099511634003, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 3257683648, 'ino': 2199023264097, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3260102318, 'ino': 1099511634290, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 3262841084, 'ino': 1099511633563, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-5.xml'}, {'damage_type': 'backtrace', 'id': 3265210726, 'ino': 2199023263165, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-32.xml'}, {'damage_type': 'backtrace', 'id': 3265394021, 'ino': 2199023267094, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-47.xml'}, {'damage_type': 'backtrace', 'id': 3265758544, 'ino': 1099511634628, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-30.xml'}, {'damage_type': 'backtrace', 'id': 3266137709, 'ino': 1099511631545, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-76.xml'}, {'damage_type': 'backtrace', 'id': 3268370160, 'ino': 2199023267286, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-13.xml'}, {'damage_type': 'backtrace', 'id': 3268817656, 'ino': 2199023267595, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-14.jpg'}, {'damage_type': 'backtrace', 'id': 3268882759, 'ino': 1099511633493, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 3271646065, 'ino': 2199023257976, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3272874602, 'ino': 2199023266115, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3273418185, 'ino': 2199023267017, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-73.xml'}, {'damage_type': 'backtrace', 'id': 3273568821, 'ino': 2199023266093, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3283030543, 'ino': 1099511634056, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-45.xml'}, {'damage_type': 'backtrace', 'id': 3285355416, 'ino': 2199023267576, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-43.xml'}, {'damage_type': 'backtrace', 'id': 3285706819, 'ino': 2199023267403, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 3295873817, 'ino': 2199023266065, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 3298265909, 'ino': 1099511632953, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-55.xml'}, {'damage_type': 'backtrace', 'id': 3299644144, 'ino': 1099511634698, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 3299963248, 'ino': 2199023266052, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 3300122032, 'ino': 2199023267079, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-52.xml'}, {'damage_type': 'backtrace', 'id': 3301346577, 'ino': 2199023274829, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 3303198740, 'ino': 1099511632801, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3303312470, 'ino': 2199023262819, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-13.xml'}, {'damage_type': 'backtrace', 'id': 3304640554, 'ino': 2199023265992, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 3306231469, 'ino': 2199023267519, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 3312900638, 'ino': 1099511630350, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 3313459173, 'ino': 1099511634026, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 3316167259, 'ino': 2199023267756, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 3317707666, 'ino': 2199023262871, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 3318248619, 'ino': 2199023262628, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-15.xml'}, {'damage_type': 'backtrace', 'id': 3318354524, 'ino': 2199023263238, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3318677441, 'ino': 2199023261486, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 3322471199, 'ino': 1099511633057, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-89.xml'}, {'damage_type': 'backtrace', 'id': 3323269959, 'ino': 1099511631740, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 3324479296, 'ino': 1099511633971, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 3326136571, 'ino': 2199023263433, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3329614038, 'ino': 2199023261990, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 3337900060, 'ino': 2199023266018, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 3338187820, 'ino': 2199023267415, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 3340547491, 'ino': 2199023265978, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 3341556102, 'ino': 2199023259429, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-34.xml'}, {'damage_type': 'backtrace', 'id': 3351425669, 'ino': 2199023267516, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 3351953371, 'ino': 1099511634084, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 3352102683, 'ino': 1099511630989, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 3356501705, 'ino': 1099511634074, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-36.xml'}, {'damage_type': 'backtrace', 'id': 3357814532, 'ino': 2199023263196, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3359132552, 'ino': 2199023263917, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-58.xml'}, {'damage_type': 'backtrace', 'id': 3361399201, 'ino': 1099511630185, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3361666787, 'ino': 1099511633980, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 3363785461, 'ino': 1099511634240, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 3367777481, 'ino': 2199023262445, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 3367980056, 'ino': 2199023262034, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 3369805122, 'ino': 1099511630318, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 3375825773, 'ino': 1099511631417, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-73.xml'}, {'damage_type': 'backtrace', 'id': 3386412348, 'ino': 2199023263098, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-59.xml'}, {'damage_type': 'backtrace', 'id': 3394985404, 'ino': 2199023264210, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3396815126, 'ino': 2199023264181, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3397531691, 'ino': 2199023267124, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3404361960, 'ino': 1099511635736, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-64.xml'}, {'damage_type': 'backtrace', 'id': 3404455165, 'ino': 2199023261643, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3406227409, 'ino': 1099511631155, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-48.xml'}, {'damage_type': 'backtrace', 'id': 3407339356, 'ino': 2199023258531, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-30.xml'}, {'damage_type': 'backtrace', 'id': 3407529470, 'ino': 2199023263874, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-67.xml'}, {'damage_type': 'backtrace', 'id': 3409749033, 'ino': 1099511634473, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 3415624255, 'ino': 2199023262620, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 3416941346, 'ino': 1099511630154, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3417749278, 'ino': 2199023263966, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-48.xml'}, {'damage_type': 'backtrace', 'id': 3418154414, 'ino': 2199023262985, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3420383713, 'ino': 2199023261386, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3422492951, 'ino': 2199023267638, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3422510411, 'ino': 2199023262844, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3426114206, 'ino': 2199023267847, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 3427634270, 'ino': 2199023267604, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3434452838, 'ino': 2199023267850, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3434830909, 'ino': 2199023261273, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3436174511, 'ino': 1099511634404, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-79.xml'}, {'damage_type': 'backtrace', 'id': 3436381835, 'ino': 1099511633590, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 3438085034, 'ino': 2199023261163, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-55.xml'}, {'damage_type': 'backtrace', 'id': 3440496058, 'ino': 2199023267707, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-82.jpg'}, {'damage_type': 'backtrace', 'id': 3441229142, 'ino': 2199023267380, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3443141157, 'ino': 1099511631238, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 3451302869, 'ino': 2199023258014, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 3453695634, 'ino': 1099511634296, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-59.xml'}, {'damage_type': 'backtrace', 'id': 3454701494, 'ino': 3298534887183, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 3455105640, 'ino': 2199023261167, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3458601702, 'ino': 2199023263032, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 3460007380, 'ino': 2199023259440, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 3460244901, 'ino': 2199023261470, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 3460969016, 'ino': 2199023262824, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3463647303, 'ino': 1099511634094, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 3471041599, 'ino': 1099511630132, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-86.xml'}, {'damage_type': 'backtrace', 'id': 3472250777, 'ino': 2199023266091, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3475073122, 'ino': 2199023259465, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-28.xml'}, {'damage_type': 'backtrace', 'id': 3476948778, 'ino': 2199023263262, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-3.xml'}, {'damage_type': 'backtrace', 'id': 3489063652, 'ino': 2199023267713, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 3495995434, 'ino': 2199023265944, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3501026619, 'ino': 2199023261993, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 3501134448, 'ino': 1099511630113, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-45.xml'}, {'damage_type': 'backtrace', 'id': 3507512896, 'ino': 2199023257686, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 3512257350, 'ino': 2199023263384, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-70.xml'}, {'damage_type': 'backtrace', 'id': 3519946268, 'ino': 1099511634325, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-48.xml'}, {'damage_type': 'backtrace', 'id': 3522368043, 'ino': 1099511631225, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-93.xml'}, {'damage_type': 'backtrace', 'id': 3523902990, 'ino': 1099511630186, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3525985888, 'ino': 2199023261492, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3527366181, 'ino': 2199023263013, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-16.jpg'}, {'damage_type': 'backtrace', 'id': 3529272318, 'ino': 1099511633995, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 3529840581, 'ino': 2199023258364, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-11.xml'}, {'damage_type': 'backtrace', 'id': 3531412706, 'ino': 1099511634494, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-40.xml'}, {'damage_type': 'backtrace', 'id': 3538024475, 'ino': 2199023267241, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3539688110, 'ino': 1099511636048, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 3540238003, 'ino': 2199023267386, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 3541047918, 'ino': 1099511636057, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 3545028271, 'ino': 2199023267234, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3545783393, 'ino': 2199023262963, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 3551295657, 'ino': 2199023257756, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 3554634540, 'ino': 2199023266105, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3558065008, 'ino': 2199023267841, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 3558095754, 'ino': 2199023260052, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 3558503302, 'ino': 2199023262831, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3559496619, 'ino': 1099511631428, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-70.xml'}, {'damage_type': 'backtrace', 'id': 3562104863, 'ino': 1099511632547, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-93.jpg'}, {'damage_type': 'backtrace', 'id': 3573172501, 'ino': 2199023263150, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-38.xml'}, {'damage_type': 'backtrace', 'id': 3576566703, 'ino': 2199023259765, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3576952544, 'ino': 2199023259602, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3577848310, 'ino': 1099511636193, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 3577878801, 'ino': 2199023267513, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3578718617, 'ino': 2199023267321, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3579256525, 'ino': 1099511634478, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 3579299518, 'ino': 1099511630742, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 3579817211, 'ino': 1099511635677, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-2.xml'}, {'damage_type': 'backtrace', 'id': 3582039840, 'ino': 2199023267563, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 3582120818, 'ino': 2199023259471, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3585663798, 'ino': 2199023266030, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-47.jpg'}, {'damage_type': 'backtrace', 'id': 3591421664, 'ino': 2199023263316, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-92.xml'}, {'damage_type': 'backtrace', 'id': 3592831919, 'ino': 2199023267272, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 3605443329, 'ino': 2199023263424, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3605970836, 'ino': 2199023261622, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 3611144420, 'ino': 2199023262933, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3613100128, 'ino': 2199023267031, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-68.xml'}, {'damage_type': 'backtrace', 'id': 3613125007, 'ino': 2199023258515, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-34.xml'}, {'damage_type': 'backtrace', 'id': 3613834797, 'ino': 1099511630114, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-77.xml'}, {'damage_type': 'backtrace', 'id': 3614912915, 'ino': 2199023259529, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-15.xml'}, {'damage_type': 'backtrace', 'id': 3622384277, 'ino': 1099511630309, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-71.jpg'}, {'damage_type': 'backtrace', 'id': 3624883057, 'ino': 2199023262941, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 3628661006, 'ino': 1099511633445, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 3630499283, 'ino': 1099511634930, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 3634849733, 'ino': 1099511634059, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-43.xml'}, {'damage_type': 'backtrace', 'id': 3635233269, 'ino': 1099511631806, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-2.xml'}, {'damage_type': 'backtrace', 'id': 3635543119, 'ino': 1099511630332, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 3646335413, 'ino': 2199023263337, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-85.xml'}, {'damage_type': 'backtrace', 'id': 3647402747, 'ino': 2199023263381, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-71.xml'}, {'damage_type': 'backtrace', 'id': 3651085019, 'ino': 2199023261512, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-36.jpg'}, {'damage_type': 'backtrace', 'id': 3653482199, 'ino': 2199023266054, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-35.jpg'}, {'damage_type': 'backtrace', 'id': 3653668319, 'ino': 2199023267374, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 3656243151, 'ino': 1099511634111, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 3656992514, 'ino': 2199023263993, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-41.xml'}, {'damage_type': 'backtrace', 'id': 3663094625, 'ino': 1099511630360, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-28.jpg'}, {'damage_type': 'backtrace', 'id': 3667927009, 'ino': 1099511631662, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-36.xml'}, {'damage_type': 'backtrace', 'id': 3670419339, 'ino': 1099511634399, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-83.xml'}, {'damage_type': 'backtrace', 'id': 3673597424, 'ino': 2199023265988, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 3673776483, 'ino': 1099511634036, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-52.xml'}, {'damage_type': 'backtrace', 'id': 3674427144, 'ino': 2199023267655, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3676642327, 'ino': 1099511630182, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-10.xml'}, {'damage_type': 'backtrace', 'id': 3684388467, 'ino': 2199023263017, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 3691736905, 'ino': 2199023264168, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-4.xml'}, {'damage_type': 'backtrace', 'id': 3692537365, 'ino': 1099511635656, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-63.xml'}, {'damage_type': 'backtrace', 'id': 3694127551, 'ino': 2199023259525, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3704118613, 'ino': 2199023257405, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-33.xml'}, {'damage_type': 'backtrace', 'id': 3706477715, 'ino': 2199023263406, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-63.xml'}, {'damage_type': 'backtrace', 'id': 3706692247, 'ino': 3298534887160, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 3707277668, 'ino': 2199023258393, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-5.xml'}, {'damage_type': 'backtrace', 'id': 3708243167, 'ino': 2199023267498, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 3709555321, 'ino': 2199023263210, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-18.xml'}, {'damage_type': 'backtrace', 'id': 3709726648, 'ino': 2199023263365, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-76.xml'}, {'damage_type': 'backtrace', 'id': 3710209247, 'ino': 1099511634032, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-54.xml'}, {'damage_type': 'backtrace', 'id': 3717411159, 'ino': 2199023263167, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-31.xml'}, {'damage_type': 'backtrace', 'id': 3717673276, 'ino': 2199023261228, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3718061143, 'ino': 2199023257808, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 3719838845, 'ino': 1099511633975, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 3723010738, 'ino': 1099511630190, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3726995907, 'ino': 2199023259594, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3727049716, 'ino': 2199023263923, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-57.xml'}, {'damage_type': 'backtrace', 'id': 3729563706, 'ino': 2199023258591, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-13.xml'}, {'damage_type': 'backtrace', 'id': 3730378155, 'ino': 2199023267121, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-39.xml'}, {'damage_type': 'backtrace', 'id': 3733589813, 'ino': 2199023267738, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-72.jpg'}, {'damage_type': 'backtrace', 'id': 3734330627, 'ino': 1099511631250, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-81.xml'}, {'damage_type': 'backtrace', 'id': 3734478363, 'ino': 2199023262039, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-67.xml'}, {'damage_type': 'backtrace', 'id': 3736550045, 'ino': 2199023266002, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-61.jpg'}, {'damage_type': 'backtrace', 'id': 3737129648, 'ino': 2199023257204, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-64.xml'}, {'damage_type': 'backtrace', 'id': 3740392276, 'ino': 1099511631707, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 3742980380, 'ino': 2199023266087, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-19.jpg'}, {'damage_type': 'backtrace', 'id': 3744617684, 'ino': 2199023257510, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3745306263, 'ino': 2199023267624, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3745965187, 'ino': 1099511634075, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-35.xml'}, {'damage_type': 'backtrace', 'id': 3748457334, 'ino': 2199023257500, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3748946987, 'ino': 2199023267207, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3751946717, 'ino': 2199023267777, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 3752445333, 'ino': 2199023263943, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-53.xml'}, {'damage_type': 'backtrace', 'id': 3753385123, 'ino': 2199023263034, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-17.jpg'}, {'damage_type': 'backtrace', 'id': 3754734842, 'ino': 2199023263372, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-74.xml'}, {'damage_type': 'backtrace', 'id': 3754777596, 'ino': 1099511634517, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-96.xml'}, {'damage_type': 'backtrace', 'id': 3755237293, 'ino': 2199023267174, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-25.xml'}, {'damage_type': 'backtrace', 'id': 3757407189, 'ino': 2199023259622, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3758420652, 'ino': 1099511631421, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-72.xml'}, {'damage_type': 'backtrace', 'id': 3758939564, 'ino': 2199023259412, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-37.xml'}, {'damage_type': 'backtrace', 'id': 3759104273, 'ino': 2199023267392, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 3759352267, 'ino': 2199023257343, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-39.xml'}, {'damage_type': 'backtrace', 'id': 3761631630, 'ino': 2199023261306, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3774039513, 'ino': 2199023265972, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 3774062909, 'ino': 1099511634115, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 3774830763, 'ino': 2199023267630, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 3776502426, 'ino': 1099511634741, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-17.xml'}, {'damage_type': 'backtrace', 'id': 3785479753, 'ino': 2199023267335, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-91.jpg'}, {'damage_type': 'backtrace', 'id': 3790837311, 'ino': 2199023267629, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-24.xml'}, {'damage_type': 'backtrace', 'id': 3791751949, 'ino': 1099511630748, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-20.jpg'}, {'damage_type': 'backtrace', 'id': 3792658180, 'ino': 1099511633937, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-88.xml'}, {'damage_type': 'backtrace', 'id': 3792956575, 'ino': 2199023259336, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-52.xml'}, {'damage_type': 'backtrace', 'id': 3794360189, 'ino': 1099511630328, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 3798836436, 'ino': 1099511634108, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-23.xml'}, {'damage_type': 'backtrace', 'id': 3803977311, 'ino': 1099511630347, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-41.jpg'}, {'damage_type': 'backtrace', 'id': 3804904271, 'ino': 2199023259747, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-10.jpg'}, {'damage_type': 'backtrace', 'id': 3806491185, 'ino': 2199023258483, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-42.xml'}, {'damage_type': 'backtrace', 'id': 3811539837, 'ino': 2199023262829, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-9.xml'}, {'damage_type': 'backtrace', 'id': 3812183548, 'ino': 1099511634424, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-62.xml'}, {'damage_type': 'backtrace', 'id': 3814905214, 'ino': 1099511631659, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-7.xml'}, {'damage_type': 'backtrace', 'id': 3816250200, 'ino': 1099511631388, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-78.xml'}, {'damage_type': 'backtrace', 'id': 3816626169, 'ino': 1099511630341, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-44.jpg'}, {'damage_type': 'backtrace', 'id': 3817608064, 'ino': 2199023263290, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3820181242, 'ino': 1099511631542, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3821513990, 'ino': 1099511634411, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 3822233823, 'ino': 2199023267203, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-17.xml'}, {'damage_type': 'backtrace', 'id': 3825050772, 'ino': 2199023263319, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-91.xml'}, {'damage_type': 'backtrace', 'id': 3826420128, 'ino': 2199023262849, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3826719249, 'ino': 2199023265964, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-80.jpg'}, {'damage_type': 'backtrace', 'id': 3840590374, 'ino': 1099511630275, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-75.jpg'}, {'damage_type': 'backtrace', 'id': 3843165113, 'ino': 2199023267873, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 3848851516, 'ino': 1099511634624, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-93.xml'}, {'damage_type': 'backtrace', 'id': 3857974484, 'ino': 2199023259635, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 3859750699, 'ino': 2199023263224, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3861238423, 'ino': 1099511634342, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-38.xml'}, {'damage_type': 'backtrace', 'id': 3863415388, 'ino': 2199023267073, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-54.xml'}, {'damage_type': 'backtrace', 'id': 3863422253, 'ino': 2199023262889, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 3863838399, 'ino': 2199023267810, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3866163713, 'ino': 2199023266119, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 3867484055, 'ino': 1099511634822, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-9.xml'}, {'damage_type': 'backtrace', 'id': 3871331982, 'ino': 2199023267486, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3871597805, 'ino': 2199023263074, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-4.jpg'}, {'damage_type': 'backtrace', 'id': 3873595217, 'ino': 2199023261998, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 3874589895, 'ino': 1099511634729, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 3880564900, 'ino': 2199023259626, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-43.jpg'}, {'damage_type': 'backtrace', 'id': 3884589628, 'ino': 2199023259685, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 3886256627, 'ino': 2199023258937, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/article-75.xml'}, {'damage_type': 'backtrace', 'id': 3889975467, 'ino': 2199023258553, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-22.xml'}, {'damage_type': 'backtrace', 'id': 3890235790, 'ino': 2199023267583, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 3891925912, 'ino': 2199023259771, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-75.xml'}, {'damage_type': 'backtrace', 'id': 3894700725, 'ino': 1099511634268, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-69.xml'}, {'damage_type': 'backtrace', 'id': 3897152808, 'ino': 1099511631232, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-88.xml'}, {'damage_type': 'backtrace', 'id': 3900204846, 'ino': 1099511630208, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-1.xml'}, {'damage_type': 'backtrace', 'id': 3901248921, 'ino': 2199023263217, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3903060277, 'ino': 2199023267684, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-7.xml'}, {'damage_type': 'backtrace', 'id': 3905509817, 'ino': 2199023262561, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 3907264915, 'ino': 2199023261323, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-14.xml'}, {'damage_type': 'backtrace', 'id': 3907529769, 'ino': 1099511634958, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-1.xml'}, {'damage_type': 'backtrace', 'id': 3908816344, 'ino': 1099511634142, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 3909692717, 'ino': 2199023261528, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 3910030279, 'ino': 1099511634410, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-76.xml'}, {'damage_type': 'backtrace', 'id': 3910665523, 'ino': 1099511631699, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-66.xml'}, {'damage_type': 'backtrace', 'id': 3911090247, 'ino': 2199023264156, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-6.xml'}, {'damage_type': 'backtrace', 'id': 3911708672, 'ino': 1099511634381, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-6.xml'}, {'damage_type': 'backtrace', 'id': 3911737458, 'ino': 2199023267816, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-46.jpg'}, {'damage_type': 'backtrace', 'id': 3912876836, 'ino': 1099511634705, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/comment-82.xml'}, {'damage_type': 'backtrace', 'id': 3915010925, 'ino': 2199023261880, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 3918842840, 'ino': 1099511630159, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-23.xml'}, {'damage_type': 'backtrace', 'id': 3920807764, 'ino': 1099511634389, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-91.xml'}, {'damage_type': 'backtrace', 'id': 3923733558, 'ino': 2199023259977, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-55.xml'}, {'damage_type': 'backtrace', 'id': 3925798261, 'ino': 1099511634028, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-56.xml'}, {'damage_type': 'backtrace', 'id': 3926226393, 'ino': 2199023263450, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-51.xml'}, {'damage_type': 'backtrace', 'id': 3929100854, 'ino': 2199023262914, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-49.jpg'}, {'damage_type': 'backtrace', 'id': 3929442916, 'ino': 2199023263061, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 3929928162, 'ino': 2199023258461, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-1.jpg'}, {'damage_type': 'backtrace', 'id': 3929968330, 'ino': 2199023262961, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 3931275541, 'ino': 2199023267424, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 3933415051, 'ino': 1099511630105, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-48.xml'}, {'damage_type': 'backtrace', 'id': 3936499156, 'ino': 2199023266113, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3939114758, 'ino': 2199023258428, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-9.jpg'}, {'damage_type': 'backtrace', 'id': 3942695090, 'ino': 1099511635671, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-3.xml'}, {'damage_type': 'backtrace', 'id': 3943052069, 'ino': 2199023257702, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/picture-65.jpg'}, {'damage_type': 'backtrace', 'id': 3947929089, 'ino': 1099511634204, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-85.xml'}, {'damage_type': 'backtrace', 'id': 3949164589, 'ino': 2199023264101, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-16.xml'}, {'damage_type': 'backtrace', 'id': 3949321585, 'ino': 1099511633464, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-32.xml'}, {'damage_type': 'backtrace', 'id': 3949446900, 'ino': 2199023262909, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 3952080081, 'ino': 2199023267458, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3952624329, 'ino': 2199023263049, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 3954181374, 'ino': 2199023261888, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-87.xml'}, {'damage_type': 'backtrace', 'id': 3954235360, 'ino': 2199023258610, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-8.xml'}, {'damage_type': 'backtrace', 'id': 3954848763, 'ino': 2199023263047, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3955061240, 'ino': 2199023259357, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-47.xml'}, {'damage_type': 'backtrace', 'id': 3960667120, 'ino': 2199023267726, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-76.jpg'}, {'damage_type': 'backtrace', 'id': 3961502712, 'ino': 2199023261143, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-60.xml'}, {'damage_type': 'backtrace', 'id': 3961642274, 'ino': 2199023267543, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-31.jpg'}, {'damage_type': 'backtrace', 'id': 3962769264, 'ino': 2199023267710, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-81.jpg'}, {'damage_type': 'backtrace', 'id': 3967858658, 'ino': 2199023267622, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-27.xml'}, {'damage_type': 'backtrace', 'id': 3977647676, 'ino': 2199023267330, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-48.jpg'}, {'damage_type': 'backtrace', 'id': 3979192788, 'ino': 2199023263068, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 3984165007, 'ino': 2199023261895, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-85.xml'}, {'damage_type': 'backtrace', 'id': 3988686044, 'ino': 2199023267026, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-70.xml'}, {'damage_type': 'backtrace', 'id': 3989270756, 'ino': 2199023267598, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 3989673851, 'ino': 1099511634489, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 3993567008, 'ino': 1099511636068, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-34.xml'}, {'damage_type': 'backtrace', 'id': 3996000438, 'ino': 1099511634020, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-39.xml'}, {'damage_type': 'backtrace', 'id': 3999592823, 'ino': 1099511634102, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 4001431570, 'ino': 2199023264337, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-21.jpg'}, {'damage_type': 'backtrace', 'id': 4001955855, 'ino': 1099511634709, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-36.xml'}, {'damage_type': 'backtrace', 'id': 4002171708, 'ino': 1099511633450, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-37.xml'}, {'damage_type': 'backtrace', 'id': 4002841686, 'ino': 2199023262814, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/article-15.xml'}, {'damage_type': 'backtrace', 'id': 4004328063, 'ino': 2199023266012, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 4005530544, 'ino': 2199023263953, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/article-1.xml'}, {'damage_type': 'backtrace', 'id': 4006864094, 'ino': 2199023264198, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-37.jpg'}, {'damage_type': 'backtrace', 'id': 4008519070, 'ino': 2199023259697, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-23.jpg'}, {'damage_type': 'backtrace', 'id': 4012006882, 'ino': 1099511630142, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-32.xml'}, {'damage_type': 'backtrace', 'id': 4012098267, 'ino': 1099511634062, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 4012626410, 'ino': 2199023267750, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-68.jpg'}, {'damage_type': 'backtrace', 'id': 4015530477, 'ino': 1099511634433, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 4019546056, 'ino': 2199023259754, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 4020864137, 'ino': 2199023259563, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-8.xml'}, {'damage_type': 'backtrace', 'id': 4021048503, 'ino': 1099511634226, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/article-43.xml'}, {'damage_type': 'backtrace', 'id': 4021223055, 'ino': 2199023258523, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-32.xml'}, {'damage_type': 'backtrace', 'id': 4023042460, 'ino': 1099511630825, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-5.jpg'}, {'damage_type': 'backtrace', 'id': 4025481713, 'ino': 1099511630152, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-26.xml'}, {'damage_type': 'backtrace', 'id': 4026937136, 'ino': 1099511630171, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-15.xml'}, {'damage_type': 'backtrace', 'id': 4032399129, 'ino': 2199023264122, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-12.xml'}, {'damage_type': 'backtrace', 'id': 4034669700, 'ino': 2199023267592, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 4035860367, 'ino': 2199023267601, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 4039970842, 'ino': 2199023261438, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-55.jpg'}, {'damage_type': 'backtrace', 'id': 4050565386, 'ino': 2199023263145, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-40.xml'}, {'damage_type': 'backtrace', 'id': 4052545941, 'ino': 1099511634371, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/article-8.xml'}, {'damage_type': 'backtrace', 'id': 4053152003, 'ino': 2199023267500, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 4054819470, 'ino': 2199023267061, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-58.xml'}, {'damage_type': 'backtrace', 'id': 4055807187, 'ino': 2199023267691, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-5.xml'}, {'damage_type': 'backtrace', 'id': 4056007968, 'ino': 2199023262911, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 4056064346, 'ino': 2199023267564, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-24.jpg'}, {'damage_type': 'backtrace', 'id': 4057813731, 'ino': 2199023267360, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-84.jpg'}, {'damage_type': 'backtrace', 'id': 4063669545, 'ino': 2199023263362, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-77.xml'}, {'damage_type': 'backtrace', 'id': 4064106986, 'ino': 3298534884749, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-38.jpg'}, {'damage_type': 'backtrace', 'id': 4066274981, 'ino': 2199023266022, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-51.jpg'}, {'damage_type': 'backtrace', 'id': 4069493725, 'ino': 1099511630327, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-56.jpg'}, {'damage_type': 'backtrace', 'id': 4070917394, 'ino': 2199023260114, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-44.xml'}, {'damage_type': 'backtrace', 'id': 4072401667, 'ino': 1099511634045, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-27.xml'}, {'damage_type': 'backtrace', 'id': 4078930295, 'ino': 1099511634127, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-8.xml'}, {'damage_type': 'backtrace', 'id': 4079220447, 'ino': 1099511634202, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-86.xml'}, {'damage_type': 'backtrace', 'id': 4080479979, 'ino': 2199023267534, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-34.jpg'}, {'damage_type': 'backtrace', 'id': 4081375444, 'ino': 2199023267280, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 4083962607, 'ino': 1099511634080, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-33.xml'}, {'damage_type': 'backtrace', 'id': 4085545374, 'ino': 1099511634365, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 4089349434, 'ino': 1099511630359, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-29.jpg'}, {'damage_type': 'backtrace', 'id': 4091212764, 'ino': 2199023257759, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-14/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 4094365856, 'ino': 2199023261366, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-6.xml'}, {'damage_type': 'backtrace', 'id': 4096001894, 'ino': 2199023261195, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-46.xml'}, {'damage_type': 'backtrace', 'id': 4096992108, 'ino': 1099511630206, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-2.xml'}, {'damage_type': 'backtrace', 'id': 4098056908, 'ino': 2199023259701, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 4098728642, 'ino': 1099511634398, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-84.xml'}, {'damage_type': 'backtrace', 'id': 4102813652, 'ino': 1099511634065, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-19.xml'}, {'damage_type': 'backtrace', 'id': 4102856741, 'ino': 2199023263255, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-5.xml'}, {'damage_type': 'backtrace', 'id': 4103283139, 'ino': 2199023257212, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-62.xml'}, {'damage_type': 'backtrace', 'id': 4104071788, 'ino': 1099511630723, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 4105776598, 'ino': 2199023264049, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-27.xml'}, {'damage_type': 'backtrace', 'id': 4107821171, 'ino': 2199023266020, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-52.jpg'}, {'damage_type': 'backtrace', 'id': 4112119374, 'ino': 1099511630333, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-50.jpg'}, {'damage_type': 'backtrace', 'id': 4117602404, 'ino': 2199023259548, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-11.xml'}, {'damage_type': 'backtrace', 'id': 4118002611, 'ino': 2199023267268, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-62.jpg'}, {'damage_type': 'backtrace', 'id': 4118665103, 'ino': 1099511634272, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-68.xml'}, {'damage_type': 'backtrace', 'id': 4119118070, 'ino': 2199023267669, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-12.xml'}, {'damage_type': 'backtrace', 'id': 4119395177, 'ino': 2199023259375, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-99.xml'}, {'damage_type': 'backtrace', 'id': 4120842776, 'ino': 2199023262616, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-18.xml'}, {'damage_type': 'backtrace', 'id': 4122406440, 'ino': 2199023267819, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-45.jpg'}, {'damage_type': 'backtrace', 'id': 4124575237, 'ino': 1099511630200, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-4.xml'}, {'damage_type': 'backtrace', 'id': 4126841752, 'ino': 2199023267318, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/article-5.xml'}, {'damage_type': 'backtrace', 'id': 4128328556, 'ino': 1099511631869, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-49.xml'}, {'damage_type': 'backtrace', 'id': 4130961743, 'ino': 2199023258665, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/picture-25.jpg'}, {'damage_type': 'backtrace', 'id': 4132003565, 'ino': 2199023263031, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 4141157969, 'ino': 2199023266016, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 4142940968, 'ino': 1099511633487, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-28.xml'}, {'damage_type': 'backtrace', 'id': 4148891154, 'ino': 2199023262981, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-22.jpg'}, {'damage_type': 'backtrace', 'id': 4150797472, 'ino': 2199023267138, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-34.xml'}, {'damage_type': 'backtrace', 'id': 4151691166, 'ino': 2199023263947, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-52.xml'}, {'damage_type': 'backtrace', 'id': 4154863021, 'ino': 1099511631229, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-33.xml'}, {'damage_type': 'backtrace', 'id': 4155567583, 'ino': 2199023263080, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-49/picture-2.jpg'}, {'damage_type': 'backtrace', 'id': 4156681396, 'ino': 2199023264403, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-15.jpg'}, {'damage_type': 'backtrace', 'id': 4157488626, 'ino': 2199023264445, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-11.jpg'}, {'damage_type': 'backtrace', 'id': 4160196840, 'ino': 2199023267560, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 4160715996, 'ino': 2199023267110, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-42.xml'}, {'damage_type': 'backtrace', 'id': 4167183597, 'ino': 1099511630161, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-21.xml'}, {'damage_type': 'backtrace', 'id': 4168639458, 'ino': 1099511635640, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 4171705876, 'ino': 1099511635664, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/comment-4.xml'}, {'damage_type': 'backtrace', 'id': 4175934793, 'ino': 1099511633504, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-20.xml'}, {'damage_type': 'backtrace', 'id': 4180037823, 'ino': 2199023261661, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-3.jpg'}, {'damage_type': 'backtrace', 'id': 4182265194, 'ino': 2199023267555, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-27.jpg'}, {'damage_type': 'backtrace', 'id': 4182404388, 'ino': 2199023262936, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-40.jpg'}, {'damage_type': 'backtrace', 'id': 4183056279, 'ino': 2199023267606, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-33.xml'}, {'damage_type': 'backtrace', 'id': 4185377691, 'ino': 1099511634193, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-89.xml'}, {'damage_type': 'backtrace', 'id': 4194104124, 'ino': 2199023267304, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-53.jpg'}, {'damage_type': 'backtrace', 'id': 4195273345, 'ino': 2199023258479, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-43.xml'}, {'damage_type': 'backtrace', 'id': 4199437632, 'ino': 1099511634311, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/comment-53.xml'}, {'damage_type': 'backtrace', 'id': 4207131790, 'ino': 2199023261394, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-66.jpg'}, {'damage_type': 'backtrace', 'id': 4210562902, 'ino': 2199023263888, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-64.xml'}, {'damage_type': 'backtrace', 'id': 4210654212, 'ino': 2199023267698, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/article-3.xml'}, {'damage_type': 'backtrace', 'id': 4211421435, 'ino': 2199023263123, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-49.xml'}, {'damage_type': 'backtrace', 'id': 4211648051, 'ino': 1099511631720, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 4212520520, 'ino': 2199023263029, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 4216822259, 'ino': 1099511634750, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/comment-16.xml'}, {'damage_type': 'backtrace', 'id': 4217446057, 'ino': 2199023263864, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/article-69.xml'}, {'damage_type': 'backtrace', 'id': 4217562495, 'ino': 2199023267466, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 4221067100, 'ino': 2199023267530, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/picture-13.jpg'}, {'damage_type': 'backtrace', 'id': 4224753711, 'ino': 2199023260024, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/comment-51.xml'}, {'damage_type': 'backtrace', 'id': 4226529715, 'ino': 1099511630324, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-59.jpg'}, {'damage_type': 'backtrace', 'id': 4227529650, 'ino': 1099511633960, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-77.xml'}, {'damage_type': 'backtrace', 'id': 4227574149, 'ino': 2199023258622, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/article-5.xml'}, {'damage_type': 'backtrace', 'id': 4227908272, 'ino': 1099511630122, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/article-41.xml'}, {'damage_type': 'backtrace', 'id': 4236668646, 'ino': 1099511630329, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53/picture-54.jpg'}, {'damage_type': 'backtrace', 'id': 4237270096, 'ino': 1099511634425, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/comment-61.xml'}, {'damage_type': 'backtrace', 'id': 4241807136, 'ino': 2199023267735, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-73.jpg'}, {'damage_type': 'backtrace', 'id': 4243787206, 'ino': 2199023267220, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-81/article-12.xml'}, {'damage_type': 'backtrace', 'id': 4245170872, 'ino': 2199023263157, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-51/article-35.xml'}, {'damage_type': 'backtrace', 'id': 4253107843, 'ino': 1099511631703, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-65.xml'}, {'damage_type': 'backtrace', 'id': 4253510271, 'ino': 2199023259382, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/article-42.xml'}, {'damage_type': 'backtrace', 'id': 4254956381, 'ino': 1099511631014, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-6.jpg'}, {'damage_type': 'backtrace', 'id': 4256699990, 'ino': 1099511633979, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 4259271806, 'ino': 2199023257308, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-12/article-43.xml'}, {'damage_type': 'backtrace', 'id': 4261301830, 'ino': 2199023262938, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-39.jpg'}, {'damage_type': 'backtrace', 'id': 4261531604, 'ino': 1099511630995, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-84/picture-18.jpg'}, {'damage_type': 'backtrace', 'id': 4268523134, 'ino': 2199023267546, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 4272764744, 'ino': 2199023263041, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-47/picture-8.jpg'}, {'damage_type': 'backtrace', 'id': 4272828164, 'ino': 1099511633439, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-24/comment-41.xml'}, {'damage_type': 'backtrace', 'id': 4274747131, 'ino': 1099511633991, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/comment-64.xml'}, {'damage_type': 'backtrace', 'id': 4276032086, 'ino': 1099511636093, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-71/comment-29.xml'}, {'damage_type': 'backtrace', 'id': 4277772513, 'ino': 2199023267540, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-83/picture-32.jpg'}, {'damage_type': 'backtrace', 'id': 4280256495, 'ino': 2199023261536, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/picture-30.jpg'}, {'damage_type': 'backtrace', 'id': 4283225970, 'ino': 2199023258416, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-18/picture-12.jpg'}, {'damage_type': 'backtrace', 'id': 4287797950, 'ino': 2199023264284, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-58/picture-26.jpg'}, {'damage_type': 'backtrace', 'id': 4289843588, 'ino': 2199023261335, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-35/article-13.xml'}, {'damage_type': 'backtrace', 'id': 4294440192, 'ino': 1099511633976, 'path': '/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-19/comment-66.xml'}] 2024-03-27T07:28:58.071 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-03-27T07:28:59.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:28:58 smithi149 ceph-mon[36065]: pgmap v164: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2024-03-27T07:28:59.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:28:58 smithi153 ceph-mon[36179]: pgmap v164: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2024-03-27T07:28:59.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:28:58 smithi082 ceph-mon[32178]: pgmap v164: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 14 MiB/s wr, 1.31k op/s 2024-03-27T07:29:01.006 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:00 smithi149 ceph-mon[36065]: pgmap v165: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-03-27T07:29:01.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:00 smithi153 ceph-mon[36179]: pgmap v165: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-03-27T07:29:01.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:00 smithi082 ceph-mon[32178]: pgmap v165: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-03-27T07:29:03.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:02 smithi153 ceph-mon[36179]: pgmap v166: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-03-27T07:29:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:02 smithi082 ceph-mon[32178]: pgmap v166: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-03-27T07:29:03.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:02 smithi149 ceph-mon[36065]: pgmap v166: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.22k op/s 2024-03-27T07:29:05.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:04 smithi153 ceph-mon[36179]: pgmap v167: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 1.25k op/s 2024-03-27T07:29:05.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:04 smithi082 ceph-mon[32178]: pgmap v167: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 1.25k op/s 2024-03-27T07:29:05.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:04 smithi149 ceph-mon[36065]: pgmap v167: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 13 MiB/s wr, 1.25k op/s 2024-03-27T07:29:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.434+0000 7fa24a93a640 1 -- 172.21.15.82:0/2205700752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa244110700 msgr2=0x7fa24410e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:06.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.434+0000 7fa24a93a640 1 --2- 172.21.15.82:0/2205700752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa244110700 0x7fa24410e3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa23c01acb0 tx=0x7fa23c03d150 comp rx=0 tx=0).stop 2024-03-27T07:29:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.435+0000 7fa24a93a640 1 -- 172.21.15.82:0/2205700752 shutdown_connections 2024-03-27T07:29:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.435+0000 7fa24a93a640 1 --2- 172.21.15.82:0/2205700752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24411b330 0x7fa24411d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.435+0000 7fa24a93a640 1 --2- 172.21.15.82:0/2205700752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa244110700 0x7fa24410e3f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.435+0000 7fa24a93a640 1 --2- 172.21.15.82:0/2205700752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa244110290 0x7fa24410deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.435+0000 7fa24a93a640 1 -- 172.21.15.82:0/2205700752 >> 172.21.15.82:0/2205700752 conn(0x7fa24406cbf0 msgr2=0x7fa24406d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:06.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.444+0000 7fa24a93a640 1 -- 172.21.15.82:0/2205700752 shutdown_connections 2024-03-27T07:29:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.444+0000 7fa24a93a640 1 -- 172.21.15.82:0/2205700752 wait complete. 2024-03-27T07:29:06.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.445+0000 7fa24a93a640 1 Processor -- start 2024-03-27T07:29:06.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.445+0000 7fa24a93a640 1 -- start start 2024-03-27T07:29:06.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.445+0000 7fa24a93a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa244110290 0x7fa24411aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.445+0000 7fa24a93a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa244110700 0x7fa244116a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.445+0000 7fa24a93a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa24411b330 0x7fa244116fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.445+0000 7fa24a93a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2441134f0 con 0x7fa244110290 2024-03-27T07:29:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.445+0000 7fa24a93a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa244113370 con 0x7fa244110700 2024-03-27T07:29:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.445+0000 7fa24a93a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa244113670 con 0x7fa24411b330 2024-03-27T07:29:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.445+0000 7fa243fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa244110290 0x7fa24411aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa248ed7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa24411b330 0x7fa244116fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa243fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa244110290 0x7fa24411aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40280/0 (socket says 172.21.15.82:40280) 2024-03-27T07:29:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa243fff640 1 -- 172.21.15.82:0/3918586127 learned_addr learned my addr 172.21.15.82:0/3918586127 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa2437fe640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa244110700 0x7fa244116a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa248ed7640 1 -- 172.21.15.82:0/3918586127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa244110700 msgr2=0x7fa244116a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa248ed7640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa244110700 0x7fa244116a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa248ed7640 1 -- 172.21.15.82:0/3918586127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa244110290 msgr2=0x7fa24411aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa248ed7640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa244110290 0x7fa24411aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa248ed7640 1 -- 172.21.15.82:0/3918586127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2441176d0 con 0x7fa24411b330 2024-03-27T07:29:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa2437fe640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa244110700 0x7fa244116a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:29:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa243fff640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa244110290 0x7fa24411aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:29:06.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.446+0000 7fa248ed7640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa24411b330 0x7fa244116fd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa23400e940 tx=0x7fa23400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.458+0000 7fa2417fa640 1 -- 172.21.15.82:0/3918586127 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23400ccc0 con 0x7fa24411b330 2024-03-27T07:29:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.458+0000 7fa2417fa640 1 -- 172.21.15.82:0/3918586127 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa2340035f0 con 0x7fa24411b330 2024-03-27T07:29:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.458+0000 7fa2417fa640 1 -- 172.21.15.82:0/3918586127 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23400ce60 con 0x7fa24411b330 2024-03-27T07:29:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.459+0000 7fa24a93a640 1 -- 172.21.15.82:0/3918586127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2441ab0d0 con 0x7fa24411b330 2024-03-27T07:29:06.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.459+0000 7fa24a93a640 1 -- 172.21.15.82:0/3918586127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2441ab480 con 0x7fa24411b330 2024-03-27T07:29:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.473+0000 7fa24d5f6740 1 Processor -- start 2024-03-27T07:29:06.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.474+0000 7fa24d5f6740 1 -- start start 2024-03-27T07:29:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.475+0000 7fa24d5f6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edba0f0 0x55d62edba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.475+0000 7fa24d5f6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.475+0000 7fa24d5f6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62edc5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.475+0000 7fa243fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.475+0000 7fa243fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:38914/0 (socket says 172.21.15.82:38914) 2024-03-27T07:29:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.475+0000 7fa243fff640 1 -- 172.21.15.82:0/3008919752 learned_addr learned my addr 172.21.15.82:0/3008919752 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.475+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3008919752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d62ed80cd0 con 0x55d62edc37e0 2024-03-27T07:29:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.476+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3008919752 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55d62ecc5950 con 0x55d62edba0f0 2024-03-27T07:29:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.476+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3008919752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d62ed1de50 con 0x55d62edbaa10 2024-03-27T07:29:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.476+0000 7fa243fff640 1 -- 172.21.15.82:0/3008919752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edba0f0 msgr2=0x55d62edba4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T07:29:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.476+0000 7fa243fff640 1 --2- 172.21.15.82:0/3008919752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edba0f0 0x55d62edba4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.479 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.476+0000 7fa243fff640 1 -- 172.21.15.82:0/3008919752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 msgr2=0x55d62edc5bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:29:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.476+0000 7fa2437fe640 1 --2- 172.21.15.82:0/3008919752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62edc5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.476+0000 7fa243fff640 1 --2- 172.21.15.82:0/3008919752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62edc5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.476+0000 7fa243fff640 1 -- 172.21.15.82:0/3008919752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62ea32210 con 0x55d62edbaa10 2024-03-27T07:29:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.476+0000 7fa2437fe640 1 --2- 172.21.15.82:0/3008919752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62edc5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:29:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.477+0000 7fa243fff640 1 --2- 172.21.15.82:0/3008919752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc32a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa238010580 tx=0x7fa238010a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=706e15ea550b10db server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.481+0000 7fa2417fa640 1 -- 172.21.15.82:0/3918586127 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fa234004020 con 0x7fa24411b330 2024-03-27T07:29:06.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.484+0000 7fa2417fa640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa22c0a3a50 0x7fa22c0a5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.484+0000 7fa2437fe640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa22c0a3a50 0x7fa22c0a5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.485+0000 7fa2417fa640 1 -- 172.21.15.82:0/3918586127 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa2340d0230 con 0x7fa24411b330 2024-03-27T07:29:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.485+0000 7fa2437fe640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa22c0a3a50 0x7fa22c0a5f10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa23c006010 tx=0x7fa23c03f040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.487+0000 7fa2327fc640 1 -- 172.21.15.82:0/3008919752 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23800e890 con 0x55d62edbaa10 2024-03-27T07:29:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.487+0000 7fa2327fc640 1 -- 172.21.15.82:0/3008919752 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa238011440 con 0x55d62edbaa10 2024-03-27T07:29:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.488+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3008919752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 msgr2=0x55d62edc32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.488+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/3008919752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc32a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa238010580 tx=0x7fa238010a40 comp rx=0 tx=0).stop 2024-03-27T07:29:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.488+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3008919752 shutdown_connections 2024-03-27T07:29:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.488+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/3008919752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62edc5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.488+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/3008919752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc32a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.488+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/3008919752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edba0f0 0x55d62edba4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.488+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3008919752 >> 172.21.15.82:0/3008919752 conn(0x55d62edb4a10 msgr2=0x55d62edb4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.519+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3008919752 shutdown_connections 2024-03-27T07:29:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.519+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3008919752 wait complete. 2024-03-27T07:29:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.519+0000 7fa24d5f6740 1 -- start start 2024-03-27T07:29:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.520+0000 7fa24d5f6740 1 Processor -- start 2024-03-27T07:29:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.520+0000 7fa24d5f6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edba0f0 0x55d62edc0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.520+0000 7fa24d5f6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edbaa10 0x55d62edc0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa243fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edba0f0 0x55d62edc0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa24d5f6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edc37e0 0x55d62edc12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa24d5f6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d62ed19e00 con 0x55d62edba0f0 2024-03-27T07:29:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa243fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edba0f0 0x55d62edc0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40298/0 (socket says 172.21.15.82:40298) 2024-03-27T07:29:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa243fff640 1 -- 172.21.15.82:0/2866632214 learned_addr learned my addr 172.21.15.82:0/2866632214 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2866632214 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55d62ecc6520 con 0x55d62edbaa10 2024-03-27T07:29:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2866632214 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55d62ecd98e0 con 0x55d62edc37e0 2024-03-27T07:29:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa24d5f6740 10 client.0 _ll_register_callbacks cb 0x55d62ed14a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:29:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa2437fe640 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edbaa10 0x55d62edc0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa248ed7640 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edc37e0 0x55d62edc12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa248ed7640 1 -- 172.21.15.82:0/2866632214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edbaa10 msgr2=0x55d62edc0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa248ed7640 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edbaa10 0x55d62edc0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.521+0000 7fa248ed7640 1 -- 172.21.15.82:0/2866632214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edba0f0 msgr2=0x55d62edc0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.522+0000 7fa248ed7640 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edba0f0 0x55d62edc0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.522+0000 7fa248ed7640 1 -- 172.21.15.82:0/2866632214 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62eafe620 con 0x55d62edc37e0 2024-03-27T07:29:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.522+0000 7fa243fff640 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edba0f0 0x55d62edc0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:29:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.522+0000 7fa248ed7640 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edc37e0 0x55d62edc12d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa2340cd940 tx=0x7fa2340056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1457a99c3d227342 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.534+0000 7fa2277fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:29:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.534+0000 7fa2277fe640 1 -- 172.21.15.82:0/2866632214 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2340b4070 con 0x55d62edc37e0 2024-03-27T07:29:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.534+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2866632214 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d62ed2b390 con 0x55d62edc37e0 2024-03-27T07:29:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.534+0000 7fa2277fe640 1 -- 172.21.15.82:0/2866632214 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa23409b800 con 0x55d62edc37e0 2024-03-27T07:29:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.534+0000 7fa2277fe640 1 -- 172.21.15.82:0/2866632214 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa2340b9020 con 0x55d62edc37e0 2024-03-27T07:29:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.534+0000 7fa24d5f6740 10 client.26647 fetch_fsmap learned FSMap version 30 2024-03-27T07:29:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.534+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2866632214 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d62edd2450 con 0x55d62edc37e0 2024-03-27T07:29:06.537 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.534+0000 7fa2277fe640 1 -- 172.21.15.82:0/2866632214 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55d62ed2b390 con 0x55d62edc37e0 2024-03-27T07:29:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.535+0000 7fa2277fe640 1 -- 172.21.15.82:0/2866632214 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa23409b270 con 0x55d62edc37e0 2024-03-27T07:29:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.535+0000 7fa24d5f6740 10 client.26647 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:29:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.535+0000 7fa24d5f6740 10 client.26647 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:29:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.535+0000 7fa24d5f6740 20 client.26647 populate_metadata read hostname 'smithi082' 2024-03-27T07:29:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.535+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d62edd3960 0x55d62edd5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.535+0000 7fa24d5f6740 4 client.26647 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:29:06.538 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.535+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2866632214 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d62ed256e0 con 0x55d62edd3960 2024-03-27T07:29:06.539 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.536+0000 7fa243fff640 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d62edd3960 0x55d62edd5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.538+0000 7fa2277fe640 10 client.26647 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:06.541 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.538+0000 7fa243fff640 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d62edd3960 0x55d62edd5d50 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3533a946d0cb827 server_cookie=bc7afba7ea568516 in_seq=0 out_seq=0 2024-03-27T07:29:06.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.543+0000 7fa2277fe640 1 -- 172.21.15.82:0/2866632214 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d62ed256e0 con 0x55d62edd3960 2024-03-27T07:29:06.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.543+0000 7fa2277fe640 10 client.26647 handle_command_reply: tid=0 2024-03-27T07:29:06.545 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.543+0000 7fa24d5f6740 1 client.26647 shutdown 2024-03-27T07:29:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2866632214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edc37e0 msgr2=0x55d62edc12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edc37e0 0x55d62edc12d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa2340cd940 tx=0x7fa2340056d0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2866632214 shutdown_connections 2024-03-27T07:29:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edc37e0 0x55d62edc12d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edbaa10 0x55d62edc0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d62edd3960 0x55d62edd5d50 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2866632214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edba0f0 0x55d62edc0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2866632214 >> 172.21.15.82:0/2866632214 conn(0x55d62edb4a10 msgr2=0x55d62edb6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa2277fe640 0 client.26647 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2866632214 shutdown_connections 2024-03-27T07:29:06.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.546+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2866632214 wait complete. 2024-03-27T07:29:06.551 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.549+0000 7fa24d5f6740 20 client.26647 trim_cache size 0 max 16384 2024-03-27T07:29:06.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.617+0000 7fa24d5f6740 1 Processor -- start 2024-03-27T07:29:06.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.618+0000 7fa24d5f6740 1 -- start start 2024-03-27T07:29:06.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.619+0000 7fa24d5f6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edba0f0 0x55d62edc2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.620+0000 7fa243fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edba0f0 0x55d62edc2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.620+0000 7fa243fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edba0f0 0x55d62edc2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:38926/0 (socket says 172.21.15.82:38926) 2024-03-27T07:29:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.620+0000 7fa243fff640 1 -- 172.21.15.82:0/2873336829 learned_addr learned my addr 172.21.15.82:0/2873336829 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.620+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edbaa10 0x55d62edcef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.620+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62eddb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.620+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2873336829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2441b6770 con 0x55d62edc37e0 2024-03-27T07:29:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.620+0000 7fa2437fe640 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edbaa10 0x55d62edcef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.621+0000 7fa248ed7640 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62eddb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.621+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2873336829 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa2441b3fe0 con 0x55d62edbaa10 2024-03-27T07:29:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.621+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2873336829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2441b1e30 con 0x55d62edba0f0 2024-03-27T07:29:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.621+0000 7fa243fff640 1 -- 172.21.15.82:0/2873336829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edbaa10 msgr2=0x55d62edcef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.621+0000 7fa243fff640 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edbaa10 0x55d62edcef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.621+0000 7fa243fff640 1 -- 172.21.15.82:0/2873336829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 msgr2=0x55d62eddb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:06.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.621+0000 7fa243fff640 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62eddb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.621+0000 7fa243fff640 1 -- 172.21.15.82:0/2873336829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d62edd60c0 con 0x55d62edba0f0 2024-03-27T07:29:06.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.622+0000 7fa243fff640 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edba0f0 0x55d62edc2f80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa238010580 tx=0x7fa238005210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d028e7731e0749 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.640+0000 7fa231ffb640 1 -- 172.21.15.82:0/2873336829 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23802d070 con 0x55d62edba0f0 2024-03-27T07:29:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.640+0000 7fa231ffb640 1 -- 172.21.15.82:0/2873336829 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa238020030 con 0x55d62edba0f0 2024-03-27T07:29:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.640+0000 7fa231ffb640 1 -- 172.21.15.82:0/2873336829 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23801a9a0 con 0x55d62edba0f0 2024-03-27T07:29:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.641+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2873336829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edba0f0 msgr2=0x55d62edc2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.641+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edba0f0 0x55d62edc2f80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa238010580 tx=0x7fa238005210 comp rx=0 tx=0).stop 2024-03-27T07:29:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.642+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2873336829 shutdown_connections 2024-03-27T07:29:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.642+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62eddb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.642+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edbaa10 0x55d62edcef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.642+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/2873336829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edba0f0 0x55d62edc2f80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.642+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2873336829 >> 172.21.15.82:0/2873336829 conn(0x55d62edb4a10 msgr2=0x55d62edbb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.658+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2873336829 shutdown_connections 2024-03-27T07:29:06.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.658+0000 7fa24d5f6740 1 -- 172.21.15.82:0/2873336829 wait complete. 2024-03-27T07:29:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.659+0000 7fa24d5f6740 1 -- start start 2024-03-27T07:29:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.659+0000 7fa24d5f6740 1 Processor -- start 2024-03-27T07:29:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa24d5f6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edba0f0 0x55d62edc6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa24d5f6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa24d5f6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62ee31c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa24d5f6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa2441b24a0 con 0x55d62edc37e0 2024-03-27T07:29:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa24d5f6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa2441b3910 con 0x55d62edba0f0 2024-03-27T07:29:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa24d5f6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa2441b2b70 con 0x55d62edbaa10 2024-03-27T07:29:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa24d5f6740 10 client.0 _ll_register_callbacks cb 0x7fa234003d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:29:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa2437fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa2437fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:38930/0 (socket says 172.21.15.82:38930) 2024-03-27T07:29:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa2437fe640 1 -- 172.21.15.82:0/3989515185 learned_addr learned my addr 172.21.15.82:0/3989515185 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.660+0000 7fa248ed7640 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62ee31c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.661+0000 7fa243fff640 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edba0f0 0x55d62edc6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.661+0000 7fa2437fe640 1 -- 172.21.15.82:0/3989515185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edba0f0 msgr2=0x55d62edc6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.661+0000 7fa2437fe640 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edba0f0 0x55d62edc6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.661+0000 7fa2437fe640 1 -- 172.21.15.82:0/3989515185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 msgr2=0x55d62ee31c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.661+0000 7fa2437fe640 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62ee31c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.661+0000 7fa2437fe640 1 -- 172.21.15.82:0/3989515185 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d62ee32240 con 0x55d62edbaa10 2024-03-27T07:29:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.661+0000 7fa248ed7640 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62ee31c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:29:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.662+0000 7fa2437fe640 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc6c40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa244110ae0 tx=0x7fa23c03d150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aacc8d810b8ca6ad server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.667+0000 7fa2277fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:29:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.667+0000 7fa2277fe640 1 -- 172.21.15.82:0/3989515185 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c04a040 con 0x55d62edbaa10 2024-03-27T07:29:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.667+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3989515185 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa238020030 con 0x55d62edbaa10 2024-03-27T07:29:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.667+0000 7fa2277fe640 1 -- 172.21.15.82:0/3989515185 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7fa23c045990 con 0x55d62edbaa10 2024-03-27T07:29:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.667+0000 7fa2277fe640 1 -- 172.21.15.82:0/3989515185 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa23c045b90 con 0x55d62edbaa10 2024-03-27T07:29:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.667+0000 7fa24d5f6740 10 client.26653 fetch_fsmap learned FSMap version 30 2024-03-27T07:29:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.667+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3989515185 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d62ee39630 con 0x55d62edbaa10 2024-03-27T07:29:06.670 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.667+0000 7fa2277fe640 1 -- 172.21.15.82:0/3989515185 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa238020030 con 0x55d62edbaa10 2024-03-27T07:29:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.669+0000 7fa2277fe640 1 -- 172.21.15.82:0/3989515185 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fa23c050440 con 0x55d62edbaa10 2024-03-27T07:29:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.669+0000 7fa24d5f6740 10 client.26653 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:29:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.669+0000 7fa24d5f6740 10 client.26653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:29:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.669+0000 7fa24d5f6740 20 client.26653 populate_metadata read hostname 'smithi082' 2024-03-27T07:29:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.669+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d62ee39dc0 0x55d62ee3c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.669+0000 7fa24d5f6740 4 client.26653 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:29:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.669+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3989515185 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d62eca3770 con 0x55d62ee39dc0 2024-03-27T07:29:06.672 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.669+0000 7fa243fff640 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d62ee39dc0 0x55d62ee3c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:06.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.670+0000 7fa243fff640 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d62ee39dc0 0x55d62ee3c1e0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2159a2aa8226ea4b server_cookie=1bb597e5ef38f88f in_seq=0 out_seq=0 2024-03-27T07:29:06.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:06.670+0000 7fa2277fe640 10 client.26653 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:07.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:06 smithi153 ceph-mon[36179]: pgmap v168: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 440 op/s 2024-03-27T07:29:07.170 INFO:tasks.workunit.client.0.smithi082.stdout: 300 1588445 555 1105969 546 613040 1522 2024-03-27T07:29:07.195 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:06 smithi082 ceph-mon[32178]: pgmap v168: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 440 op/s 2024-03-27T07:29:07.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:06 smithi149 ceph-mon[36065]: pgmap v168: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.9 MiB/s wr, 440 op/s 2024-03-27T07:29:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.860+0000 7fa2277fe640 1 -- 172.21.15.82:0/3989515185 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d62eca3770 con 0x55d62ee39dc0 2024-03-27T07:29:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.860+0000 7fa2277fe640 10 client.26653 handle_command_reply: tid=0 2024-03-27T07:29:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.860+0000 7fa24d5f6740 1 client.26653 shutdown 2024-03-27T07:29:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.860+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3989515185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 msgr2=0x55d62edc6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:07.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.860+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc6c40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa244110ae0 tx=0x7fa23c03d150 comp rx=0 tx=0).stop 2024-03-27T07:29:07.872 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.869+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3989515185 shutdown_connections 2024-03-27T07:29:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.869+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55d62ee39dc0 0x55d62ee3c1e0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.869+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d62edc37e0 0x55d62ee31c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.869+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55d62edbaa10 0x55d62edc6c40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.869+0000 7fa24d5f6740 1 --2- 172.21.15.82:0/3989515185 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55d62edba0f0 0x55d62edc6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.869+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3989515185 >> 172.21.15.82:0/3989515185 conn(0x55d62edb4a10 msgr2=0x55d62edc0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.869+0000 7fa2277fe640 0 client.26653 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.870+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3989515185 shutdown_connections 2024-03-27T07:29:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.870+0000 7fa24d5f6740 1 -- 172.21.15.82:0/3989515185 wait complete. 2024-03-27T07:29:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.870+0000 7fa24d5f6740 20 client.26653 trim_cache size 0 max 16384 2024-03-27T07:29:07.873 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:29:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:29:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:29:07.874 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:29:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.882+0000 7fa24a93a640 1 -- 172.21.15.82:0/3918586127 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa22c0a3a50 msgr2=0x7fa22c0a5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.882+0000 7fa24a93a640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa22c0a3a50 0x7fa22c0a5f10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa23c006010 tx=0x7fa23c03f040 comp rx=0 tx=0).stop 2024-03-27T07:29:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.882+0000 7fa24a93a640 1 -- 172.21.15.82:0/3918586127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa24411b330 msgr2=0x7fa244116fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:07.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.882+0000 7fa24a93a640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa24411b330 0x7fa244116fd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa23400e940 tx=0x7fa23400ee00 comp rx=0 tx=0).stop 2024-03-27T07:29:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.884+0000 7fa24a93a640 1 -- 172.21.15.82:0/3918586127 shutdown_connections 2024-03-27T07:29:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.884+0000 7fa24a93a640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa22c0a3a50 0x7fa22c0a5f10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.884+0000 7fa24a93a640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa24411b330 0x7fa244116fd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.884+0000 7fa24a93a640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa244110700 0x7fa244116a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.884+0000 7fa24a93a640 1 --2- 172.21.15.82:0/3918586127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa244110290 0x7fa24411aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.884+0000 7fa24a93a640 1 -- 172.21.15.82:0/3918586127 >> 172.21.15.82:0/3918586127 conn(0x7fa24406cbf0 msgr2=0x7fa24411c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.884+0000 7fa24a93a640 1 -- 172.21.15.82:0/3918586127 shutdown_connections 2024-03-27T07:29:07.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:07.884+0000 7fa24a93a640 1 -- 172.21.15.82:0/3918586127 wait complete. 2024-03-27T07:29:09.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:08 smithi153 ceph-mon[36179]: pgmap v169: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.8 MiB/s wr, 480 op/s 2024-03-27T07:29:09.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:08 smithi082 ceph-mon[32178]: pgmap v169: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.8 MiB/s wr, 480 op/s 2024-03-27T07:29:09.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:08 smithi149 ceph-mon[36065]: pgmap v169: 97 pgs: 97 active+clean; 1.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.8 MiB/s wr, 480 op/s 2024-03-27T07:29:11.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:10 smithi153 ceph-mon[36179]: pgmap v170: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 317 op/s 2024-03-27T07:29:11.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:10 smithi082 ceph-mon[32178]: pgmap v170: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 317 op/s 2024-03-27T07:29:11.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:10 smithi149 ceph-mon[36065]: pgmap v170: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.4 MiB/s wr, 317 op/s 2024-03-27T07:29:13.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:12 smithi153 ceph-mon[36179]: pgmap v171: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 435 op/s 2024-03-27T07:29:13.056 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:12 smithi149 ceph-mon[36065]: pgmap v171: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 435 op/s 2024-03-27T07:29:13.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:12 smithi082 ceph-mon[32178]: pgmap v171: 97 pgs: 97 active+clean; 1.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.2 MiB/s wr, 435 op/s 2024-03-27T07:29:15.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:14 smithi153 ceph-mon[36179]: pgmap v172: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.4 MiB/s wr, 743 op/s 2024-03-27T07:29:15.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:14 smithi082 ceph-mon[32178]: pgmap v172: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.4 MiB/s wr, 743 op/s 2024-03-27T07:29:15.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:14 smithi149 ceph-mon[36065]: pgmap v172: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.4 MiB/s wr, 743 op/s 2024-03-27T07:29:17.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:16 smithi153 ceph-mon[36179]: pgmap v173: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 649 op/s 2024-03-27T07:29:17.170 INFO:tasks.workunit.client.0.smithi082.stdout: 314 2066004 816 1448354 754 799221 902 2024-03-27T07:29:17.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:16 smithi082 ceph-mon[32178]: pgmap v173: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 649 op/s 2024-03-27T07:29:17.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:16 smithi149 ceph-mon[36065]: pgmap v173: 97 pgs: 97 active+clean; 1.3 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.7 MiB/s wr, 649 op/s 2024-03-27T07:29:19.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:18 smithi153 ceph-mon[36179]: pgmap v174: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.3 MiB/s wr, 1.02k op/s 2024-03-27T07:29:19.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:18 smithi082 ceph-mon[32178]: pgmap v174: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.3 MiB/s wr, 1.02k op/s 2024-03-27T07:29:19.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:18 smithi149 ceph-mon[36065]: pgmap v174: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 8.3 MiB/s wr, 1.02k op/s 2024-03-27T07:29:21.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:20 smithi082 ceph-mon[32178]: pgmap v175: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.4 MiB/s wr, 959 op/s 2024-03-27T07:29:21.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:20 smithi149 ceph-mon[36065]: pgmap v175: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.4 MiB/s wr, 959 op/s 2024-03-27T07:29:21.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:20 smithi153 ceph-mon[36179]: pgmap v175: 97 pgs: 97 active+clean; 1.3 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 8.4 MiB/s wr, 959 op/s 2024-03-27T07:29:22.984 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.981+0000 7f839333a640 1 -- 172.21.15.82:0/1355599482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c110150 msgr2=0x7f838c110530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.981+0000 7f839333a640 1 --2- 172.21.15.82:0/1355599482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c110150 0x7f838c110530 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8388009900 tx=0x7f838802bcc0 comp rx=0 tx=0).stop 2024-03-27T07:29:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.981+0000 7f839333a640 1 -- 172.21.15.82:0/1355599482 shutdown_connections 2024-03-27T07:29:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.981+0000 7f839333a640 1 --2- 172.21.15.82:0/1355599482 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c10e740 0x7f838c11d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.981+0000 7f839333a640 1 --2- 172.21.15.82:0/1355599482 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f838c10dcc0 0x7f838c10e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.981+0000 7f839333a640 1 --2- 172.21.15.82:0/1355599482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c110150 0x7f838c110530 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:22.985 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.981+0000 7f839333a640 1 -- 172.21.15.82:0/1355599482 >> 172.21.15.82:0/1355599482 conn(0x7f838c06cad0 msgr2=0x7f838c06cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.983+0000 7f839333a640 1 -- 172.21.15.82:0/1355599482 shutdown_connections 2024-03-27T07:29:22.986 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.983+0000 7f839333a640 1 -- 172.21.15.82:0/1355599482 wait complete. 2024-03-27T07:29:22.987 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.984+0000 7f839333a640 1 Processor -- start 2024-03-27T07:29:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.984+0000 7f839333a640 1 -- start start 2024-03-27T07:29:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.984+0000 7f839333a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c10dcc0 0x7f838c11ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.984+0000 7f839333a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f838c10e740 0x7f838c115f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.984+0000 7f839333a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c110150 0x7f838c116480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.984+0000 7f839333a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f838c120b40 con 0x7f838c110150 2024-03-27T07:29:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.984+0000 7f839333a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f838c1209c0 con 0x7f838c10e740 2024-03-27T07:29:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.984+0000 7f839333a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f838c120cc0 con 0x7f838c10dcc0 2024-03-27T07:29:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.985+0000 7f83918d7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c110150 0x7f838c116480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.985+0000 7f83908d5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f838c10e740 0x7f838c115f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.985+0000 7f83908d5640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f838c10e740 0x7f838c115f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:32804/0 (socket says 172.21.15.82:32804) 2024-03-27T07:29:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.985+0000 7f83908d5640 1 -- 172.21.15.82:0/1735117233 learned_addr learned my addr 172.21.15.82:0/1735117233 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.986+0000 7f83918d7640 1 -- 172.21.15.82:0/1735117233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c10dcc0 msgr2=0x7f838c11ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.986+0000 7f83918d7640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c10dcc0 0x7f838c11ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.986+0000 7f83918d7640 1 -- 172.21.15.82:0/1735117233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f838c10e740 msgr2=0x7f838c115f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.986+0000 7f83918d7640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f838c10e740 0x7f838c115f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.986+0000 7f83918d7640 1 -- 172.21.15.82:0/1735117233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838c116a40 con 0x7f838c110150 2024-03-27T07:29:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:22.987+0000 7f83918d7640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c110150 0x7f838c116480 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f838400ecd0 tx=0x7f838400c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.012+0000 7f83827fc640 1 -- 172.21.15.82:0/1735117233 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8384004b20 con 0x7f838c110150 2024-03-27T07:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.012+0000 7f83827fc640 1 -- 172.21.15.82:0/1735117233 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8384004cc0 con 0x7f838c110150 2024-03-27T07:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.012+0000 7f83827fc640 1 -- 172.21.15.82:0/1735117233 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8384011760 con 0x7f838c110150 2024-03-27T07:29:23.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.012+0000 7f839333a640 1 -- 172.21.15.82:0/1735117233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838c116d30 con 0x7f838c110150 2024-03-27T07:29:23.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.013+0000 7f839333a640 1 -- 172.21.15.82:0/1735117233 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838c11acc0 con 0x7f838c110150 2024-03-27T07:29:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.018+0000 7f8395ff9740 1 Processor -- start 2024-03-27T07:29:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.020+0000 7f8395ff9740 1 -- start start 2024-03-27T07:29:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.020+0000 7f8395ff9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9290 0x559c3e4f9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.020+0000 7f8395ff9740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9bb0 0x559c3e502440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.020+0000 7f8395ff9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e502980 0x559c3e504d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.020+0000 7f8395ff9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559c3e4bfcd0 con 0x559c3e4f9290 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.020+0000 7f8395ff9740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x559c3e404950 con 0x559c3e4f9bb0 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.020+0000 7f8395ff9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559c3e45ce50 con 0x559c3e502980 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.020+0000 7f83910d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9bb0 0x559c3e502440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.020+0000 7f83910d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9bb0 0x559c3e502440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:32820/0 (socket says 172.21.15.82:32820) 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.020+0000 7f83910d6640 1 -- 172.21.15.82:0/373004615 learned_addr learned my addr 172.21.15.82:0/373004615 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.021+0000 7f83827fc640 1 -- 172.21.15.82:0/1735117233 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f8384011900 con 0x7f838c110150 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.021+0000 7f83908d5640 1 --2- 172.21.15.82:0/373004615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9290 0x559c3e4f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.021+0000 7f83910d6640 1 -- 172.21.15.82:0/373004615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e502980 msgr2=0x559c3e504d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:29:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.021+0000 7f83910d6640 1 --2- 172.21.15.82:0/373004615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e502980 0x559c3e504d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.021+0000 7f83910d6640 1 -- 172.21.15.82:0/373004615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9290 msgr2=0x559c3e4f9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.021+0000 7f83910d6640 1 --2- 172.21.15.82:0/373004615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9290 0x559c3e4f9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.021+0000 7f83910d6640 1 -- 172.21.15.82:0/373004615 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c3e171210 con 0x559c3e4f9bb0 2024-03-27T07:29:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.021+0000 7f83908d5640 1 --2- 172.21.15.82:0/373004615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9290 0x559c3e4f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:29:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.022+0000 7f83827fc640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83780a3980 0x7f83780a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.022+0000 7f83908d5640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83780a3980 0x7f83780a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.022+0000 7f83910d6640 1 --2- 172.21.15.82:0/373004615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9bb0 0x559c3e502440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8388009230 tx=0x7f8388005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2553f96442e4ec7e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.023+0000 7f83908d5640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83780a3980 0x7f83780a5e40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x559c3e4f4fd0 tx=0x7f837c005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.024+0000 7f83827fc640 1 -- 172.21.15.82:0/1735117233 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f83840d1250 con 0x7f838c110150 2024-03-27T07:29:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.038+0000 7f83777fe640 1 -- 172.21.15.82:0/373004615 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388042020 con 0x559c3e4f9bb0 2024-03-27T07:29:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.038+0000 7f83777fe640 1 -- 172.21.15.82:0/373004615 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f838802c910 con 0x559c3e4f9bb0 2024-03-27T07:29:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.042+0000 7f8395ff9740 1 -- 172.21.15.82:0/373004615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9bb0 msgr2=0x559c3e502440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.042+0000 7f8395ff9740 1 --2- 172.21.15.82:0/373004615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9bb0 0x559c3e502440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8388009230 tx=0x7f8388005780 comp rx=0 tx=0).stop 2024-03-27T07:29:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.062+0000 7f8395ff9740 1 -- 172.21.15.82:0/373004615 shutdown_connections 2024-03-27T07:29:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.062+0000 7f8395ff9740 1 --2- 172.21.15.82:0/373004615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e502980 0x559c3e504d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.062+0000 7f8395ff9740 1 --2- 172.21.15.82:0/373004615 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9bb0 0x559c3e502440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.062+0000 7f8395ff9740 1 --2- 172.21.15.82:0/373004615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9290 0x559c3e4f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.062+0000 7f8395ff9740 1 -- 172.21.15.82:0/373004615 >> 172.21.15.82:0/373004615 conn(0x559c3e4f3bb0 msgr2=0x559c3e4f3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.062+0000 7f8395ff9740 1 -- 172.21.15.82:0/373004615 shutdown_connections 2024-03-27T07:29:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.063+0000 7f8395ff9740 1 -- 172.21.15.82:0/373004615 wait complete. 2024-03-27T07:29:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.063+0000 7f8395ff9740 1 -- start start 2024-03-27T07:29:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.063+0000 7f8395ff9740 1 Processor -- start 2024-03-27T07:29:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.064+0000 7f8395ff9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9290 0x559c3e4ff900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.064+0000 7f8395ff9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 0x559c3e4ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.064+0000 7f8395ff9740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e502980 0x559c3e500380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.064+0000 7f8395ff9740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559c3e458e00 con 0x559c3e4f9bb0 2024-03-27T07:29:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.064+0000 7f8395ff9740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x559c3e405520 con 0x559c3e502980 2024-03-27T07:29:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.064+0000 7f8395ff9740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559c3e4188e0 con 0x559c3e4f9290 2024-03-27T07:29:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.064+0000 7f8395ff9740 10 client.0 _ll_register_callbacks cb 0x559c3e453a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:29:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.065+0000 7f83910d6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9290 0x559c3e4ff900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.065+0000 7f83910d6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9290 0x559c3e4ff900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:43970/0 (socket says 172.21.15.82:43970) 2024-03-27T07:29:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.065+0000 7f83910d6640 1 -- 172.21.15.82:0/4183013399 learned_addr learned my addr 172.21.15.82:0/4183013399 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.065+0000 7f83918d7640 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e502980 0x559c3e500380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.066+0000 7f83908d5640 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 0x559c3e4ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.067+0000 7f83908d5640 1 -- 172.21.15.82:0/4183013399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9290 msgr2=0x559c3e4ff900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.067+0000 7f83908d5640 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9290 0x559c3e4ff900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.067+0000 7f83908d5640 1 -- 172.21.15.82:0/4183013399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e502980 msgr2=0x559c3e500380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.067+0000 7f83908d5640 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e502980 0x559c3e500380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.067+0000 7f83908d5640 1 -- 172.21.15.82:0/4183013399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c3e23d620 con 0x559c3e4f9bb0 2024-03-27T07:29:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.068+0000 7f83908d5640 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 0x559c3e4ffe40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f838c1176b0 tx=0x7f837c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fcd11772168d1e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.119+0000 7f8374ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:29:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.119+0000 7f8374ff9640 1 -- 172.21.15.82:0/4183013399 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f837c0119a0 con 0x559c3e4f9bb0 2024-03-27T07:29:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.119+0000 7f8395ff9740 1 -- 172.21.15.82:0/4183013399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f838802c910 con 0x559c3e4f9bb0 2024-03-27T07:29:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.120+0000 7f8374ff9640 1 -- 172.21.15.82:0/4183013399 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f837c011b40 con 0x559c3e4f9bb0 2024-03-27T07:29:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.120+0000 7f8374ff9640 1 -- 172.21.15.82:0/4183013399 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f837c011d40 con 0x559c3e4f9bb0 2024-03-27T07:29:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.120+0000 7f8395ff9740 10 client.16803 fetch_fsmap learned FSMap version 30 2024-03-27T07:29:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.120+0000 7f8395ff9740 1 -- 172.21.15.82:0/4183013399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559c3e511510 con 0x559c3e4f9bb0 2024-03-27T07:29:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.122+0000 7f8374ff9640 1 -- 172.21.15.82:0/4183013399 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f838802c910 con 0x559c3e4f9bb0 2024-03-27T07:29:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.122+0000 7f8374ff9640 1 -- 172.21.15.82:0/4183013399 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f837c028460 con 0x559c3e4f9bb0 2024-03-27T07:29:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.122+0000 7f8395ff9740 10 client.16803 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:29:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.122+0000 7f8395ff9740 10 client.16803 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:29:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.122+0000 7f8395ff9740 20 client.16803 populate_metadata read hostname 'smithi082' 2024-03-27T07:29:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.122+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559c3e512ed0 0x559c3e515330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.122+0000 7f8395ff9740 4 client.16803 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:29:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.122+0000 7f8395ff9740 1 -- 172.21.15.82:0/4183013399 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c3e46a390 con 0x559c3e512ed0 2024-03-27T07:29:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.122+0000 7f83910d6640 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559c3e512ed0 0x559c3e515330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.123+0000 7f83910d6640 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559c3e512ed0 0x559c3e515330 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bc635e974e376bb server_cookie=99b215550e6712c4 in_seq=0 out_seq=0 2024-03-27T07:29:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.143+0000 7f8374ff9640 10 client.16803 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.143+0000 7f8374ff9640 1 -- 172.21.15.82:0/4183013399 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x559c3e46a390 con 0x559c3e512ed0 2024-03-27T07:29:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.144+0000 7f8374ff9640 10 client.16803 handle_command_reply: tid=0 2024-03-27T07:29:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.144+0000 7f8395ff9740 1 client.16803 shutdown 2024-03-27T07:29:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.145+0000 7f8395ff9740 1 -- 172.21.15.82:0/4183013399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 msgr2=0x559c3e4ffe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.145+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 0x559c3e4ffe40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f838c1176b0 tx=0x7f837c0046c0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.145+0000 7f8395ff9740 1 -- 172.21.15.82:0/4183013399 shutdown_connections 2024-03-27T07:29:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.145+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559c3e512ed0 0x559c3e515330 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.145+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 0x559c3e4ffe40 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.145+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e502980 0x559c3e500380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.145+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4183013399 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9290 0x559c3e4ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.145+0000 7f8395ff9740 1 -- 172.21.15.82:0/4183013399 >> 172.21.15.82:0/4183013399 conn(0x559c3e4f3bb0 msgr2=0x559c3e4f5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.146+0000 7f8374ff9640 0 client.16803 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.146+0000 7f8395ff9740 1 -- 172.21.15.82:0/4183013399 shutdown_connections 2024-03-27T07:29:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.146+0000 7f8395ff9740 1 -- 172.21.15.82:0/4183013399 wait complete. 2024-03-27T07:29:23.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.146+0000 7f8395ff9740 20 client.16803 trim_cache size 0 max 16384 2024-03-27T07:29:23.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:22 smithi082 ceph-mon[32178]: pgmap v176: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.9 MiB/s wr, 1.01k op/s 2024-03-27T07:29:23.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:22 smithi149 ceph-mon[36065]: pgmap v176: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.9 MiB/s wr, 1.01k op/s 2024-03-27T07:29:23.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:22 smithi153 ceph-mon[36179]: pgmap v176: 97 pgs: 97 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.9 MiB/s wr, 1.01k op/s 2024-03-27T07:29:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.371+0000 7f8395ff9740 1 Processor -- start 2024-03-27T07:29:23.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.371+0000 7f8395ff9740 1 -- start start 2024-03-27T07:29:23.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.372+0000 7f8395ff9740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e502030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.372+0000 7f8395ff9740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 0x559c3e4ee750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.372+0000 7f83910d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e502030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.372+0000 7f83910d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e502030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:32834/0 (socket says 172.21.15.82:32834) 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.372+0000 7f83908d5640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 0x559c3e4ee750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.372+0000 7f83910d6640 1 -- 172.21.15.82:0/1210974950 learned_addr learned my addr 172.21.15.82:0/1210974950 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.372+0000 7f8395ff9740 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e502980 0x559c3e50e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.372+0000 7f8395ff9740 1 -- 172.21.15.82:0/1210974950 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8370011160 con 0x559c3e4f9bb0 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.372+0000 7f8395ff9740 1 -- 172.21.15.82:0/1210974950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f837000e9d0 con 0x559c3e4f9290 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.372+0000 7f8395ff9740 1 -- 172.21.15.82:0/1210974950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f837000c820 con 0x559c3e502980 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.373+0000 7f83918d7640 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e502980 0x559c3e50e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.373+0000 7f83910d6640 1 -- 172.21.15.82:0/1210974950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e502980 msgr2=0x559c3e50e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.373+0000 7f83910d6640 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e502980 0x559c3e50e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.373+0000 7f83910d6640 1 -- 172.21.15.82:0/1210974950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 msgr2=0x559c3e4ee750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:23.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.373+0000 7f83910d6640 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 0x559c3e4ee750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.373+0000 7f83910d6640 1 -- 172.21.15.82:0/1210974950 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c3e4fe8b0 con 0x559c3e4f9290 2024-03-27T07:29:23.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.373+0000 7f83918d7640 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e502980 0x559c3e50e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:29:23.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.373+0000 7f83908d5640 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 0x559c3e4ee750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:29:23.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.373+0000 7f83910d6640 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e502030 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8388009230 tx=0x7f8388009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9661f0ea969a0915 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:23.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.392+0000 7f8376ffd640 1 -- 172.21.15.82:0/1210974950 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388042040 con 0x559c3e4f9290 2024-03-27T07:29:23.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.392+0000 7f8376ffd640 1 -- 172.21.15.82:0/1210974950 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8388051070 con 0x559c3e4f9290 2024-03-27T07:29:23.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.392+0000 7f8376ffd640 1 -- 172.21.15.82:0/1210974950 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83880516c0 con 0x559c3e4f9290 2024-03-27T07:29:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.402+0000 7f8395ff9740 1 -- 172.21.15.82:0/1210974950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 msgr2=0x559c3e502030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.402+0000 7f8395ff9740 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e502030 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8388009230 tx=0x7f8388009260 comp rx=0 tx=0).stop 2024-03-27T07:29:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.402+0000 7f8395ff9740 1 -- 172.21.15.82:0/1210974950 shutdown_connections 2024-03-27T07:29:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.402+0000 7f8395ff9740 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e4f9bb0 0x559c3e4ee750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.402+0000 7f8395ff9740 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e502980 0x559c3e50e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.402+0000 7f8395ff9740 1 --2- 172.21.15.82:0/1210974950 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e502030 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.402+0000 7f8395ff9740 1 -- 172.21.15.82:0/1210974950 >> 172.21.15.82:0/1210974950 conn(0x559c3e4f3bb0 msgr2=0x559c3e4f5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.402+0000 7f8395ff9740 1 -- 172.21.15.82:0/1210974950 shutdown_connections 2024-03-27T07:29:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.402+0000 7f8395ff9740 1 -- 172.21.15.82:0/1210974950 wait complete. 2024-03-27T07:29:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.403+0000 7f8395ff9740 1 -- start start 2024-03-27T07:29:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.403+0000 7f8395ff9740 1 Processor -- start 2024-03-27T07:29:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.404+0000 7f8395ff9740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e50a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.404+0000 7f8395ff9740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9bb0 0x559c3e505cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.404+0000 7f83910d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e50a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.404+0000 7f83910d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e50a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:32848/0 (socket says 172.21.15.82:32848) 2024-03-27T07:29:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.405+0000 7f83910d6640 1 -- 172.21.15.82:0/4146327983 learned_addr learned my addr 172.21.15.82:0/4146327983 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.405+0000 7f83908d5640 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9bb0 0x559c3e505cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.421 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.419+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e502980 0x559c3e506200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.419+0000 7f83918d7640 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e502980 0x559c3e506200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.419+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f837000ce90 con 0x559c3e502980 2024-03-27T07:29:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.419+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f837000e300 con 0x559c3e4f9290 2024-03-27T07:29:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.419+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f837000d560 con 0x559c3e4f9bb0 2024-03-27T07:29:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.420+0000 7f83910d6640 1 -- 172.21.15.82:0/4146327983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9bb0 msgr2=0x559c3e505cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.420+0000 7f83910d6640 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9bb0 0x559c3e505cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.420+0000 7f83910d6640 1 -- 172.21.15.82:0/4146327983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e502980 msgr2=0x559c3e506200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.420+0000 7f83910d6640 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e502980 0x559c3e506200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.420+0000 7f83910d6640 1 -- 172.21.15.82:0/4146327983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c3e5067f0 con 0x559c3e4f9290 2024-03-27T07:29:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.421+0000 7f83918d7640 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e502980 0x559c3e506200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:29:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.421+0000 7f83910d6640 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e50a750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8388003dc0 tx=0x7f8388003df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32306043c33f5670 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.421+0000 7f8395ff9740 10 client.0 _ll_register_callbacks cb 0x7f837c009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:29:23.424 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.422+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8388051070 con 0x559c3e4f9290 2024-03-27T07:29:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.426+0000 7f8374ff9640 10 client.26648 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:29:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.427+0000 7f8374ff9640 1 -- 172.21.15.82:0/4146327983 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388042040 con 0x559c3e4f9290 2024-03-27T07:29:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.427+0000 7f8374ff9640 1 -- 172.21.15.82:0/4146327983 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f838802cdb0 con 0x559c3e4f9290 2024-03-27T07:29:23.431 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.428+0000 7f8374ff9640 1 -- 172.21.15.82:0/4146327983 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f838802c910 con 0x559c3e4f9290 2024-03-27T07:29:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.430+0000 7f8395ff9740 10 client.26648 fetch_fsmap learned FSMap version 30 2024-03-27T07:29:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.430+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({fsmap=30}) -- 0x559c3e578ca0 con 0x559c3e4f9290 2024-03-27T07:29:23.436 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.434+0000 7f8374ff9640 1 -- 172.21.15.82:0/4146327983 <== mon.2 v2:172.21.15.149:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f8388003f90 con 0x559c3e4f9290 2024-03-27T07:29:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.434+0000 7f8395ff9740 10 client.26648 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:29:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.434+0000 7f8395ff9740 10 client.26648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:29:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.434+0000 7f8395ff9740 20 client.26648 populate_metadata read hostname 'smithi082' 2024-03-27T07:29:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.434+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559c3e578ef0 0x559c3e57b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.435+0000 7f8395ff9740 4 client.26648 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:29:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.435+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f8388051070 con 0x559c3e578ef0 2024-03-27T07:29:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.435+0000 7f83908d5640 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559c3e578ef0 0x559c3e57b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.436+0000 7f83908d5640 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559c3e578ef0 0x559c3e57b340 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e94866937cc2ed server_cookie=3b0e9f248daa6ded in_seq=0 out_seq=0 2024-03-27T07:29:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:23.439+0000 7f8374ff9640 10 client.26648 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.650+0000 7f8374ff9640 1 -- 172.21.15.82:0/4146327983 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f8388051070 con 0x559c3e578ef0 2024-03-27T07:29:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.650+0000 7f8374ff9640 10 client.26648 handle_command_reply: tid=0 2024-03-27T07:29:24.653 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.650+0000 7f8395ff9740 1 client.26648 shutdown 2024-03-27T07:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.650+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 msgr2=0x559c3e50a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.650+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e50a750 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8388003dc0 tx=0x7f8388003df0 comp rx=0 tx=0).stop 2024-03-27T07:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.651+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 shutdown_connections 2024-03-27T07:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.651+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559c3e578ef0 0x559c3e57b340 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.651+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559c3e502980 0x559c3e506200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.651+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559c3e4f9bb0 0x559c3e505cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.651+0000 7f8395ff9740 1 --2- 172.21.15.82:0/4146327983 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559c3e4f9290 0x559c3e50a750 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:24.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.651+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 >> 172.21.15.82:0/4146327983 conn(0x559c3e4f3bb0 msgr2=0x559c3e4f5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.651+0000 7f8374ff9640 0 client.26648 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.652+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 shutdown_connections 2024-03-27T07:29:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.652+0000 7f8395ff9740 1 -- 172.21.15.82:0/4146327983 wait complete. 2024-03-27T07:29:24.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.652+0000 7f8395ff9740 20 client.26648 trim_cache size 0 max 16384 2024-03-27T07:29:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:29:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:29:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:29:24.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:29:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.658+0000 7f839333a640 1 -- 172.21.15.82:0/1735117233 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83780a3980 msgr2=0x7f83780a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:24.660 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.658+0000 7f839333a640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83780a3980 0x7f83780a5e40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x559c3e4f4fd0 tx=0x7f837c005f90 comp rx=0 tx=0).stop 2024-03-27T07:29:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.658+0000 7f839333a640 1 -- 172.21.15.82:0/1735117233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c110150 msgr2=0x7f838c116480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:24.661 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.658+0000 7f839333a640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c110150 0x7f838c116480 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f838400ecd0 tx=0x7f838400c640 comp rx=0 tx=0).stop 2024-03-27T07:29:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.659+0000 7f839333a640 1 -- 172.21.15.82:0/1735117233 shutdown_connections 2024-03-27T07:29:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.659+0000 7f839333a640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f83780a3980 0x7f83780a5e40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.659+0000 7f839333a640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f838c110150 0x7f838c116480 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.659+0000 7f839333a640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f838c10e740 0x7f838c115f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.659+0000 7f839333a640 1 --2- 172.21.15.82:0/1735117233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c10dcc0 0x7f838c11ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.659+0000 7f839333a640 1 -- 172.21.15.82:0/1735117233 >> 172.21.15.82:0/1735117233 conn(0x7f838c06cad0 msgr2=0x7f838c0711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.659+0000 7f839333a640 1 -- 172.21.15.82:0/1735117233 shutdown_connections 2024-03-27T07:29:24.662 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:24.659+0000 7f839333a640 1 -- 172.21.15.82:0/1735117233 wait complete. 2024-03-27T07:29:25.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:24 smithi082 ceph-mon[32178]: pgmap v177: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2024-03-27T07:29:25.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:24 smithi149 ceph-mon[36065]: pgmap v177: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2024-03-27T07:29:25.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:24 smithi153 ceph-mon[36179]: pgmap v177: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 1.07k op/s 2024-03-27T07:29:27.170 INFO:tasks.workunit.client.0.smithi082.stdout: 332 2332097 1176 1634962 1073 896590 795 2024-03-27T07:29:27.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:26 smithi082 ceph-mon[32178]: pgmap v178: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 748 op/s 2024-03-27T07:29:27.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:26 smithi149 ceph-mon[36065]: pgmap v178: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 748 op/s 2024-03-27T07:29:27.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:26 smithi153 ceph-mon[36179]: pgmap v178: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 12 MiB/s wr, 748 op/s 2024-03-27T07:29:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:28 smithi082 ceph-mon[32178]: pgmap v179: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 1.15k op/s 2024-03-27T07:29:29.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:28 smithi149 ceph-mon[36065]: pgmap v179: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 1.15k op/s 2024-03-27T07:29:29.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:28 smithi153 ceph-mon[36179]: pgmap v179: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 1.15k op/s 2024-03-27T07:29:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:30 smithi082 ceph-mon[32178]: pgmap v180: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.9 MiB/s wr, 811 op/s 2024-03-27T07:29:31.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:30 smithi149 ceph-mon[36065]: pgmap v180: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.9 MiB/s wr, 811 op/s 2024-03-27T07:29:31.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:30 smithi153 ceph-mon[36179]: pgmap v180: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.9 MiB/s wr, 811 op/s 2024-03-27T07:29:33.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:32 smithi082 ceph-mon[32178]: pgmap v181: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.2 MiB/s wr, 781 op/s 2024-03-27T07:29:33.265 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:32 smithi149 ceph-mon[36065]: pgmap v181: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.2 MiB/s wr, 781 op/s 2024-03-27T07:29:33.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:32 smithi153 ceph-mon[36179]: pgmap v181: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.2 MiB/s wr, 781 op/s 2024-03-27T07:29:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:34 smithi082 ceph-mon[32178]: pgmap v182: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.2 MiB/s wr, 752 op/s 2024-03-27T07:29:35.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:34 smithi149 ceph-mon[36065]: pgmap v182: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.2 MiB/s wr, 752 op/s 2024-03-27T07:29:35.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:34 smithi153 ceph-mon[36179]: pgmap v182: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.2 MiB/s wr, 752 op/s 2024-03-27T07:29:36.090 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:35 smithi082 ceph-mon[32178]: pgmap v183: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 546 op/s 2024-03-27T07:29:36.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:35 smithi149 ceph-mon[36065]: pgmap v183: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 546 op/s 2024-03-27T07:29:36.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:35 smithi153 ceph-mon[36179]: pgmap v183: 97 pgs: 97 active+clean; 1.4 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.7 MiB/s wr, 546 op/s 2024-03-27T07:29:37.171 INFO:tasks.workunit.client.0.smithi082.stdout: 343 2184572 992 1548710 822 840919 1142 2024-03-27T07:29:38.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.025+0000 7f1dadf15640 1 -- 172.21.15.82:0/1659874612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da810dc30 msgr2=0x7f1da810e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:38.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.025+0000 7f1dadf15640 1 --2- 172.21.15.82:0/1659874612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da810dc30 0x7f1da810e0b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009ca0 tx=0x7f1da002c120 comp rx=0 tx=0).stop 2024-03-27T07:29:38.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.027+0000 7f1dadf15640 1 -- 172.21.15.82:0/1659874612 shutdown_connections 2024-03-27T07:29:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.027+0000 7f1dadf15640 1 --2- 172.21.15.82:0/1659874612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da810dc30 0x7f1da810e0b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.027+0000 7f1dadf15640 1 --2- 172.21.15.82:0/1659874612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1da810e750 0x7f1da811d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.027+0000 7f1dadf15640 1 --2- 172.21.15.82:0/1659874612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1da81100d0 0x7f1da81104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.027+0000 7f1dadf15640 1 -- 172.21.15.82:0/1659874612 >> 172.21.15.82:0/1659874612 conn(0x7f1da806ca60 msgr2=0x7f1da806ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.029+0000 7f1dadf15640 1 -- 172.21.15.82:0/1659874612 shutdown_connections 2024-03-27T07:29:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.029+0000 7f1dadf15640 1 -- 172.21.15.82:0/1659874612 wait complete. 2024-03-27T07:29:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.030+0000 7f1dadf15640 1 Processor -- start 2024-03-27T07:29:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.030+0000 7f1dadf15640 1 -- start start 2024-03-27T07:29:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dadf15640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da810dc30 0x7f1da81a71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dadf15640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1da810e750 0x7f1da81a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dadf15640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1da81100d0 0x7f1da81aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dadf15640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1da8120bd0 con 0x7f1da810dc30 2024-03-27T07:29:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dadf15640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1da8120a50 con 0x7f1da81100d0 2024-03-27T07:29:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dadf15640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1da8120d50 con 0x7f1da810e750 2024-03-27T07:29:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dad714640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1da81100d0 0x7f1da81aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1da810e750 0x7f1da81a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1da810e750 0x7f1da81a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:43328/0 (socket says 172.21.15.82:43328) 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dad714640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1da81100d0 0x7f1da81aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:49480/0 (socket says 172.21.15.82:49480) 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1da7fff640 1 -- 172.21.15.82:0/3633450470 learned_addr learned my addr 172.21.15.82:0/3633450470 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dad714640 1 -- 172.21.15.82:0/3633450470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1da810e750 msgr2=0x7f1da81a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dad714640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1da810e750 0x7f1da81a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dacf13640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da810dc30 0x7f1da81a71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dad714640 1 -- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da810dc30 msgr2=0x7f1da81a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dad714640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da810dc30 0x7f1da81a71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1dad714640 1 -- 172.21.15.82:0/3633450470 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da81ac1a0 con 0x7f1da81100d0 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.031+0000 7f1da7fff640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1da810e750 0x7f1da81a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:29:38.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.032+0000 7f1dacf13640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da810dc30 0x7f1da81a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:29:38.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.032+0000 7f1dad714640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1da81100d0 0x7f1da81aba70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e970 tx=0x7f1d9800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:38.040 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.038+0000 7f1da5ffb640 1 -- 172.21.15.82:0/3633450470 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800ccc0 con 0x7f1da81100d0 2024-03-27T07:29:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.038+0000 7f1dadf15640 1 -- 172.21.15.82:0/3633450470 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da81ac490 con 0x7f1da81100d0 2024-03-27T07:29:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.038+0000 7f1dadf15640 1 -- 172.21.15.82:0/3633450470 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da81b3d20 con 0x7f1da81100d0 2024-03-27T07:29:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.039+0000 7f1da5ffb640 1 -- 172.21.15.82:0/3633450470 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d98005020 con 0x7f1da81100d0 2024-03-27T07:29:38.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.039+0000 7f1da5ffb640 1 -- 172.21.15.82:0/3633450470 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98004a00 con 0x7f1da81100d0 2024-03-27T07:29:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.044+0000 7f1da5ffb640 1 -- 172.21.15.82:0/3633450470 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f1d98004ba0 con 0x7f1da81100d0 2024-03-27T07:29:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.046+0000 7f1db1e39740 1 Processor -- start 2024-03-27T07:29:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.046+0000 7f1db1e39740 1 -- start start 2024-03-27T07:29:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.046+0000 7f1db1e39740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 0x55fb32b6e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1db1e39740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b77440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 0x55fb32b6e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 0x55fb32b6e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:43338/0 (socket says 172.21.15.82:43338) 2024-03-27T07:29:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1da7fff640 1 -- 172.21.15.82:0/4264951541 learned_addr learned my addr 172.21.15.82:0/4264951541 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1db1e39740 1 --2- 172.21.15.82:0/4264951541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b79d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1db1e39740 1 -- 172.21.15.82:0/4264951541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fb32b34cd0 con 0x55fb32b6ebb0 2024-03-27T07:29:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1db1e39740 1 -- 172.21.15.82:0/4264951541 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55fb32a79950 con 0x55fb32b77980 2024-03-27T07:29:38.050 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1db1e39740 1 -- 172.21.15.82:0/4264951541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fb32ad1e50 con 0x55fb32b6e290 2024-03-27T07:29:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1da5ffb640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1d900a3980 0x7f1d900a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1dacf13640 1 --2- 172.21.15.82:0/4264951541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b77440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1da7fff640 1 -- 172.21.15.82:0/4264951541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 msgr2=0x55fb32b79d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1da7fff640 1 --2- 172.21.15.82:0/4264951541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b79d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1da7fff640 1 -- 172.21.15.82:0/4264951541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 msgr2=0x55fb32b77440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1da7fff640 1 --2- 172.21.15.82:0/4264951541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b77440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1da7fff640 1 -- 172.21.15.82:0/4264951541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb327e6210 con 0x55fb32b6e290 2024-03-27T07:29:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1dacf13640 1 --2- 172.21.15.82:0/4264951541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b77440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:29:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.047+0000 7f1dad714640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1d900a3980 0x7f1d900a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.048+0000 7f1da7fff640 1 --2- 172.21.15.82:0/4264951541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 0x55fb32b6e670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009dc0 tx=0x7f1da00097e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f46311055a276a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.048+0000 7f1dad714640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1d900a3980 0x7f1d900a5e40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800c6a0 tx=0x7f1d98013000 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.048+0000 7f1da5ffb640 1 -- 172.21.15.82:0/3633450470 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f1d980d0fd0 con 0x7f1da81100d0 2024-03-27T07:29:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.049+0000 7f1d8effd640 1 -- 172.21.15.82:0/4264951541 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0043020 con 0x55fb32b6e290 2024-03-27T07:29:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.049+0000 7f1d8effd640 1 -- 172.21.15.82:0/4264951541 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1da0003970 con 0x55fb32b6e290 2024-03-27T07:29:38.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.049+0000 7f1d8effd640 1 -- 172.21.15.82:0/4264951541 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0039040 con 0x55fb32b6e290 2024-03-27T07:29:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.050+0000 7f1db1e39740 1 -- 172.21.15.82:0/4264951541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 msgr2=0x55fb32b6e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:38.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.050+0000 7f1db1e39740 1 --2- 172.21.15.82:0/4264951541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 0x55fb32b6e670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009dc0 tx=0x7f1da00097e0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.054+0000 7f1db1e39740 1 -- 172.21.15.82:0/4264951541 shutdown_connections 2024-03-27T07:29:38.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.054+0000 7f1db1e39740 1 --2- 172.21.15.82:0/4264951541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b77440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.054+0000 7f1db1e39740 1 --2- 172.21.15.82:0/4264951541 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b79d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.054+0000 7f1db1e39740 1 --2- 172.21.15.82:0/4264951541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 0x55fb32b6e670 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.054+0000 7f1db1e39740 1 -- 172.21.15.82:0/4264951541 >> 172.21.15.82:0/4264951541 conn(0x55fb32b68bb0 msgr2=0x55fb32b68f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.068+0000 7f1db1e39740 1 -- 172.21.15.82:0/4264951541 shutdown_connections 2024-03-27T07:29:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.069+0000 7f1db1e39740 1 -- 172.21.15.82:0/4264951541 wait complete. 2024-03-27T07:29:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.069+0000 7f1db1e39740 1 -- start start 2024-03-27T07:29:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.069+0000 7f1db1e39740 1 Processor -- start 2024-03-27T07:29:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.070+0000 7f1db1e39740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 0x55fb32b74a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.070+0000 7f1db1e39740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b74f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.070+0000 7f1db1e39740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b75480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.070+0000 7f1db1e39740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fb32acde00 con 0x55fb32b6ebb0 2024-03-27T07:29:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.070+0000 7f1db1e39740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55fb32a7a520 con 0x55fb32b77980 2024-03-27T07:29:38.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.070+0000 7f1db1e39740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fb32a8d8e0 con 0x55fb32b6e290 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.070+0000 7f1db1e39740 10 client.0 _ll_register_callbacks cb 0x55fb32ac8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.070+0000 7f1dacf13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b74f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.070+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 0x55fb32b74a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.071+0000 7f1dacf13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b74f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41018/0 (socket says 172.21.15.82:41018) 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.071+0000 7f1dacf13640 1 -- 172.21.15.82:0/2660014752 learned_addr learned my addr 172.21.15.82:0/2660014752 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.071+0000 7f1da7fff640 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b75480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.071+0000 7f1dacf13640 1 -- 172.21.15.82:0/2660014752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 msgr2=0x55fb32b74a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.071+0000 7f1dacf13640 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 0x55fb32b74a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.071+0000 7f1dacf13640 1 -- 172.21.15.82:0/2660014752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 msgr2=0x55fb32b75480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.071+0000 7f1dacf13640 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b75480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.071+0000 7f1dacf13640 1 -- 172.21.15.82:0/2660014752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb328b2620 con 0x55fb32b6ebb0 2024-03-27T07:29:38.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.072+0000 7f1dacf13640 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b74f40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00d510 tx=0x7f1d9c00d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d6d796b86e019b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:38.083 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.081+0000 7f1d8c7f8640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:29:38.084 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.081+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/2660014752 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c016070 con 0x55fb32b6ebb0 2024-03-27T07:29:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.082+0000 7f1db1e39740 1 -- 172.21.15.82:0/2660014752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1da0003970 con 0x55fb32b6ebb0 2024-03-27T07:29:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.082+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/2660014752 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f1d9c012660 con 0x55fb32b6ebb0 2024-03-27T07:29:38.085 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.083+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/2660014752 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c022050 con 0x55fb32b6ebb0 2024-03-27T07:29:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.083+0000 7f1db1e39740 10 client.16815 fetch_fsmap learned FSMap version 30 2024-03-27T07:29:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.083+0000 7f1db1e39740 1 -- 172.21.15.82:0/2660014752 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fb32b863c0 con 0x55fb32b6ebb0 2024-03-27T07:29:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.084+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/2660014752 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1da0003970 con 0x55fb32b6ebb0 2024-03-27T07:29:38.086 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.084+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/2660014752 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f1d9c011b30 con 0x55fb32b6ebb0 2024-03-27T07:29:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.084+0000 7f1db1e39740 10 client.16815 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:29:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.084+0000 7f1db1e39740 10 client.16815 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:29:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.085+0000 7f1db1e39740 20 client.16815 populate_metadata read hostname 'smithi082' 2024-03-27T07:29:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.085+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fb32b87d80 0x55fb32b8a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.085+0000 7f1db1e39740 4 client.16815 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:29:38.087 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.085+0000 7f1db1e39740 1 -- 172.21.15.82:0/2660014752 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb32adf390 con 0x55fb32b87d80 2024-03-27T07:29:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.085+0000 7f1da7fff640 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fb32b87d80 0x55fb32b8a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.086+0000 7f1da7fff640 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fb32b87d80 0x55fb32b8a1a0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baed23f361f4cbd1 server_cookie=62c04eca73e9d1ed in_seq=0 out_seq=0 2024-03-27T07:29:38.088 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.086+0000 7f1d8c7f8640 10 client.16815 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.087+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/2660014752 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55fb32adf390 con 0x55fb32b87d80 2024-03-27T07:29:38.089 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.087+0000 7f1d8c7f8640 10 client.16815 handle_command_reply: tid=0 2024-03-27T07:29:38.090 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.087+0000 7f1db1e39740 1 client.16815 shutdown 2024-03-27T07:29:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.091+0000 7f1db1e39740 1 -- 172.21.15.82:0/2660014752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 msgr2=0x55fb32b74f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.091+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b74f40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00d510 tx=0x7f1d9c00d9d0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.091+0000 7f1db1e39740 1 -- 172.21.15.82:0/2660014752 shutdown_connections 2024-03-27T07:29:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.091+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fb32b87d80 0x55fb32b8a1a0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.091+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6ebb0 0x55fb32b74f40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.091+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b75480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.091+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2660014752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b6e290 0x55fb32b74a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.091+0000 7f1db1e39740 1 -- 172.21.15.82:0/2660014752 >> 172.21.15.82:0/2660014752 conn(0x55fb32b68bb0 msgr2=0x55fb32b6a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.091+0000 7f1d8c7f8640 0 client.16815 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.091+0000 7f1db1e39740 1 -- 172.21.15.82:0/2660014752 shutdown_connections 2024-03-27T07:29:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.092+0000 7f1db1e39740 1 -- 172.21.15.82:0/2660014752 wait complete. 2024-03-27T07:29:38.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.092+0000 7f1db1e39740 20 client.16815 trim_cache size 0 max 16384 2024-03-27T07:29:38.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.149+0000 7f1db1e39740 1 Processor -- start 2024-03-27T07:29:38.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.165+0000 7f1db1e39740 1 -- start start 2024-03-27T07:29:38.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.165+0000 7f1db1e39740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6e290 0x55fb32b77130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.166+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6e290 0x55fb32b77130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.166+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6e290 0x55fb32b77130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41026/0 (socket says 172.21.15.82:41026) 2024-03-27T07:29:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.166+0000 7f1da7fff640 1 -- 172.21.15.82:0/2994497539 learned_addr learned my addr 172.21.15.82:0/2994497539 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:38.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.166+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2994497539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b83080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.166+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2994497539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b750d0 0x55fb32b8fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.167+0000 7f1dacf13640 1 --2- 172.21.15.82:0/2994497539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b83080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.167+0000 7f1db1e39740 1 -- 172.21.15.82:0/2994497539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d94011030 con 0x55fb32b6e290 2024-03-27T07:29:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.167+0000 7f1db1e39740 1 -- 172.21.15.82:0/2994497539 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400e8a0 con 0x55fb32b77980 2024-03-27T07:29:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.167+0000 7f1db1e39740 1 -- 172.21.15.82:0/2994497539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400c6f0 con 0x55fb32b750d0 2024-03-27T07:29:38.170 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.167+0000 7f1da7fff640 1 -- 172.21.15.82:0/2994497539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b750d0 msgr2=0x55fb32b8fab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:29:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.167+0000 7f1da7fff640 1 --2- 172.21.15.82:0/2994497539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b750d0 0x55fb32b8fab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.167+0000 7f1da7fff640 1 -- 172.21.15.82:0/2994497539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 msgr2=0x55fb32b83080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.167+0000 7f1da7fff640 1 --2- 172.21.15.82:0/2994497539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b83080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.167+0000 7f1da7fff640 1 -- 172.21.15.82:0/2994497539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb32b739b0 con 0x55fb32b6e290 2024-03-27T07:29:38.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.168+0000 7f1da7fff640 1 --2- 172.21.15.82:0/2994497539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6e290 0x55fb32b77130 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1da002c730 tx=0x7f1da002c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd8b21583c4dafb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.176+0000 7f1d8e7fc640 1 -- 172.21.15.82:0/2994497539 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0039040 con 0x55fb32b6e290 2024-03-27T07:29:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.176+0000 7f1d8e7fc640 1 -- 172.21.15.82:0/2994497539 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1da0003970 con 0x55fb32b6e290 2024-03-27T07:29:38.179 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.176+0000 7f1d8e7fc640 1 -- 172.21.15.82:0/2994497539 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da0043040 con 0x55fb32b6e290 2024-03-27T07:29:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.177+0000 7f1db1e39740 1 -- 172.21.15.82:0/2994497539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6e290 msgr2=0x55fb32b77130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.178+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2994497539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6e290 0x55fb32b77130 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1da002c730 tx=0x7f1da002c640 comp rx=0 tx=0).stop 2024-03-27T07:29:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.178+0000 7f1db1e39740 1 -- 172.21.15.82:0/2994497539 shutdown_connections 2024-03-27T07:29:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.178+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2994497539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b750d0 0x55fb32b8fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.178+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2994497539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b77980 0x55fb32b83080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.178+0000 7f1db1e39740 1 --2- 172.21.15.82:0/2994497539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b6e290 0x55fb32b77130 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.178+0000 7f1db1e39740 1 -- 172.21.15.82:0/2994497539 >> 172.21.15.82:0/2994497539 conn(0x55fb32b68bb0 msgr2=0x55fb32b749c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.179+0000 7f1db1e39740 1 -- 172.21.15.82:0/2994497539 shutdown_connections 2024-03-27T07:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.179+0000 7f1db1e39740 1 -- 172.21.15.82:0/2994497539 wait complete. 2024-03-27T07:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.179+0000 7f1db1e39740 1 -- start start 2024-03-27T07:29:38.182 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.179+0000 7f1db1e39740 1 Processor -- start 2024-03-27T07:29:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.180+0000 7f1db1e39740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b6e290 0x55fb32b7b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.180+0000 7f1db1e39740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b750d0 0x55fb32b7b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.180+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b6e290 0x55fb32b7b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.180+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b6e290 0x55fb32b7b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:49514/0 (socket says 172.21.15.82:49514) 2024-03-27T07:29:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.181+0000 7f1dacf13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b750d0 0x55fb32b7b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.181+0000 7f1dacf13640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b750d0 0x55fb32b7b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41028/0 (socket says 172.21.15.82:41028) 2024-03-27T07:29:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.181+0000 7f1da7fff640 1 -- 172.21.15.82:0/932543164 learned_addr learned my addr 172.21.15.82:0/932543164 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.181+0000 7f1db1e39740 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b77980 0x55fb32b7bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.181+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400cd60 con 0x55fb32b750d0 2024-03-27T07:29:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.181+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400e1d0 con 0x55fb32b6e290 2024-03-27T07:29:38.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.181+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1d9400d430 con 0x55fb32b77980 2024-03-27T07:29:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.182+0000 7f1dacf13640 1 -- 172.21.15.82:0/932543164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b77980 msgr2=0x55fb32b7bd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T07:29:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.182+0000 7f1dacf13640 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b77980 0x55fb32b7bd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.182+0000 7f1dacf13640 1 -- 172.21.15.82:0/932543164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b6e290 msgr2=0x55fb32b7b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.182+0000 7f1dacf13640 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b6e290 0x55fb32b7b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.182+0000 7f1dacf13640 1 -- 172.21.15.82:0/932543164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb32bed3b0 con 0x55fb32b750d0 2024-03-27T07:29:38.185 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.182+0000 7f1dacf13640 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b750d0 0x55fb32b7b7c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55fb32b75a90 tx=0x7f1d9c01a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b80beded4e5b483 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:38.186 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.183+0000 7f1db1e39740 10 client.0 _ll_register_callbacks cb 0x7f1d9c00b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:29:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.183+0000 7f1d8c7f8640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:29:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.183+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/932543164 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c016070 con 0x55fb32b750d0 2024-03-27T07:29:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.183+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1da0003970 con 0x55fb32b750d0 2024-03-27T07:29:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.183+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/932543164 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f1d9c01ab70 con 0x55fb32b750d0 2024-03-27T07:29:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.184+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/932543164 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c034050 con 0x55fb32b750d0 2024-03-27T07:29:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.184+0000 7f1db1e39740 10 client.16821 fetch_fsmap learned FSMap version 30 2024-03-27T07:29:38.187 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.184+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55fb32bee460 con 0x55fb32b750d0 2024-03-27T07:29:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.185+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/932543164 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f1d9c004040 con 0x55fb32b750d0 2024-03-27T07:29:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.185+0000 7f1db1e39740 10 client.16821 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:29:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.185+0000 7f1db1e39740 10 client.16821 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:29:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.185+0000 7f1db1e39740 20 client.16821 populate_metadata read hostname 'smithi082' 2024-03-27T07:29:38.188 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.186+0000 7f1db1e39740 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fb32beec30 0x55fb32bf10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.186+0000 7f1db1e39740 4 client.16821 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:29:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.186+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fb32ad96e0 con 0x55fb32beec30 2024-03-27T07:29:38.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.186+0000 7f1da7fff640 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fb32beec30 0x55fb32bf10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.187+0000 7f1da7fff640 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fb32beec30 0x55fb32bf10f0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d74df85b22a3c8b server_cookie=f9bd3860048f3e0e in_seq=0 out_seq=0 2024-03-27T07:29:38.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:38.187+0000 7f1d8c7f8640 10 client.16821 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:38.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:38 smithi082 ceph-mon[32178]: pgmap v184: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.6 MiB/s wr, 926 op/s 2024-03-27T07:29:38.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:38 smithi149 ceph-mon[36065]: pgmap v184: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.6 MiB/s wr, 926 op/s 2024-03-27T07:29:38.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:38 smithi153 ceph-mon[36179]: pgmap v184: 97 pgs: 97 active+clean; 1.4 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.6 MiB/s wr, 926 op/s 2024-03-27T07:29:40.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:40 smithi082 ceph-mon[32178]: pgmap v185: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.1 MiB/s wr, 585 op/s 2024-03-27T07:29:40.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:40 smithi149 ceph-mon[36065]: pgmap v185: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.1 MiB/s wr, 585 op/s 2024-03-27T07:29:40.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:40 smithi153 ceph-mon[36179]: pgmap v185: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.1 MiB/s wr, 585 op/s 2024-03-27T07:29:41.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.154+0000 7f1d8c7f8640 1 -- 172.21.15.82:0/932543164 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fb32ad96e0 con 0x55fb32beec30 2024-03-27T07:29:41.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.154+0000 7f1d8c7f8640 10 client.16821 handle_command_reply: tid=0 2024-03-27T07:29:41.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.155+0000 7f1db1e39740 1 client.16821 shutdown 2024-03-27T07:29:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.164+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b750d0 msgr2=0x55fb32b7b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.164+0000 7f1db1e39740 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b750d0 0x55fb32b7b7c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55fb32b75a90 tx=0x7f1d9c01a700 comp rx=0 tx=0).stop 2024-03-27T07:29:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.168+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 shutdown_connections 2024-03-27T07:29:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.168+0000 7f1db1e39740 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fb32beec30 0x55fb32bf10f0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.168+0000 7f1db1e39740 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fb32b750d0 0x55fb32b7b7c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.168+0000 7f1db1e39740 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fb32b77980 0x55fb32b7bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.168+0000 7f1db1e39740 1 --2- 172.21.15.82:0/932543164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fb32b6e290 0x55fb32b7b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.168+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 >> 172.21.15.82:0/932543164 conn(0x55fb32b68bb0 msgr2=0x55fb32b69e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.168+0000 7f1d8c7f8640 0 client.16821 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.168+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 shutdown_connections 2024-03-27T07:29:41.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.168+0000 7f1db1e39740 1 -- 172.21.15.82:0/932543164 wait complete. 2024-03-27T07:29:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.169+0000 7f1db1e39740 20 client.16821 trim_cache size 0 max 16384 2024-03-27T07:29:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:29:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:29:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:29:41.172 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:29:41.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.179+0000 7f1dadf15640 1 -- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1d900a3980 msgr2=0x7f1d900a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:41.183 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.180+0000 7f1dadf15640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1d900a3980 0x7f1d900a5e40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800c6a0 tx=0x7f1d98013000 comp rx=0 tx=0).stop 2024-03-27T07:29:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.180+0000 7f1dadf15640 1 -- 172.21.15.82:0/3633450470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1da81100d0 msgr2=0x7f1da81aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.180+0000 7f1dadf15640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1da81100d0 0x7f1da81aba70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e970 tx=0x7f1d9800ee30 comp rx=0 tx=0).stop 2024-03-27T07:29:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.180+0000 7f1dadf15640 1 -- 172.21.15.82:0/3633450470 shutdown_connections 2024-03-27T07:29:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.180+0000 7f1dadf15640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1d900a3980 0x7f1d900a5e40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.180+0000 7f1dadf15640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1da81100d0 0x7f1da81aba70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.180+0000 7f1dadf15640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1da810e750 0x7f1da81a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.180+0000 7f1dadf15640 1 --2- 172.21.15.82:0/3633450470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1da810dc30 0x7f1da81a71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.180+0000 7f1dadf15640 1 -- 172.21.15.82:0/3633450470 >> 172.21.15.82:0/3633450470 conn(0x7f1da806ca60 msgr2=0x7f1da8070ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.181+0000 7f1dadf15640 1 -- 172.21.15.82:0/3633450470 shutdown_connections 2024-03-27T07:29:41.184 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:41.181+0000 7f1dadf15640 1 -- 172.21.15.82:0/3633450470 wait complete. 2024-03-27T07:29:42.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:42 smithi082 ceph-mon[32178]: pgmap v186: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 734 op/s 2024-03-27T07:29:42.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:42 smithi149 ceph-mon[36065]: pgmap v186: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 734 op/s 2024-03-27T07:29:42.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:42 smithi153 ceph-mon[36179]: pgmap v186: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 11 MiB/s wr, 734 op/s 2024-03-27T07:29:44.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:44 smithi082 ceph-mon[32178]: pgmap v187: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2024-03-27T07:29:44.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:44 smithi149 ceph-mon[36065]: pgmap v187: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2024-03-27T07:29:44.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:44 smithi153 ceph-mon[36179]: pgmap v187: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 13 MiB/s wr, 1.19k op/s 2024-03-27T07:29:46.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:46 smithi082 ceph-mon[32178]: pgmap v188: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 1.11k op/s 2024-03-27T07:29:46.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:46 smithi149 ceph-mon[36065]: pgmap v188: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 1.11k op/s 2024-03-27T07:29:46.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:46 smithi153 ceph-mon[36179]: pgmap v188: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 1.11k op/s 2024-03-27T07:29:47.171 INFO:tasks.workunit.client.0.smithi082.stdout: 355 2270633 680 1595946 645 844655 1315 2024-03-27T07:29:48.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:48 smithi082 ceph-mon[32178]: pgmap v189: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-03-27T07:29:48.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:48 smithi149 ceph-mon[36065]: pgmap v189: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-03-27T07:29:48.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:48 smithi153 ceph-mon[36179]: pgmap v189: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 1.18k op/s 2024-03-27T07:29:50.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:50 smithi082 ceph-mon[32178]: pgmap v190: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.9 MiB/s wr, 806 op/s 2024-03-27T07:29:50.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:50 smithi149 ceph-mon[36065]: pgmap v190: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.9 MiB/s wr, 806 op/s 2024-03-27T07:29:50.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:50 smithi153 ceph-mon[36179]: pgmap v190: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.9 MiB/s wr, 806 op/s 2024-03-27T07:29:52.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:52 smithi082 ceph-mon[32178]: pgmap v191: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.4 MiB/s wr, 772 op/s 2024-03-27T07:29:52.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:52 smithi149 ceph-mon[36065]: pgmap v191: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.4 MiB/s wr, 772 op/s 2024-03-27T07:29:52.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:52 smithi153 ceph-mon[36179]: pgmap v191: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.4 MiB/s wr, 772 op/s 2024-03-27T07:29:54.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:54 smithi082 ceph-mon[32178]: pgmap v192: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 648 op/s 2024-03-27T07:29:54.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:54 smithi149 ceph-mon[36065]: pgmap v192: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 648 op/s 2024-03-27T07:29:54.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:54 smithi153 ceph-mon[36179]: pgmap v192: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 648 op/s 2024-03-27T07:29:55.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:55 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:29:55.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:55 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:29:55.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:55 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:29:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.926+0000 7f0252ffa640 1 -- 172.21.15.82:0/2570968223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f024c10d2a0 msgr2=0x7f024c079e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.926+0000 7f0252ffa640 1 --2- 172.21.15.82:0/2570968223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f024c10d2a0 0x7f024c079e60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f023c009900 tx=0x7f023c02bd10 comp rx=0 tx=0).stop 2024-03-27T07:29:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.943+0000 7f0252ffa640 1 -- 172.21.15.82:0/2570968223 shutdown_connections 2024-03-27T07:29:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.943+0000 7f0252ffa640 1 --2- 172.21.15.82:0/2570968223 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c10e7c0 0x7f024c10cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.943+0000 7f0252ffa640 1 --2- 172.21.15.82:0/2570968223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f024c10d2a0 0x7f024c079e60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:55.945 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.943+0000 7f0252ffa640 1 --2- 172.21.15.82:0/2570968223 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f024c10dea0 0x7f024c10e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:55.946 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.943+0000 7f0252ffa640 1 -- 172.21.15.82:0/2570968223 >> 172.21.15.82:0/2570968223 conn(0x7f024c06ca60 msgr2=0x7f024c06ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.945+0000 7f0252ffa640 1 -- 172.21.15.82:0/2570968223 shutdown_connections 2024-03-27T07:29:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.946+0000 7f0252ffa640 1 -- 172.21.15.82:0/2570968223 wait complete. 2024-03-27T07:29:55.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.947+0000 7f0252ffa640 1 Processor -- start 2024-03-27T07:29:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.947+0000 7f0252ffa640 1 -- start start 2024-03-27T07:29:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.947+0000 7f0252ffa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f024c10d2a0 0x7f024c079e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.947+0000 7f0252ffa640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c10dea0 0x7f024c073e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:55.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.947+0000 7f0252ffa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f024c10e7c0 0x7f024c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.947+0000 7f0252ffa640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f024c07c4a0 con 0x7f024c10dea0 2024-03-27T07:29:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.947+0000 7f0252ffa640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f024c07c320 con 0x7f024c10d2a0 2024-03-27T07:29:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.947+0000 7f0252ffa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f024c07c620 con 0x7f024c10e7c0 2024-03-27T07:29:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.948+0000 7f0251ff8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f024c10d2a0 0x7f024c079e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.948+0000 7f0251ff8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f024c10d2a0 0x7f024c079e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:54780/0 (socket says 172.21.15.82:54780) 2024-03-27T07:29:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.948+0000 7f0251ff8640 1 -- 172.21.15.82:0/2108606445 learned_addr learned my addr 172.21.15.82:0/2108606445 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.948+0000 7f02527f9640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f024c10e7c0 0x7f024c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.949+0000 7f0251ff8640 1 -- 172.21.15.82:0/2108606445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f024c10e7c0 msgr2=0x7f024c0745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.949+0000 7f0251ff8640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f024c10e7c0 0x7f024c0745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.949+0000 7f0251ff8640 1 -- 172.21.15.82:0/2108606445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c10dea0 msgr2=0x7f024c073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.949+0000 7f0251ff8640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c10dea0 0x7f024c073e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.949+0000 7f0251ff8640 1 -- 172.21.15.82:0/2108606445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c136e00 con 0x7f024c10d2a0 2024-03-27T07:29:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.950+0000 7f0251ff8640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f024c10d2a0 0x7f024c079e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f024800c890 tx=0x7f024800cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.997+0000 7f0242ffd640 1 -- 172.21.15.82:0/2108606445 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248004220 con 0x7f024c10d2a0 2024-03-27T07:29:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.997+0000 7f0252ffa640 1 -- 172.21.15.82:0/2108606445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024c1370f0 con 0x7f024c10d2a0 2024-03-27T07:29:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.997+0000 7f0252ffa640 1 -- 172.21.15.82:0/2108606445 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024c137610 con 0x7f024c10d2a0 2024-03-27T07:29:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.997+0000 7f0242ffd640 1 -- 172.21.15.82:0/2108606445 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0248007e30 con 0x7f024c10d2a0 2024-03-27T07:29:56.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:55.997+0000 7f0242ffd640 1 -- 172.21.15.82:0/2108606445 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248004a00 con 0x7f024c10d2a0 2024-03-27T07:29:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.001+0000 7f0256e49740 1 Processor -- start 2024-03-27T07:29:56.004 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.001+0000 7f0256e49740 1 -- start start 2024-03-27T07:29:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.002+0000 7f0256e49740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 0x556ef1217670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.002+0000 7f0256e49740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef1220440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.002+0000 7f0256e49740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef1222d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.002+0000 7f0242ffd640 1 -- 172.21.15.82:0/2108606445 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f0248004ba0 con 0x7f024c10d2a0 2024-03-27T07:29:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.002+0000 7f0256e49740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556ef11ddcd0 con 0x556ef1217bb0 2024-03-27T07:29:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.002+0000 7f0256e49740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556ef1122950 con 0x556ef1220980 2024-03-27T07:29:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.002+0000 7f0256e49740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556ef117ae50 con 0x556ef1217290 2024-03-27T07:29:56.005 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.003+0000 7f0242ffd640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02380a3980 0x7f02380a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:56.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.003+0000 7f0242ffd640 1 -- 172.21.15.82:0/2108606445 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f02480d0d00 con 0x7f024c10d2a0 2024-03-27T07:29:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.012+0000 7f02517f7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef1222d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:56.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.012+0000 7f02527f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 0x556ef1217670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.012+0000 7f02527f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 0x556ef1217670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:45644/0 (socket says 172.21.15.82:45644) 2024-03-27T07:29:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.012+0000 7f02527f9640 1 -- 172.21.15.82:0/2726527072 learned_addr learned my addr 172.21.15.82:0/2726527072 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.013+0000 7f02517f7640 1 -- 172.21.15.82:0/2726527072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 msgr2=0x556ef1217670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.013+0000 7f02517f7640 1 --2- 172.21.15.82:0/2726527072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 0x556ef1217670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:56.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.013+0000 7f02517f7640 1 -- 172.21.15.82:0/2726527072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 msgr2=0x556ef1220440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.013+0000 7f02517f7640 1 --2- 172.21.15.82:0/2726527072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef1220440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.013+0000 7f02517f7640 1 -- 172.21.15.82:0/2726527072 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef0e8f210 con 0x556ef1220980 2024-03-27T07:29:56.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.013+0000 7f02517f7640 1 --2- 172.21.15.82:0/2726527072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef1222d70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f024c0756c0 tx=0x7f024400e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4632e895d7bd0a51 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:56.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.019+0000 7f0237fff640 1 -- 172.21.15.82:0/2726527072 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244016070 con 0x556ef1220980 2024-03-27T07:29:56.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.019+0000 7f0237fff640 1 -- 172.21.15.82:0/2726527072 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0244005020 con 0x556ef1220980 2024-03-27T07:29:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.020+0000 7f0256e49740 1 -- 172.21.15.82:0/2726527072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 msgr2=0x556ef1222d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:56.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.020+0000 7f0256e49740 1 --2- 172.21.15.82:0/2726527072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef1222d70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f024c0756c0 tx=0x7f024400e6c0 comp rx=0 tx=0).stop 2024-03-27T07:29:56.026 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.024+0000 7f02527f9640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02380a3980 0x7f02380a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.026+0000 7f0256e49740 1 -- 172.21.15.82:0/2726527072 shutdown_connections 2024-03-27T07:29:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.026+0000 7f0256e49740 1 --2- 172.21.15.82:0/2726527072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef1220440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.026+0000 7f0256e49740 1 --2- 172.21.15.82:0/2726527072 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef1222d70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.026+0000 7f0256e49740 1 --2- 172.21.15.82:0/2726527072 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 0x556ef1217670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.026+0000 7f0256e49740 1 -- 172.21.15.82:0/2726527072 >> 172.21.15.82:0/2726527072 conn(0x556ef1211bb0 msgr2=0x556ef1211f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.026+0000 7f0256e49740 1 -- 172.21.15.82:0/2726527072 shutdown_connections 2024-03-27T07:29:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.026+0000 7f0256e49740 1 -- 172.21.15.82:0/2726527072 wait complete. 2024-03-27T07:29:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.027+0000 7f0256e49740 1 -- start start 2024-03-27T07:29:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.027+0000 7f0256e49740 1 Processor -- start 2024-03-27T07:29:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.028+0000 7f0256e49740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1217290 0x556ef121d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.028+0000 7f0256e49740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef121de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.028+0000 7f0256e49740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1220980 0x556ef121e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.028+0000 7f0256e49740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556ef1176e00 con 0x556ef1217bb0 2024-03-27T07:29:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.028+0000 7f0256e49740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556ef1123520 con 0x556ef1217290 2024-03-27T07:29:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.028+0000 7f0256e49740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556ef11368e0 con 0x556ef1220980 2024-03-27T07:29:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.028+0000 7f0256e49740 10 client.0 _ll_register_callbacks cb 0x556ef1171a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:29:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.032+0000 7f02527f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1220980 0x556ef121e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.032+0000 7f02527f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1220980 0x556ef121e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:45654/0 (socket says 172.21.15.82:45654) 2024-03-27T07:29:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.032+0000 7f02527f9640 1 -- 172.21.15.82:0/1480946106 learned_addr learned my addr 172.21.15.82:0/1480946106 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.032+0000 7f0251ff8640 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1217290 0x556ef121d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:56.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.032+0000 7f02527f9640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02380a3980 0x7f02380a5e40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f023c009230 tx=0x7f023c02e040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.033+0000 7f02527f9640 1 -- 172.21.15.82:0/1480946106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1217290 msgr2=0x556ef121d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.033+0000 7f02527f9640 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1217290 0x556ef121d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.033+0000 7f02527f9640 1 -- 172.21.15.82:0/1480946106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 msgr2=0x556ef121de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.033+0000 7f02527f9640 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef121de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.033+0000 7f02527f9640 1 -- 172.21.15.82:0/1480946106 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef0f5b620 con 0x556ef1220980 2024-03-27T07:29:56.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.033+0000 7f02527f9640 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1220980 0x556ef121e3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f023c009850 tx=0x7f023c045040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c656022557f8e9a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.038+0000 7f02357fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:29:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.038+0000 7f02357fa640 1 -- 172.21.15.82:0/1480946106 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c051060 con 0x556ef1220980 2024-03-27T07:29:56.045 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.040+0000 7f0256e49740 1 -- 172.21.15.82:0/1480946106 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0244005020 con 0x556ef1220980 2024-03-27T07:29:56.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.044+0000 7f02357fa640 1 -- 172.21.15.82:0/1480946106 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f023c034850 con 0x556ef1220980 2024-03-27T07:29:56.046 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.044+0000 7f02357fa640 1 -- 172.21.15.82:0/1480946106 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f023c039040 con 0x556ef1220980 2024-03-27T07:29:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.055+0000 7f0256e49740 10 client.26686 fetch_fsmap learned FSMap version 30 2024-03-27T07:29:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.055+0000 7f0256e49740 1 -- 172.21.15.82:0/1480946106 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556ef122f620 con 0x556ef1220980 2024-03-27T07:29:56.068 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.066+0000 7f02357fa640 1 -- 172.21.15.82:0/1480946106 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0244005020 con 0x556ef1220980 2024-03-27T07:29:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.066+0000 7f02357fa640 1 -- 172.21.15.82:0/1480946106 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f023c03f040 con 0x556ef1220980 2024-03-27T07:29:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.066+0000 7f0256e49740 10 client.26686 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:29:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.066+0000 7f0256e49740 10 client.26686 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:29:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.066+0000 7f0256e49740 20 client.26686 populate_metadata read hostname 'smithi082' 2024-03-27T07:29:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.066+0000 7f0256e49740 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556ef1231020 0x556ef12334a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.066+0000 7f0256e49740 4 client.26686 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:29:56.069 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.066+0000 7f0256e49740 1 -- 172.21.15.82:0/1480946106 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ef1188390 con 0x556ef1231020 2024-03-27T07:29:56.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.075+0000 7f0251ff8640 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556ef1231020 0x556ef12334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:56.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.095+0000 7f0251ff8640 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556ef1231020 0x556ef12334a0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee36e7baf4879b7 server_cookie=708bc8180fcddaa0 in_seq=0 out_seq=0 2024-03-27T07:29:56.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:56.096+0000 7f02357fa640 10 client.26686 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:56.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:56 smithi149 ceph-mon[36065]: pgmap v193: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 175 op/s 2024-03-27T07:29:56.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:56 smithi153 ceph-mon[36179]: pgmap v193: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 175 op/s 2024-03-27T07:29:56.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:56 smithi082 ceph-mon[32178]: pgmap v193: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 175 op/s 2024-03-27T07:29:57.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.098+0000 7f02357fa640 1 -- 172.21.15.82:0/1480946106 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556ef1188390 con 0x556ef1231020 2024-03-27T07:29:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.098+0000 7f02357fa640 10 client.26686 handle_command_reply: tid=0 2024-03-27T07:29:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.098+0000 7f0256e49740 1 client.26686 shutdown 2024-03-27T07:29:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.098+0000 7f0256e49740 1 -- 172.21.15.82:0/1480946106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1220980 msgr2=0x556ef121e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.098+0000 7f0256e49740 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1220980 0x556ef121e3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f023c009850 tx=0x7f023c045040 comp rx=0 tx=0).stop 2024-03-27T07:29:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.100+0000 7f0256e49740 1 -- 172.21.15.82:0/1480946106 shutdown_connections 2024-03-27T07:29:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.100+0000 7f0256e49740 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556ef1231020 0x556ef12334a0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.100+0000 7f0256e49740 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef121de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.100+0000 7f0256e49740 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1220980 0x556ef121e3b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.100+0000 7f0256e49740 1 --2- 172.21.15.82:0/1480946106 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1217290 0x556ef121d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.100+0000 7f0256e49740 1 -- 172.21.15.82:0/1480946106 >> 172.21.15.82:0/1480946106 conn(0x556ef1211bb0 msgr2=0x556ef1213900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.100+0000 7f02357fa640 0 client.26686 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.101+0000 7f0256e49740 1 -- 172.21.15.82:0/1480946106 shutdown_connections 2024-03-27T07:29:57.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.101+0000 7f0256e49740 1 -- 172.21.15.82:0/1480946106 wait complete. 2024-03-27T07:29:57.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.102+0000 7f0256e49740 20 client.26686 trim_cache size 0 max 16384 2024-03-27T07:29:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.144+0000 7f0256e49740 1 Processor -- start 2024-03-27T07:29:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.144+0000 7f0256e49740 1 -- start start 2024-03-27T07:29:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.145+0000 7f0256e49740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 0x556ef122c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.145+0000 7f0256e49740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef1238d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.146+0000 7f0251ff8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 0x556ef122c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.146+0000 7f0256e49740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef121dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.146+0000 7f0256e49740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0230011110 con 0x556ef1217bb0 2024-03-27T07:29:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.146+0000 7f0256e49740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f023000e980 con 0x556ef1220980 2024-03-27T07:29:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.146+0000 7f0256e49740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f023000c7d0 con 0x556ef1217290 2024-03-27T07:29:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.146+0000 7f0251ff8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 0x556ef122c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:45670/0 (socket says 172.21.15.82:45670) 2024-03-27T07:29:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.146+0000 7f0251ff8640 1 -- 172.21.15.82:0/667424753 learned_addr learned my addr 172.21.15.82:0/667424753 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.146+0000 7f02527f9640 1 --2- 172.21.15.82:0/667424753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef121dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.147+0000 7f02517f7640 1 --2- 172.21.15.82:0/667424753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef1238d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.148+0000 7f02517f7640 1 -- 172.21.15.82:0/667424753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 msgr2=0x556ef122c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.148+0000 7f02517f7640 1 --2- 172.21.15.82:0/667424753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 0x556ef122c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.148+0000 7f02517f7640 1 -- 172.21.15.82:0/667424753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 msgr2=0x556ef121dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.148+0000 7f02517f7640 1 --2- 172.21.15.82:0/667424753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef121dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.148+0000 7f02517f7640 1 -- 172.21.15.82:0/667424753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ef121bee0 con 0x556ef1217bb0 2024-03-27T07:29:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.149+0000 7f02517f7640 1 --2- 172.21.15.82:0/667424753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef1238d70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x556ef1212910 tx=0x7f0244009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c29e960b6bf5ba server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.150+0000 7f02377fe640 1 -- 172.21.15.82:0/667424753 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244016070 con 0x556ef1217bb0 2024-03-27T07:29:57.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.150+0000 7f02377fe640 1 -- 172.21.15.82:0/667424753 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0244003970 con 0x556ef1217bb0 2024-03-27T07:29:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.150+0000 7f02377fe640 1 -- 172.21.15.82:0/667424753 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244011bf0 con 0x556ef1217bb0 2024-03-27T07:29:57.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.151+0000 7f0256e49740 1 -- 172.21.15.82:0/667424753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 msgr2=0x556ef1238d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:57.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.151+0000 7f0256e49740 1 --2- 172.21.15.82:0/667424753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef1238d70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x556ef1212910 tx=0x7f0244009f10 comp rx=0 tx=0).stop 2024-03-27T07:29:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.155+0000 7f0256e49740 1 -- 172.21.15.82:0/667424753 shutdown_connections 2024-03-27T07:29:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.155+0000 7f0256e49740 1 --2- 172.21.15.82:0/667424753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217bb0 0x556ef1238d70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.155+0000 7f0256e49740 1 --2- 172.21.15.82:0/667424753 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef121dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.155+0000 7f0256e49740 1 --2- 172.21.15.82:0/667424753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217290 0x556ef122c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.155+0000 7f0256e49740 1 -- 172.21.15.82:0/667424753 >> 172.21.15.82:0/667424753 conn(0x556ef1211bb0 msgr2=0x556ef120c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.161+0000 7f0256e49740 1 -- 172.21.15.82:0/667424753 shutdown_connections 2024-03-27T07:29:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.161+0000 7f0256e49740 1 -- 172.21.15.82:0/667424753 wait complete. 2024-03-27T07:29:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.162+0000 7f0256e49740 1 -- start start 2024-03-27T07:29:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.162+0000 7f0256e49740 1 Processor -- start 2024-03-27T07:29:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.163+0000 7f0256e49740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217290 0x556ef12288e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.163+0000 7f0256e49740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217bb0 0x556ef1223d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.163+0000 7f0256e49740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef12242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.163+0000 7f02517f7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217bb0 0x556ef1223d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f02517f7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217bb0 0x556ef1223d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:45678/0 (socket says 172.21.15.82:45678) 2024-03-27T07:29:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f02517f7640 1 -- 172.21.15.82:0/3669268480 learned_addr learned my addr 172.21.15.82:0/3669268480 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:29:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f023000ce40 con 0x556ef1217290 2024-03-27T07:29:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f02527f9640 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef12242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f023000e2b0 con 0x556ef1220980 2024-03-27T07:29:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f023000d510 con 0x556ef1217bb0 2024-03-27T07:29:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f0256e49740 10 client.0 _ll_register_callbacks cb 0x7f023c0047c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:29:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f02517f7640 1 -- 172.21.15.82:0/3669268480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 msgr2=0x556ef12242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f02517f7640 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef12242a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f02517f7640 1 -- 172.21.15.82:0/3669268480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217290 msgr2=0x556ef12288e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:29:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f02517f7640 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217290 0x556ef12288e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.164+0000 7f02517f7640 1 -- 172.21.15.82:0/3669268480 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ef1224940 con 0x556ef1217bb0 2024-03-27T07:29:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.165+0000 7f02517f7640 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217bb0 0x556ef1223d60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0244009640 tx=0x7f0244000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6423b08b35dc5cf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:29:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.165+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0244003970 con 0x556ef1217bb0 2024-03-27T07:29:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.165+0000 7f02357fa640 10 client.26692 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:29:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.165+0000 7f02357fa640 1 -- 172.21.15.82:0/3669268480 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244016040 con 0x556ef1217bb0 2024-03-27T07:29:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.165+0000 7f02357fa640 1 -- 172.21.15.82:0/3669268480 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8440+0+0 (secure 0 0 0) 0x7f0244011a70 con 0x556ef1217bb0 2024-03-27T07:29:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.165+0000 7f02357fa640 1 -- 172.21.15.82:0/3669268480 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0244036050 con 0x556ef1217bb0 2024-03-27T07:29:57.171 INFO:tasks.workunit.client.0.smithi082.stdout: 364 2035383 591 1417112 477 791394 1496 2024-03-27T07:29:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.175+0000 7f0256e49740 10 client.26692 fetch_fsmap learned FSMap version 30 2024-03-27T07:29:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.175+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({fsmap=30}) -- 0x556ef1297100 con 0x556ef1217bb0 2024-03-27T07:29:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.177+0000 7f02357fa640 1 -- 172.21.15.82:0/3669268480 <== mon.1 v2:172.21.15.153:3300/0 4 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7f024400f040 con 0x556ef1217bb0 2024-03-27T07:29:57.180 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.177+0000 7f0256e49740 10 client.26692 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:29:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.177+0000 7f0256e49740 10 client.26692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:29:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.177+0000 7f0256e49740 20 client.26692 populate_metadata read hostname 'smithi082' 2024-03-27T07:29:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.178+0000 7f0256e49740 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556ef12975e0 0x556ef1299a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:29:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.178+0000 7f0256e49740 4 client.26692 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:29:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.178+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f0244003970 con 0x556ef12975e0 2024-03-27T07:29:57.181 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.178+0000 7f0251ff8640 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556ef12975e0 0x556ef1299a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:29:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.187+0000 7f0251ff8640 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556ef12975e0 0x556ef1299a00 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ffc2ab5e8c02f21 server_cookie=a0ea4258e3ad2954 in_seq=0 out_seq=0 2024-03-27T07:29:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:57.187+0000 7f02357fa640 10 client.26692 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:58.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:58 smithi149 ceph-mon[36065]: pgmap v194: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.2 MiB/s wr, 543 op/s 2024-03-27T07:29:58.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:58 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:29:58.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:58 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:29:58.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:29:58 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:29:58.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:58 smithi153 ceph-mon[36179]: pgmap v194: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.2 MiB/s wr, 543 op/s 2024-03-27T07:29:58.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:58 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:29:58.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:58 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:29:58.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:29:58 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:29:58.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:58 smithi082 ceph-mon[32178]: pgmap v194: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 8.2 MiB/s wr, 543 op/s 2024-03-27T07:29:58.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:58 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:29:58.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:58 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:29:58.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:29:58 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:29:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.452+0000 7f02357fa640 1 -- 172.21.15.82:0/3669268480 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f0244003970 con 0x556ef12975e0 2024-03-27T07:29:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.452+0000 7f02357fa640 10 client.26692 handle_command_reply: tid=0 2024-03-27T07:29:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.452+0000 7f0256e49740 1 client.26692 shutdown 2024-03-27T07:29:59.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217bb0 msgr2=0x556ef1223d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:59.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f0256e49740 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217bb0 0x556ef1223d60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0244009640 tx=0x7f0244000f40 comp rx=0 tx=0).stop 2024-03-27T07:29:59.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 shutdown_connections 2024-03-27T07:29:59.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f0256e49740 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556ef1220980 0x556ef12242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:59.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f0256e49740 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556ef1217bb0 0x556ef1223d60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:59.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f0256e49740 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556ef12975e0 0x556ef1299a00 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:59.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f0256e49740 1 --2- 172.21.15.82:0/3669268480 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556ef1217290 0x556ef12288e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:59.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 >> 172.21.15.82:0/3669268480 conn(0x556ef1211bb0 msgr2=0x556ef1212fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:59.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f02357fa640 0 client.26692 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:29:59.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 shutdown_connections 2024-03-27T07:29:59.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.456+0000 7f0256e49740 1 -- 172.21.15.82:0/3669268480 wait complete. 2024-03-27T07:29:59.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.457+0000 7f0256e49740 20 client.26692 trim_cache size 0 max 16384 2024-03-27T07:29:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:29:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:29:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:29:59.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:29:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.483+0000 7f0252ffa640 1 -- 172.21.15.82:0/2108606445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02380a3980 msgr2=0x7f02380a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:59.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.483+0000 7f0252ffa640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02380a3980 0x7f02380a5e40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f023c009230 tx=0x7f023c02e040 comp rx=0 tx=0).stop 2024-03-27T07:29:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.483+0000 7f0252ffa640 1 -- 172.21.15.82:0/2108606445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f024c10d2a0 msgr2=0x7f024c079e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:29:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.483+0000 7f0252ffa640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f024c10d2a0 0x7f024c079e00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f024800c890 tx=0x7f024800cd50 comp rx=0 tx=0).stop 2024-03-27T07:29:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.484+0000 7f0252ffa640 1 -- 172.21.15.82:0/2108606445 shutdown_connections 2024-03-27T07:29:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.484+0000 7f0252ffa640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f02380a3980 0x7f02380a5e40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.484+0000 7f0252ffa640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f024c10dea0 0x7f024c073e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.484+0000 7f0252ffa640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f024c10e7c0 0x7f024c0745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.484+0000 7f0252ffa640 1 --2- 172.21.15.82:0/2108606445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f024c10d2a0 0x7f024c079e00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:29:59.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.484+0000 7f0252ffa640 1 -- 172.21.15.82:0/2108606445 >> 172.21.15.82:0/2108606445 conn(0x7f024c06ca60 msgr2=0x7f024c070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:29:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.486+0000 7f0252ffa640 1 -- 172.21.15.82:0/2108606445 shutdown_connections 2024-03-27T07:29:59.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:29:59.486+0000 7f0252ffa640 1 -- 172.21.15.82:0/2108606445 wait complete. 2024-03-27T07:30:00.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:00 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[32174]: 2024-03-27T07:29:59.999+0000 7fbafc1bf700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-03-27T07:30:00.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:00 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[32174]: 2024-03-27T07:29:59.999+0000 7fbafc1bf700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-03-27T07:30:00.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:00 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[32174]: 2024-03-27T07:29:59.999+0000 7fbafc1bf700 -1 log_channel(cluster) log [ERR] : mds.h(mds.2): Metadata damage detected 2024-03-27T07:30:00.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:00 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[32174]: 2024-03-27T07:29:59.999+0000 7fbafc1bf700 -1 log_channel(cluster) log [ERR] : mds.i(mds.1): Metadata damage detected 2024-03-27T07:30:00.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:00 smithi082 ceph-mon[32178]: pgmap v195: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 524 op/s 2024-03-27T07:30:00.440 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:00 smithi082 ceph-mon[32178]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-03-27T07:30:00.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:00 smithi082 ceph-mon[32178]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-03-27T07:30:00.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:00 smithi082 ceph-mon[32178]: mds.h(mds.2): Metadata damage detected 2024-03-27T07:30:00.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:00 smithi082 ceph-mon[32178]: mds.i(mds.1): Metadata damage detected 2024-03-27T07:30:00.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:00 smithi149 ceph-mon[36065]: pgmap v195: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 524 op/s 2024-03-27T07:30:00.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:00 smithi149 ceph-mon[36065]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-03-27T07:30:00.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:00 smithi149 ceph-mon[36065]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-03-27T07:30:00.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:00 smithi149 ceph-mon[36065]: mds.h(mds.2): Metadata damage detected 2024-03-27T07:30:00.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:00 smithi149 ceph-mon[36065]: mds.i(mds.1): Metadata damage detected 2024-03-27T07:30:00.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:00 smithi153 ceph-mon[36179]: pgmap v195: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 524 op/s 2024-03-27T07:30:00.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:00 smithi153 ceph-mon[36179]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-03-27T07:30:00.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:00 smithi153 ceph-mon[36179]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-03-27T07:30:00.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:00 smithi153 ceph-mon[36179]: mds.h(mds.2): Metadata damage detected 2024-03-27T07:30:00.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:00 smithi153 ceph-mon[36179]: mds.i(mds.1): Metadata damage detected 2024-03-27T07:30:02.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:02 smithi149 ceph-mon[36065]: pgmap v196: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.2 MiB/s wr, 606 op/s 2024-03-27T07:30:02.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:02 smithi153 ceph-mon[36179]: pgmap v196: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.2 MiB/s wr, 606 op/s 2024-03-27T07:30:02.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:02 smithi082 ceph-mon[32178]: pgmap v196: 97 pgs: 97 active+clean; 1.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.2 MiB/s wr, 606 op/s 2024-03-27T07:30:04.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:04 smithi149 ceph-mon[36065]: pgmap v197: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-03-27T07:30:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:04 smithi153 ceph-mon[36179]: pgmap v197: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-03-27T07:30:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:04 smithi082 ceph-mon[32178]: pgmap v197: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 11 MiB/s wr, 1.00k op/s 2024-03-27T07:30:05.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:05 smithi149 ceph-mon[36065]: osdmap e90: 12 total, 12 up, 12 in 2024-03-27T07:30:05.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:05 smithi153 ceph-mon[36179]: osdmap e90: 12 total, 12 up, 12 in 2024-03-27T07:30:05.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:05 smithi082 ceph-mon[32178]: osdmap e90: 12 total, 12 up, 12 in 2024-03-27T07:30:06.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:06 smithi149 ceph-mon[36065]: pgmap v199: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2024-03-27T07:30:06.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:06 smithi153 ceph-mon[36179]: pgmap v199: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2024-03-27T07:30:06.590 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:06 smithi082 ceph-mon[32178]: pgmap v199: 97 pgs: 97 active+clean; 1.6 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2024-03-27T07:30:07.171 INFO:tasks.workunit.client.0.smithi082.stdout: 371 1529022 486 1082456 510 613912 609 2024-03-27T07:30:08.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:08 smithi149 ceph-mon[36065]: pgmap v200: 97 pgs: 36 active+clean+snaptrim_wait, 41 active+clean, 20 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 881 op/s 2024-03-27T07:30:08.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:08 smithi153 ceph-mon[36179]: pgmap v200: 97 pgs: 36 active+clean+snaptrim_wait, 41 active+clean, 20 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 881 op/s 2024-03-27T07:30:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:08 smithi082 ceph-mon[32178]: pgmap v200: 97 pgs: 36 active+clean+snaptrim_wait, 41 active+clean, 20 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.2 MiB/s wr, 881 op/s 2024-03-27T07:30:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:10 smithi149 ceph-mon[36065]: pgmap v201: 97 pgs: 42 active+clean+snaptrim_wait, 33 active+clean, 22 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 833 op/s 2024-03-27T07:30:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:10 smithi153 ceph-mon[36179]: pgmap v201: 97 pgs: 42 active+clean+snaptrim_wait, 33 active+clean, 22 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 833 op/s 2024-03-27T07:30:10.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:10 smithi082 ceph-mon[32178]: pgmap v201: 97 pgs: 42 active+clean+snaptrim_wait, 33 active+clean, 22 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 833 op/s 2024-03-27T07:30:12.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:12 smithi149 ceph-mon[36065]: pgmap v202: 97 pgs: 37 active+clean+snaptrim_wait, 42 active+clean, 18 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 737 op/s 2024-03-27T07:30:12.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:12 smithi153 ceph-mon[36179]: pgmap v202: 97 pgs: 37 active+clean+snaptrim_wait, 42 active+clean, 18 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 737 op/s 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.591+0000 7fcc09dd7640 1 -- 172.21.15.82:0/985976136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041059f0 msgr2=0x7fcc04105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.591+0000 7fcc09dd7640 1 --2- 172.21.15.82:0/985976136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041059f0 0x7fcc04105dd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009900 tx=0x7fcbf402bc30 comp rx=0 tx=0).stop 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.591+0000 7fcc09dd7640 1 -- 172.21.15.82:0/985976136 shutdown_connections 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.591+0000 7fcc09dd7640 1 --2- 172.21.15.82:0/985976136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc04101660 0x7fcc0410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.592+0000 7fcc09dd7640 1 --2- 172.21.15.82:0/985976136 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc04100ca0 0x7fcc04101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.592+0000 7fcc09dd7640 1 --2- 172.21.15.82:0/985976136 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041059f0 0x7fcc04105dd0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.592+0000 7fcc09dd7640 1 -- 172.21.15.82:0/985976136 >> 172.21.15.82:0/985976136 conn(0x7fcc040778a0 msgr2=0x7fcc04077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.592+0000 7fcc09dd7640 1 -- 172.21.15.82:0/985976136 shutdown_connections 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.592+0000 7fcc09dd7640 1 -- 172.21.15.82:0/985976136 wait complete. 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.592+0000 7fcc09dd7640 1 Processor -- start 2024-03-27T07:30:12.597 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.592+0000 7fcc09dd7640 1 -- start start 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.592+0000 7fcc09dd7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc04100ca0 0x7fcc041026c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc09dd7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc04101660 0x7fcc04102c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc09dd7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041059f0 0x7fcc04103140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc09dd7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04110f10 con 0x7fcc041059f0 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc09dd7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04110d90 con 0x7fcc04100ca0 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc09dd7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04111090 con 0x7fcc04101660 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041059f0 0x7fcc04103140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041059f0 0x7fcc04103140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49882/0 (socket says 172.21.15.82:49882) 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc03fff640 1 -- 172.21.15.82:0/302510205 learned_addr learned my addr 172.21.15.82:0/302510205 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc037fe640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc04100ca0 0x7fcc041026c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.598 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc02ffd640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc04101660 0x7fcc04102c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc03fff640 1 -- 172.21.15.82:0/302510205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc04101660 msgr2=0x7fcc04102c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc03fff640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc04101660 0x7fcc04102c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc03fff640 1 -- 172.21.15.82:0/302510205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc04100ca0 msgr2=0x7fcc041026c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc03fff640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc04100ca0 0x7fcc041026c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc03fff640 1 -- 172.21.15.82:0/302510205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc041a6910 con 0x7fcc041059f0 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc03fff640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041059f0 0x7fcc04103140 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00ea60 tx=0x7fcbfc00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc00ff9640 1 -- 172.21.15.82:0/302510205 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc00ce40 con 0x7fcc041059f0 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc09dd7640 1 -- 172.21.15.82:0/302510205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc041a6c00 con 0x7fcc041059f0 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc00ff9640 1 -- 172.21.15.82:0/302510205 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbfc005020 con 0x7fcc041059f0 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc00ff9640 1 -- 172.21.15.82:0/302510205 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc010690 con 0x7fcc041059f0 2024-03-27T07:30:12.599 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.593+0000 7fcc09dd7640 1 -- 172.21.15.82:0/302510205 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc041a71a0 con 0x7fcc041059f0 2024-03-27T07:30:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.595+0000 7fcc00ff9640 1 -- 172.21.15.82:0/302510205 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fcbfc0051d0 con 0x7fcc041059f0 2024-03-27T07:30:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc0c9c3740 1 Processor -- start 2024-03-27T07:30:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc0c9c3740 1 -- start start 2024-03-27T07:30:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc00ff9640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fcbf00a3820 0x7fcbf00a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd920f0 0x5560efd924d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd92a10 0x5560efd9b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd9dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5560efd58cd0 con 0x5560efd9b7e0 2024-03-27T07:30:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5560efc9d950 con 0x5560efd920f0 2024-03-27T07:30:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5560efcf5e50 con 0x5560efd92a10 2024-03-27T07:30:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc02ffd640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fcbf00a3820 0x7fcbf00a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd9dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd920f0 0x5560efd924d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd920f0 0x5560efd924d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:56004/0 (socket says 172.21.15.82:56004) 2024-03-27T07:30:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd9dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49894/0 (socket says 172.21.15.82:49894) 2024-03-27T07:30:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc00ff9640 1 -- 172.21.15.82:0/302510205 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8528+0+0 (secure 0 0 0) 0x7fcbfc0d0690 con 0x7fcc041059f0 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc037fe640 1 -- 172.21.15.82:0/4093831597 learned_addr learned my addr 172.21.15.82:0/4093831597 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.596+0000 7fcc02ffd640 1 --2- 172.21.15.82:0/4093831597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd92a10 0x5560efd9b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcc03fff640 1 -- 172.21.15.82:0/4093831597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd92a10 msgr2=0x5560efd9b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcc03fff640 1 --2- 172.21.15.82:0/4093831597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd92a10 0x5560efd9b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcc03fff640 1 -- 172.21.15.82:0/4093831597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd920f0 msgr2=0x5560efd924d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcc03fff640 1 --2- 172.21.15.82:0/4093831597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd920f0 0x5560efd924d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcc03fff640 1 -- 172.21.15.82:0/4093831597 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560efa0a210 con 0x5560efd9b7e0 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcc037fe640 1 --2- 172.21.15.82:0/4093831597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd920f0 0x5560efd924d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcc02ffd640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fcbf00a3820 0x7fcbf00a5ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc04104150 tx=0x7fcbec009ab0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcc03fff640 1 --2- 172.21.15.82:0/4093831597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd9dbd0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0cdde0 tx=0x7fcbfc01c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920d45f782a64166 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcbf9ffb640 1 -- 172.21.15.82:0/4093831597 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0708c0 con 0x5560efd9b7e0 2024-03-27T07:30:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcbf9ffb640 1 -- 172.21.15.82:0/4093831597 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbfc0677b0 con 0x5560efd9b7e0 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.597+0000 7fcbf9ffb640 1 -- 172.21.15.82:0/4093831597 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc00a250 con 0x5560efd9b7e0 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/4093831597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 msgr2=0x5560efd9dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/4093831597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd9dbd0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc0cdde0 tx=0x7fcbfc01c590 comp rx=0 tx=0).stop 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/4093831597 shutdown_connections 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/4093831597 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd9dbd0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/4093831597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd92a10 0x5560efd9b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/4093831597 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd920f0 0x5560efd924d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/4093831597 >> 172.21.15.82:0/4093831597 conn(0x5560efd8ca10 msgr2=0x5560efd8cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/4093831597 shutdown_connections 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/4093831597 wait complete. 2024-03-27T07:30:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 -- start start 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 Processor -- start 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efd98890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efd98dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5560efcf1e00 con 0x5560efd9b7e0 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5560efc9e520 con 0x5560efd92a10 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.598+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5560efcb18e0 con 0x5560efd920f0 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc0c9c3740 10 client.0 _ll_register_callbacks cb 0x5560efceca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49896/0 (socket says 172.21.15.82:49896) 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc03fff640 1 -- 172.21.15.82:0/3428621836 learned_addr learned my addr 172.21.15.82:0/3428621836 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc02ffd640 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efd98dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc037fe640 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efd98890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc03fff640 1 -- 172.21.15.82:0/3428621836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 msgr2=0x5560efd98890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc03fff640 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efd98890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc03fff640 1 -- 172.21.15.82:0/3428621836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 msgr2=0x5560efd98dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc03fff640 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efd98dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc03fff640 1 -- 172.21.15.82:0/3428621836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560efad6620 con 0x5560efd9b7e0 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc03fff640 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99310 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc01c190 tx=0x7fcbfc0a5500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd323a83e47ea81 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcbe2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/3428621836 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc09c820 con 0x5560efd9b7e0 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3428621836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbfc0677b0 con 0x5560efd9b7e0 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/3428621836 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8528+0+0 (secure 0 0 0) 0x7fcbfc068320 con 0x5560efd9b7e0 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/3428621836 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcbfc0a0bd0 con 0x5560efd9b7e0 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc0c9c3740 10 client.16839 fetch_fsmap learned FSMap version 30 2024-03-27T07:30:12.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3428621836 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5560efdb2c10 con 0x5560efd9b7e0 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.599+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/3428621836 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbfc0677b0 con 0x5560efd9b7e0 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.600+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/3428621836 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fcbfc09caf0 con 0x5560efd9b7e0 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.600+0000 7fcc0c9c3740 10 client.16839 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.600+0000 7fcc0c9c3740 10 client.16839 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.600+0000 7fcc0c9c3740 20 client.16839 populate_metadata read hostname 'smithi082' 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.600+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5560efdb3f60 0x5560efdb6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.600+0000 7fcc0c9c3740 4 client.16839 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.600+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3428621836 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560efd03390 con 0x5560efdb3f60 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.600+0000 7fcc037fe640 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5560efdb3f60 0x5560efdb6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.600+0000 7fcbe2ffd640 10 client.16839 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.600+0000 7fcc037fe640 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5560efdb3f60 0x5560efdb6350 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84853ceffcb4c0da server_cookie=a4de80600404f20e in_seq=0 out_seq=0 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/3428621836 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5560efd03390 con 0x5560efdb3f60 2024-03-27T07:30:12.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcbe2ffd640 10 client.16839 handle_command_reply: tid=0 2024-03-27T07:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcc0c9c3740 1 client.16839 shutdown 2024-03-27T07:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3428621836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 msgr2=0x5560efd99310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99310 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc01c190 tx=0x7fcbfc0a5500 comp rx=0 tx=0).stop 2024-03-27T07:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3428621836 shutdown_connections 2024-03-27T07:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5560efdb3f60 0x5560efdb6350 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99310 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efd98dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcbe2ffd640 0 client.16839 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:12.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.603+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/3428621836 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efd98890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.604+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3428621836 >> 172.21.15.82:0/3428621836 conn(0x5560efd8ca10 msgr2=0x5560efd8e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.604+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3428621836 shutdown_connections 2024-03-27T07:30:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.604+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3428621836 wait complete. 2024-03-27T07:30:12.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.604+0000 7fcc0c9c3740 20 client.16839 trim_cache size 0 max 16384 2024-03-27T07:30:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.618+0000 7fcc0c9c3740 1 Processor -- start 2024-03-27T07:30:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.618+0000 7fcc0c9c3740 1 -- start start 2024-03-27T07:30:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.618+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efd9afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.618+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efd8e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.618+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.618+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc041adfd0 con 0x5560efd9b7e0 2024-03-27T07:30:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.618+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc041ab840 con 0x5560efd92a10 2024-03-27T07:30:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.618+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc041a9690 con 0x5560efd920f0 2024-03-27T07:30:12.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.618+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.618+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efd9afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc037fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efd9afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37962/0 (socket says 172.21.15.82:37962) 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc037fe640 1 -- 172.21.15.82:0/3836413224 learned_addr learned my addr 172.21.15.82:0/3836413224 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49902/0 (socket says 172.21.15.82:49902) 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc02ffd640 1 --2- 172.21.15.82:0/3836413224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efd8e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc037fe640 1 -- 172.21.15.82:0/3836413224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 msgr2=0x5560efd8e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc037fe640 1 --2- 172.21.15.82:0/3836413224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efd8e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc037fe640 1 -- 172.21.15.82:0/3836413224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 msgr2=0x5560efd99130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc037fe640 1 --2- 172.21.15.82:0/3836413224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc037fe640 1 -- 172.21.15.82:0/3836413224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560efd96de0 con 0x5560efd920f0 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc03fff640 1 --2- 172.21.15.82:0/3836413224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcc037fe640 1 --2- 172.21.15.82:0/3836413224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efd9afc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40096c0 tx=0x7fcbf4005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eab8374b1d8f1f94 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:12.629 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcbf97fa640 1 -- 172.21.15.82:0/3836413224 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4004230 con 0x5560efd920f0 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcbf97fa640 1 -- 172.21.15.82:0/3836413224 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbf404f070 con 0x5560efd920f0 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.619+0000 7fcbf97fa640 1 -- 172.21.15.82:0/3836413224 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4004ec0 con 0x5560efd920f0 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3836413224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 msgr2=0x5560efd9afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/3836413224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efd9afc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40096c0 tx=0x7fcbf4005fd0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3836413224 shutdown_connections 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/3836413224 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efd99130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/3836413224 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efd8e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/3836413224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efd9afc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3836413224 >> 172.21.15.82:0/3836413224 conn(0x5560efd8ca10 msgr2=0x5560efd8b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3836413224 shutdown_connections 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/3836413224 wait complete. 2024-03-27T07:30:12.630 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 -- start start 2024-03-27T07:30:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 Processor -- start 2024-03-27T07:30:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efda7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efda83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.620+0000 7fcc0c9c3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efe18f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc041a9d00 con 0x5560efd9b7e0 2024-03-27T07:30:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fcc041ab170 con 0x5560efd92a10 2024-03-27T07:30:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc0c9c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc041aa3d0 con 0x5560efd920f0 2024-03-27T07:30:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc0c9c3740 10 client.0 _ll_register_callbacks cb 0x7fcbfc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:30:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efe18f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.631 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc03fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efe18f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49918/0 (socket says 172.21.15.82:49918) 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc03fff640 1 -- 172.21.15.82:0/413654486 learned_addr learned my addr 172.21.15.82:0/413654486 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc02ffd640 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efda83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc037fe640 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efda7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc03fff640 1 -- 172.21.15.82:0/413654486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 msgr2=0x5560efda7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc03fff640 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efda7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc03fff640 1 -- 172.21.15.82:0/413654486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 msgr2=0x5560efda83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc03fff640 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efda83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc03fff640 1 -- 172.21.15.82:0/413654486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560efe19590 con 0x5560efd9b7e0 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc03fff640 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efe18f80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00c760 tx=0x7fcbfc0a5570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7aec614c8260f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcbe2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/413654486 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0a5270 con 0x5560efd9b7e0 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/413654486 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8528+0+0 (secure 0 0 0) 0x7fcbfc09ca80 con 0x5560efd9b7e0 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/413654486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcbf404f070 con 0x5560efd9b7e0 2024-03-27T07:30:12.632 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/413654486 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcbfc09cc80 con 0x5560efd9b7e0 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc0c9c3740 10 client.16845 fetch_fsmap learned FSMap version 30 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/413654486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5560efe19590 con 0x5560efd9b7e0 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.621+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/413654486 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbf404f070 con 0x5560efd9b7e0 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.622+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/413654486 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8354+0+0 (secure 0 0 0) 0x7fcbfc0bb310 con 0x5560efd9b7e0 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.622+0000 7fcc0c9c3740 10 client.16845 fetch_fsmap finished waiting for FSMap version 30 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.622+0000 7fcc0c9c3740 10 client.16845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.622+0000 7fcc0c9c3740 20 client.16845 populate_metadata read hostname 'smithi082' 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.622+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5560efe1abd0 0x5560efe1cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.622+0000 7fcc0c9c3740 4 client.16845 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.622+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/413654486 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5560efcfd6e0 con 0x5560efe1abd0 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.622+0000 7fcc037fe640 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5560efe1abd0 0x5560efe1cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.622+0000 7fcbe2ffd640 10 client.16845 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:12.633 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:12.622+0000 7fcc037fe640 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5560efe1abd0 0x5560efe1cff0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c4da1cec83ec60e server_cookie=2ed79cdddf9a28e in_seq=0 out_seq=0 2024-03-27T07:30:12.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:12 smithi082 ceph-mon[32178]: pgmap v202: 97 pgs: 37 active+clean+snaptrim_wait, 42 active+clean, 18 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.7 MiB/s wr, 737 op/s 2024-03-27T07:30:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.635+0000 7fcbe2ffd640 1 -- 172.21.15.82:0/413654486 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5560efcfd6e0 con 0x5560efe1abd0 2024-03-27T07:30:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.635+0000 7fcbe2ffd640 10 client.16845 handle_command_reply: tid=0 2024-03-27T07:30:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.635+0000 7fcc0c9c3740 1 client.16845 shutdown 2024-03-27T07:30:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.635+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/413654486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 msgr2=0x5560efe18f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:13.640 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.635+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efe18f80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00c760 tx=0x7fcbfc0a5570 comp rx=0 tx=0).stop 2024-03-27T07:30:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.636+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/413654486 shutdown_connections 2024-03-27T07:30:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.636+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5560efe1abd0 0x5560efe1cff0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.636+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5560efd9b7e0 0x5560efe18f80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:13.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.636+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5560efd92a10 0x5560efda83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:13.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.636+0000 7fcc0c9c3740 1 --2- 172.21.15.82:0/413654486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5560efd920f0 0x5560efda7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:13.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.636+0000 7fcbe2ffd640 0 client.16845 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:13.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.636+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/413654486 >> 172.21.15.82:0/413654486 conn(0x5560efd8ca10 msgr2=0x5560efd8b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:13.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.640+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/413654486 shutdown_connections 2024-03-27T07:30:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.640+0000 7fcc0c9c3740 1 -- 172.21.15.82:0/413654486 wait complete. 2024-03-27T07:30:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.640+0000 7fcc0c9c3740 20 client.16845 trim_cache size 0 max 16384 2024-03-27T07:30:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:30:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:30:13.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:30:13.645 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:30:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.658+0000 7fcc09dd7640 1 -- 172.21.15.82:0/302510205 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fcbf00a3820 msgr2=0x7fcbf00a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.658+0000 7fcc09dd7640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fcbf00a3820 0x7fcbf00a5ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc04104150 tx=0x7fcbec009ab0 comp rx=0 tx=0).stop 2024-03-27T07:30:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.658+0000 7fcc09dd7640 1 -- 172.21.15.82:0/302510205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041059f0 msgr2=0x7fcc04103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:13.663 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.658+0000 7fcc09dd7640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041059f0 0x7fcc04103140 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00ea60 tx=0x7fcbfc00ef20 comp rx=0 tx=0).stop 2024-03-27T07:30:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.658+0000 7fcc09dd7640 1 -- 172.21.15.82:0/302510205 shutdown_connections 2024-03-27T07:30:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.658+0000 7fcc09dd7640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fcbf00a3820 0x7fcbf00a5ce0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.658+0000 7fcc09dd7640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc041059f0 0x7fcc04103140 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.658+0000 7fcc09dd7640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc04101660 0x7fcc04102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.659+0000 7fcc09dd7640 1 --2- 172.21.15.82:0/302510205 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fcc04100ca0 0x7fcc041026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.659+0000 7fcc09dd7640 1 -- 172.21.15.82:0/302510205 >> 172.21.15.82:0/302510205 conn(0x7fcc040778a0 msgr2=0x7fcc04069410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.661+0000 7fcc09dd7640 1 -- 172.21.15.82:0/302510205 shutdown_connections 2024-03-27T07:30:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:13.661+0000 7fcc09dd7640 1 -- 172.21.15.82:0/302510205 wait complete. 2024-03-27T07:30:14.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:14 smithi149 ceph-mon[36065]: pgmap v203: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-03-27T07:30:14.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:14 smithi153 ceph-mon[36179]: pgmap v203: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-03-27T07:30:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:14 smithi082 ceph-mon[32178]: pgmap v203: 97 pgs: 6 active+clean+snaptrim_wait, 89 active+clean, 2 active+clean+snaptrim; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 277 op/s 2024-03-27T07:30:16.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:16 smithi149 ceph-mon[36065]: pgmap v204: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 208 op/s 2024-03-27T07:30:16.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:16 smithi153 ceph-mon[36179]: pgmap v204: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 208 op/s 2024-03-27T07:30:16.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:16 smithi082 ceph-mon[32178]: pgmap v204: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 208 op/s 2024-03-27T07:30:17.171 INFO:tasks.workunit.client.0.smithi082.stdout: 386 334832 733 231669 716 124050 587 2024-03-27T07:30:19.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:18 smithi153 ceph-mon[36179]: pgmap v205: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 594 op/s 2024-03-27T07:30:19.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:18 smithi153 ceph-mon[36179]: osdmap e91: 12 total, 12 up, 12 in 2024-03-27T07:30:19.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:18 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:19.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:18 smithi082 ceph-mon[32178]: pgmap v205: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 594 op/s 2024-03-27T07:30:19.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:18 smithi082 ceph-mon[32178]: osdmap e91: 12 total, 12 up, 12 in 2024-03-27T07:30:19.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:18 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:19.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:18 smithi149 ceph-mon[36065]: pgmap v205: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 594 op/s 2024-03-27T07:30:19.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:18 smithi149 ceph-mon[36065]: osdmap e91: 12 total, 12 up, 12 in 2024-03-27T07:30:19.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:18 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:21.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:20 smithi153 ceph-mon[36179]: pgmap v207: 97 pgs: 97 active+clean; 1.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 624 op/s 2024-03-27T07:30:21.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:20 smithi082 ceph-mon[32178]: pgmap v207: 97 pgs: 97 active+clean; 1.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 624 op/s 2024-03-27T07:30:21.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:20 smithi149 ceph-mon[36065]: pgmap v207: 97 pgs: 97 active+clean; 1.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.8 MiB/s wr, 624 op/s 2024-03-27T07:30:23.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:22 smithi153 ceph-mon[36179]: pgmap v208: 97 pgs: 97 active+clean; 1.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.6 MiB/s wr, 611 op/s 2024-03-27T07:30:23.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:22 smithi082 ceph-mon[32178]: pgmap v208: 97 pgs: 97 active+clean; 1.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.6 MiB/s wr, 611 op/s 2024-03-27T07:30:23.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:22 smithi149 ceph-mon[36065]: pgmap v208: 97 pgs: 97 active+clean; 1.7 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.6 MiB/s wr, 611 op/s 2024-03-27T07:30:25.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:24 smithi153 ceph-mon[36179]: pgmap v209: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 724 op/s 2024-03-27T07:30:25.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:24 smithi082 ceph-mon[32178]: pgmap v209: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 724 op/s 2024-03-27T07:30:25.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:24 smithi149 ceph-mon[36065]: pgmap v209: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 724 op/s 2024-03-27T07:30:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3133492258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f841009e0 msgr2=0x7f7f84100e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 --2- 172.21.15.82:0/3133492258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f841009e0 0x7f7f84100e60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009930 tx=0x7f7f7402bc30 comp rx=0 tx=0).stop 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3133492258 shutdown_connections 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 --2- 172.21.15.82:0/3133492258 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f841009e0 0x7f7f84100e60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 --2- 172.21.15.82:0/3133492258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f841013a0 0x7f7f8410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 --2- 172.21.15.82:0/3133492258 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f841069f0 0x7f7f84106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3133492258 >> 172.21.15.82:0/3133492258 conn(0x7f7f84077b10 msgr2=0x7f7f84077f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3133492258 shutdown_connections 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3133492258 wait complete. 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 Processor -- start 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.791+0000 7f7f8c4c9640 1 -- start start 2024-03-27T07:30:26.797 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f8c4c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f841009e0 0x7f7f841983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f8c4c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f841013a0 0x7f7f84198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f8c4c9640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f841069f0 0x7f7f8419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f8c4c9640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f84110e00 con 0x7f7f841013a0 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f8c4c9640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7f84110c80 con 0x7f7f841069f0 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f8c4c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f84110f80 con 0x7f7f841009e0 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f89a64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f841013a0 0x7f7f84198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f89a64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f841013a0 0x7f7f84198930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58092/0 (socket says 172.21.15.82:58092) 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f89a64640 1 -- 172.21.15.82:0/3630367371 learned_addr learned my addr 172.21.15.82:0/3630367371 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f8a265640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f841009e0 0x7f7f841983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f8aa66640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f841069f0 0x7f7f8419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f89a64640 1 -- 172.21.15.82:0/3630367371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f841009e0 msgr2=0x7f7f841983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f89a64640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f841009e0 0x7f7f841983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f89a64640 1 -- 172.21.15.82:0/3630367371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f841069f0 msgr2=0x7f7f8419ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f89a64640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f841069f0 0x7f7f8419ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f89a64640 1 -- 172.21.15.82:0/3630367371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8419d3e0 con 0x7f7f841013a0 2024-03-27T07:30:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f8a265640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f841009e0 0x7f7f841983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:30:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f89a64640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f841013a0 0x7f7f84198930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009230 tx=0x7f7f7402cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f7b7fe640 1 -- 172.21.15.82:0/3630367371 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74041070 con 0x7f7f841013a0 2024-03-27T07:30:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f7b7fe640 1 -- 172.21.15.82:0/3630367371 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f74004450 con 0x7f7f841013a0 2024-03-27T07:30:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f7b7fe640 1 -- 172.21.15.82:0/3630367371 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f74003e50 con 0x7f7f841013a0 2024-03-27T07:30:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.792+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3630367371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8419d670 con 0x7f7f841013a0 2024-03-27T07:30:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.793+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3630367371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f841a4f60 con 0x7f7f841013a0 2024-03-27T07:30:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.795+0000 7f7f7b7fe640 1 -- 172.21.15.82:0/3630367371 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f7f74044070 con 0x7f7f841013a0 2024-03-27T07:30:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8f194740 1 Processor -- start 2024-03-27T07:30:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8f194740 1 -- start start 2024-03-27T07:30:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b170f0 0x559f40b174d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b17a10 0x559f40b202a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 0x559f40b22bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8f194740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559f40addcd0 con 0x559f40b170f0 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8f194740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x559f40a22950 con 0x559f40b207e0 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8f194740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559f40a7ae50 con 0x559f40b17a10 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f7b7fe640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f700a3a40 0x7f7f700a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8aa66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b170f0 0x559f40b174d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8aa66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b170f0 0x559f40b174d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58102/0 (socket says 172.21.15.82:58102) 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8a265640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b17a10 0x559f40b202a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f8aa66640 1 -- 172.21.15.82:0/632382251 learned_addr learned my addr 172.21.15.82:0/632382251 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.796+0000 7f7f89a64640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 0x559f40b22bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f8aa66640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f700a3a40 0x7f7f700a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f7b7fe640 1 -- 172.21.15.82:0/3630367371 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f7f740f1850 con 0x7f7f841013a0 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f8a265640 1 -- 172.21.15.82:0/632382251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 msgr2=0x559f40b22bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f8a265640 1 --2- 172.21.15.82:0/632382251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 0x559f40b22bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f8a265640 1 -- 172.21.15.82:0/632382251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b170f0 msgr2=0x559f40b174d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f8a265640 1 --2- 172.21.15.82:0/632382251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b170f0 0x559f40b174d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f8a265640 1 -- 172.21.15.82:0/632382251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f4078f210 con 0x559f40b17a10 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f8aa66640 1 --2- 172.21.15.82:0/632382251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b170f0 0x559f40b174d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f89a64640 1 --2- 172.21.15.82:0/632382251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 0x559f40b22bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f8aa66640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f700a3a40 0x7f7f700a5f00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0099e0 tx=0x7f7f7c009500 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f8a265640 1 --2- 172.21.15.82:0/632382251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b17a10 0x559f40b202a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009f50 tx=0x7f7f800118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7023d40ec027be server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f78bfe640 1 -- 172.21.15.82:0/632382251 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80004030 con 0x559f40b17a10 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f78bfe640 1 -- 172.21.15.82:0/632382251 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f80005500 con 0x559f40b17a10 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.797+0000 7f7f78bfe640 1 -- 172.21.15.82:0/632382251 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f80004e10 con 0x559f40b17a10 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.798+0000 7f7f8f194740 1 -- 172.21.15.82:0/632382251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b17a10 msgr2=0x559f40b202a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.798+0000 7f7f8f194740 1 --2- 172.21.15.82:0/632382251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b17a10 0x559f40b202a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009f50 tx=0x7f7f800118d0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.798+0000 7f7f8f194740 1 -- 172.21.15.82:0/632382251 shutdown_connections 2024-03-27T07:30:26.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.798+0000 7f7f8f194740 1 --2- 172.21.15.82:0/632382251 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 0x559f40b22bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.798+0000 7f7f8f194740 1 --2- 172.21.15.82:0/632382251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b17a10 0x559f40b202a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.798+0000 7f7f8f194740 1 --2- 172.21.15.82:0/632382251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b170f0 0x559f40b174d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.798+0000 7f7f8f194740 1 -- 172.21.15.82:0/632382251 >> 172.21.15.82:0/632382251 conn(0x559f40b11a10 msgr2=0x559f40b11df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.798+0000 7f7f8f194740 1 -- 172.21.15.82:0/632382251 shutdown_connections 2024-03-27T07:30:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.798+0000 7f7f8f194740 1 -- 172.21.15.82:0/632382251 wait complete. 2024-03-27T07:30:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.798+0000 7f7f8f194740 1 -- start start 2024-03-27T07:30:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8f194740 1 Processor -- start 2024-03-27T07:30:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 0x559f40b1d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b1dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 0x559f40b1e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8f194740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559f40a76e00 con 0x559f40b17a10 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8f194740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x559f40a23520 con 0x559f40b207e0 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8f194740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559f40a368e0 con 0x559f40b170f0 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8f194740 10 client.0 _ll_register_callbacks cb 0x559f40a71a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f89a64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b1dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8a265640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 0x559f40b1d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f89a64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b1dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58106/0 (socket says 172.21.15.82:58106) 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f89a64640 1 -- 172.21.15.82:0/393409432 learned_addr learned my addr 172.21.15.82:0/393409432 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8aa66640 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 0x559f40b1e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f89a64640 1 -- 172.21.15.82:0/393409432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 msgr2=0x559f40b1d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f89a64640 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 0x559f40b1d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f89a64640 1 -- 172.21.15.82:0/393409432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 msgr2=0x559f40b1e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f89a64640 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 0x559f40b1e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f89a64640 1 -- 172.21.15.82:0/393409432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f4085b620 con 0x559f40b17a10 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f8a265640 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 0x559f40b1d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f89a64640 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b1dd90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7f740bd8c0 tx=0x7f7f7408c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d79b0d98ac0ab1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.799+0000 7f7f6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f6dffb640 1 -- 172.21.15.82:0/393409432 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7404b050 con 0x559f40b17a10 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f6dffb640 1 -- 172.21.15.82:0/393409432 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f7f740c62f0 con 0x559f40b17a10 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f8f194740 1 -- 172.21.15.82:0/393409432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f80005500 con 0x559f40b17a10 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f6dffb640 1 -- 172.21.15.82:0/393409432 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7f740bd520 con 0x559f40b17a10 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f8f194740 10 client.16857 fetch_fsmap learned FSMap version 31 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f8f194740 1 -- 172.21.15.82:0/393409432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559f40b2f3c0 con 0x559f40b17a10 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f6dffb640 1 -- 172.21.15.82:0/393409432 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f80005500 con 0x559f40b17a10 2024-03-27T07:30:26.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f6dffb640 1 -- 172.21.15.82:0/393409432 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f7f740bd010 con 0x559f40b17a10 2024-03-27T07:30:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f8f194740 10 client.16857 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T07:30:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f8f194740 10 client.16857 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:30:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f8f194740 20 client.16857 populate_metadata read hostname 'smithi082' 2024-03-27T07:30:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f8f194740 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559f40b30850 0x559f40b32d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f8f194740 4 client.16857 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:30:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f8f194740 1 -- 172.21.15.82:0/393409432 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f40a88390 con 0x559f40b30850 2024-03-27T07:30:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.800+0000 7f7f8a265640 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559f40b30850 0x559f40b32d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.801+0000 7f7f6dffb640 10 client.16857 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.801+0000 7f7f8a265640 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559f40b30850 0x559f40b32d10 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e69b326a13c8830 server_cookie=1d9af66fdae6ec65 in_seq=0 out_seq=0 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.801+0000 7f7f6dffb640 1 -- 172.21.15.82:0/393409432 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x559f40a88390 con 0x559f40b30850 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.801+0000 7f7f6dffb640 10 client.16857 handle_command_reply: tid=0 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.801+0000 7f7f8f194740 1 client.16857 shutdown 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 1 -- 172.21.15.82:0/393409432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 msgr2=0x559f40b1dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b1dd90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f7f740bd8c0 tx=0x7f7f7408c760 comp rx=0 tx=0).stop 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 1 -- 172.21.15.82:0/393409432 shutdown_connections 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559f40b30850 0x559f40b32d10 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b1dd90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f6dffb640 0 client.16857 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b207e0 0x559f40b1e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 1 --2- 172.21.15.82:0/393409432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 0x559f40b1d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 1 -- 172.21.15.82:0/393409432 >> 172.21.15.82:0/393409432 conn(0x559f40b11a10 msgr2=0x559f40b13760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 1 -- 172.21.15.82:0/393409432 shutdown_connections 2024-03-27T07:30:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 1 -- 172.21.15.82:0/393409432 wait complete. 2024-03-27T07:30:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.802+0000 7f7f8f194740 20 client.16857 trim_cache size 0 max 16384 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.816+0000 7f7f8f194740 1 Processor -- start 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.816+0000 7f7f8f194740 1 -- start start 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 0x559f40b1ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b17a10 0x559f40b2beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b207e0 0x559f40b385e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8f194740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841b0090 con 0x559f40b207e0 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8f194740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841ad8d0 con 0x559f40b17a10 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8f194740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841ab740 con 0x559f40b170f0 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8aa66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b207e0 0x559f40b385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8aa66640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b207e0 0x559f40b385e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58118/0 (socket says 172.21.15.82:58118) 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f89a64640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b17a10 0x559f40b2beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.824 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8aa66640 1 -- 172.21.15.82:0/1810110553 learned_addr learned my addr 172.21.15.82:0/1810110553 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8a265640 1 --2- 172.21.15.82:0/1810110553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 0x559f40b1ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8aa66640 1 -- 172.21.15.82:0/1810110553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 msgr2=0x559f40b1ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8aa66640 1 --2- 172.21.15.82:0/1810110553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 0x559f40b1ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8aa66640 1 -- 172.21.15.82:0/1810110553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b17a10 msgr2=0x559f40b2beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8aa66640 1 --2- 172.21.15.82:0/1810110553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b17a10 0x559f40b2beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8aa66640 1 -- 172.21.15.82:0/1810110553 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f40b2c3f0 con 0x559f40b207e0 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f8aa66640 1 --2- 172.21.15.82:0/1810110553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b207e0 0x559f40b385e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c011ad0 tx=0x7f7f7c008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85e5d2f74f8f820 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f6ffff640 1 -- 172.21.15.82:0/1810110553 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c00fcf0 con 0x559f40b207e0 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f6ffff640 1 -- 172.21.15.82:0/1810110553 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f7c00fe90 con 0x559f40b207e0 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.817+0000 7f7f6ffff640 1 -- 172.21.15.82:0/1810110553 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c005730 con 0x559f40b207e0 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 -- 172.21.15.82:0/1810110553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b207e0 msgr2=0x559f40b385e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 --2- 172.21.15.82:0/1810110553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b207e0 0x559f40b385e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c011ad0 tx=0x7f7f7c008000 comp rx=0 tx=0).stop 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 -- 172.21.15.82:0/1810110553 shutdown_connections 2024-03-27T07:30:26.825 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 --2- 172.21.15.82:0/1810110553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b207e0 0x559f40b385e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 --2- 172.21.15.82:0/1810110553 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b17a10 0x559f40b2beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 --2- 172.21.15.82:0/1810110553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b170f0 0x559f40b1ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 -- 172.21.15.82:0/1810110553 >> 172.21.15.82:0/1810110553 conn(0x559f40b11a10 msgr2=0x559f40b11df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 -- 172.21.15.82:0/1810110553 shutdown_connections 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 -- 172.21.15.82:0/1810110553 wait complete. 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 -- start start 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.818+0000 7f7f8f194740 1 Processor -- start 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b170f0 0x559f40b288c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b23c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8f194740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b207e0 0x559f40b24370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8f194740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841abd90 con 0x559f40b17a10 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8f194740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841ad200 con 0x559f40b170f0 2024-03-27T07:30:26.826 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8f194740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7f841ac460 con 0x559f40b207e0 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8f194740 10 client.0 _ll_register_callbacks cb 0x7f7f74009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f89a64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b23c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f89a64640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b23c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58126/0 (socket says 172.21.15.82:58126) 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f89a64640 1 -- 172.21.15.82:0/2211307421 learned_addr learned my addr 172.21.15.82:0/2211307421 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8a265640 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b170f0 0x559f40b288c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8aa66640 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b207e0 0x559f40b24370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f89a64640 1 -- 172.21.15.82:0/2211307421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b207e0 msgr2=0x559f40b24370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f89a64640 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b207e0 0x559f40b24370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f89a64640 1 -- 172.21.15.82:0/2211307421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b170f0 msgr2=0x559f40b288c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f89a64640 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b170f0 0x559f40b288c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f89a64640 1 -- 172.21.15.82:0/2211307421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f40b95c10 con 0x559f40b17a10 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f89a64640 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b23c30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7f740de110 tx=0x7f7f74003920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12777d437ba4149b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f6dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f6dffb640 1 -- 172.21.15.82:0/2211307421 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7404b040 con 0x559f40b17a10 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f6dffb640 1 -- 172.21.15.82:0/2211307421 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f7f740c64f0 con 0x559f40b17a10 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8f194740 1 -- 172.21.15.82:0/2211307421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f7c00fe90 con 0x559f40b17a10 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f6dffb640 1 -- 172.21.15.82:0/2211307421 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7f74004c80 con 0x559f40b17a10 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8f194740 10 client.16863 fetch_fsmap learned FSMap version 31 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.819+0000 7f7f8f194740 1 -- 172.21.15.82:0/2211307421 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559f40b95c10 con 0x559f40b17a10 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f6dffb640 1 -- 172.21.15.82:0/2211307421 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f7c00fe90 con 0x559f40b17a10 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f6dffb640 1 -- 172.21.15.82:0/2211307421 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f7f740b9aa0 con 0x559f40b17a10 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f8f194740 10 client.16863 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f8f194740 10 client.16863 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f8f194740 20 client.16863 populate_metadata read hostname 'smithi082' 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f8f194740 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559f40b971e0 0x559f40b99600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f8f194740 4 client.16863 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:30:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f8f194740 1 -- 172.21.15.82:0/2211307421 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f40a826e0 con 0x559f40b971e0 2024-03-27T07:30:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f8a265640 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559f40b971e0 0x559f40b99600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f8a265640 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559f40b971e0 0x559f40b99600 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4d2320d9462cb31 server_cookie=26b8afb6b34dd945 in_seq=0 out_seq=0 2024-03-27T07:30:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.820+0000 7f7f6dffb640 10 client.16863 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f6dffb640 1 -- 172.21.15.82:0/2211307421 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f40a826e0 con 0x559f40b971e0 2024-03-27T07:30:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f6dffb640 10 client.16863 handle_command_reply: tid=0 2024-03-27T07:30:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f8f194740 1 client.16863 shutdown 2024-03-27T07:30:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f8f194740 1 -- 172.21.15.82:0/2211307421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 msgr2=0x559f40b23c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f8f194740 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b23c30 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7f740de110 tx=0x7f7f74003920 comp rx=0 tx=0).stop 2024-03-27T07:30:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f8f194740 1 -- 172.21.15.82:0/2211307421 shutdown_connections 2024-03-27T07:30:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f8f194740 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559f40b971e0 0x559f40b99600 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f8f194740 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559f40b17a10 0x559f40b23c30 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f8f194740 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559f40b207e0 0x559f40b24370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f6dffb640 0 client.16863 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f8f194740 1 --2- 172.21.15.82:0/2211307421 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559f40b170f0 0x559f40b288c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.970+0000 7f7f8f194740 1 -- 172.21.15.82:0/2211307421 >> 172.21.15.82:0/2211307421 conn(0x559f40b11a10 msgr2=0x559f40b101e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8f194740 1 -- 172.21.15.82:0/2211307421 shutdown_connections 2024-03-27T07:30:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8f194740 1 -- 172.21.15.82:0/2211307421 wait complete. 2024-03-27T07:30:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8f194740 20 client.16863 trim_cache size 0 max 16384 2024-03-27T07:30:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:30:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:30:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:30:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:30:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3630367371 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f700a3a40 msgr2=0x7f7f700a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8c4c9640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f700a3a40 0x7f7f700a5f00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f7c0099e0 tx=0x7f7f7c009500 comp rx=0 tx=0).stop 2024-03-27T07:30:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3630367371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f841013a0 msgr2=0x7f7f84198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8c4c9640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f841013a0 0x7f7f84198930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009230 tx=0x7f7f7402cb30 comp rx=0 tx=0).stop 2024-03-27T07:30:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3630367371 shutdown_connections 2024-03-27T07:30:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8c4c9640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f7f700a3a40 0x7f7f700a5f00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8c4c9640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f841013a0 0x7f7f84198930 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8c4c9640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7f841069f0 0x7f7f8419ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8c4c9640 1 --2- 172.21.15.82:0/3630367371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f841009e0 0x7f7f841983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:26.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.971+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3630367371 >> 172.21.15.82:0/3630367371 conn(0x7f7f84077b10 msgr2=0x7f7f8406a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:26.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.972+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3630367371 shutdown_connections 2024-03-27T07:30:26.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:26.972+0000 7f7f8c4c9640 1 -- 172.21.15.82:0/3630367371 wait complete. 2024-03-27T07:30:27.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:26 smithi153 ceph-mon[36179]: pgmap v210: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.8 MiB/s wr, 709 op/s 2024-03-27T07:30:27.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:26 smithi082 ceph-mon[32178]: pgmap v210: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.8 MiB/s wr, 709 op/s 2024-03-27T07:30:27.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:26 smithi149 ceph-mon[36065]: pgmap v210: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.8 MiB/s wr, 709 op/s 2024-03-27T07:30:28.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:28 smithi082 ceph-mon[32178]: pgmap v211: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 235 op/s 2024-03-27T07:30:29.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:28 smithi153 ceph-mon[36179]: pgmap v211: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 235 op/s 2024-03-27T07:30:29.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:28 smithi149 ceph-mon[36065]: pgmap v211: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 235 op/s 2024-03-27T07:30:31.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:30 smithi153 ceph-mon[36179]: pgmap v212: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 215 op/s 2024-03-27T07:30:31.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:30 smithi082 ceph-mon[32178]: pgmap v212: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 215 op/s 2024-03-27T07:30:31.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:30 smithi149 ceph-mon[36065]: pgmap v212: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.6 MiB/s wr, 215 op/s 2024-03-27T07:30:32.316 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-03-27T07:30:32.316 INFO:tasks.workunit.client.0.smithi082.stdout:Final score for writes: 386 2024-03-27T07:30:32.316 INFO:tasks.workunit.client.0.smithi082.stdout:Final score for reads : 792634 2024-03-27T07:30:32.316 INFO:tasks.workunit.client.0.smithi082.stdout: 2024-03-27T07:30:32.318 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-27T07:30:32.318 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-27T07:30:33.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:32 smithi082 ceph-mon[32178]: pgmap v213: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 156 op/s 2024-03-27T07:30:33.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:32 smithi149 ceph-mon[36065]: pgmap v213: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 156 op/s 2024-03-27T07:30:33.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:32 smithi153 ceph-mon[36179]: pgmap v213: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 156 op/s 2024-03-27T07:30:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:34 smithi082 ceph-mon[32178]: pgmap v214: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 213 op/s 2024-03-27T07:30:35.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:34 smithi149 ceph-mon[36065]: pgmap v214: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 213 op/s 2024-03-27T07:30:35.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:34 smithi153 ceph-mon[36179]: pgmap v214: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 213 op/s 2024-03-27T07:30:37.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:36 smithi082 ceph-mon[32178]: pgmap v215: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 236 KiB/s wr, 83 op/s 2024-03-27T07:30:37.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:36 smithi149 ceph-mon[36065]: pgmap v215: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 236 KiB/s wr, 83 op/s 2024-03-27T07:30:37.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:36 smithi153 ceph-mon[36179]: pgmap v215: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 236 KiB/s wr, 83 op/s 2024-03-27T07:30:39.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:38 smithi082 ceph-mon[32178]: pgmap v216: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 536 KiB/s wr, 117 op/s 2024-03-27T07:30:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:38 smithi149 ceph-mon[36065]: pgmap v216: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 536 KiB/s wr, 117 op/s 2024-03-27T07:30:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:38 smithi153 ceph-mon[36179]: pgmap v216: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 536 KiB/s wr, 117 op/s 2024-03-27T07:30:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.060+0000 7f10cc80e640 1 -- 172.21.15.82:0/2686755379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c8101660 msgr2=0x7f10c810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.060+0000 7f10cc80e640 1 --2- 172.21.15.82:0/2686755379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c8101660 0x7f10c810d880 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009ca0 tx=0x7f10c002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.060+0000 7f10cc80e640 1 -- 172.21.15.82:0/2686755379 shutdown_connections 2024-03-27T07:30:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.060+0000 7f10cc80e640 1 --2- 172.21.15.82:0/2686755379 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c8101660 0x7f10c810d880 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.060+0000 7f10cc80e640 1 --2- 172.21.15.82:0/2686755379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c8100ca0 0x7f10c8101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.060+0000 7f10cc80e640 1 --2- 172.21.15.82:0/2686755379 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10c81059f0 0x7f10c8105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.060+0000 7f10cc80e640 1 -- 172.21.15.82:0/2686755379 >> 172.21.15.82:0/2686755379 conn(0x7f10c80778a0 msgr2=0x7f10c8077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:40.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.060+0000 7f10cc80e640 1 -- 172.21.15.82:0/2686755379 shutdown_connections 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.060+0000 7f10cc80e640 1 -- 172.21.15.82:0/2686755379 wait complete. 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10cc80e640 1 Processor -- start 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10cc80e640 1 -- start start 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10cc80e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10c8100ca0 0x7f10c8198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10cc80e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c8101660 0x7f10c81988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10cc80e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c81059f0 0x7f10c819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10cc80e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8112030 con 0x7f10c8101660 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10cc80e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8111eb0 con 0x7f10c8100ca0 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10cc80e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81121b0 con 0x7f10c81059f0 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c8101660 0x7f10c81988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c8101660 0x7f10c81988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38634/0 (socket says 172.21.15.82:38634) 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c5d9b640 1 -- 172.21.15.82:0/2785979865 learned_addr learned my addr 172.21.15.82:0/2785979865 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:40.066 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c659c640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10c8100ca0 0x7f10c8198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c6d9d640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c81059f0 0x7f10c819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c5d9b640 1 -- 172.21.15.82:0/2785979865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c81059f0 msgr2=0x7f10c819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c81059f0 0x7f10c819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c5d9b640 1 -- 172.21.15.82:0/2785979865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10c8100ca0 msgr2=0x7f10c8198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10c8100ca0 0x7f10c8198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c5d9b640 1 -- 172.21.15.82:0/2785979865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c819d360 con 0x7f10c8101660 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.061+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c8101660 0x7f10c81988b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00d950 tx=0x7f10bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.062+0000 7f10b77fe640 1 -- 172.21.15.82:0/2785979865 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc017070 con 0x7f10c8101660 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.062+0000 7f10cc80e640 1 -- 172.21.15.82:0/2785979865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c819d650 con 0x7f10c8101660 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.062+0000 7f10b77fe640 1 -- 172.21.15.82:0/2785979865 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10bc009c30 con 0x7f10c8101660 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.062+0000 7f10b77fe640 1 -- 172.21.15.82:0/2785979865 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc003d60 con 0x7f10c8101660 2024-03-27T07:30:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.062+0000 7f10cc80e640 1 -- 172.21.15.82:0/2785979865 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c81a4ee0 con 0x7f10c8101660 2024-03-27T07:30:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.064+0000 7f10b77fe640 1 -- 172.21.15.82:0/2785979865 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f10bc003f00 con 0x7f10c8101660 2024-03-27T07:30:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.064+0000 7f10cf3fa740 1 Processor -- start 2024-03-27T07:30:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.064+0000 7f10cf3fa740 1 -- start start 2024-03-27T07:30:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.064+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94923c10 0x557f94923ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.064+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f949316b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.064+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94931bf0 0x557f94933fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.064+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557f948eacd0 con 0x557f94924530 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.064+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x557f9482f950 con 0x557f94931bf0 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.064+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557f94887e50 con 0x557f94923c10 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10b77fe640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10b00a3820 0x7f10b00a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f949316b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c6d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94923c10 0x557f94923ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f949316b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38636/0 (socket says 172.21.15.82:38636) 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c659c640 1 -- 172.21.15.82:0/4021051978 learned_addr learned my addr 172.21.15.82:0/4021051978 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c5d9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94931bf0 0x557f94933fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c6d9d640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10b00a3820 0x7f10b00a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10b77fe640 1 -- 172.21.15.82:0/2785979865 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f10bc0cf9c0 con 0x7f10c8101660 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c659c640 1 -- 172.21.15.82:0/4021051978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94923c10 msgr2=0x557f94923ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:40.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c659c640 1 --2- 172.21.15.82:0/4021051978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94923c10 0x557f94923ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c659c640 1 -- 172.21.15.82:0/4021051978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94931bf0 msgr2=0x557f94933fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c659c640 1 --2- 172.21.15.82:0/4021051978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94931bf0 0x557f94933fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c659c640 1 -- 172.21.15.82:0/4021051978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f9459c210 con 0x557f94924530 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c6d9d640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10b00a3820 0x7f10b00a5ce0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f10c0004af0 tx=0x7f10c0005c50 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10c659c640 1 --2- 172.21.15.82:0/4021051978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f949316b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f10b800bcd0 tx=0x7f10b80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e3c03f813665e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10b4ff9640 1 -- 172.21.15.82:0/4021051978 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8005220 con 0x557f94924530 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10b4ff9640 1 -- 172.21.15.82:0/4021051978 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10b8004c80 con 0x557f94924530 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.065+0000 7f10b4ff9640 1 -- 172.21.15.82:0/4021051978 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b80117c0 con 0x557f94924530 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.066+0000 7f10cf3fa740 1 -- 172.21.15.82:0/4021051978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 msgr2=0x557f949316b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.066+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/4021051978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f949316b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f10b800bcd0 tx=0x7f10b80107a0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.066+0000 7f10cf3fa740 1 -- 172.21.15.82:0/4021051978 shutdown_connections 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.066+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/4021051978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f949316b0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.066+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/4021051978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94931bf0 0x557f94933fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.066+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/4021051978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94923c10 0x557f94923ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.066+0000 7f10cf3fa740 1 -- 172.21.15.82:0/4021051978 >> 172.21.15.82:0/4021051978 conn(0x557f9491ea10 msgr2=0x557f9491edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.066+0000 7f10cf3fa740 1 -- 172.21.15.82:0/4021051978 shutdown_connections 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.066+0000 7f10cf3fa740 1 -- 172.21.15.82:0/4021051978 wait complete. 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.066+0000 7f10cf3fa740 1 -- start start 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10cf3fa740 1 Processor -- start 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94923c10 0x557f9492ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f9492f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94931bf0 0x557f9492f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557f94883e00 con 0x557f94924530 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x557f94830520 con 0x557f94931bf0 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x557f948438e0 con 0x557f94923c10 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10cf3fa740 10 client.0 _ll_register_callbacks cb 0x557f9487ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:30:40.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f9492f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c659c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94923c10 0x557f9492ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c5d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f9492f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38646/0 (socket says 172.21.15.82:38646) 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c5d9b640 1 -- 172.21.15.82:0/2384626847 learned_addr learned my addr 172.21.15.82:0/2384626847 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c6d9d640 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94931bf0 0x557f9492f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c5d9b640 1 -- 172.21.15.82:0/2384626847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94923c10 msgr2=0x557f9492ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94923c10 0x557f9492ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c5d9b640 1 -- 172.21.15.82:0/2384626847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94931bf0 msgr2=0x557f9492f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94931bf0 0x557f9492f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c5d9b640 1 -- 172.21.15.82:0/2384626847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f94668620 con 0x557f94924530 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f9492f170 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0cd190 tx=0x7f10bc06a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d539120c56bf0851 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10adffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10adffb640 1 -- 172.21.15.82:0/2384626847 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc09bc20 con 0x557f94924530 2024-03-27T07:30:40.078 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10adffb640 1 -- 172.21.15.82:0/2384626847 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f10bc098290 con 0x557f94924530 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.067+0000 7f10cf3fa740 1 -- 172.21.15.82:0/2384626847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10b8004c80 con 0x557f94924530 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10adffb640 1 -- 172.21.15.82:0/2384626847 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f10bc09ff20 con 0x557f94924530 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10cf3fa740 10 client.16875 fetch_fsmap learned FSMap version 31 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10cf3fa740 1 -- 172.21.15.82:0/2384626847 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557f94940810 con 0x557f94924530 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10adffb640 1 -- 172.21.15.82:0/2384626847 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10b8004c80 con 0x557f94924530 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10adffb640 1 -- 172.21.15.82:0/2384626847 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f10bc0babd0 con 0x557f94924530 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10cf3fa740 10 client.16875 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10cf3fa740 10 client.16875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10cf3fa740 20 client.16875 populate_metadata read hostname 'smithi082' 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557f94941d70 0x557f949441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10cf3fa740 4 client.16875 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10cf3fa740 1 -- 172.21.15.82:0/2384626847 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f94895390 con 0x557f94941d70 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.068+0000 7f10c659c640 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557f94941d70 0x557f949441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.079 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.069+0000 7f10adffb640 10 client.16875 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:40.080 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.069+0000 7f10c659c640 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557f94941d70 0x557f949441c0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cdd199ffc0ac1f server_cookie=f20ad0a2ffe78287 in_seq=0 out_seq=0 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10adffb640 1 -- 172.21.15.82:0/2384626847 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557f94895390 con 0x557f94941d70 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10adffb640 10 client.16875 handle_command_reply: tid=0 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 client.16875 shutdown 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 -- 172.21.15.82:0/2384626847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 msgr2=0x557f9492f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f9492f170 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0cd190 tx=0x7f10bc06a7c0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 -- 172.21.15.82:0/2384626847 shutdown_connections 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557f94941d70 0x557f949441c0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94924530 0x557f9492f170 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94931bf0 0x557f9492f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10adffb640 0 client.16875 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/2384626847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94923c10 0x557f9492ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.081 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 -- 172.21.15.82:0/2384626847 >> 172.21.15.82:0/2384626847 conn(0x557f9491ea10 msgr2=0x557f94920760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 -- 172.21.15.82:0/2384626847 shutdown_connections 2024-03-27T07:30:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 1 -- 172.21.15.82:0/2384626847 wait complete. 2024-03-27T07:30:40.082 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.072+0000 7f10cf3fa740 20 client.16875 trim_cache size 0 max 16384 2024-03-27T07:30:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10cf3fa740 1 Processor -- start 2024-03-27T07:30:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10cf3fa740 1 -- start start 2024-03-27T07:30:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94923c10 0x557f94931360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94924530 0x557f9493d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94931bf0 0x557f94949a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81ade60 con 0x557f94931bf0 2024-03-27T07:30:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81ab6a0 con 0x557f94923c10 2024-03-27T07:30:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81a9510 con 0x557f94924530 2024-03-27T07:30:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10c6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94931bf0 0x557f94949a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.094 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10c6d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94931bf0 0x557f94949a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38650/0 (socket says 172.21.15.82:38650) 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10c6d9d640 1 -- 172.21.15.82:0/3764805021 learned_addr learned my addr 172.21.15.82:0/3764805021 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10c659c640 1 --2- 172.21.15.82:0/3764805021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94923c10 0x557f94931360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.087+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/3764805021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94924530 0x557f9493d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10c6d9d640 1 -- 172.21.15.82:0/3764805021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94924530 msgr2=0x557f9493d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10c6d9d640 1 --2- 172.21.15.82:0/3764805021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94924530 0x557f9493d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10c6d9d640 1 -- 172.21.15.82:0/3764805021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94923c10 msgr2=0x557f94931360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10c6d9d640 1 --2- 172.21.15.82:0/3764805021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94923c10 0x557f94931360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10c6d9d640 1 -- 172.21.15.82:0/3764805021 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f9491fb80 con 0x557f94931bf0 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10c6d9d640 1 --2- 172.21.15.82:0/3764805021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94931bf0 0x557f94949a90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f10c0036000 tx=0x7f10c0009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c844a7c185b3e059 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10affff640 1 -- 172.21.15.82:0/3764805021 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0039040 con 0x557f94931bf0 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10affff640 1 -- 172.21.15.82:0/3764805021 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c0053070 con 0x557f94931bf0 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10affff640 1 -- 172.21.15.82:0/3764805021 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0004460 con 0x557f94931bf0 2024-03-27T07:30:40.095 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10cf3fa740 1 -- 172.21.15.82:0/3764805021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94931bf0 msgr2=0x557f94949a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/3764805021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94931bf0 0x557f94949a90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f10c0036000 tx=0x7f10c0009360 comp rx=0 tx=0).stop 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10cf3fa740 1 -- 172.21.15.82:0/3764805021 shutdown_connections 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/3764805021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94931bf0 0x557f94949a90 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/3764805021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94924530 0x557f9493d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/3764805021 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94923c10 0x557f94931360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.088+0000 7f10cf3fa740 1 -- 172.21.15.82:0/3764805021 >> 172.21.15.82:0/3764805021 conn(0x557f9491ea10 msgr2=0x557f9491da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 1 -- 172.21.15.82:0/3764805021 shutdown_connections 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 1 -- 172.21.15.82:0/3764805021 wait complete. 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 1 -- start start 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 1 Processor -- start 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94923c10 0x557f949398c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94924530 0x557f94936890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94931bf0 0x557f94936dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81a9b60 con 0x557f94923c10 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81aafd0 con 0x557f94924530 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81aa230 con 0x557f94931bf0 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10cf3fa740 10 client.0 _ll_register_callbacks cb 0x7f10bc003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94923c10 0x557f949398c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94923c10 0x557f949398c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38662/0 (socket says 172.21.15.82:38662) 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c659c640 1 -- 172.21.15.82:0/1230925007 learned_addr learned my addr 172.21.15.82:0/1230925007 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94924530 0x557f94936890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c6d9d640 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94931bf0 0x557f94936dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c659c640 1 -- 172.21.15.82:0/1230925007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94931bf0 msgr2=0x557f94936dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c659c640 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94931bf0 0x557f94936dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c659c640 1 -- 172.21.15.82:0/1230925007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94924530 msgr2=0x557f94936890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c659c640 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94924530 0x557f94936890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c659c640 1 -- 172.21.15.82:0/1230925007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f94939f60 con 0x557f94923c10 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94924530 0x557f94936890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.089+0000 7f10c6d9d640 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94931bf0 0x557f94936dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10c659c640 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94923c10 0x557f949398c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f10b800bcd0 tx=0x7f10b800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea9004097fd1ff5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10adffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10adffb640 1 -- 172.21.15.82:0/1230925007 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8004660 con 0x557f94923c10 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10adffb640 1 -- 172.21.15.82:0/1230925007 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7f10b8004800 con 0x557f94923c10 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10cf3fa740 1 -- 172.21.15.82:0/1230925007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10c0053070 con 0x557f94923c10 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10adffb640 1 -- 172.21.15.82:0/1230925007 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f10b8037050 con 0x557f94923c10 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10cf3fa740 10 client.16881 fetch_fsmap learned FSMap version 31 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10cf3fa740 1 -- 172.21.15.82:0/1230925007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557f949a8b40 con 0x557f94923c10 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10adffb640 1 -- 172.21.15.82:0/1230925007 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10c0053070 con 0x557f94923c10 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10adffb640 1 -- 172.21.15.82:0/1230925007 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f10b8029500 con 0x557f94923c10 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10cf3fa740 10 client.16881 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T07:30:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10cf3fa740 10 client.16881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:30:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10cf3fa740 20 client.16881 populate_metadata read hostname 'smithi082' 2024-03-27T07:30:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557f949a9080 0x557f949ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10cf3fa740 4 client.16881 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:30:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10cf3fa740 1 -- 172.21.15.82:0/1230925007 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557f9488f6e0 con 0x557f949a9080 2024-03-27T07:30:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.090+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557f949a9080 0x557f949ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.091+0000 7f10adffb640 10 client.16881 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:40.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:40.091+0000 7f10c5d9b640 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557f949a9080 0x557f949ab4a0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aba9ebbc12c2159e server_cookie=beb3039dba9bb679 in_seq=0 out_seq=0 2024-03-27T07:30:41.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:40 smithi082 ceph-mon[32178]: pgmap v217: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 751 KiB/s wr, 116 op/s 2024-03-27T07:30:41.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:40 smithi149 ceph-mon[36065]: pgmap v217: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 751 KiB/s wr, 116 op/s 2024-03-27T07:30:41.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:40 smithi153 ceph-mon[36179]: pgmap v217: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 751 KiB/s wr, 116 op/s 2024-03-27T07:30:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10adffb640 1 -- 172.21.15.82:0/1230925007 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557f9488f6e0 con 0x557f949a9080 2024-03-27T07:30:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10adffb640 10 client.16881 handle_command_reply: tid=0 2024-03-27T07:30:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 client.16881 shutdown 2024-03-27T07:30:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 -- 172.21.15.82:0/1230925007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94923c10 msgr2=0x557f949398c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94923c10 0x557f949398c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f10b800bcd0 tx=0x7f10b800b940 comp rx=0 tx=0).stop 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 -- 172.21.15.82:0/1230925007 shutdown_connections 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x557f94931bf0 0x557f94936dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x557f94924530 0x557f94936890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x557f949a9080 0x557f949ab4a0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 --2- 172.21.15.82:0/1230925007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557f94923c10 0x557f949398c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10adffb640 0 client.16881 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 -- 172.21.15.82:0/1230925007 >> 172.21.15.82:0/1230925007 conn(0x557f9491ea10 msgr2=0x557f9491fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 -- 172.21.15.82:0/1230925007 shutdown_connections 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 1 -- 172.21.15.82:0/1230925007 wait complete. 2024-03-27T07:30:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.568+0000 7f10cf3fa740 20 client.16881 trim_cache size 0 max 16384 2024-03-27T07:30:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:30:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:30:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:30:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:30:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 -- 172.21.15.82:0/2785979865 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10b00a3820 msgr2=0x7f10b00a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10b00a3820 0x7f10b00a5ce0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f10c0004af0 tx=0x7f10c0005c50 comp rx=0 tx=0).stop 2024-03-27T07:30:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 -- 172.21.15.82:0/2785979865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c8101660 msgr2=0x7f10c81988b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c8101660 0x7f10c81988b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00d950 tx=0x7f10bc00de10 comp rx=0 tx=0).stop 2024-03-27T07:30:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 -- 172.21.15.82:0/2785979865 shutdown_connections 2024-03-27T07:30:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f10b00a3820 0x7f10b00a5ce0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10c8101660 0x7f10c81988b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c81059f0 0x7f10c819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 --2- 172.21.15.82:0/2785979865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10c8100ca0 0x7f10c8198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:42.574 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 -- 172.21.15.82:0/2785979865 >> 172.21.15.82:0/2785979865 conn(0x7f10c80778a0 msgr2=0x7f10c80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:42.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 -- 172.21.15.82:0/2785979865 shutdown_connections 2024-03-27T07:30:42.575 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:42.569+0000 7f10cc80e640 1 -- 172.21.15.82:0/2785979865 wait complete. 2024-03-27T07:30:43.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:42 smithi153 ceph-mon[36179]: pgmap v218: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 741 KiB/s wr, 110 op/s 2024-03-27T07:30:43.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:42 smithi082 ceph-mon[32178]: pgmap v218: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 741 KiB/s wr, 110 op/s 2024-03-27T07:30:43.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:42 smithi149 ceph-mon[36065]: pgmap v218: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 741 KiB/s wr, 110 op/s 2024-03-27T07:30:45.057 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:44 smithi149 ceph-mon[36065]: pgmap v219: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 995 KiB/s wr, 261 op/s 2024-03-27T07:30:45.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:44 smithi082 ceph-mon[32178]: pgmap v219: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 995 KiB/s wr, 261 op/s 2024-03-27T07:30:45.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:44 smithi153 ceph-mon[36179]: pgmap v219: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 995 KiB/s wr, 261 op/s 2024-03-27T07:30:47.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:46 smithi082 ceph-mon[32178]: pgmap v220: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 1009 KiB/s wr, 220 op/s 2024-03-27T07:30:47.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:46 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:47.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:46 smithi149 ceph-mon[36065]: pgmap v220: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 1009 KiB/s wr, 220 op/s 2024-03-27T07:30:47.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:46 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:47.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:46 smithi153 ceph-mon[36179]: pgmap v220: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 1009 KiB/s wr, 220 op/s 2024-03-27T07:30:47.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:46 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:49.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:48 smithi082 ceph-mon[32178]: pgmap v221: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2024-03-27T07:30:49.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:48 smithi149 ceph-mon[36065]: pgmap v221: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2024-03-27T07:30:49.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:48 smithi153 ceph-mon[36179]: pgmap v221: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 303 op/s 2024-03-27T07:30:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:50 smithi082 ceph-mon[32178]: pgmap v222: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 1.5 MiB/s wr, 276 op/s 2024-03-27T07:30:51.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:50 smithi149 ceph-mon[36065]: pgmap v222: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 1.5 MiB/s wr, 276 op/s 2024-03-27T07:30:51.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:50 smithi153 ceph-mon[36179]: pgmap v222: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 1.5 MiB/s wr, 276 op/s 2024-03-27T07:30:52.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:51 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:52.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:51 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:52.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:51 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:53.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:52 smithi082 ceph-mon[32178]: pgmap v223: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 1.2 MiB/s wr, 265 op/s 2024-03-27T07:30:53.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:52 smithi149 ceph-mon[36065]: pgmap v223: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 1.2 MiB/s wr, 265 op/s 2024-03-27T07:30:53.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:52 smithi153 ceph-mon[36179]: pgmap v223: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 1.2 MiB/s wr, 265 op/s 2024-03-27T07:30:55.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:54 smithi082 ceph-mon[32178]: pgmap v224: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 356 op/s 2024-03-27T07:30:55.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:54 smithi149 ceph-mon[36065]: pgmap v224: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 356 op/s 2024-03-27T07:30:55.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:54 smithi153 ceph-mon[36179]: pgmap v224: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 356 op/s 2024-03-27T07:30:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 -- 172.21.15.82:0/2445754524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd548106a20 msgr2=0x7fd548106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 --2- 172.21.15.82:0/2445754524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd548106a20 0x7fd548106e00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd544009930 tx=0x7fd54402bc30 comp rx=0 tx=0).stop 2024-03-27T07:30:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 -- 172.21.15.82:0/2445754524 shutdown_connections 2024-03-27T07:30:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 --2- 172.21.15.82:0/2445754524 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd5481013d0 0x7fd54810d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 --2- 172.21.15.82:0/2445754524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd548100a10 0x7fd548100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 --2- 172.21.15.82:0/2445754524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd548106a20 0x7fd548106e00 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 -- 172.21.15.82:0/2445754524 >> 172.21.15.82:0/2445754524 conn(0x7fd548077b70 msgr2=0x7fd548077f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 -- 172.21.15.82:0/2445754524 shutdown_connections 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 -- 172.21.15.82:0/2445754524 wait complete. 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 Processor -- start 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.668+0000 7fd54f516640 1 -- start start 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54f516640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd548100a10 0x7fd548198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54f516640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5481013d0 0x7fd5481989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54f516640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd548106a20 0x7fd54819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54f516640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd548110e30 con 0x7fd5481013d0 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54f516640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd548110cb0 con 0x7fd548100a10 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54f516640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd548110fb0 con 0x7fd548106a20 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54cab1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5481013d0 0x7fd5481989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54d2b2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd548100a10 0x7fd548198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54cab1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5481013d0 0x7fd5481989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44904/0 (socket says 172.21.15.82:44904) 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54cab1640 1 -- 172.21.15.82:0/1204581367 learned_addr learned my addr 172.21.15.82:0/1204581367 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54dab3640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd548106a20 0x7fd54819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54cab1640 1 -- 172.21.15.82:0/1204581367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd548106a20 msgr2=0x7fd54819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54cab1640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd548106a20 0x7fd54819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54cab1640 1 -- 172.21.15.82:0/1204581367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd548100a10 msgr2=0x7fd548198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54cab1640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd548100a10 0x7fd548198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54cab1640 1 -- 172.21.15.82:0/1204581367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54819d460 con 0x7fd5481013d0 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54cab1640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5481013d0 0x7fd5481989b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd53800e9f0 tx=0x7fd53800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd53e7fc640 1 -- 172.21.15.82:0/1204581367 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53800cd80 con 0x7fd5481013d0 2024-03-27T07:30:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd53e7fc640 1 -- 172.21.15.82:0/1204581367 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd538005500 con 0x7fd5481013d0 2024-03-27T07:30:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.669+0000 7fd54f516640 1 -- 172.21.15.82:0/1204581367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54819d750 con 0x7fd5481013d0 2024-03-27T07:30:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.670+0000 7fd53e7fc640 1 -- 172.21.15.82:0/1204581367 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd538010690 con 0x7fd5481013d0 2024-03-27T07:30:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.670+0000 7fd54f516640 1 -- 172.21.15.82:0/1204581367 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5481a4fe0 con 0x7fd5481013d0 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.672+0000 7fd53e7fc640 1 -- 172.21.15.82:0/1204581367 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fd5380046c0 con 0x7fd5481013d0 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.672+0000 7fd5521ce740 1 Processor -- start 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.672+0000 7fd5521ce740 1 -- start start 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.672+0000 7fd53e7fc640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd5340a38a0 0x7fd5340a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a004d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a00a10 0x55ab98a092a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 0x55ab98a0bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd5521ce740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ab989c6cd0 con 0x55ab98a000f0 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd5521ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ab9890b950 con 0x55ab98a00a10 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd5521ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ab98963e50 con 0x55ab98a097e0 2024-03-27T07:30:55.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd53e7fc640 1 -- 172.21.15.82:0/1204581367 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd5380d0470 con 0x7fd5481013d0 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54dab3640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd5340a38a0 0x7fd5340a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54d2b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54d2b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a004d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44912/0 (socket says 172.21.15.82:44912) 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54cab1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a00a10 0x55ab98a092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54d2b2640 1 -- 172.21.15.82:0/3611732363 learned_addr learned my addr 172.21.15.82:0/3611732363 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54dab3640 1 --2- 172.21.15.82:0/3611732363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 0x55ab98a0bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54d2b2640 1 -- 172.21.15.82:0/3611732363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 msgr2=0x55ab98a0bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54d2b2640 1 --2- 172.21.15.82:0/3611732363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 0x55ab98a0bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54d2b2640 1 -- 172.21.15.82:0/3611732363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a00a10 msgr2=0x55ab98a092a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54d2b2640 1 --2- 172.21.15.82:0/3611732363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a00a10 0x55ab98a092a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54d2b2640 1 -- 172.21.15.82:0/3611732363 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab98678210 con 0x55ab98a000f0 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54cab1640 1 --2- 172.21.15.82:0/3611732363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a00a10 0x55ab98a092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:30:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54dab3640 1 --2- 172.21.15.82:0/3611732363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 0x55ab98a0bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54dab3640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd5340a38a0 0x7fd5340a5d60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd540005fd0 tx=0x7fd540009b00 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd54d2b2640 1 --2- 172.21.15.82:0/3611732363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a004d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd54402cfd0 tx=0x7fd5440095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44aafe0cd96f2225 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd5337fe640 1 -- 172.21.15.82:0/3611732363 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544042070 con 0x55ab98a000f0 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd5337fe640 1 -- 172.21.15.82:0/3611732363 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd544004030 con 0x55ab98a000f0 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.673+0000 7fd5337fe640 1 -- 172.21.15.82:0/3611732363 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544004af0 con 0x55ab98a000f0 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.674+0000 7fd5521ce740 1 -- 172.21.15.82:0/3611732363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 msgr2=0x55ab98a004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.674+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3611732363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a004d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd54402cfd0 tx=0x7fd5440095f0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.674+0000 7fd5521ce740 1 -- 172.21.15.82:0/3611732363 shutdown_connections 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.674+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3611732363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 0x55ab98a0bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.674+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3611732363 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a00a10 0x55ab98a092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.674+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3611732363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a004d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.674+0000 7fd5521ce740 1 -- 172.21.15.82:0/3611732363 >> 172.21.15.82:0/3611732363 conn(0x55ab989faa10 msgr2=0x55ab989fadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.674+0000 7fd5521ce740 1 -- 172.21.15.82:0/3611732363 shutdown_connections 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.674+0000 7fd5521ce740 1 -- 172.21.15.82:0/3611732363 wait complete. 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd5521ce740 1 -- start start 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd5521ce740 1 Processor -- start 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a067c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a00a10 0x55ab98a06d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 0x55ab98a07240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd5521ce740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ab9895fe00 con 0x55ab98a000f0 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd5521ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ab9890c520 con 0x55ab98a097e0 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd5521ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ab9891f8e0 con 0x55ab98a00a10 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd5521ce740 10 client.0 _ll_register_callbacks cb 0x55ab9895aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd54d2b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd54d2b2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a067c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44916/0 (socket says 172.21.15.82:44916) 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd54d2b2640 1 -- 172.21.15.82:0/3874967634 learned_addr learned my addr 172.21.15.82:0/3874967634 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd54dab3640 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 0x55ab98a07240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd54cab1640 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a00a10 0x55ab98a06d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd54d2b2640 1 -- 172.21.15.82:0/3874967634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a00a10 msgr2=0x55ab98a06d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd54d2b2640 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a00a10 0x55ab98a06d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd54d2b2640 1 -- 172.21.15.82:0/3874967634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 msgr2=0x55ab98a07240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd54d2b2640 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 0x55ab98a07240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.675+0000 7fd54d2b2640 1 -- 172.21.15.82:0/3874967634 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab98744620 con 0x55ab98a000f0 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd54d2b2640 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a067c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd544005ab0 tx=0x7fd544004b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52cd6d650e8a489 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd530ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd530ff9640 1 -- 172.21.15.82:0/3874967634 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54404e060 con 0x55ab98a000f0 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd530ff9640 1 -- 172.21.15.82:0/3874967634 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd54402ca90 con 0x55ab98a000f0 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd5521ce740 1 -- 172.21.15.82:0/3874967634 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd544004030 con 0x55ab98a000f0 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd530ff9640 1 -- 172.21.15.82:0/3874967634 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd544042070 con 0x55ab98a000f0 2024-03-27T07:30:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd5521ce740 10 client.16893 fetch_fsmap learned FSMap version 33 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd5521ce740 1 -- 172.21.15.82:0/3874967634 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ab98a18300 con 0x55ab98a000f0 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd530ff9640 1 -- 172.21.15.82:0/3874967634 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd544004030 con 0x55ab98a000f0 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd530ff9640 1 -- 172.21.15.82:0/3874967634 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 33) ==== 8354+0+0 (secure 0 0 0) 0x7fd544003780 con 0x55ab98a000f0 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd5521ce740 10 client.16893 fetch_fsmap finished waiting for FSMap version 33 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd5521ce740 10 client.16893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd5521ce740 20 client.16893 populate_metadata read hostname 'smithi082' 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ab98a19650 0x55ab98a1ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd5521ce740 4 client.16893 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.676+0000 7fd5521ce740 1 -- 172.21.15.82:0/3874967634 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab98971390 con 0x55ab98a19650 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.677+0000 7fd54cab1640 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ab98a19650 0x55ab98a1ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.677+0000 7fd530ff9640 10 client.16893 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.677+0000 7fd54cab1640 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ab98a19650 0x55ab98a1ba40 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae5a02917557f297 server_cookie=5514d47cc0c2c101 in_seq=0 out_seq=0 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd530ff9640 1 -- 172.21.15.82:0/3874967634 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ab98971390 con 0x55ab98a19650 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd530ff9640 10 client.16893 handle_command_reply: tid=0 2024-03-27T07:30:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 client.16893 shutdown 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 -- 172.21.15.82:0/3874967634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 msgr2=0x55ab98a067c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a067c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd544005ab0 tx=0x7fd544004b00 comp rx=0 tx=0).stop 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 -- 172.21.15.82:0/3874967634 shutdown_connections 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 0x55ab98a07240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a00a10 0x55ab98a06d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ab98a19650 0x55ab98a1ba40 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3874967634 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a000f0 0x55ab98a067c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd530ff9640 0 client.16893 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 -- 172.21.15.82:0/3874967634 >> 172.21.15.82:0/3874967634 conn(0x55ab989faa10 msgr2=0x55ab989fc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 -- 172.21.15.82:0/3874967634 shutdown_connections 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 1 -- 172.21.15.82:0/3874967634 wait complete. 2024-03-27T07:30:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.678+0000 7fd5521ce740 20 client.16893 trim_cache size 0 max 16384 2024-03-27T07:30:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd5521ce740 1 Processor -- start 2024-03-27T07:30:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd5521ce740 1 -- start start 2024-03-27T07:30:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a000f0 0x55ab98a08ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a11860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 0x55ab98a14e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd5521ce740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5481aff40 con 0x55ab98a00a10 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd5521ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5481ad7b0 con 0x55ab98a000f0 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd5521ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd5481ab620 con 0x55ab98a097e0 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd54cab1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a11860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd54cab1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a11860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44918/0 (socket says 172.21.15.82:44918) 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd54cab1640 1 -- 172.21.15.82:0/3353240539 learned_addr learned my addr 172.21.15.82:0/3353240539 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.693+0000 7fd54dab3640 1 --2- 172.21.15.82:0/3353240539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 0x55ab98a14e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd54cab1640 1 -- 172.21.15.82:0/3353240539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 msgr2=0x55ab98a14e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd54cab1640 1 --2- 172.21.15.82:0/3353240539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 0x55ab98a14e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd54cab1640 1 -- 172.21.15.82:0/3353240539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a000f0 msgr2=0x55ab98a08ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd54cab1640 1 --2- 172.21.15.82:0/3353240539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a000f0 0x55ab98a08ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd54cab1640 1 -- 172.21.15.82:0/3353240539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab98a06780 con 0x55ab98a00a10 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd54cab1640 1 --2- 172.21.15.82:0/3353240539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a11860 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd538098a80 tx=0x7fd538087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec335a8f8e336066 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd532ffd640 1 -- 172.21.15.82:0/3353240539 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53809cd20 con 0x55ab98a00a10 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd532ffd640 1 -- 172.21.15.82:0/3353240539 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd53809c620 con 0x55ab98a00a10 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd532ffd640 1 -- 172.21.15.82:0/3353240539 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5380600b0 con 0x55ab98a00a10 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd5521ce740 1 -- 172.21.15.82:0/3353240539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 msgr2=0x55ab98a11860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3353240539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a11860 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd538098a80 tx=0x7fd538087040 comp rx=0 tx=0).stop 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd5521ce740 1 -- 172.21.15.82:0/3353240539 shutdown_connections 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3353240539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a11860 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3353240539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a097e0 0x55ab98a14e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd5521ce740 1 --2- 172.21.15.82:0/3353240539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a000f0 0x55ab98a08ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.694+0000 7fd5521ce740 1 -- 172.21.15.82:0/3353240539 >> 172.21.15.82:0/3353240539 conn(0x55ab989faa10 msgr2=0x55ab98a00f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 1 -- 172.21.15.82:0/3353240539 shutdown_connections 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 1 -- 172.21.15.82:0/3353240539 wait complete. 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 1 -- start start 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 1 Processor -- start 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a000f0 0x55ab98a02c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a03160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 0x55ab98a036c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5481abc70 con 0x55ab98a00a10 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd5481ad0e0 con 0x55ab98a097e0 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd5481ac340 con 0x55ab98a000f0 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd5521ce740 10 client.0 _ll_register_callbacks cb 0x7fd53800cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd54cab1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a03160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd54cab1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a03160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44920/0 (socket says 172.21.15.82:44920) 2024-03-27T07:30:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd54cab1640 1 -- 172.21.15.82:0/671064294 learned_addr learned my addr 172.21.15.82:0/671064294 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:30:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.695+0000 7fd54d2b2640 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a000f0 0x55ab98a02c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd54cab1640 1 -- 172.21.15.82:0/671064294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a000f0 msgr2=0x55ab98a02c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd54cab1640 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a000f0 0x55ab98a02c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd54cab1640 1 -- 172.21.15.82:0/671064294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 msgr2=0x55ab98a036c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:30:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd54dab3640 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 0x55ab98a036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd54cab1640 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 0x55ab98a036c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd54cab1640 1 -- 172.21.15.82:0/671064294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab98a03ef0 con 0x55ab98a00a10 2024-03-27T07:30:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd54dab3640 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 0x55ab98a036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:30:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd54cab1640 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a03160 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd53809c5b0 tx=0x7fd5380ce0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62778856a15359c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:30:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd530ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:30:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd530ff9640 1 -- 172.21.15.82:0/671064294 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5380a5290 con 0x55ab98a00a10 2024-03-27T07:30:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd530ff9640 1 -- 172.21.15.82:0/671064294 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 8484+0+0 (secure 0 0 0) 0x7fd5380600b0 con 0x55ab98a00a10 2024-03-27T07:30:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd5521ce740 1 -- 172.21.15.82:0/671064294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd53809c620 con 0x55ab98a00a10 2024-03-27T07:30:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd530ff9640 1 -- 172.21.15.82:0/671064294 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd53809cd20 con 0x55ab98a00a10 2024-03-27T07:30:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd5521ce740 10 client.16899 fetch_fsmap learned FSMap version 33 2024-03-27T07:30:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd5521ce740 1 -- 172.21.15.82:0/671064294 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ab98a83f30 con 0x55ab98a00a10 2024-03-27T07:30:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd530ff9640 1 -- 172.21.15.82:0/671064294 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd53809c620 con 0x55ab98a00a10 2024-03-27T07:30:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.696+0000 7fd530ff9640 1 -- 172.21.15.82:0/671064294 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 33) ==== 8354+0+0 (secure 0 0 0) 0x7fd538085b60 con 0x55ab98a00a10 2024-03-27T07:30:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.697+0000 7fd5521ce740 10 client.16899 fetch_fsmap finished waiting for FSMap version 33 2024-03-27T07:30:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.697+0000 7fd5521ce740 10 client.16899 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:30:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.697+0000 7fd5521ce740 20 client.16899 populate_metadata read hostname 'smithi082' 2024-03-27T07:30:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.697+0000 7fd5521ce740 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ab98a846c0 0x55ab98a86ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:30:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.697+0000 7fd5521ce740 4 client.16899 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:30:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.697+0000 7fd5521ce740 1 -- 172.21.15.82:0/671064294 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ab9896b6e0 con 0x55ab98a846c0 2024-03-27T07:30:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.697+0000 7fd54d2b2640 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ab98a846c0 0x55ab98a86ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:30:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.698+0000 7fd54d2b2640 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ab98a846c0 0x55ab98a86ae0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50c86e76ea782cdc server_cookie=e48029aba2628a98 in_seq=0 out_seq=0 2024-03-27T07:30:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:55.698+0000 7fd530ff9640 10 client.16899 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.843+0000 7fd530ff9640 1 -- 172.21.15.82:0/671064294 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ab9896b6e0 con 0x55ab98a846c0 2024-03-27T07:30:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.843+0000 7fd530ff9640 10 client.16899 handle_command_reply: tid=0 2024-03-27T07:30:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 client.16899 shutdown 2024-03-27T07:30:56.847 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 -- 172.21.15.82:0/671064294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 msgr2=0x55ab98a03160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a03160 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd53809c5b0 tx=0x7fd5380ce0c0 comp rx=0 tx=0).stop 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 -- 172.21.15.82:0/671064294 shutdown_connections 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ab98a846c0 0x55ab98a86ae0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab98a00a10 0x55ab98a03160 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ab98a097e0 0x55ab98a036c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd530ff9640 0 client.16899 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 --2- 172.21.15.82:0/671064294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ab98a000f0 0x55ab98a02c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 -- 172.21.15.82:0/671064294 >> 172.21.15.82:0/671064294 conn(0x55ab989faa10 msgr2=0x55ab98a06c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 -- 172.21.15.82:0/671064294 shutdown_connections 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 1 -- 172.21.15.82:0/671064294 wait complete. 2024-03-27T07:30:56.848 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.844+0000 7fd5521ce740 20 client.16899 trim_cache size 0 max 16384 2024-03-27T07:30:56.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:30:56.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:30:56.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:30:56.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:30:56.849 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 -- 172.21.15.82:0/1204581367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd5340a38a0 msgr2=0x7fd5340a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd5340a38a0 0x7fd5340a5d60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd540005fd0 tx=0x7fd540009b00 comp rx=0 tx=0).stop 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 -- 172.21.15.82:0/1204581367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5481013d0 msgr2=0x7fd5481989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5481013d0 0x7fd5481989b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd53800e9f0 tx=0x7fd53800edf0 comp rx=0 tx=0).stop 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 -- 172.21.15.82:0/1204581367 shutdown_connections 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd5340a38a0 0x7fd5340a5d60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5481013d0 0x7fd5481989b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd548106a20 0x7fd54819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 --2- 172.21.15.82:0/1204581367 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd548100a10 0x7fd548198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 -- 172.21.15.82:0/1204581367 >> 172.21.15.82:0/1204581367 conn(0x7fd548077b70 msgr2=0x7fd54806a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 -- 172.21.15.82:0/1204581367 shutdown_connections 2024-03-27T07:30:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:30:56.845+0000 7fd54f516640 1 -- 172.21.15.82:0/1204581367 wait complete. 2024-03-27T07:30:57.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:56 smithi082 ceph-mon[32178]: pgmap v225: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 216 op/s 2024-03-27T07:30:57.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:56 smithi149 ceph-mon[36065]: pgmap v225: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 216 op/s 2024-03-27T07:30:57.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:56 smithi153 ceph-mon[36179]: pgmap v225: 97 pgs: 97 active+clean; 1.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.7 MiB/s wr, 216 op/s 2024-03-27T07:30:58.376 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:30:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[67179]: *** Caught signal (Segmentation fault) ** 2024-03-27T07:30:58.376 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:30:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[67179]: in thread 7ff7be5d8700 thread_name:MR_Finisher 2024-03-27T07:30:58.376 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:30:58 smithi153 podman[71830]: 2024-03-27 07:30:58.153762353 +0000 UTC m=+0.021720042 container died ad65a8c6f54f4cb00d416e97f6f5dc0c64e24b11bec833df2b8e485fafd1efb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-03-27T07:30:59.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:58 smithi082 ceph-mon[32178]: pgmap v226: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 311 op/s 2024-03-27T07:30:59.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:58 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:59.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:58 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:30:59.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:58 smithi153 ceph-mon[36179]: pgmap v226: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 311 op/s 2024-03-27T07:30:59.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:58 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:59.240 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:58 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:30:59.241 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:30:58 smithi153 podman[71830]: 2024-03-27 07:30:58.929690431 +0000 UTC m=+0.797648102 container remove ad65a8c6f54f4cb00d416e97f6f5dc0c64e24b11bec833df2b8e485fafd1efb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-27T07:30:59.241 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:30:58 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service: Main process exited, code=exited, status=139/n/a 2024-03-27T07:30:59.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:58 smithi149 ceph-mon[36065]: pgmap v226: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.3 MiB/s wr, 311 op/s 2024-03-27T07:30:59.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:58 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:30:59.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:58 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:30:59.539 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:30:59 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service: Failed with result 'exit-code'. 2024-03-27T07:30:59.539 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:30:59 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service: Consumed 23.388s CPU time. 2024-03-27T07:31:00.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:59 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:31:00.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:59 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:31:00.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:30:59 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:31:00.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:59 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:31:00.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:59 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:31:00.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:30:59 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:31:00.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:59 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:31:00.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:59 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:31:00.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:30:59 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:31:01.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:00 smithi082 ceph-mon[32178]: pgmap v227: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 243 op/s 2024-03-27T07:31:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:00 smithi149 ceph-mon[36065]: pgmap v227: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 243 op/s 2024-03-27T07:31:01.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:00 smithi153 ceph-mon[36179]: pgmap v227: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.1 MiB/s wr, 243 op/s 2024-03-27T07:31:02.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:01 smithi082 ceph-mon[32178]: pgmap v228: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 229 op/s 2024-03-27T07:31:02.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:01 smithi149 ceph-mon[36065]: pgmap v228: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 229 op/s 2024-03-27T07:31:02.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:01 smithi153 ceph-mon[36179]: pgmap v228: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 229 op/s 2024-03-27T07:31:04.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:04 smithi082 ceph-mon[32178]: pgmap v229: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 327 op/s 2024-03-27T07:31:04.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:04 smithi149 ceph-mon[36065]: pgmap v229: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 327 op/s 2024-03-27T07:31:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:04 smithi153 ceph-mon[36179]: pgmap v229: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.4 MiB/s wr, 327 op/s 2024-03-27T07:31:05.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:05 smithi082 ceph-mon[32178]: osdmap e92: 12 total, 12 up, 12 in 2024-03-27T07:31:05.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:05 smithi149 ceph-mon[36065]: osdmap e92: 12 total, 12 up, 12 in 2024-03-27T07:31:05.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:05 smithi153 ceph-mon[36179]: osdmap e92: 12 total, 12 up, 12 in 2024-03-27T07:31:06.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:06 smithi082 ceph-mon[32178]: pgmap v231: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 289 op/s 2024-03-27T07:31:06.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:06 smithi149 ceph-mon[36065]: pgmap v231: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 289 op/s 2024-03-27T07:31:06.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:06 smithi153 ceph-mon[36179]: pgmap v231: 97 pgs: 97 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 289 op/s 2024-03-27T07:31:07.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:07 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:31:07.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:07 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:31:07.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:07 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:31:08.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:08 smithi149 ceph-mon[36065]: pgmap v232: 97 pgs: 36 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 41 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 243 op/s 2024-03-27T07:31:08.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:08 smithi153 ceph-mon[36179]: pgmap v232: 97 pgs: 36 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 41 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 243 op/s 2024-03-27T07:31:08.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:08 smithi082 ceph-mon[32178]: pgmap v232: 97 pgs: 36 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 41 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 243 op/s 2024-03-27T07:31:09.562 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:09 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service: Scheduled restart job, restart counter is at 1. 2024-03-27T07:31:09.562 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:09 smithi153 systemd[1]: Stopped Ceph mds.c for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:31:09.562 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:09 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service: Consumed 23.388s CPU time. 2024-03-27T07:31:09.562 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:09 smithi153 systemd[1]: Starting Ceph mds.c for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:31:09.903 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:09 smithi153 podman[72058]: 2024-03-27 07:31:09.461920637 +0000 UTC m=+0.023976654 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:31:09.903 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:09 smithi153 podman[72058]: 2024-03-27 07:31:09.597740455 +0000 UTC m=+0.159796487 container create d9c75297230aae8cfc5340d721268adab1d25d02613750c56d2138e575d2a1e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:31:09.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.951+0000 7fd20bb0f640 1 -- 172.21.15.82:0/1011758193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd204100c70 msgr2=0x7fd2041067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:09.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.951+0000 7fd20bb0f640 1 --2- 172.21.15.82:0/1011758193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd204100c70 0x7fd2041067a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009930 tx=0x7fd1f402bc80 comp rx=0 tx=0).stop 2024-03-27T07:31:09.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.951+0000 7fd20bb0f640 1 -- 172.21.15.82:0/1011758193 shutdown_connections 2024-03-27T07:31:09.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.951+0000 7fd20bb0f640 1 --2- 172.21.15.82:0/1011758193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd204100c70 0x7fd2041067a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.951+0000 7fd20bb0f640 1 --2- 172.21.15.82:0/1011758193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd204106ed0 0x7fd20410ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.951+0000 7fd20bb0f640 1 --2- 172.21.15.82:0/1011758193 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd2041002c0 0x7fd2041006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.951+0000 7fd20bb0f640 1 -- 172.21.15.82:0/1011758193 >> 172.21.15.82:0/1011758193 conn(0x7fd204076fe0 msgr2=0x7fd2040fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:09.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.952+0000 7fd20bb0f640 1 -- 172.21.15.82:0/1011758193 shutdown_connections 2024-03-27T07:31:09.955 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.952+0000 7fd20bb0f640 1 -- 172.21.15.82:0/1011758193 wait complete. 2024-03-27T07:31:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.952+0000 7fd20bb0f640 1 Processor -- start 2024-03-27T07:31:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.952+0000 7fd20bb0f640 1 -- start start 2024-03-27T07:31:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.952+0000 7fd20bb0f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2041002c0 0x7fd2041983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.952+0000 7fd20bb0f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd204106ed0 0x7fd204198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.952+0000 7fd20bb0f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20419cc30 0x7fd20419d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.952+0000 7fd20bb0f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd204111ea0 con 0x7fd20419cc30 2024-03-27T07:31:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.952+0000 7fd20bb0f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd204111d20 con 0x7fd204106ed0 2024-03-27T07:31:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.952+0000 7fd20bb0f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd204112020 con 0x7fd2041002c0 2024-03-27T07:31:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20a0ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20419cc30 0x7fd20419d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd2098ab640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2041002c0 0x7fd2041983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20a0ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20419cc30 0x7fd20419d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41726/0 (socket says 172.21.15.82:41726) 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20a0ac640 1 -- 172.21.15.82:0/3860011134 learned_addr learned my addr 172.21.15.82:0/3860011134 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd2090aa640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd204106ed0 0x7fd204198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20a0ac640 1 -- 172.21.15.82:0/3860011134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2041002c0 msgr2=0x7fd2041983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20a0ac640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2041002c0 0x7fd2041983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20a0ac640 1 -- 172.21.15.82:0/3860011134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd204106ed0 msgr2=0x7fd204198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20a0ac640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd204106ed0 0x7fd204198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20a0ac640 1 -- 172.21.15.82:0/3860011134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20419d720 con 0x7fd20419cc30 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20a0ac640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20419cc30 0x7fd20419d0e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00eb10 tx=0x7fd1fc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd1faffd640 1 -- 172.21.15.82:0/3860011134 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc004b20 con 0x7fd20419cc30 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd1faffd640 1 -- 172.21.15.82:0/3860011134 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1fc004cc0 con 0x7fd20419cc30 2024-03-27T07:31:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20bb0f640 1 -- 172.21.15.82:0/3860011134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20419da10 con 0x7fd20419cc30 2024-03-27T07:31:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.953+0000 7fd20bb0f640 1 -- 172.21.15.82:0/3860011134 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2041a51d0 con 0x7fd20419cc30 2024-03-27T07:31:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.954+0000 7fd1faffd640 1 -- 172.21.15.82:0/3860011134 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc010760 con 0x7fd20419cc30 2024-03-27T07:31:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.956+0000 7fd1faffd640 1 -- 172.21.15.82:0/3860011134 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fd1fc010900 con 0x7fd20419cc30 2024-03-27T07:31:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd1faffd640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1f00a3980 0x7fd1f00a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd20e7cc740 1 Processor -- start 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd1faffd640 1 -- 172.21.15.82:0/3860011134 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8528+0+0 (secure 0 0 0) 0x7fd1fc0d0500 con 0x7fd20419cc30 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd2098ab640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1f00a3980 0x7fd1f00a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd20e7cc740 1 -- start start 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adb70f0 0x55b51adb74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb7a10 0x55b51adc02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adc07e0 0x55b51adc2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b51ad7dcd0 con 0x55b51adb70f0 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b51acc2950 con 0x55b51adc07e0 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b51ad1ae50 con 0x55b51adb7a10 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd2090aa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb7a10 0x55b51adc02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd2090aa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb7a10 0x55b51adc02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:46430/0 (socket says 172.21.15.82:46430) 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd2090aa640 1 -- 172.21.15.82:0/538980670 learned_addr learned my addr 172.21.15.82:0/538980670 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd2098ab640 1 --2- 172.21.15.82:0/538980670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adb70f0 0x55b51adb74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.957+0000 7fd20a0ac640 1 --2- 172.21.15.82:0/538980670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adc07e0 0x55b51adc2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.958+0000 7fd2098ab640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1f00a3980 0x7fd1f00a5e40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd200005d00 tx=0x7fd2000107a0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.958+0000 7fd2090aa640 1 -- 172.21.15.82:0/538980670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adc07e0 msgr2=0x55b51adc2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.958+0000 7fd2090aa640 1 --2- 172.21.15.82:0/538980670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adc07e0 0x55b51adc2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.958+0000 7fd2090aa640 1 -- 172.21.15.82:0/538980670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adb70f0 msgr2=0x55b51adb74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.958+0000 7fd2090aa640 1 --2- 172.21.15.82:0/538980670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adb70f0 0x55b51adb74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.958+0000 7fd2090aa640 1 -- 172.21.15.82:0/538980670 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51aa2f210 con 0x55b51adb7a10 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.958+0000 7fd2098ab640 1 --2- 172.21.15.82:0/538980670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adb70f0 0x55b51adb74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.958+0000 7fd2090aa640 1 --2- 172.21.15.82:0/538980670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb7a10 0x55b51adc02a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4000c00 tx=0x7fd1f4005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25433ee42e9f836d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.958+0000 7fd1effff640 1 -- 172.21.15.82:0/538980670 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f402c870 con 0x55b51adb7a10 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.958+0000 7fd1effff640 1 -- 172.21.15.82:0/538980670 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1f402ca10 con 0x55b51adb7a10 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.959+0000 7fd20e7cc740 1 -- 172.21.15.82:0/538980670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb7a10 msgr2=0x55b51adc02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.959+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/538980670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb7a10 0x55b51adc02a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4000c00 tx=0x7fd1f4005d50 comp rx=0 tx=0).stop 2024-03-27T07:31:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.959+0000 7fd20e7cc740 1 -- 172.21.15.82:0/538980670 shutdown_connections 2024-03-27T07:31:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.959+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/538980670 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adc07e0 0x55b51adc2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.959+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/538980670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb7a10 0x55b51adc02a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.959+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/538980670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adb70f0 0x55b51adb74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.959+0000 7fd20e7cc740 1 -- 172.21.15.82:0/538980670 >> 172.21.15.82:0/538980670 conn(0x55b51adb1a10 msgr2=0x55b51adb1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.959+0000 7fd20e7cc740 1 -- 172.21.15.82:0/538980670 shutdown_connections 2024-03-27T07:31:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.959+0000 7fd20e7cc740 1 -- 172.21.15.82:0/538980670 wait complete. 2024-03-27T07:31:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.959+0000 7fd20e7cc740 1 -- start start 2024-03-27T07:31:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.960+0000 7fd20e7cc740 1 Processor -- start 2024-03-27T07:31:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.960+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adbd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.960+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adbdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51adbe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b51ad16e00 con 0x55b51adc07e0 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b51acc3520 con 0x55b51adb7a10 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b51acd68e0 con 0x55b51adb70f0 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd2090aa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adbdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20a0ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51adbe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20a0ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51adbe100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41752/0 (socket says 172.21.15.82:41752) 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20a0ac640 1 -- 172.21.15.82:0/811440889 learned_addr learned my addr 172.21.15.82:0/811440889 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd2090aa640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adbdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:39506/0 (socket says 172.21.15.82:39506) 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20e7cc740 10 client.0 _ll_register_callbacks cb 0x55b51ad11a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20a0ac640 1 -- 172.21.15.82:0/811440889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 msgr2=0x55b51adbd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20a0ac640 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adbd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20a0ac640 1 -- 172.21.15.82:0/811440889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 msgr2=0x55b51adbdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20a0ac640 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adbdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.961+0000 7fd20a0ac640 1 -- 172.21.15.82:0/811440889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51aafb620 con 0x55b51adc07e0 2024-03-27T07:31:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.962+0000 7fd20a0ac640 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51adbe100 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0049d0 tx=0x7fd1fc09c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8016421a6a7c5e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.962+0000 7fd1ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:31:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.962+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/811440889 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0b5060 con 0x55b51adc07e0 2024-03-27T07:31:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.962+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/811440889 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8528+0+0 (secure 0 0 0) 0x7fd1fc09caf0 con 0x55b51adc07e0 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.962+0000 7fd20e7cc740 1 -- 172.21.15.82:0/811440889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1f402ca10 con 0x55b51adc07e0 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.962+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/811440889 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd1fc0ba050 con 0x55b51adc07e0 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.962+0000 7fd20e7cc740 10 client.16917 fetch_fsmap learned FSMap version 35 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.962+0000 7fd20e7cc740 1 -- 172.21.15.82:0/811440889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b51add36b0 con 0x55b51adc07e0 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.963+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/811440889 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1f402ca10 con 0x55b51adc07e0 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.963+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/811440889 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd1fc0bb240 con 0x55b51adc07e0 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.963+0000 7fd20e7cc740 10 client.16917 fetch_fsmap finished waiting for FSMap version 35 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.963+0000 7fd20e7cc740 10 client.16917 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.963+0000 7fd20e7cc740 20 client.16917 populate_metadata read hostname 'smithi082' 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.963+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b51add4be0 0x55b51add7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.963+0000 7fd20e7cc740 4 client.16917 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.963+0000 7fd20e7cc740 1 -- 172.21.15.82:0/811440889 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b51ad28390 con 0x55b51add4be0 2024-03-27T07:31:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.964+0000 7fd2098ab640 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b51add4be0 0x55b51add7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:09.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.966+0000 7fd1ed7fa640 10 client.16917 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:09.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.966+0000 7fd2098ab640 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b51add4be0 0x55b51add7070 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dec89cd90e5546e server_cookie=e6d546135c85b967 in_seq=0 out_seq=0 2024-03-27T07:31:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.974+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/811440889 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b51ad28390 con 0x55b51add4be0 2024-03-27T07:31:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.974+0000 7fd1ed7fa640 10 client.16917 handle_command_reply: tid=0 2024-03-27T07:31:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.974+0000 7fd20e7cc740 1 client.16917 shutdown 2024-03-27T07:31:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.974+0000 7fd20e7cc740 1 -- 172.21.15.82:0/811440889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 msgr2=0x55b51adbe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.974+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51adbe100 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0049d0 tx=0x7fd1fc09c1d0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.975+0000 7fd20e7cc740 1 -- 172.21.15.82:0/811440889 shutdown_connections 2024-03-27T07:31:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.975+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b51add4be0 0x55b51add7070 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.975+0000 7fd1ed7fa640 0 client.16917 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.975+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51adbe100 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.975+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adbdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.975+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/811440889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adbd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.975+0000 7fd20e7cc740 1 -- 172.21.15.82:0/811440889 >> 172.21.15.82:0/811440889 conn(0x55b51adb1a10 msgr2=0x55b51adb3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.975+0000 7fd20e7cc740 1 -- 172.21.15.82:0/811440889 shutdown_connections 2024-03-27T07:31:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.975+0000 7fd20e7cc740 1 -- 172.21.15.82:0/811440889 wait complete. 2024-03-27T07:31:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.975+0000 7fd20e7cc740 20 client.16917 trim_cache size 0 max 16384 2024-03-27T07:31:09.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.993+0000 7fd20e7cc740 1 Processor -- start 2024-03-27T07:31:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.993+0000 7fd20e7cc740 1 -- start start 2024-03-27T07:31:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.993+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adbfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.993+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adbcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.993+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51add02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.993+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e8011110 con 0x55b51adc07e0 2024-03-27T07:31:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.993+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e800e920 con 0x55b51adb7a10 2024-03-27T07:31:10.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.993+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e800c770 con 0x55b51adb70f0 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd2098ab640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adbfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd2098ab640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adbfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:46458/0 (socket says 172.21.15.82:46458) 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd2098ab640 1 -- 172.21.15.82:0/4002605765 learned_addr learned my addr 172.21.15.82:0/4002605765 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd2090aa640 1 --2- 172.21.15.82:0/4002605765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adbcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd20a0ac640 1 --2- 172.21.15.82:0/4002605765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51add02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd2098ab640 1 -- 172.21.15.82:0/4002605765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 msgr2=0x55b51adbcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd2098ab640 1 --2- 172.21.15.82:0/4002605765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adbcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd2098ab640 1 -- 172.21.15.82:0/4002605765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 msgr2=0x55b51add02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd2098ab640 1 --2- 172.21.15.82:0/4002605765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51add02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd2098ab640 1 -- 172.21.15.82:0/4002605765 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51adb69d0 con 0x55b51adb70f0 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd20a0ac640 1 --2- 172.21.15.82:0/4002605765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51add02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:31:10.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd2098ab640 1 --2- 172.21.15.82:0/4002605765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adbfdb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd2000133a0 tx=0x7fd200015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c134785db2d935e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd1ef7fe640 1 -- 172.21.15.82:0/4002605765 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd200028d10 con 0x55b51adb70f0 2024-03-27T07:31:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.994+0000 7fd1ef7fe640 1 -- 172.21.15.82:0/4002605765 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd20002d070 con 0x55b51adb70f0 2024-03-27T07:31:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.995+0000 7fd1ef7fe640 1 -- 172.21.15.82:0/4002605765 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd200011ab0 con 0x55b51adb70f0 2024-03-27T07:31:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.995+0000 7fd20e7cc740 1 -- 172.21.15.82:0/4002605765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 msgr2=0x55b51adbfdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.995+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/4002605765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adbfdb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd2000133a0 tx=0x7fd200015000 comp rx=0 tx=0).stop 2024-03-27T07:31:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.995+0000 7fd20e7cc740 1 -- 172.21.15.82:0/4002605765 shutdown_connections 2024-03-27T07:31:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.995+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/4002605765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51add02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.995+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/4002605765 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adbcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.995+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/4002605765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adbfdb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.995+0000 7fd20e7cc740 1 -- 172.21.15.82:0/4002605765 >> 172.21.15.82:0/4002605765 conn(0x55b51adb1a10 msgr2=0x55b51adb0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.995+0000 7fd20e7cc740 1 -- 172.21.15.82:0/4002605765 shutdown_connections 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.995+0000 7fd20e7cc740 1 -- 172.21.15.82:0/4002605765 wait complete. 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd20e7cc740 1 -- start start 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd20e7cc740 1 Processor -- start 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adba050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd20e7cc740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51adba740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e800cde0 con 0x55b51adc07e0 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e800e250 con 0x55b51adb7a10 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd20e7cc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e800d4b0 con 0x55b51adb70f0 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd20e7cc740 10 client.0 _ll_register_callbacks cb 0x7fd1fc098a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:31:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd2098ab640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd2098ab640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:46470/0 (socket says 172.21.15.82:46470) 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd2098ab640 1 -- 172.21.15.82:0/2943907825 learned_addr learned my addr 172.21.15.82:0/2943907825 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd20a0ac640 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51adba740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.996+0000 7fd2090aa640 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adba050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd2098ab640 1 -- 172.21.15.82:0/2943907825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 msgr2=0x55b51adba050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd2098ab640 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adba050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd2098ab640 1 -- 172.21.15.82:0/2943907825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 msgr2=0x55b51adba740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd2098ab640 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51adba740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd2098ab640 1 -- 172.21.15.82:0/2943907825 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51ae39f70 con 0x55b51adb70f0 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd2098ab640 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adccd40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd20000b940 tx=0x7fd200005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7d1fccf97140c39 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd1ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/2943907825 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd200035070 con 0x55b51adb70f0 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd20e7cc740 1 -- 172.21.15.82:0/2943907825 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd20002d070 con 0x55b51adb70f0 2024-03-27T07:31:10.064 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/2943907825 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8528+0+0 (secure 0 0 0) 0x7fd2000283b0 con 0x55b51adb70f0 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/2943907825 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd2000285d0 con 0x55b51adb70f0 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd20e7cc740 10 client.26785 fetch_fsmap learned FSMap version 35 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.997+0000 7fd20e7cc740 1 -- 172.21.15.82:0/2943907825 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b51ae3b0b0 con 0x55b51adb70f0 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.998+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/2943907825 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd20002d070 con 0x55b51adb70f0 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.998+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/2943907825 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 35) ==== 8362+0+0 (secure 0 0 0) 0x7fd2000313f0 con 0x55b51adb70f0 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.998+0000 7fd20e7cc740 10 client.26785 fetch_fsmap finished waiting for FSMap version 35 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.998+0000 7fd20e7cc740 10 client.26785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.998+0000 7fd20e7cc740 20 client.26785 populate_metadata read hostname 'smithi082' 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.998+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b51add4be0 0x55b51ae3d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.998+0000 7fd20e7cc740 4 client.26785 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.998+0000 7fd20e7cc740 1 -- 172.21.15.82:0/2943907825 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b51ad226e0 con 0x55b51add4be0 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:09.999+0000 7fd2090aa640 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b51add4be0 0x55b51ae3d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:10.002+0000 7fd1ed7fa640 10 client.26785 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:10.065 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:10.002+0000 7fd2090aa640 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b51add4be0 0x55b51ae3d8a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=983da2020bba4248 server_cookie=afcf91f309b24ac5 in_seq=0 out_seq=0 2024-03-27T07:31:10.203 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:09 smithi153 podman[72058]: 2024-03-27 07:31:09.901275633 +0000 UTC m=+0.463331655 container init d9c75297230aae8cfc5340d721268adab1d25d02613750c56d2138e575d2a1e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-03-27T07:31:10.204 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:09 smithi153 podman[72058]: 2024-03-27 07:31:09.905889145 +0000 UTC m=+0.467945165 container start d9c75297230aae8cfc5340d721268adab1d25d02613750c56d2138e575d2a1e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD) 2024-03-27T07:31:10.204 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:09 smithi153 ceph-mds[72078]: -- 172.21.15.153:0/361610201 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5607b6d15a40 con 0x5607b6ce8800 2024-03-27T07:31:10.204 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:09 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: starting mds.c at 2024-03-27T07:31:10.204 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:10 smithi153 bash[72058]: d9c75297230aae8cfc5340d721268adab1d25d02613750c56d2138e575d2a1e6 2024-03-27T07:31:10.204 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:31:10 smithi153 systemd[1]: Started Ceph mds.c for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:31:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:10 smithi149 ceph-mon[36065]: pgmap v233: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 1.2 MiB/s wr, 231 op/s 2024-03-27T07:31:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:10 smithi149 ceph-mon[36065]: daemon mds.c restarted 2024-03-27T07:31:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:10 smithi153 ceph-mon[36179]: pgmap v233: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 1.2 MiB/s wr, 231 op/s 2024-03-27T07:31:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:10 smithi153 ceph-mon[36179]: daemon mds.c restarted 2024-03-27T07:31:10.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:10 smithi082 ceph-mon[32178]: pgmap v233: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 1.2 MiB/s wr, 231 op/s 2024-03-27T07:31:10.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:10 smithi082 ceph-mon[32178]: daemon mds.c restarted 2024-03-27T07:31:11.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:11 smithi149 ceph-mon[36065]: osdmap e93: 12 total, 12 up, 12 in 2024-03-27T07:31:11.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:11 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6836/4036329754,v1:172.21.15.153:6837/4036329754] up:boot 2024-03-27T07:31:11.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:11 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-03-27T07:31:11.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:11 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:31:11.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:11 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:31:11.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:11 smithi153 ceph-mon[36179]: osdmap e93: 12 total, 12 up, 12 in 2024-03-27T07:31:11.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:11 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6836/4036329754,v1:172.21.15.153:6837/4036329754] up:boot 2024-03-27T07:31:11.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:11 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-03-27T07:31:11.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:11 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:31:11.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:11 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:31:11.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:11 smithi082 ceph-mon[32178]: osdmap e93: 12 total, 12 up, 12 in 2024-03-27T07:31:11.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:11 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6836/4036329754,v1:172.21.15.153:6837/4036329754] up:boot 2024-03-27T07:31:11.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:11 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-03-27T07:31:11.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:11 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:31:11.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:11 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:31:12.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:12 smithi149 ceph-mon[36065]: pgmap v235: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 827 KiB/s wr, 142 op/s 2024-03-27T07:31:12.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:12 smithi153 ceph-mon[36179]: pgmap v235: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 827 KiB/s wr, 142 op/s 2024-03-27T07:31:12.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:12 smithi082 ceph-mon[32178]: pgmap v235: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.7 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 827 KiB/s wr, 142 op/s 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd1ed7fa640 1 -- 172.21.15.82:0/2943907825 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b51ad226e0 con 0x55b51add4be0 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd1ed7fa640 10 client.26785 handle_command_reply: tid=0 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 client.26785 shutdown 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 -- 172.21.15.82:0/2943907825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 msgr2=0x55b51adccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adccd40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd20000b940 tx=0x7fd200005850 comp rx=0 tx=0).stop 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 -- 172.21.15.82:0/2943907825 shutdown_connections 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b51add4be0 0x55b51ae3d8a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b51adc07e0 0x55b51adba740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b51adb7a10 0x55b51adba050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 --2- 172.21.15.82:0/2943907825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b51adb70f0 0x55b51adccd40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 -- 172.21.15.82:0/2943907825 >> 172.21.15.82:0/2943907825 conn(0x55b51adb1a10 msgr2=0x55b51adb01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd1ed7fa640 0 client.26785 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 -- 172.21.15.82:0/2943907825 shutdown_connections 2024-03-27T07:31:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.995+0000 7fd20e7cc740 1 -- 172.21.15.82:0/2943907825 wait complete. 2024-03-27T07:31:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.996+0000 7fd20e7cc740 20 client.26785 trim_cache size 0 max 16384 2024-03-27T07:31:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:31:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:31:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:31:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:31:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.996+0000 7fd20bb0f640 1 -- 172.21.15.82:0/3860011134 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1f00a3980 msgr2=0x7fd1f00a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.996+0000 7fd20bb0f640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1f00a3980 0x7fd1f00a5e40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd200005d00 tx=0x7fd2000107a0 comp rx=0 tx=0).stop 2024-03-27T07:31:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.997+0000 7fd20bb0f640 1 -- 172.21.15.82:0/3860011134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20419cc30 msgr2=0x7fd20419d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.997+0000 7fd20bb0f640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20419cc30 0x7fd20419d0e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00eb10 tx=0x7fd1fc00c2d0 comp rx=0 tx=0).stop 2024-03-27T07:31:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.997+0000 7fd20bb0f640 1 -- 172.21.15.82:0/3860011134 shutdown_connections 2024-03-27T07:31:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.997+0000 7fd20bb0f640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fd1f00a3980 0x7fd1f00a5e40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.997+0000 7fd20bb0f640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd20419cc30 0x7fd20419d0e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.997+0000 7fd20bb0f640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fd204106ed0 0x7fd204198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.997+0000 7fd20bb0f640 1 --2- 172.21.15.82:0/3860011134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2041002c0 0x7fd2041983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.997+0000 7fd20bb0f640 1 -- 172.21.15.82:0/3860011134 >> 172.21.15.82:0/3860011134 conn(0x7fd204076fe0 msgr2=0x7fd2040fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.997+0000 7fd20bb0f640 1 -- 172.21.15.82:0/3860011134 shutdown_connections 2024-03-27T07:31:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:13.997+0000 7fd20bb0f640 1 -- 172.21.15.82:0/3860011134 wait complete. 2024-03-27T07:31:14.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:14 smithi149 ceph-mon[36065]: pgmap v236: 97 pgs: 6 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 89 active+clean; 1.7 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-03-27T07:31:14.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:14 smithi153 ceph-mon[36179]: pgmap v236: 97 pgs: 6 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 89 active+clean; 1.7 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-03-27T07:31:14.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:14 smithi082 ceph-mon[32178]: pgmap v236: 97 pgs: 6 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 89 active+clean; 1.7 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 142 op/s 2024-03-27T07:31:16.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:16 smithi149 ceph-mon[36065]: pgmap v237: 97 pgs: 97 active+clean; 1.7 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-03-27T07:31:16.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:16 smithi153 ceph-mon[36179]: pgmap v237: 97 pgs: 97 active+clean; 1.7 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-03-27T07:31:16.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:16 smithi082 ceph-mon[32178]: pgmap v237: 97 pgs: 97 active+clean; 1.7 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 147 op/s 2024-03-27T07:31:19.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:18 smithi153 ceph-mon[36179]: pgmap v238: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-03-27T07:31:19.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:18 smithi153 ceph-mon[36179]: osdmap e94: 12 total, 12 up, 12 in 2024-03-27T07:31:19.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:18 smithi082 ceph-mon[32178]: pgmap v238: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-03-27T07:31:19.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:18 smithi082 ceph-mon[32178]: osdmap e94: 12 total, 12 up, 12 in 2024-03-27T07:31:19.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:18 smithi149 ceph-mon[36065]: pgmap v238: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-03-27T07:31:19.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:18 smithi149 ceph-mon[36065]: osdmap e94: 12 total, 12 up, 12 in 2024-03-27T07:31:21.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:20 smithi153 ceph-mon[36179]: pgmap v240: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.9 MiB/s wr, 264 op/s 2024-03-27T07:31:21.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:20 smithi082 ceph-mon[32178]: pgmap v240: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.9 MiB/s wr, 264 op/s 2024-03-27T07:31:21.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:20 smithi149 ceph-mon[36065]: pgmap v240: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 1.9 MiB/s wr, 264 op/s 2024-03-27T07:31:23.039 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:22 smithi153 ceph-mon[36179]: pgmap v241: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-03-27T07:31:23.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:22 smithi082 ceph-mon[32178]: pgmap v241: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-03-27T07:31:23.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:22 smithi149 ceph-mon[36065]: pgmap v241: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 235 op/s 2024-03-27T07:31:25.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:24 smithi082 ceph-mon[32178]: pgmap v242: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 296 op/s 2024-03-27T07:31:25.193 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:24 smithi153 ceph-mon[36179]: pgmap v242: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 296 op/s 2024-03-27T07:31:25.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:24 smithi149 ceph-mon[36065]: pgmap v242: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 296 op/s 2024-03-27T07:31:27.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.095+0000 7f688c90d640 1 -- 172.21.15.82:0/1677405413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6888101640 msgr2=0x7f688810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:27.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.095+0000 7f688c90d640 1 --2- 172.21.15.82:0/1677405413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6888101640 0x7f688810d880 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6880009ca0 tx=0x7f688002c0f0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.095+0000 7f688c90d640 1 -- 172.21.15.82:0/1677405413 shutdown_connections 2024-03-27T07:31:27.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.095+0000 7f688c90d640 1 --2- 172.21.15.82:0/1677405413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6888101640 0x7f688810d880 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.095+0000 7f688c90d640 1 --2- 172.21.15.82:0/1677405413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6888100ca0 0x7f6888101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.095+0000 7f688c90d640 1 --2- 172.21.15.82:0/1677405413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68881059d0 0x7f6888105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.095+0000 7f688c90d640 1 -- 172.21.15.82:0/1677405413 >> 172.21.15.82:0/1677405413 conn(0x7f6888077820 msgr2=0x7f6888077c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:27.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.095+0000 7f688c90d640 1 -- 172.21.15.82:0/1677405413 shutdown_connections 2024-03-27T07:31:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.095+0000 7f688c90d640 1 -- 172.21.15.82:0/1677405413 wait complete. 2024-03-27T07:31:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.096+0000 7f688c90d640 1 Processor -- start 2024-03-27T07:31:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.096+0000 7f688c90d640 1 -- start start 2024-03-27T07:31:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.096+0000 7f688c90d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6888100ca0 0x7f68881983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.096+0000 7f688c90d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6888101640 0x7f68881988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.096+0000 7f688c90d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68881059d0 0x7f688819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.096+0000 7f688c90d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6888112010 con 0x7f6888100ca0 2024-03-27T07:31:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.096+0000 7f688c90d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6888111e90 con 0x7f68881059d0 2024-03-27T07:31:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.096+0000 7f688c90d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6888112190 con 0x7f6888101640 2024-03-27T07:31:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f688659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6888100ca0 0x7f68881983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f688659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6888100ca0 0x7f68881983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36432/0 (socket says 172.21.15.82:36432) 2024-03-27T07:31:27.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f6886d9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68881059d0 0x7f688819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f688659c640 1 -- 172.21.15.82:0/2068205575 learned_addr learned my addr 172.21.15.82:0/2068205575 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f687ffff640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6888101640 0x7f68881988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f688659c640 1 -- 172.21.15.82:0/2068205575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6888101640 msgr2=0x7f68881988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f688659c640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6888101640 0x7f68881988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f688659c640 1 -- 172.21.15.82:0/2068205575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68881059d0 msgr2=0x7f688819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:27.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f688659c640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68881059d0 0x7f688819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f688659c640 1 -- 172.21.15.82:0/2068205575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688819d3a0 con 0x7f6888100ca0 2024-03-27T07:31:27.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f688659c640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6888100ca0 0x7f68881983b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f687800b4a0 tx=0x7f687800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:27.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f687f7fe640 1 -- 172.21.15.82:0/2068205575 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878014070 con 0x7f6888100ca0 2024-03-27T07:31:27.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f688c90d640 1 -- 172.21.15.82:0/2068205575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688819d690 con 0x7f6888100ca0 2024-03-27T07:31:27.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f687f7fe640 1 -- 172.21.15.82:0/2068205575 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6878010af0 con 0x7f6888100ca0 2024-03-27T07:31:27.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.097+0000 7f687f7fe640 1 -- 172.21.15.82:0/2068205575 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878017d10 con 0x7f6888100ca0 2024-03-27T07:31:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.098+0000 7f688c90d640 1 -- 172.21.15.82:0/2068205575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68881a4f20 con 0x7f6888100ca0 2024-03-27T07:31:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.101+0000 7f688f5cd740 1 Processor -- start 2024-03-27T07:31:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.101+0000 7f688f5cd740 1 -- start start 2024-03-27T07:31:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.101+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 0x55aa64f018e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.101+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f01e20 0x55aa64f0a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.101+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.101+0000 7f688f5cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aa64ec3cd0 con 0x55aa64f0abf0 2024-03-27T07:31:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.101+0000 7f688f5cd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55aa64e08950 con 0x55aa64f01e20 2024-03-27T07:31:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.101+0000 7f688f5cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa64e60e50 con 0x55aa64f01500 2024-03-27T07:31:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36434/0 (socket says 172.21.15.82:36434) 2024-03-27T07:31:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f6886d9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 0x55aa64f018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687ffff640 1 -- 172.21.15.82:0/4201429828 learned_addr learned my addr 172.21.15.82:0/4201429828 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687ffff640 1 -- 172.21.15.82:0/4201429828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 msgr2=0x55aa64f018e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687ffff640 1 --2- 172.21.15.82:0/4201429828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 0x55aa64f018e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687ffff640 1 -- 172.21.15.82:0/4201429828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f01e20 msgr2=0x55aa64f0a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:31:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687ffff640 1 --2- 172.21.15.82:0/4201429828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f01e20 0x55aa64f0a6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687ffff640 1 -- 172.21.15.82:0/4201429828 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa64b75210 con 0x55aa64f0abf0 2024-03-27T07:31:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687f7fe640 1 -- 172.21.15.82:0/2068205575 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f6878017070 con 0x7f6888100ca0 2024-03-27T07:31:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687ffff640 1 --2- 172.21.15.82:0/4201429828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0cfe0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6870009c90 tx=0x7f6870011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829bbbc3f21ba286 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687cff9640 1 -- 172.21.15.82:0/4201429828 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687001e070 con 0x55aa64f0abf0 2024-03-27T07:31:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687cff9640 1 -- 172.21.15.82:0/4201429828 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6870019b10 con 0x55aa64f0abf0 2024-03-27T07:31:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.102+0000 7f687cff9640 1 -- 172.21.15.82:0/4201429828 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687000ea70 con 0x55aa64f0abf0 2024-03-27T07:31:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f687f7fe640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f68740a3820 0x7f68740a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f6886d9d640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f68740a3820 0x7f68740a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f687f7fe640 1 -- 172.21.15.82:0/2068205575 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8484+0+0 (secure 0 0 0) 0x7f68780cf360 con 0x7f6888100ca0 2024-03-27T07:31:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f688f5cd740 1 -- 172.21.15.82:0/4201429828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 msgr2=0x55aa64f0cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f688f5cd740 1 --2- 172.21.15.82:0/4201429828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0cfe0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6870009c90 tx=0x7f6870011810 comp rx=0 tx=0).stop 2024-03-27T07:31:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f688f5cd740 1 -- 172.21.15.82:0/4201429828 shutdown_connections 2024-03-27T07:31:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f688f5cd740 1 --2- 172.21.15.82:0/4201429828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0cfe0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f688f5cd740 1 --2- 172.21.15.82:0/4201429828 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f01e20 0x55aa64f0a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f688f5cd740 1 --2- 172.21.15.82:0/4201429828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 0x55aa64f018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f688f5cd740 1 -- 172.21.15.82:0/4201429828 >> 172.21.15.82:0/4201429828 conn(0x55aa64efbe20 msgr2=0x55aa64efc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f6886d9d640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f68740a3820 0x7f68740a5ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6880004af0 tx=0x7f6880005c50 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f688f5cd740 1 -- 172.21.15.82:0/4201429828 shutdown_connections 2024-03-27T07:31:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.103+0000 7f688f5cd740 1 -- 172.21.15.82:0/4201429828 wait complete. 2024-03-27T07:31:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.104+0000 7f688f5cd740 1 -- start start 2024-03-27T07:31:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.104+0000 7f688f5cd740 1 Processor -- start 2024-03-27T07:31:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.104+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01500 0x55aa64f07c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.104+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 0x55aa64f081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.104+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f0abf0 0x55aa64f08710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.104+0000 7f688f5cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55aa64e5ce00 con 0x55aa64f01500 2024-03-27T07:31:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.104+0000 7f688f5cd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55aa64e09520 con 0x55aa64f0abf0 2024-03-27T07:31:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.104+0000 7f688f5cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55aa64e1c8e0 con 0x55aa64f01e20 2024-03-27T07:31:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.104+0000 7f688f5cd740 10 client.0 _ll_register_callbacks cb 0x55aa64e57a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:31:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01500 0x55aa64f07c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f687ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 0x55aa64f081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01500 0x55aa64f07c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36436/0 (socket says 172.21.15.82:36436) 2024-03-27T07:31:27.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688659c640 1 -- 172.21.15.82:0/1811062609 learned_addr learned my addr 172.21.15.82:0/1811062609 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f6886d9d640 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f0abf0 0x55aa64f08710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688659c640 1 -- 172.21.15.82:0/1811062609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 msgr2=0x55aa64f081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688659c640 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 0x55aa64f081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688659c640 1 -- 172.21.15.82:0/1811062609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f0abf0 msgr2=0x55aa64f08710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688659c640 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f0abf0 0x55aa64f08710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688659c640 1 -- 172.21.15.82:0/1811062609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa64c41620 con 0x55aa64f01500 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f687ffff640 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 0x55aa64f081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688659c640 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01500 0x55aa64f07c90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f68780cd0d0 tx=0x7f6878009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d179a9e2cf1dabfa server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f686dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f686dffb640 1 -- 172.21.15.82:0/1811062609 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687801e050 con 0x55aa64f01500 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f686dffb640 1 -- 172.21.15.82:0/1811062609 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8484+0+0 (secure 0 0 0) 0x7f68780ccd50 con 0x55aa64f01500 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688f5cd740 1 -- 172.21.15.82:0/1811062609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6870019b10 con 0x55aa64f01500 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f686dffb640 1 -- 172.21.15.82:0/1811062609 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f687809f9d0 con 0x55aa64f01500 2024-03-27T07:31:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688f5cd740 10 client.16935 fetch_fsmap learned FSMap version 37 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.105+0000 7f688f5cd740 1 -- 172.21.15.82:0/1811062609 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55aa64f19820 con 0x55aa64f01500 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.106+0000 7f686dffb640 1 -- 172.21.15.82:0/1811062609 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6870019b10 con 0x55aa64f01500 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.106+0000 7f686dffb640 1 -- 172.21.15.82:0/1811062609 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f687809abb0 con 0x55aa64f01500 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.106+0000 7f688f5cd740 10 client.16935 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.106+0000 7f688f5cd740 10 client.16935 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.106+0000 7f688f5cd740 20 client.16935 populate_metadata read hostname 'smithi082' 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.106+0000 7f688f5cd740 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55aa64f1ace0 0x55aa64f1d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.106+0000 7f688f5cd740 4 client.16935 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.106+0000 7f688f5cd740 1 -- 172.21.15.82:0/1811062609 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa64e6e390 con 0x55aa64f1ace0 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.106+0000 7f687ffff640 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55aa64f1ace0 0x55aa64f1d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f686dffb640 10 client.16935 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f687ffff640 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55aa64f1ace0 0x55aa64f1d0d0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbcba564fe84529c server_cookie=796da401349ff1bc in_seq=0 out_seq=0 2024-03-27T07:31:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f686dffb640 1 -- 172.21.15.82:0/1811062609 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55aa64e6e390 con 0x55aa64f1ace0 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f686dffb640 10 client.16935 handle_command_reply: tid=0 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f688f5cd740 1 client.16935 shutdown 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f688f5cd740 1 -- 172.21.15.82:0/1811062609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01500 msgr2=0x55aa64f07c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f688f5cd740 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01500 0x55aa64f07c90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f68780cd0d0 tx=0x7f6878009230 comp rx=0 tx=0).stop 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f688f5cd740 1 -- 172.21.15.82:0/1811062609 shutdown_connections 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f688f5cd740 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f0abf0 0x55aa64f08710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f688f5cd740 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 0x55aa64f081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f688f5cd740 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55aa64f1ace0 0x55aa64f1d0d0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f688f5cd740 1 --2- 172.21.15.82:0/1811062609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01500 0x55aa64f07c90 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f686dffb640 0 client.16935 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.107+0000 7f688f5cd740 1 -- 172.21.15.82:0/1811062609 >> 172.21.15.82:0/1811062609 conn(0x55aa64efbe20 msgr2=0x55aa64efdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.108+0000 7f688f5cd740 1 -- 172.21.15.82:0/1811062609 shutdown_connections 2024-03-27T07:31:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.108+0000 7f688f5cd740 1 -- 172.21.15.82:0/1811062609 wait complete. 2024-03-27T07:31:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.108+0000 7f688f5cd740 20 client.16935 trim_cache size 0 max 16384 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.122+0000 7f688f5cd740 1 Processor -- start 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.122+0000 7f688f5cd740 1 -- start start 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 0x55aa64f0a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01e20 0x55aa64f162c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f0abf0 0x55aa64ef68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f688f5cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68881ade40 con 0x55aa64f01e20 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f688f5cd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f68881ab650 con 0x55aa64f0abf0 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f688f5cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68881a94e0 con 0x55aa64f01500 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f687ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01e20 0x55aa64f162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f687ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01e20 0x55aa64f162c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36444/0 (socket says 172.21.15.82:36444) 2024-03-27T07:31:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f687ffff640 1 -- 172.21.15.82:0/3602643998 learned_addr learned my addr 172.21.15.82:0/3602643998 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f6886d9d640 1 --2- 172.21.15.82:0/3602643998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f0abf0 0x55aa64ef68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f688659c640 1 --2- 172.21.15.82:0/3602643998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 0x55aa64f0a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f687ffff640 1 -- 172.21.15.82:0/3602643998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 msgr2=0x55aa64f0a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f687ffff640 1 --2- 172.21.15.82:0/3602643998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 0x55aa64f0a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f687ffff640 1 -- 172.21.15.82:0/3602643998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f0abf0 msgr2=0x55aa64ef68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f687ffff640 1 --2- 172.21.15.82:0/3602643998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f0abf0 0x55aa64ef68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f687ffff640 1 -- 172.21.15.82:0/3602643998 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa64f1d700 con 0x55aa64f01e20 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f688659c640 1 --2- 172.21.15.82:0/3602643998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 0x55aa64f0a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f687ffff640 1 --2- 172.21.15.82:0/3602643998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01e20 0x55aa64f162c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f68700058c0 tx=0x7f687000e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e712bf46e3501d09 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f686ffff640 1 -- 172.21.15.82:0/3602643998 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687001e040 con 0x55aa64f01e20 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f686ffff640 1 -- 172.21.15.82:0/3602643998 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f687001f040 con 0x55aa64f01e20 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.123+0000 7f686ffff640 1 -- 172.21.15.82:0/3602643998 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687002b430 con 0x55aa64f01e20 2024-03-27T07:31:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 -- 172.21.15.82:0/3602643998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01e20 msgr2=0x55aa64f162c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 --2- 172.21.15.82:0/3602643998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01e20 0x55aa64f162c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f68700058c0 tx=0x7f687000e5d0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 -- 172.21.15.82:0/3602643998 shutdown_connections 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 --2- 172.21.15.82:0/3602643998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f01e20 0x55aa64f162c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 --2- 172.21.15.82:0/3602643998 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f0abf0 0x55aa64ef68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 --2- 172.21.15.82:0/3602643998 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01500 0x55aa64f0a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 -- 172.21.15.82:0/3602643998 >> 172.21.15.82:0/3602643998 conn(0x55aa64efbe20 msgr2=0x55aa64ef61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 -- 172.21.15.82:0/3602643998 shutdown_connections 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 -- 172.21.15.82:0/3602643998 wait complete. 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 -- start start 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.124+0000 7f688f5cd740 1 Processor -- start 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f01500 0x55aa64f0e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 0x55aa64f0e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f688f5cd740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f688f5cd740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68881a9b30 con 0x55aa64f0abf0 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f688f5cd740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f68881aaf80 con 0x55aa64f01500 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f688f5cd740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f68881aa1e0 con 0x55aa64f01e20 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f688f5cd740 10 client.0 _ll_register_callbacks cb 0x7f6878017ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f6886d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f688659c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f01500 0x55aa64f0e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f6886d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36446/0 (socket says 172.21.15.82:36446) 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f6886d9d640 1 -- 172.21.15.82:0/3904018048 learned_addr learned my addr 172.21.15.82:0/3904018048 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f687ffff640 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 0x55aa64f0e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f6886d9d640 1 -- 172.21.15.82:0/3904018048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 msgr2=0x55aa64f0e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f6886d9d640 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 0x55aa64f0e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.135 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f6886d9d640 1 -- 172.21.15.82:0/3904018048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f01500 msgr2=0x55aa64f0e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f6886d9d640 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f01500 0x55aa64f0e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f6886d9d640 1 -- 172.21.15.82:0/3904018048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa64f80100 con 0x55aa64f0abf0 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f6886d9d640 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0edb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6880037040 tx=0x7f68800095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7de57566cfc602 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f686dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f686dffb640 1 -- 172.21.15.82:0/3904018048 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880039040 con 0x55aa64f0abf0 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f686dffb640 1 -- 172.21.15.82:0/3904018048 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8484+0+0 (secure 0 0 0) 0x7f6880058470 con 0x55aa64f0abf0 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.125+0000 7f688f5cd740 1 -- 172.21.15.82:0/3904018048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f687001f040 con 0x55aa64f0abf0 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f686dffb640 1 -- 172.21.15.82:0/3904018048 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f6880058670 con 0x55aa64f0abf0 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f688f5cd740 10 client.16941 fetch_fsmap learned FSMap version 37 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f688f5cd740 1 -- 172.21.15.82:0/3904018048 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55aa64f813f0 con 0x55aa64f0abf0 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f686dffb640 1 -- 172.21.15.82:0/3904018048 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f687001f040 con 0x55aa64f0abf0 2024-03-27T07:31:27.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f686dffb640 1 -- 172.21.15.82:0/3904018048 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f688005f020 con 0x55aa64f0abf0 2024-03-27T07:31:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f688f5cd740 10 client.16941 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:31:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f688f5cd740 10 client.16941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:31:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f688f5cd740 20 client.16941 populate_metadata read hostname 'smithi082' 2024-03-27T07:31:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f688f5cd740 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55aa64f81b80 0x55aa64f83fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f688f5cd740 4 client.16941 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:31:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f688f5cd740 1 -- 172.21.15.82:0/3904018048 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aa64e686e0 con 0x55aa64f81b80 2024-03-27T07:31:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.126+0000 7f688659c640 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55aa64f81b80 0x55aa64f83fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.127+0000 7f688659c640 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55aa64f81b80 0x55aa64f83fa0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb0a2222e06927e0 server_cookie=72bf311e01684a9e in_seq=0 out_seq=0 2024-03-27T07:31:27.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:27.127+0000 7f686dffb640 10 client.16941 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:27.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:26 smithi082 ceph-mon[32178]: pgmap v243: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 289 op/s 2024-03-27T07:31:27.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:26 smithi149 ceph-mon[36065]: pgmap v243: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 289 op/s 2024-03-27T07:31:27.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:26 smithi153 ceph-mon[36179]: pgmap v243: 97 pgs: 97 active+clean; 1.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 289 op/s 2024-03-27T07:31:28.920 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f686dffb640 1 -- 172.21.15.82:0/3904018048 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aa64e686e0 con 0x55aa64f81b80 2024-03-27T07:31:28.920 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f686dffb640 10 client.16941 handle_command_reply: tid=0 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 client.16941 shutdown 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 -- 172.21.15.82:0/3904018048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 msgr2=0x55aa64f0edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0edb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6880037040 tx=0x7f68800095c0 comp rx=0 tx=0).stop 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 -- 172.21.15.82:0/3904018048 shutdown_connections 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55aa64f81b80 0x55aa64f83fa0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55aa64f0abf0 0x55aa64f0edb0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f686dffb640 0 client.16941 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55aa64f01e20 0x55aa64f0e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 --2- 172.21.15.82:0/3904018048 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55aa64f01500 0x55aa64f0e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 -- 172.21.15.82:0/3904018048 >> 172.21.15.82:0/3904018048 conn(0x55aa64efbe20 msgr2=0x55aa64efdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 -- 172.21.15.82:0/3904018048 shutdown_connections 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 1 -- 172.21.15.82:0/3904018048 wait complete. 2024-03-27T07:31:28.921 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.917+0000 7f688f5cd740 20 client.16941 trim_cache size 0 max 16384 2024-03-27T07:31:28.922 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:31:28.922 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:31:28.922 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:31:28.922 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:31:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 -- 172.21.15.82:0/2068205575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f68740a3820 msgr2=0x7f68740a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f68740a3820 0x7f68740a5ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6880004af0 tx=0x7f6880005c50 comp rx=0 tx=0).stop 2024-03-27T07:31:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 -- 172.21.15.82:0/2068205575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6888100ca0 msgr2=0x7f68881983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6888100ca0 0x7f68881983b0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f687800b4a0 tx=0x7f687800b960 comp rx=0 tx=0).stop 2024-03-27T07:31:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 -- 172.21.15.82:0/2068205575 shutdown_connections 2024-03-27T07:31:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f68740a3820 0x7f68740a5ce0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f68881059d0 0x7f688819cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6888101640 0x7f68881988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 --2- 172.21.15.82:0/2068205575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6888100ca0 0x7f68881983b0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:28.923 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 -- 172.21.15.82:0/2068205575 >> 172.21.15.82:0/2068205575 conn(0x7f6888077820 msgr2=0x7f68880fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 -- 172.21.15.82:0/2068205575 shutdown_connections 2024-03-27T07:31:28.924 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:28.918+0000 7f688c90d640 1 -- 172.21.15.82:0/2068205575 wait complete. 2024-03-27T07:31:29.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:28 smithi082 ceph-mon[32178]: pgmap v244: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.8 MiB/s wr, 271 op/s 2024-03-27T07:31:29.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:28 smithi149 ceph-mon[36065]: pgmap v244: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.8 MiB/s wr, 271 op/s 2024-03-27T07:31:29.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:28 smithi153 ceph-mon[36179]: pgmap v244: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.8 MiB/s wr, 271 op/s 2024-03-27T07:31:31.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:30 smithi082 ceph-mon[32178]: pgmap v245: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.2 MiB/s wr, 262 op/s 2024-03-27T07:31:31.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:30 smithi149 ceph-mon[36065]: pgmap v245: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.2 MiB/s wr, 262 op/s 2024-03-27T07:31:31.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:30 smithi153 ceph-mon[36179]: pgmap v245: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.2 MiB/s wr, 262 op/s 2024-03-27T07:31:33.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:32 smithi082 ceph-mon[32178]: pgmap v246: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2024-03-27T07:31:33.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:32 smithi149 ceph-mon[36065]: pgmap v246: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2024-03-27T07:31:33.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:32 smithi153 ceph-mon[36179]: pgmap v246: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 4.0 MiB/s wr, 242 op/s 2024-03-27T07:31:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:34 smithi082 ceph-mon[32178]: pgmap v247: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 7.9 MiB/s wr, 439 op/s 2024-03-27T07:31:35.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:34 smithi149 ceph-mon[36065]: pgmap v247: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 7.9 MiB/s wr, 439 op/s 2024-03-27T07:31:35.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:34 smithi153 ceph-mon[36179]: pgmap v247: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 7.9 MiB/s wr, 439 op/s 2024-03-27T07:31:37.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:36 smithi082 ceph-mon[32178]: pgmap v248: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 381 op/s 2024-03-27T07:31:37.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:36 smithi149 ceph-mon[36065]: pgmap v248: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 381 op/s 2024-03-27T07:31:37.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:36 smithi153 ceph-mon[36179]: pgmap v248: 97 pgs: 97 active+clean; 1.7 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 MiB/s rd, 7.3 MiB/s wr, 381 op/s 2024-03-27T07:31:39.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:38 smithi082 ceph-mon[32178]: pgmap v249: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 8.8 MiB/s wr, 497 op/s 2024-03-27T07:31:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:38 smithi149 ceph-mon[36065]: pgmap v249: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 8.8 MiB/s wr, 497 op/s 2024-03-27T07:31:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:38 smithi153 ceph-mon[36179]: pgmap v249: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 8.8 MiB/s wr, 497 op/s 2024-03-27T07:31:41.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:40 smithi082 ceph-mon[32178]: pgmap v250: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 380 op/s 2024-03-27T07:31:41.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:40 smithi149 ceph-mon[36065]: pgmap v250: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 380 op/s 2024-03-27T07:31:41.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:40 smithi153 ceph-mon[36179]: pgmap v250: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 380 op/s 2024-03-27T07:31:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 -- 172.21.15.82:0/3595900752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f01024c0 msgr2=0x7f18f010e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 --2- 172.21.15.82:0/3595900752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f01024c0 0x7f18f010e9d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f18e8009cd0 tx=0x7f18e802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 -- 172.21.15.82:0/3595900752 shutdown_connections 2024-03-27T07:31:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 --2- 172.21.15.82:0/3595900752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f01024c0 0x7f18f010e9d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 --2- 172.21.15.82:0/3595900752 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18f0101b00 0x7f18f0101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 --2- 172.21.15.82:0/3595900752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0107ba0 0x7f18f0107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 -- 172.21.15.82:0/3595900752 >> 172.21.15.82:0/3595900752 conn(0x7f18f00fd610 msgr2=0x7f18f00ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 -- 172.21.15.82:0/3595900752 shutdown_connections 2024-03-27T07:31:42.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 -- 172.21.15.82:0/3595900752 wait complete. 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 Processor -- start 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.018+0000 7f18f865c640 1 -- start start 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f865c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0101b00 0x7f18f0198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f865c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18f01024c0 0x7f18f0198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f865c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0107ba0 0x7f18f019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f865c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18f0111ef0 con 0x7f18f0101b00 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f865c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f18f0111d70 con 0x7f18f01024c0 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f865c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f18f0112070 con 0x7f18f0107ba0 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f63f8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0101b00 0x7f18f0198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f63f8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0101b00 0x7f18f0198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54304/0 (socket says 172.21.15.82:54304) 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f63f8640 1 -- 172.21.15.82:0/2983378639 learned_addr learned my addr 172.21.15.82:0/2983378639 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0107ba0 0x7f18f019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f5bf7640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18f01024c0 0x7f18f0198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f63f8640 1 -- 172.21.15.82:0/2983378639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0107ba0 msgr2=0x7f18f019cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f63f8640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0107ba0 0x7f18f019cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f63f8640 1 -- 172.21.15.82:0/2983378639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18f01024c0 msgr2=0x7f18f0198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f63f8640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18f01024c0 0x7f18f0198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f63f8640 1 -- 172.21.15.82:0/2983378639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f019d2b0 con 0x7f18f0101b00 2024-03-27T07:31:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f63f8640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0101b00 0x7f18f0198310 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00e9f0 tx=0x7f18ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18e77fe640 1 -- 172.21.15.82:0/2983378639 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00cd80 con 0x7f18f0101b00 2024-03-27T07:31:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18e77fe640 1 -- 172.21.15.82:0/2983378639 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18ec010910 con 0x7f18f0101b00 2024-03-27T07:31:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f865c640 1 -- 172.21.15.82:0/2983378639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f019d5a0 con 0x7f18f0101b00 2024-03-27T07:31:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18e77fe640 1 -- 172.21.15.82:0/2983378639 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec018990 con 0x7f18f0101b00 2024-03-27T07:31:42.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.019+0000 7f18f865c640 1 -- 172.21.15.82:0/2983378639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f01a4e30 con 0x7f18f0101b00 2024-03-27T07:31:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.022+0000 7f18e77fe640 1 -- 172.21.15.82:0/2983378639 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f18ec010ac0 con 0x7f18f0101b00 2024-03-27T07:31:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.022+0000 7f18fb247740 1 Processor -- start 2024-03-27T07:31:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18fb247740 1 -- start start 2024-03-27T07:31:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18e77fe640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f18dc0a3820 0x7f18dc0a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18fb247740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613de0f0 0x5590613de4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18fb247740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18fb247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 0x5590613e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18fb247740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5590613a4cd0 con 0x5590613de0f0 2024-03-27T07:31:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18fb247740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5590612e9950 con 0x5590613dea10 2024-03-27T07:31:42.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18fb247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559061341e50 con 0x5590613e77e0 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f18dc0a3820 0x7f18dc0a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18e77fe640 1 -- 172.21.15.82:0/2983378639 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8484+0+0 (secure 0 0 0) 0x7f18ec0d0350 con 0x7f18f0101b00 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f63f8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613de0f0 0x5590613de4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f63f8640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613de0f0 0x5590613de4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54316/0 (socket says 172.21.15.82:54316) 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f63f8640 1 -- 172.21.15.82:0/2119843794 learned_addr learned my addr 172.21.15.82:0/2119843794 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f5bf7640 1 --2- 172.21.15.82:0/2119843794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/2119843794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 0x5590613e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f5bf7640 1 -- 172.21.15.82:0/2119843794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 msgr2=0x5590613e9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f5bf7640 1 --2- 172.21.15.82:0/2119843794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 0x5590613e9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f5bf7640 1 -- 172.21.15.82:0/2119843794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613de0f0 msgr2=0x5590613de4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f5bf7640 1 --2- 172.21.15.82:0/2119843794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613de0f0 0x5590613de4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f5bf7640 1 -- 172.21.15.82:0/2119843794 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559061056210 con 0x5590613dea10 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.023+0000 7f18f63f8640 1 --2- 172.21.15.82:0/2119843794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613de0f0 0x5590613de4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:31:42.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.024+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f18dc0a3820 0x7f18dc0a5ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18e8005cc0 tx=0x7f18e802ce00 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.024+0000 7f18f5bf7640 1 --2- 172.21.15.82:0/2119843794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613e72a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009bf0 tx=0x7f18e0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f21e975ba51c01 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.024+0000 7f18e4bfe640 1 -- 172.21.15.82:0/2119843794 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0004050 con 0x5590613dea10 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.024+0000 7f18e4bfe640 1 -- 172.21.15.82:0/2119843794 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18e00041f0 con 0x5590613dea10 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.024+0000 7f18e4bfe640 1 -- 172.21.15.82:0/2119843794 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0019820 con 0x5590613dea10 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 -- 172.21.15.82:0/2119843794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 msgr2=0x5590613e72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 --2- 172.21.15.82:0/2119843794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613e72a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009bf0 tx=0x7f18e0011810 comp rx=0 tx=0).stop 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 -- 172.21.15.82:0/2119843794 shutdown_connections 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 --2- 172.21.15.82:0/2119843794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 0x5590613e9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 --2- 172.21.15.82:0/2119843794 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613e72a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 --2- 172.21.15.82:0/2119843794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613de0f0 0x5590613de4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 -- 172.21.15.82:0/2119843794 >> 172.21.15.82:0/2119843794 conn(0x5590613d8a10 msgr2=0x5590613d8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:42.034 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 -- 172.21.15.82:0/2119843794 shutdown_connections 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 -- 172.21.15.82:0/2119843794 wait complete. 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 -- start start 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 Processor -- start 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613de0f0 0x5590613e47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613dea10 0x5590613e4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 0x5590613e5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55906133de00 con 0x5590613dea10 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5590612ea520 con 0x5590613de0f0 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.025+0000 7f18fb247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5590612fd8e0 con 0x5590613e77e0 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18fb247740 10 client.0 _ll_register_callbacks cb 0x559061338a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f63f8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613de0f0 0x5590613e47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f5bf7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613dea10 0x5590613e4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.035 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f63f8640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613de0f0 0x5590613e47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:52536/0 (socket says 172.21.15.82:52536) 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f63f8640 1 -- 172.21.15.82:0/3606214291 learned_addr learned my addr 172.21.15.82:0/3606214291 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 0x5590613e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f5bf7640 1 -- 172.21.15.82:0/3606214291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 msgr2=0x5590613e5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f5bf7640 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 0x5590613e5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f5bf7640 1 -- 172.21.15.82:0/3606214291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613de0f0 msgr2=0x5590613e47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f5bf7640 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613de0f0 0x5590613e47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f5bf7640 1 -- 172.21.15.82:0/3606214291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559061122620 con 0x5590613dea10 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 0x5590613e5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f63f8640 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613de0f0 0x5590613e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18f5bf7640 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613dea10 0x5590613e4d10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f18e0000c00 tx=0x7f18e0009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360c9fa01559562 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18d9ffb640 1 -- 172.21.15.82:0/3606214291 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0029020 con 0x5590613dea10 2024-03-27T07:31:42.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18d9ffb640 1 -- 172.21.15.82:0/3606214291 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8484+0+0 (secure 0 0 0) 0x7f18e0005240 con 0x5590613dea10 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18fb247740 1 -- 172.21.15.82:0/3606214291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18e00041f0 con 0x5590613dea10 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18d9ffb640 1 -- 172.21.15.82:0/3606214291 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f18e0034050 con 0x5590613dea10 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18fb247740 10 client.16953 fetch_fsmap learned FSMap version 37 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.026+0000 7f18fb247740 1 -- 172.21.15.82:0/3606214291 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5590613f6320 con 0x5590613dea10 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18d9ffb640 1 -- 172.21.15.82:0/3606214291 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18e00041f0 con 0x5590613dea10 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18d9ffb640 1 -- 172.21.15.82:0/3606214291 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f18e0004c30 con 0x5590613dea10 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18fb247740 10 client.16953 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18fb247740 10 client.16953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18fb247740 20 client.16953 populate_metadata read hostname 'smithi082' 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18fb247740 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5590613f7730 0x5590613f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18fb247740 4 client.16953 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18fb247740 1 -- 172.21.15.82:0/3606214291 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55906134f390 con 0x5590613f7730 2024-03-27T07:31:42.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18f63f8640 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5590613f7730 0x5590613f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18f63f8640 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5590613f7730 0x5590613f9b20 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e19dde3d005f2e32 server_cookie=778fd1c9a7eec547 in_seq=0 out_seq=0 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.027+0000 7f18d9ffb640 10 client.16953 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.028+0000 7f18d9ffb640 1 -- 172.21.15.82:0/3606214291 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55906134f390 con 0x5590613f7730 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.028+0000 7f18d9ffb640 10 client.16953 handle_command_reply: tid=0 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.028+0000 7f18fb247740 1 client.16953 shutdown 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 1 -- 172.21.15.82:0/3606214291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613dea10 msgr2=0x5590613e4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613dea10 0x5590613e4d10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f18e0000c00 tx=0x7f18e0009fd0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 1 -- 172.21.15.82:0/3606214291 shutdown_connections 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5590613f7730 0x5590613f9b20 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613dea10 0x5590613e4d10 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613e77e0 0x5590613e5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 1 --2- 172.21.15.82:0/3606214291 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613de0f0 0x5590613e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 1 -- 172.21.15.82:0/3606214291 >> 172.21.15.82:0/3606214291 conn(0x5590613d8a10 msgr2=0x5590613da760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18d9ffb640 0 client.16953 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 1 -- 172.21.15.82:0/3606214291 shutdown_connections 2024-03-27T07:31:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 1 -- 172.21.15.82:0/3606214291 wait complete. 2024-03-27T07:31:42.039 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.029+0000 7f18fb247740 20 client.16953 trim_cache size 0 max 16384 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18fb247740 1 Processor -- start 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18fb247740 1 -- start start 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18fb247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 0x5590613f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18fb247740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613ff390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18fb247740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613e4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18fb247740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18f01adf30 con 0x5590613e77e0 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18fb247740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f18f01ab740 con 0x5590613dea10 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18fb247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f18f01a95b0 con 0x5590613de0f0 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f6bf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613e4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f6bf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613e4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54328/0 (socket says 172.21.15.82:54328) 2024-03-27T07:31:42.051 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f6bf9640 1 -- 172.21.15.82:0/3745593033 learned_addr learned my addr 172.21.15.82:0/3745593033 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f63f8640 1 --2- 172.21.15.82:0/3745593033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 0x5590613f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f5bf7640 1 --2- 172.21.15.82:0/3745593033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613ff390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f6bf9640 1 -- 172.21.15.82:0/3745593033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 msgr2=0x5590613f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/3745593033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 0x5590613f2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f6bf9640 1 -- 172.21.15.82:0/3745593033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 msgr2=0x5590613ff390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/3745593033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613ff390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f6bf9640 1 -- 172.21.15.82:0/3745593033 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590613d8840 con 0x5590613e77e0 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/3745593033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613e4790 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f18e8036000 tx=0x7f18e8049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c537fc2ba83c81dc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.044+0000 7f18dbfff640 1 -- 172.21.15.82:0/3745593033 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8046040 con 0x5590613e77e0 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18dbfff640 1 -- 172.21.15.82:0/3745593033 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18e8051070 con 0x5590613e77e0 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18dbfff640 1 -- 172.21.15.82:0/3745593033 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e8039040 con 0x5590613e77e0 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 -- 172.21.15.82:0/3745593033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 msgr2=0x5590613e4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:42.052 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 --2- 172.21.15.82:0/3745593033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613e4790 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f18e8036000 tx=0x7f18e8049000 comp rx=0 tx=0).stop 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 -- 172.21.15.82:0/3745593033 shutdown_connections 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 --2- 172.21.15.82:0/3745593033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613e4790 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 --2- 172.21.15.82:0/3745593033 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613ff390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 --2- 172.21.15.82:0/3745593033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 0x5590613f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 -- 172.21.15.82:0/3745593033 >> 172.21.15.82:0/3745593033 conn(0x5590613d8a10 msgr2=0x5590613e30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 -- 172.21.15.82:0/3745593033 shutdown_connections 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 -- 172.21.15.82:0/3745593033 wait complete. 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 -- start start 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.045+0000 7f18fb247740 1 Processor -- start 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18fb247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 0x5590613ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18fb247740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613ef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18fb247740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613eaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18fb247740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18f01a9c00 con 0x5590613e77e0 2024-03-27T07:31:42.053 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18fb247740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f18f01ab070 con 0x5590613dea10 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18fb247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f18f01aa2d0 con 0x5590613de0f0 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18fb247740 10 client.0 _ll_register_callbacks cb 0x7f18ec009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f6bf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613eaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f6bf9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613eaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54342/0 (socket says 172.21.15.82:54342) 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f63f8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 0x5590613ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f6bf9640 1 -- 172.21.15.82:0/953853961 learned_addr learned my addr 172.21.15.82:0/953853961 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f5bf7640 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f6bf9640 1 -- 172.21.15.82:0/953853961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 msgr2=0x5590613ef3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 0x5590613ef3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f6bf9640 1 -- 172.21.15.82:0/953853961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 msgr2=0x5590613ef910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613ef910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f6bf9640 1 -- 172.21.15.82:0/953853961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590613f33f0 con 0x5590613e77e0 2024-03-27T07:31:42.054 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f63f8640 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 0x5590613ef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18f6bf9640 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613eaab0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f18e8005c90 tx=0x7f18e8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4daeef9c792faf05 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18d9ffb640 1 -- 172.21.15.82:0/953853961 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e805a070 con 0x5590613e77e0 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18d9ffb640 1 -- 172.21.15.82:0/953853961 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8484+0+0 (secure 0 0 0) 0x7f18e8004330 con 0x5590613e77e0 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.046+0000 7f18fb247740 1 -- 172.21.15.82:0/953853961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18e8051070 con 0x5590613e77e0 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18d9ffb640 1 -- 172.21.15.82:0/953853961 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f18e8003e40 con 0x5590613e77e0 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18fb247740 10 client.16959 fetch_fsmap learned FSMap version 37 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18fb247740 1 -- 172.21.15.82:0/953853961 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55906145d450 con 0x5590613e77e0 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18d9ffb640 1 -- 172.21.15.82:0/953853961 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18e8051070 con 0x5590613e77e0 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18d9ffb640 1 -- 172.21.15.82:0/953853961 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f18e8056460 con 0x5590613e77e0 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18fb247740 10 client.16959 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18fb247740 10 client.16959 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18fb247740 20 client.16959 populate_metadata read hostname 'smithi082' 2024-03-27T07:31:42.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18fb247740 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55906145dbb0 0x55906145ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18fb247740 4 client.16959 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:31:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18fb247740 1 -- 172.21.15.82:0/953853961 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5590613496e0 con 0x55906145dbb0 2024-03-27T07:31:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.047+0000 7f18f63f8640 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55906145dbb0 0x55906145ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.048+0000 7f18d9ffb640 10 client.16959 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:42.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:42.048+0000 7f18f63f8640 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55906145dbb0 0x55906145ffd0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc70b6a4e60ead4d server_cookie=bd652abf0420e7ac in_seq=0 out_seq=0 2024-03-27T07:31:43.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:42 smithi082 ceph-mon[32178]: pgmap v251: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 358 op/s 2024-03-27T07:31:43.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:42 smithi149 ceph-mon[36065]: pgmap v251: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 358 op/s 2024-03-27T07:31:43.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:42 smithi153 ceph-mon[36179]: pgmap v251: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 5.4 MiB/s wr, 358 op/s 2024-03-27T07:31:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18d9ffb640 1 -- 172.21.15.82:0/953853961 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5590613496e0 con 0x55906145dbb0 2024-03-27T07:31:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18d9ffb640 10 client.16959 handle_command_reply: tid=0 2024-03-27T07:31:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 client.16959 shutdown 2024-03-27T07:31:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 -- 172.21.15.82:0/953853961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 msgr2=0x5590613eaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613eaab0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f18e8005c90 tx=0x7f18e8009c20 comp rx=0 tx=0).stop 2024-03-27T07:31:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 -- 172.21.15.82:0/953853961 shutdown_connections 2024-03-27T07:31:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55906145dbb0 0x55906145ffd0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5590613e77e0 0x5590613eaab0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18d9ffb640 0 client.16959 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5590613dea10 0x5590613ef910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 --2- 172.21.15.82:0/953853961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5590613de0f0 0x5590613ef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 -- 172.21.15.82:0/953853961 >> 172.21.15.82:0/953853961 conn(0x5590613d8a10 msgr2=0x5590613e4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 -- 172.21.15.82:0/953853961 shutdown_connections 2024-03-27T07:31:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.896+0000 7f18fb247740 1 -- 172.21.15.82:0/953853961 wait complete. 2024-03-27T07:31:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.897+0000 7f18fb247740 20 client.16959 trim_cache size 0 max 16384 2024-03-27T07:31:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:31:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:31:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:31:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:31:43.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.897+0000 7f18f865c640 1 -- 172.21.15.82:0/2983378639 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f18dc0a3820 msgr2=0x7f18dc0a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:43.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.897+0000 7f18f865c640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f18dc0a3820 0x7f18dc0a5ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f18e8005cc0 tx=0x7f18e802ce00 comp rx=0 tx=0).stop 2024-03-27T07:31:43.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.897+0000 7f18f865c640 1 -- 172.21.15.82:0/2983378639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0101b00 msgr2=0x7f18f0198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.897+0000 7f18f865c640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0101b00 0x7f18f0198310 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00e9f0 tx=0x7f18ec00eeb0 comp rx=0 tx=0).stop 2024-03-27T07:31:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.898+0000 7f18f865c640 1 -- 172.21.15.82:0/2983378639 shutdown_connections 2024-03-27T07:31:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.898+0000 7f18f865c640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f18dc0a3820 0x7f18dc0a5ce0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.898+0000 7f18f865c640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0107ba0 0x7f18f019cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.898+0000 7f18f865c640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f18f01024c0 0x7f18f0198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.898+0000 7f18f865c640 1 --2- 172.21.15.82:0/2983378639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18f0101b00 0x7f18f0198310 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.898+0000 7f18f865c640 1 -- 172.21.15.82:0/2983378639 >> 172.21.15.82:0/2983378639 conn(0x7f18f00fd610 msgr2=0x7f18f00fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.898+0000 7f18f865c640 1 -- 172.21.15.82:0/2983378639 shutdown_connections 2024-03-27T07:31:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:43.898+0000 7f18f865c640 1 -- 172.21.15.82:0/2983378639 wait complete. 2024-03-27T07:31:45.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:44 smithi153 ceph-mon[36179]: pgmap v252: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 415 op/s 2024-03-27T07:31:45.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:44 smithi082 ceph-mon[32178]: pgmap v252: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 415 op/s 2024-03-27T07:31:45.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:44 smithi149 ceph-mon[36065]: pgmap v252: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 5.8 MiB/s wr, 415 op/s 2024-03-27T07:31:47.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:46 smithi082 ceph-mon[32178]: pgmap v253: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 231 op/s 2024-03-27T07:31:47.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:46 smithi149 ceph-mon[36065]: pgmap v253: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 231 op/s 2024-03-27T07:31:47.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:46 smithi153 ceph-mon[36179]: pgmap v253: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 231 op/s 2024-03-27T07:31:49.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:48 smithi082 ceph-mon[32178]: pgmap v254: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 329 op/s 2024-03-27T07:31:49.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:48 smithi149 ceph-mon[36065]: pgmap v254: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 329 op/s 2024-03-27T07:31:49.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:48 smithi153 ceph-mon[36179]: pgmap v254: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.4 MiB/s wr, 329 op/s 2024-03-27T07:31:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:50 smithi082 ceph-mon[32178]: pgmap v255: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 206 op/s 2024-03-27T07:31:51.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:50 smithi149 ceph-mon[36065]: pgmap v255: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 206 op/s 2024-03-27T07:31:51.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:50 smithi153 ceph-mon[36179]: pgmap v255: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 206 op/s 2024-03-27T07:31:53.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:52 smithi082 ceph-mon[32178]: pgmap v256: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 192 op/s 2024-03-27T07:31:53.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:52 smithi149 ceph-mon[36065]: pgmap v256: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 192 op/s 2024-03-27T07:31:53.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:52 smithi153 ceph-mon[36179]: pgmap v256: 97 pgs: 97 active+clean; 1.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 192 op/s 2024-03-27T07:31:55.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:54 smithi082 ceph-mon[32178]: pgmap v257: 97 pgs: 97 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 255 op/s 2024-03-27T07:31:55.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:54 smithi149 ceph-mon[36065]: pgmap v257: 97 pgs: 97 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 255 op/s 2024-03-27T07:31:55.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:54 smithi153 ceph-mon[36179]: pgmap v257: 97 pgs: 97 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.8 MiB/s wr, 255 op/s 2024-03-27T07:31:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.995+0000 7f5e0ae67640 1 -- 172.21.15.82:0/2138665612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e0406af70 msgr2=0x7f5e041067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.995+0000 7f5e0ae67640 1 --2- 172.21.15.82:0/2138665612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e0406af70 0x7f5e041067e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009900 tx=0x7f5df402bc30 comp rx=0 tx=0).stop 2024-03-27T07:31:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.995+0000 7f5e0ae67640 1 -- 172.21.15.82:0/2138665612 shutdown_connections 2024-03-27T07:31:57.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.995+0000 7f5e0ae67640 1 --2- 172.21.15.82:0/2138665612 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e04106f10 0x7f5e0410ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.995+0000 7f5e0ae67640 1 --2- 172.21.15.82:0/2138665612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e0406af70 0x7f5e041067e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.995+0000 7f5e0ae67640 1 --2- 172.21.15.82:0/2138665612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e0406a5c0 0x7f5e0406a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.995+0000 7f5e0ae67640 1 -- 172.21.15.82:0/2138665612 >> 172.21.15.82:0/2138665612 conn(0x7f5e04077820 msgr2=0x7f5e04077c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.995+0000 7f5e0ae67640 1 -- 172.21.15.82:0/2138665612 shutdown_connections 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.995+0000 7f5e0ae67640 1 -- 172.21.15.82:0/2138665612 wait complete. 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e0ae67640 1 Processor -- start 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e0ae67640 1 -- start start 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e0ae67640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e0406a5c0 0x7f5e04198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e0ae67640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04106f10 0x7f5e04198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e0ae67640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0419cbf0 0x7f5e0419d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e0ae67640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e04111f30 con 0x7f5e04106f10 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e0ae67640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e04111db0 con 0x7f5e0419cbf0 2024-03-27T07:31:57.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e0ae67640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041120b0 con 0x7f5e0406a5c0 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04106f10 0x7f5e04198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04106f10 0x7f5e04198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42844/0 (socket says 172.21.15.82:42844) 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e08c03640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e0406a5c0 0x7f5e04198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5dfbfff640 1 -- 172.21.15.82:0/3244932362 learned_addr learned my addr 172.21.15.82:0/3244932362 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e09404640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0419cbf0 0x7f5e0419d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5dfbfff640 1 -- 172.21.15.82:0/3244932362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e0406a5c0 msgr2=0x7f5e04198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e0406a5c0 0x7f5e04198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5dfbfff640 1 -- 172.21.15.82:0/3244932362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0419cbf0 msgr2=0x7f5e0419d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0419cbf0 0x7f5e0419d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5dfbfff640 1 -- 172.21.15.82:0/3244932362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0419d6e0 con 0x7f5e04106f10 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5e08c03640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e0406a5c0 0x7f5e04198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.996+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04106f10 0x7f5e04198870 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5df4036040 tx=0x7f5df402cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:57.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.997+0000 7f5df9ffb640 1 -- 172.21.15.82:0/3244932362 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4041070 con 0x7f5e04106f10 2024-03-27T07:31:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.997+0000 7f5e0ae67640 1 -- 172.21.15.82:0/3244932362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0419d970 con 0x7f5e04106f10 2024-03-27T07:31:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.997+0000 7f5df9ffb640 1 -- 172.21.15.82:0/3244932362 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5df4004450 con 0x7f5e04106f10 2024-03-27T07:31:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.997+0000 7f5df9ffb640 1 -- 172.21.15.82:0/3244932362 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df4003d90 con 0x7f5e04106f10 2024-03-27T07:31:57.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.997+0000 7f5e0ae67640 1 -- 172.21.15.82:0/3244932362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e041a5190 con 0x7f5e04106f10 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.999+0000 7f5df9ffb640 1 -- 172.21.15.82:0/3244932362 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f5df4044070 con 0x7f5e04106f10 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:56.999+0000 7f5e0da4d740 1 Processor -- start 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e0da4d740 1 -- start start 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e80f0 0x5614703e84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703e8a10 0x5614703f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 0x5614703f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5614703aecd0 con 0x5614703e80f0 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5614702f3950 con 0x5614703e8a10 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56147034be50 con 0x5614703f17e0 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5df9ffb640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5dec0a3820 0x7f5dec0a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e09404640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e80f0 0x5614703e84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.010 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e09404640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e80f0 0x5614703e84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42858/0 (socket says 172.21.15.82:42858) 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e09404640 1 -- 172.21.15.82:0/1082910167 learned_addr learned my addr 172.21.15.82:0/1082910167 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e08c03640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703e8a10 0x5614703f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/1082910167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 0x5614703f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e09404640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5dec0a3820 0x7f5dec0a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5df9ffb640 1 -- 172.21.15.82:0/3244932362 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8484+0+0 (secure 0 0 0) 0x7f5df40f1a60 con 0x7f5e04106f10 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e09404640 1 -- 172.21.15.82:0/1082910167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 msgr2=0x5614703f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e09404640 1 --2- 172.21.15.82:0/1082910167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 0x5614703f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e09404640 1 -- 172.21.15.82:0/1082910167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703e8a10 msgr2=0x5614703f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e09404640 1 --2- 172.21.15.82:0/1082910167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703e8a10 0x5614703f12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e09404640 1 -- 172.21.15.82:0/1082910167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561470060210 con 0x5614703e80f0 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/1082910167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 0x5614703f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.000+0000 7f5e09404640 1 --2- 172.21.15.82:0/1082910167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e80f0 0x5614703e84d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc011e20 tx=0x7f5dfc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933b0949c4d5384 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:57.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5e09404640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5dec0a3820 0x7f5dec0a5ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00fc90 tx=0x7f5dfc01e000 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5deaffd640 1 -- 172.21.15.82:0/1082910167 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc01dcb0 con 0x5614703e80f0 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5deaffd640 1 -- 172.21.15.82:0/1082910167 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dfc01de50 con 0x5614703e80f0 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5deaffd640 1 -- 172.21.15.82:0/1082910167 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc004220 con 0x5614703e80f0 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5e0da4d740 1 -- 172.21.15.82:0/1082910167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e80f0 msgr2=0x5614703e84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/1082910167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e80f0 0x5614703e84d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc011e20 tx=0x7f5dfc00f790 comp rx=0 tx=0).stop 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5e0da4d740 1 -- 172.21.15.82:0/1082910167 shutdown_connections 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/1082910167 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 0x5614703f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/1082910167 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703e8a10 0x5614703f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/1082910167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e80f0 0x5614703e84d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5e0da4d740 1 -- 172.21.15.82:0/1082910167 >> 172.21.15.82:0/1082910167 conn(0x5614703e2a10 msgr2=0x5614703e2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5e0da4d740 1 -- 172.21.15.82:0/1082910167 shutdown_connections 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.001+0000 7f5e0da4d740 1 -- 172.21.15.82:0/1082910167 wait complete. 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e0da4d740 1 -- start start 2024-03-27T07:31:57.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e0da4d740 1 Processor -- start 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703e80f0 0x5614703ee8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703eede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 0x5614703ef320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561470347e00 con 0x5614703e8a10 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5614702f4520 con 0x5614703e80f0 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5614703078e0 con 0x5614703f17e0 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e0da4d740 10 client.0 _ll_register_callbacks cb 0x561470342a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703eede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703eede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42872/0 (socket says 172.21.15.82:42872) 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e08c03640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703e80f0 0x5614703ee8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5dfbfff640 1 -- 172.21.15.82:0/4055967228 learned_addr learned my addr 172.21.15.82:0/4055967228 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.002+0000 7f5e09404640 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 0x5614703ef320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5dfbfff640 1 -- 172.21.15.82:0/4055967228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 msgr2=0x5614703ef320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:57.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 0x5614703ef320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5dfbfff640 1 -- 172.21.15.82:0/4055967228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703e80f0 msgr2=0x5614703ee8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703e80f0 0x5614703ee8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5dfbfff640 1 -- 172.21.15.82:0/4055967228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56147012c620 con 0x5614703e8a10 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703eede0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5df402c820 tx=0x7f5df404d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdd29cb1a5350b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5de3fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5de3fff640 1 -- 172.21.15.82:0/4055967228 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df404b030 con 0x5614703e8a10 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5de3fff640 1 -- 172.21.15.82:0/4055967228 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8484+0+0 (secure 0 0 0) 0x7f5df40ba440 con 0x5614703e8a10 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5e0da4d740 1 -- 172.21.15.82:0/4055967228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dfc01de50 con 0x5614703e8a10 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5de3fff640 1 -- 172.21.15.82:0/4055967228 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5df40bd910 con 0x5614703e8a10 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5e0da4d740 10 client.16971 fetch_fsmap learned FSMap version 37 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5e0da4d740 1 -- 172.21.15.82:0/4055967228 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x561470400340 con 0x5614703e8a10 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5de3fff640 1 -- 172.21.15.82:0/4055967228 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dfc01de50 con 0x5614703e8a10 2024-03-27T07:31:57.014 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5de3fff640 1 -- 172.21.15.82:0/4055967228 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f5df40ef450 con 0x5614703e8a10 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5e0da4d740 10 client.16971 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5e0da4d740 10 client.16971 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5e0da4d740 20 client.16971 populate_metadata read hostname 'smithi082' 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5614704017a0 0x561470403c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5e0da4d740 4 client.16971 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.003+0000 7f5e0da4d740 1 -- 172.21.15.82:0/4055967228 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561470359390 con 0x5614704017a0 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.004+0000 7f5e08c03640 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5614704017a0 0x561470403c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.004+0000 7f5de3fff640 10 client.16971 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.004+0000 7f5e08c03640 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5614704017a0 0x561470403c10 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e1a8af648f54e2 server_cookie=5f2b6afcba4dcc5a in_seq=0 out_seq=0 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5de3fff640 1 -- 172.21.15.82:0/4055967228 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561470359390 con 0x5614704017a0 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5de3fff640 10 client.16971 handle_command_reply: tid=0 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 client.16971 shutdown 2024-03-27T07:31:57.015 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 -- 172.21.15.82:0/4055967228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 msgr2=0x5614703eede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703eede0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5df402c820 tx=0x7f5df404d000 comp rx=0 tx=0).stop 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 -- 172.21.15.82:0/4055967228 shutdown_connections 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5614704017a0 0x561470403c10 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703eede0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703f17e0 0x5614703ef320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/4055967228 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703e80f0 0x5614703ee8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5de3fff640 0 client.16971 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 -- 172.21.15.82:0/4055967228 >> 172.21.15.82:0/4055967228 conn(0x5614703e2a10 msgr2=0x5614703e4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 -- 172.21.15.82:0/4055967228 shutdown_connections 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 1 -- 172.21.15.82:0/4055967228 wait complete. 2024-03-27T07:31:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.005+0000 7f5e0da4d740 20 client.16971 trim_cache size 0 max 16384 2024-03-27T07:31:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.019+0000 7f5e0da4d740 1 Processor -- start 2024-03-27T07:31:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.019+0000 7f5e0da4d740 1 -- start start 2024-03-27T07:31:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.019+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703e80f0 0x5614703f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.019+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703fcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.019+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703f17e0 0x5614703e4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041affd0 con 0x5614703e8a10 2024-03-27T07:31:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041ad7e0 con 0x5614703f17e0 2024-03-27T07:31:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041ab650 con 0x5614703e80f0 2024-03-27T07:31:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703fcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703fcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42888/0 (socket says 172.21.15.82:42888) 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5e09404640 1 --2- 172.21.15.82:0/3895056999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703f17e0 0x5614703e4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5e08c03640 1 --2- 172.21.15.82:0/3895056999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703e80f0 0x5614703f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dfbfff640 1 -- 172.21.15.82:0/3895056999 learned_addr learned my addr 172.21.15.82:0/3895056999 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dfbfff640 1 -- 172.21.15.82:0/3895056999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703e80f0 msgr2=0x5614703f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/3895056999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703e80f0 0x5614703f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dfbfff640 1 -- 172.21.15.82:0/3895056999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703f17e0 msgr2=0x5614703e4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/3895056999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703f17e0 0x5614703e4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dfbfff640 1 -- 172.21.15.82:0/3895056999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561470404240 con 0x5614703e8a10 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/3895056999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703fcdf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5df404c000 tx=0x7f5df4004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af931a0d06dcf00b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dea7fc640 1 -- 172.21.15.82:0/3895056999 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df404b040 con 0x5614703e8a10 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dea7fc640 1 -- 172.21.15.82:0/3895056999 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5df40c20d0 con 0x5614703e8a10 2024-03-27T07:31:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.020+0000 7f5dea7fc640 1 -- 172.21.15.82:0/3895056999 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df40c3260 con 0x5614703e8a10 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 -- 172.21.15.82:0/3895056999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 msgr2=0x5614703fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/3895056999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703fcdf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5df404c000 tx=0x7f5df4004ee0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 -- 172.21.15.82:0/3895056999 shutdown_connections 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/3895056999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703fcdf0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/3895056999 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703f17e0 0x5614703e4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/3895056999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703e80f0 0x5614703f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 -- 172.21.15.82:0/3895056999 >> 172.21.15.82:0/3895056999 conn(0x5614703e2a10 msgr2=0x5614703e3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 -- 172.21.15.82:0/3895056999 shutdown_connections 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 -- 172.21.15.82:0/3895056999 wait complete. 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 -- start start 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 Processor -- start 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.021+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703e80f0 0x5614703ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703ec020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e0da4d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703f17e0 0x56147046af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041abca0 con 0x5614703e8a10 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041ad110 con 0x5614703f17e0 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e0da4d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041ac370 con 0x5614703e80f0 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e0da4d740 10 client.0 _ll_register_callbacks cb 0x7f5df4007f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703ec020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5dfbfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703ec020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42902/0 (socket says 172.21.15.82:42902) 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5dfbfff640 1 -- 172.21.15.82:0/850164248 learned_addr learned my addr 172.21.15.82:0/850164248 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e08c03640 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703e80f0 0x5614703ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e09404640 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703f17e0 0x56147046af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5dfbfff640 1 -- 172.21.15.82:0/850164248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703e80f0 msgr2=0x5614703ebae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703e80f0 0x5614703ebae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5dfbfff640 1 -- 172.21.15.82:0/850164248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703f17e0 msgr2=0x56147046af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703f17e0 0x56147046af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5dfbfff640 1 -- 172.21.15.82:0/850164248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614703e9690 con 0x5614703e8a10 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5dfbfff640 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703ec020 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5df40bdd60 tx=0x7f5df4005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf66bf3a27c32a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5de3fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5de3fff640 1 -- 172.21.15.82:0/850164248 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df40d6030 con 0x5614703e8a10 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5de3fff640 1 -- 172.21.15.82:0/850164248 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8484+0+0 (secure 0 0 0) 0x7f5df40ef3c0 con 0x5614703e8a10 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e0da4d740 1 -- 172.21.15.82:0/850164248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5df40c20d0 con 0x5614703e8a10 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5de3fff640 1 -- 172.21.15.82:0/850164248 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5df404b070 con 0x5614703e8a10 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e0da4d740 10 client.16977 fetch_fsmap learned FSMap version 37 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.022+0000 7f5e0da4d740 1 -- 172.21.15.82:0/850164248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5614703e9690 con 0x5614703e8a10 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5de3fff640 1 -- 172.21.15.82:0/850164248 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5df40c20d0 con 0x5614703e8a10 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5de3fff640 1 -- 172.21.15.82:0/850164248 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f5df40c6be0 con 0x5614703e8a10 2024-03-27T07:31:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5e0da4d740 10 client.16977 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:31:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5e0da4d740 10 client.16977 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:31:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5e0da4d740 20 client.16977 populate_metadata read hostname 'smithi082' 2024-03-27T07:31:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56147046c740 0x56147046eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:31:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5e0da4d740 4 client.16977 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:31:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5e0da4d740 1 -- 172.21.15.82:0/850164248 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5614703536e0 con 0x56147046c740 2024-03-27T07:31:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5e08c03640 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56147046c740 0x56147046eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:31:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5de3fff640 10 client.16977 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:57.023+0000 7f5e08c03640 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56147046c740 0x56147046eb60 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f94b87f9b66e0e1e server_cookie=bbe326f80c9cf99a in_seq=0 out_seq=0 2024-03-27T07:31:57.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:56 smithi082 ceph-mon[32178]: pgmap v258: 97 pgs: 97 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 206 op/s 2024-03-27T07:31:57.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:56 smithi149 ceph-mon[36065]: pgmap v258: 97 pgs: 97 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 206 op/s 2024-03-27T07:31:57.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:56 smithi153 ceph-mon[36179]: pgmap v258: 97 pgs: 97 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 206 op/s 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5de3fff640 1 -- 172.21.15.82:0/850164248 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5614703536e0 con 0x56147046c740 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5de3fff640 10 client.16977 handle_command_reply: tid=0 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 client.16977 shutdown 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 -- 172.21.15.82:0/850164248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 msgr2=0x5614703ec020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703ec020 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5df40bdd60 tx=0x7f5df4005b70 comp rx=0 tx=0).stop 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 -- 172.21.15.82:0/850164248 shutdown_connections 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56147046c740 0x56147046eb60 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5614703e8a10 0x5614703ec020 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5de3fff640 0 client.16977 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5614703f17e0 0x56147046af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:59.074 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 --2- 172.21.15.82:0/850164248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5614703e80f0 0x5614703ebae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 -- 172.21.15.82:0/850164248 >> 172.21.15.82:0/850164248 conn(0x5614703e2a10 msgr2=0x5614703ef0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 -- 172.21.15.82:0/850164248 shutdown_connections 2024-03-27T07:31:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 1 -- 172.21.15.82:0/850164248 wait complete. 2024-03-27T07:31:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.070+0000 7f5e0da4d740 20 client.16977 trim_cache size 0 max 16384 2024-03-27T07:31:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:31:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:31:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:31:59.075 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:31:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 -- 172.21.15.82:0/3244932362 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5dec0a3820 msgr2=0x7f5dec0a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5dec0a3820 0x7f5dec0a5ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00fc90 tx=0x7f5dfc01e000 comp rx=0 tx=0).stop 2024-03-27T07:31:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 -- 172.21.15.82:0/3244932362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04106f10 msgr2=0x7f5e04198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:31:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04106f10 0x7f5e04198870 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5df4036040 tx=0x7f5df402cb20 comp rx=0 tx=0).stop 2024-03-27T07:31:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 -- 172.21.15.82:0/3244932362 shutdown_connections 2024-03-27T07:31:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5dec0a3820 0x7f5dec0a5ce0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5e04106f10 0x7f5e04198870 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:59.076 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5e0419cbf0 0x7f5e0419d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 --2- 172.21.15.82:0/3244932362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5e0406a5c0 0x7f5e04198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:31:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 -- 172.21.15.82:0/3244932362 >> 172.21.15.82:0/3244932362 conn(0x7f5e04077820 msgr2=0x7f5e040fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:31:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 -- 172.21.15.82:0/3244932362 shutdown_connections 2024-03-27T07:31:59.077 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:31:59.071+0000 7f5e0ae67640 1 -- 172.21.15.82:0/3244932362 wait complete. 2024-03-27T07:31:59.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:58 smithi082 ceph-mon[32178]: pgmap v259: 97 pgs: 97 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 262 op/s 2024-03-27T07:31:59.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:58 smithi149 ceph-mon[36065]: pgmap v259: 97 pgs: 97 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 262 op/s 2024-03-27T07:31:59.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:58 smithi153 ceph-mon[36179]: pgmap v259: 97 pgs: 97 active+clean; 1.8 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 262 op/s 2024-03-27T07:32:00.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:31:59 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:32:00.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:31:59 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:32:00.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:31:59 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:32:01.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:00 smithi082 ceph-mon[32178]: pgmap v260: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 231 op/s 2024-03-27T07:32:01.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:00 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:32:01.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:00 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:32:01.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:00 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:32:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:00 smithi149 ceph-mon[36065]: pgmap v260: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 231 op/s 2024-03-27T07:32:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:00 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:32:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:00 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:32:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:00 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:32:01.294 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:00 smithi153 ceph-mon[36179]: pgmap v260: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 231 op/s 2024-03-27T07:32:01.294 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:00 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:32:01.294 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:00 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:32:01.294 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:00 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:32:02.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:01 smithi082 ceph-mon[32178]: pgmap v261: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 226 op/s 2024-03-27T07:32:02.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:01 smithi149 ceph-mon[36065]: pgmap v261: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 226 op/s 2024-03-27T07:32:02.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:01 smithi153 ceph-mon[36179]: pgmap v261: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 226 op/s 2024-03-27T07:32:04.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:04 smithi082 ceph-mon[32178]: pgmap v262: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 846 op/s 2024-03-27T07:32:04.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:04 smithi149 ceph-mon[36065]: pgmap v262: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 846 op/s 2024-03-27T07:32:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:04 smithi153 ceph-mon[36179]: pgmap v262: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 846 op/s 2024-03-27T07:32:06.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:06 smithi082 ceph-mon[32178]: pgmap v263: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 790 op/s 2024-03-27T07:32:06.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:06 smithi149 ceph-mon[36065]: pgmap v263: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 790 op/s 2024-03-27T07:32:06.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:06 smithi153 ceph-mon[36179]: pgmap v263: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 790 op/s 2024-03-27T07:32:08.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:08 smithi082 ceph-mon[32178]: pgmap v264: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 839 op/s 2024-03-27T07:32:08.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:08 smithi149 ceph-mon[36065]: pgmap v264: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 839 op/s 2024-03-27T07:32:08.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:08 smithi153 ceph-mon[36179]: pgmap v264: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.3 MiB/s wr, 839 op/s 2024-03-27T07:32:10.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:10 smithi082 ceph-mon[32178]: pgmap v265: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 776 op/s 2024-03-27T07:32:10.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:10 smithi082 ceph-mon[32178]: osdmap e95: 12 total, 12 up, 12 in 2024-03-27T07:32:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:10 smithi149 ceph-mon[36065]: pgmap v265: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 776 op/s 2024-03-27T07:32:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:10 smithi149 ceph-mon[36065]: osdmap e95: 12 total, 12 up, 12 in 2024-03-27T07:32:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:10 smithi153 ceph-mon[36179]: pgmap v265: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.0 MiB/s wr, 776 op/s 2024-03-27T07:32:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:10 smithi153 ceph-mon[36179]: osdmap e95: 12 total, 12 up, 12 in 2024-03-27T07:32:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.206+0000 7f3e150ed640 1 -- 172.21.15.82:0/4167425821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1010c280 msgr2=0x7f3e10108b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.206+0000 7f3e150ed640 1 --2- 172.21.15.82:0/4167425821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1010c280 0x7f3e10108b50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009ca0 tx=0x7f3e0802c1a0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.207+0000 7f3e150ed640 1 -- 172.21.15.82:0/4167425821 shutdown_connections 2024-03-27T07:32:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.207+0000 7f3e150ed640 1 --2- 172.21.15.82:0/4167425821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e10109090 0x7f3e10109510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.208+0000 7f3e150ed640 1 --2- 172.21.15.82:0/4167425821 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e10116be0 0x7f3e10118fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.211 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.208+0000 7f3e150ed640 1 --2- 172.21.15.82:0/4167425821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1010c280 0x7f3e10108b50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.208+0000 7f3e150ed640 1 -- 172.21.15.82:0/4167425821 >> 172.21.15.82:0/4167425821 conn(0x7f3e1006d080 msgr2=0x7f3e1006d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.208+0000 7f3e150ed640 1 -- 172.21.15.82:0/4167425821 shutdown_connections 2024-03-27T07:32:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.208+0000 7f3e150ed640 1 -- 172.21.15.82:0/4167425821 wait complete. 2024-03-27T07:32:12.213 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.210+0000 7f3e150ed640 1 Processor -- start 2024-03-27T07:32:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.210+0000 7f3e150ed640 1 -- start start 2024-03-27T07:32:12.215 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e150ed640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e10109090 0x7f3e101a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e150ed640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1010c280 0x7f3e101a3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e150ed640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e10116be0 0x7f3e101a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e0ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e10109090 0x7f3e101a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e150ed640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1011c9e0 con 0x7f3e10109090 2024-03-27T07:32:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e0ed9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e10109090 0x7f3e101a2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51764/0 (socket says 172.21.15.82:51764) 2024-03-27T07:32:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e150ed640 1 -- 172.21.15.82:0/1908999846 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1011c860 con 0x7f3e10116be0 2024-03-27T07:32:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/1908999846 learned_addr learned my addr 172.21.15.82:0/1908999846 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e150ed640 1 -- 172.21.15.82:0/1908999846 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1011cb60 con 0x7f3e1010c280 2024-03-27T07:32:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e0e59c640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1010c280 0x7f3e101a3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.211+0000 7f3e0f59e640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e10116be0 0x7f3e101a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/1908999846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1010c280 msgr2=0x7f3e101a3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1010c280 0x7f3e101a3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/1908999846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e10116be0 msgr2=0x7f3e101a7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e10116be0 0x7f3e101a7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/1908999846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e101a7e30 con 0x7f3e10109090 2024-03-27T07:32:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3e0f59e640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e10116be0 0x7f3e101a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:32:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e10109090 0x7f3e101a2e40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3e080348f0 tx=0x7f3e08003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3df7fff640 1 -- 172.21.15.82:0/1908999846 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08039040 con 0x7f3e10109090 2024-03-27T07:32:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3e150ed640 1 -- 172.21.15.82:0/1908999846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e101a80c0 con 0x7f3e10109090 2024-03-27T07:32:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3df7fff640 1 -- 172.21.15.82:0/1908999846 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e08044070 con 0x7f3e10109090 2024-03-27T07:32:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3df7fff640 1 -- 172.21.15.82:0/1908999846 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08032bd0 con 0x7f3e10109090 2024-03-27T07:32:12.219 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.212+0000 7f3e150ed640 1 -- 172.21.15.82:0/1908999846 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e101af9b0 con 0x7f3e10109090 2024-03-27T07:32:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.215+0000 7f3df7fff640 1 -- 172.21.15.82:0/1908999846 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f3e08004240 con 0x7f3e10109090 2024-03-27T07:32:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.215+0000 7f3e17db2740 1 Processor -- start 2024-03-27T07:32:12.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.216+0000 7f3e17db2740 1 -- start start 2024-03-27T07:32:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d970f0 0x559888d974d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d97a10 0x559888da02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888da07e0 0x559888da2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3df7fff640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3df80a38a0 0x7f3df80a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3e17db2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559888d5dcd0 con 0x559888d970f0 2024-03-27T07:32:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3e17db2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x559888ca2950 con 0x559888da07e0 2024-03-27T07:32:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3e17db2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559888cfae50 con 0x559888d97a10 2024-03-27T07:32:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3e0f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d970f0 0x559888d974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3df7fff640 1 -- 172.21.15.82:0/1908999846 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8528+0+0 (secure 0 0 0) 0x7f3e080f29c0 con 0x7f3e10109090 2024-03-27T07:32:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3e0f59e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d970f0 0x559888d974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51766/0 (socket says 172.21.15.82:51766) 2024-03-27T07:32:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.217+0000 7f3e0f59e640 1 -- 172.21.15.82:0/4088030823 learned_addr learned my addr 172.21.15.82:0/4088030823 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.218+0000 7f3e0e59c640 1 --2- 172.21.15.82:0/4088030823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888da07e0 0x559888da2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.218+0000 7f3e0f59e640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3df80a38a0 0x7f3df80a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.218+0000 7f3e0f59e640 1 -- 172.21.15.82:0/4088030823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d97a10 msgr2=0x559888da02a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:32:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.218+0000 7f3e0f59e640 1 --2- 172.21.15.82:0/4088030823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d97a10 0x559888da02a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.218+0000 7f3e0f59e640 1 -- 172.21.15.82:0/4088030823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888da07e0 msgr2=0x559888da2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.218+0000 7f3e0f59e640 1 --2- 172.21.15.82:0/4088030823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888da07e0 0x559888da2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.218+0000 7f3e0f59e640 1 -- 172.21.15.82:0/4088030823 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559888a0f210 con 0x559888d970f0 2024-03-27T07:32:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.218+0000 7f3e0f59e640 1 --2- 172.21.15.82:0/4088030823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d970f0 0x559888d974d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000af80 tx=0x7f3e00014780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de7d93ce930bb9d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.219+0000 7f3e0f59e640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3df80a38a0 0x7f3df80a5d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e0001e000 tx=0x7f3e0001b000 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.220+0000 7f3df57fa640 1 -- 172.21.15.82:0/4088030823 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e000163d0 con 0x559888d970f0 2024-03-27T07:32:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.220+0000 7f3df57fa640 1 -- 172.21.15.82:0/4088030823 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e00016a50 con 0x559888d970f0 2024-03-27T07:32:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.220+0000 7f3df57fa640 1 -- 172.21.15.82:0/4088030823 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00015640 con 0x559888d970f0 2024-03-27T07:32:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.221+0000 7f3e17db2740 1 -- 172.21.15.82:0/4088030823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d970f0 msgr2=0x559888d974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.221+0000 7f3e17db2740 1 --2- 172.21.15.82:0/4088030823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d970f0 0x559888d974d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000af80 tx=0x7f3e00014780 comp rx=0 tx=0).stop 2024-03-27T07:32:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.222+0000 7f3e17db2740 1 -- 172.21.15.82:0/4088030823 shutdown_connections 2024-03-27T07:32:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.222+0000 7f3e17db2740 1 --2- 172.21.15.82:0/4088030823 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888da07e0 0x559888da2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.222+0000 7f3e17db2740 1 --2- 172.21.15.82:0/4088030823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d97a10 0x559888da02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.222+0000 7f3e17db2740 1 --2- 172.21.15.82:0/4088030823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d970f0 0x559888d974d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.226 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.222+0000 7f3e17db2740 1 -- 172.21.15.82:0/4088030823 >> 172.21.15.82:0/4088030823 conn(0x559888d91a10 msgr2=0x559888d91df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.223+0000 7f3e17db2740 1 -- 172.21.15.82:0/4088030823 shutdown_connections 2024-03-27T07:32:12.227 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.224+0000 7f3e17db2740 1 -- 172.21.15.82:0/4088030823 wait complete. 2024-03-27T07:32:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.224+0000 7f3e17db2740 1 -- start start 2024-03-27T07:32:12.228 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.225+0000 7f3e17db2740 1 Processor -- start 2024-03-27T07:32:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.227+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 0x559888da8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.227+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d97a10 0x559888da8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.227+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 0x559888da9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.227+0000 7f3e17db2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559888cf6e00 con 0x559888d97a10 2024-03-27T07:32:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.227+0000 7f3e17db2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x559888ca3520 con 0x559888d970f0 2024-03-27T07:32:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.227+0000 7f3e17db2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x559888cb68e0 con 0x559888da07e0 2024-03-27T07:32:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.227+0000 7f3e17db2740 10 client.0 _ll_register_callbacks cb 0x559888cf1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:32:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.228+0000 7f3e0f59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 0x559888da9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.228+0000 7f3e0f59e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 0x559888da9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:55014/0 (socket says 172.21.15.82:55014) 2024-03-27T07:32:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.228+0000 7f3e0f59e640 1 -- 172.21.15.82:0/2290198320 learned_addr learned my addr 172.21.15.82:0/2290198320 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.228+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 0x559888da8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.229+0000 7f3e0e59c640 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d97a10 0x559888da8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.231+0000 7f3e0e59c640 1 -- 172.21.15.82:0/2290198320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 msgr2=0x559888da9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.231+0000 7f3e0e59c640 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 0x559888da9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.231+0000 7f3e0e59c640 1 -- 172.21.15.82:0/2290198320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 msgr2=0x559888da8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.231+0000 7f3e0e59c640 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 0x559888da8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.231+0000 7f3e0e59c640 1 -- 172.21.15.82:0/2290198320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559888adb620 con 0x559888d97a10 2024-03-27T07:32:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.231+0000 7f3e0e59c640 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d97a10 0x559888da8fd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x559888d92ba0 tx=0x7f3e04022760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260f41aecf05f247 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.232+0000 7f3df2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:32:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.232+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2290198320 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04025660 con 0x559888d97a10 2024-03-27T07:32:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.232+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2290198320 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8528+0+0 (secure 0 0 0) 0x7f3e04025800 con 0x559888d97a10 2024-03-27T07:32:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.233+0000 7f3e17db2740 1 -- 172.21.15.82:0/2290198320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e00016a50 con 0x559888d97a10 2024-03-27T07:32:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.235+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2290198320 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3e04025a00 con 0x559888d97a10 2024-03-27T07:32:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.235+0000 7f3e17db2740 10 client.16986 fetch_fsmap learned FSMap version 37 2024-03-27T07:32:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.235+0000 7f3e17db2740 1 -- 172.21.15.82:0/2290198320 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559888daf4d0 con 0x559888d97a10 2024-03-27T07:32:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.236+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2290198320 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e00016a50 con 0x559888d97a10 2024-03-27T07:32:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.236+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2290198320 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f3e0402e400 con 0x559888d97a10 2024-03-27T07:32:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.237+0000 7f3e17db2740 10 client.16986 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:32:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.237+0000 7f3e17db2740 10 client.16986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:32:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.237+0000 7f3e17db2740 20 client.16986 populate_metadata read hostname 'smithi082' 2024-03-27T07:32:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.237+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559888db0940 0x559888db2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.237+0000 7f3e17db2740 4 client.16986 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:32:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.237+0000 7f3e17db2740 1 -- 172.21.15.82:0/2290198320 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559888d08390 con 0x559888db0940 2024-03-27T07:32:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.238+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559888db0940 0x559888db2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.239+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559888db0940 0x559888db2d50 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45996bc6a08108de server_cookie=dd95553377c72d9 in_seq=0 out_seq=0 2024-03-27T07:32:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.239+0000 7f3df2ff5640 10 client.16986 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.240+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2290198320 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x559888d08390 con 0x559888db0940 2024-03-27T07:32:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.240+0000 7f3df2ff5640 10 client.16986 handle_command_reply: tid=0 2024-03-27T07:32:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.242+0000 7f3e17db2740 1 client.16986 shutdown 2024-03-27T07:32:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.242+0000 7f3e17db2740 1 -- 172.21.15.82:0/2290198320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d97a10 msgr2=0x559888da8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.242+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d97a10 0x559888da8fd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x559888d92ba0 tx=0x7f3e04022760 comp rx=0 tx=0).stop 2024-03-27T07:32:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.242+0000 7f3e17db2740 1 -- 172.21.15.82:0/2290198320 shutdown_connections 2024-03-27T07:32:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.242+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559888db0940 0x559888db2d50 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.242+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888d97a10 0x559888da8fd0 secure :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0x559888d92ba0 tx=0x7f3e04022760 comp rx=0 tx=0).stop 2024-03-27T07:32:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.242+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 0x559888da9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.242+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2290198320 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 0x559888da8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.242+0000 7f3e17db2740 1 -- 172.21.15.82:0/2290198320 >> 172.21.15.82:0/2290198320 conn(0x559888d91a10 msgr2=0x559888d93760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.242+0000 7f3df2ff5640 0 client.16986 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.243+0000 7f3e17db2740 1 -- 172.21.15.82:0/2290198320 shutdown_connections 2024-03-27T07:32:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.243+0000 7f3e17db2740 1 -- 172.21.15.82:0/2290198320 wait complete. 2024-03-27T07:32:12.247 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.243+0000 7f3e17db2740 20 client.16986 trim_cache size 0 max 16384 2024-03-27T07:32:12.274 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.271+0000 7f3e17db2740 1 Processor -- start 2024-03-27T07:32:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.272+0000 7f3e17db2740 1 -- start start 2024-03-27T07:32:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.272+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 0x559888dab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.272+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 0x559888db8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.275 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.272+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888db8b60 0x559888da5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e0e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 0x559888db8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e0e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 0x559888db8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:55020/0 (socket says 172.21.15.82:55020) 2024-03-27T07:32:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e0e59c640 1 -- 172.21.15.82:0/736630776 learned_addr learned my addr 172.21.15.82:0/736630776 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e17db2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101b67d0 con 0x559888db8b60 2024-03-27T07:32:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e17db2740 1 -- 172.21.15.82:0/736630776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101b3fe0 con 0x559888d970f0 2024-03-27T07:32:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e17db2740 1 -- 172.21.15.82:0/736630776 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101b1e50 con 0x559888da07e0 2024-03-27T07:32:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/736630776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 0x559888dab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/736630776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 msgr2=0x559888db8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/736630776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 0x559888db8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/736630776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888db8b60 msgr2=0x559888da5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/736630776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888db8b60 0x559888da5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.273+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/736630776 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559888d96a20 con 0x559888d970f0 2024-03-27T07:32:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.274+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/736630776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 0x559888dab1c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3e080f01b0 tx=0x7f3e0802e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9953b5ea284d04c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.274+0000 7f3df4ff9640 1 -- 172.21.15.82:0/736630776 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08003e40 con 0x559888d970f0 2024-03-27T07:32:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.274+0000 7f3df4ff9640 1 -- 172.21.15.82:0/736630776 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e080bf320 con 0x559888d970f0 2024-03-27T07:32:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.274+0000 7f3df4ff9640 1 -- 172.21.15.82:0/736630776 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e08032e90 con 0x559888d970f0 2024-03-27T07:32:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.275+0000 7f3e17db2740 1 -- 172.21.15.82:0/736630776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 msgr2=0x559888dab1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.275+0000 7f3e17db2740 1 --2- 172.21.15.82:0/736630776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 0x559888dab1c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3e080f01b0 tx=0x7f3e0802e040 comp rx=0 tx=0).stop 2024-03-27T07:32:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.276+0000 7f3e17db2740 1 -- 172.21.15.82:0/736630776 shutdown_connections 2024-03-27T07:32:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.276+0000 7f3e17db2740 1 --2- 172.21.15.82:0/736630776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888db8b60 0x559888da5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.276+0000 7f3e17db2740 1 --2- 172.21.15.82:0/736630776 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888da07e0 0x559888db8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.276+0000 7f3e17db2740 1 --2- 172.21.15.82:0/736630776 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888d970f0 0x559888dab1c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.276+0000 7f3e17db2740 1 -- 172.21.15.82:0/736630776 >> 172.21.15.82:0/736630776 conn(0x559888d91a10 msgr2=0x559888d936f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.277+0000 7f3e17db2740 1 -- 172.21.15.82:0/736630776 shutdown_connections 2024-03-27T07:32:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.278+0000 7f3e17db2740 1 -- 172.21.15.82:0/736630776 wait complete. 2024-03-27T07:32:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.278+0000 7f3e17db2740 1 -- start start 2024-03-27T07:32:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.278+0000 7f3e17db2740 1 Processor -- start 2024-03-27T07:32:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.280+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d970f0 0x559888e0ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.280+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888da07e0 0x559888e104a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.280+0000 7f3e17db2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888db8b60 0x559888d9a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.280+0000 7f3e17db2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101b24a0 con 0x559888db8b60 2024-03-27T07:32:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.280+0000 7f3e17db2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101b3910 con 0x559888da07e0 2024-03-27T07:32:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.280+0000 7f3e17db2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3e101b2b70 con 0x559888d970f0 2024-03-27T07:32:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.280+0000 7f3e17db2740 10 client.0 _ll_register_callbacks cb 0x7f3e040094f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:32:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.282+0000 7f3e0ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d970f0 0x559888e0ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.282+0000 7f3e0ed9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d970f0 0x559888e0ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:55030/0 (socket says 172.21.15.82:55030) 2024-03-27T07:32:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.282+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/2849811105 learned_addr learned my addr 172.21.15.82:0/2849811105 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.282+0000 7f3e0e59c640 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888da07e0 0x559888e104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.282+0000 7f3e0f59e640 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888db8b60 0x559888d9a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.283+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/2849811105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888da07e0 msgr2=0x559888e104a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.283+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888da07e0 0x559888e104a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.283+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/2849811105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888db8b60 msgr2=0x559888d9a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.283+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888db8b60 0x559888d9a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.283+0000 7f3e0ed9d640 1 -- 172.21.15.82:0/2849811105 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559888d9b0d0 con 0x559888d970f0 2024-03-27T07:32:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.283+0000 7f3e0ed9d640 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d970f0 0x559888e0ff60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3e08037040 tx=0x7f3e080bec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db78708d926ca4a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.283+0000 7f3df2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:32:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.284+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2849811105 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e080d7070 con 0x559888d970f0 2024-03-27T07:32:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.284+0000 7f3e17db2740 1 -- 172.21.15.82:0/2849811105 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e080bf320 con 0x559888d970f0 2024-03-27T07:32:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.284+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2849811105 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8528+0+0 (secure 0 0 0) 0x7f3e080bb290 con 0x559888d970f0 2024-03-27T07:32:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.285+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2849811105 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f3e080bcfe0 con 0x559888d970f0 2024-03-27T07:32:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.285+0000 7f3e17db2740 10 client.26851 fetch_fsmap learned FSMap version 37 2024-03-27T07:32:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.285+0000 7f3e17db2740 1 -- 172.21.15.82:0/2849811105 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x559888e17720 con 0x559888d970f0 2024-03-27T07:32:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.286+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2849811105 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e080bf320 con 0x559888d970f0 2024-03-27T07:32:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.286+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2849811105 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f3e0803c030 con 0x559888d970f0 2024-03-27T07:32:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.286+0000 7f3e17db2740 10 client.26851 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:32:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.286+0000 7f3e17db2740 10 client.26851 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:32:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.286+0000 7f3e17db2740 20 client.26851 populate_metadata read hostname 'smithi082' 2024-03-27T07:32:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.286+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559888e17bc0 0x559888e19fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.286+0000 7f3e17db2740 4 client.26851 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:32:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.286+0000 7f3e17db2740 1 -- 172.21.15.82:0/2849811105 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559888d026e0 con 0x559888e17bc0 2024-03-27T07:32:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.286+0000 7f3e0e59c640 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559888e17bc0 0x559888e19fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.287+0000 7f3df2ff5640 10 client.26851 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.287+0000 7f3e0e59c640 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559888e17bc0 0x559888e19fe0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e44726356521e69c server_cookie=5bb4cd2f0743c140 in_seq=0 out_seq=0 2024-03-27T07:32:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.394+0000 7f3df2ff5640 1 -- 172.21.15.82:0/2849811105 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559888d026e0 con 0x559888e17bc0 2024-03-27T07:32:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3df2ff5640 10 client.26851 handle_command_reply: tid=0 2024-03-27T07:32:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3e17db2740 1 client.26851 shutdown 2024-03-27T07:32:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3e17db2740 1 -- 172.21.15.82:0/2849811105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d970f0 msgr2=0x559888e0ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d970f0 0x559888e0ff60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3e08037040 tx=0x7f3e080bec90 comp rx=0 tx=0).stop 2024-03-27T07:32:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3e17db2740 1 -- 172.21.15.82:0/2849811105 shutdown_connections 2024-03-27T07:32:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x559888e17bc0 0x559888e19fe0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559888db8b60 0x559888d9a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x559888da07e0 0x559888e104a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3e17db2740 1 --2- 172.21.15.82:0/2849811105 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x559888d970f0 0x559888e0ff60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3e17db2740 1 -- 172.21.15.82:0/2849811105 >> 172.21.15.82:0/2849811105 conn(0x559888d91a10 msgr2=0x559888d92d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.395+0000 7f3df2ff5640 0 client.26851 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.396+0000 7f3e17db2740 1 -- 172.21.15.82:0/2849811105 shutdown_connections 2024-03-27T07:32:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.396+0000 7f3e17db2740 1 -- 172.21.15.82:0/2849811105 wait complete. 2024-03-27T07:32:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.397+0000 7f3e17db2740 20 client.26851 trim_cache size 0 max 16384 2024-03-27T07:32:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:32:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:32:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:32:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:32:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.397+0000 7f3e150ed640 1 -- 172.21.15.82:0/1908999846 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3df80a38a0 msgr2=0x7f3df80a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.397+0000 7f3e150ed640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3df80a38a0 0x7f3df80a5d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3e0001e000 tx=0x7f3e0001b000 comp rx=0 tx=0).stop 2024-03-27T07:32:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.397+0000 7f3e150ed640 1 -- 172.21.15.82:0/1908999846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e10109090 msgr2=0x7f3e101a2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.398+0000 7f3e150ed640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e10109090 0x7f3e101a2e40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3e080348f0 tx=0x7f3e08003c20 comp rx=0 tx=0).stop 2024-03-27T07:32:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.399+0000 7f3e150ed640 1 -- 172.21.15.82:0/1908999846 shutdown_connections 2024-03-27T07:32:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.399+0000 7f3e150ed640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f3df80a38a0 0x7f3df80a5d60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.399+0000 7f3e150ed640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f3e10116be0 0x7f3e101a7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.399+0000 7f3e150ed640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e1010c280 0x7f3e101a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.400+0000 7f3e150ed640 1 --2- 172.21.15.82:0/1908999846 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e10109090 0x7f3e101a2e40 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.400+0000 7f3e150ed640 1 -- 172.21.15.82:0/1908999846 >> 172.21.15.82:0/1908999846 conn(0x7f3e1006d080 msgr2=0x7f3e10116fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.400+0000 7f3e150ed640 1 -- 172.21.15.82:0/1908999846 shutdown_connections 2024-03-27T07:32:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:12.400+0000 7f3e150ed640 1 -- 172.21.15.82:0/1908999846 wait complete. 2024-03-27T07:32:12.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:12 smithi082 ceph-mon[32178]: pgmap v267: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 828 op/s 2024-03-27T07:32:12.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:12 smithi149 ceph-mon[36065]: pgmap v267: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 828 op/s 2024-03-27T07:32:12.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:12 smithi153 ceph-mon[36179]: pgmap v267: 97 pgs: 97 active+clean; 1.8 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 828 op/s 2024-03-27T07:32:14.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:14 smithi149 ceph-mon[36065]: pgmap v268: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 1.8 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-03-27T07:32:14.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:14 smithi153 ceph-mon[36179]: pgmap v268: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 1.8 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-03-27T07:32:14.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:14 smithi082 ceph-mon[32178]: pgmap v268: 97 pgs: 20 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 41 active+clean; 1.8 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 171 op/s 2024-03-27T07:32:16.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:16 smithi149 ceph-mon[36065]: pgmap v269: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-03-27T07:32:16.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:16 smithi153 ceph-mon[36179]: pgmap v269: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-03-27T07:32:16.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:16 smithi082 ceph-mon[32178]: pgmap v269: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 168 op/s 2024-03-27T07:32:18.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:18 smithi149 ceph-mon[36065]: pgmap v270: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 167 op/s 2024-03-27T07:32:18.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:18 smithi153 ceph-mon[36179]: pgmap v270: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 167 op/s 2024-03-27T07:32:18.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:18 smithi082 ceph-mon[32178]: pgmap v270: 97 pgs: 8 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 67 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 167 op/s 2024-03-27T07:32:20.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:20 smithi149 ceph-mon[36065]: pgmap v271: 97 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 75 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-03-27T07:32:20.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:20 smithi153 ceph-mon[36179]: pgmap v271: 97 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 75 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-03-27T07:32:20.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:20 smithi082 ceph-mon[32178]: pgmap v271: 97 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 75 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-03-27T07:32:22.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:22 smithi149 ceph-mon[36065]: pgmap v272: 97 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 75 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 139 op/s 2024-03-27T07:32:22.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:22 smithi153 ceph-mon[36179]: pgmap v272: 97 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 75 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 139 op/s 2024-03-27T07:32:22.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:22 smithi082 ceph-mon[32178]: pgmap v272: 97 pgs: 6 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 75 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 139 op/s 2024-03-27T07:32:24.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:24 smithi149 ceph-mon[36065]: pgmap v273: 97 pgs: 97 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-03-27T07:32:24.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:24 smithi153 ceph-mon[36179]: pgmap v273: 97 pgs: 97 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-03-27T07:32:24.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:24 smithi082 ceph-mon[32178]: pgmap v273: 97 pgs: 97 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 227 op/s 2024-03-27T07:32:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.495+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1140015386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e01059f0 msgr2=0x7f86e0105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.495+0000 7f86e6ad4640 1 --2- 172.21.15.82:0/1140015386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e01059f0 0x7f86e0105dd0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009900 tx=0x7f86d402bc30 comp rx=0 tx=0).stop 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.495+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1140015386 shutdown_connections 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.495+0000 7f86e6ad4640 1 --2- 172.21.15.82:0/1140015386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e0101660 0x7f86e010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.495+0000 7f86e6ad4640 1 --2- 172.21.15.82:0/1140015386 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e0100ca0 0x7f86e0101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.495+0000 7f86e6ad4640 1 --2- 172.21.15.82:0/1140015386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e01059f0 0x7f86e0105dd0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.495+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1140015386 >> 172.21.15.82:0/1140015386 conn(0x7f86e00778a0 msgr2=0x7f86e0077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.495+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1140015386 shutdown_connections 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.495+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1140015386 wait complete. 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e6ad4640 1 Processor -- start 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e6ad4640 1 -- start start 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e6ad4640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e0100ca0 0x7f86e0199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e6ad4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e0101660 0x7f86e0199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e6ad4640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e01059f0 0x7f86e01a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e6ad4640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86e0110f10 con 0x7f86e01059f0 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e6ad4640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f86e0110d90 con 0x7f86e0100ca0 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e6ad4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86e0111090 con 0x7f86e0101660 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e5071640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e01059f0 0x7f86e01a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e4870640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e0100ca0 0x7f86e0199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e4870640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e0100ca0 0x7f86e0199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:34076/0 (socket says 172.21.15.82:34076) 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e5071640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e01059f0 0x7f86e01a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32810/0 (socket says 172.21.15.82:32810) 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e4870640 1 -- 172.21.15.82:0/1672909530 learned_addr learned my addr 172.21.15.82:0/1672909530 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86dffff640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e0101660 0x7f86e0199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e5071640 1 -- 172.21.15.82:0/1672909530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e0101660 msgr2=0x7f86e0199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:25.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e5071640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e0101660 0x7f86e0199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e5071640 1 -- 172.21.15.82:0/1672909530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e0100ca0 msgr2=0x7f86e0199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e5071640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e0100ca0 0x7f86e0199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e5071640 1 -- 172.21.15.82:0/1672909530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e01a47f0 con 0x7f86e01059f0 2024-03-27T07:32:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.496+0000 7f86e4870640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e0100ca0 0x7f86e0199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:32:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.497+0000 7f86e5071640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e01059f0 0x7f86e01a42b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f86d8005fd0 tx=0x7f86d800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.497+0000 7f86ddffb640 1 -- 172.21.15.82:0/1672909530 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d800cd80 con 0x7f86e01059f0 2024-03-27T07:32:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.497+0000 7f86ddffb640 1 -- 172.21.15.82:0/1672909530 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86d8005020 con 0x7f86e01059f0 2024-03-27T07:32:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.497+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1672909530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e01a49c0 con 0x7f86e01059f0 2024-03-27T07:32:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.497+0000 7f86ddffb640 1 -- 172.21.15.82:0/1672909530 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d8010720 con 0x7f86e01059f0 2024-03-27T07:32:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.497+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1672909530 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e01a4eb0 con 0x7f86e01059f0 2024-03-27T07:32:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.499+0000 7f86ddffb640 1 -- 172.21.15.82:0/1672909530 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f86d80051d0 con 0x7f86e01059f0 2024-03-27T07:32:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.499+0000 7f86e979a740 1 Processor -- start 2024-03-27T07:32:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.499+0000 7f86e979a740 1 -- start start 2024-03-27T07:32:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86ddffb640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f86d00a3820 0x7f86d00a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86e979a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e114d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86e979a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e11a10 0x55f100e1a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86e979a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e1a7e0 0x55f100e1cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86e979a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f100dd7cd0 con 0x55f100e11a10 2024-03-27T07:32:25.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86e979a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f100d1c950 con 0x55f100e110f0 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86e979a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f100d74e50 con 0x55f100e1a7e0 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86ddffb640 1 -- 172.21.15.82:0/1672909530 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8528+0+0 (secure 0 0 0) 0x7f86d80d0580 con 0x7f86e01059f0 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f86d00a3820 0x7f86d00a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86e4870640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e114d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e11a10 0x55f100e1a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e11a10 0x55f100e1a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32812/0 (socket says 172.21.15.82:32812) 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86e4870640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e114d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:34088/0 (socket says 172.21.15.82:34088) 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 -- 172.21.15.82:0/3559394881 learned_addr learned my addr 172.21.15.82:0/3559394881 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86e5071640 1 --2- 172.21.15.82:0/3559394881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e1a7e0 0x55f100e1cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 -- 172.21.15.82:0/3559394881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e1a7e0 msgr2=0x55f100e1cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 --2- 172.21.15.82:0/3559394881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e1a7e0 0x55f100e1cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 -- 172.21.15.82:0/3559394881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 msgr2=0x55f100e114d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:25.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 --2- 172.21.15.82:0/3559394881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e114d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 -- 172.21.15.82:0/3559394881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f100a89210 con 0x55f100e11a10 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86e4870640 1 --2- 172.21.15.82:0/3559394881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 --2- 172.21.15.82:0/3559394881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e11a10 0x55f100e1a2a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f86cc012a80 tx=0x7f86cc012f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a9bce848bda8bc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86dffff640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f86d00a3820 0x7f86d00a5ce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00f7f0 tx=0x7f86cc01d000 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.500+0000 7f86caffd640 1 -- 172.21.15.82:0/3559394881 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc022030 con 0x55f100e11a10 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86caffd640 1 -- 172.21.15.82:0/3559394881 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86cc012590 con 0x55f100e11a10 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86caffd640 1 -- 172.21.15.82:0/3559394881 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc01cc00 con 0x55f100e11a10 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86e979a740 1 -- 172.21.15.82:0/3559394881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e11a10 msgr2=0x55f100e1a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86e979a740 1 --2- 172.21.15.82:0/3559394881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e11a10 0x55f100e1a2a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f86cc012a80 tx=0x7f86cc012f40 comp rx=0 tx=0).stop 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86e979a740 1 -- 172.21.15.82:0/3559394881 shutdown_connections 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86e979a740 1 --2- 172.21.15.82:0/3559394881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e11a10 0x55f100e1a2a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86e979a740 1 --2- 172.21.15.82:0/3559394881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e1a7e0 0x55f100e1cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86e979a740 1 --2- 172.21.15.82:0/3559394881 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e114d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.512 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86e979a740 1 -- 172.21.15.82:0/3559394881 >> 172.21.15.82:0/3559394881 conn(0x55f100e0ba10 msgr2=0x55f100e0bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86e979a740 1 -- 172.21.15.82:0/3559394881 shutdown_connections 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.501+0000 7f86e979a740 1 -- 172.21.15.82:0/3559394881 wait complete. 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e979a740 1 -- start start 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e979a740 1 Processor -- start 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e979a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e17800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e979a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e17d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e979a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e18280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e979a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f100d70e00 con 0x55f100e1a7e0 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e979a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f100d1d520 con 0x55f100e110f0 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e979a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f100d308e0 con 0x55f100e11a10 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e979a740 10 client.0 _ll_register_callbacks cb 0x55f100d6ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e5071640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e18280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.513 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e4870640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e17800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e5071640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e18280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32828/0 (socket says 172.21.15.82:32828) 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86e5071640 1 -- 172.21.15.82:0/3838995965 learned_addr learned my addr 172.21.15.82:0/3838995965 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.502+0000 7f86dffff640 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e17d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e5071640 1 -- 172.21.15.82:0/3838995965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 msgr2=0x55f100e17d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e5071640 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e17d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e5071640 1 -- 172.21.15.82:0/3838995965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 msgr2=0x55f100e17800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e5071640 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e17800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e5071640 1 -- 172.21.15.82:0/3838995965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f100b55620 con 0x55f100e1a7e0 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e4870640 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e17800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e5071640 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e18280 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009fd0 tx=0x7f86d809cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f20d9b34ee629f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86bffff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86bffff640 1 -- 172.21.15.82:0/3838995965 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d80cdf50 con 0x55f100e1a7e0 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86bffff640 1 -- 172.21.15.82:0/3838995965 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8528+0+0 (secure 0 0 0) 0x7f86d80ce0f0 con 0x55f100e1a7e0 2024-03-27T07:32:25.514 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e979a740 1 -- 172.21.15.82:0/3838995965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86cc012590 con 0x55f100e1a7e0 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86bffff640 1 -- 172.21.15.82:0/3838995965 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f86d80a4ef0 con 0x55f100e1a7e0 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e979a740 10 client.17001 fetch_fsmap learned FSMap version 37 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e979a740 1 -- 172.21.15.82:0/3838995965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f100e292f0 con 0x55f100e1a7e0 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86bffff640 1 -- 172.21.15.82:0/3838995965 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86cc012590 con 0x55f100e1a7e0 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86bffff640 1 -- 172.21.15.82:0/3838995965 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f86d80d0180 con 0x55f100e1a7e0 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e979a740 10 client.17001 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e979a740 10 client.17001 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e979a740 20 client.17001 populate_metadata read hostname 'smithi082' 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e979a740 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f100e2a7b0 0x55f100e2cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e979a740 4 client.17001 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.503+0000 7f86e979a740 1 -- 172.21.15.82:0/3838995965 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f100d82390 con 0x55f100e2a7b0 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.504+0000 7f86e4870640 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f100e2a7b0 0x55f100e2cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.504+0000 7f86bffff640 10 client.17001 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:25.515 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.504+0000 7f86e4870640 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f100e2a7b0 0x55f100e2cba0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aead6ee33dff2c5 server_cookie=c9710cbb9434ffd1 in_seq=0 out_seq=0 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86bffff640 1 -- 172.21.15.82:0/3838995965 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f100d82390 con 0x55f100e2a7b0 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86bffff640 10 client.17001 handle_command_reply: tid=0 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 client.17001 shutdown 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 -- 172.21.15.82:0/3838995965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 msgr2=0x55f100e18280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e18280 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f86d8009fd0 tx=0x7f86d809cf50 comp rx=0 tx=0).stop 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 -- 172.21.15.82:0/3838995965 shutdown_connections 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f100e2a7b0 0x55f100e2cba0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e18280 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e17d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 --2- 172.21.15.82:0/3838995965 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e17800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86bffff640 0 client.17001 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 -- 172.21.15.82:0/3838995965 >> 172.21.15.82:0/3838995965 conn(0x55f100e0ba10 msgr2=0x55f100e0d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:25.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 -- 172.21.15.82:0/3838995965 shutdown_connections 2024-03-27T07:32:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 1 -- 172.21.15.82:0/3838995965 wait complete. 2024-03-27T07:32:25.517 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.505+0000 7f86e979a740 20 client.17001 trim_cache size 0 max 16384 2024-03-27T07:32:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e979a740 1 Processor -- start 2024-03-27T07:32:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e979a740 1 -- start start 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e979a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e110f0 0x55f100e19f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e979a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e25df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e979a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e1a7e0 0x55f100e32440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e979a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86e01b0110 con 0x55f100e110f0 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e979a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f86e01ad920 con 0x55f100e1a7e0 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e979a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86e01ab770 con 0x55f100e11a10 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e4870640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e110f0 0x55f100e19f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e4870640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e110f0 0x55f100e19f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32830/0 (socket says 172.21.15.82:32830) 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e4870640 1 -- 172.21.15.82:0/3137007593 learned_addr learned my addr 172.21.15.82:0/3137007593 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e5071640 1 --2- 172.21.15.82:0/3137007593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e1a7e0 0x55f100e32440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86dffff640 1 --2- 172.21.15.82:0/3137007593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e25df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e4870640 1 -- 172.21.15.82:0/3137007593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 msgr2=0x55f100e25df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e4870640 1 --2- 172.21.15.82:0/3137007593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e25df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e4870640 1 -- 172.21.15.82:0/3137007593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e1a7e0 msgr2=0x55f100e32440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e4870640 1 --2- 172.21.15.82:0/3137007593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e1a7e0 0x55f100e32440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e4870640 1 -- 172.21.15.82:0/3137007593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f100e15d50 con 0x55f100e110f0 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86dffff640 1 --2- 172.21.15.82:0/3137007593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e25df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.520+0000 7f86e4870640 1 --2- 172.21.15.82:0/3137007593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e110f0 0x55f100e19f30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f86d4006010 tx=0x7f86d40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50463f5426b7a338 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86ca7fc640 1 -- 172.21.15.82:0/3137007593 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4004380 con 0x55f100e110f0 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86ca7fc640 1 -- 172.21.15.82:0/3137007593 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86d4004f00 con 0x55f100e110f0 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86ca7fc640 1 -- 172.21.15.82:0/3137007593 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d404b290 con 0x55f100e110f0 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86e979a740 1 -- 172.21.15.82:0/3137007593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e110f0 msgr2=0x55f100e19f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86e979a740 1 --2- 172.21.15.82:0/3137007593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e110f0 0x55f100e19f30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f86d4006010 tx=0x7f86d40058d0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86e979a740 1 -- 172.21.15.82:0/3137007593 shutdown_connections 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86e979a740 1 --2- 172.21.15.82:0/3137007593 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e1a7e0 0x55f100e32440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86e979a740 1 --2- 172.21.15.82:0/3137007593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e25df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86e979a740 1 --2- 172.21.15.82:0/3137007593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e110f0 0x55f100e19f30 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86e979a740 1 -- 172.21.15.82:0/3137007593 >> 172.21.15.82:0/3137007593 conn(0x55f100e0ba10 msgr2=0x55f100e177c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86e979a740 1 -- 172.21.15.82:0/3137007593 shutdown_connections 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86e979a740 1 -- 172.21.15.82:0/3137007593 wait complete. 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.521+0000 7f86e979a740 1 -- start start 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e979a740 1 Processor -- start 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e979a740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e14bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e979a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e150f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e979a740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e89a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e979a740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f86e01abde0 con 0x55f100e1a7e0 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e979a740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f86e01ad250 con 0x55f100e110f0 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e979a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f86e01ac4b0 con 0x55f100e11a10 2024-03-27T07:32:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e979a740 10 client.0 _ll_register_callbacks cb 0x7f86d809c4e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e5071640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e89a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e4870640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e14bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e5071640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e89a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32846/0 (socket says 172.21.15.82:32846) 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e4870640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e14bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:34128/0 (socket says 172.21.15.82:34128) 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e5071640 1 -- 172.21.15.82:0/1605874116 learned_addr learned my addr 172.21.15.82:0/1605874116 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86dffff640 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e150f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e5071640 1 -- 172.21.15.82:0/1605874116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 msgr2=0x55f100e150f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e5071640 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e150f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e5071640 1 -- 172.21.15.82:0/1605874116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 msgr2=0x55f100e14bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e5071640 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e14bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e5071640 1 -- 172.21.15.82:0/1605874116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f100e8a000 con 0x55f100e1a7e0 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86e5071640 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e89a40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f86d80b1fd0 tx=0x7f86d80cddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c070ed246a014e4a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.522+0000 7f86bffff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86bffff640 1 -- 172.21.15.82:0/1605874116 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d809c250 con 0x55f100e1a7e0 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86bffff640 1 -- 172.21.15.82:0/1605874116 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 8528+0+0 (secure 0 0 0) 0x7f86d80bb2a0 con 0x55f100e1a7e0 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86e979a740 1 -- 172.21.15.82:0/1605874116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86d4004f00 con 0x55f100e1a7e0 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86bffff640 1 -- 172.21.15.82:0/1605874116 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f86d8051020 con 0x55f100e1a7e0 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86e979a740 10 client.17007 fetch_fsmap learned FSMap version 37 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86e979a740 1 -- 172.21.15.82:0/1605874116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f100e91380 con 0x55f100e1a7e0 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86bffff640 1 -- 172.21.15.82:0/1605874116 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86d4004f00 con 0x55f100e1a7e0 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86bffff640 1 -- 172.21.15.82:0/1605874116 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f86d809b640 con 0x55f100e1a7e0 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86e979a740 10 client.17007 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86e979a740 10 client.17007 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86e979a740 20 client.17007 populate_metadata read hostname 'smithi082' 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86e979a740 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f100e91990 0x55f100e93db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86e979a740 4 client.17007 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:32:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86e979a740 1 -- 172.21.15.82:0/1605874116 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f100d7c6e0 con 0x55f100e91990 2024-03-27T07:32:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.523+0000 7f86e4870640 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f100e91990 0x55f100e93db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.524+0000 7f86bffff640 10 client.17007 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.524+0000 7f86e4870640 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f100e91990 0x55f100e93db0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be68618574165197 server_cookie=1b367e62c06d8f2f in_seq=0 out_seq=0 2024-03-27T07:32:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86bffff640 1 -- 172.21.15.82:0/1605874116 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f100d7c6e0 con 0x55f100e91990 2024-03-27T07:32:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86bffff640 10 client.17007 handle_command_reply: tid=0 2024-03-27T07:32:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 client.17007 shutdown 2024-03-27T07:32:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 -- 172.21.15.82:0/1605874116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 msgr2=0x55f100e89a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e89a40 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f86d80b1fd0 tx=0x7f86d80cddb0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 -- 172.21.15.82:0/1605874116 shutdown_connections 2024-03-27T07:32:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f100e91990 0x55f100e93db0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f100e1a7e0 0x55f100e89a40 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f100e11a10 0x55f100e150f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86bffff640 0 client.17007 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 --2- 172.21.15.82:0/1605874116 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f100e110f0 0x55f100e14bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 -- 172.21.15.82:0/1605874116 >> 172.21.15.82:0/1605874116 conn(0x55f100e0ba10 msgr2=0x55f100e18050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 -- 172.21.15.82:0/1605874116 shutdown_connections 2024-03-27T07:32:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 1 -- 172.21.15.82:0/1605874116 wait complete. 2024-03-27T07:32:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.577+0000 7f86e979a740 20 client.17007 trim_cache size 0 max 16384 2024-03-27T07:32:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:32:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:32:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:32:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:32:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1672909530 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f86d00a3820 msgr2=0x7f86d00a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f86d00a3820 0x7f86d00a5ce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00f7f0 tx=0x7f86cc01d000 comp rx=0 tx=0).stop 2024-03-27T07:32:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1672909530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e01059f0 msgr2=0x7f86e01a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e01059f0 0x7f86e01a42b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f86d8005fd0 tx=0x7f86d800ee60 comp rx=0 tx=0).stop 2024-03-27T07:32:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1672909530 shutdown_connections 2024-03-27T07:32:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f86d00a3820 0x7f86d00a5ce0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f86e01059f0 0x7f86e01a42b0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86e0101660 0x7f86e0199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 --2- 172.21.15.82:0/1672909530 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f86e0100ca0 0x7f86e0199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1672909530 >> 172.21.15.82:0/1672909530 conn(0x7f86e00778a0 msgr2=0x7f86e00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1672909530 shutdown_connections 2024-03-27T07:32:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:25.578+0000 7f86e6ad4640 1 -- 172.21.15.82:0/1672909530 wait complete. 2024-03-27T07:32:26.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:26 smithi149 ceph-mon[36065]: pgmap v274: 97 pgs: 97 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-03-27T07:32:26.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:26 smithi153 ceph-mon[36179]: pgmap v274: 97 pgs: 97 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-03-27T07:32:26.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:26 smithi082 ceph-mon[32178]: pgmap v274: 97 pgs: 97 active+clean; 1.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 166 op/s 2024-03-27T07:32:29.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:28 smithi082 ceph-mon[32178]: pgmap v275: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 265 op/s 2024-03-27T07:32:29.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:28 smithi082 ceph-mon[32178]: osdmap e96: 12 total, 12 up, 12 in 2024-03-27T07:32:29.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:28 smithi149 ceph-mon[36065]: pgmap v275: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 265 op/s 2024-03-27T07:32:29.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:28 smithi149 ceph-mon[36065]: osdmap e96: 12 total, 12 up, 12 in 2024-03-27T07:32:29.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:28 smithi153 ceph-mon[36179]: pgmap v275: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 265 op/s 2024-03-27T07:32:29.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:28 smithi153 ceph-mon[36179]: osdmap e96: 12 total, 12 up, 12 in 2024-03-27T07:32:31.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:30 smithi082 ceph-mon[32178]: pgmap v277: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 257 op/s 2024-03-27T07:32:31.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:30 smithi149 ceph-mon[36065]: pgmap v277: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 257 op/s 2024-03-27T07:32:31.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:30 smithi153 ceph-mon[36179]: pgmap v277: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 257 op/s 2024-03-27T07:32:33.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:32 smithi082 ceph-mon[32178]: pgmap v278: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 257 op/s 2024-03-27T07:32:33.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:32 smithi149 ceph-mon[36065]: pgmap v278: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 257 op/s 2024-03-27T07:32:33.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:32 smithi153 ceph-mon[36179]: pgmap v278: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 257 op/s 2024-03-27T07:32:35.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:34 smithi082 ceph-mon[32178]: pgmap v279: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 258 op/s 2024-03-27T07:32:35.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:34 smithi149 ceph-mon[36065]: pgmap v279: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 258 op/s 2024-03-27T07:32:35.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:34 smithi153 ceph-mon[36179]: pgmap v279: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 258 op/s 2024-03-27T07:32:37.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:36 smithi082 ceph-mon[32178]: pgmap v280: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 257 op/s 2024-03-27T07:32:37.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:36 smithi149 ceph-mon[36065]: pgmap v280: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 257 op/s 2024-03-27T07:32:37.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:36 smithi153 ceph-mon[36179]: pgmap v280: 97 pgs: 97 active+clean; 1.8 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 257 op/s 2024-03-27T07:32:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.664+0000 7f0c57f93640 1 -- 172.21.15.82:0/625186292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c50101660 msgr2=0x7f0c5010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.664+0000 7f0c57f93640 1 --2- 172.21.15.82:0/625186292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c50101660 0x7f0c5010d880 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0c48009ca0 tx=0x7f0c4802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.664+0000 7f0c57f93640 1 -- 172.21.15.82:0/625186292 shutdown_connections 2024-03-27T07:32:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.664+0000 7f0c57f93640 1 --2- 172.21.15.82:0/625186292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c50101660 0x7f0c5010d880 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.682 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.664+0000 7f0c57f93640 1 --2- 172.21.15.82:0/625186292 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c50100ca0 0x7f0c50101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.664+0000 7f0c57f93640 1 --2- 172.21.15.82:0/625186292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c501059f0 0x7f0c50105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.664+0000 7f0c57f93640 1 -- 172.21.15.82:0/625186292 >> 172.21.15.82:0/625186292 conn(0x7f0c500778a0 msgr2=0x7f0c50077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.664+0000 7f0c57f93640 1 -- 172.21.15.82:0/625186292 shutdown_connections 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.664+0000 7f0c57f93640 1 -- 172.21.15.82:0/625186292 wait complete. 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c57f93640 1 Processor -- start 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c57f93640 1 -- start start 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c57f93640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c50100ca0 0x7f0c50198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c57f93640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c50101660 0x7f0c50198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c57f93640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c501059f0 0x7f0c5019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c57f93640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50110f10 con 0x7f0c501059f0 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c57f93640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50110d90 con 0x7f0c50100ca0 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c57f93640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c50111090 con 0x7f0c50101660 2024-03-27T07:32:38.683 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c56530640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c501059f0 0x7f0c5019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c56530640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c501059f0 0x7f0c5019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55230/0 (socket says 172.21.15.82:55230) 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c56530640 1 -- 172.21.15.82:0/2238805190 learned_addr learned my addr 172.21.15.82:0/2238805190 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c5552e640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c50101660 0x7f0c50198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.665+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c50100ca0 0x7f0c50198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c56530640 1 -- 172.21.15.82:0/2238805190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c50101660 msgr2=0x7f0c50198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c56530640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c50101660 0x7f0c50198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c56530640 1 -- 172.21.15.82:0/2238805190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c50100ca0 msgr2=0x7f0c50198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c56530640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c50100ca0 0x7f0c50198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c56530640 1 -- 172.21.15.82:0/2238805190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c5019d3a0 con 0x7f0c501059f0 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c56530640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c501059f0 0x7f0c5019cc70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0c4802c700 tx=0x7f0c48032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c46ffd640 1 -- 172.21.15.82:0/2238805190 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48042020 con 0x7f0c501059f0 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c57f93640 1 -- 172.21.15.82:0/2238805190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c5019d630 con 0x7f0c501059f0 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c46ffd640 1 -- 172.21.15.82:0/2238805190 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c48034640 con 0x7f0c501059f0 2024-03-27T07:32:38.684 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c46ffd640 1 -- 172.21.15.82:0/2238805190 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c48039040 con 0x7f0c501059f0 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.666+0000 7f0c57f93640 1 -- 172.21.15.82:0/2238805190 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c501a4f20 con 0x7f0c501059f0 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.668+0000 7f0c46ffd640 1 -- 172.21.15.82:0/2238805190 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f0c48045020 con 0x7f0c501059f0 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c5ab76740 1 Processor -- start 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c5ab76740 1 -- start start 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 0x55b4cba254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cba30bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b4cb9ebcd0 con 0x55b4cba25a10 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b4cb930950 con 0x55b4cba250f0 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b4cb988e50 con 0x55b4cba2e7e0 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c46ffd640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0c3c0a3820 0x7f0c3c0a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.685 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c55d2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c55d2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55242/0 (socket says 172.21.15.82:55242) 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c55d2f640 1 -- 172.21.15.82:0/4011038449 learned_addr learned my addr 172.21.15.82:0/4011038449 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c5552e640 1 --2- 172.21.15.82:0/4011038449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 0x55b4cba254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c56530640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0c3c0a3820 0x7f0c3c0a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c5552e640 1 --2- 172.21.15.82:0/4011038449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cba30bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.669+0000 7f0c46ffd640 1 -- 172.21.15.82:0/2238805190 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8484+0+0 (secure 0 0 0) 0x7f0c480f1ed0 con 0x7f0c501059f0 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c55d2f640 1 -- 172.21.15.82:0/4011038449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 msgr2=0x55b4cba30bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/4011038449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cba30bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c55d2f640 1 -- 172.21.15.82:0/4011038449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 msgr2=0x55b4cba254d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/4011038449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 0x55b4cba254d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.686 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c55d2f640 1 -- 172.21.15.82:0/4011038449 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4cb69d210 con 0x55b4cba25a10 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c5552e640 1 --2- 172.21.15.82:0/4011038449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 0x55b4cba254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/4011038449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2e2a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009c70 tx=0x7f0c4c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edba6263184d078 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c56530640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0c3c0a3820 0x7f0c3c0a5ce0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0c480bdee0 tx=0x7f0c480b3670 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c3bfff640 1 -- 172.21.15.82:0/4011038449 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c004230 con 0x55b4cba25a10 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c3bfff640 1 -- 172.21.15.82:0/4011038449 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c4c0043d0 con 0x55b4cba25a10 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.670+0000 7f0c3bfff640 1 -- 172.21.15.82:0/4011038449 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c019760 con 0x55b4cba25a10 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 -- 172.21.15.82:0/4011038449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 msgr2=0x55b4cba2e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/4011038449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2e2a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009c70 tx=0x7f0c4c011810 comp rx=0 tx=0).stop 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 -- 172.21.15.82:0/4011038449 shutdown_connections 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/4011038449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2e2a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/4011038449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cba30bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/4011038449 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 0x55b4cba254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.687 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 -- 172.21.15.82:0/4011038449 >> 172.21.15.82:0/4011038449 conn(0x55b4cba1fa10 msgr2=0x55b4cba1fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 -- 172.21.15.82:0/4011038449 shutdown_connections 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 -- 172.21.15.82:0/4011038449 wait complete. 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 -- start start 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 Processor -- start 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba250f0 0x55b4cba2b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba2e7e0 0x55b4cba2c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.671+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b4cb984e00 con 0x55b4cba25a10 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b4cb931520 con 0x55b4cba2e7e0 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b4cb9448e0 con 0x55b4cba250f0 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c5ab76740 10 client.0 _ll_register_callbacks cb 0x55b4cb97fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c55d2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.688 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c55d2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55254/0 (socket says 172.21.15.82:55254) 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c55d2f640 1 -- 172.21.15.82:0/3795210045 learned_addr learned my addr 172.21.15.82:0/3795210045 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c5552e640 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba250f0 0x55b4cba2b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c5552e640 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba2e7e0 0x55b4cba2c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c55d2f640 1 -- 172.21.15.82:0/3795210045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba250f0 msgr2=0x55b4cba2b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba250f0 0x55b4cba2b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c55d2f640 1 -- 172.21.15.82:0/3795210045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba2e7e0 msgr2=0x55b4cba2c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba2e7e0 0x55b4cba2c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c55d2f640 1 -- 172.21.15.82:0/3795210045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4cb769620 con 0x55b4cba25a10 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c5552e640 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba2e7e0 0x55b4cba2c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2bd10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009560 tx=0x7f0c4c005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4c24a62ec7a196 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c397fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:32:38.689 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c397fa640 1 -- 172.21.15.82:0/3795210045 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c027070 con 0x55b4cba25a10 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c397fa640 1 -- 172.21.15.82:0/3795210045 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8484+0+0 (secure 0 0 0) 0x7f0c4c0035f0 con 0x55b4cba25a10 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c5ab76740 1 -- 172.21.15.82:0/3795210045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c4c0043d0 con 0x55b4cba25a10 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c397fa640 1 -- 172.21.15.82:0/3795210045 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0c4c033050 con 0x55b4cba25a10 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c5ab76740 10 client.17019 fetch_fsmap learned FSMap version 37 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.672+0000 7f0c5ab76740 1 -- 172.21.15.82:0/3795210045 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b4cba3d360 con 0x55b4cba25a10 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c397fa640 1 -- 172.21.15.82:0/3795210045 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c4c0043d0 con 0x55b4cba25a10 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c397fa640 1 -- 172.21.15.82:0/3795210045 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f0c4c018070 con 0x55b4cba25a10 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c5ab76740 10 client.17019 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c5ab76740 10 client.17019 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c5ab76740 20 client.17019 populate_metadata read hostname 'smithi082' 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b4cba3e710 0x55b4cba40b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c5ab76740 4 client.17019 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:32:38.690 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c5ab76740 1 -- 172.21.15.82:0/3795210045 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4cb996390 con 0x55b4cba3e710 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c5552e640 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b4cba3e710 0x55b4cba40b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c397fa640 10 client.17019 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.673+0000 7f0c5552e640 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b4cba3e710 0x55b4cba40b00 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d06d9dac57824dc server_cookie=abcc67c542328b5b in_seq=0 out_seq=0 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c397fa640 1 -- 172.21.15.82:0/3795210045 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b4cb996390 con 0x55b4cba3e710 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c397fa640 10 client.17019 handle_command_reply: tid=0 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 client.17019 shutdown 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 -- 172.21.15.82:0/3795210045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 msgr2=0x55b4cba2bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2bd10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c009560 tx=0x7f0c4c005750 comp rx=0 tx=0).stop 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 -- 172.21.15.82:0/3795210045 shutdown_connections 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b4cba3e710 0x55b4cba40b00 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba2bd10 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba2e7e0 0x55b4cba2c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.691 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/3795210045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba250f0 0x55b4cba2b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c397fa640 0 client.17019 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:38.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 -- 172.21.15.82:0/3795210045 >> 172.21.15.82:0/3795210045 conn(0x55b4cba1fa10 msgr2=0x55b4cba21760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:38.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 -- 172.21.15.82:0/3795210045 shutdown_connections 2024-03-27T07:32:38.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 1 -- 172.21.15.82:0/3795210045 wait complete. 2024-03-27T07:32:38.692 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.674+0000 7f0c5ab76740 20 client.17019 trim_cache size 0 max 16384 2024-03-27T07:32:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5ab76740 1 Processor -- start 2024-03-27T07:32:38.697 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5ab76740 1 -- start start 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba250f0 0x55b4cba2df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba25a10 0x55b4cba39eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cba463c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501b00a0 con 0x55b4cba250f0 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501ad8b0 con 0x55b4cba25a10 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501ab720 con 0x55b4cba2e7e0 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5552e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba250f0 0x55b4cba2df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5552e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba250f0 0x55b4cba2df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55264/0 (socket says 172.21.15.82:55264) 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5552e640 1 -- 172.21.15.82:0/1204339539 learned_addr learned my addr 172.21.15.82:0/1204339539 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/1204339539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba25a10 0x55b4cba39eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.698 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5552e640 1 --2- 172.21.15.82:0/1204339539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cba463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5552e640 1 -- 172.21.15.82:0/1204339539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 msgr2=0x55b4cba463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5552e640 1 --2- 172.21.15.82:0/1204339539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cba463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5552e640 1 -- 172.21.15.82:0/1204339539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba25a10 msgr2=0x55b4cba39eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5552e640 1 --2- 172.21.15.82:0/1204339539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba25a10 0x55b4cba39eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.689+0000 7f0c5552e640 1 -- 172.21.15.82:0/1204339539 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4cba41130 con 0x55b4cba250f0 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c5552e640 1 --2- 172.21.15.82:0/1204339539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba250f0 0x55b4cba2df00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0c40000c00 tx=0x7f0c40005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7ebe9d182f179 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c3b7fe640 1 -- 172.21.15.82:0/1204339539 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4001a040 con 0x55b4cba250f0 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c3b7fe640 1 -- 172.21.15.82:0/1204339539 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c400044d0 con 0x55b4cba250f0 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c3b7fe640 1 -- 172.21.15.82:0/1204339539 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40020780 con 0x55b4cba250f0 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1204339539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba250f0 msgr2=0x55b4cba2df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/1204339539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba250f0 0x55b4cba2df00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f0c40000c00 tx=0x7f0c40005f90 comp rx=0 tx=0).stop 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1204339539 shutdown_connections 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/1204339539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cba463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.699 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/1204339539 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba25a10 0x55b4cba39eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/1204339539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba250f0 0x55b4cba2df00 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1204339539 >> 172.21.15.82:0/1204339539 conn(0x55b4cba1fa10 msgr2=0x55b4cba20d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1204339539 shutdown_connections 2024-03-27T07:32:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.690+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1204339539 wait complete. 2024-03-27T07:32:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5ab76740 1 -- start start 2024-03-27T07:32:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5ab76740 1 Processor -- start 2024-03-27T07:32:38.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 0x55b4cba28b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba290a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5ab76740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cbaa39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501abd70 con 0x55b4cba25a10 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501ad1e0 con 0x55b4cba250f0 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5ab76740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0c501ac440 con 0x55b4cba2e7e0 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5ab76740 10 client.0 _ll_register_callbacks cb 0x7f0c40009a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c55d2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba290a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c55d2f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba290a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55272/0 (socket says 172.21.15.82:55272) 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c55d2f640 1 -- 172.21.15.82:0/1856887992 learned_addr learned my addr 172.21.15.82:0/1856887992 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5552e640 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 0x55b4cba28b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5552e640 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cbaa39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.701 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c55d2f640 1 -- 172.21.15.82:0/1856887992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 msgr2=0x55b4cbaa39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cbaa39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c55d2f640 1 -- 172.21.15.82:0/1856887992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 msgr2=0x55b4cba28b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 0x55b4cba28b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c55d2f640 1 -- 172.21.15.82:0/1856887992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4cbaa3fe0 con 0x55b4cba25a10 2024-03-27T07:32:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.691+0000 7f0c5552e640 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 0x55b4cba28b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:32:38.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c55d2f640 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba290a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x55b4cba2cda0 tx=0x7f0c4c009af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2f6272ef1516e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c397fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c397fa640 1 -- 172.21.15.82:0/1856887992 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c03c060 con 0x55b4cba25a10 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c397fa640 1 -- 172.21.15.82:0/1856887992 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8484+0+0 (secure 0 0 0) 0x7f0c4c01a440 con 0x55b4cba25a10 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1856887992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c400044d0 con 0x55b4cba25a10 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c397fa640 1 -- 172.21.15.82:0/1856887992 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0c4c027040 con 0x55b4cba25a10 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c5ab76740 10 client.17025 fetch_fsmap learned FSMap version 37 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1856887992 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b4cbaa52d0 con 0x55b4cba25a10 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c397fa640 1 -- 172.21.15.82:0/1856887992 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0c400044d0 con 0x55b4cba25a10 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c397fa640 1 -- 172.21.15.82:0/1856887992 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f0c4c018050 con 0x55b4cba25a10 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c5ab76740 10 client.17025 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:32:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c5ab76740 10 client.17025 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:32:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c5ab76740 20 client.17025 populate_metadata read hostname 'smithi082' 2024-03-27T07:32:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b4cbaa59f0 0x55b4cbaa7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c5ab76740 4 client.17025 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:32:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1856887992 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b4cb9906e0 con 0x55b4cbaa59f0 2024-03-27T07:32:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.692+0000 7f0c5552e640 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b4cbaa59f0 0x55b4cbaa7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.693+0000 7f0c397fa640 10 client.17025 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.693+0000 7f0c5552e640 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b4cbaa59f0 0x55b4cbaa7e10 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a96b0810be2ce47 server_cookie=5b0b1a277f9929e7 in_seq=0 out_seq=0 2024-03-27T07:32:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c397fa640 1 -- 172.21.15.82:0/1856887992 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b4cb9906e0 con 0x55b4cbaa59f0 2024-03-27T07:32:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c397fa640 10 client.17025 handle_command_reply: tid=0 2024-03-27T07:32:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 client.17025 shutdown 2024-03-27T07:32:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1856887992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 msgr2=0x55b4cba290a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba290a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x55b4cba2cda0 tx=0x7f0c4c009af0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1856887992 shutdown_connections 2024-03-27T07:32:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b4cbaa59f0 0x55b4cbaa7e10 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b4cba25a10 0x55b4cba290a0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c397fa640 0 client.17025 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b4cba2e7e0 0x55b4cbaa39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 --2- 172.21.15.82:0/1856887992 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b4cba250f0 0x55b4cba28b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1856887992 >> 172.21.15.82:0/1856887992 conn(0x55b4cba1fa10 msgr2=0x55b4cba21620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1856887992 shutdown_connections 2024-03-27T07:32:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 1 -- 172.21.15.82:0/1856887992 wait complete. 2024-03-27T07:32:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.847+0000 7f0c5ab76740 20 client.17025 trim_cache size 0 max 16384 2024-03-27T07:32:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:32:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:32:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:32:38.853 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:32:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 -- 172.21.15.82:0/2238805190 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0c3c0a3820 msgr2=0x7f0c3c0a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0c3c0a3820 0x7f0c3c0a5ce0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0c480bdee0 tx=0x7f0c480b3670 comp rx=0 tx=0).stop 2024-03-27T07:32:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 -- 172.21.15.82:0/2238805190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c501059f0 msgr2=0x7f0c5019cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c501059f0 0x7f0c5019cc70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f0c4802c700 tx=0x7f0c48032f20 comp rx=0 tx=0).stop 2024-03-27T07:32:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 -- 172.21.15.82:0/2238805190 shutdown_connections 2024-03-27T07:32:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0c3c0a3820 0x7f0c3c0a5ce0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c501059f0 0x7f0c5019cc70 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0c50101660 0x7f0c50198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 --2- 172.21.15.82:0/2238805190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0c50100ca0 0x7f0c50198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 -- 172.21.15.82:0/2238805190 >> 172.21.15.82:0/2238805190 conn(0x7f0c500778a0 msgr2=0x7f0c50069a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 -- 172.21.15.82:0/2238805190 shutdown_connections 2024-03-27T07:32:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:38.848+0000 7f0c57f93640 1 -- 172.21.15.82:0/2238805190 wait complete. 2024-03-27T07:32:39.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:38 smithi082 ceph-mon[32178]: pgmap v281: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 311 op/s 2024-03-27T07:32:39.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:38 smithi149 ceph-mon[36065]: pgmap v281: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 311 op/s 2024-03-27T07:32:39.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:38 smithi153 ceph-mon[36179]: pgmap v281: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 311 op/s 2024-03-27T07:32:41.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:40 smithi082 ceph-mon[32178]: pgmap v282: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 298 op/s 2024-03-27T07:32:41.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:40 smithi149 ceph-mon[36065]: pgmap v282: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 298 op/s 2024-03-27T07:32:41.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:40 smithi153 ceph-mon[36179]: pgmap v282: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 298 op/s 2024-03-27T07:32:43.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:42 smithi082 ceph-mon[32178]: pgmap v283: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 269 op/s 2024-03-27T07:32:43.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:42 smithi149 ceph-mon[36065]: pgmap v283: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 269 op/s 2024-03-27T07:32:43.290 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:42 smithi153 ceph-mon[36179]: pgmap v283: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.7 MiB/s wr, 269 op/s 2024-03-27T07:32:45.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:44 smithi082 ceph-mon[32178]: pgmap v284: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 399 op/s 2024-03-27T07:32:45.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:44 smithi149 ceph-mon[36065]: pgmap v284: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 399 op/s 2024-03-27T07:32:45.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:44 smithi153 ceph-mon[36179]: pgmap v284: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 399 op/s 2024-03-27T07:32:47.091 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:46 smithi153 ceph-mon[36179]: pgmap v285: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 323 op/s 2024-03-27T07:32:47.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:46 smithi082 ceph-mon[32178]: pgmap v285: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 323 op/s 2024-03-27T07:32:47.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:46 smithi149 ceph-mon[36065]: pgmap v285: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 323 op/s 2024-03-27T07:32:49.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:48 smithi082 ceph-mon[32178]: pgmap v286: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 409 op/s 2024-03-27T07:32:49.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:48 smithi149 ceph-mon[36065]: pgmap v286: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 409 op/s 2024-03-27T07:32:49.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:48 smithi153 ceph-mon[36179]: pgmap v286: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 409 op/s 2024-03-27T07:32:51.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:50 smithi082 ceph-mon[32178]: pgmap v287: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 273 op/s 2024-03-27T07:32:51.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:50 smithi149 ceph-mon[36065]: pgmap v287: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 273 op/s 2024-03-27T07:32:51.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:50 smithi153 ceph-mon[36179]: pgmap v287: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 273 op/s 2024-03-27T07:32:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.943+0000 7fe3d78c0640 1 -- 172.21.15.82:0/530777738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d0102dc0 msgr2=0x7fe3d01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.943+0000 7fe3d78c0640 1 --2- 172.21.15.82:0/530777738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d0102dc0 0x7fe3d01031a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc009900 tx=0x7fe3cc02bcd0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.943+0000 7fe3d78c0640 1 -- 172.21.15.82:0/530777738 shutdown_connections 2024-03-27T07:32:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.943+0000 7fe3d78c0640 1 --2- 172.21.15.82:0/530777738 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d010c190 0x7fe3d010e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.943+0000 7fe3d78c0640 1 --2- 172.21.15.82:0/530777738 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3d01036e0 0x7fe3d010bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.943+0000 7fe3d78c0640 1 --2- 172.21.15.82:0/530777738 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d0102dc0 0x7fe3d01031a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.947 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.943+0000 7fe3d78c0640 1 -- 172.21.15.82:0/530777738 >> 172.21.15.82:0/530777738 conn(0x7fe3d0077b70 msgr2=0x7fe3d0077f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:51.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.943+0000 7fe3d78c0640 1 -- 172.21.15.82:0/530777738 shutdown_connections 2024-03-27T07:32:51.948 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.944+0000 7fe3d78c0640 1 -- 172.21.15.82:0/530777738 wait complete. 2024-03-27T07:32:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.945+0000 7fe3d78c0640 1 Processor -- start 2024-03-27T07:32:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.945+0000 7fe3d78c0640 1 -- start start 2024-03-27T07:32:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.945+0000 7fe3d78c0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3d0102dc0 0x7fe3d0102610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.945+0000 7fe3d78c0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d01036e0 0x7fe3d0100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.945+0000 7fe3d78c0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d010c190 0x7fe3d0101050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.945+0000 7fe3d565c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3d0102dc0 0x7fe3d0102610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d565c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3d0102dc0 0x7fe3d0102610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:43782/0 (socket says 172.21.15.82:43782) 2024-03-27T07:32:51.949 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d565c640 1 -- 172.21.15.82:0/2532715834 learned_addr learned my addr 172.21.15.82:0/2532715834 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0111f20 con 0x7fe3d01036e0 2024-03-27T07:32:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0111da0 con 0x7fe3d010c190 2024-03-27T07:32:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01120a0 con 0x7fe3d0102dc0 2024-03-27T07:32:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d010c190 0x7fe3d0101050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d565c640 1 -- 172.21.15.82:0/2532715834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d010c190 msgr2=0x7fe3d0101050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d565c640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d010c190 0x7fe3d0101050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d565c640 1 -- 172.21.15.82:0/2532715834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d01036e0 msgr2=0x7fe3d0100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d565c640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d01036e0 0x7fe3d0100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d565c640 1 -- 172.21.15.82:0/2532715834 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d01aae60 con 0x7fe3d0102dc0 2024-03-27T07:32:51.950 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.946+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d010c190 0x7fe3d0101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:32:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.947+0000 7fe3d565c640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3d0102dc0 0x7fe3d0102610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc005940 tx=0x7fe3cc02cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.948+0000 7fe3c67fc640 1 -- 172.21.15.82:0/2532715834 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc041070 con 0x7fe3d0102dc0 2024-03-27T07:32:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.948+0000 7fe3c67fc640 1 -- 172.21.15.82:0/2532715834 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3cc004450 con 0x7fe3d0102dc0 2024-03-27T07:32:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.948+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d01ab030 con 0x7fe3d0102dc0 2024-03-27T07:32:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.948+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d01ab4f0 con 0x7fe3d0102dc0 2024-03-27T07:32:51.951 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.949+0000 7fe3c67fc640 1 -- 172.21.15.82:0/2532715834 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3cc003d80 con 0x7fe3d0102dc0 2024-03-27T07:32:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.951+0000 7fe3da585740 1 Processor -- start 2024-03-27T07:32:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3da585740 1 -- start start 2024-03-27T07:32:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3da585740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea154d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3da585740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea15a10 0x55f86ea1e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3da585740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea1e7e0 0x55f86ea20bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3da585740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f86e9dbcd0 con 0x55f86ea150f0 2024-03-27T07:32:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3da585740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f86e920950 con 0x55f86ea1e7e0 2024-03-27T07:32:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3da585740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f86e978e50 con 0x55f86ea15a10 2024-03-27T07:32:51.957 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3d5e5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea154d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3d5e5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea154d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59328/0 (socket says 172.21.15.82:59328) 2024-03-27T07:32:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1673215654 learned_addr learned my addr 172.21.15.82:0/1673215654 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3d4e5b640 1 --2- 172.21.15.82:0/1673215654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea1e7e0 0x55f86ea20bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1673215654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea15a10 msgr2=0x55f86ea1e2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:32:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1673215654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea15a10 0x55f86ea1e2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1673215654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea1e7e0 msgr2=0x55f86ea20bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1673215654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea1e7e0 0x55f86ea20bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.952+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1673215654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86e68d210 con 0x55f86ea150f0 2024-03-27T07:32:51.958 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.953+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1673215654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea154d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009ee0 tx=0x7fe3c800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108a180b72392871 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.953+0000 7fe3c67fc640 1 -- 172.21.15.82:0/2532715834 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fe3cc044070 con 0x7fe3d0102dc0 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.953+0000 7fe3bb7fe640 1 -- 172.21.15.82:0/1673215654 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8011640 con 0x55f86ea150f0 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.953+0000 7fe3bb7fe640 1 -- 172.21.15.82:0/1673215654 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3c8011cc0 con 0x55f86ea150f0 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.953+0000 7fe3bb7fe640 1 -- 172.21.15.82:0/1673215654 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8010d90 con 0x55f86ea150f0 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.953+0000 7fe3c67fc640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe3bc0a3980 0x7fe3bc0a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.953+0000 7fe3d565c640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe3bc0a3980 0x7fe3bc0a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.953+0000 7fe3c67fc640 1 -- 172.21.15.82:0/2532715834 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8484+0+0 (secure 0 0 0) 0x7fe3cc0f1b60 con 0x7fe3d0102dc0 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 -- 172.21.15.82:0/1673215654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 msgr2=0x55f86ea154d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 --2- 172.21.15.82:0/1673215654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea154d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009ee0 tx=0x7fe3c800f730 comp rx=0 tx=0).stop 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 -- 172.21.15.82:0/1673215654 shutdown_connections 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 --2- 172.21.15.82:0/1673215654 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea1e7e0 0x55f86ea20bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 --2- 172.21.15.82:0/1673215654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea15a10 0x55f86ea1e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 --2- 172.21.15.82:0/1673215654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea154d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 -- 172.21.15.82:0/1673215654 >> 172.21.15.82:0/1673215654 conn(0x55f86ea0fa10 msgr2=0x55f86ea0fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 -- 172.21.15.82:0/1673215654 shutdown_connections 2024-03-27T07:32:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 -- 172.21.15.82:0/1673215654 wait complete. 2024-03-27T07:32:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3d565c640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe3bc0a3980 0x7fe3bc0a5e40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55f86ea14ba0 tx=0x7fe3cc000bc0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 -- start start 2024-03-27T07:32:51.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.954+0000 7fe3da585740 1 Processor -- start 2024-03-27T07:32:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3da585740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea150f0 0x55f86ea1b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3da585740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea15a10 0x55f86ea1bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3da585740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3da585740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f86e974e00 con 0x55f86ea1e7e0 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3da585740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f86e921520 con 0x55f86ea150f0 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3da585740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f86e9348e0 con 0x55f86ea15a10 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d5e5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d5e5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59336/0 (socket says 172.21.15.82:59336) 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1163926125 learned_addr learned my addr 172.21.15.82:0/1163926125 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3da585740 10 client.0 _ll_register_callbacks cb 0x55f86e96fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d4e5b640 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea15a10 0x55f86ea1bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea150f0 0x55f86ea1b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1163926125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea15a10 msgr2=0x55f86ea1bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea15a10 0x55f86ea1bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1163926125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea150f0 msgr2=0x55f86ea1b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea150f0 0x55f86ea1b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1163926125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86e759620 con 0x55f86ea1e7e0 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1c2f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009cf0 tx=0x7fe3c8005a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a52fc0f5335cd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.955+0000 7fe3b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.956+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1163926125 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c802e060 con 0x55f86ea1e7e0 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.956+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1163926125 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8484+0+0 (secure 0 0 0) 0x7fe3c8011440 con 0x55f86ea1e7e0 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.956+0000 7fe3da585740 1 -- 172.21.15.82:0/1163926125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3c8011cc0 con 0x55f86ea1e7e0 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.956+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1163926125 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe3c8011640 con 0x55f86ea1e7e0 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.956+0000 7fe3da585740 10 client.17034 fetch_fsmap learned FSMap version 37 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.956+0000 7fe3da585740 1 -- 172.21.15.82:0/1163926125 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f86ea2d3f0 con 0x55f86ea1e7e0 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.957+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1163926125 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3c801b410 con 0x55f86ea1e7e0 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.958+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1163926125 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fe3c80293f0 con 0x55f86ea1e7e0 2024-03-27T07:32:51.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.959+0000 7fe3da585740 10 client.17034 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:32:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.959+0000 7fe3da585740 10 client.17034 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:32:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.959+0000 7fe3da585740 20 client.17034 populate_metadata read hostname 'smithi082' 2024-03-27T07:32:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.959+0000 7fe3da585740 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f86ea2e800 0x55f86ea30bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.959+0000 7fe3da585740 4 client.17034 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:32:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.959+0000 7fe3da585740 1 -- 172.21.15.82:0/1163926125 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe3c8011cc0 con 0x55f86ea2e800 2024-03-27T07:32:51.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.960+0000 7fe3d4e5b640 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f86ea2e800 0x55f86ea30bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.960+0000 7fe3d4e5b640 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f86ea2e800 0x55f86ea30bf0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c2ff52f3069526 server_cookie=23c9b63e90915193 in_seq=0 out_seq=0 2024-03-27T07:32:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.960+0000 7fe3b8ff9640 10 client.17034 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.962+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1163926125 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7fe3c8011cc0 con 0x55f86ea2e800 2024-03-27T07:32:51.966 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.962+0000 7fe3b8ff9640 10 client.17034 handle_command_reply: tid=0 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.962+0000 7fe3da585740 1 client.17034 shutdown 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.962+0000 7fe3da585740 1 -- 172.21.15.82:0/1163926125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea1e7e0 msgr2=0x55f86ea1c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.962+0000 7fe3da585740 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1c2f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009cf0 tx=0x7fe3c8005a50 comp rx=0 tx=0).stop 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.963+0000 7fe3da585740 1 -- 172.21.15.82:0/1163926125 shutdown_connections 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.963+0000 7fe3da585740 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f86ea2e800 0x55f86ea30bf0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.963+0000 7fe3b8ff9640 0 client.17034 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.963+0000 7fe3da585740 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1c2f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.963+0000 7fe3da585740 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea15a10 0x55f86ea1bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.963+0000 7fe3da585740 1 --2- 172.21.15.82:0/1163926125 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea150f0 0x55f86ea1b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.963+0000 7fe3da585740 1 -- 172.21.15.82:0/1163926125 >> 172.21.15.82:0/1163926125 conn(0x55f86ea0fa10 msgr2=0x55f86ea11760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.963+0000 7fe3da585740 1 -- 172.21.15.82:0/1163926125 shutdown_connections 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.963+0000 7fe3da585740 1 -- 172.21.15.82:0/1163926125 wait complete. 2024-03-27T07:32:51.967 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.963+0000 7fe3da585740 20 client.17034 trim_cache size 0 max 16384 2024-03-27T07:32:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.987+0000 7fe3da585740 1 Processor -- start 2024-03-27T07:32:51.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.989+0000 7fe3da585740 1 -- start start 2024-03-27T07:32:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.989+0000 7fe3da585740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea150f0 0x55f86ea1dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.989+0000 7fe3da585740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea15a10 0x55f86ea29eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.990+0000 7fe3da585740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.990+0000 7fe3da585740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b66d0 con 0x55f86ea15a10 2024-03-27T07:32:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.990+0000 7fe3da585740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b3ee0 con 0x55f86ea150f0 2024-03-27T07:32:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.990+0000 7fe3da585740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b1d50 con 0x55f86ea1e7e0 2024-03-27T07:32:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.990+0000 7fe3d5e5d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.990+0000 7fe3d5e5d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:43794/0 (socket says 172.21.15.82:43794) 2024-03-27T07:32:51.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.990+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/2535385506 learned_addr learned my addr 172.21.15.82:0/2535385506 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:51.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.990+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/2535385506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea150f0 0x55f86ea1dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.991+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/2535385506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea150f0 msgr2=0x55f86ea1dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.991+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/2535385506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea150f0 0x55f86ea1dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.991+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/2535385506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea15a10 msgr2=0x55f86ea29eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.991+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/2535385506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea15a10 0x55f86ea29eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.991+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/2535385506 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f86ea2a3f0 con 0x55f86ea1e7e0 2024-03-27T07:32:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.991+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/2535385506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1a850 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009540 tx=0x7fe3c800f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85ee5418abef2d81 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.991+0000 7fe3baffd640 1 -- 172.21.15.82:0/2535385506 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c802e070 con 0x55f86ea1e7e0 2024-03-27T07:32:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.991+0000 7fe3baffd640 1 -- 172.21.15.82:0/2535385506 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3c8010d20 con 0x55f86ea1e7e0 2024-03-27T07:32:51.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.991+0000 7fe3baffd640 1 -- 172.21.15.82:0/2535385506 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8029a30 con 0x55f86ea1e7e0 2024-03-27T07:32:51.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.992+0000 7fe3da585740 1 -- 172.21.15.82:0/2535385506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 msgr2=0x55f86ea1a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.992+0000 7fe3da585740 1 --2- 172.21.15.82:0/2535385506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1a850 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009540 tx=0x7fe3c800f730 comp rx=0 tx=0).stop 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.992+0000 7fe3da585740 1 -- 172.21.15.82:0/2535385506 shutdown_connections 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.992+0000 7fe3da585740 1 --2- 172.21.15.82:0/2535385506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea15a10 0x55f86ea29eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.992+0000 7fe3da585740 1 --2- 172.21.15.82:0/2535385506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 0x55f86ea1a850 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.992+0000 7fe3da585740 1 --2- 172.21.15.82:0/2535385506 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea150f0 0x55f86ea1dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.992+0000 7fe3da585740 1 -- 172.21.15.82:0/2535385506 >> 172.21.15.82:0/2535385506 conn(0x55f86ea0fa10 msgr2=0x55f86ea1a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.992+0000 7fe3da585740 1 -- 172.21.15.82:0/2535385506 shutdown_connections 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.992+0000 7fe3da585740 1 -- 172.21.15.82:0/2535385506 wait complete. 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.993+0000 7fe3da585740 1 -- start start 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.993+0000 7fe3da585740 1 Processor -- start 2024-03-27T07:32:51.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.993+0000 7fe3da585740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea265b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.993+0000 7fe3da585740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea15a10 0x55f86ea21ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.993+0000 7fe3da585740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 0x55f86ea22000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.993+0000 7fe3da585740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b23a0 con 0x55f86ea150f0 2024-03-27T07:32:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.993+0000 7fe3da585740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b3810 con 0x55f86ea15a10 2024-03-27T07:32:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.993+0000 7fe3da585740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01b2a70 con 0x55f86ea1e7e0 2024-03-27T07:32:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.993+0000 7fe3da585740 10 client.0 _ll_register_callbacks cb 0x7fe3c8015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:32:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.993+0000 7fe3d5e5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea265b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3d5e5d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea265b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59354/0 (socket says 172.21.15.82:59354) 2024-03-27T07:32:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1799782015 learned_addr learned my addr 172.21.15.82:0/1799782015 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:32:52.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 0x55f86ea22000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3d4e5b640 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea15a10 0x55f86ea21ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1799782015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 msgr2=0x55f86ea22000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 0x55f86ea22000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1799782015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea15a10 msgr2=0x55f86ea21ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea15a10 0x55f86ea21ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3d5e5d640 1 -- 172.21.15.82:0/1799782015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f86ea22640 con 0x55f86ea150f0 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3d5e5d640 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea265b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8029fd0 tx=0x7fe3c80295e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9137716ed914f796 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3b8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1799782015 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c802e070 con 0x55f86ea150f0 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3da585740 1 -- 172.21.15.82:0/1799782015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3c8010d20 con 0x55f86ea150f0 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.994+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1799782015 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 8484+0+0 (secure 0 0 0) 0x7fe3c8029c40 con 0x55f86ea150f0 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1799782015 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe3c80293f0 con 0x55f86ea150f0 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3da585740 10 client.17037 fetch_fsmap learned FSMap version 37 2024-03-27T07:32:52.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3da585740 1 -- 172.21.15.82:0/1799782015 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f86ea948b0 con 0x55f86ea150f0 2024-03-27T07:32:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1799782015 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3c8010d20 con 0x55f86ea150f0 2024-03-27T07:32:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1799782015 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fe3c8011cb0 con 0x55f86ea150f0 2024-03-27T07:32:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3da585740 10 client.17037 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:32:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3da585740 10 client.17037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:32:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3da585740 20 client.17037 populate_metadata read hostname 'smithi082' 2024-03-27T07:32:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3da585740 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f86ea2e800 0x55f86ea96fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:32:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3da585740 4 client.17037 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:32:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3da585740 1 -- 172.21.15.82:0/1799782015 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f86e986390 con 0x55f86ea2e800 2024-03-27T07:32:52.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.995+0000 7fe3d4e5b640 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f86ea2e800 0x55f86ea96fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:32:52.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.996+0000 7fe3d4e5b640 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f86ea2e800 0x55f86ea96fc0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e50a409c740a7fd0 server_cookie=b0ee8012307cfde1 in_seq=0 out_seq=0 2024-03-27T07:32:52.003 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:51.996+0000 7fe3b8ff9640 10 client.17037 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.216+0000 7fe3b8ff9640 1 -- 172.21.15.82:0/1799782015 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f86e986390 con 0x55f86ea2e800 2024-03-27T07:32:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.216+0000 7fe3b8ff9640 10 client.17037 handle_command_reply: tid=0 2024-03-27T07:32:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.216+0000 7fe3da585740 1 client.17037 shutdown 2024-03-27T07:32:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.216+0000 7fe3da585740 1 -- 172.21.15.82:0/1799782015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 msgr2=0x55f86ea265b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.216+0000 7fe3da585740 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea265b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8029fd0 tx=0x7fe3c80295e0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3da585740 1 -- 172.21.15.82:0/1799782015 shutdown_connections 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3da585740 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f86ea1e7e0 0x55f86ea22000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3da585740 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f86ea15a10 0x55f86ea21ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3da585740 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f86ea2e800 0x55f86ea96fc0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3da585740 1 --2- 172.21.15.82:0/1799782015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f86ea150f0 0x55f86ea265b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3da585740 1 -- 172.21.15.82:0/1799782015 >> 172.21.15.82:0/1799782015 conn(0x55f86ea0fa10 msgr2=0x55f86ea10e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3b8ff9640 0 client.17037 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3da585740 1 -- 172.21.15.82:0/1799782015 shutdown_connections 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3da585740 1 -- 172.21.15.82:0/1799782015 wait complete. 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3da585740 20 client.17037 trim_cache size 0 max 16384 2024-03-27T07:32:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:32:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:32:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:32:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:32:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe3bc0a3980 msgr2=0x7fe3bc0a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe3bc0a3980 0x7fe3bc0a5e40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55f86ea14ba0 tx=0x7fe3cc000bc0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3d0102dc0 msgr2=0x7fe3d0102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3d0102dc0 0x7fe3d0102610 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc005940 tx=0x7fe3cc02cbd0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 shutdown_connections 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe3bc0a3980 0x7fe3bc0a5e40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3d01036e0 0x7fe3d0100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe3d010c190 0x7fe3d0101050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 --2- 172.21.15.82:0/2532715834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3d0102dc0 0x7fe3d0102610 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 >> 172.21.15.82:0/2532715834 conn(0x7fe3d0077b70 msgr2=0x7fe3d00fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 shutdown_connections 2024-03-27T07:32:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:32:52.217+0000 7fe3d78c0640 1 -- 172.21.15.82:0/2532715834 wait complete. 2024-03-27T07:32:53.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:52 smithi082 ceph-mon[32178]: pgmap v288: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 252 op/s 2024-03-27T07:32:53.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:52 smithi149 ceph-mon[36065]: pgmap v288: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 252 op/s 2024-03-27T07:32:53.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:52 smithi153 ceph-mon[36179]: pgmap v288: 97 pgs: 97 active+clean; 1.8 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 252 op/s 2024-03-27T07:32:55.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:54 smithi082 ceph-mon[32178]: pgmap v289: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 343 op/s 2024-03-27T07:32:55.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:54 smithi149 ceph-mon[36065]: pgmap v289: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 343 op/s 2024-03-27T07:32:55.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:54 smithi153 ceph-mon[36179]: pgmap v289: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.7 MiB/s wr, 343 op/s 2024-03-27T07:32:57.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:56 smithi082 ceph-mon[32178]: pgmap v290: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 229 op/s 2024-03-27T07:32:57.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:56 smithi149 ceph-mon[36065]: pgmap v290: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 229 op/s 2024-03-27T07:32:57.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:56 smithi153 ceph-mon[36179]: pgmap v290: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 229 op/s 2024-03-27T07:32:59.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:32:58 smithi082 ceph-mon[32178]: pgmap v291: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 285 op/s 2024-03-27T07:32:59.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:32:58 smithi149 ceph-mon[36065]: pgmap v291: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 285 op/s 2024-03-27T07:32:59.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:32:58 smithi153 ceph-mon[36179]: pgmap v291: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 285 op/s 2024-03-27T07:33:01.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:00 smithi082 ceph-mon[32178]: pgmap v292: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 194 op/s 2024-03-27T07:33:01.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:00 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:33:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:00 smithi149 ceph-mon[36065]: pgmap v292: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 194 op/s 2024-03-27T07:33:01.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:00 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:33:01.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:00 smithi153 ceph-mon[36179]: pgmap v292: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 194 op/s 2024-03-27T07:33:01.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:00 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:33:02.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:01 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:33:02.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:01 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:33:02.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:01 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:33:02.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:01 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:33:02.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:01 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:33:02.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:01 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:33:02.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:01 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:33:02.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:01 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:33:02.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:01 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:33:03.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:02 smithi082 ceph-mon[32178]: pgmap v293: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 182 op/s 2024-03-27T07:33:03.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:02 smithi149 ceph-mon[36065]: pgmap v293: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 182 op/s 2024-03-27T07:33:03.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:02 smithi153 ceph-mon[36179]: pgmap v293: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 182 op/s 2024-03-27T07:33:05.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:04 smithi082 ceph-mon[32178]: pgmap v294: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 285 op/s 2024-03-27T07:33:05.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:04 smithi149 ceph-mon[36065]: pgmap v294: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 285 op/s 2024-03-27T07:33:05.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:04 smithi153 ceph-mon[36179]: pgmap v294: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 285 op/s 2024-03-27T07:33:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.354+0000 7fe6a48fc640 1 -- 172.21.15.82:0/3209383624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6980089d0 msgr2=0x7fe698006d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.354+0000 7fe6a48fc640 1 --2- 172.21.15.82:0/3209383624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6980089d0 0x7fe698006d60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fe690009900 tx=0x7fe69002bc60 comp rx=0 tx=0).stop 2024-03-27T07:33:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.354+0000 7fe6a48fc640 1 -- 172.21.15.82:0/3209383624 shutdown_connections 2024-03-27T07:33:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.354+0000 7fe6a48fc640 1 --2- 172.21.15.82:0/3209383624 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6980a6b60 0x7fe6980a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.354+0000 7fe6a48fc640 1 --2- 172.21.15.82:0/3209383624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6980072a0 0x7fe698007720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.354+0000 7fe6a48fc640 1 --2- 172.21.15.82:0/3209383624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6980089d0 0x7fe698006d60 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.354+0000 7fe6a48fc640 1 -- 172.21.15.82:0/3209383624 >> 172.21.15.82:0/3209383624 conn(0x7fe69800cb30 msgr2=0x7fe69800cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.357+0000 7fe6a48fc640 1 -- 172.21.15.82:0/3209383624 shutdown_connections 2024-03-27T07:33:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.357+0000 7fe6a48fc640 1 -- 172.21.15.82:0/3209383624 wait complete. 2024-03-27T07:33:05.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.358+0000 7fe6a48fc640 1 Processor -- start 2024-03-27T07:33:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.358+0000 7fe6a48fc640 1 -- start start 2024-03-27T07:33:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.358+0000 7fe6a48fc640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6980072a0 0x7fe698132d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.358+0000 7fe6a48fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6980089d0 0x7fe6981332b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.359+0000 7fe6a48fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6980a6b60 0x7fe698137630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.359+0000 7fe6a48fc640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6980ac8f0 con 0x7fe6980072a0 2024-03-27T07:33:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.359+0000 7fe6a48fc640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe6980ac770 con 0x7fe6980089d0 2024-03-27T07:33:05.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.359+0000 7fe6a48fc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe6980aca70 con 0x7fe6980a6b60 2024-03-27T07:33:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.359+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6980072a0 0x7fe698132d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.359+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6980072a0 0x7fe698132d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43014/0 (socket says 172.21.15.82:43014) 2024-03-27T07:33:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.359+0000 7fe69f7fe640 1 -- 172.21.15.82:0/1174296322 learned_addr learned my addr 172.21.15.82:0/1174296322 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:05.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.359+0000 7fe69ffff640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6980a6b60 0x7fe698137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.360+0000 7fe69f7fe640 1 -- 172.21.15.82:0/1174296322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6980a6b60 msgr2=0x7fe698137630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.360+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6980a6b60 0x7fe698137630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.360+0000 7fe69f7fe640 1 -- 172.21.15.82:0/1174296322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6980089d0 msgr2=0x7fe6981332b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:33:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.360+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6980089d0 0x7fe6981332b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.360+0000 7fe69f7fe640 1 -- 172.21.15.82:0/1174296322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe698137d30 con 0x7fe6980072a0 2024-03-27T07:33:05.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.360+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6980072a0 0x7fe698132d70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe690000c00 tx=0x7fe6900045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.361+0000 7fe69cff9640 1 -- 172.21.15.82:0/1174296322 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690041070 con 0x7fe6980072a0 2024-03-27T07:33:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.361+0000 7fe6a48fc640 1 -- 172.21.15.82:0/1174296322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe698137fc0 con 0x7fe6980072a0 2024-03-27T07:33:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.361+0000 7fe6a48fc640 1 -- 172.21.15.82:0/1174296322 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe69809a330 con 0x7fe6980072a0 2024-03-27T07:33:05.364 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.361+0000 7fe69cff9640 1 -- 172.21.15.82:0/1174296322 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe69002cd40 con 0x7fe6980072a0 2024-03-27T07:33:05.365 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.362+0000 7fe69cff9640 1 -- 172.21.15.82:0/1174296322 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690034440 con 0x7fe6980072a0 2024-03-27T07:33:05.367 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.364+0000 7fe69cff9640 1 -- 172.21.15.82:0/1174296322 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fe690044070 con 0x7fe6980072a0 2024-03-27T07:33:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.365+0000 7fe69cff9640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe6880a3860 0x7fe6880a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.368 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.366+0000 7fe69cff9640 1 -- 172.21.15.82:0/1174296322 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8528+0+0 (secure 0 0 0) 0x7fe6900f1d10 con 0x7fe6980072a0 2024-03-27T07:33:05.370 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.367+0000 7fe69effd640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe6880a3860 0x7fe6880a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.370+0000 7fe69effd640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe6880a3860 0x7fe6880a5d20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe6980a6120 tx=0x7fe694006bd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:05.373 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.370+0000 7fe6a8826740 1 Processor -- start 2024-03-27T07:33:05.374 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.371+0000 7fe6a8826740 1 -- start start 2024-03-27T07:33:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.371+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c58302290 0x556c58302670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.371+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302bb0 0x556c5830b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.371+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c5830b980 0x556c5830dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe6a8826740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556c582c8cd0 con 0x556c58302290 2024-03-27T07:33:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe6a8826740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556c5820d950 con 0x556c5830b980 2024-03-27T07:33:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe6a8826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556c58265e50 con 0x556c58302bb0 2024-03-27T07:33:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c58302290 0x556c58302670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c58302290 0x556c58302670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43026/0 (socket says 172.21.15.82:43026) 2024-03-27T07:33:05.375 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe69f7fe640 1 -- 172.21.15.82:0/1432872786 learned_addr learned my addr 172.21.15.82:0/1432872786 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe69f7fe640 1 -- 172.21.15.82:0/1432872786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302bb0 msgr2=0x556c5830b440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:33:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/1432872786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302bb0 0x556c5830b440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe69f7fe640 1 -- 172.21.15.82:0/1432872786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c5830b980 msgr2=0x556c5830dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/1432872786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c5830b980 0x556c5830dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.372+0000 7fe69f7fe640 1 -- 172.21.15.82:0/1432872786 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c57f7a210 con 0x556c58302290 2024-03-27T07:33:05.376 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.373+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/1432872786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c58302290 0x556c58302670 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe6900c66b0 tx=0x7fe6900bdbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d759eba544dc25 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.374+0000 7fe685ffb640 1 -- 172.21.15.82:0/1432872786 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69004b040 con 0x556c58302290 2024-03-27T07:33:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.374+0000 7fe685ffb640 1 -- 172.21.15.82:0/1432872786 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6900be670 con 0x556c58302290 2024-03-27T07:33:05.377 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.374+0000 7fe685ffb640 1 -- 172.21.15.82:0/1432872786 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900be430 con 0x556c58302290 2024-03-27T07:33:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.375+0000 7fe6a8826740 1 -- 172.21.15.82:0/1432872786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c58302290 msgr2=0x556c58302670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.375+0000 7fe6a8826740 1 --2- 172.21.15.82:0/1432872786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c58302290 0x556c58302670 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe6900c66b0 tx=0x7fe6900bdbe0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.375+0000 7fe6a8826740 1 -- 172.21.15.82:0/1432872786 shutdown_connections 2024-03-27T07:33:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.375+0000 7fe6a8826740 1 --2- 172.21.15.82:0/1432872786 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c5830b980 0x556c5830dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.375+0000 7fe6a8826740 1 --2- 172.21.15.82:0/1432872786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302bb0 0x556c5830b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.375+0000 7fe6a8826740 1 --2- 172.21.15.82:0/1432872786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c58302290 0x556c58302670 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.379 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.375+0000 7fe6a8826740 1 -- 172.21.15.82:0/1432872786 >> 172.21.15.82:0/1432872786 conn(0x556c582fcbb0 msgr2=0x556c582fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.379+0000 7fe6a8826740 1 -- 172.21.15.82:0/1432872786 shutdown_connections 2024-03-27T07:33:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.379+0000 7fe6a8826740 1 -- 172.21.15.82:0/1432872786 wait complete. 2024-03-27T07:33:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.380+0000 7fe6a8826740 1 -- start start 2024-03-27T07:33:05.383 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.380+0000 7fe6a8826740 1 Processor -- start 2024-03-27T07:33:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.381+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58308920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.381+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c58308e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.381+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c583093a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.381+0000 7fe6a8826740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556c58261e00 con 0x556c5830b980 2024-03-27T07:33:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.381+0000 7fe6a8826740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556c5820e520 con 0x556c58302bb0 2024-03-27T07:33:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.381+0000 7fe6a8826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556c582218e0 con 0x556c58302290 2024-03-27T07:33:05.384 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.381+0000 7fe6a8826740 10 client.0 _ll_register_callbacks cb 0x556c5825ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:33:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.383+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58308920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.383+0000 7fe69ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c583093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.383+0000 7fe69ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c583093a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43042/0 (socket says 172.21.15.82:43042) 2024-03-27T07:33:05.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.383+0000 7fe69ffff640 1 -- 172.21.15.82:0/755910570 learned_addr learned my addr 172.21.15.82:0/755910570 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.384+0000 7fe69f7fe640 1 -- 172.21.15.82:0/755910570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 msgr2=0x556c58308e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.384+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c58308e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.384+0000 7fe69f7fe640 1 -- 172.21.15.82:0/755910570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 msgr2=0x556c583093a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.384+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c583093a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.384+0000 7fe69f7fe640 1 -- 172.21.15.82:0/755910570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c58046620 con 0x556c58302290 2024-03-27T07:33:05.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.385+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58308920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe690004650 tx=0x7fe6900ef6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f684ff47d11771d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.386+0000 7fe67effd640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:33:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.386+0000 7fe67effd640 1 -- 172.21.15.82:0/755910570 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6900dc060 con 0x556c58302290 2024-03-27T07:33:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.386+0000 7fe6a8826740 1 -- 172.21.15.82:0/755910570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6900be670 con 0x556c58302290 2024-03-27T07:33:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.386+0000 7fe67effd640 1 -- 172.21.15.82:0/755910570 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8528+0+0 (secure 0 0 0) 0x7fe6900c6750 con 0x556c58302290 2024-03-27T07:33:05.389 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.386+0000 7fe67effd640 1 -- 172.21.15.82:0/755910570 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe69004b030 con 0x556c58302290 2024-03-27T07:33:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.388+0000 7fe6a8826740 10 client.26908 fetch_fsmap learned FSMap version 37 2024-03-27T07:33:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.388+0000 7fe6a8826740 1 -- 172.21.15.82:0/755910570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556c5832b170 con 0x556c58302290 2024-03-27T07:33:05.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.389+0000 7fe67effd640 1 -- 172.21.15.82:0/755910570 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6900be670 con 0x556c58302290 2024-03-27T07:33:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.389+0000 7fe67effd640 1 -- 172.21.15.82:0/755910570 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fe6900bd3c0 con 0x556c58302290 2024-03-27T07:33:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.389+0000 7fe6a8826740 10 client.26908 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:33:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.389+0000 7fe6a8826740 10 client.26908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:33:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.389+0000 7fe6a8826740 20 client.26908 populate_metadata read hostname 'smithi082' 2024-03-27T07:33:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.389+0000 7fe6a8826740 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556c5832c2f0 0x556c5832e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.389+0000 7fe6a8826740 4 client.26908 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:33:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.389+0000 7fe6a8826740 1 -- 172.21.15.82:0/755910570 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c58273390 con 0x556c5832c2f0 2024-03-27T07:33:05.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.390+0000 7fe69effd640 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556c5832c2f0 0x556c5832e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.393+0000 7fe69effd640 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556c5832c2f0 0x556c5832e6e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec7d72488dc1e72c server_cookie=8da41e9a6d1c44fe in_seq=0 out_seq=0 2024-03-27T07:33:05.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.393+0000 7fe67effd640 10 client.26908 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.394+0000 7fe67effd640 1 -- 172.21.15.82:0/755910570 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556c58273390 con 0x556c5832c2f0 2024-03-27T07:33:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.394+0000 7fe67effd640 10 client.26908 handle_command_reply: tid=0 2024-03-27T07:33:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.394+0000 7fe6a8826740 1 client.26908 shutdown 2024-03-27T07:33:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.395+0000 7fe6a8826740 1 -- 172.21.15.82:0/755910570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 msgr2=0x556c58308920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:05.397 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.395+0000 7fe6a8826740 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58308920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe690004650 tx=0x7fe6900ef6a0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.395+0000 7fe6a8826740 1 -- 172.21.15.82:0/755910570 shutdown_connections 2024-03-27T07:33:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.395+0000 7fe6a8826740 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556c5832c2f0 0x556c5832e6e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.395+0000 7fe6a8826740 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c583093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.395+0000 7fe6a8826740 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c58308e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.395+0000 7fe6a8826740 1 --2- 172.21.15.82:0/755910570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58308920 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.395+0000 7fe6a8826740 1 -- 172.21.15.82:0/755910570 >> 172.21.15.82:0/755910570 conn(0x556c582fcbb0 msgr2=0x556c582fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.395+0000 7fe67effd640 0 client.26908 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:05.398 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.396+0000 7fe6a8826740 1 -- 172.21.15.82:0/755910570 shutdown_connections 2024-03-27T07:33:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.396+0000 7fe6a8826740 1 -- 172.21.15.82:0/755910570 wait complete. 2024-03-27T07:33:05.399 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.397+0000 7fe6a8826740 20 client.26908 trim_cache size 0 max 16384 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe6a8826740 1 Processor -- start 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe6a8826740 1 -- start start 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58327d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c583091c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c58333f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe6a8826740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c011180 con 0x556c5830b980 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe6a8826740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c00e990 con 0x556c58302bb0 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe6a8826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c00c7e0 con 0x556c58302290 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58327d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe69f7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58327d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:54420/0 (socket says 172.21.15.82:54420) 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.430+0000 7fe69f7fe640 1 -- 172.21.15.82:0/514167720 learned_addr learned my addr 172.21.15.82:0/514167720 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.431+0000 7fe69effd640 1 --2- 172.21.15.82:0/514167720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c583091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.432+0000 7fe69ffff640 1 --2- 172.21.15.82:0/514167720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c58333f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.432+0000 7fe69effd640 1 -- 172.21.15.82:0/514167720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 msgr2=0x556c58327d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.432+0000 7fe69effd640 1 --2- 172.21.15.82:0/514167720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58327d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.437 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.432+0000 7fe69effd640 1 -- 172.21.15.82:0/514167720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 msgr2=0x556c58333f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.432+0000 7fe69effd640 1 --2- 172.21.15.82:0/514167720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c58333f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.432+0000 7fe69effd640 1 -- 172.21.15.82:0/514167720 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c58301b70 con 0x556c58302bb0 2024-03-27T07:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.433+0000 7fe69effd640 1 --2- 172.21.15.82:0/514167720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c583091c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x556c5832ef00 tx=0x7fe69400e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef3d40477fc67dc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.433+0000 7fe6857fa640 1 -- 172.21.15.82:0/514167720 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6940213b0 con 0x556c58302bb0 2024-03-27T07:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.433+0000 7fe6857fa640 1 -- 172.21.15.82:0/514167720 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe694025030 con 0x556c58302bb0 2024-03-27T07:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.433+0000 7fe6857fa640 1 -- 172.21.15.82:0/514167720 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69401f650 con 0x556c58302bb0 2024-03-27T07:33:05.438 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.434+0000 7fe6a8826740 1 -- 172.21.15.82:0/514167720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 msgr2=0x556c583091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.434+0000 7fe6a8826740 1 --2- 172.21.15.82:0/514167720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c583091c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x556c5832ef00 tx=0x7fe69400e000 comp rx=0 tx=0).stop 2024-03-27T07:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.436+0000 7fe6a8826740 1 -- 172.21.15.82:0/514167720 shutdown_connections 2024-03-27T07:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.436+0000 7fe6a8826740 1 --2- 172.21.15.82:0/514167720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c58333f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.436+0000 7fe6a8826740 1 --2- 172.21.15.82:0/514167720 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c583091c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.436+0000 7fe6a8826740 1 --2- 172.21.15.82:0/514167720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58327d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.439 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.436+0000 7fe6a8826740 1 -- 172.21.15.82:0/514167720 >> 172.21.15.82:0/514167720 conn(0x556c582fcbb0 msgr2=0x556c582fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:05.440 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.437+0000 7fe6a8826740 1 -- 172.21.15.82:0/514167720 shutdown_connections 2024-03-27T07:33:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.440+0000 7fe6a8826740 1 -- 172.21.15.82:0/514167720 wait complete. 2024-03-27T07:33:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.440+0000 7fe6a8826740 1 -- start start 2024-03-27T07:33:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.441+0000 7fe6a8826740 1 Processor -- start 2024-03-27T07:33:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.441+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58313b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.441+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c58314050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.441+0000 7fe6a8826740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c58305720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.441+0000 7fe6a8826740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c00ce50 con 0x556c5830b980 2024-03-27T07:33:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.441+0000 7fe6a8826740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c00e2c0 con 0x556c58302bb0 2024-03-27T07:33:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.441+0000 7fe6a8826740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c00d520 con 0x556c58302290 2024-03-27T07:33:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.441+0000 7fe6a8826740 10 client.0 _ll_register_callbacks cb 0x7fe6900c6be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:33:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.442+0000 7fe69effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c58314050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.442+0000 7fe69effd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c58314050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:58546/0 (socket says 172.21.15.82:58546) 2024-03-27T07:33:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.442+0000 7fe69effd640 1 -- 172.21.15.82:0/331595358 learned_addr learned my addr 172.21.15.82:0/331595358 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.443+0000 7fe69ffff640 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c58305720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.443+0000 7fe69effd640 1 -- 172.21.15.82:0/331595358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 msgr2=0x556c58313b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.443+0000 7fe69effd640 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58313b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.443+0000 7fe69effd640 1 -- 172.21.15.82:0/331595358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 msgr2=0x556c58305720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.443+0000 7fe69effd640 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c58305720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.443+0000 7fe69effd640 1 -- 172.21.15.82:0/331595358 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c58305f50 con 0x556c58302bb0 2024-03-27T07:33:05.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.444+0000 7fe69effd640 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c58314050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe6940094f0 tx=0x7fe694012ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=210f73d4f6bdde22 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.444+0000 7fe67effd640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:33:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.447+0000 7fe67effd640 1 -- 172.21.15.82:0/331595358 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe694037060 con 0x556c58302bb0 2024-03-27T07:33:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.447+0000 7fe67effd640 1 -- 172.21.15.82:0/331595358 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8528+0+0 (secure 0 0 0) 0x7fe694012960 con 0x556c58302bb0 2024-03-27T07:33:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.447+0000 7fe6a8826740 1 -- 172.21.15.82:0/331595358 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe694025030 con 0x556c58302bb0 2024-03-27T07:33:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.449+0000 7fe67effd640 1 -- 172.21.15.82:0/331595358 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe694012e80 con 0x556c58302bb0 2024-03-27T07:33:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.450+0000 7fe6a8826740 10 client.26888 fetch_fsmap learned FSMap version 37 2024-03-27T07:33:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.450+0000 7fe6a8826740 1 -- 172.21.15.82:0/331595358 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x556c5831c2f0 con 0x556c58302bb0 2024-03-27T07:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.451+0000 7fe67effd640 1 -- 172.21.15.82:0/331595358 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe694025030 con 0x556c58302bb0 2024-03-27T07:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.451+0000 7fe67effd640 1 -- 172.21.15.82:0/331595358 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fe694012070 con 0x556c58302bb0 2024-03-27T07:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.451+0000 7fe6a8826740 10 client.26888 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.451+0000 7fe6a8826740 10 client.26888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:33:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.451+0000 7fe6a8826740 20 client.26888 populate_metadata read hostname 'smithi082' 2024-03-27T07:33:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.451+0000 7fe6a8826740 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556c5831ca00 0x556c5831ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.451+0000 7fe6a8826740 4 client.26888 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:33:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.451+0000 7fe6a8826740 1 -- 172.21.15.82:0/331595358 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556c5826d6e0 con 0x556c5831ca00 2024-03-27T07:33:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.452+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556c5831ca00 0x556c5831ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.454+0000 7fe69f7fe640 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556c5831ca00 0x556c5831ee20 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=959d011916f4813c server_cookie=62a872cab7707b7a in_seq=0 out_seq=0 2024-03-27T07:33:05.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:05.455+0000 7fe67effd640 10 client.26888 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:06.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:05 smithi082 ceph-mon[32178]: osdmap e97: 12 total, 12 up, 12 in 2024-03-27T07:33:06.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:05 smithi082 ceph-mon[32178]: pgmap v296: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 227 op/s 2024-03-27T07:33:06.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:05 smithi149 ceph-mon[36065]: osdmap e97: 12 total, 12 up, 12 in 2024-03-27T07:33:06.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:05 smithi149 ceph-mon[36065]: pgmap v296: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 227 op/s 2024-03-27T07:33:06.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:05 smithi153 ceph-mon[36179]: osdmap e97: 12 total, 12 up, 12 in 2024-03-27T07:33:06.289 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:05 smithi153 ceph-mon[36179]: pgmap v296: 97 pgs: 97 active+clean; 1.9 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 227 op/s 2024-03-27T07:33:08.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:08 smithi149 ceph-mon[36065]: pgmap v297: 97 pgs: 30 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 49 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 253 op/s 2024-03-27T07:33:08.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:08 smithi153 ceph-mon[36179]: pgmap v297: 97 pgs: 30 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 49 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 253 op/s 2024-03-27T07:33:08.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:08 smithi082 ceph-mon[32178]: pgmap v297: 97 pgs: 30 active+clean+snaptrim_wait, 18 active+clean+snaptrim, 49 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 253 op/s 2024-03-27T07:33:10.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:10 smithi149 ceph-mon[36065]: pgmap v298: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 420 op/s 2024-03-27T07:33:10.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:10 smithi153 ceph-mon[36179]: pgmap v298: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 420 op/s 2024-03-27T07:33:10.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:10 smithi082 ceph-mon[32178]: pgmap v298: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 420 op/s 2024-03-27T07:33:12.506 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:12 smithi149 ceph-mon[36065]: pgmap v299: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 420 op/s 2024-03-27T07:33:12.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:12 smithi153 ceph-mon[36179]: pgmap v299: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 420 op/s 2024-03-27T07:33:12.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:12 smithi082 ceph-mon[32178]: pgmap v299: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 420 op/s 2024-03-27T07:33:14.191 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe67effd640 1 -- 172.21.15.82:0/331595358 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556c5826d6e0 con 0x556c5831ca00 2024-03-27T07:33:14.191 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe67effd640 10 client.26888 handle_command_reply: tid=0 2024-03-27T07:33:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 client.26888 shutdown 2024-03-27T07:33:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 -- 172.21.15.82:0/331595358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 msgr2=0x556c58314050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c58314050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe6940094f0 tx=0x7fe694012ce0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 -- 172.21.15.82:0/331595358 shutdown_connections 2024-03-27T07:33:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556c5831ca00 0x556c5831ee20 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556c5830b980 0x556c58305720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.192 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556c58302bb0 0x556c58314050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe67effd640 0 client.26888 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 --2- 172.21.15.82:0/331595358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556c58302290 0x556c58313b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 -- 172.21.15.82:0/331595358 >> 172.21.15.82:0/331595358 conn(0x556c582fcbb0 msgr2=0x556c582fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 -- 172.21.15.82:0/331595358 shutdown_connections 2024-03-27T07:33:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 1 -- 172.21.15.82:0/331595358 wait complete. 2024-03-27T07:33:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.188+0000 7fe6a8826740 20 client.26888 trim_cache size 0 max 16384 2024-03-27T07:33:14.193 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:33:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:33:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:33:14.194 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:33:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 -- 172.21.15.82:0/1174296322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe6880a3860 msgr2=0x7fe6880a5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe6880a3860 0x7fe6880a5d20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe6980a6120 tx=0x7fe694006bd0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 -- 172.21.15.82:0/1174296322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6980072a0 msgr2=0x7fe698132d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6980072a0 0x7fe698132d70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fe690000c00 tx=0x7fe6900045e0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 -- 172.21.15.82:0/1174296322 shutdown_connections 2024-03-27T07:33:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe6880a3860 0x7fe6880a5d20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6980a6b60 0x7fe698137630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe6980089d0 0x7fe6981332b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 --2- 172.21.15.82:0/1174296322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6980072a0 0x7fe698132d70 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:14.195 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 -- 172.21.15.82:0/1174296322 >> 172.21.15.82:0/1174296322 conn(0x7fe69800cb30 msgr2=0x7fe6980a2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 -- 172.21.15.82:0/1174296322 shutdown_connections 2024-03-27T07:33:14.196 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:14.189+0000 7fe6a48fc640 1 -- 172.21.15.82:0/1174296322 wait complete. 2024-03-27T07:33:14.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:14 smithi149 ceph-mon[36065]: pgmap v300: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 2.16k op/s 2024-03-27T07:33:14.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:14 smithi153 ceph-mon[36179]: pgmap v300: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 2.16k op/s 2024-03-27T07:33:14.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:14 smithi082 ceph-mon[32178]: pgmap v300: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.5 MiB/s wr, 2.16k op/s 2024-03-27T07:33:16.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:16 smithi149 ceph-mon[36065]: pgmap v301: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 2.26k op/s 2024-03-27T07:33:16.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:16 smithi153 ceph-mon[36179]: pgmap v301: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 2.26k op/s 2024-03-27T07:33:16.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:16 smithi082 ceph-mon[32178]: pgmap v301: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 2.26k op/s 2024-03-27T07:33:18.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:18 smithi149 ceph-mon[36065]: pgmap v302: 97 pgs: 40 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 36 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 2.06k op/s 2024-03-27T07:33:18.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:18 smithi153 ceph-mon[36179]: pgmap v302: 97 pgs: 40 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 36 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 2.06k op/s 2024-03-27T07:33:18.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:18 smithi082 ceph-mon[32178]: pgmap v302: 97 pgs: 40 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 36 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.3 MiB/s wr, 2.06k op/s 2024-03-27T07:33:20.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:20 smithi149 ceph-mon[36065]: pgmap v303: 97 pgs: 40 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 36 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.3 MiB/s wr, 1.98k op/s 2024-03-27T07:33:20.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:20 smithi153 ceph-mon[36179]: pgmap v303: 97 pgs: 40 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 36 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.3 MiB/s wr, 1.98k op/s 2024-03-27T07:33:20.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:20 smithi082 ceph-mon[32178]: pgmap v303: 97 pgs: 40 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 36 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 1.3 MiB/s wr, 1.98k op/s 2024-03-27T07:33:22.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:22 smithi149 ceph-mon[36065]: pgmap v304: 97 pgs: 40 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 36 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.2 MiB/s wr, 1.83k op/s 2024-03-27T07:33:22.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:22 smithi153 ceph-mon[36179]: pgmap v304: 97 pgs: 40 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 36 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.2 MiB/s wr, 1.83k op/s 2024-03-27T07:33:22.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:22 smithi082 ceph-mon[32178]: pgmap v304: 97 pgs: 40 active+clean+snaptrim_wait, 21 active+clean+snaptrim, 36 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 1.2 MiB/s wr, 1.83k op/s 2024-03-27T07:33:24.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:24 smithi149 ceph-mon[36065]: pgmap v305: 97 pgs: 27 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 59 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.2 MiB/s wr, 1.87k op/s 2024-03-27T07:33:24.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:24 smithi153 ceph-mon[36179]: pgmap v305: 97 pgs: 27 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 59 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.2 MiB/s wr, 1.87k op/s 2024-03-27T07:33:24.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:24 smithi082 ceph-mon[32178]: pgmap v305: 97 pgs: 27 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 59 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.2 MiB/s wr, 1.87k op/s 2024-03-27T07:33:26.505 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:26 smithi149 ceph-mon[36065]: pgmap v306: 97 pgs: 21 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 66 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 668 KiB/s wr, 324 op/s 2024-03-27T07:33:26.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:26 smithi153 ceph-mon[36179]: pgmap v306: 97 pgs: 21 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 66 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 668 KiB/s wr, 324 op/s 2024-03-27T07:33:26.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:26 smithi082 ceph-mon[32178]: pgmap v306: 97 pgs: 21 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 66 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 668 KiB/s wr, 324 op/s 2024-03-27T07:33:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 -- 172.21.15.82:0/2838679004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80bc107c40 msgr2=0x7f80bc108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 --2- 172.21.15.82:0/2838679004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80bc107c40 0x7f80bc108020 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009ca0 tx=0x7f80ac02c180 comp rx=0 tx=0).stop 2024-03-27T07:33:27.287 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 -- 172.21.15.82:0/2838679004 shutdown_connections 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 --2- 172.21.15.82:0/2838679004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80bc069b70 0x7f80bc10e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 --2- 172.21.15.82:0/2838679004 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc0691d0 0x7f80bc069630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 --2- 172.21.15.82:0/2838679004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80bc107c40 0x7f80bc108020 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 -- 172.21.15.82:0/2838679004 >> 172.21.15.82:0/2838679004 conn(0x7f80bc0778a0 msgr2=0x7f80bc077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 -- 172.21.15.82:0/2838679004 shutdown_connections 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 -- 172.21.15.82:0/2838679004 wait complete. 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 Processor -- start 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.283+0000 7f80c19a0640 1 -- start start 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c19a0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80bc0691d0 0x7f80bc198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c19a0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc069b70 0x7f80bc198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c19a0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80bc107c40 0x7f80bc19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c19a0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc111f00 con 0x7f80bc0691d0 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c19a0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc111d80 con 0x7f80bc069b70 2024-03-27T07:33:27.288 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c19a0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc112080 con 0x7f80bc107c40 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80baffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80bc0691d0 0x7f80bc198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80baffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80bc0691d0 0x7f80bc198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57550/0 (socket says 172.21.15.82:57550) 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80baffd640 1 -- 172.21.15.82:0/2488675955 learned_addr learned my addr 172.21.15.82:0/2488675955 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80ba7fc640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc069b70 0x7f80bc198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80bb7fe640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80bc107c40 0x7f80bc19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80baffd640 1 -- 172.21.15.82:0/2488675955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80bc107c40 msgr2=0x7f80bc19cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80baffd640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80bc107c40 0x7f80bc19cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80baffd640 1 -- 172.21.15.82:0/2488675955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc069b70 msgr2=0x7f80bc198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80baffd640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc069b70 0x7f80bc198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80baffd640 1 -- 172.21.15.82:0/2488675955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc19d2a0 con 0x7f80bc0691d0 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80baffd640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80bc0691d0 0x7f80bc198300 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005e30 tx=0x7f80ac035ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c099e640 1 -- 172.21.15.82:0/2488675955 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac039040 con 0x7f80bc0691d0 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c19a0640 1 -- 172.21.15.82:0/2488675955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc19d530 con 0x7f80bc0691d0 2024-03-27T07:33:27.289 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c099e640 1 -- 172.21.15.82:0/2488675955 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80ac044070 con 0x7f80bc0691d0 2024-03-27T07:33:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c099e640 1 -- 172.21.15.82:0/2488675955 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0329f0 con 0x7f80bc0691d0 2024-03-27T07:33:27.290 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.284+0000 7f80c19a0640 1 -- 172.21.15.82:0/2488675955 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc1a4e20 con 0x7f80bc0691d0 2024-03-27T07:33:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.286+0000 7f80c099e640 1 -- 172.21.15.82:0/2488675955 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f80ac032b90 con 0x7f80bc0691d0 2024-03-27T07:33:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80c4581740 1 Processor -- start 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80c4581740 1 -- start start 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80c099e640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80a40a3820 0x7f80a40a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80c4581740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4e54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80c4581740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4ee2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80bb7fe640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80a40a3820 0x7f80a40a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80c4581740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80c4581740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ba7a4abcd0 con 0x55ba7a4e50f0 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80c4581740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ba7a3f0950 con 0x55ba7a4e5a10 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80c4581740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ba7a448e50 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80c099e640 1 -- 172.21.15.82:0/2488675955 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 8528+0+0 (secure 0 0 0) 0x7f80ac0f2430 con 0x7f80bc0691d0 2024-03-27T07:33:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80ba7fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4ee2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80baffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4e54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80baffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4e54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57560/0 (socket says 172.21.15.82:57560) 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80ba7fc640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4ee2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:55324/0 (socket says 172.21.15.82:55324) 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80baffd640 1 -- 172.21.15.82:0/4077364745 learned_addr learned my addr 172.21.15.82:0/4077364745 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.287+0000 7f80bb7fe640 1 --2- 172.21.15.82:0/4077364745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80baffd640 1 -- 172.21.15.82:0/4077364745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 msgr2=0x55ba7a4f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80baffd640 1 --2- 172.21.15.82:0/4077364745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80baffd640 1 -- 172.21.15.82:0/4077364745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 msgr2=0x55ba7a4ee2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80baffd640 1 --2- 172.21.15.82:0/4077364745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4ee2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80baffd640 1 -- 172.21.15.82:0/4077364745 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba7a15d210 con 0x55ba7a4e50f0 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80bb7fe640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80a40a3820 0x7f80a40a5ce0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80b4005f60 tx=0x7f80b4013830 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80baffd640 1 --2- 172.21.15.82:0/4077364745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4e54d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0bb0a0 tx=0x7f80ac003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45f0ac185fd8ac3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80a1ffb640 1 -- 172.21.15.82:0/4077364745 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0be6d0 con 0x55ba7a4e50f0 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80a1ffb640 1 -- 172.21.15.82:0/4077364745 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80ac0c2a80 con 0x55ba7a4e50f0 2024-03-27T07:33:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80a1ffb640 1 -- 172.21.15.82:0/4077364745 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0bad40 con 0x55ba7a4e50f0 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80c4581740 1 -- 172.21.15.82:0/4077364745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 msgr2=0x55ba7a4e54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.288+0000 7f80c4581740 1 --2- 172.21.15.82:0/4077364745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4e54d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0bb0a0 tx=0x7f80ac003f50 comp rx=0 tx=0).stop 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 -- 172.21.15.82:0/4077364745 shutdown_connections 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 --2- 172.21.15.82:0/4077364745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 --2- 172.21.15.82:0/4077364745 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4ee2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 --2- 172.21.15.82:0/4077364745 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4e54d0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 -- 172.21.15.82:0/4077364745 >> 172.21.15.82:0/4077364745 conn(0x55ba7a4dfa10 msgr2=0x55ba7a4dfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 -- 172.21.15.82:0/4077364745 shutdown_connections 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 -- 172.21.15.82:0/4077364745 wait complete. 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 -- start start 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 Processor -- start 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4eb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4ebcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4ec210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ba7a444e00 con 0x55ba7a4e50f0 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ba7a3f1520 con 0x55ba7a4e5a10 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ba7a4048e0 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80c4581740 10 client.0 _ll_register_callbacks cb 0x55ba7a43fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80baffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4eb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80baffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4eb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57574/0 (socket says 172.21.15.82:57574) 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.289+0000 7f80baffd640 1 -- 172.21.15.82:0/1637905848 learned_addr learned my addr 172.21.15.82:0/1637905848 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80ba7fc640 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4ebcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80bb7fe640 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4ec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80baffd640 1 -- 172.21.15.82:0/1637905848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 msgr2=0x55ba7a4ec210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80baffd640 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4ec210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80baffd640 1 -- 172.21.15.82:0/1637905848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 msgr2=0x55ba7a4ebcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80baffd640 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4ebcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80baffd640 1 -- 172.21.15.82:0/1637905848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba7a229620 con 0x55ba7a4e50f0 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80baffd640 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4eb790 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009430 tx=0x7f80ac0efc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706a094b416a0de1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f809affd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f809affd640 1 -- 172.21.15.82:0/1637905848 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0be6d0 con 0x55ba7a4e50f0 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f809affd640 1 -- 172.21.15.82:0/1637905848 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8528+0+0 (secure 0 0 0) 0x7f80ac009890 con 0x55ba7a4e50f0 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80c4581740 1 -- 172.21.15.82:0/1637905848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80ac0c2a80 con 0x55ba7a4e50f0 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f809affd640 1 -- 172.21.15.82:0/1637905848 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f80ac0be930 con 0x55ba7a4e50f0 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80c4581740 10 client.17067 fetch_fsmap learned FSMap version 37 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f80c4581740 1 -- 172.21.15.82:0/1637905848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ba7a4fcfe0 con 0x55ba7a4e50f0 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f809affd640 1 -- 172.21.15.82:0/1637905848 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80ac0c2a80 con 0x55ba7a4e50f0 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.290+0000 7f809affd640 1 -- 172.21.15.82:0/1637905848 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f80ac03c030 con 0x55ba7a4e50f0 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.291+0000 7f80c4581740 10 client.17067 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:33:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.291+0000 7f80c4581740 10 client.17067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:33:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.291+0000 7f80c4581740 20 client.17067 populate_metadata read hostname 'smithi082' 2024-03-27T07:33:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.291+0000 7f80c4581740 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ba7a4fe330 0x55ba7a500740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.291+0000 7f80c4581740 4 client.17067 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:33:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.291+0000 7f80c4581740 1 -- 172.21.15.82:0/1637905848 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba7a456390 con 0x55ba7a4fe330 2024-03-27T07:33:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.291+0000 7f80ba7fc640 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ba7a4fe330 0x55ba7a500740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.291+0000 7f80ba7fc640 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ba7a4fe330 0x55ba7a500740 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=722fa98d658c28c6 server_cookie=8901f3e89a62d2c9 in_seq=0 out_seq=0 2024-03-27T07:33:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.291+0000 7f809affd640 10 client.17067 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:27.316 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f809affd640 1 -- 172.21.15.82:0/1637905848 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ba7a456390 con 0x55ba7a4fe330 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f809affd640 10 client.17067 handle_command_reply: tid=0 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 client.17067 shutdown 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 -- 172.21.15.82:0/1637905848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 msgr2=0x55ba7a4eb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4eb790 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f80ac009430 tx=0x7f80ac0efc30 comp rx=0 tx=0).stop 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 -- 172.21.15.82:0/1637905848 shutdown_connections 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4ec210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4ebcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ba7a4fe330 0x55ba7a500740 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 --2- 172.21.15.82:0/1637905848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4eb790 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f809affd640 0 client.17067 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 -- 172.21.15.82:0/1637905848 >> 172.21.15.82:0/1637905848 conn(0x55ba7a4dfa10 msgr2=0x55ba7a4e1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:27.317 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 -- 172.21.15.82:0/1637905848 shutdown_connections 2024-03-27T07:33:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 1 -- 172.21.15.82:0/1637905848 wait complete. 2024-03-27T07:33:27.318 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.314+0000 7f80c4581740 20 client.17067 trim_cache size 0 max 16384 2024-03-27T07:33:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.328+0000 7f80c4581740 1 Processor -- start 2024-03-27T07:33:27.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.328+0000 7f80c4581740 1 -- start start 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.328+0000 7f80c4581740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.328+0000 7f80c4581740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a506050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.328+0000 7f80c4581740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.328+0000 7f80c4581740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc1b0120 con 0x55ba7a4e50f0 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.328+0000 7f80c4581740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc1ad930 con 0x55ba7a4e5a10 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.328+0000 7f80c4581740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc1ab780 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80baffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80baffd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4f9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57576/0 (socket says 172.21.15.82:57576) 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80baffd640 1 -- 172.21.15.82:0/912024742 learned_addr learned my addr 172.21.15.82:0/912024742 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80ba7fc640 1 --2- 172.21.15.82:0/912024742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a506050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80bb7fe640 1 --2- 172.21.15.82:0/912024742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80baffd640 1 -- 172.21.15.82:0/912024742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 msgr2=0x55ba7a4e0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80baffd640 1 --2- 172.21.15.82:0/912024742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4e0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80baffd640 1 -- 172.21.15.82:0/912024742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 msgr2=0x55ba7a506050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80baffd640 1 --2- 172.21.15.82:0/912024742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a506050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80baffd640 1 -- 172.21.15.82:0/912024742 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba7a4df840 con 0x55ba7a4e50f0 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80ba7fc640 1 --2- 172.21.15.82:0/912024742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a506050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80baffd640 1 --2- 172.21.15.82:0/912024742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4f9b80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0bb0a0 tx=0x7f80ac0bcbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b734e810880e4f62 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80a17fa640 1 -- 172.21.15.82:0/912024742 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0be6d0 con 0x55ba7a4e50f0 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80a17fa640 1 -- 172.21.15.82:0/912024742 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80ac0a90b0 con 0x55ba7a4e50f0 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.329+0000 7f80a17fa640 1 -- 172.21.15.82:0/912024742 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0dd330 con 0x55ba7a4e50f0 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 -- 172.21.15.82:0/912024742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 msgr2=0x55ba7a4f9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 --2- 172.21.15.82:0/912024742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4f9b80 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f80ac0bb0a0 tx=0x7f80ac0bcbe0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 -- 172.21.15.82:0/912024742 shutdown_connections 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 --2- 172.21.15.82:0/912024742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4e0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 --2- 172.21.15.82:0/912024742 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a506050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 --2- 172.21.15.82:0/912024742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4f9b80 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 -- 172.21.15.82:0/912024742 >> 172.21.15.82:0/912024742 conn(0x55ba7a4dfa10 msgr2=0x55ba7a4e6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 -- 172.21.15.82:0/912024742 shutdown_connections 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 -- 172.21.15.82:0/912024742 wait complete. 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 -- start start 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 Processor -- start 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4e8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4e8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc1abdf0 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc1ad260 con 0x55ba7a4e5a10 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc1ac4c0 con 0x55ba7a4e50f0 2024-03-27T07:33:27.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.330+0000 7f80c4581740 10 client.0 _ll_register_callbacks cb 0x7f80b000b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80bb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80bb7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4e8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57578/0 (socket says 172.21.15.82:57578) 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80bb7fe640 1 -- 172.21.15.82:0/3639280883 learned_addr learned my addr 172.21.15.82:0/3639280883 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80baffd640 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80ba7fc640 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4e8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80bb7fe640 1 -- 172.21.15.82:0/3639280883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4e50f0 msgr2=0x55ba7a4e8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80bb7fe640 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4e8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80bb7fe640 1 -- 172.21.15.82:0/3639280883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 msgr2=0x55ba7a4e8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80bb7fe640 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4e8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80bb7fe640 1 -- 172.21.15.82:0/3639280883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba7a567c60 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80bb7fe640 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4e8f80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f80b4013d30 tx=0x7f80b401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd033489e6d330ac server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f809affd640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:33:27.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f809affd640 1 -- 172.21.15.82:0/3639280883 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4012070 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f809affd640 1 -- 172.21.15.82:0/3639280883 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 8528+0+0 (secure 0 0 0) 0x7f80b4012210 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80c4581740 1 -- 172.21.15.82:0/3639280883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ba7a4506e0 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f809affd640 1 -- 172.21.15.82:0/3639280883 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f80b4037050 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80c4581740 10 client.17073 fetch_fsmap learned FSMap version 37 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f80c4581740 1 -- 172.21.15.82:0/3639280883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ba7a568f50 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.331+0000 7f809affd640 1 -- 172.21.15.82:0/3639280883 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55ba7a4506e0 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.332+0000 7f809affd640 1 -- 172.21.15.82:0/3639280883 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f80b401f070 con 0x55ba7a4ee7e0 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.332+0000 7f80c4581740 10 client.17073 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.332+0000 7f80c4581740 10 client.17073 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.332+0000 7f80c4581740 20 client.17073 populate_metadata read hostname 'smithi082' 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.332+0000 7f80c4581740 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ba7a5697b0 0x55ba7a56bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.332+0000 7f80c4581740 4 client.17073 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.332+0000 7f80c4581740 1 -- 172.21.15.82:0/3639280883 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ba7a3ce770 con 0x55ba7a5697b0 2024-03-27T07:33:27.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.332+0000 7f80baffd640 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ba7a5697b0 0x55ba7a56bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.332+0000 7f809affd640 10 client.17073 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:27.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.332+0000 7f80baffd640 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ba7a5697b0 0x55ba7a56bbd0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=858f2763dc8ba1cd server_cookie=b7c463c61dd5f2ec in_seq=0 out_seq=0 2024-03-27T07:33:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.483+0000 7f809affd640 1 -- 172.21.15.82:0/3639280883 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ba7a3ce770 con 0x55ba7a5697b0 2024-03-27T07:33:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.483+0000 7f809affd640 10 client.17073 handle_command_reply: tid=0 2024-03-27T07:33:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.483+0000 7f80c4581740 1 client.17073 shutdown 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.483+0000 7f80c4581740 1 -- 172.21.15.82:0/3639280883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4ee7e0 msgr2=0x55ba7a4e8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.483+0000 7f80c4581740 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4e8f80 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f80b4013d30 tx=0x7f80b401b000 comp rx=0 tx=0).stop 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.484+0000 7f80c4581740 1 -- 172.21.15.82:0/3639280883 shutdown_connections 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.484+0000 7f80c4581740 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ba7a5697b0 0x55ba7a56bbd0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.484+0000 7f80c4581740 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ba7a4ee7e0 0x55ba7a4e8f80 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.484+0000 7f80c4581740 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ba7a4e5a10 0x55ba7a4e8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.484+0000 7f80c4581740 1 --2- 172.21.15.82:0/3639280883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ba7a4e50f0 0x55ba7a4e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.484+0000 7f80c4581740 1 -- 172.21.15.82:0/3639280883 >> 172.21.15.82:0/3639280883 conn(0x55ba7a4dfa10 msgr2=0x55ba7a4e0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.484+0000 7f809affd640 0 client.17073 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.484+0000 7f80c4581740 1 -- 172.21.15.82:0/3639280883 shutdown_connections 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.484+0000 7f80c4581740 1 -- 172.21.15.82:0/3639280883 wait complete. 2024-03-27T07:33:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.484+0000 7f80c4581740 20 client.17073 trim_cache size 0 max 16384 2024-03-27T07:33:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:33:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:33:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:33:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 -- 172.21.15.82:0/2488675955 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80a40a3820 msgr2=0x7f80a40a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80a40a3820 0x7f80a40a5ce0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f80b4005f60 tx=0x7f80b4013830 comp rx=0 tx=0).stop 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 -- 172.21.15.82:0/2488675955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80bc0691d0 msgr2=0x7f80bc198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80bc0691d0 0x7f80bc198300 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f80ac005e30 tx=0x7f80ac035ed0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 -- 172.21.15.82:0/2488675955 shutdown_connections 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80a40a3820 0x7f80a40a5ce0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80bc107c40 0x7f80bc19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f80bc069b70 0x7f80bc198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 --2- 172.21.15.82:0/2488675955 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80bc0691d0 0x7f80bc198300 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 -- 172.21.15.82:0/2488675955 >> 172.21.15.82:0/2488675955 conn(0x7f80bc0778a0 msgr2=0x7f80bc0ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 -- 172.21.15.82:0/2488675955 shutdown_connections 2024-03-27T07:33:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:27.485+0000 7f80c19a0640 1 -- 172.21.15.82:0/2488675955 wait complete. 2024-03-27T07:33:29.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:28 smithi082 ceph-mon[32178]: pgmap v307: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 220 op/s 2024-03-27T07:33:29.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:28 smithi149 ceph-mon[36065]: pgmap v307: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 220 op/s 2024-03-27T07:33:29.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:28 smithi153 ceph-mon[36179]: pgmap v307: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 220 op/s 2024-03-27T07:33:31.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:30 smithi082 ceph-mon[32178]: pgmap v308: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 117 op/s 2024-03-27T07:33:31.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:30 smithi149 ceph-mon[36065]: pgmap v308: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 117 op/s 2024-03-27T07:33:31.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:30 smithi153 ceph-mon[36179]: pgmap v308: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 117 op/s 2024-03-27T07:33:33.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:32 smithi082 ceph-mon[32178]: pgmap v309: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 101 op/s 2024-03-27T07:33:33.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:32 smithi149 ceph-mon[36065]: pgmap v309: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 101 op/s 2024-03-27T07:33:33.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:32 smithi153 ceph-mon[36179]: pgmap v309: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.4 MiB/s wr, 101 op/s 2024-03-27T07:33:34.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:33 smithi082 ceph-mon[32178]: osdmap e98: 12 total, 12 up, 12 in 2024-03-27T07:33:34.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:33 smithi149 ceph-mon[36065]: osdmap e98: 12 total, 12 up, 12 in 2024-03-27T07:33:34.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:33 smithi153 ceph-mon[36179]: osdmap e98: 12 total, 12 up, 12 in 2024-03-27T07:33:35.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:34 smithi082 ceph-mon[32178]: pgmap v311: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 172 op/s 2024-03-27T07:33:35.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:34 smithi149 ceph-mon[36065]: pgmap v311: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 172 op/s 2024-03-27T07:33:35.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:34 smithi153 ceph-mon[36179]: pgmap v311: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 172 op/s 2024-03-27T07:33:37.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:36 smithi082 ceph-mon[32178]: pgmap v312: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-03-27T07:33:37.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:36 smithi149 ceph-mon[36065]: pgmap v312: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-03-27T07:33:37.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:36 smithi153 ceph-mon[36179]: pgmap v312: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 181 op/s 2024-03-27T07:33:39.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:38 smithi082 ceph-mon[32178]: pgmap v313: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-03-27T07:33:39.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:38 smithi149 ceph-mon[36065]: pgmap v313: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-03-27T07:33:39.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:38 smithi153 ceph-mon[36179]: pgmap v313: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-03-27T07:33:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.573+0000 7f876b735640 1 -- 172.21.15.82:0/394906102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8764100ca0 msgr2=0x7f8764101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.573+0000 7f876b735640 1 --2- 172.21.15.82:0/394906102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8764100ca0 0x7f8764101120 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f8754009900 tx=0x7f875402bc30 comp rx=0 tx=0).stop 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.573+0000 7f876b735640 1 -- 172.21.15.82:0/394906102 shutdown_connections 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.573+0000 7f876b735640 1 --2- 172.21.15.82:0/394906102 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8764100ca0 0x7f8764101120 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.573+0000 7f876b735640 1 --2- 172.21.15.82:0/394906102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8764101660 0x7f876410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.573+0000 7f876b735640 1 --2- 172.21.15.82:0/394906102 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87641059f0 0x7f8764105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.573+0000 7f876b735640 1 -- 172.21.15.82:0/394906102 >> 172.21.15.82:0/394906102 conn(0x7f87640778b0 msgr2=0x7f8764077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.573+0000 7f876b735640 1 -- 172.21.15.82:0/394906102 shutdown_connections 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.573+0000 7f876b735640 1 -- 172.21.15.82:0/394906102 wait complete. 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f876b735640 1 Processor -- start 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f876b735640 1 -- start start 2024-03-27T07:33:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f876b735640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8764100ca0 0x7f87641990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f876b735640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8764101660 0x7f8764199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f876b735640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87641059f0 0x7f87641a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f876b735640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8764110e00 con 0x7f8764101660 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f876b735640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8764110c80 con 0x7f87641059f0 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f876b735640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8764110f80 con 0x7f8764100ca0 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f8768cd0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8764101660 0x7f8764199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f8768cd0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8764101660 0x7f8764199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38220/0 (socket says 172.21.15.82:38220) 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f8768cd0640 1 -- 172.21.15.82:0/1895028550 learned_addr learned my addr 172.21.15.82:0/1895028550 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f87694d1640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8764100ca0 0x7f87641990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f8769cd2640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87641059f0 0x7f87641a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f8768cd0640 1 -- 172.21.15.82:0/1895028550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8764100ca0 msgr2=0x7f87641990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f8768cd0640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8764100ca0 0x7f87641990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f8768cd0640 1 -- 172.21.15.82:0/1895028550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87641059f0 msgr2=0x7f87641a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f8768cd0640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87641059f0 0x7f87641a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.574+0000 7f8768cd0640 1 -- 172.21.15.82:0/1895028550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87641a4680 con 0x7f8764101660 2024-03-27T07:33:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.575+0000 7f8768cd0640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8764101660 0x7f8764199600 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f8754005940 tx=0x7f87540043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.575+0000 7f875a7fc640 1 -- 172.21.15.82:0/1895028550 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754041070 con 0x7f8764101660 2024-03-27T07:33:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.575+0000 7f875a7fc640 1 -- 172.21.15.82:0/1895028550 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f875402ccc0 con 0x7f8764101660 2024-03-27T07:33:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.575+0000 7f876b735640 1 -- 172.21.15.82:0/1895028550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87641a4850 con 0x7f8764101660 2024-03-27T07:33:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.575+0000 7f875a7fc640 1 -- 172.21.15.82:0/1895028550 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8754003e20 con 0x7f8764101660 2024-03-27T07:33:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.575+0000 7f876b735640 1 -- 172.21.15.82:0/1895028550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87641a4d10 con 0x7f8764101660 2024-03-27T07:33:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.577+0000 7f875a7fc640 1 -- 172.21.15.82:0/1895028550 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f8754044070 con 0x7f8764101660 2024-03-27T07:33:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f876e3f4740 1 Processor -- start 2024-03-27T07:33:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f876e3f4740 1 -- start start 2024-03-27T07:33:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb57a10 0x555c4eb602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb607e0 0x555c4eb62bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f876e3f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555c4eb1dcd0 con 0x555c4eb57a10 2024-03-27T07:33:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f876e3f4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555c4ea62950 con 0x555c4eb570f0 2024-03-27T07:33:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f876e3f4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555c4eabae50 con 0x555c4eb607e0 2024-03-27T07:33:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f87694d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb57a10 0x555c4eb602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f8769cd2640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f87694d1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb57a10 0x555c4eb602a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38232/0 (socket says 172.21.15.82:38232) 2024-03-27T07:33:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f87694d1640 1 -- 172.21.15.82:0/3723340378 learned_addr learned my addr 172.21.15.82:0/3723340378 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f875a7fc640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f87500a38a0 0x7f87500a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f8768cd0640 1 --2- 172.21.15.82:0/3723340378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb607e0 0x555c4eb62bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f8769cd2640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f87500a38a0 0x7f87500a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f8769cd2640 1 -- 172.21.15.82:0/3723340378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb607e0 msgr2=0x555c4eb62bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f8769cd2640 1 --2- 172.21.15.82:0/3723340378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb607e0 0x555c4eb62bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f8769cd2640 1 -- 172.21.15.82:0/3723340378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb57a10 msgr2=0x555c4eb602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f8769cd2640 1 --2- 172.21.15.82:0/3723340378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb57a10 0x555c4eb602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f875a7fc640 1 -- 172.21.15.82:0/1895028550 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8484+0+0 (secure 0 0 0) 0x7f87540f1af0 con 0x7f8764101660 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f8769cd2640 1 -- 172.21.15.82:0/3723340378 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c4e7cf210 con 0x555c4eb570f0 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.578+0000 7f87694d1640 1 --2- 172.21.15.82:0/3723340378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb57a10 0x555c4eb602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.579+0000 7f8769cd2640 1 --2- 172.21.15.82:0/3723340378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb574d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f875c009800 tx=0x7f875c014ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15da6b669618d732 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.579+0000 7f8769cd2640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f87500a38a0 0x7f87500a5d60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f875c01c000 tx=0x7f875c01e000 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.579+0000 7f874f7fe640 1 -- 172.21.15.82:0/3723340378 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c023070 con 0x555c4eb570f0 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.579+0000 7f874f7fe640 1 -- 172.21.15.82:0/3723340378 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f875c012dc0 con 0x555c4eb570f0 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.579+0000 7f874f7fe640 1 -- 172.21.15.82:0/3723340378 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c01ed60 con 0x555c4eb570f0 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 -- 172.21.15.82:0/3723340378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 msgr2=0x555c4eb574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:40.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 --2- 172.21.15.82:0/3723340378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb574d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f875c009800 tx=0x7f875c014ed0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 -- 172.21.15.82:0/3723340378 shutdown_connections 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 --2- 172.21.15.82:0/3723340378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb57a10 0x555c4eb602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 --2- 172.21.15.82:0/3723340378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb607e0 0x555c4eb62bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 --2- 172.21.15.82:0/3723340378 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb574d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 -- 172.21.15.82:0/3723340378 >> 172.21.15.82:0/3723340378 conn(0x555c4eb51a10 msgr2=0x555c4eb51df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 -- 172.21.15.82:0/3723340378 shutdown_connections 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 -- 172.21.15.82:0/3723340378 wait complete. 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 -- start start 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 Processor -- start 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb5dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb5e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555c4eab6e00 con 0x555c4eb607e0 2024-03-27T07:33:40.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x555c4ea63520 con 0x555c4eb570f0 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.580+0000 7f876e3f4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x555c4ea768e0 con 0x555c4eb57a10 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f876e3f4740 10 client.0 _ll_register_callbacks cb 0x555c4eab1a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f8769cd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb5e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f87694d1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f8769cd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb5e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38246/0 (socket says 172.21.15.82:38246) 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f8769cd2640 1 -- 172.21.15.82:0/916620923 learned_addr learned my addr 172.21.15.82:0/916620923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f8768cd0640 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb5dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f87694d1640 1 -- 172.21.15.82:0/916620923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 msgr2=0x555c4eb5dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f87694d1640 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb5dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f87694d1640 1 -- 172.21.15.82:0/916620923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 msgr2=0x555c4eb5e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f87694d1640 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb5e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f87694d1640 1 -- 172.21.15.82:0/916620923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c4e89b620 con 0x555c4eb570f0 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f8769cd2640 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb5e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:33:40.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f87694d1640 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5d790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f876000bf00 tx=0x7f8760011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f0e43e966e0d190 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f874cff9640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f874cff9640 1 -- 172.21.15.82:0/916620923 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760004020 con 0x555c4eb570f0 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f874cff9640 1 -- 172.21.15.82:0/916620923 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8484+0+0 (secure 0 0 0) 0x7f87600041c0 con 0x555c4eb570f0 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f876e3f4740 1 -- 172.21.15.82:0/916620923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f875c012dc0 con 0x555c4eb570f0 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f874cff9640 1 -- 172.21.15.82:0/916620923 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f87600043c0 con 0x555c4eb570f0 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f876e3f4740 10 client.26918 fetch_fsmap learned FSMap version 37 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.581+0000 7f876e3f4740 1 -- 172.21.15.82:0/916620923 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x555c4eb6f2d0 con 0x555c4eb570f0 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f874cff9640 1 -- 172.21.15.82:0/916620923 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f875c012dc0 con 0x555c4eb570f0 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f874cff9640 1 -- 172.21.15.82:0/916620923 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f8760021030 con 0x555c4eb570f0 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f876e3f4740 10 client.26918 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f876e3f4740 10 client.26918 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f876e3f4740 20 client.26918 populate_metadata read hostname 'smithi082' 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f876e3f4740 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x555c4eb70850 0x555c4eb72c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f876e3f4740 4 client.26918 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:33:40.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f876e3f4740 1 -- 172.21.15.82:0/916620923 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c4eac8390 con 0x555c4eb70850 2024-03-27T07:33:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f8768cd0640 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x555c4eb70850 0x555c4eb72c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f874cff9640 10 client.26918 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.582+0000 7f8768cd0640 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x555c4eb70850 0x555c4eb72c40 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec6bf59215e276d9 server_cookie=98c54bfb9eec5318 in_seq=0 out_seq=0 2024-03-27T07:33:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f874cff9640 1 -- 172.21.15.82:0/916620923 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x555c4eac8390 con 0x555c4eb70850 2024-03-27T07:33:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f874cff9640 10 client.26918 handle_command_reply: tid=0 2024-03-27T07:33:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 client.26918 shutdown 2024-03-27T07:33:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 -- 172.21.15.82:0/916620923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 msgr2=0x555c4eb5d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5d790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f876000bf00 tx=0x7f8760011810 comp rx=0 tx=0).stop 2024-03-27T07:33:40.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 -- 172.21.15.82:0/916620923 shutdown_connections 2024-03-27T07:33:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x555c4eb70850 0x555c4eb72c40 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb5e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb5dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 --2- 172.21.15.82:0/916620923 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5d790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f874cff9640 0 client.26918 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 -- 172.21.15.82:0/916620923 >> 172.21.15.82:0/916620923 conn(0x555c4eb51a10 msgr2=0x555c4eb53760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 -- 172.21.15.82:0/916620923 shutdown_connections 2024-03-27T07:33:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 1 -- 172.21.15.82:0/916620923 wait complete. 2024-03-27T07:33:40.595 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.584+0000 7f876e3f4740 20 client.26918 trim_cache size 0 max 16384 2024-03-27T07:33:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f876e3f4740 1 Processor -- start 2024-03-27T07:33:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f876e3f4740 1 -- start start 2024-03-27T07:33:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb6be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb78500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f876e3f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f87641b0090 con 0x555c4eb607e0 2024-03-27T07:33:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f876e3f4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f87641ad8a0 con 0x555c4eb570f0 2024-03-27T07:33:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f876e3f4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f87641ab710 con 0x555c4eb57a10 2024-03-27T07:33:40.602 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f8769cd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb78500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f87694d1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f8768cd0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb6be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f87694d1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:51566/0 (socket says 172.21.15.82:51566) 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f8769cd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb78500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38254/0 (socket says 172.21.15.82:38254) 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f87694d1640 1 -- 172.21.15.82:0/591952231 learned_addr learned my addr 172.21.15.82:0/591952231 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f8769cd2640 1 -- 172.21.15.82:0/591952231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 msgr2=0x555c4eb6be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f8769cd2640 1 --2- 172.21.15.82:0/591952231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb6be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f8769cd2640 1 -- 172.21.15.82:0/591952231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 msgr2=0x555c4eb5fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f8769cd2640 1 --2- 172.21.15.82:0/591952231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.599+0000 7f8769cd2640 1 -- 172.21.15.82:0/591952231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c4eb6c390 con 0x555c4eb607e0 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f8769cd2640 1 --2- 172.21.15.82:0/591952231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb78500 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f875c009fd0 tx=0x7f875c0149c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7f49d4c994cd7c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f874effd640 1 -- 172.21.15.82:0/591952231 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c023030 con 0x555c4eb607e0 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f874effd640 1 -- 172.21.15.82:0/591952231 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f875c0099f0 con 0x555c4eb607e0 2024-03-27T07:33:40.603 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f874effd640 1 -- 172.21.15.82:0/591952231 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c01e3f0 con 0x555c4eb607e0 2024-03-27T07:33:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f876e3f4740 1 -- 172.21.15.82:0/591952231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 msgr2=0x555c4eb78500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f876e3f4740 1 --2- 172.21.15.82:0/591952231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb78500 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f875c009fd0 tx=0x7f875c0149c0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f876e3f4740 1 -- 172.21.15.82:0/591952231 shutdown_connections 2024-03-27T07:33:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f876e3f4740 1 --2- 172.21.15.82:0/591952231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4eb78500 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f876e3f4740 1 --2- 172.21.15.82:0/591952231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb6be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f876e3f4740 1 --2- 172.21.15.82:0/591952231 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.609 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f876e3f4740 1 -- 172.21.15.82:0/591952231 >> 172.21.15.82:0/591952231 conn(0x555c4eb51a10 msgr2=0x555c4eb536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f876e3f4740 1 -- 172.21.15.82:0/591952231 shutdown_connections 2024-03-27T07:33:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.600+0000 7f876e3f4740 1 -- 172.21.15.82:0/591952231 wait complete. 2024-03-27T07:33:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f876e3f4740 1 -- start start 2024-03-27T07:33:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f876e3f4740 1 Processor -- start 2024-03-27T07:33:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb5b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f876e3f4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4ebd5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f876e3f4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f87641abd60 con 0x555c4eb607e0 2024-03-27T07:33:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f876e3f4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f87641ad1d0 con 0x555c4eb570f0 2024-03-27T07:33:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f876e3f4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f87641ac430 con 0x555c4eb57a10 2024-03-27T07:33:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f876e3f4740 10 client.0 _ll_register_callbacks cb 0x7f876000b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:33:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f8769cd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4ebd5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f8769cd2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4ebd5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38262/0 (socket says 172.21.15.82:38262) 2024-03-27T07:33:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f8769cd2640 1 -- 172.21.15.82:0/871780766 learned_addr learned my addr 172.21.15.82:0/871780766 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f87694d1640 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f8768cd0640 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb5b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f8769cd2640 1 -- 172.21.15.82:0/871780766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 msgr2=0x555c4eb5b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f8769cd2640 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb5b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f8769cd2640 1 -- 172.21.15.82:0/871780766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 msgr2=0x555c4eb5abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f8769cd2640 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.601+0000 7f8769cd2640 1 -- 172.21.15.82:0/871780766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c4ebd60f0 con 0x555c4eb607e0 2024-03-27T07:33:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f8769cd2640 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4ebd5b30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f875c01eeb0 tx=0x7f875c01eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47567b3c6010a31d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f874cff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:33:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f874cff9640 1 -- 172.21.15.82:0/871780766 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c023040 con 0x555c4eb607e0 2024-03-27T07:33:40.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f874cff9640 1 -- 172.21.15.82:0/871780766 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8484+0+0 (secure 0 0 0) 0x7f875c014570 con 0x555c4eb607e0 2024-03-27T07:33:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f876e3f4740 1 -- 172.21.15.82:0/871780766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f875c0099f0 con 0x555c4eb607e0 2024-03-27T07:33:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f874cff9640 1 -- 172.21.15.82:0/871780766 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f875c00ebc0 con 0x555c4eb607e0 2024-03-27T07:33:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f876e3f4740 10 client.17091 fetch_fsmap learned FSMap version 37 2024-03-27T07:33:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f876e3f4740 1 -- 172.21.15.82:0/871780766 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x555c4ebd73e0 con 0x555c4eb607e0 2024-03-27T07:33:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f874cff9640 1 -- 172.21.15.82:0/871780766 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f875c0099f0 con 0x555c4eb607e0 2024-03-27T07:33:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f874cff9640 1 -- 172.21.15.82:0/871780766 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f875c043020 con 0x555c4eb607e0 2024-03-27T07:33:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f876e3f4740 10 client.17091 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:33:40.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f876e3f4740 10 client.17091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:33:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f876e3f4740 20 client.17091 populate_metadata read hostname 'smithi082' 2024-03-27T07:33:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f876e3f4740 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x555c4ebd7910 0x555c4ebd9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f876e3f4740 4 client.17091 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:33:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f876e3f4740 1 -- 172.21.15.82:0/871780766 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555c4eac26e0 con 0x555c4ebd7910 2024-03-27T07:33:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.602+0000 7f87694d1640 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x555c4ebd7910 0x555c4ebd9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.603+0000 7f874cff9640 10 client.17091 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:40.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:40.603+0000 7f87694d1640 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x555c4ebd7910 0x555c4ebd9d30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=737e53c50763c4a8 server_cookie=6560c6efd3c7bff6 in_seq=0 out_seq=0 2024-03-27T07:33:41.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:40 smithi082 ceph-mon[32178]: pgmap v314: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 230 op/s 2024-03-27T07:33:41.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:40 smithi149 ceph-mon[36065]: pgmap v314: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 230 op/s 2024-03-27T07:33:41.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:40 smithi153 ceph-mon[36179]: pgmap v314: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 230 op/s 2024-03-27T07:33:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.611+0000 7f874cff9640 1 -- 172.21.15.82:0/871780766 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555c4eac26e0 con 0x555c4ebd7910 2024-03-27T07:33:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.611+0000 7f874cff9640 10 client.17091 handle_command_reply: tid=0 2024-03-27T07:33:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.611+0000 7f876e3f4740 1 client.17091 shutdown 2024-03-27T07:33:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f876e3f4740 1 -- 172.21.15.82:0/871780766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 msgr2=0x555c4ebd5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f876e3f4740 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4ebd5b30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f875c01eeb0 tx=0x7f875c01eee0 comp rx=0 tx=0).stop 2024-03-27T07:33:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f876e3f4740 1 -- 172.21.15.82:0/871780766 shutdown_connections 2024-03-27T07:33:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f876e3f4740 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x555c4ebd7910 0x555c4ebd9d30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f876e3f4740 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555c4eb607e0 0x555c4ebd5b30 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f876e3f4740 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x555c4eb57a10 0x555c4eb5b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f876e3f4740 1 --2- 172.21.15.82:0/871780766 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x555c4eb570f0 0x555c4eb5abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f876e3f4740 1 -- 172.21.15.82:0/871780766 >> 172.21.15.82:0/871780766 conn(0x555c4eb51a10 msgr2=0x555c4eb501e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f874cff9640 0 client.17091 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f876e3f4740 1 -- 172.21.15.82:0/871780766 shutdown_connections 2024-03-27T07:33:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.612+0000 7f876e3f4740 1 -- 172.21.15.82:0/871780766 wait complete. 2024-03-27T07:33:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876e3f4740 20 client.17091 trim_cache size 0 max 16384 2024-03-27T07:33:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:33:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:33:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:33:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:33:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876b735640 1 -- 172.21.15.82:0/1895028550 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f87500a38a0 msgr2=0x7f87500a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876b735640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f87500a38a0 0x7f87500a5d60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f875c01c000 tx=0x7f875c01e000 comp rx=0 tx=0).stop 2024-03-27T07:33:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876b735640 1 -- 172.21.15.82:0/1895028550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8764101660 msgr2=0x7f8764199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876b735640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8764101660 0x7f8764199600 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f8754005940 tx=0x7f87540043b0 comp rx=0 tx=0).stop 2024-03-27T07:33:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876b735640 1 -- 172.21.15.82:0/1895028550 shutdown_connections 2024-03-27T07:33:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876b735640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f87500a38a0 0x7f87500a5d60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876b735640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8764101660 0x7f8764199600 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876b735640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f87641059f0 0x7f87641a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876b735640 1 --2- 172.21.15.82:0/1895028550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8764100ca0 0x7f87641990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.613+0000 7f876b735640 1 -- 172.21.15.82:0/1895028550 >> 172.21.15.82:0/1895028550 conn(0x7f87640778b0 msgr2=0x7f87640fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.614+0000 7f876b735640 1 -- 172.21.15.82:0/1895028550 shutdown_connections 2024-03-27T07:33:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:42.614+0000 7f876b735640 1 -- 172.21.15.82:0/1895028550 wait complete. 2024-03-27T07:33:43.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:42 smithi082 ceph-mon[32178]: pgmap v315: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 230 op/s 2024-03-27T07:33:43.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:42 smithi149 ceph-mon[36065]: pgmap v315: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 230 op/s 2024-03-27T07:33:43.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:42 smithi153 ceph-mon[36179]: pgmap v315: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 230 op/s 2024-03-27T07:33:45.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:44 smithi082 ceph-mon[32178]: pgmap v316: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 349 op/s 2024-03-27T07:33:45.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:44 smithi149 ceph-mon[36065]: pgmap v316: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 349 op/s 2024-03-27T07:33:45.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:44 smithi153 ceph-mon[36179]: pgmap v316: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 349 op/s 2024-03-27T07:33:47.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:46 smithi082 ceph-mon[32178]: pgmap v317: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-03-27T07:33:47.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:46 smithi149 ceph-mon[36065]: pgmap v317: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-03-27T07:33:47.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:46 smithi153 ceph-mon[36179]: pgmap v317: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-03-27T07:33:49.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:48 smithi082 ceph-mon[32178]: pgmap v318: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 375 op/s 2024-03-27T07:33:49.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:48 smithi149 ceph-mon[36065]: pgmap v318: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 375 op/s 2024-03-27T07:33:49.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:48 smithi153 ceph-mon[36179]: pgmap v318: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 375 op/s 2024-03-27T07:33:51.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:50 smithi082 ceph-mon[32178]: pgmap v319: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 321 op/s 2024-03-27T07:33:51.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:50 smithi149 ceph-mon[36065]: pgmap v319: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 321 op/s 2024-03-27T07:33:51.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:50 smithi153 ceph-mon[36179]: pgmap v319: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 321 op/s 2024-03-27T07:33:53.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:52 smithi082 ceph-mon[32178]: pgmap v320: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-03-27T07:33:53.259 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:52 smithi149 ceph-mon[36065]: pgmap v320: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-03-27T07:33:53.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:52 smithi153 ceph-mon[36179]: pgmap v320: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 299 op/s 2024-03-27T07:33:55.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:54 smithi082 ceph-mon[32178]: pgmap v321: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 396 op/s 2024-03-27T07:33:55.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:54 smithi149 ceph-mon[36065]: pgmap v321: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 396 op/s 2024-03-27T07:33:55.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:54 smithi153 ceph-mon[36179]: pgmap v321: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 396 op/s 2024-03-27T07:33:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 -- 172.21.15.82:0/518603647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0184105ac0 msgr2=0x7f0184105ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 --2- 172.21.15.82:0/518603647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0184105ac0 0x7f0184105ea0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0178009900 tx=0x7f017802bc30 comp rx=0 tx=0).stop 2024-03-27T07:33:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 -- 172.21.15.82:0/518603647 shutdown_connections 2024-03-27T07:33:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 --2- 172.21.15.82:0/518603647 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01841016f0 0x7f018410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 --2- 172.21.15.82:0/518603647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0184100d30 0x7f01841011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 --2- 172.21.15.82:0/518603647 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0184105ac0 0x7f0184105ea0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 -- 172.21.15.82:0/518603647 >> 172.21.15.82:0/518603647 conn(0x7f0184077830 msgr2=0x7f0184077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 -- 172.21.15.82:0/518603647 shutdown_connections 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 -- 172.21.15.82:0/518603647 wait complete. 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 Processor -- start 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.706+0000 7f018af1e640 1 -- start start 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f018af1e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0184100d30 0x7f01840fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f018af1e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01841016f0 0x7f01840fec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f018af1e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0184105ac0 0x7f01840ff1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f018af1e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0184110e40 con 0x7f01841016f0 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f018af1e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f0184110cc0 con 0x7f0184105ac0 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f018af1e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0184110fc0 con 0x7f0184100d30 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0183fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01841016f0 0x7f01840fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0183fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01841016f0 0x7f01840fec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50028/0 (socket says 172.21.15.82:50028) 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0183fff640 1 -- 172.21.15.82:0/2206215091 learned_addr learned my addr 172.21.15.82:0/2206215091 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0188cba640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0184100d30 0x7f01840fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f01894bb640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0184105ac0 0x7f01840ff1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0183fff640 1 -- 172.21.15.82:0/2206215091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0184100d30 msgr2=0x7f01840fe740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0183fff640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0184100d30 0x7f01840fe740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0183fff640 1 -- 172.21.15.82:0/2206215091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0184105ac0 msgr2=0x7f01840ff1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0183fff640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0184105ac0 0x7f01840ff1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0183fff640 1 -- 172.21.15.82:0/2206215091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01841a6880 con 0x7f01841016f0 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f01894bb640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0184105ac0 0x7f01840ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0183fff640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01841016f0 0x7f01840fec80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f017000d950 tx=0x7f017000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0181ffb640 1 -- 172.21.15.82:0/2206215091 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170017070 con 0x7f01841016f0 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f018af1e640 1 -- 172.21.15.82:0/2206215091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01841a6b70 con 0x7f01841016f0 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0181ffb640 1 -- 172.21.15.82:0/2206215091 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0170009c30 con 0x7f01841016f0 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.707+0000 7f0181ffb640 1 -- 172.21.15.82:0/2206215091 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017000f6b0 con 0x7f01841016f0 2024-03-27T07:33:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.708+0000 7f018af1e640 1 -- 172.21.15.82:0/2206215091 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01841a7110 con 0x7f01841016f0 2024-03-27T07:33:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.709+0000 7f0181ffb640 1 -- 172.21.15.82:0/2206215091 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f01700109d0 con 0x7f01841016f0 2024-03-27T07:33:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f018dbe3740 1 Processor -- start 2024-03-27T07:33:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f018dbe3740 1 -- start start 2024-03-27T07:33:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f0181ffb640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01740a3820 0x7f01740a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 0x5595aa4bf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f01894bb640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01740a3820 0x7f01740a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f0181ffb640 1 -- 172.21.15.82:0/2206215091 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8484+0+0 (secure 0 0 0) 0x7f01700cfd10 con 0x7f01841016f0 2024-03-27T07:33:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f018dbe3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5595aa485cd0 con 0x5595aa4bfa10 2024-03-27T07:33:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f018dbe3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5595aa3ca950 con 0x5595aa4c87e0 2024-03-27T07:33:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f018dbe3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5595aa422e50 con 0x5595aa4bf0f0 2024-03-27T07:33:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f0183fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f0183fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50040/0 (socket says 172.21.15.82:50040) 2024-03-27T07:33:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f0183fff640 1 -- 172.21.15.82:0/618848098 learned_addr learned my addr 172.21.15.82:0/618848098 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f0188cba640 1 --2- 172.21.15.82:0/618848098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 0x5595aa4bf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.710+0000 7f01894bb640 1 --2- 172.21.15.82:0/618848098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f0183fff640 1 -- 172.21.15.82:0/618848098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 msgr2=0x5595aa4bf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:55.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f0183fff640 1 --2- 172.21.15.82:0/618848098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 0x5595aa4bf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f0183fff640 1 -- 172.21.15.82:0/618848098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 msgr2=0x5595aa4cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:55.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f0183fff640 1 --2- 172.21.15.82:0/618848098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f0183fff640 1 -- 172.21.15.82:0/618848098 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595aa137210 con 0x5595aa4bfa10 2024-03-27T07:33:55.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f0188cba640 1 --2- 172.21.15.82:0/618848098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 0x5595aa4bf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:33:55.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f01894bb640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01740a3820 0x7f01740a5ce0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f017c009370 tx=0x7f017c013c40 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:55.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f0183fff640 1 --2- 172.21.15.82:0/618848098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c82a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f01700a4600 tx=0x7f017009b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec107c6dac73c46e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:55.724 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f016effd640 1 -- 172.21.15.82:0/618848098 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170020040 con 0x5595aa4bfa10 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f016effd640 1 -- 172.21.15.82:0/618848098 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01700a0270 con 0x5595aa4bfa10 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.711+0000 7f016effd640 1 -- 172.21.15.82:0/618848098 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01700cde10 con 0x5595aa4bfa10 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 -- 172.21.15.82:0/618848098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 msgr2=0x5595aa4c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 --2- 172.21.15.82:0/618848098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c82a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f01700a4600 tx=0x7f017009b950 comp rx=0 tx=0).stop 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 -- 172.21.15.82:0/618848098 shutdown_connections 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 --2- 172.21.15.82:0/618848098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c82a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 --2- 172.21.15.82:0/618848098 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 --2- 172.21.15.82:0/618848098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 0x5595aa4bf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 -- 172.21.15.82:0/618848098 >> 172.21.15.82:0/618848098 conn(0x5595aa4b9a10 msgr2=0x5595aa4b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 -- 172.21.15.82:0/618848098 shutdown_connections 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 -- 172.21.15.82:0/618848098 wait complete. 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 -- start start 2024-03-27T07:33:55.725 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 Processor -- start 2024-03-27T07:33:55.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 0x5595aa4c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.712+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4c6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f018dbe3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5595aa41ee00 con 0x5595aa4bfa10 2024-03-27T07:33:55.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f018dbe3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5595aa3cb520 con 0x5595aa4c87e0 2024-03-27T07:33:55.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f018dbe3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5595aa3de8e0 con 0x5595aa4bf0f0 2024-03-27T07:33:55.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f018dbe3740 10 client.0 _ll_register_callbacks cb 0x5595aa419a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:33:55.726 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0183fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0183fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50048/0 (socket says 172.21.15.82:50048) 2024-03-27T07:33:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0183fff640 1 -- 172.21.15.82:0/1553636087 learned_addr learned my addr 172.21.15.82:0/1553636087 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0188cba640 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 0x5595aa4c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f01894bb640 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0183fff640 1 -- 172.21.15.82:0/1553636087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 msgr2=0x5595aa4c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0183fff640 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 0x5595aa4c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.727 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0183fff640 1 -- 172.21.15.82:0/1553636087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 msgr2=0x5595aa4c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0183fff640 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0183fff640 1 -- 172.21.15.82:0/1553636087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595aa203620 con 0x5595aa4bfa10 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0183fff640 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c5df0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f017009be50 tx=0x7f0170010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293d675357a00497 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0163fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0163fff640 1 -- 172.21.15.82:0/1553636087 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0170020070 con 0x5595aa4bfa10 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0163fff640 1 -- 172.21.15.82:0/1553636087 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8484+0+0 (secure 0 0 0) 0x7f01700cdde0 con 0x5595aa4bfa10 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f018dbe3740 1 -- 172.21.15.82:0/1553636087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01700a0270 con 0x5595aa4bfa10 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f0163fff640 1 -- 172.21.15.82:0/1553636087 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f01700b5230 con 0x5595aa4bfa10 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f018dbe3740 10 client.17103 fetch_fsmap learned FSMap version 37 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.713+0000 7f018dbe3740 1 -- 172.21.15.82:0/1553636087 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5595aa4d7340 con 0x5595aa4bfa10 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f0163fff640 1 -- 172.21.15.82:0/1553636087 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01700a0270 con 0x5595aa4bfa10 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f0163fff640 1 -- 172.21.15.82:0/1553636087 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f017007ace0 con 0x5595aa4bfa10 2024-03-27T07:33:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f018dbe3740 10 client.17103 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f018dbe3740 10 client.17103 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f018dbe3740 20 client.17103 populate_metadata read hostname 'smithi082' 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f018dbe3740 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5595aa4d8690 0x5595aa4daa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f018dbe3740 4 client.17103 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f018dbe3740 1 -- 172.21.15.82:0/1553636087 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595aa430390 con 0x5595aa4d8690 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f0188cba640 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5595aa4d8690 0x5595aa4daa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f0188cba640 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5595aa4d8690 0x5595aa4daa80 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79b43946e769a89b server_cookie=784b4996cc6d4e49 in_seq=0 out_seq=0 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.714+0000 7f0163fff640 10 client.17103 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f0163fff640 1 -- 172.21.15.82:0/1553636087 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5595aa430390 con 0x5595aa4d8690 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f0163fff640 10 client.17103 handle_command_reply: tid=0 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 client.17103 shutdown 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 -- 172.21.15.82:0/1553636087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 msgr2=0x5595aa4c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c5df0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f017009be50 tx=0x7f0170010d70 comp rx=0 tx=0).stop 2024-03-27T07:33:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 -- 172.21.15.82:0/1553636087 shutdown_connections 2024-03-27T07:33:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5595aa4d8690 0x5595aa4daa80 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bfa10 0x5595aa4c5df0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 --2- 172.21.15.82:0/1553636087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bf0f0 0x5595aa4c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f0163fff640 0 client.17103 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 -- 172.21.15.82:0/1553636087 >> 172.21.15.82:0/1553636087 conn(0x5595aa4b9a10 msgr2=0x5595aa4bb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 -- 172.21.15.82:0/1553636087 shutdown_connections 2024-03-27T07:33:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 1 -- 172.21.15.82:0/1553636087 wait complete. 2024-03-27T07:33:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.715+0000 7f018dbe3740 20 client.17103 trim_cache size 0 max 16384 2024-03-27T07:33:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f018dbe3740 1 Processor -- start 2024-03-27T07:33:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f018dbe3740 1 -- start start 2024-03-27T07:33:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bfa10 0x5595aa4b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f018dbe3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01841b2270 con 0x5595aa4bf0f0 2024-03-27T07:33:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f018dbe3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f01841afa80 con 0x5595aa4c87e0 2024-03-27T07:33:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f018dbe3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01841ad8f0 con 0x5595aa4bfa10 2024-03-27T07:33:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f0188cba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f0188cba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4c6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50060/0 (socket says 172.21.15.82:50060) 2024-03-27T07:33:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f0188cba640 1 -- 172.21.15.82:0/1674623066 learned_addr learned my addr 172.21.15.82:0/1674623066 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f0183fff640 1 --2- 172.21.15.82:0/1674623066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bfa10 0x5595aa4b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f01894bb640 1 --2- 172.21.15.82:0/1674623066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f0188cba640 1 -- 172.21.15.82:0/1674623066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bfa10 msgr2=0x5595aa4b88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f0188cba640 1 --2- 172.21.15.82:0/1674623066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bfa10 0x5595aa4b88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f0188cba640 1 -- 172.21.15.82:0/1674623066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 msgr2=0x5595aa4e00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f0188cba640 1 --2- 172.21.15.82:0/1674623066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4e00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f0188cba640 1 -- 172.21.15.82:0/1674623066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595aa4c6690 con 0x5595aa4bf0f0 2024-03-27T07:33:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f01894bb640 1 --2- 172.21.15.82:0/1674623066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4e00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:33:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f0188cba640 1 --2- 172.21.15.82:0/1674623066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4c6150 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0178009900 tx=0x7f0178005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f44967622f8778 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f016e7fc640 1 -- 172.21.15.82:0/1674623066 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178004400 con 0x5595aa4bf0f0 2024-03-27T07:33:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f016e7fc640 1 -- 172.21.15.82:0/1674623066 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0178051070 con 0x5595aa4bf0f0 2024-03-27T07:33:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.730+0000 7f016e7fc640 1 -- 172.21.15.82:0/1674623066 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178005120 con 0x5595aa4bf0f0 2024-03-27T07:33:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 -- 172.21.15.82:0/1674623066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 msgr2=0x5595aa4c6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 --2- 172.21.15.82:0/1674623066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4c6150 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0178009900 tx=0x7f0178005fd0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 -- 172.21.15.82:0/1674623066 shutdown_connections 2024-03-27T07:33:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 --2- 172.21.15.82:0/1674623066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4c87e0 0x5595aa4e00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 --2- 172.21.15.82:0/1674623066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4bfa10 0x5595aa4b88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 --2- 172.21.15.82:0/1674623066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4c6150 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 -- 172.21.15.82:0/1674623066 >> 172.21.15.82:0/1674623066 conn(0x5595aa4b9a10 msgr2=0x5595aa4b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 -- 172.21.15.82:0/1674623066 shutdown_connections 2024-03-27T07:33:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 -- 172.21.15.82:0/1674623066 wait complete. 2024-03-27T07:33:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 -- start start 2024-03-27T07:33:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.731+0000 7f018dbe3740 1 Processor -- start 2024-03-27T07:33:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4bfa10 0x5595aa4cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f018dbe3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4c87e0 0x5595aa4cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f018dbe3740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01841adf40 con 0x5595aa4bf0f0 2024-03-27T07:33:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f018dbe3740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f01841af3b0 con 0x5595aa4bfa10 2024-03-27T07:33:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f018dbe3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01841ae610 con 0x5595aa4c87e0 2024-03-27T07:33:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f018dbe3740 10 client.0 _ll_register_callbacks cb 0x7f018406a2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:33:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0188cba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0188cba640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50076/0 (socket says 172.21.15.82:50076) 2024-03-27T07:33:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0188cba640 1 -- 172.21.15.82:0/109365204 learned_addr learned my addr 172.21.15.82:0/109365204 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:33:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0183fff640 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4bfa10 0x5595aa4cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f01894bb640 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4c87e0 0x5595aa4cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0188cba640 1 -- 172.21.15.82:0/109365204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4c87e0 msgr2=0x5595aa4cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0188cba640 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4c87e0 0x5595aa4cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0188cba640 1 -- 172.21.15.82:0/109365204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4bfa10 msgr2=0x5595aa4cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0188cba640 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4bfa10 0x5595aa4cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0188cba640 1 -- 172.21.15.82:0/109365204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595aa4cdf70 con 0x5595aa4bf0f0 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0188cba640 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4d0610 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f017802c420 tx=0x7f0178004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8154cdfdc8246e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0163fff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.732+0000 7f0163fff640 1 -- 172.21.15.82:0/109365204 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0178059020 con 0x5595aa4bf0f0 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f018dbe3740 1 -- 172.21.15.82:0/109365204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0178051070 con 0x5595aa4bf0f0 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f0163fff640 1 -- 172.21.15.82:0/109365204 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8484+0+0 (secure 0 0 0) 0x7f017802c8b0 con 0x5595aa4bf0f0 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f0163fff640 1 -- 172.21.15.82:0/109365204 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f0178004930 con 0x5595aa4bf0f0 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f018dbe3740 10 client.17109 fetch_fsmap learned FSMap version 37 2024-03-27T07:33:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f018dbe3740 1 -- 172.21.15.82:0/109365204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5595aa53f560 con 0x5595aa4bf0f0 2024-03-27T07:33:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f0163fff640 1 -- 172.21.15.82:0/109365204 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0178051070 con 0x5595aa4bf0f0 2024-03-27T07:33:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f0163fff640 1 -- 172.21.15.82:0/109365204 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f017804b100 con 0x5595aa4bf0f0 2024-03-27T07:33:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f018dbe3740 10 client.17109 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:33:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f018dbe3740 10 client.17109 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:33:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f018dbe3740 20 client.17109 populate_metadata read hostname 'smithi082' 2024-03-27T07:33:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f018dbe3740 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5595aa53fc80 0x5595aa5420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:33:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f018dbe3740 4 client.17109 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:33:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f018dbe3740 1 -- 172.21.15.82:0/109365204 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595aa42a6e0 con 0x5595aa53fc80 2024-03-27T07:33:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.733+0000 7f0183fff640 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5595aa53fc80 0x5595aa5420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:33:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.734+0000 7f0163fff640 10 client.17109 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.734+0000 7f0183fff640 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5595aa53fc80 0x5595aa5420a0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79ca12311bba5bfb server_cookie=45052d4d99af500 in_seq=0 out_seq=0 2024-03-27T07:33:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f0163fff640 1 -- 172.21.15.82:0/109365204 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5595aa42a6e0 con 0x5595aa53fc80 2024-03-27T07:33:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f0163fff640 10 client.17109 handle_command_reply: tid=0 2024-03-27T07:33:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f018dbe3740 1 client.17109 shutdown 2024-03-27T07:33:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f018dbe3740 1 -- 172.21.15.82:0/109365204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 msgr2=0x5595aa4d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f018dbe3740 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4d0610 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f017802c420 tx=0x7f0178004740 comp rx=0 tx=0).stop 2024-03-27T07:33:55.862 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f018dbe3740 1 -- 172.21.15.82:0/109365204 shutdown_connections 2024-03-27T07:33:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f018dbe3740 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5595aa4c87e0 0x5595aa4cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f018dbe3740 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5595aa4bfa10 0x5595aa4cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f018dbe3740 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5595aa53fc80 0x5595aa5420a0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f0163fff640 0 client.17109 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:33:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f018dbe3740 1 --2- 172.21.15.82:0/109365204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5595aa4bf0f0 0x5595aa4d0610 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.859+0000 7f018dbe3740 1 -- 172.21.15.82:0/109365204 >> 172.21.15.82:0/109365204 conn(0x5595aa4b9a10 msgr2=0x5595aa4c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.860+0000 7f018dbe3740 1 -- 172.21.15.82:0/109365204 shutdown_connections 2024-03-27T07:33:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.860+0000 7f018dbe3740 1 -- 172.21.15.82:0/109365204 wait complete. 2024-03-27T07:33:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.860+0000 7f018dbe3740 20 client.17109 trim_cache size 0 max 16384 2024-03-27T07:33:55.863 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:33:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:33:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:33:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:33:55.864 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 -- 172.21.15.82:0/2206215091 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01740a3820 msgr2=0x7f01740a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01740a3820 0x7f01740a5ce0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f017c009370 tx=0x7f017c013c40 comp rx=0 tx=0).stop 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 -- 172.21.15.82:0/2206215091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01841016f0 msgr2=0x7f01840fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01841016f0 0x7f01840fec80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f017000d950 tx=0x7f017000de10 comp rx=0 tx=0).stop 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 -- 172.21.15.82:0/2206215091 shutdown_connections 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01740a3820 0x7f01740a5ce0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01841016f0 0x7f01840fec80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f0184105ac0 0x7f01840ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 --2- 172.21.15.82:0/2206215091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0184100d30 0x7f01840fe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 -- 172.21.15.82:0/2206215091 >> 172.21.15.82:0/2206215091 conn(0x7f0184077830 msgr2=0x7f018406a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 -- 172.21.15.82:0/2206215091 shutdown_connections 2024-03-27T07:33:55.865 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:33:55.861+0000 7f018af1e640 1 -- 172.21.15.82:0/2206215091 wait complete. 2024-03-27T07:33:57.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:56 smithi082 ceph-mon[32178]: pgmap v322: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 227 op/s 2024-03-27T07:33:57.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:56 smithi149 ceph-mon[36065]: pgmap v322: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 227 op/s 2024-03-27T07:33:57.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:56 smithi153 ceph-mon[36179]: pgmap v322: 97 pgs: 97 active+clean; 1.9 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 227 op/s 2024-03-27T07:33:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:33:58 smithi082 ceph-mon[32178]: pgmap v323: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2024-03-27T07:33:59.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:33:58 smithi149 ceph-mon[36065]: pgmap v323: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2024-03-27T07:33:59.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:33:58 smithi153 ceph-mon[36179]: pgmap v323: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 315 op/s 2024-03-27T07:34:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:00 smithi082 ceph-mon[32178]: pgmap v324: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 261 op/s 2024-03-27T07:34:01.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:00 smithi149 ceph-mon[36065]: pgmap v324: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 261 op/s 2024-03-27T07:34:01.288 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:00 smithi153 ceph-mon[36179]: pgmap v324: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 261 op/s 2024-03-27T07:34:02.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:01 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:34:02.255 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:01 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:34:02.291 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:01 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:34:03.038 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:02 smithi153 ceph-mon[36179]: pgmap v325: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 236 op/s 2024-03-27T07:34:03.115 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:02 smithi149 ceph-mon[36065]: pgmap v325: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 236 op/s 2024-03-27T07:34:03.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:02 smithi082 ceph-mon[32178]: pgmap v325: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 236 op/s 2024-03-27T07:34:04.428 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: pgmap v326: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 326 op/s 2024-03-27T07:34:04.428 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.428 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.429 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.429 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.429 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.429 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.429 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.429 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.429 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.430 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.430 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.430 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.430 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-27T07:34:04.430 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: Unable to set osd_memory_target on smithi082 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-03-27T07:34:04.430 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.431 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.431 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.431 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.431 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.431 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.431 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.432 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:04 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: pgmap v326: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 326 op/s 2024-03-27T07:34:04.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: Unable to set osd_memory_target on smithi082 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.539 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.540 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:04 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: pgmap v326: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 326 op/s 2024-03-27T07:34:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi082 to 176.2M 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: Unable to set osd_memory_target on smithi082 to 184762368: error parsing value: Value '184762368' is below minimum 939524096 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:04.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:04 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:05.522 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:05 smithi149 ceph-mon[36065]: Adjusting osd_memory_target on smithi153 to 174.1M 2024-03-27T07:34:05.523 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:05 smithi149 ceph-mon[36065]: Unable to set osd_memory_target on smithi153 to 182635622: error parsing value: Value '182635622' is below minimum 939524096 2024-03-27T07:34:05.537 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:05 smithi153 ceph-mon[36179]: Adjusting osd_memory_target on smithi153 to 174.1M 2024-03-27T07:34:05.538 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:05 smithi153 ceph-mon[36179]: Unable to set osd_memory_target on smithi153 to 182635622: error parsing value: Value '182635622' is below minimum 939524096 2024-03-27T07:34:05.687 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:05 smithi082 ceph-mon[32178]: Adjusting osd_memory_target on smithi153 to 174.1M 2024-03-27T07:34:05.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:05 smithi082 ceph-mon[32178]: Unable to set osd_memory_target on smithi153 to 182635622: error parsing value: Value '182635622' is below minimum 939524096 2024-03-27T07:34:06.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:06 smithi149 ceph-mon[36065]: pgmap v327: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-03-27T07:34:06.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:06 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:06.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:06 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:06.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:06 smithi153 ceph-mon[36179]: pgmap v327: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-03-27T07:34:06.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:06 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:06.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:06 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:06 smithi082 ceph-mon[32178]: pgmap v327: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 236 op/s 2024-03-27T07:34:06.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:06 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:06.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:06 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:07.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:07 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:07.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:07 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:07.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:07 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:34:07.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:07 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:34:07.755 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:07 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:07.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:07 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:07.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:07 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:07.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:07 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:34:07.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:07 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:34:07.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:07 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:07.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:07 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:07.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:07 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi149", "name": "osd_memory_target"}]: dispatch 2024-03-27T07:34:07.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:07 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:34:07.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:07 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:34:07.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:07 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:34:08.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:08 smithi149 ceph-mon[36065]: pgmap v328: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 295 op/s 2024-03-27T07:34:08.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:08 smithi153 ceph-mon[36179]: pgmap v328: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 295 op/s 2024-03-27T07:34:08.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:08 smithi082 ceph-mon[32178]: pgmap v328: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 295 op/s 2024-03-27T07:34:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.957+0000 7fecac702640 1 -- 172.21.15.82:0/825176827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca41059f0 msgr2=0x7feca4105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.957+0000 7fecac702640 1 --2- 172.21.15.82:0/825176827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca41059f0 0x7feca4105dd0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7feca0009900 tx=0x7feca002bc30 comp rx=0 tx=0).stop 2024-03-27T07:34:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.957+0000 7fecac702640 1 -- 172.21.15.82:0/825176827 shutdown_connections 2024-03-27T07:34:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.957+0000 7fecac702640 1 --2- 172.21.15.82:0/825176827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca4101660 0x7feca410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.957+0000 7fecac702640 1 --2- 172.21.15.82:0/825176827 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feca4100ca0 0x7feca4101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.957+0000 7fecac702640 1 --2- 172.21.15.82:0/825176827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca41059f0 0x7feca4105dd0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.957+0000 7fecac702640 1 -- 172.21.15.82:0/825176827 >> 172.21.15.82:0/825176827 conn(0x7feca40778a0 msgr2=0x7feca4077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.957+0000 7fecac702640 1 -- 172.21.15.82:0/825176827 shutdown_connections 2024-03-27T07:34:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.957+0000 7fecac702640 1 -- 172.21.15.82:0/825176827 wait complete. 2024-03-27T07:34:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecac702640 1 Processor -- start 2024-03-27T07:34:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecac702640 1 -- start start 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecac702640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca4100ca0 0x7feca4199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecac702640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feca4101660 0x7feca4199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecac702640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca41059f0 0x7feca41a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecac702640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feca4110f10 con 0x7feca41059f0 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecac702640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feca4110d90 con 0x7feca4101660 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecac702640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feca4111090 con 0x7feca4100ca0 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecaac9f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca41059f0 0x7feca41a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecaac9f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca41059f0 0x7feca41a42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43902/0 (socket says 172.21.15.82:43902) 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecaac9f640 1 -- 172.21.15.82:0/3171141413 learned_addr learned my addr 172.21.15.82:0/3171141413 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7feca9c9d640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feca4101660 0x7feca4199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecaa49e640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca4100ca0 0x7feca4199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecaac9f640 1 -- 172.21.15.82:0/3171141413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca4100ca0 msgr2=0x7feca4199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecaac9f640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca4100ca0 0x7feca4199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecaac9f640 1 -- 172.21.15.82:0/3171141413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feca4101660 msgr2=0x7feca4199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecaac9f640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feca4101660 0x7feca4199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7fecaac9f640 1 -- 172.21.15.82:0/3171141413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca41a4810 con 0x7feca41059f0 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.958+0000 7feca9c9d640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feca4101660 0x7feca4199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.959+0000 7fecaac9f640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca41059f0 0x7feca41a42d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00ea60 tx=0x7fec9c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.959+0000 7fec9b7fe640 1 -- 172.21.15.82:0/3171141413 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00ce40 con 0x7feca41059f0 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.959+0000 7fec9b7fe640 1 -- 172.21.15.82:0/3171141413 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec9c005020 con 0x7feca41059f0 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.959+0000 7fecac702640 1 -- 172.21.15.82:0/3171141413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca41a49e0 con 0x7feca41059f0 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.959+0000 7fec9b7fe640 1 -- 172.21.15.82:0/3171141413 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9c010690 con 0x7feca41059f0 2024-03-27T07:34:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.959+0000 7fecac702640 1 -- 172.21.15.82:0/3171141413 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca41a4ed0 con 0x7feca41059f0 2024-03-27T07:34:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.961+0000 7fec9b7fe640 1 -- 172.21.15.82:0/3171141413 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fec9c005520 con 0x7feca41059f0 2024-03-27T07:34:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.961+0000 7fecaf3c6740 1 Processor -- start 2024-03-27T07:34:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fecaf3c6740 1 -- start start 2024-03-27T07:34:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f94e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 0x56016f9572a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.970 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f959bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56016f914cd0 con 0x56016f94e0f0 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56016f859950 con 0x56016f94ea10 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56016f8b1e50 con 0x56016f9577e0 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fec9b7fe640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fec900a3820 0x7fec900a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7feca9c9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f94e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7feca9c9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f94e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43906/0 (socket says 172.21.15.82:43906) 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7feca9c9d640 1 -- 172.21.15.82:0/3618003176 learned_addr learned my addr 172.21.15.82:0/3618003176 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fecaa49e640 1 --2- 172.21.15.82:0/3618003176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 0x56016f9572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7feca9c9d640 1 --2- 172.21.15.82:0/3618003176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f959bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fecaac9f640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fec900a3820 0x7fec900a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.962+0000 7fecaa49e640 1 -- 172.21.15.82:0/3618003176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 msgr2=0x56016f959bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.963+0000 7fecaa49e640 1 --2- 172.21.15.82:0/3618003176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f959bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.963+0000 7fecaa49e640 1 -- 172.21.15.82:0/3618003176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 msgr2=0x56016f94e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:08.971 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.963+0000 7fecaa49e640 1 --2- 172.21.15.82:0/3618003176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f94e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.963+0000 7fecaa49e640 1 -- 172.21.15.82:0/3618003176 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56016f5c6210 con 0x56016f94ea10 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.963+0000 7fec9b7fe640 1 -- 172.21.15.82:0/3171141413 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 8484+0+0 (secure 0 0 0) 0x7fec9c0d04a0 con 0x7feca41059f0 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.963+0000 7fecaa49e640 1 --2- 172.21.15.82:0/3618003176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 0x56016f9572a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feca0000c00 tx=0x7feca0005be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e3837d020d044d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.963+0000 7fecaac9f640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fec900a3820 0x7fec900a5ce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0cdcc0 tx=0x7fec9c06e280 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.963+0000 7fec98ff9640 1 -- 172.21.15.82:0/3618003176 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca0042070 con 0x56016f94ea10 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.963+0000 7fec98ff9640 1 -- 172.21.15.82:0/3618003176 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca002c8b0 con 0x56016f94ea10 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.963+0000 7fec98ff9640 1 -- 172.21.15.82:0/3618003176 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca0004c00 con 0x56016f94ea10 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 -- 172.21.15.82:0/3618003176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 msgr2=0x56016f9572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/3618003176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 0x56016f9572a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7feca0000c00 tx=0x7feca0005be0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 -- 172.21.15.82:0/3618003176 shutdown_connections 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/3618003176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f959bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/3618003176 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 0x56016f9572a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.972 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/3618003176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f94e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 -- 172.21.15.82:0/3618003176 >> 172.21.15.82:0/3618003176 conn(0x56016f948a10 msgr2=0x56016f948df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 -- 172.21.15.82:0/3618003176 shutdown_connections 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 -- 172.21.15.82:0/3618003176 wait complete. 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 -- start start 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.964+0000 7fecaf3c6740 1 Processor -- start 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f954810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f94ea10 0x56016f954d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f9577e0 0x56016f955290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56016f8ade00 con 0x56016f94e0f0 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56016f85a520 con 0x56016f9577e0 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56016f86d8e0 con 0x56016f94ea10 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaf3c6740 10 client.0 _ll_register_callbacks cb 0x56016f8a8a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:34:08.973 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7feca9c9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f954810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7feca9c9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f954810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43922/0 (socket says 172.21.15.82:43922) 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7feca9c9d640 1 -- 172.21.15.82:0/461486201 learned_addr learned my addr 172.21.15.82:0/461486201 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaa49e640 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f94ea10 0x56016f954d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7feca9c9d640 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f9577e0 0x56016f955290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7feca9c9d640 1 -- 172.21.15.82:0/461486201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f94ea10 msgr2=0x56016f954d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7feca9c9d640 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f94ea10 0x56016f954d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7feca9c9d640 1 -- 172.21.15.82:0/461486201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f9577e0 msgr2=0x56016f955290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7feca9c9d640 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f9577e0 0x56016f955290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7feca9c9d640 1 -- 172.21.15.82:0/461486201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56016f692620 con 0x56016f94e0f0 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7feca9c9d640 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f954810 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fec94013430 tx=0x7fec94005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376e535d7a8e72b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fec8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fec8dffb640 1 -- 172.21.15.82:0/461486201 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec940040f0 con 0x56016f94e0f0 2024-03-27T07:34:08.974 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fec8dffb640 1 -- 172.21.15.82:0/461486201 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8484+0+0 (secure 0 0 0) 0x7fec94009040 con 0x56016f94e0f0 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaf3c6740 1 -- 172.21.15.82:0/461486201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca002c8b0 con 0x56016f94e0f0 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fec8dffb640 1 -- 172.21.15.82:0/461486201 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fec94004290 con 0x56016f94e0f0 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaf3c6740 10 client.17121 fetch_fsmap learned FSMap version 37 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.965+0000 7fecaf3c6740 1 -- 172.21.15.82:0/461486201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56016f966310 con 0x56016f94e0f0 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fec8dffb640 1 -- 172.21.15.82:0/461486201 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca002c8b0 con 0x56016f94e0f0 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fec8dffb640 1 -- 172.21.15.82:0/461486201 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fec9400f5f0 con 0x56016f94e0f0 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fecaf3c6740 10 client.17121 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fecaf3c6740 10 client.17121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fecaf3c6740 20 client.17121 populate_metadata read hostname 'smithi082' 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56016f967820 0x56016f969c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fecaf3c6740 4 client.17121 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fecaf3c6740 1 -- 172.21.15.82:0/461486201 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56016f8bf390 con 0x56016f967820 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fecaa49e640 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56016f967820 0x56016f969c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.975 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fec8dffb640 10 client.17121 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.966+0000 7fecaa49e640 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56016f967820 0x56016f969c30 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d913340793304fd2 server_cookie=7942c152b63b1f9f in_seq=0 out_seq=0 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fec8dffb640 1 -- 172.21.15.82:0/461486201 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56016f8bf390 con 0x56016f967820 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fec8dffb640 10 client.17121 handle_command_reply: tid=0 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 client.17121 shutdown 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 -- 172.21.15.82:0/461486201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 msgr2=0x56016f954810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f954810 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fec94013430 tx=0x7fec94005f90 comp rx=0 tx=0).stop 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 -- 172.21.15.82:0/461486201 shutdown_connections 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f9577e0 0x56016f955290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f94ea10 0x56016f954d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56016f967820 0x56016f969c30 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/461486201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f954810 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fec8dffb640 0 client.17121 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 -- 172.21.15.82:0/461486201 >> 172.21.15.82:0/461486201 conn(0x56016f948a10 msgr2=0x56016f94a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:08.976 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 -- 172.21.15.82:0/461486201 shutdown_connections 2024-03-27T07:34:08.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.967+0000 7fecaf3c6740 1 -- 172.21.15.82:0/461486201 wait complete. 2024-03-27T07:34:08.977 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.968+0000 7fecaf3c6740 20 client.17121 trim_cache size 0 max 16384 2024-03-27T07:34:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaf3c6740 1 Processor -- start 2024-03-27T07:34:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaf3c6740 1 -- start start 2024-03-27T07:34:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94e0f0 0x56016f962e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94ea10 0x56016f96f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f951ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feca41b0080 con 0x56016f94ea10 2024-03-27T07:34:08.990 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feca41ad890 con 0x56016f94e0f0 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feca41ab700 con 0x56016f9577e0 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaa49e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94ea10 0x56016f96f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaa49e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94ea10 0x56016f96f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43928/0 (socket says 172.21.15.82:43928) 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaa49e640 1 -- 172.21.15.82:0/35846572 learned_addr learned my addr 172.21.15.82:0/35846572 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7feca9c9d640 1 --2- 172.21.15.82:0/35846572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94e0f0 0x56016f962e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7feca9c9d640 1 --2- 172.21.15.82:0/35846572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f951ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaa49e640 1 -- 172.21.15.82:0/35846572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 msgr2=0x56016f951ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaa49e640 1 --2- 172.21.15.82:0/35846572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f951ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaa49e640 1 -- 172.21.15.82:0/35846572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94e0f0 msgr2=0x56016f962e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaa49e640 1 --2- 172.21.15.82:0/35846572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94e0f0 0x56016f962e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.991 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaa49e640 1 -- 172.21.15.82:0/35846572 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56016f964420 con 0x56016f94ea10 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7feca9c9d640 1 --2- 172.21.15.82:0/35846572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94e0f0 0x56016f962e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.983+0000 7fecaa49e640 1 --2- 172.21.15.82:0/35846572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94ea10 0x56016f96f540 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7feca0004870 tx=0x7feca002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f726220df476d1b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fec8ffff640 1 -- 172.21.15.82:0/35846572 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca0042040 con 0x56016f94ea10 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fec8ffff640 1 -- 172.21.15.82:0/35846572 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca0050070 con 0x56016f94ea10 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fec8ffff640 1 -- 172.21.15.82:0/35846572 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca0050480 con 0x56016f94ea10 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fecaf3c6740 1 -- 172.21.15.82:0/35846572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94ea10 msgr2=0x56016f96f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/35846572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94ea10 0x56016f96f540 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7feca0004870 tx=0x7feca002bc30 comp rx=0 tx=0).stop 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fecaf3c6740 1 -- 172.21.15.82:0/35846572 shutdown_connections 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/35846572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94ea10 0x56016f96f540 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/35846572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f951ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/35846572 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94e0f0 0x56016f962e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.992 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fecaf3c6740 1 -- 172.21.15.82:0/35846572 >> 172.21.15.82:0/35846572 conn(0x56016f948a10 msgr2=0x56016f94a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fecaf3c6740 1 -- 172.21.15.82:0/35846572 shutdown_connections 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fecaf3c6740 1 -- 172.21.15.82:0/35846572 wait complete. 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.984+0000 7fecaf3c6740 1 -- start start 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fecaf3c6740 1 Processor -- start 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f95f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 0x56016f95c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fecaf3c6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f95c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7feca41abd50 con 0x56016f94e0f0 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7feca41ad1c0 con 0x56016f94ea10 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fecaf3c6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7feca41ac420 con 0x56016f9577e0 2024-03-27T07:34:08.993 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fecaf3c6740 10 client.0 _ll_register_callbacks cb 0x7fec940135d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:34:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7feca9c9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f95f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7feca9c9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f95f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43930/0 (socket says 172.21.15.82:43930) 2024-03-27T07:34:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7feca9c9d640 1 -- 172.21.15.82:0/2162887445 learned_addr learned my addr 172.21.15.82:0/2162887445 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:08.994 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fecaa49e640 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 0x56016f95c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7feca9c9d640 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f95c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7feca9c9d640 1 -- 172.21.15.82:0/2162887445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 msgr2=0x56016f95c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7feca9c9d640 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f95c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7feca9c9d640 1 -- 172.21.15.82:0/2162887445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 msgr2=0x56016f95c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:08.995 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7feca9c9d640 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 0x56016f95c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7feca9c9d640 1 -- 172.21.15.82:0/2162887445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56016f95ced0 con 0x56016f94e0f0 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7feca9c9d640 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f95f480 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fec940059f0 tx=0x7fec940134d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dae668b32e5220d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fec8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.985+0000 7fec8dffb640 1 -- 172.21.15.82:0/2162887445 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94030070 con 0x56016f94e0f0 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fec8dffb640 1 -- 172.21.15.82:0/2162887445 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 8484+0+0 (secure 0 0 0) 0x7fec9400f5d0 con 0x56016f94e0f0 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fecaf3c6740 1 -- 172.21.15.82:0/2162887445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca0050070 con 0x56016f94e0f0 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fec8dffb640 1 -- 172.21.15.82:0/2162887445 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fec94040050 con 0x56016f94e0f0 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fecaf3c6740 10 client.17127 fetch_fsmap learned FSMap version 37 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fecaf3c6740 1 -- 172.21.15.82:0/2162887445 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x56016f9ce8b0 con 0x56016f94e0f0 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fec8dffb640 1 -- 172.21.15.82:0/2162887445 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feca0050070 con 0x56016f94e0f0 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fec8dffb640 1 -- 172.21.15.82:0/2162887445 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fec94037070 con 0x56016f94e0f0 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fecaf3c6740 10 client.17127 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:34:08.996 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fecaf3c6740 10 client.17127 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:34:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fecaf3c6740 20 client.17127 populate_metadata read hostname 'smithi082' 2024-03-27T07:34:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56016f9cf070 0x56016f9d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fecaf3c6740 4 client.17127 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:34:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fecaf3c6740 1 -- 172.21.15.82:0/2162887445 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56016f8b96e0 con 0x56016f9cf070 2024-03-27T07:34:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.986+0000 7fecaa49e640 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56016f9cf070 0x56016f9d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.987+0000 7fecaa49e640 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56016f9cf070 0x56016f9d1490 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf41db3dfc3ceb4b server_cookie=4339e5a78f426479 in_seq=0 out_seq=0 2024-03-27T07:34:08.997 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.987+0000 7fec8dffb640 10 client.17127 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.994+0000 7fec8dffb640 1 -- 172.21.15.82:0/2162887445 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56016f8b96e0 con 0x56016f9cf070 2024-03-27T07:34:08.998 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.994+0000 7fec8dffb640 10 client.17127 handle_command_reply: tid=0 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.994+0000 7fecaf3c6740 1 client.17127 shutdown 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.994+0000 7fecaf3c6740 1 -- 172.21.15.82:0/2162887445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 msgr2=0x56016f95f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.994+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f95f480 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fec940059f0 tx=0x7fec940134d0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.994+0000 7fecaf3c6740 1 -- 172.21.15.82:0/2162887445 shutdown_connections 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56016f9577e0 0x56016f95c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56016f94ea10 0x56016f95c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56016f9cf070 0x56016f9d1490 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecaf3c6740 1 --2- 172.21.15.82:0/2162887445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56016f94e0f0 0x56016f95f480 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fec8dffb640 0 client.17127 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecaf3c6740 1 -- 172.21.15.82:0/2162887445 >> 172.21.15.82:0/2162887445 conn(0x56016f948a10 msgr2=0x56016f9547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecaf3c6740 1 -- 172.21.15.82:0/2162887445 shutdown_connections 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecaf3c6740 1 -- 172.21.15.82:0/2162887445 wait complete. 2024-03-27T07:34:08.999 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecaf3c6740 20 client.17127 trim_cache size 0 max 16384 2024-03-27T07:34:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:34:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:34:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:34:09.000 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:34:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 -- 172.21.15.82:0/3171141413 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fec900a3820 msgr2=0x7fec900a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fec900a3820 0x7fec900a5ce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0cdcc0 tx=0x7fec9c06e280 comp rx=0 tx=0).stop 2024-03-27T07:34:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 -- 172.21.15.82:0/3171141413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca41059f0 msgr2=0x7feca41a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca41059f0 0x7feca41a42d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fec9c00ea60 tx=0x7fec9c00ef20 comp rx=0 tx=0).stop 2024-03-27T07:34:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 -- 172.21.15.82:0/3171141413 shutdown_connections 2024-03-27T07:34:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fec900a3820 0x7fec900a5ce0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feca41059f0 0x7feca41a42d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7feca4101660 0x7feca4199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 --2- 172.21.15.82:0/3171141413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca4100ca0 0x7feca4199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:09.001 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 -- 172.21.15.82:0/3171141413 >> 172.21.15.82:0/3171141413 conn(0x7feca40778a0 msgr2=0x7feca40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 -- 172.21.15.82:0/3171141413 shutdown_connections 2024-03-27T07:34:09.002 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:08.995+0000 7fecac702640 1 -- 172.21.15.82:0/3171141413 wait complete. 2024-03-27T07:34:10.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:10 smithi149 ceph-mon[36065]: pgmap v329: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 208 op/s 2024-03-27T07:34:10.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:10 smithi153 ceph-mon[36179]: pgmap v329: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 208 op/s 2024-03-27T07:34:10.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:10 smithi082 ceph-mon[32178]: pgmap v329: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 208 op/s 2024-03-27T07:34:11.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:11 smithi149 ceph-mon[36065]: osdmap e99: 12 total, 12 up, 12 in 2024-03-27T07:34:11.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:11 smithi153 ceph-mon[36179]: osdmap e99: 12 total, 12 up, 12 in 2024-03-27T07:34:11.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:11 smithi082 ceph-mon[32178]: osdmap e99: 12 total, 12 up, 12 in 2024-03-27T07:34:12.756 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:12 smithi149 ceph-mon[36065]: pgmap v331: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 219 op/s 2024-03-27T07:34:12.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:12 smithi153 ceph-mon[36179]: pgmap v331: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 219 op/s 2024-03-27T07:34:12.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:12 smithi082 ceph-mon[32178]: pgmap v331: 97 pgs: 97 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.1 MiB/s wr, 219 op/s 2024-03-27T07:34:14.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:14 smithi149 ceph-mon[36065]: pgmap v332: 97 pgs: 36 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 41 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 160 op/s 2024-03-27T07:34:14.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:14 smithi153 ceph-mon[36179]: pgmap v332: 97 pgs: 36 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 41 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 160 op/s 2024-03-27T07:34:14.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:14 smithi082 ceph-mon[32178]: pgmap v332: 97 pgs: 36 active+clean+snaptrim_wait, 20 active+clean+snaptrim, 41 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 160 op/s 2024-03-27T07:34:16.754 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:16 smithi149 ceph-mon[36065]: pgmap v333: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 155 op/s 2024-03-27T07:34:16.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:16 smithi153 ceph-mon[36179]: pgmap v333: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 155 op/s 2024-03-27T07:34:16.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:16 smithi082 ceph-mon[32178]: pgmap v333: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 155 op/s 2024-03-27T07:34:18.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:18 smithi153 ceph-mon[36179]: pgmap v334: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 118 op/s 2024-03-27T07:34:18.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:18 smithi082 ceph-mon[32178]: pgmap v334: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 118 op/s 2024-03-27T07:34:19.005 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:18 smithi149 ceph-mon[36065]: pgmap v334: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.2 MiB/s wr, 118 op/s 2024-03-27T07:34:20.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:20 smithi153 ceph-mon[36179]: pgmap v335: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-03-27T07:34:20.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:20 smithi082 ceph-mon[32178]: pgmap v335: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-03-27T07:34:21.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:20 smithi149 ceph-mon[36065]: pgmap v335: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-03-27T07:34:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.097+0000 7f6be48af640 1 -- 172.21.15.82:0/205311387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be01024b0 msgr2=0x7f6be010e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.097+0000 7f6be48af640 1 --2- 172.21.15.82:0/205311387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be01024b0 0x7f6be010e9c0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009cd0 tx=0x7f6bd802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.097+0000 7f6be48af640 1 -- 172.21.15.82:0/205311387 shutdown_connections 2024-03-27T07:34:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.097+0000 7f6be48af640 1 --2- 172.21.15.82:0/205311387 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be01024b0 0x7f6be010e9c0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.097+0000 7f6be48af640 1 --2- 172.21.15.82:0/205311387 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6be0101af0 0x7f6be0101f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.097+0000 7f6be48af640 1 --2- 172.21.15.82:0/205311387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be0107b90 0x7f6be0107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.097+0000 7f6be48af640 1 -- 172.21.15.82:0/205311387 >> 172.21.15.82:0/205311387 conn(0x7f6be00fd5e0 msgr2=0x7f6be00ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.097+0000 7f6be48af640 1 -- 172.21.15.82:0/205311387 shutdown_connections 2024-03-27T07:34:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.097+0000 7f6be48af640 1 -- 172.21.15.82:0/205311387 wait complete. 2024-03-27T07:34:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.098+0000 7f6be48af640 1 Processor -- start 2024-03-27T07:34:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.098+0000 7f6be48af640 1 -- start start 2024-03-27T07:34:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6be48af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be0101af0 0x7f6be0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6be48af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be01024b0 0x7f6be0198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6be48af640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6be0107b90 0x7f6be019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6be48af640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0111ee0 con 0x7f6be0101af0 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6be48af640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0111d60 con 0x7f6be0107b90 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6be48af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0112060 con 0x7f6be01024b0 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bddd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be01024b0 0x7f6be0198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bddd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be01024b0 0x7f6be0198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:40902/0 (socket says 172.21.15.82:40902) 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bddd9b640 1 -- 172.21.15.82:0/4083601159 learned_addr learned my addr 172.21.15.82:0/4083601159 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bde59c640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be0101af0 0x7f6be0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bded9d640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6be0107b90 0x7f6be019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bddd9b640 1 -- 172.21.15.82:0/4083601159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6be0107b90 msgr2=0x7f6be019cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bddd9b640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6be0107b90 0x7f6be019cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bddd9b640 1 -- 172.21.15.82:0/4083601159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be0101af0 msgr2=0x7f6be0198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bddd9b640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be0101af0 0x7f6be0198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bddd9b640 1 -- 172.21.15.82:0/4083601159 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be019d2f0 con 0x7f6be01024b0 2024-03-27T07:34:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.099+0000 7f6bddd9b640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be01024b0 0x7f6be0198840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400e9f0 tx=0x7f6bd400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.100+0000 7f6bcf7fe640 1 -- 172.21.15.82:0/4083601159 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400cd80 con 0x7f6be01024b0 2024-03-27T07:34:22.104 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.100+0000 7f6be48af640 1 -- 172.21.15.82:0/4083601159 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be019d5e0 con 0x7f6be01024b0 2024-03-27T07:34:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.100+0000 7f6bcf7fe640 1 -- 172.21.15.82:0/4083601159 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bd4010910 con 0x7f6be01024b0 2024-03-27T07:34:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.100+0000 7f6bcf7fe640 1 -- 172.21.15.82:0/4083601159 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40188f0 con 0x7f6be01024b0 2024-03-27T07:34:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.100+0000 7f6be48af640 1 -- 172.21.15.82:0/4083601159 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be01a4e70 con 0x7f6be01024b0 2024-03-27T07:34:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.103+0000 7f6bcf7fe640 1 -- 172.21.15.82:0/4083601159 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f6bd4010ac0 con 0x7f6be01024b0 2024-03-27T07:34:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.104+0000 7f6be7574740 1 Processor -- start 2024-03-27T07:34:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.104+0000 7f6bcf7fe640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6bc80a3820 0x7f6bc80a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.104+0000 7f6be7574740 1 -- start start 2024-03-27T07:34:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.104+0000 7f6bcf7fe640 1 -- 172.21.15.82:0/4083601159 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8528+0+0 (secure 0 0 0) 0x7f6bd40d04f0 con 0x7f6be01024b0 2024-03-27T07:34:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.104+0000 7f6bded9d640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6bc80a3820 0x7f6bc80a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.104+0000 7f6be7574740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1a770 0x561214b1ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6be7574740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1b120 0x561214b074c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6be7574740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b07ae0 0x561214b07f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6be7574740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561214ad3cd0 con 0x561214b1b120 2024-03-27T07:34:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6be7574740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561214a18950 con 0x561214b07ae0 2024-03-27T07:34:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6be7574740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561214a70e50 con 0x561214b1a770 2024-03-27T07:34:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1a770 0x561214b1ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1a770 0x561214b1ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:40914/0 (socket says 172.21.15.82:40914) 2024-03-27T07:34:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bde59c640 1 -- 172.21.15.82:0/749407403 learned_addr learned my addr 172.21.15.82:0/749407403 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bddd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1b120 0x561214b074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bded9d640 1 --2- 172.21.15.82:0/749407403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b07ae0 0x561214b07f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bded9d640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6bc80a3820 0x7f6bc80a5ce0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8005cc0 tx=0x7f6bd8005c50 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bde59c640 1 -- 172.21.15.82:0/749407403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b07ae0 msgr2=0x561214b07f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bde59c640 1 --2- 172.21.15.82:0/749407403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b07ae0 0x561214b07f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bde59c640 1 -- 172.21.15.82:0/749407403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1b120 msgr2=0x561214b074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bde59c640 1 --2- 172.21.15.82:0/749407403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1b120 0x561214b074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bde59c640 1 -- 172.21.15.82:0/749407403 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561214785210 con 0x561214b1a770 2024-03-27T07:34:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.105+0000 7f6bde59c640 1 --2- 172.21.15.82:0/749407403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1a770 0x561214b1ab50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009c70 tx=0x7f6bd0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a803b482769546c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.106+0000 7f6bccff9640 1 -- 172.21.15.82:0/749407403 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0004230 con 0x561214b1a770 2024-03-27T07:34:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.106+0000 7f6bccff9640 1 -- 172.21.15.82:0/749407403 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bd00043d0 con 0x561214b1a770 2024-03-27T07:34:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.106+0000 7f6bccff9640 1 -- 172.21.15.82:0/749407403 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0019820 con 0x561214b1a770 2024-03-27T07:34:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.106+0000 7f6be7574740 1 -- 172.21.15.82:0/749407403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1a770 msgr2=0x561214b1ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.106+0000 7f6be7574740 1 --2- 172.21.15.82:0/749407403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1a770 0x561214b1ab50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009c70 tx=0x7f6bd0011810 comp rx=0 tx=0).stop 2024-03-27T07:34:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.106+0000 7f6be7574740 1 -- 172.21.15.82:0/749407403 shutdown_connections 2024-03-27T07:34:22.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.106+0000 7f6be7574740 1 --2- 172.21.15.82:0/749407403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1b120 0x561214b074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.106+0000 7f6be7574740 1 --2- 172.21.15.82:0/749407403 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b07ae0 0x561214b07f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.106+0000 7f6be7574740 1 --2- 172.21.15.82:0/749407403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1a770 0x561214b1ab50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.106+0000 7f6be7574740 1 -- 172.21.15.82:0/749407403 >> 172.21.15.82:0/749407403 conn(0x561214b09f80 msgr2=0x561214b0a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:22.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.107+0000 7f6be7574740 1 -- 172.21.15.82:0/749407403 shutdown_connections 2024-03-27T07:34:22.118 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.107+0000 7f6be7574740 1 -- 172.21.15.82:0/749407403 wait complete. 2024-03-27T07:34:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.107+0000 7f6be7574740 1 -- start start 2024-03-27T07:34:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.107+0000 7f6be7574740 1 Processor -- start 2024-03-27T07:34:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.107+0000 7f6be7574740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b07ae0 0x561214b1e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6be7574740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b1a770 0x561214b1ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6be7574740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 0x561214b1f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6be7574740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561214a6ce00 con 0x561214b07ae0 2024-03-27T07:34:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b07ae0 0x561214b1e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b07ae0 0x561214b1e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45442/0 (socket says 172.21.15.82:45442) 2024-03-27T07:34:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bde59c640 1 -- 172.21.15.82:0/2002189513 learned_addr learned my addr 172.21.15.82:0/2002189513 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6be7574740 1 -- 172.21.15.82:0/2002189513 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561214a19520 con 0x561214b1a770 2024-03-27T07:34:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6be7574740 1 -- 172.21.15.82:0/2002189513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561214a2c8e0 con 0x561214b1b120 2024-03-27T07:34:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6be7574740 10 client.0 _ll_register_callbacks cb 0x561214a67a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:34:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bded9d640 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 0x561214b1f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bddd9b640 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b1a770 0x561214b1ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bded9d640 1 -- 172.21.15.82:0/2002189513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b1a770 msgr2=0x561214b1ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bded9d640 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b1a770 0x561214b1ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bded9d640 1 -- 172.21.15.82:0/2002189513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b07ae0 msgr2=0x561214b1e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bded9d640 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b07ae0 0x561214b1e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bded9d640 1 -- 172.21.15.82:0/2002189513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561214851620 con 0x561214b1b120 2024-03-27T07:34:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bde59c640 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b07ae0 0x561214b1e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:34:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bded9d640 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 0x561214b1f170 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6bd802c630 tx=0x7f6bd802c0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3f7bb750a8c78bc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.108+0000 7f6bc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:34:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.109+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/2002189513 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd804f020 con 0x561214b1b120 2024-03-27T07:34:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.109+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/2002189513 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8528+0+0 (secure 0 0 0) 0x7f6bd8003d80 con 0x561214b1b120 2024-03-27T07:34:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.109+0000 7f6be7574740 1 -- 172.21.15.82:0/2002189513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd00043d0 con 0x561214b1b120 2024-03-27T07:34:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.109+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/2002189513 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f6bd805a050 con 0x561214b1b120 2024-03-27T07:34:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.109+0000 7f6be7574740 10 client.26995 fetch_fsmap learned FSMap version 37 2024-03-27T07:34:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.109+0000 7f6be7574740 1 -- 172.21.15.82:0/2002189513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x561214b2dbc0 con 0x561214b1b120 2024-03-27T07:34:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.109+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/2002189513 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bd00043d0 con 0x561214b1b120 2024-03-27T07:34:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.109+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/2002189513 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f6bd803f6e0 con 0x561214b1b120 2024-03-27T07:34:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.110+0000 7f6be7574740 10 client.26995 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:34:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.110+0000 7f6be7574740 10 client.26995 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:34:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.110+0000 7f6be7574740 20 client.26995 populate_metadata read hostname 'smithi082' 2024-03-27T07:34:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.110+0000 7f6be7574740 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561214b2f140 0x561214b31590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.110+0000 7f6be7574740 4 client.26995 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:34:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.110+0000 7f6be7574740 1 -- 172.21.15.82:0/2002189513 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561214a7e390 con 0x561214b2f140 2024-03-27T07:34:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.110+0000 7f6bde59c640 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561214b2f140 0x561214b31590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.111+0000 7f6bde59c640 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561214b2f140 0x561214b31590 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eac515ab37128761 server_cookie=1157f27a84811a5a in_seq=0 out_seq=0 2024-03-27T07:34:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.111+0000 7f6bc5ffb640 10 client.26995 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/2002189513 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561214a7e390 con 0x561214b2f140 2024-03-27T07:34:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6bc5ffb640 10 client.26995 handle_command_reply: tid=0 2024-03-27T07:34:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 client.26995 shutdown 2024-03-27T07:34:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 -- 172.21.15.82:0/2002189513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 msgr2=0x561214b1f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 0x561214b1f170 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6bd802c630 tx=0x7f6bd802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.127 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 -- 172.21.15.82:0/2002189513 shutdown_connections 2024-03-27T07:34:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 0x561214b1f170 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b1a770 0x561214b1ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561214b2f140 0x561214b31590 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 --2- 172.21.15.82:0/2002189513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b07ae0 0x561214b1e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6bc5ffb640 0 client.26995 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 -- 172.21.15.82:0/2002189513 >> 172.21.15.82:0/2002189513 conn(0x561214b09f80 msgr2=0x561214b096e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:22.128 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 -- 172.21.15.82:0/2002189513 shutdown_connections 2024-03-27T07:34:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 1 -- 172.21.15.82:0/2002189513 wait complete. 2024-03-27T07:34:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.112+0000 7f6be7574740 20 client.26995 trim_cache size 0 max 16384 2024-03-27T07:34:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.133+0000 7f6be7574740 1 Processor -- start 2024-03-27T07:34:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.133+0000 7f6be7574740 1 -- start start 2024-03-27T07:34:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.133+0000 7f6be7574740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b07ae0 0x561214b20e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.133+0000 7f6be7574740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b2a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.133+0000 7f6be7574740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b1b120 0x561214b08d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.133+0000 7f6be7574740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01aded0 con 0x561214b1a770 2024-03-27T07:34:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6be7574740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01ab6e0 con 0x561214b1b120 2024-03-27T07:34:22.136 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6be7574740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01a9550 con 0x561214b07ae0 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bddd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b2a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b07ae0 0x561214b20e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bddd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b2a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45448/0 (socket says 172.21.15.82:45448) 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bde59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b07ae0 0x561214b20e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:40930/0 (socket says 172.21.15.82:40930) 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bddd9b640 1 -- 172.21.15.82:0/3290481264 learned_addr learned my addr 172.21.15.82:0/3290481264 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bded9d640 1 --2- 172.21.15.82:0/3290481264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b1b120 0x561214b08d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bddd9b640 1 -- 172.21.15.82:0/3290481264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b07ae0 msgr2=0x561214b20e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bddd9b640 1 --2- 172.21.15.82:0/3290481264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b07ae0 0x561214b20e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bddd9b640 1 -- 172.21.15.82:0/3290481264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b1b120 msgr2=0x561214b08d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bddd9b640 1 --2- 172.21.15.82:0/3290481264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b1b120 0x561214b08d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bddd9b640 1 -- 172.21.15.82:0/3290481264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561214b1cc40 con 0x561214b1a770 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.134+0000 7f6bddd9b640 1 --2- 172.21.15.82:0/3290481264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b2a690 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40097b0 tx=0x7f6bd4087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8f184f9acf6d14 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.135+0000 7f6bc7fff640 1 -- 172.21.15.82:0/3290481264 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40b4020 con 0x561214b1a770 2024-03-27T07:34:22.137 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.135+0000 7f6bc7fff640 1 -- 172.21.15.82:0/3290481264 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bd40cdec0 con 0x561214b1a770 2024-03-27T07:34:22.138 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.135+0000 7f6bc7fff640 1 -- 172.21.15.82:0/3290481264 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd409bde0 con 0x561214b1a770 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.135+0000 7f6be7574740 1 -- 172.21.15.82:0/3290481264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 msgr2=0x561214b2a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.135+0000 7f6be7574740 1 --2- 172.21.15.82:0/3290481264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b2a690 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40097b0 tx=0x7f6bd4087040 comp rx=0 tx=0).stop 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 -- 172.21.15.82:0/3290481264 shutdown_connections 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 --2- 172.21.15.82:0/3290481264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b2a690 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 --2- 172.21.15.82:0/3290481264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b1b120 0x561214b08d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 --2- 172.21.15.82:0/3290481264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b07ae0 0x561214b20e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 -- 172.21.15.82:0/3290481264 >> 172.21.15.82:0/3290481264 conn(0x561214b09f80 msgr2=0x561214b1cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 -- 172.21.15.82:0/3290481264 shutdown_connections 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 -- 172.21.15.82:0/3290481264 wait complete. 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 -- start start 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 Processor -- start 2024-03-27T07:34:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b07ae0 0x561214b35ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b36530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 0x561214b36a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01a9ba0 con 0x561214b1a770 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01ab010 con 0x561214b07ae0 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01aa270 con 0x561214b1b120 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.136+0000 7f6be7574740 10 client.0 _ll_register_callbacks cb 0x7f6bd4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bddd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b36530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bddd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b36530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45454/0 (socket says 172.21.15.82:45454) 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bddd9b640 1 -- 172.21.15.82:0/703001014 learned_addr learned my addr 172.21.15.82:0/703001014 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bded9d640 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 0x561214b36a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bde59c640 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b07ae0 0x561214b35ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bddd9b640 1 -- 172.21.15.82:0/703001014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 msgr2=0x561214b36a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bddd9b640 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 0x561214b36a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bddd9b640 1 -- 172.21.15.82:0/703001014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b07ae0 msgr2=0x561214b35ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bddd9b640 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b07ae0 0x561214b35ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bddd9b640 1 -- 172.21.15.82:0/703001014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561214b94490 con 0x561214b1a770 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bddd9b640 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b36530 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40d04c0 tx=0x7f6bd400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c31f1a215171395 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bc5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/703001014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40ba070 con 0x561214b1a770 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/703001014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8528+0+0 (secure 0 0 0) 0x7f6bd409bb80 con 0x561214b1a770 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.137+0000 7f6be7574740 1 -- 172.21.15.82:0/703001014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd40cdec0 con 0x561214b1a770 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.138+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/703001014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f6bd40b4070 con 0x561214b1a770 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.138+0000 7f6be7574740 10 client.17145 fetch_fsmap learned FSMap version 37 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.138+0000 7f6be7574740 1 -- 172.21.15.82:0/703001014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x561214b95680 con 0x561214b1a770 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.138+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/703001014 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bd40cdec0 con 0x561214b1a770 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.138+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/703001014 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f6bd409b5f0 con 0x561214b1a770 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.139+0000 7f6be7574740 10 client.17145 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:34:22.143 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.139+0000 7f6be7574740 10 client.17145 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:34:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.139+0000 7f6be7574740 20 client.17145 populate_metadata read hostname 'smithi082' 2024-03-27T07:34:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.139+0000 7f6be7574740 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561214b95dd0 0x561214b981f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.139+0000 7f6be7574740 4 client.17145 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:34:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.139+0000 7f6be7574740 1 -- 172.21.15.82:0/703001014 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561214a786e0 con 0x561214b95dd0 2024-03-27T07:34:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.141+0000 7f6bde59c640 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561214b95dd0 0x561214b981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:22.144 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.141+0000 7f6bc5ffb640 10 client.17145 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.142+0000 7f6bde59c640 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561214b95dd0 0x561214b981f0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1940814f4f08cf2 server_cookie=8d7f0742e771bf0d in_seq=0 out_seq=0 2024-03-27T07:34:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6bc5ffb640 1 -- 172.21.15.82:0/703001014 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561214a786e0 con 0x561214b95dd0 2024-03-27T07:34:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6bc5ffb640 10 client.17145 handle_command_reply: tid=0 2024-03-27T07:34:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 client.17145 shutdown 2024-03-27T07:34:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 -- 172.21.15.82:0/703001014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 msgr2=0x561214b36530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:22.230 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b36530 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f6bd40d04c0 tx=0x7f6bd400cf90 comp rx=0 tx=0).stop 2024-03-27T07:34:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 -- 172.21.15.82:0/703001014 shutdown_connections 2024-03-27T07:34:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561214b95dd0 0x561214b981f0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561214b1a770 0x561214b36530 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6bc5ffb640 0 client.17145 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561214b1b120 0x561214b36a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 --2- 172.21.15.82:0/703001014 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561214b07ae0 0x561214b35ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 -- 172.21.15.82:0/703001014 >> 172.21.15.82:0/703001014 conn(0x561214b09f80 msgr2=0x561214b08d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 -- 172.21.15.82:0/703001014 shutdown_connections 2024-03-27T07:34:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.228+0000 7f6be7574740 1 -- 172.21.15.82:0/703001014 wait complete. 2024-03-27T07:34:22.231 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.229+0000 7f6be7574740 20 client.17145 trim_cache size 0 max 16384 2024-03-27T07:34:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:34:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:34:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:34:22.232 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:34:22.233 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.229+0000 7f6be48af640 1 -- 172.21.15.82:0/4083601159 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6bc80a3820 msgr2=0x7f6bc80a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.229+0000 7f6be48af640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6bc80a3820 0x7f6bc80a5ce0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8005cc0 tx=0x7f6bd8005c50 comp rx=0 tx=0).stop 2024-03-27T07:34:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.229+0000 7f6be48af640 1 -- 172.21.15.82:0/4083601159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be01024b0 msgr2=0x7f6be0198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.229+0000 7f6be48af640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be01024b0 0x7f6be0198840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400e9f0 tx=0x7f6bd400eeb0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.229+0000 7f6be48af640 1 -- 172.21.15.82:0/4083601159 shutdown_connections 2024-03-27T07:34:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.229+0000 7f6be48af640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f6bc80a3820 0x7f6bc80a5ce0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.230+0000 7f6be48af640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6be0107b90 0x7f6be019cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.230+0000 7f6be48af640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6be01024b0 0x7f6be0198840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.234 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.230+0000 7f6be48af640 1 --2- 172.21.15.82:0/4083601159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6be0101af0 0x7f6be0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.230+0000 7f6be48af640 1 -- 172.21.15.82:0/4083601159 >> 172.21.15.82:0/4083601159 conn(0x7f6be00fd5e0 msgr2=0x7f6be00fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.230+0000 7f6be48af640 1 -- 172.21.15.82:0/4083601159 shutdown_connections 2024-03-27T07:34:22.235 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:22.230+0000 7f6be48af640 1 -- 172.21.15.82:0/4083601159 wait complete. 2024-03-27T07:34:22.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:22 smithi153 ceph-mon[36179]: pgmap v336: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-03-27T07:34:22.806 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:22 smithi149 ceph-mon[36065]: pgmap v336: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-03-27T07:34:22.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:22 smithi082 ceph-mon[32178]: pgmap v336: 97 pgs: 42 active+clean+snaptrim_wait, 22 active+clean+snaptrim, 33 active+clean; 1.9 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-03-27T07:34:24.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:24 smithi153 ceph-mon[36179]: pgmap v337: 97 pgs: 36 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 42 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 128 op/s 2024-03-27T07:34:24.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:24 smithi082 ceph-mon[32178]: pgmap v337: 97 pgs: 36 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 42 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 128 op/s 2024-03-27T07:34:25.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:24 smithi149 ceph-mon[36065]: pgmap v337: 97 pgs: 36 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 42 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 128 op/s 2024-03-27T07:34:26.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:26 smithi153 ceph-mon[36179]: pgmap v338: 97 pgs: 36 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 42 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 877 KiB/s wr, 92 op/s 2024-03-27T07:34:26.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:26 smithi082 ceph-mon[32178]: pgmap v338: 97 pgs: 36 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 42 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 877 KiB/s wr, 92 op/s 2024-03-27T07:34:27.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:26 smithi149 ceph-mon[36065]: pgmap v338: 97 pgs: 36 active+clean+snaptrim_wait, 19 active+clean+snaptrim, 42 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 877 KiB/s wr, 92 op/s 2024-03-27T07:34:28.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:28 smithi153 ceph-mon[36179]: pgmap v339: 97 pgs: 29 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 54 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1012 KiB/s wr, 123 op/s 2024-03-27T07:34:28.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:28 smithi082 ceph-mon[32178]: pgmap v339: 97 pgs: 29 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 54 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1012 KiB/s wr, 123 op/s 2024-03-27T07:34:29.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:28 smithi149 ceph-mon[36065]: pgmap v339: 97 pgs: 29 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 54 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1012 KiB/s wr, 123 op/s 2024-03-27T07:34:30.788 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:30 smithi153 ceph-mon[36179]: pgmap v340: 97 pgs: 27 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 58 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 866 KiB/s wr, 111 op/s 2024-03-27T07:34:30.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:30 smithi082 ceph-mon[32178]: pgmap v340: 97 pgs: 27 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 58 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 866 KiB/s wr, 111 op/s 2024-03-27T07:34:31.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:30 smithi149 ceph-mon[36065]: pgmap v340: 97 pgs: 27 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 58 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 866 KiB/s wr, 111 op/s 2024-03-27T07:34:32.790 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:32 smithi153 ceph-mon[36179]: pgmap v341: 97 pgs: 27 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 58 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 859 KiB/s wr, 97 op/s 2024-03-27T07:34:32.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:32 smithi082 ceph-mon[32178]: pgmap v341: 97 pgs: 27 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 58 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 859 KiB/s wr, 97 op/s 2024-03-27T07:34:33.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:32 smithi149 ceph-mon[36065]: pgmap v341: 97 pgs: 27 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 58 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 859 KiB/s wr, 97 op/s 2024-03-27T07:34:34.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:34 smithi153 ceph-mon[36179]: pgmap v342: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-03-27T07:34:34.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:34 smithi082 ceph-mon[32178]: pgmap v342: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-03-27T07:34:35.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:34 smithi149 ceph-mon[36065]: pgmap v342: 97 pgs: 6 active+clean+snaptrim_wait, 3 active+clean+snaptrim, 88 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-03-27T07:34:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.321+0000 7f34e8da0640 1 -- 172.21.15.82:0/1602034651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e4100ca0 msgr2=0x7f34e4101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.321+0000 7f34e8da0640 1 --2- 172.21.15.82:0/1602034651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e4100ca0 0x7f34e4101120 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f34d8009ca0 tx=0x7f34d802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.322+0000 7f34e8da0640 1 -- 172.21.15.82:0/1602034651 shutdown_connections 2024-03-27T07:34:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.322+0000 7f34e8da0640 1 --2- 172.21.15.82:0/1602034651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e4100ca0 0x7f34e4101120 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.323 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.322+0000 7f34e8da0640 1 --2- 172.21.15.82:0/1602034651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e4101660 0x7f34e410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.322+0000 7f34e8da0640 1 --2- 172.21.15.82:0/1602034651 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e41059f0 0x7f34e4105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.322+0000 7f34e8da0640 1 -- 172.21.15.82:0/1602034651 >> 172.21.15.82:0/1602034651 conn(0x7f34e40778a0 msgr2=0x7f34e4077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.322+0000 7f34e8da0640 1 -- 172.21.15.82:0/1602034651 shutdown_connections 2024-03-27T07:34:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.322+0000 7f34e8da0640 1 -- 172.21.15.82:0/1602034651 wait complete. 2024-03-27T07:34:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.322+0000 7f34e8da0640 1 Processor -- start 2024-03-27T07:34:35.324 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.322+0000 7f34e8da0640 1 -- start start 2024-03-27T07:34:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.322+0000 7f34e8da0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4100ca0 0x7f34e4198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e8da0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e4101660 0x7f34e4198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e8da0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e41059f0 0x7f34e419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e8da0640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34e4110ed0 con 0x7f34e4101660 2024-03-27T07:34:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e8da0640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34e4110d50 con 0x7f34e4100ca0 2024-03-27T07:34:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e8da0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34e4111050 con 0x7f34e41059f0 2024-03-27T07:34:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e4101660 0x7f34e4198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.326 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e4101660 0x7f34e4198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42734/0 (socket says 172.21.15.82:42734) 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e1d9b640 1 -- 172.21.15.82:0/2320161501 learned_addr learned my addr 172.21.15.82:0/2320161501 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e259c640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4100ca0 0x7f34e4198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e2d9d640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e41059f0 0x7f34e419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e1d9b640 1 -- 172.21.15.82:0/2320161501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e41059f0 msgr2=0x7f34e419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e41059f0 0x7f34e419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e1d9b640 1 -- 172.21.15.82:0/2320161501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4100ca0 msgr2=0x7f34e4198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4100ca0 0x7f34e4198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e1d9b640 1 -- 172.21.15.82:0/2320161501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e419d3d0 con 0x7f34e4101660 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e4101660 0x7f34e4198970 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f34d8005e30 tx=0x7f34d80324f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34d37fe640 1 -- 172.21.15.82:0/2320161501 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8042020 con 0x7f34e4101660 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e8da0640 1 -- 172.21.15.82:0/2320161501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e419d660 con 0x7f34e4101660 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34d37fe640 1 -- 172.21.15.82:0/2320161501 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d8003970 con 0x7f34e4101660 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34d37fe640 1 -- 172.21.15.82:0/2320161501 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8039040 con 0x7f34e4101660 2024-03-27T07:34:35.327 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.323+0000 7f34e8da0640 1 -- 172.21.15.82:0/2320161501 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e41a4f50 con 0x7f34e4101660 2024-03-27T07:34:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.325+0000 7f34d37fe640 1 -- 172.21.15.82:0/2320161501 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f34d8045020 con 0x7f34e4101660 2024-03-27T07:34:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.326+0000 7f34eb982740 1 Processor -- start 2024-03-27T07:34:35.334 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.326+0000 7f34d37fe640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f34cc0a3820 0x7f34cc0a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.326+0000 7f34e2d9d640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f34cc0a3820 0x7f34cc0a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.326+0000 7f34eb982740 1 -- start start 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34d37fe640 1 -- 172.21.15.82:0/2320161501 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 8528+0+0 (secure 0 0 0) 0x7f34d80f20a0 con 0x7f34e4101660 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e2d9d640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f34cc0a3820 0x7f34cc0a5ce0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f34d4005fd0 tx=0x7f34d4005d40 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34eb982740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0000f0 0x55b8bd0004d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34eb982740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd0092a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34eb982740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0097e0 0x55b8bd00bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34eb982740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b8bcfc6cd0 con 0x55b8bd000a10 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34eb982740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b8bcf0b950 con 0x55b8bd0097e0 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34eb982740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b8bcf63e50 con 0x55b8bd0000f0 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd0092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd0092a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42744/0 (socket says 172.21.15.82:42744) 2024-03-27T07:34:35.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e1d9b640 1 -- 172.21.15.82:0/489903086 learned_addr learned my addr 172.21.15.82:0/489903086 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e2d9d640 1 --2- 172.21.15.82:0/489903086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0097e0 0x55b8bd00bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e259c640 1 --2- 172.21.15.82:0/489903086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0000f0 0x55b8bd0004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e1d9b640 1 -- 172.21.15.82:0/489903086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0000f0 msgr2=0x55b8bd0004d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/489903086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0000f0 0x55b8bd0004d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e1d9b640 1 -- 172.21.15.82:0/489903086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0097e0 msgr2=0x55b8bd00bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/489903086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0097e0 0x55b8bd00bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e1d9b640 1 -- 172.21.15.82:0/489903086 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8bcc78210 con 0x55b8bd000a10 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/489903086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd0092a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f34d80c6a40 tx=0x7f34d80bde40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ad451fb676ce3f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.327+0000 7f34d0ff9640 1 -- 172.21.15.82:0/489903086 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d80d7070 con 0x55b8bd000a10 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34d0ff9640 1 -- 172.21.15.82:0/489903086 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d80bea00 con 0x55b8bd000a10 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34d0ff9640 1 -- 172.21.15.82:0/489903086 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d8003c30 con 0x55b8bd000a10 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34eb982740 1 -- 172.21.15.82:0/489903086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 msgr2=0x55b8bd0092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34eb982740 1 --2- 172.21.15.82:0/489903086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd0092a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f34d80c6a40 tx=0x7f34d80bde40 comp rx=0 tx=0).stop 2024-03-27T07:34:35.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34eb982740 1 -- 172.21.15.82:0/489903086 shutdown_connections 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34eb982740 1 --2- 172.21.15.82:0/489903086 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd0092a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34eb982740 1 --2- 172.21.15.82:0/489903086 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0097e0 0x55b8bd00bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34eb982740 1 --2- 172.21.15.82:0/489903086 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0000f0 0x55b8bd0004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34eb982740 1 -- 172.21.15.82:0/489903086 >> 172.21.15.82:0/489903086 conn(0x55b8bcffaa10 msgr2=0x55b8bcffadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34eb982740 1 -- 172.21.15.82:0/489903086 shutdown_connections 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.328+0000 7f34eb982740 1 -- 172.21.15.82:0/489903086 wait complete. 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34eb982740 1 -- start start 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34eb982740 1 Processor -- start 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34eb982740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 0x55b8bd0067e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34eb982740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd006d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34eb982740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0097e0 0x55b8bd007260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34eb982740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b8bcf5fe00 con 0x55b8bd000a10 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34eb982740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55b8bcf0c520 con 0x55b8bd0000f0 2024-03-27T07:34:35.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34eb982740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55b8bcf1f8e0 con 0x55b8bd0097e0 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34eb982740 10 client.0 _ll_register_callbacks cb 0x55b8bcf5aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd006d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e259c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 0x55b8bd0067e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e1d9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd006d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42760/0 (socket says 172.21.15.82:42760) 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e1d9b640 1 -- 172.21.15.82:0/780276290 learned_addr learned my addr 172.21.15.82:0/780276290 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e2d9d640 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0097e0 0x55b8bd007260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e1d9b640 1 -- 172.21.15.82:0/780276290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0097e0 msgr2=0x55b8bd007260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0097e0 0x55b8bd007260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e1d9b640 1 -- 172.21.15.82:0/780276290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 msgr2=0x55b8bd0067e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 0x55b8bd0067e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e1d9b640 1 -- 172.21.15.82:0/780276290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8bcd44620 con 0x55b8bd000a10 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e259c640 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 0x55b8bd0067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd006d20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f34d80bacd0 tx=0x7f34d8032fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c0d30c93bd24a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:35.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.329+0000 7f34c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34c9ffb640 1 -- 172.21.15.82:0/780276290 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d80dc060 con 0x55b8bd000a10 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34c9ffb640 1 -- 172.21.15.82:0/780276290 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8528+0+0 (secure 0 0 0) 0x7f34d80ba970 con 0x55b8bd000a10 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34eb982740 1 -- 172.21.15.82:0/780276290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34d80bea00 con 0x55b8bd000a10 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34c9ffb640 1 -- 172.21.15.82:0/780276290 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f34d80d7070 con 0x55b8bd000a10 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34eb982740 10 client.17157 fetch_fsmap learned FSMap version 37 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34eb982740 1 -- 172.21.15.82:0/780276290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b8bd018060 con 0x55b8bd000a10 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34c9ffb640 1 -- 172.21.15.82:0/780276290 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34d809f070 con 0x55b8bd000a10 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34c9ffb640 1 -- 172.21.15.82:0/780276290 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f34d80d2bb0 con 0x55b8bd000a10 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34eb982740 10 client.17157 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34eb982740 10 client.17157 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34eb982740 20 client.17157 populate_metadata read hostname 'smithi082' 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34eb982740 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b8bd0193b0 0x55b8bd01b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34eb982740 4 client.17157 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:34:35.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34eb982740 1 -- 172.21.15.82:0/780276290 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8bcf71390 con 0x55b8bd0193b0 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.330+0000 7f34e259c640 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b8bd0193b0 0x55b8bd01b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.331+0000 7f34e259c640 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b8bd0193b0 0x55b8bd01b7a0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83523e6c0bb9a177 server_cookie=17e058e634580046 in_seq=0 out_seq=0 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.331+0000 7f34c9ffb640 10 client.17157 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34c9ffb640 1 -- 172.21.15.82:0/780276290 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b8bcf71390 con 0x55b8bd0193b0 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34c9ffb640 10 client.17157 handle_command_reply: tid=0 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 client.17157 shutdown 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 -- 172.21.15.82:0/780276290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 msgr2=0x55b8bd006d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd006d20 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f34d80bacd0 tx=0x7f34d8032fc0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 -- 172.21.15.82:0/780276290 shutdown_connections 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b8bd0193b0 0x55b8bd01b7a0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd000a10 0x55b8bd006d20 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0097e0 0x55b8bd007260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34c9ffb640 0 client.17157 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:35.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 --2- 172.21.15.82:0/780276290 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 0x55b8bd0067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 -- 172.21.15.82:0/780276290 >> 172.21.15.82:0/780276290 conn(0x55b8bcffaa10 msgr2=0x55b8bcffc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 -- 172.21.15.82:0/780276290 shutdown_connections 2024-03-27T07:34:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 1 -- 172.21.15.82:0/780276290 wait complete. 2024-03-27T07:34:35.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.332+0000 7f34eb982740 20 client.17157 trim_cache size 0 max 16384 2024-03-27T07:34:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.346+0000 7f34eb982740 1 Processor -- start 2024-03-27T07:34:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34eb982740 1 -- start start 2024-03-27T07:34:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34eb982740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0000f0 0x55b8bd014be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34eb982740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd000a10 0x55b8bd000f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.352 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34eb982740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0097e0 0x55b8bd020f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34eb982740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34e41b00e0 con 0x55b8bd0000f0 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34eb982740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34e41ad8f0 con 0x55b8bd000a10 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34eb982740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34e41ab740 con 0x55b8bd0097e0 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0000f0 0x55b8bd014be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e259c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0000f0 0x55b8bd014be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42764/0 (socket says 172.21.15.82:42764) 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e259c640 1 -- 172.21.15.82:0/2137572026 learned_addr learned my addr 172.21.15.82:0/2137572026 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/2137572026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd000a10 0x55b8bd000f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e2d9d640 1 --2- 172.21.15.82:0/2137572026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0097e0 0x55b8bd020f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e259c640 1 -- 172.21.15.82:0/2137572026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0097e0 msgr2=0x55b8bd020f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e259c640 1 --2- 172.21.15.82:0/2137572026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0097e0 0x55b8bd020f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e259c640 1 -- 172.21.15.82:0/2137572026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd000a10 msgr2=0x55b8bd000f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e259c640 1 --2- 172.21.15.82:0/2137572026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd000a10 0x55b8bd000f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e259c640 1 -- 172.21.15.82:0/2137572026 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8bd015120 con 0x55b8bd0000f0 2024-03-27T07:34:35.353 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34e259c640 1 --2- 172.21.15.82:0/2137572026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0000f0 0x55b8bd014be0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f34dc011680 tx=0x7f34dc00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17af9b77b551b2a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34cbfff640 1 -- 172.21.15.82:0/2137572026 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc020370 con 0x55b8bd0000f0 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34cbfff640 1 -- 172.21.15.82:0/2137572026 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34dc020510 con 0x55b8bd0000f0 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.347+0000 7f34cbfff640 1 -- 172.21.15.82:0/2137572026 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc010690 con 0x55b8bd0000f0 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 -- 172.21.15.82:0/2137572026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0000f0 msgr2=0x55b8bd014be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 --2- 172.21.15.82:0/2137572026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0000f0 0x55b8bd014be0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f34dc011680 tx=0x7f34dc00b410 comp rx=0 tx=0).stop 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 -- 172.21.15.82:0/2137572026 shutdown_connections 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 --2- 172.21.15.82:0/2137572026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd0097e0 0x55b8bd020f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 --2- 172.21.15.82:0/2137572026 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd000a10 0x55b8bd000f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 --2- 172.21.15.82:0/2137572026 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0000f0 0x55b8bd014be0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 -- 172.21.15.82:0/2137572026 >> 172.21.15.82:0/2137572026 conn(0x55b8bcffaa10 msgr2=0x55b8bcffadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 -- 172.21.15.82:0/2137572026 shutdown_connections 2024-03-27T07:34:35.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 -- 172.21.15.82:0/2137572026 wait complete. 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 -- start start 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 Processor -- start 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 0x55b8bd00ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd000a10 0x55b8bd00d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0097e0 0x55b8bd07e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f34e41abdb0 con 0x55b8bd0097e0 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f34e41ad220 con 0x55b8bd0000f0 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f34e41ac480 con 0x55b8bd000a10 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.348+0000 7f34eb982740 10 client.0 _ll_register_callbacks cb 0x7f34dc00b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0097e0 0x55b8bd07e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e2d9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0097e0 0x55b8bd07e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42780/0 (socket says 172.21.15.82:42780) 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e2d9d640 1 -- 172.21.15.82:0/282571678 learned_addr learned my addr 172.21.15.82:0/282571678 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e259c640 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 0x55b8bd00ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e1d9b640 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd000a10 0x55b8bd00d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e2d9d640 1 -- 172.21.15.82:0/282571678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd000a10 msgr2=0x55b8bd00d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e2d9d640 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd000a10 0x55b8bd00d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e2d9d640 1 -- 172.21.15.82:0/282571678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 msgr2=0x55b8bd00ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e2d9d640 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 0x55b8bd00ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e2d9d640 1 -- 172.21.15.82:0/282571678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8bd00dc90 con 0x55b8bd0097e0 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34e2d9d640 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0097e0 0x55b8bd07e540 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f34d400be80 tx=0x7f34d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b07676a5a49122 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34c9ffb640 1 -- 172.21.15.82:0/282571678 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d401e830 con 0x55b8bd0097e0 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34c9ffb640 1 -- 172.21.15.82:0/282571678 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(99..99 src has 1..99) ==== 8528+0+0 (secure 0 0 0) 0x7f34d401e9d0 con 0x55b8bd0097e0 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34eb982740 1 -- 172.21.15.82:0/282571678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34dc020510 con 0x55b8bd0097e0 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34c9ffb640 1 -- 172.21.15.82:0/282571678 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f34d4011e50 con 0x55b8bd0097e0 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34eb982740 10 client.17163 fetch_fsmap learned FSMap version 37 2024-03-27T07:34:35.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34eb982740 1 -- 172.21.15.82:0/282571678 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55b8bd07fbf0 con 0x55b8bd0097e0 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.349+0000 7f34c9ffb640 1 -- 172.21.15.82:0/282571678 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f34dc020510 con 0x55b8bd0097e0 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.350+0000 7f34c9ffb640 1 -- 172.21.15.82:0/282571678 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f34d4028070 con 0x55b8bd0097e0 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.350+0000 7f34eb982740 10 client.17163 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.350+0000 7f34eb982740 10 client.17163 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.350+0000 7f34eb982740 20 client.17163 populate_metadata read hostname 'smithi082' 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.350+0000 7f34eb982740 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b8bd080420 0x55b8bd082840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.350+0000 7f34eb982740 4 client.17163 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.350+0000 7f34eb982740 1 -- 172.21.15.82:0/282571678 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b8bcf6b6e0 con 0x55b8bd080420 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.350+0000 7f34e259c640 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b8bd080420 0x55b8bd082840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.350+0000 7f34c9ffb640 10 client.17163 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:35.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.350+0000 7f34e259c640 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b8bd080420 0x55b8bd082840 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a398c1d8755c8715 server_cookie=78121575f6375984 in_seq=0 out_seq=0 2024-03-27T07:34:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.358+0000 7f34c9ffb640 1 -- 172.21.15.82:0/282571678 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b8bcf6b6e0 con 0x55b8bd080420 2024-03-27T07:34:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.358+0000 7f34c9ffb640 10 client.17163 handle_command_reply: tid=0 2024-03-27T07:34:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.358+0000 7f34eb982740 1 client.17163 shutdown 2024-03-27T07:34:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.358+0000 7f34eb982740 1 -- 172.21.15.82:0/282571678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0097e0 msgr2=0x55b8bd07e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.358+0000 7f34eb982740 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0097e0 0x55b8bd07e540 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f34d400be80 tx=0x7f34d4004730 comp rx=0 tx=0).stop 2024-03-27T07:34:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34eb982740 1 -- 172.21.15.82:0/282571678 shutdown_connections 2024-03-27T07:34:35.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34eb982740 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55b8bd080420 0x55b8bd082840 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34eb982740 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b8bd0097e0 0x55b8bd07e540 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34c9ffb640 0 client.17163 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34eb982740 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55b8bd000a10 0x55b8bd00d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34eb982740 1 --2- 172.21.15.82:0/282571678 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55b8bd0000f0 0x55b8bd00ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34eb982740 1 -- 172.21.15.82:0/282571678 >> 172.21.15.82:0/282571678 conn(0x55b8bcffaa10 msgr2=0x55b8bd000f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34eb982740 1 -- 172.21.15.82:0/282571678 shutdown_connections 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34eb982740 1 -- 172.21.15.82:0/282571678 wait complete. 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34eb982740 20 client.17163 trim_cache size 0 max 16384 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:34:35.361 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:34:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:34:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 -- 172.21.15.82:0/2320161501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f34cc0a3820 msgr2=0x7f34cc0a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f34cc0a3820 0x7f34cc0a5ce0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f34d4005fd0 tx=0x7f34d4005d40 comp rx=0 tx=0).stop 2024-03-27T07:34:35.362 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 -- 172.21.15.82:0/2320161501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e4101660 msgr2=0x7f34e4198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e4101660 0x7f34e4198970 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f34d8005e30 tx=0x7f34d80324f0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 -- 172.21.15.82:0/2320161501 shutdown_connections 2024-03-27T07:34:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f34cc0a3820 0x7f34cc0a5ce0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34e4101660 0x7f34e4198970 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34e41059f0 0x7f34e419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 --2- 172.21.15.82:0/2320161501 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f34e4100ca0 0x7f34e4198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 -- 172.21.15.82:0/2320161501 >> 172.21.15.82:0/2320161501 conn(0x7f34e40778a0 msgr2=0x7f34e4069450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 -- 172.21.15.82:0/2320161501 shutdown_connections 2024-03-27T07:34:35.363 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:35.359+0000 7f34e8da0640 1 -- 172.21.15.82:0/2320161501 wait complete. 2024-03-27T07:34:36.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:36 smithi153 ceph-mon[36179]: pgmap v343: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 815 KiB/s wr, 106 op/s 2024-03-27T07:34:36.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:36 smithi082 ceph-mon[32178]: pgmap v343: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 815 KiB/s wr, 106 op/s 2024-03-27T07:34:37.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:36 smithi149 ceph-mon[36065]: pgmap v343: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.9 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 815 KiB/s wr, 106 op/s 2024-03-27T07:34:39.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:38 smithi082 ceph-mon[32178]: pgmap v344: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 159 op/s 2024-03-27T07:34:39.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:38 smithi082 ceph-mon[32178]: osdmap e100: 12 total, 12 up, 12 in 2024-03-27T07:34:39.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:38 smithi149 ceph-mon[36065]: pgmap v344: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 159 op/s 2024-03-27T07:34:39.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:38 smithi149 ceph-mon[36065]: osdmap e100: 12 total, 12 up, 12 in 2024-03-27T07:34:39.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:38 smithi153 ceph-mon[36179]: pgmap v344: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 159 op/s 2024-03-27T07:34:39.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:38 smithi153 ceph-mon[36179]: osdmap e100: 12 total, 12 up, 12 in 2024-03-27T07:34:41.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:40 smithi082 ceph-mon[32178]: pgmap v346: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-03-27T07:34:41.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:40 smithi149 ceph-mon[36065]: pgmap v346: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-03-27T07:34:41.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:40 smithi153 ceph-mon[36179]: pgmap v346: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-03-27T07:34:43.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:42 smithi082 ceph-mon[32178]: pgmap v347: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-03-27T07:34:43.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:42 smithi149 ceph-mon[36065]: pgmap v347: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-03-27T07:34:43.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:42 smithi153 ceph-mon[36179]: pgmap v347: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 167 op/s 2024-03-27T07:34:45.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:44 smithi082 ceph-mon[32178]: pgmap v348: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 239 op/s 2024-03-27T07:34:45.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:44 smithi149 ceph-mon[36065]: pgmap v348: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 239 op/s 2024-03-27T07:34:45.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:44 smithi153 ceph-mon[36179]: pgmap v348: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 239 op/s 2024-03-27T07:34:47.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:46 smithi082 ceph-mon[32178]: pgmap v349: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-03-27T07:34:47.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:46 smithi149 ceph-mon[36065]: pgmap v349: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-03-27T07:34:47.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:46 smithi153 ceph-mon[36179]: pgmap v349: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-03-27T07:34:48.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 -- 172.21.15.82:0/4071730357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61401013d0 msgr2=0x7f61401017b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:48.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 --2- 172.21.15.82:0/4071730357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61401013d0 0x7f61401017b0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6134009900 tx=0x7f613402bc30 comp rx=0 tx=0).stop 2024-03-27T07:34:48.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 -- 172.21.15.82:0/4071730357 shutdown_connections 2024-03-27T07:34:48.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 --2- 172.21.15.82:0/4071730357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6140105f80 0x7f614010db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 --2- 172.21.15.82:0/4071730357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6140101d80 0x7f61401058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.465 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 --2- 172.21.15.82:0/4071730357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61401013d0 0x7f61401017b0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 -- 172.21.15.82:0/4071730357 >> 172.21.15.82:0/4071730357 conn(0x7f6140076fe0 msgr2=0x7f61400fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 -- 172.21.15.82:0/4071730357 shutdown_connections 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 -- 172.21.15.82:0/4071730357 wait complete. 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 Processor -- start 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.451+0000 7f6146eed640 1 -- start start 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6146eed640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61401013d0 0x7f61401994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6146eed640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6140105f80 0x7f61401999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6146eed640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6140199f70 0x7f61401a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6146eed640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6140111080 con 0x7f61401013d0 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6146eed640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6140110f00 con 0x7f6140105f80 2024-03-27T07:34:48.466 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6146eed640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6140111200 con 0x7f6140199f70 2024-03-27T07:34:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6144c89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61401013d0 0x7f61401994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6144c89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61401013d0 0x7f61401994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34028/0 (socket says 172.21.15.82:34028) 2024-03-27T07:34:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6144c89640 1 -- 172.21.15.82:0/6539978 learned_addr learned my addr 172.21.15.82:0/6539978 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f613ffff640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6140105f80 0x7f61401999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f614548a640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6140199f70 0x7f61401a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6144c89640 1 -- 172.21.15.82:0/6539978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6140199f70 msgr2=0x7f61401a4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6144c89640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6140199f70 0x7f61401a4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.467 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6144c89640 1 -- 172.21.15.82:0/6539978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6140105f80 msgr2=0x7f61401999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6144c89640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6140105f80 0x7f61401999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6144c89640 1 -- 172.21.15.82:0/6539978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61401a4cf0 con 0x7f61401013d0 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6144c89640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61401013d0 0x7f61401994a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f613402c240 tx=0x7f61340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f613dffb640 1 -- 172.21.15.82:0/6539978 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134043020 con 0x7f61401013d0 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f613dffb640 1 -- 172.21.15.82:0/6539978 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61340054e0 con 0x7f61401013d0 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f6146eed640 1 -- 172.21.15.82:0/6539978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61401a4f80 con 0x7f61401013d0 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.452+0000 7f613dffb640 1 -- 172.21.15.82:0/6539978 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134003b20 con 0x7f61401013d0 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.453+0000 7f6146eed640 1 -- 172.21.15.82:0/6539978 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61401a5440 con 0x7f61401013d0 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f613dffb640 1 -- 172.21.15.82:0/6539978 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f6134046020 con 0x7f61401013d0 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6149bb4740 1 Processor -- start 2024-03-27T07:34:48.468 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6149bb4740 1 -- start start 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f613dffb640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61300a3820 0x7f61300a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e718b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e71942a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 0x5647e7196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6149bb4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5647e7151cd0 con 0x5647e718b0f0 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6149bb4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5647e7096950 con 0x5647e71947e0 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6149bb4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5647e70eee50 con 0x5647e718ba10 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6144c89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e718b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f614548a640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61300a3820 0x7f61300a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6144c89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e718b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34038/0 (socket says 172.21.15.82:34038) 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f613ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e71942a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f6144c89640 1 -- 172.21.15.82:0/20482695 learned_addr learned my addr 172.21.15.82:0/20482695 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:48.469 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.455+0000 7f614548a640 1 --2- 172.21.15.82:0/20482695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 0x5647e7196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f613dffb640 1 -- 172.21.15.82:0/6539978 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8484+0+0 (secure 0 0 0) 0x7f61340f1f40 con 0x7f61401013d0 2024-03-27T07:34:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f6144c89640 1 -- 172.21.15.82:0/20482695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 msgr2=0x5647e71942a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f6144c89640 1 --2- 172.21.15.82:0/20482695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e71942a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f6144c89640 1 -- 172.21.15.82:0/20482695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 msgr2=0x5647e7196bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f6144c89640 1 --2- 172.21.15.82:0/20482695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 0x5647e7196bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f6144c89640 1 -- 172.21.15.82:0/20482695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647e6e03210 con 0x5647e718b0f0 2024-03-27T07:34:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f6144c89640 1 --2- 172.21.15.82:0/20482695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e718b4d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6134000c00 tx=0x7f61340035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e61286f7fc82623 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:48.470 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f614548a640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61300a3820 0x7f61300a5ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5647e7186e30 tx=0x7f6138009b70 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f612affd640 1 -- 172.21.15.82:0/20482695 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61340bdb60 con 0x5647e718b0f0 2024-03-27T07:34:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f612affd640 1 -- 172.21.15.82:0/20482695 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61340be900 con 0x5647e718b0f0 2024-03-27T07:34:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.456+0000 7f612affd640 1 -- 172.21.15.82:0/20482695 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61340044e0 con 0x5647e718b0f0 2024-03-27T07:34:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 -- 172.21.15.82:0/20482695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 msgr2=0x5647e718b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 --2- 172.21.15.82:0/20482695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e718b4d0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f6134000c00 tx=0x7f61340035f0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 -- 172.21.15.82:0/20482695 shutdown_connections 2024-03-27T07:34:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 --2- 172.21.15.82:0/20482695 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 0x5647e7196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 --2- 172.21.15.82:0/20482695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e71942a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 --2- 172.21.15.82:0/20482695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e718b4d0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.471 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 -- 172.21.15.82:0/20482695 >> 172.21.15.82:0/20482695 conn(0x5647e7185a10 msgr2=0x5647e7185df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 -- 172.21.15.82:0/20482695 shutdown_connections 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 -- 172.21.15.82:0/20482695 wait complete. 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 -- start start 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 Processor -- start 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.457+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e7191870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e7191db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 0x5647e71922f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6149bb4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5647e70eae00 con 0x5647e718b0f0 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6149bb4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5647e7097520 con 0x5647e71947e0 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6149bb4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5647e70aa8e0 con 0x5647e718ba10 2024-03-27T07:34:48.472 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6149bb4740 10 client.0 _ll_register_callbacks cb 0x5647e70e5a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6144c89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e7191870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6144c89640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e7191870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34042/0 (socket says 172.21.15.82:34042) 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6144c89640 1 -- 172.21.15.82:0/3226022264 learned_addr learned my addr 172.21.15.82:0/3226022264 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f614548a640 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 0x5647e71922f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f613ffff640 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e7191db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6144c89640 1 -- 172.21.15.82:0/3226022264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 msgr2=0x5647e7191db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6144c89640 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e7191db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6144c89640 1 -- 172.21.15.82:0/3226022264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 msgr2=0x5647e71922f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6144c89640 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 0x5647e71922f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6144c89640 1 -- 172.21.15.82:0/3226022264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647e6ecf620 con 0x5647e718b0f0 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f614548a640 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 0x5647e71922f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6144c89640 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e7191870 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f61340ef870 tx=0x7f613402ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b483361f52bb69e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:48.473 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f611ffff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f611ffff640 1 -- 172.21.15.82:0/3226022264 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61340dc070 con 0x5647e718b0f0 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f611ffff640 1 -- 172.21.15.82:0/3226022264 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8484+0+0 (secure 0 0 0) 0x7f61340bc500 con 0x5647e718b0f0 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6149bb4740 1 -- 172.21.15.82:0/3226022264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61340be900 con 0x5647e718b0f0 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f611ffff640 1 -- 172.21.15.82:0/3226022264 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f61340a1050 con 0x5647e718b0f0 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6149bb4740 10 client.17175 fetch_fsmap learned FSMap version 37 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.458+0000 7f6149bb4740 1 -- 172.21.15.82:0/3226022264 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5647e71a3100 con 0x5647e718b0f0 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f611ffff640 1 -- 172.21.15.82:0/3226022264 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61340be900 con 0x5647e718b0f0 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f611ffff640 1 -- 172.21.15.82:0/3226022264 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f61340dd430 con 0x5647e718b0f0 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f6149bb4740 10 client.17175 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f6149bb4740 10 client.17175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f6149bb4740 20 client.17175 populate_metadata read hostname 'smithi082' 2024-03-27T07:34:48.474 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5647e71a4450 0x5647e71a6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f6149bb4740 4 client.17175 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f6149bb4740 1 -- 172.21.15.82:0/3226022264 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647e70fc390 con 0x5647e71a4450 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f613ffff640 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5647e71a4450 0x5647e71a6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f611ffff640 10 client.17175 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.459+0000 7f613ffff640 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5647e71a4450 0x5647e71a6840 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7010a214e7c15444 server_cookie=d19e8537b601500c in_seq=0 out_seq=0 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f611ffff640 1 -- 172.21.15.82:0/3226022264 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5647e70fc390 con 0x5647e71a4450 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f611ffff640 10 client.17175 handle_command_reply: tid=0 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 client.17175 shutdown 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 -- 172.21.15.82:0/3226022264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 msgr2=0x5647e7191870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e7191870 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f61340ef870 tx=0x7f613402ca90 comp rx=0 tx=0).stop 2024-03-27T07:34:48.475 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 -- 172.21.15.82:0/3226022264 shutdown_connections 2024-03-27T07:34:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e71947e0 0x5647e71922f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e7191db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5647e71a4450 0x5647e71a6840 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3226022264 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e718b0f0 0x5647e7191870 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 -- 172.21.15.82:0/3226022264 >> 172.21.15.82:0/3226022264 conn(0x5647e7185a10 msgr2=0x5647e7187760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f611ffff640 0 client.17175 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 -- 172.21.15.82:0/3226022264 shutdown_connections 2024-03-27T07:34:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 1 -- 172.21.15.82:0/3226022264 wait complete. 2024-03-27T07:34:48.476 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.460+0000 7f6149bb4740 20 client.17175 trim_cache size 0 max 16384 2024-03-27T07:34:48.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f6149bb4740 1 Processor -- start 2024-03-27T07:34:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f6149bb4740 1 -- start start 2024-03-27T07:34:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 0x5647e719fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e7187570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e71ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f6149bb4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61401b00f0 con 0x5647e71947e0 2024-03-27T07:34:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f6149bb4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61401ad900 con 0x5647e718b0f0 2024-03-27T07:34:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f6149bb4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61401ab770 con 0x5647e718ba10 2024-03-27T07:34:48.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f614548a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e71ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f6144c89640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 0x5647e719fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f614548a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e71ac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34044/0 (socket says 172.21.15.82:34044) 2024-03-27T07:34:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f614548a640 1 -- 172.21.15.82:0/342080726 learned_addr learned my addr 172.21.15.82:0/342080726 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f613ffff640 1 --2- 172.21.15.82:0/342080726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e7187570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f614548a640 1 -- 172.21.15.82:0/342080726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 msgr2=0x5647e7187570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:48.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f614548a640 1 --2- 172.21.15.82:0/342080726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e7187570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f614548a640 1 -- 172.21.15.82:0/342080726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 msgr2=0x5647e719fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.475+0000 7f614548a640 1 --2- 172.21.15.82:0/342080726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 0x5647e719fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f614548a640 1 -- 172.21.15.82:0/342080726 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647e71a6b70 con 0x5647e71947e0 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f614548a640 1 --2- 172.21.15.82:0/342080726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e71ac0a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6138011dd0 tx=0x7f6138004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd90b0c2d64ab799 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f612a7fc640 1 -- 172.21.15.82:0/342080726 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138011e00 con 0x5647e71947e0 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f612a7fc640 1 -- 172.21.15.82:0/342080726 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6138013c90 con 0x5647e71947e0 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f612a7fc640 1 -- 172.21.15.82:0/342080726 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138022810 con 0x5647e71947e0 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f6149bb4740 1 -- 172.21.15.82:0/342080726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 msgr2=0x5647e71ac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f6149bb4740 1 --2- 172.21.15.82:0/342080726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e71ac0a0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f6138011dd0 tx=0x7f6138004ab0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f6149bb4740 1 -- 172.21.15.82:0/342080726 shutdown_connections 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f6149bb4740 1 --2- 172.21.15.82:0/342080726 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e71ac0a0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f6149bb4740 1 --2- 172.21.15.82:0/342080726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e7187570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f6149bb4740 1 --2- 172.21.15.82:0/342080726 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 0x5647e719fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.476+0000 7f6149bb4740 1 -- 172.21.15.82:0/342080726 >> 172.21.15.82:0/342080726 conn(0x5647e7185a10 msgr2=0x5647e7186e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 1 -- 172.21.15.82:0/342080726 shutdown_connections 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 1 -- 172.21.15.82:0/342080726 wait complete. 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 1 -- start start 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 1 Processor -- start 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 0x5647e719c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e71991e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e7199720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61401abdc0 con 0x5647e71947e0 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61401ad230 con 0x5647e718b0f0 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61401ac490 con 0x5647e718ba10 2024-03-27T07:34:48.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f6149bb4740 10 client.0 _ll_register_callbacks cb 0x7f6138013720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:34:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.477+0000 7f614548a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e7199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f6144c89640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 0x5647e719c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f6144c89640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 0x5647e719c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:51618/0 (socket says 172.21.15.82:51618) 2024-03-27T07:34:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f613ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e71991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f614548a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e7199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34050/0 (socket says 172.21.15.82:34050) 2024-03-27T07:34:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f6144c89640 1 -- 172.21.15.82:0/3071622227 learned_addr learned my addr 172.21.15.82:0/3071622227 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:34:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f614548a640 1 -- 172.21.15.82:0/3071622227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 msgr2=0x5647e71991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f614548a640 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e71991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f614548a640 1 -- 172.21.15.82:0/3071622227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 msgr2=0x5647e719c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f614548a640 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 0x5647e719c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f614548a640 1 -- 172.21.15.82:0/3071622227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647e7199f50 con 0x5647e71947e0 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f6144c89640 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 0x5647e719c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f614548a640 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e7199720 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6138009270 tx=0x7f6138005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cd147c66c50433 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f611ffff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f611ffff640 1 -- 172.21.15.82:0/3071622227 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6138003fb0 con 0x5647e71947e0 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f611ffff640 1 -- 172.21.15.82:0/3071622227 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8484+0+0 (secure 0 0 0) 0x7f6138004150 con 0x5647e71947e0 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f6149bb4740 1 -- 172.21.15.82:0/3071622227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6138013c90 con 0x5647e71947e0 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f611ffff640 1 -- 172.21.15.82:0/3071622227 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f6138004350 con 0x5647e71947e0 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f6149bb4740 10 client.17181 fetch_fsmap learned FSMap version 37 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f6149bb4740 1 -- 172.21.15.82:0/3071622227 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5647e720b5e0 con 0x5647e71947e0 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.478+0000 7f611ffff640 1 -- 172.21.15.82:0/3071622227 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6138013c90 con 0x5647e71947e0 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.479+0000 7f611ffff640 1 -- 172.21.15.82:0/3071622227 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f61380124e0 con 0x5647e71947e0 2024-03-27T07:34:48.487 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.479+0000 7f6149bb4740 10 client.17181 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:34:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.479+0000 7f6149bb4740 10 client.17181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:34:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.479+0000 7f6149bb4740 20 client.17181 populate_metadata read hostname 'smithi082' 2024-03-27T07:34:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.479+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5647e720bca0 0x5647e720e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:34:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.479+0000 7f6149bb4740 4 client.17181 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:34:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.479+0000 7f6149bb4740 1 -- 172.21.15.82:0/3071622227 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5647e70f66e0 con 0x5647e720bca0 2024-03-27T07:34:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.479+0000 7f6144c89640 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5647e720bca0 0x5647e720e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:34:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.479+0000 7f6144c89640 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5647e720bca0 0x5647e720e0c0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=299abc02b4f04e32 server_cookie=3d86c5e8403bf11e in_seq=0 out_seq=0 2024-03-27T07:34:48.488 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.479+0000 7f611ffff640 10 client.17181 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f611ffff640 1 -- 172.21.15.82:0/3071622227 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5647e70f66e0 con 0x5647e720bca0 2024-03-27T07:34:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f611ffff640 10 client.17181 handle_command_reply: tid=0 2024-03-27T07:34:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 client.17181 shutdown 2024-03-27T07:34:48.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 -- 172.21.15.82:0/3071622227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 msgr2=0x5647e7199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e7199720 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f6138009270 tx=0x7f6138005bd0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 -- 172.21.15.82:0/3071622227 shutdown_connections 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5647e720bca0 0x5647e720e0c0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5647e71947e0 0x5647e7199720 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5647e718ba10 0x5647e71991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 --2- 172.21.15.82:0/3071622227 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5647e718b0f0 0x5647e719c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f611ffff640 0 client.17181 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 -- 172.21.15.82:0/3071622227 >> 172.21.15.82:0/3071622227 conn(0x5647e7185a10 msgr2=0x5647e71920a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 -- 172.21.15.82:0/3071622227 shutdown_connections 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 1 -- 172.21.15.82:0/3071622227 wait complete. 2024-03-27T07:34:48.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.486+0000 7f6149bb4740 20 client.17181 trim_cache size 0 max 16384 2024-03-27T07:34:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:34:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:34:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:34:48.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:34:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 -- 172.21.15.82:0/6539978 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61300a3820 msgr2=0x7f61300a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61300a3820 0x7f61300a5ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5647e7186e30 tx=0x7f6138009b70 comp rx=0 tx=0).stop 2024-03-27T07:34:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 -- 172.21.15.82:0/6539978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61401013d0 msgr2=0x7f61401994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:34:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61401013d0 0x7f61401994a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f613402c240 tx=0x7f61340042f0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 -- 172.21.15.82:0/6539978 shutdown_connections 2024-03-27T07:34:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61300a3820 0x7f61300a5ce0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6140199f70 0x7f61401a4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f6140105f80 0x7f61401999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 --2- 172.21.15.82:0/6539978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61401013d0 0x7f61401994a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:34:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 -- 172.21.15.82:0/6539978 >> 172.21.15.82:0/6539978 conn(0x7f6140076fe0 msgr2=0x7f61400fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:34:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 -- 172.21.15.82:0/6539978 shutdown_connections 2024-03-27T07:34:48.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:34:48.487+0000 7f6146eed640 1 -- 172.21.15.82:0/6539978 wait complete. 2024-03-27T07:34:49.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:48 smithi082 ceph-mon[32178]: pgmap v350: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-03-27T07:34:49.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:48 smithi149 ceph-mon[36065]: pgmap v350: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-03-27T07:34:49.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:48 smithi153 ceph-mon[36179]: pgmap v350: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-03-27T07:34:51.089 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:50 smithi153 ceph-mon[36179]: pgmap v351: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 247 op/s 2024-03-27T07:34:51.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:50 smithi082 ceph-mon[32178]: pgmap v351: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 247 op/s 2024-03-27T07:34:51.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:50 smithi149 ceph-mon[36065]: pgmap v351: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 247 op/s 2024-03-27T07:34:53.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:52 smithi082 ceph-mon[32178]: pgmap v352: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 214 op/s 2024-03-27T07:34:53.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:52 smithi149 ceph-mon[36065]: pgmap v352: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 214 op/s 2024-03-27T07:34:53.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:52 smithi153 ceph-mon[36179]: pgmap v352: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 214 op/s 2024-03-27T07:34:55.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:54 smithi082 ceph-mon[32178]: pgmap v353: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 304 op/s 2024-03-27T07:34:55.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:54 smithi149 ceph-mon[36065]: pgmap v353: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 304 op/s 2024-03-27T07:34:55.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:54 smithi153 ceph-mon[36179]: pgmap v353: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 304 op/s 2024-03-27T07:34:57.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:56 smithi082 ceph-mon[32178]: pgmap v354: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 225 op/s 2024-03-27T07:34:57.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:56 smithi149 ceph-mon[36065]: pgmap v354: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 225 op/s 2024-03-27T07:34:57.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:56 smithi153 ceph-mon[36179]: pgmap v354: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 225 op/s 2024-03-27T07:34:59.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:34:58 smithi082 ceph-mon[32178]: pgmap v355: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 275 op/s 2024-03-27T07:34:59.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:34:58 smithi149 ceph-mon[36065]: pgmap v355: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 275 op/s 2024-03-27T07:34:59.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:34:58 smithi153 ceph-mon[36179]: pgmap v355: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 275 op/s 2024-03-27T07:35:01.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:00 smithi082 ceph-mon[32178]: pgmap v356: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-03-27T07:35:01.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:00 smithi149 ceph-mon[36065]: pgmap v356: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-03-27T07:35:01.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:00 smithi153 ceph-mon[36179]: pgmap v356: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.4 MiB/s wr, 255 op/s 2024-03-27T07:35:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.608+0000 7faba1313640 1 -- 172.21.15.82:0/1871514187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab9c100d30 msgr2=0x7fab9c1011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.608+0000 7faba1313640 1 --2- 172.21.15.82:0/1871514187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab9c100d30 0x7fab9c1011b0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fab84009900 tx=0x7fab8402bc30 comp rx=0 tx=0).stop 2024-03-27T07:35:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.608+0000 7faba1313640 1 -- 172.21.15.82:0/1871514187 shutdown_connections 2024-03-27T07:35:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.608+0000 7faba1313640 1 --2- 172.21.15.82:0/1871514187 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab9c100d30 0x7fab9c1011b0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.608+0000 7faba1313640 1 --2- 172.21.15.82:0/1871514187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c1016f0 0x7fab9c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.608+0000 7faba1313640 1 --2- 172.21.15.82:0/1871514187 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c1059e0 0x7fab9c105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.608+0000 7faba1313640 1 -- 172.21.15.82:0/1871514187 >> 172.21.15.82:0/1871514187 conn(0x7fab9c077a30 msgr2=0x7fab9c077e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.608+0000 7faba1313640 1 -- 172.21.15.82:0/1871514187 shutdown_connections 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.608+0000 7faba1313640 1 -- 172.21.15.82:0/1871514187 wait complete. 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7faba1313640 1 Processor -- start 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7faba1313640 1 -- start start 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7faba1313640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c100d30 0x7fab9c1990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7faba1313640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab9c1016f0 0x7fab9c199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7faba1313640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c1059e0 0x7fab9c1a4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7faba1313640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c110e70 con 0x7fab9c1016f0 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7faba1313640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c110cf0 con 0x7fab9c1059e0 2024-03-27T07:35:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7faba1313640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c110ff0 con 0x7fab9c100d30 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7fab93fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab9c1016f0 0x7fab9c199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7fab93fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab9c1016f0 0x7fab9c199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58346/0 (socket says 172.21.15.82:58346) 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7fab93fff640 1 -- 172.21.15.82:0/3612574635 learned_addr learned my addr 172.21.15.82:0/3612574635 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.609+0000 7fab9b7fe640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c1059e0 0x7fab9c1a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab9affd640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c100d30 0x7fab9c1990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab93fff640 1 -- 172.21.15.82:0/3612574635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c100d30 msgr2=0x7fab9c1990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab93fff640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c100d30 0x7fab9c1990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab93fff640 1 -- 172.21.15.82:0/3612574635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c1059e0 msgr2=0x7fab9c1a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab93fff640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c1059e0 0x7fab9c1a4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab93fff640 1 -- 172.21.15.82:0/3612574635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c1a4690 con 0x7fab9c1016f0 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab9affd640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c100d30 0x7fab9c1990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:35:01.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab93fff640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab9c1016f0 0x7fab9c199610 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fab8402efd0 tx=0x7fab84004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab98ff9640 1 -- 172.21.15.82:0/3612574635 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84041070 con 0x7fab9c1016f0 2024-03-27T07:35:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7faba1313640 1 -- 172.21.15.82:0/3612574635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9c1a4860 con 0x7fab9c1016f0 2024-03-27T07:35:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7faba1313640 1 -- 172.21.15.82:0/3612574635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab9c1a4d20 con 0x7fab9c1016f0 2024-03-27T07:35:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab98ff9640 1 -- 172.21.15.82:0/3612574635 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab840054e0 con 0x7fab9c1016f0 2024-03-27T07:35:01.614 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.610+0000 7fab98ff9640 1 -- 172.21.15.82:0/3612574635 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab84034440 con 0x7fab9c1016f0 2024-03-27T07:35:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.613+0000 7fab98ff9640 1 -- 172.21.15.82:0/3612574635 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fab84044070 con 0x7fab9c1016f0 2024-03-27T07:35:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.613+0000 7fab98ff9640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab880a3920 0x7fab880a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.613+0000 7fab98ff9640 1 -- 172.21.15.82:0/3612574635 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 8484+0+0 (secure 0 0 0) 0x7fab840f1dd0 con 0x7fab9c1016f0 2024-03-27T07:35:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.613+0000 7faba3fda740 1 Processor -- start 2024-03-27T07:35:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.614+0000 7fab9affd640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab880a3920 0x7fab880a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.614+0000 7fab9affd640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab880a3920 0x7fab880a5de0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab8c005e00 tx=0x7fab8c005c90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.615+0000 7faba3fda740 1 -- start start 2024-03-27T07:35:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.615+0000 7faba3fda740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5a0f0 0x5592f0c5a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.615+0000 7faba3fda740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5aa10 0x5592f0c632a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.615+0000 7faba3fda740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c637e0 0x5592f0c65bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.615+0000 7faba3fda740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5592f0c20cd0 con 0x5592f0c5a0f0 2024-03-27T07:35:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.615+0000 7faba3fda740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5592f0b65950 con 0x5592f0c637e0 2024-03-27T07:35:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5a0f0 0x5592f0c5a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7faba3fda740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5592f0bbde50 con 0x5592f0c5aa10 2024-03-27T07:35:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9affd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5a0f0 0x5592f0c5a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58354/0 (socket says 172.21.15.82:58354) 2024-03-27T07:35:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9affd640 1 -- 172.21.15.82:0/770767027 learned_addr learned my addr 172.21.15.82:0/770767027 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9b7fe640 1 --2- 172.21.15.82:0/770767027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c637e0 0x5592f0c65bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab93fff640 1 --2- 172.21.15.82:0/770767027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5aa10 0x5592f0c632a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9affd640 1 -- 172.21.15.82:0/770767027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5aa10 msgr2=0x5592f0c632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9affd640 1 --2- 172.21.15.82:0/770767027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5aa10 0x5592f0c632a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9affd640 1 -- 172.21.15.82:0/770767027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c637e0 msgr2=0x5592f0c65bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9affd640 1 --2- 172.21.15.82:0/770767027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c637e0 0x5592f0c65bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9affd640 1 -- 172.21.15.82:0/770767027 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592f08d2210 con 0x5592f0c5a0f0 2024-03-27T07:35:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9b7fe640 1 --2- 172.21.15.82:0/770767027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c637e0 0x5592f0c65bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:35:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.616+0000 7fab9affd640 1 --2- 172.21.15.82:0/770767027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5a0f0 0x5592f0c5a4d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fab8c00fe40 tx=0x7fab8c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91178665fa956bdb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.617+0000 7fab917fa640 1 -- 172.21.15.82:0/770767027 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c022070 con 0x5592f0c5a0f0 2024-03-27T07:35:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.617+0000 7fab917fa640 1 -- 172.21.15.82:0/770767027 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab8c01e930 con 0x5592f0c5a0f0 2024-03-27T07:35:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.617+0000 7fab917fa640 1 -- 172.21.15.82:0/770767027 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c010990 con 0x5592f0c5a0f0 2024-03-27T07:35:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 -- 172.21.15.82:0/770767027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5a0f0 msgr2=0x5592f0c5a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 --2- 172.21.15.82:0/770767027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5a0f0 0x5592f0c5a4d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fab8c00fe40 tx=0x7fab8c012000 comp rx=0 tx=0).stop 2024-03-27T07:35:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 -- 172.21.15.82:0/770767027 shutdown_connections 2024-03-27T07:35:01.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 --2- 172.21.15.82:0/770767027 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c637e0 0x5592f0c65bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 --2- 172.21.15.82:0/770767027 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5aa10 0x5592f0c632a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 --2- 172.21.15.82:0/770767027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5a0f0 0x5592f0c5a4d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 -- 172.21.15.82:0/770767027 >> 172.21.15.82:0/770767027 conn(0x5592f0c54a10 msgr2=0x5592f0c54df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 -- 172.21.15.82:0/770767027 shutdown_connections 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 -- 172.21.15.82:0/770767027 wait complete. 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 -- start start 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.618+0000 7faba3fda740 1 Processor -- start 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7faba3fda740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5a0f0 0x5592f0c607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7faba3fda740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c60d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7faba3fda740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 0x5592f0c61240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7faba3fda740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5592f0bb9e00 con 0x5592f0c637e0 2024-03-27T07:35:01.623 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7faba3fda740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5592f0b66520 con 0x5592f0c5aa10 2024-03-27T07:35:01.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7faba3fda740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5592f0b798e0 con 0x5592f0c5a0f0 2024-03-27T07:35:01.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7faba3fda740 10 client.0 _ll_register_callbacks cb 0x5592f0bb4a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:35:01.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7fab93fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c60d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7fab93fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c60d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:44020/0 (socket says 172.21.15.82:44020) 2024-03-27T07:35:01.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7fab93fff640 1 -- 172.21.15.82:0/1088402510 learned_addr learned my addr 172.21.15.82:0/1088402510 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:01.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7fab9b7fe640 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 0x5592f0c61240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.624 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7fab9affd640 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5a0f0 0x5592f0c607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7fab93fff640 1 -- 172.21.15.82:0/1088402510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5a0f0 msgr2=0x5592f0c607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7fab93fff640 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5a0f0 0x5592f0c607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7fab93fff640 1 -- 172.21.15.82:0/1088402510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 msgr2=0x5592f0c61240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7fab93fff640 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 0x5592f0c61240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.619+0000 7fab93fff640 1 -- 172.21.15.82:0/1088402510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592f099e620 con 0x5592f0c5aa10 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.620+0000 7fab93fff640 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c60d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fab840bdfc0 tx=0x7fab840bd990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22d0517d29eb2c24 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.620+0000 7fab827fc640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.620+0000 7fab827fc640 1 -- 172.21.15.82:0/1088402510 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8404b040 con 0x5592f0c5aa10 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.620+0000 7fab827fc640 1 -- 172.21.15.82:0/1088402510 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8484+0+0 (secure 0 0 0) 0x7fab840d7290 con 0x5592f0c5aa10 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.620+0000 7faba3fda740 1 -- 172.21.15.82:0/1088402510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab8c01e930 con 0x5592f0c5aa10 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.620+0000 7fab827fc640 1 -- 172.21.15.82:0/1088402510 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fab840ef970 con 0x5592f0c5aa10 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.620+0000 7faba3fda740 10 client.27026 fetch_fsmap learned FSMap version 37 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.620+0000 7faba3fda740 1 -- 172.21.15.82:0/1088402510 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5592f0c72390 con 0x5592f0c5aa10 2024-03-27T07:35:01.625 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.620+0000 7fab827fc640 1 -- 172.21.15.82:0/1088402510 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab840be030 con 0x5592f0c5aa10 2024-03-27T07:35:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.621+0000 7fab827fc640 1 -- 172.21.15.82:0/1088402510 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fab840035f0 con 0x5592f0c5aa10 2024-03-27T07:35:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.621+0000 7faba3fda740 10 client.27026 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:35:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.621+0000 7faba3fda740 10 client.27026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:35:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.621+0000 7faba3fda740 20 client.27026 populate_metadata read hostname 'smithi082' 2024-03-27T07:35:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.621+0000 7faba3fda740 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5592f0c73890 0x5592f0c75cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.621+0000 7faba3fda740 4 client.27026 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:35:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.621+0000 7faba3fda740 1 -- 172.21.15.82:0/1088402510 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fab8c01e930 con 0x5592f0c73890 2024-03-27T07:35:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.621+0000 7fab9affd640 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5592f0c73890 0x5592f0c75cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.621+0000 7fab9affd640 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5592f0c73890 0x5592f0c75cd0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3314c3eae4429aa0 server_cookie=2c9e832002ebf851 in_seq=0 out_seq=0 2024-03-27T07:35:01.626 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.621+0000 7fab827fc640 10 client.27026 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7fab827fc640 1 -- 172.21.15.82:0/1088402510 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7fab8c01e930 con 0x5592f0c73890 2024-03-27T07:35:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7fab827fc640 10 client.27026 handle_command_reply: tid=0 2024-03-27T07:35:01.627 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 client.27026 shutdown 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 -- 172.21.15.82:0/1088402510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 msgr2=0x5592f0c60d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c60d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fab840bdfc0 tx=0x7fab840bd990 comp rx=0 tx=0).stop 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 -- 172.21.15.82:0/1088402510 shutdown_connections 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5592f0c73890 0x5592f0c75cd0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 0x5592f0c61240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c60d00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 --2- 172.21.15.82:0/1088402510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5a0f0 0x5592f0c607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7fab827fc640 0 client.27026 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 -- 172.21.15.82:0/1088402510 >> 172.21.15.82:0/1088402510 conn(0x5592f0c54a10 msgr2=0x5592f0c56760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 -- 172.21.15.82:0/1088402510 shutdown_connections 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.623+0000 7faba3fda740 1 -- 172.21.15.82:0/1088402510 wait complete. 2024-03-27T07:35:01.628 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.624+0000 7faba3fda740 20 client.27026 trim_cache size 0 max 16384 2024-03-27T07:35:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7faba3fda740 1 Processor -- start 2024-03-27T07:35:01.648 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7faba3fda740 1 -- start start 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7faba3fda740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5a0f0 0x5592f0c62ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7faba3fda740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c6eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7faba3fda740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 0x5592f0c56570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7faba3fda740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c011060 con 0x5592f0c637e0 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7faba3fda740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c00e870 con 0x5592f0c5aa10 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7faba3fda740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c00c6e0 con 0x5592f0c5a0f0 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7fab9b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 0x5592f0c56570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7fab93fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c6eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7fab9b7fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 0x5592f0c56570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58378/0 (socket says 172.21.15.82:58378) 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7fab93fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c6eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:44034/0 (socket says 172.21.15.82:44034) 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7fab9b7fe640 1 -- 172.21.15.82:0/3057079743 learned_addr learned my addr 172.21.15.82:0/3057079743 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.647+0000 7fab9affd640 1 --2- 172.21.15.82:0/3057079743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5a0f0 0x5592f0c62ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.648+0000 7fab9b7fe640 1 -- 172.21.15.82:0/3057079743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5a0f0 msgr2=0x5592f0c62ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.648+0000 7fab9b7fe640 1 --2- 172.21.15.82:0/3057079743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5a0f0 0x5592f0c62ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.648+0000 7fab9b7fe640 1 -- 172.21.15.82:0/3057079743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 msgr2=0x5592f0c6eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.648+0000 7fab9b7fe640 1 --2- 172.21.15.82:0/3057079743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c6eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.648+0000 7fab9b7fe640 1 -- 172.21.15.82:0/3057079743 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592f0b74f40 con 0x5592f0c637e0 2024-03-27T07:35:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.648+0000 7fab9b7fe640 1 --2- 172.21.15.82:0/3057079743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 0x5592f0c56570 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fab94015b40 tx=0x7fab94009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15073f18c965b4f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.648+0000 7fab90ff9640 1 -- 172.21.15.82:0/3057079743 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94010a50 con 0x5592f0c637e0 2024-03-27T07:35:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.648+0000 7fab90ff9640 1 -- 172.21.15.82:0/3057079743 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab94003e50 con 0x5592f0c637e0 2024-03-27T07:35:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.648+0000 7fab90ff9640 1 -- 172.21.15.82:0/3057079743 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab940047d0 con 0x5592f0c637e0 2024-03-27T07:35:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.649+0000 7faba3fda740 1 -- 172.21.15.82:0/3057079743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 msgr2=0x5592f0c56570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.649+0000 7faba3fda740 1 --2- 172.21.15.82:0/3057079743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 0x5592f0c56570 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fab94015b40 tx=0x7fab94009e90 comp rx=0 tx=0).stop 2024-03-27T07:35:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.649+0000 7faba3fda740 1 -- 172.21.15.82:0/3057079743 shutdown_connections 2024-03-27T07:35:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.649+0000 7faba3fda740 1 --2- 172.21.15.82:0/3057079743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c637e0 0x5592f0c56570 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.649+0000 7faba3fda740 1 --2- 172.21.15.82:0/3057079743 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5aa10 0x5592f0c6eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.649+0000 7faba3fda740 1 --2- 172.21.15.82:0/3057079743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c5a0f0 0x5592f0c62ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.649+0000 7faba3fda740 1 -- 172.21.15.82:0/3057079743 >> 172.21.15.82:0/3057079743 conn(0x5592f0c54a10 msgr2=0x5592f0c55e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.650+0000 7faba3fda740 1 -- 172.21.15.82:0/3057079743 shutdown_connections 2024-03-27T07:35:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.650+0000 7faba3fda740 1 -- 172.21.15.82:0/3057079743 wait complete. 2024-03-27T07:35:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.650+0000 7faba3fda740 1 -- start start 2024-03-27T07:35:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.650+0000 7faba3fda740 1 Processor -- start 2024-03-27T07:35:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7faba3fda740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5a0f0 0x5592f0c6b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7faba3fda740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5aa10 0x5592f0c684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7faba3fda740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c637e0 0x5592f0c68a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7faba3fda740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c00cd30 con 0x5592f0c5aa10 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7faba3fda740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c00e1a0 con 0x5592f0c5a0f0 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7faba3fda740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c00d400 con 0x5592f0c637e0 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7faba3fda740 10 client.0 _ll_register_callbacks cb 0x7fab840bde00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7fab93fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5aa10 0x5592f0c684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7fab93fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5aa10 0x5592f0c684e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58394/0 (socket says 172.21.15.82:58394) 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7fab93fff640 1 -- 172.21.15.82:0/4219110371 learned_addr learned my addr 172.21.15.82:0/4219110371 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7fab9affd640 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5a0f0 0x5592f0c6b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.651+0000 7fab9b7fe640 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c637e0 0x5592f0c68a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.652+0000 7fab93fff640 1 -- 172.21.15.82:0/4219110371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c637e0 msgr2=0x5592f0c68a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.652+0000 7fab93fff640 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c637e0 0x5592f0c68a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.652+0000 7fab93fff640 1 -- 172.21.15.82:0/4219110371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5a0f0 msgr2=0x5592f0c6b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.652+0000 7fab93fff640 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5a0f0 0x5592f0c6b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.652+0000 7fab93fff640 1 -- 172.21.15.82:0/4219110371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592f0c6bce0 con 0x5592f0c5aa10 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.652+0000 7fab93fff640 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5aa10 0x5592f0c684e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fab840baa00 tx=0x7fab84009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35b40c44a88af97 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.652+0000 7fab827fc640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.652+0000 7fab827fc640 1 -- 172.21.15.82:0/4219110371 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8404b070 con 0x5592f0c5aa10 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.652+0000 7fab827fc640 1 -- 172.21.15.82:0/4219110371 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 8484+0+0 (secure 0 0 0) 0x7fab840c20d0 con 0x5592f0c5aa10 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.652+0000 7faba3fda740 1 -- 172.21.15.82:0/4219110371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab94003e50 con 0x5592f0c5aa10 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.653+0000 7fab827fc640 1 -- 172.21.15.82:0/4219110371 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fab84005690 con 0x5592f0c5aa10 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.653+0000 7faba3fda740 10 client.17199 fetch_fsmap learned FSMap version 37 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.653+0000 7faba3fda740 1 -- 172.21.15.82:0/4219110371 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5592f0ce2f60 con 0x5592f0c5aa10 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.653+0000 7fab827fc640 1 -- 172.21.15.82:0/4219110371 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab94003e50 con 0x5592f0c5aa10 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.653+0000 7fab827fc640 1 -- 172.21.15.82:0/4219110371 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fab840a7140 con 0x5592f0c5aa10 2024-03-27T07:35:01.656 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.653+0000 7faba3fda740 10 client.17199 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:35:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.653+0000 7faba3fda740 10 client.17199 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:35:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.653+0000 7faba3fda740 20 client.17199 populate_metadata read hostname 'smithi082' 2024-03-27T07:35:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.653+0000 7faba3fda740 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5592f0ce35d0 0x5592f0ce59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.654+0000 7faba3fda740 4 client.17199 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:35:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.654+0000 7faba3fda740 1 -- 172.21.15.82:0/4219110371 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5592f0bcb390 con 0x5592f0ce35d0 2024-03-27T07:35:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.654+0000 7fab9affd640 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5592f0ce35d0 0x5592f0ce59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.655+0000 7fab9affd640 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5592f0ce35d0 0x5592f0ce59f0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=521e9aac66005632 server_cookie=90c53c2d46d10db2 in_seq=0 out_seq=0 2024-03-27T07:35:01.657 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:01.655+0000 7fab827fc640 10 client.17199 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.444+0000 7fab827fc640 1 -- 172.21.15.82:0/4219110371 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5592f0bcb390 con 0x5592f0ce35d0 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.444+0000 7fab827fc640 10 client.17199 handle_command_reply: tid=0 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.444+0000 7faba3fda740 1 client.17199 shutdown 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.444+0000 7faba3fda740 1 -- 172.21.15.82:0/4219110371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5aa10 msgr2=0x5592f0c684e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.444+0000 7faba3fda740 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5aa10 0x5592f0c684e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fab840baa00 tx=0x7fab84009260 comp rx=0 tx=0).stop 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.444+0000 7faba3fda740 1 -- 172.21.15.82:0/4219110371 shutdown_connections 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.444+0000 7faba3fda740 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5592f0ce35d0 0x5592f0ce59f0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba3fda740 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5592f0c5aa10 0x5592f0c684e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba3fda740 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5592f0c637e0 0x5592f0c68a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba3fda740 1 --2- 172.21.15.82:0/4219110371 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5592f0c5a0f0 0x5592f0c6b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7fab827fc640 0 client.17199 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba3fda740 1 -- 172.21.15.82:0/4219110371 >> 172.21.15.82:0/4219110371 conn(0x5592f0c54a10 msgr2=0x5592f0c566c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba3fda740 1 -- 172.21.15.82:0/4219110371 shutdown_connections 2024-03-27T07:35:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba3fda740 1 -- 172.21.15.82:0/4219110371 wait complete. 2024-03-27T07:35:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba3fda740 20 client.17199 trim_cache size 0 max 16384 2024-03-27T07:35:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:35:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:35:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:35:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:35:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba1313640 1 -- 172.21.15.82:0/3612574635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab880a3920 msgr2=0x7fab880a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba1313640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab880a3920 0x7fab880a5de0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab8c005e00 tx=0x7fab8c005c90 comp rx=0 tx=0).stop 2024-03-27T07:35:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba1313640 1 -- 172.21.15.82:0/3612574635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab9c1016f0 msgr2=0x7fab9c199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba1313640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab9c1016f0 0x7fab9c199610 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fab8402efd0 tx=0x7fab84004430 comp rx=0 tx=0).stop 2024-03-27T07:35:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba1313640 1 -- 172.21.15.82:0/3612574635 shutdown_connections 2024-03-27T07:35:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba1313640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab880a3920 0x7fab880a5de0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba1313640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab9c1016f0 0x7fab9c199610 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba1313640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab9c1059e0 0x7fab9c1a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba1313640 1 --2- 172.21.15.82:0/3612574635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab9c100d30 0x7fab9c1990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.445+0000 7faba1313640 1 -- 172.21.15.82:0/3612574635 >> 172.21.15.82:0/3612574635 conn(0x7fab9c077a30 msgr2=0x7fab9c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.446+0000 7faba1313640 1 -- 172.21.15.82:0/3612574635 shutdown_connections 2024-03-27T07:35:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:02.446+0000 7faba1313640 1 -- 172.21.15.82:0/3612574635 wait complete. 2024-03-27T07:35:03.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-mon[36179]: pgmap v357: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 214 op/s 2024-03-27T07:35:03.037 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: *** Caught signal (Segmentation fault) ** 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: in thread 7fbbad5e1700 thread_name:md_log_replay 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev) 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fbbbe9a2d20] 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2: /usr/bin/ceph-mds(+0x5484b2) [0x5607b5d8a4b2] 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5607b5d8dc63] 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 4: (MDLog::_replay_thread()+0x617) [0x5607b5de76c7] 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5607b5df0db1] 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fbbbe9981ca] 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 7: clone() 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2024-03-27T07:35:02.712+0000 7fbbad5e1700 -1 *** Caught signal (Segmentation fault) ** 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: in thread 7fbbad5e1700 thread_name:md_log_replay 2024-03-27T07:35:03.038 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev) 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fbbbe9a2d20] 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2: /usr/bin/ceph-mds(+0x5484b2) [0x5607b5d8a4b2] 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5607b5d8dc63] 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 4: (MDLog::_replay_thread()+0x617) [0x5607b5de76c7] 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5607b5df0db1] 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fbbbe9981ca] 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 7: clone() 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 0> 2024-03-27T07:35:02.712+0000 7fbbad5e1700 -1 *** Caught signal (Segmentation fault) ** 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: in thread 7fbbad5e1700 thread_name:md_log_replay 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2024-03-27T07:35:03.039 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev) 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fbbbe9a2d20] 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2: /usr/bin/ceph-mds(+0x5484b2) [0x5607b5d8a4b2] 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5607b5d8dc63] 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 4: (MDLog::_replay_thread()+0x617) [0x5607b5de76c7] 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5607b5df0db1] 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fbbbe9981ca] 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 7: clone() 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 0> 2024-03-27T07:35:02.712+0000 7fbbad5e1700 -1 *** Caught signal (Segmentation fault) ** 2024-03-27T07:35:03.040 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: in thread 7fbbad5e1700 thread_name:md_log_replay 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev) 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7fbbbe9a2d20] 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2: /usr/bin/ceph-mds(+0x5484b2) [0x5607b5d8a4b2] 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x5607b5d8dc63] 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 4: (MDLog::_replay_thread()+0x617) [0x5607b5de76c7] 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 5: (MDLog::ReplayThread::entry()+0x11) [0x5607b5df0db1] 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7fbbbe9981ca] 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 7: clone() 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[72073]: 2024-03-27T07:35:03.041 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:02 smithi153 podman[73091]: 2024-03-27 07:35:02.869175926 +0000 UTC m=+0.024273877 container died d9c75297230aae8cfc5340d721268adab1d25d02613750c56d2138e575d2a1e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326) 2024-03-27T07:35:03.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:02 smithi082 ceph-mon[32178]: pgmap v357: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 214 op/s 2024-03-27T07:35:03.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:02 smithi149 ceph-mon[36065]: pgmap v357: 97 pgs: 97 active+clean; 1.9 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 214 op/s 2024-03-27T07:35:04.251 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:03 smithi153 podman[73091]: 2024-03-27 07:35:03.996664464 +0000 UTC m=+1.151762415 container remove d9c75297230aae8cfc5340d721268adab1d25d02613750c56d2138e575d2a1e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-03-27T07:35:04.251 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:03 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service: Main process exited, code=exited, status=139/n/a 2024-03-27T07:35:04.536 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:04 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service: Failed with result 'exit-code'. 2024-03-27T07:35:04.537 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:04 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service: Consumed 9.856s CPU time. 2024-03-27T07:35:05.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:04 smithi082 ceph-mon[32178]: pgmap v358: 97 pgs: 97 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 337 op/s 2024-03-27T07:35:05.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:04 smithi149 ceph-mon[36065]: pgmap v358: 97 pgs: 97 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 337 op/s 2024-03-27T07:35:05.525 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:04 smithi153 ceph-mon[36179]: pgmap v358: 97 pgs: 97 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.3 MiB/s wr, 337 op/s 2024-03-27T07:35:06.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:05 smithi082 ceph-mon[32178]: osdmap e101: 12 total, 12 up, 12 in 2024-03-27T07:35:06.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:05 smithi149 ceph-mon[36065]: osdmap e101: 12 total, 12 up, 12 in 2024-03-27T07:35:06.332 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:05 smithi153 ceph-mon[36179]: osdmap e101: 12 total, 12 up, 12 in 2024-03-27T07:35:07.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:06 smithi082 ceph-mon[32178]: pgmap v360: 97 pgs: 97 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 292 op/s 2024-03-27T07:35:07.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:06 smithi149 ceph-mon[36065]: pgmap v360: 97 pgs: 97 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 292 op/s 2024-03-27T07:35:07.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:06 smithi153 ceph-mon[36179]: pgmap v360: 97 pgs: 97 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.8 MiB/s wr, 292 op/s 2024-03-27T07:35:08.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:07 smithi082 ceph-mon[32178]: pgmap v361: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 284 op/s 2024-03-27T07:35:08.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:07 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:35:08.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:07 smithi149 ceph-mon[36065]: pgmap v361: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 284 op/s 2024-03-27T07:35:08.254 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:07 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:35:08.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:07 smithi153 ceph-mon[36179]: pgmap v361: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.9 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.3 MiB/s wr, 284 op/s 2024-03-27T07:35:08.287 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:07 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:35:09.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:09 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:35:09.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:09 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:35:10.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:09 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:35:10.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:09 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:35:10.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:09 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:35:10.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:09 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:35:10.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:10 smithi082 ceph-mon[32178]: pgmap v362: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 262 op/s 2024-03-27T07:35:10.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:10 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:35:10.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:10 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:35:10.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:10 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:35:11.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:10 smithi149 ceph-mon[36065]: pgmap v362: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 262 op/s 2024-03-27T07:35:11.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:10 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:35:11.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:10 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:35:11.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:10 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:35:11.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:10 smithi153 ceph-mon[36179]: pgmap v362: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 262 op/s 2024-03-27T07:35:11.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:10 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:35:11.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:10 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:35:11.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:10 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:35:12.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:12 smithi082 ceph-mon[32178]: pgmap v363: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 262 op/s 2024-03-27T07:35:13.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:12 smithi149 ceph-mon[36065]: pgmap v363: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 262 op/s 2024-03-27T07:35:13.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:12 smithi153 ceph-mon[36179]: pgmap v363: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 262 op/s 2024-03-27T07:35:14.576 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:14 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service: Scheduled restart job, restart counter is at 2. 2024-03-27T07:35:14.576 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:14 smithi153 systemd[1]: Stopped Ceph mds.c for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:35:14.576 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:14 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service: Consumed 9.856s CPU time. 2024-03-27T07:35:14.577 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:14 smithi153 systemd[1]: Starting Ceph mds.c for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:35:14.577 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:14 smithi153 ceph-mon[36179]: pgmap v364: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-03-27T07:35:14.919 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:14 smithi153 podman[73317]: 2024-03-27 07:35:14.659246096 +0000 UTC m=+0.063196391 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:35:14.919 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:14 smithi153 podman[73317]: 2024-03-27 07:35:14.790475275 +0000 UTC m=+0.194425559 container create fd738c2b4d8108f6df9bcb5d78a6c57f9254796d74a09c93cc26b23c1713dbbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-27T07:35:14.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:14 smithi082 ceph-mon[32178]: pgmap v364: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-03-27T07:35:15.003 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:14 smithi149 ceph-mon[36065]: pgmap v364: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 152 op/s 2024-03-27T07:35:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.563+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/3128123083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9e4069b70 msgr2=0x7fa9e410e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:15.564 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.563+0000 7fa9eb9ac640 1 --2- 172.21.15.82:0/3128123083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9e4069b70 0x7fa9e410e9e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009900 tx=0x7fa9d802bcc0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.563+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/3128123083 shutdown_connections 2024-03-27T07:35:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.563+0000 7fa9eb9ac640 1 --2- 172.21.15.82:0/3128123083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9e4069b70 0x7fa9e410e9e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.563+0000 7fa9eb9ac640 1 --2- 172.21.15.82:0/3128123083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e40691d0 0x7fa9e4069630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.563+0000 7fa9eb9ac640 1 --2- 172.21.15.82:0/3128123083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e4107c40 0x7fa9e4108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.563+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/3128123083 >> 172.21.15.82:0/3128123083 conn(0x7fa9e40778a0 msgr2=0x7fa9e4077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.564+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/3128123083 shutdown_connections 2024-03-27T07:35:15.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.564+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/3128123083 wait complete. 2024-03-27T07:35:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.564+0000 7fa9eb9ac640 1 Processor -- start 2024-03-27T07:35:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9eb9ac640 1 -- start start 2024-03-27T07:35:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9eb9ac640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e40691d0 0x7fa9e41160f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9eb9ac640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4069b70 0x7fa9e4116630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9eb9ac640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9e4107c40 0x7fa9e41112a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9eb9ac640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e41029e0 con 0x7fa9e4107c40 2024-03-27T07:35:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9eb9ac640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e4102860 con 0x7fa9e40691d0 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9eb9ac640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e4102b60 con 0x7fa9e4069b70 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9e9f49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9e4107c40 0x7fa9e41112a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9e9f49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9e4107c40 0x7fa9e41112a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56114/0 (socket says 172.21.15.82:56114) 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9e9f49640 1 -- 172.21.15.82:0/1517623295 learned_addr learned my addr 172.21.15.82:0/1517623295 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4069b70 0x7fa9e4116630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9e9748640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e40691d0 0x7fa9e41160f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9e8f47640 1 -- 172.21.15.82:0/1517623295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e40691d0 msgr2=0x7fa9e41160f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e40691d0 0x7fa9e41160f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9e8f47640 1 -- 172.21.15.82:0/1517623295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9e4107c40 msgr2=0x7fa9e41112a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9e4107c40 0x7fa9e41112a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.565+0000 7fa9e8f47640 1 -- 172.21.15.82:0/1517623295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e4111b60 con 0x7fa9e4069b70 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.566+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4069b70 0x7fa9e4116630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000b3f0 tx=0x7fa9e000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.566+0000 7fa9d67fc640 1 -- 172.21.15.82:0/1517623295 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0015020 con 0x7fa9e4069b70 2024-03-27T07:35:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.566+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/1517623295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e4111e50 con 0x7fa9e4069b70 2024-03-27T07:35:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.566+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/1517623295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e411bfe0 con 0x7fa9e4069b70 2024-03-27T07:35:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.566+0000 7fa9d67fc640 1 -- 172.21.15.82:0/1517623295 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9e0011d10 con 0x7fa9e4069b70 2024-03-27T07:35:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.566+0000 7fa9d67fc640 1 -- 172.21.15.82:0/1517623295 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e001ae50 con 0x7fa9e4069b70 2024-03-27T07:35:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9ee594740 1 Processor -- start 2024-03-27T07:35:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9ee594740 1 -- start start 2024-03-27T07:35:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e7064d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e70f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e711bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9ee594740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f18e6cccd0 con 0x55f18e70f7e0 2024-03-27T07:35:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9ee594740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f18e611950 con 0x55f18e706a10 2024-03-27T07:35:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9ee594740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f18e669e50 con 0x55f18e7060f0 2024-03-27T07:35:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9e8f47640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e711bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9e8f47640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e711bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56120/0 (socket says 172.21.15.82:56120) 2024-03-27T07:35:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9e8f47640 1 -- 172.21.15.82:0/4029965007 learned_addr learned my addr 172.21.15.82:0/4029965007 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9e9748640 1 --2- 172.21.15.82:0/4029965007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e70f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.570+0000 7fa9d67fc640 1 -- 172.21.15.82:0/1517623295 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fa9e0018020 con 0x7fa9e4069b70 2024-03-27T07:35:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.571+0000 7fa9e8f47640 1 -- 172.21.15.82:0/4029965007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 msgr2=0x55f18e7064d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.571+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/4029965007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e7064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.571+0000 7fa9e8f47640 1 -- 172.21.15.82:0/4029965007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 msgr2=0x55f18e70f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.571+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/4029965007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e70f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.571+0000 7fa9e8f47640 1 -- 172.21.15.82:0/4029965007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f18e37e210 con 0x55f18e70f7e0 2024-03-27T07:35:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.571+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/4029965007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e711bd0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00cce80 tx=0x7fa9e00d72a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345a60e3e1b566e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.571+0000 7fa9d67fc640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9d00a3a40 0x7fa9d00a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.572+0000 7fa9d67fc640 1 -- 172.21.15.82:0/1517623295 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 8528+0+0 (secure 0 0 0) 0x7fa9e00cf720 con 0x7fa9e4069b70 2024-03-27T07:35:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.572+0000 7fa9cf7fe640 1 -- 172.21.15.82:0/4029965007 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00de070 con 0x55f18e70f7e0 2024-03-27T07:35:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.572+0000 7fa9cf7fe640 1 -- 172.21.15.82:0/4029965007 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9e009c080 con 0x55f18e70f7e0 2024-03-27T07:35:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.572+0000 7fa9cf7fe640 1 -- 172.21.15.82:0/4029965007 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e009b980 con 0x55f18e70f7e0 2024-03-27T07:35:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.572+0000 7fa9e9f49640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9d00a3a40 0x7fa9d00a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.572+0000 7fa9ee594740 1 -- 172.21.15.82:0/4029965007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 msgr2=0x55f18e711bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.572+0000 7fa9ee594740 1 --2- 172.21.15.82:0/4029965007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e711bd0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00cce80 tx=0x7fa9e00d72a0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.573+0000 7fa9e9f49640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9d00a3a40 0x7fa9d00a5f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4077cc0 tx=0x7fa9d8009560 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.573+0000 7fa9ee594740 1 -- 172.21.15.82:0/4029965007 shutdown_connections 2024-03-27T07:35:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.573+0000 7fa9ee594740 1 --2- 172.21.15.82:0/4029965007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e711bd0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.573+0000 7fa9ee594740 1 --2- 172.21.15.82:0/4029965007 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e70f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.573+0000 7fa9ee594740 1 --2- 172.21.15.82:0/4029965007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e7064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.573+0000 7fa9ee594740 1 -- 172.21.15.82:0/4029965007 >> 172.21.15.82:0/4029965007 conn(0x55f18e700a10 msgr2=0x55f18e700df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.573+0000 7fa9ee594740 1 -- 172.21.15.82:0/4029965007 shutdown_connections 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.573+0000 7fa9ee594740 1 -- 172.21.15.82:0/4029965007 wait complete. 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.573+0000 7fa9ee594740 1 -- start start 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.573+0000 7fa9ee594740 1 Processor -- start 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e7060f0 0x55f18e70c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e70cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e70f7e0 0x55f18e70d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9ee594740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f18e665e00 con 0x55f18e7060f0 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9ee594740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55f18e612520 con 0x55f18e706a10 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9ee594740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55f18e6258e0 con 0x55f18e70f7e0 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9ee594740 10 client.0 _ll_register_callbacks cb 0x55f18e660a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:35:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e9748640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e7060f0 0x55f18e70c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e9748640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e7060f0 0x55f18e70c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56128/0 (socket says 172.21.15.82:56128) 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e9748640 1 -- 172.21.15.82:0/3181884583 learned_addr learned my addr 172.21.15.82:0/3181884583 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e70cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e9f49640 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e70f7e0 0x55f18e70d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e9748640 1 -- 172.21.15.82:0/3181884583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e70f7e0 msgr2=0x55f18e70d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e9748640 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e70f7e0 0x55f18e70d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e9748640 1 -- 172.21.15.82:0/3181884583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 msgr2=0x55f18e70cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e9748640 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e70cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e9748640 1 -- 172.21.15.82:0/3181884583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f18e44a620 con 0x55f18e7060f0 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.574+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e70cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.575+0000 7fa9e9748640 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e7060f0 0x55f18e70c860 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc003c20 tx=0x7fa9dc004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d23cdf11ebe36fb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.575+0000 7fa9ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.575+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3181884583 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc012850 con 0x55f18e7060f0 2024-03-27T07:35:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.575+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3181884583 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8528+0+0 (secure 0 0 0) 0x7fa9dc0129f0 con 0x55f18e7060f0 2024-03-27T07:35:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.576+0000 7fa9ee594740 1 -- 172.21.15.82:0/3181884583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9e009c080 con 0x55f18e7060f0 2024-03-27T07:35:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.576+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3181884583 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa9dc012bf0 con 0x55f18e7060f0 2024-03-27T07:35:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.576+0000 7fa9ee594740 10 client.17211 fetch_fsmap learned FSMap version 37 2024-03-27T07:35:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.576+0000 7fa9ee594740 1 -- 172.21.15.82:0/3181884583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f18e71e4c0 con 0x55f18e7060f0 2024-03-27T07:35:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.576+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3181884583 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9e009c080 con 0x55f18e7060f0 2024-03-27T07:35:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.577+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3181884583 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fa9dc019020 con 0x55f18e7060f0 2024-03-27T07:35:15.580 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.577+0000 7fa9ee594740 10 client.17211 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:35:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.577+0000 7fa9ee594740 10 client.17211 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:35:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.577+0000 7fa9ee594740 20 client.17211 populate_metadata read hostname 'smithi082' 2024-03-27T07:35:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.577+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f18e71fa70 0x55f18e721e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.577+0000 7fa9ee594740 4 client.17211 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:35:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.577+0000 7fa9ee594740 1 -- 172.21.15.82:0/3181884583 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f18e677390 con 0x55f18e71fa70 2024-03-27T07:35:15.581 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.581+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f18e71fa70 0x55f18e721e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.582+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f18e71fa70 0x55f18e721e60 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9f347cabe137434 server_cookie=d00b9c2294442f5d in_seq=0 out_seq=0 2024-03-27T07:35:15.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.582+0000 7fa9ccff9640 10 client.17211 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.592+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3181884583 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f18e677390 con 0x55f18e71fa70 2024-03-27T07:35:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.592+0000 7fa9ccff9640 10 client.17211 handle_command_reply: tid=0 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.592+0000 7fa9ee594740 1 client.17211 shutdown 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 1 -- 172.21.15.82:0/3181884583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e7060f0 msgr2=0x55f18e70c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e7060f0 0x55f18e70c860 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc003c20 tx=0x7fa9dc004410 comp rx=0 tx=0).stop 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 1 -- 172.21.15.82:0/3181884583 shutdown_connections 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e70f7e0 0x55f18e70d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e70cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f18e71fa70 0x55f18e721e60 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3181884583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e7060f0 0x55f18e70c860 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 1 -- 172.21.15.82:0/3181884583 >> 172.21.15.82:0/3181884583 conn(0x55f18e700a10 msgr2=0x55f18e702760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ccff9640 0 client.17211 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 1 -- 172.21.15.82:0/3181884583 shutdown_connections 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 1 -- 172.21.15.82:0/3181884583 wait complete. 2024-03-27T07:35:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.593+0000 7fa9ee594740 20 client.17211 trim_cache size 0 max 16384 2024-03-27T07:35:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.609+0000 7fa9ee594740 1 Processor -- start 2024-03-27T07:35:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.609+0000 7fa9ee594740 1 -- start start 2024-03-27T07:35:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.609+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e70ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.609+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e71af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.610 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.609+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e727720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.609+0000 7fa9ee594740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c80111c0 con 0x55f18e70f7e0 2024-03-27T07:35:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.609+0000 7fa9ee594740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c800e9d0 con 0x55f18e706a10 2024-03-27T07:35:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.609+0000 7fa9ee594740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c800c820 con 0x55f18e7060f0 2024-03-27T07:35:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e9f49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e727720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e9f49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e727720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56136/0 (socket says 172.21.15.82:56136) 2024-03-27T07:35:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e9f49640 1 -- 172.21.15.82:0/506562818 learned_addr learned my addr 172.21.15.82:0/506562818 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e9748640 1 --2- 172.21.15.82:0/506562818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e70ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.611 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/506562818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e71af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e9748640 1 -- 172.21.15.82:0/506562818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 msgr2=0x55f18e71af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e9748640 1 --2- 172.21.15.82:0/506562818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e71af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e9748640 1 -- 172.21.15.82:0/506562818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 msgr2=0x55f18e727720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e9748640 1 --2- 172.21.15.82:0/506562818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e727720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.612 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e9748640 1 -- 172.21.15.82:0/506562818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f18e70adb0 con 0x55f18e7060f0 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9e9748640 1 --2- 172.21.15.82:0/506562818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e70ef90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc002230 tx=0x7fa9dc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1fd7ff5abc567d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9ceffd640 1 -- 172.21.15.82:0/506562818 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc028040 con 0x55f18e7060f0 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.610+0000 7fa9ceffd640 1 -- 172.21.15.82:0/506562818 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9dc031070 con 0x55f18e7060f0 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.611+0000 7fa9ceffd640 1 -- 172.21.15.82:0/506562818 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc01b440 con 0x55f18e7060f0 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.611+0000 7fa9ee594740 1 -- 172.21.15.82:0/506562818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 msgr2=0x55f18e70ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.611+0000 7fa9ee594740 1 --2- 172.21.15.82:0/506562818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e70ef90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc002230 tx=0x7fa9dc009bd0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.611+0000 7fa9ee594740 1 -- 172.21.15.82:0/506562818 shutdown_connections 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.611+0000 7fa9ee594740 1 --2- 172.21.15.82:0/506562818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e727720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.611+0000 7fa9ee594740 1 --2- 172.21.15.82:0/506562818 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e71af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.612+0000 7fa9ee594740 1 --2- 172.21.15.82:0/506562818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e70ef90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.613 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.612+0000 7fa9ee594740 1 -- 172.21.15.82:0/506562818 >> 172.21.15.82:0/506562818 conn(0x55f18e700a10 msgr2=0x55f18e700df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.612+0000 7fa9ee594740 1 -- 172.21.15.82:0/506562818 shutdown_connections 2024-03-27T07:35:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.612+0000 7fa9ee594740 1 -- 172.21.15.82:0/506562818 wait complete. 2024-03-27T07:35:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.613+0000 7fa9ee594740 1 -- start start 2024-03-27T07:35:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.613+0000 7fa9ee594740 1 Processor -- start 2024-03-27T07:35:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e717540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.615 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e708ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9ee594740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e709420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9ee594740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c800ce90 con 0x55f18e70f7e0 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9ee594740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c800e300 con 0x55f18e706a10 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9ee594740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c800d560 con 0x55f18e7060f0 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9ee594740 10 client.0 _ll_register_callbacks cb 0x7fa9dc009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e9748640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e717540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e9f49640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e709420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e9748640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e717540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:43758/0 (socket says 172.21.15.82:43758) 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e9748640 1 -- 172.21.15.82:0/3759944856 learned_addr learned my addr 172.21.15.82:0/3759944856 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e708ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e9748640 1 -- 172.21.15.82:0/3759944856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 msgr2=0x55f18e708ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e9748640 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e708ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e9748640 1 -- 172.21.15.82:0/3759944856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 msgr2=0x55f18e709420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:15.616 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e9748640 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e709420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e9748640 1 -- 172.21.15.82:0/3759944856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f18e709960 con 0x55f18e7060f0 2024-03-27T07:35:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9e9748640 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e717540 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc02e040 tx=0x7fa9dc005f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15e6239698bca51e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:35:15.617 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.614+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3759944856 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc039070 con 0x55f18e7060f0 2024-03-27T07:35:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.615+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3759944856 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 8528+0+0 (secure 0 0 0) 0x7fa9dc011e20 con 0x55f18e7060f0 2024-03-27T07:35:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.615+0000 7fa9ee594740 1 -- 172.21.15.82:0/3759944856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9dc031070 con 0x55f18e7060f0 2024-03-27T07:35:15.618 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.615+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3759944856 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa9dc045050 con 0x55f18e7060f0 2024-03-27T07:35:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.615+0000 7fa9ee594740 10 client.27067 fetch_fsmap learned FSMap version 37 2024-03-27T07:35:15.619 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.615+0000 7fa9ee594740 1 -- 172.21.15.82:0/3759944856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55f18e785a60 con 0x55f18e7060f0 2024-03-27T07:35:15.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.615+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3759944856 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9dc004910 con 0x55f18e7060f0 2024-03-27T07:35:15.620 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.616+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3759944856 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fa9dc019070 con 0x55f18e7060f0 2024-03-27T07:35:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.616+0000 7fa9ee594740 10 client.27067 fetch_fsmap finished waiting for FSMap version 37 2024-03-27T07:35:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.616+0000 7fa9ee594740 10 client.27067 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:35:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.616+0000 7fa9ee594740 20 client.27067 populate_metadata read hostname 'smithi082' 2024-03-27T07:35:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.616+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f18e7860d0 0x55f18e7884f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.616+0000 7fa9ee594740 4 client.27067 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:35:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.616+0000 7fa9ee594740 1 -- 172.21.15.82:0/3759944856 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fa9dc031070 con 0x55f18e7860d0 2024-03-27T07:35:15.621 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.616+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f18e7860d0 0x55f18e7884f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.619+0000 7fa9ccff9640 10 client.27067 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:15.622 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:15.619+0000 7fa9e8f47640 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f18e7860d0 0x55f18e7884f0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f5cb111df68bd35 server_cookie=7431a6207e5e6653 in_seq=0 out_seq=0 2024-03-27T07:35:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.205+0000 7fa9ccff9640 1 -- 172.21.15.82:0/3759944856 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fa9dc031070 con 0x55f18e7860d0 2024-03-27T07:35:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.205+0000 7fa9ccff9640 10 client.27067 handle_command_reply: tid=0 2024-03-27T07:35:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.205+0000 7fa9ee594740 1 client.27067 shutdown 2024-03-27T07:35:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.205+0000 7fa9ee594740 1 -- 172.21.15.82:0/3759944856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 msgr2=0x55f18e717540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.205+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e717540 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc02e040 tx=0x7fa9dc005f60 comp rx=0 tx=0).stop 2024-03-27T07:35:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.206+0000 7fa9ee594740 1 -- 172.21.15.82:0/3759944856 shutdown_connections 2024-03-27T07:35:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.206+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55f18e7860d0 0x55f18e7884f0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.206+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f18e70f7e0 0x55f18e709420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:16.207 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.206+0000 7fa9ccff9640 0 client.27067 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.206+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55f18e706a10 0x55f18e708ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.206+0000 7fa9ee594740 1 --2- 172.21.15.82:0/3759944856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f18e7060f0 0x55f18e717540 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.206+0000 7fa9ee594740 1 -- 172.21.15.82:0/3759944856 >> 172.21.15.82:0/3759944856 conn(0x55f18e700a10 msgr2=0x55f18e707b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.206+0000 7fa9ee594740 1 -- 172.21.15.82:0/3759944856 shutdown_connections 2024-03-27T07:35:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.206+0000 7fa9ee594740 1 -- 172.21.15.82:0/3759944856 wait complete. 2024-03-27T07:35:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.206+0000 7fa9ee594740 20 client.27067 trim_cache size 0 max 16384 2024-03-27T07:35:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:35:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:35:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:35:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:35:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/1517623295 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9d00a3a40 msgr2=0x7fa9d00a5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9d00a3a40 0x7fa9d00a5f00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4077cc0 tx=0x7fa9d8009560 comp rx=0 tx=0).stop 2024-03-27T07:35:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/1517623295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4069b70 msgr2=0x7fa9e4116630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4069b70 0x7fa9e4116630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000b3f0 tx=0x7fa9e000b8b0 comp rx=0 tx=0).stop 2024-03-27T07:35:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/1517623295 shutdown_connections 2024-03-27T07:35:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fa9d00a3a40 0x7fa9d00a5f00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9e4107c40 0x7fa9e41112a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e4069b70 0x7fa9e4116630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 --2- 172.21.15.82:0/1517623295 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fa9e40691d0 0x7fa9e41160f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/1517623295 >> 172.21.15.82:0/1517623295 conn(0x7fa9e40778a0 msgr2=0x7fa9e40ff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/1517623295 shutdown_connections 2024-03-27T07:35:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:16.207+0000 7fa9eb9ac640 1 -- 172.21.15.82:0/1517623295 wait complete. 2024-03-27T07:35:16.393 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:16 smithi153 podman[73317]: 2024-03-27 07:35:16.11097682 +0000 UTC m=+1.514927103 container init fd738c2b4d8108f6df9bcb5d78a6c57f9254796d74a09c93cc26b23c1713dbbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True) 2024-03-27T07:35:16.393 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:16 smithi153 podman[73317]: 2024-03-27 07:35:16.128077563 +0000 UTC m=+1.532027846 container start fd738c2b4d8108f6df9bcb5d78a6c57f9254796d74a09c93cc26b23c1713dbbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=) 2024-03-27T07:35:16.786 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[73328]: starting mds.c at 2024-03-27T07:35:16.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:16 smithi153 ceph-mon[36179]: pgmap v365: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-03-27T07:35:16.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:16 smithi153 ceph-mon[36179]: daemon mds.c restarted 2024-03-27T07:35:16.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:16 smithi082 ceph-mon[32178]: pgmap v365: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-03-27T07:35:16.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:16 smithi082 ceph-mon[32178]: daemon mds.c restarted 2024-03-27T07:35:17.003 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:16 smithi149 ceph-mon[36065]: pgmap v365: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.4 MiB/s wr, 147 op/s 2024-03-27T07:35:17.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:16 smithi149 ceph-mon[36065]: daemon mds.c restarted 2024-03-27T07:35:17.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:17 smithi082 ceph-mon[32178]: osdmap e102: 12 total, 12 up, 12 in 2024-03-27T07:35:17.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:17 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6836/1398740599,v1:172.21.15.153:6837/1398740599] up:boot 2024-03-27T07:35:17.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:17 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-03-27T07:35:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:17 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:35:17.937 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:17 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:35:18.003 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:17 smithi149 ceph-mon[36065]: osdmap e102: 12 total, 12 up, 12 in 2024-03-27T07:35:18.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:17 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6836/1398740599,v1:172.21.15.153:6837/1398740599] up:boot 2024-03-27T07:35:18.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:17 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-03-27T07:35:18.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:17 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:35:18.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:17 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:35:18.037 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:17 smithi153 bash[73317]: fd738c2b4d8108f6df9bcb5d78a6c57f9254796d74a09c93cc26b23c1713dbbf 2024-03-27T07:35:18.037 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:35:17 smithi153 systemd[1]: Started Ceph mds.c for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:35:18.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:17 smithi153 ceph-mon[36179]: osdmap e102: 12 total, 12 up, 12 in 2024-03-27T07:35:18.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:17 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6836/1398740599,v1:172.21.15.153:6837/1398740599] up:boot 2024-03-27T07:35:18.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:17 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-03-27T07:35:18.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:17 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:35:18.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:17 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:35:18.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:18 smithi082 ceph-mon[32178]: pgmap v367: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-03-27T07:35:19.003 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:18 smithi149 ceph-mon[36065]: pgmap v367: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-03-27T07:35:19.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:18 smithi153 ceph-mon[36179]: pgmap v367: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-03-27T07:35:20.786 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:20 smithi153 ceph-mon[36179]: pgmap v368: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-03-27T07:35:20.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:20 smithi082 ceph-mon[32178]: pgmap v368: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-03-27T07:35:21.003 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:20 smithi149 ceph-mon[36065]: pgmap v368: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-03-27T07:35:22.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:22 smithi082 ceph-mon[32178]: pgmap v369: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-03-27T07:35:23.003 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:22 smithi149 ceph-mon[36065]: pgmap v369: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-03-27T07:35:23.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:22 smithi153 ceph-mon[36179]: pgmap v369: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 105 op/s 2024-03-27T07:35:24.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:24 smithi082 ceph-mon[32178]: pgmap v370: 97 pgs: 19 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 42 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-03-27T07:35:25.004 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:24 smithi149 ceph-mon[36065]: pgmap v370: 97 pgs: 19 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 42 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-03-27T07:35:25.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:24 smithi153 ceph-mon[36179]: pgmap v370: 97 pgs: 19 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 42 active+clean; 1.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-03-27T07:35:26.936 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:26 smithi082 ceph-mon[32178]: pgmap v371: 97 pgs: 19 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 42 active+clean; 1.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-03-27T07:35:27.003 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:26 smithi149 ceph-mon[36065]: pgmap v371: 97 pgs: 19 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 42 active+clean; 1.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-03-27T07:35:27.037 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:26 smithi153 ceph-mon[36179]: pgmap v371: 97 pgs: 19 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 42 active+clean; 1.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-03-27T07:35:29.189 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:28 smithi082 ceph-mon[32178]: pgmap v372: 97 pgs: 16 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 49 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 119 op/s 2024-03-27T07:35:29.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:28 smithi149 ceph-mon[36065]: pgmap v372: 97 pgs: 16 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 49 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 119 op/s 2024-03-27T07:35:29.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:28 smithi153 ceph-mon[36179]: pgmap v372: 97 pgs: 16 active+clean+snaptrim, 32 active+clean+snaptrim_wait, 49 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 119 op/s 2024-03-27T07:35:29.335 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.335+0000 7fe268113640 1 -- 172.21.15.82:0/1050188164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe260101640 msgr2=0x7fe26010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:29.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.335+0000 7fe268113640 1 --2- 172.21.15.82:0/1050188164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe260101640 0x7fe26010d880 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe258009ca0 tx=0x7fe25802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.336+0000 7fe268113640 1 -- 172.21.15.82:0/1050188164 shutdown_connections 2024-03-27T07:35:29.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.336+0000 7fe268113640 1 --2- 172.21.15.82:0/1050188164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe260101640 0x7fe26010d880 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.336 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.336+0000 7fe268113640 1 --2- 172.21.15.82:0/1050188164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe260100ca0 0x7fe260101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.336+0000 7fe268113640 1 --2- 172.21.15.82:0/1050188164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2601059d0 0x7fe260105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.336+0000 7fe268113640 1 -- 172.21.15.82:0/1050188164 >> 172.21.15.82:0/1050188164 conn(0x7fe260077820 msgr2=0x7fe260077c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:29.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.336+0000 7fe268113640 1 -- 172.21.15.82:0/1050188164 shutdown_connections 2024-03-27T07:35:29.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.336+0000 7fe268113640 1 -- 172.21.15.82:0/1050188164 wait complete. 2024-03-27T07:35:29.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.337+0000 7fe268113640 1 Processor -- start 2024-03-27T07:35:29.337 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.337+0000 7fe268113640 1 -- start start 2024-03-27T07:35:29.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.337+0000 7fe268113640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe260100ca0 0x7fe260116330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.337+0000 7fe268113640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe260101640 0x7fe2601103f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.337+0000 7fe268113640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601059d0 0x7fe260110930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.337+0000 7fe268113640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe26010ef60 con 0x7fe2601059d0 2024-03-27T07:35:29.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.337+0000 7fe268113640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe26010ede0 con 0x7fe260101640 2024-03-27T07:35:29.338 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.337+0000 7fe268113640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe26010f0e0 con 0x7fe260100ca0 2024-03-27T07:35:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe2656ae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe260101640 0x7fe2601103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe2656ae640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe260101640 0x7fe2601103f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:54542/0 (socket says 172.21.15.82:54542) 2024-03-27T07:35:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe2656ae640 1 -- 172.21.15.82:0/1054411177 learned_addr learned my addr 172.21.15.82:0/1054411177 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe2666b0640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601059d0 0x7fe260110930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe265eaf640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe260100ca0 0x7fe260116330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe2656ae640 1 -- 172.21.15.82:0/1054411177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe260100ca0 msgr2=0x7fe260116330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe2656ae640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe260100ca0 0x7fe260116330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe2656ae640 1 -- 172.21.15.82:0/1054411177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601059d0 msgr2=0x7fe260110930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe2656ae640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601059d0 0x7fe260110930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.339 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe2656ae640 1 -- 172.21.15.82:0/1054411177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe260110ef0 con 0x7fe260101640 2024-03-27T07:35:29.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.338+0000 7fe265eaf640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe260100ca0 0x7fe260116330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:35:29.340 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.339+0000 7fe2656ae640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe260101640 0x7fe2601103f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe25000e9f0 tx=0x7fe25000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:29.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.341+0000 7fe256ffd640 1 -- 172.21.15.82:0/1054411177 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25000cd80 con 0x7fe260101640 2024-03-27T07:35:29.341 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.341+0000 7fe256ffd640 1 -- 172.21.15.82:0/1054411177 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe250010910 con 0x7fe260101640 2024-03-27T07:35:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.342+0000 7fe256ffd640 1 -- 172.21.15.82:0/1054411177 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250018a00 con 0x7fe260101640 2024-03-27T07:35:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.342+0000 7fe268113640 1 -- 172.21.15.82:0/1054411177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2601111e0 con 0x7fe260101640 2024-03-27T07:35:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.342+0000 7fe268113640 1 -- 172.21.15.82:0/1054411177 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2600718d0 con 0x7fe260101640 2024-03-27T07:35:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.346+0000 7fe256ffd640 1 -- 172.21.15.82:0/1054411177 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fe250018ba0 con 0x7fe260101640 2024-03-27T07:35:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.346+0000 7fe26adda740 1 Processor -- start 2024-03-27T07:35:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.346+0000 7fe26adda740 1 -- start start 2024-03-27T07:35:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.346+0000 7fe26adda740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f694d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.346+0000 7fe26adda740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f69a10 0x565023f722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.346+0000 7fe26adda740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 0x565023f74bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.346+0000 7fe26adda740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565023f2fcd0 con 0x565023f690f0 2024-03-27T07:35:29.348 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.346+0000 7fe26adda740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x565023e74950 con 0x565023f727e0 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.346+0000 7fe26adda740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565023ecce50 con 0x565023f69a10 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.346+0000 7fe2666b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2666b0640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f694d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33546/0 (socket says 172.21.15.82:33546) 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2666b0640 1 -- 172.21.15.82:0/3745261899 learned_addr learned my addr 172.21.15.82:0/3745261899 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2656ae640 1 --2- 172.21.15.82:0/3745261899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 0x565023f74bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe265eaf640 1 --2- 172.21.15.82:0/3745261899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f69a10 0x565023f722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe256ffd640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe24c0a3850 0x7fe24c0a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2666b0640 1 -- 172.21.15.82:0/3745261899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f69a10 msgr2=0x565023f722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2666b0640 1 --2- 172.21.15.82:0/3745261899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f69a10 0x565023f722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2666b0640 1 -- 172.21.15.82:0/3745261899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 msgr2=0x565023f74bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2666b0640 1 --2- 172.21.15.82:0/3745261899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 0x565023f74bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2666b0640 1 -- 172.21.15.82:0/3745261899 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565023be1210 con 0x565023f690f0 2024-03-27T07:35:29.349 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2656ae640 1 --2- 172.21.15.82:0/3745261899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 0x565023f74bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:35:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe256ffd640 1 -- 172.21.15.82:0/1054411177 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8484+0+0 (secure 0 0 0) 0x7fe2500d03c0 con 0x7fe260101640 2024-03-27T07:35:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2666b0640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe24c0a3850 0x7fe24c0a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2666b0640 1 --2- 172.21.15.82:0/3745261899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f694d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe258005e30 tx=0x7fe258032590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfa9690117d3eb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.347+0000 7fe2666b0640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe24c0a3850 0x7fe24c0a5d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe258045000 tx=0x7fe258047000 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.348+0000 7fe24bfff640 1 -- 172.21.15.82:0/3745261899 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25804f070 con 0x565023f690f0 2024-03-27T07:35:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.348+0000 7fe24bfff640 1 -- 172.21.15.82:0/3745261899 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe258032d90 con 0x565023f690f0 2024-03-27T07:35:29.350 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.348+0000 7fe24bfff640 1 -- 172.21.15.82:0/3745261899 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe258039070 con 0x565023f690f0 2024-03-27T07:35:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.348+0000 7fe26adda740 1 -- 172.21.15.82:0/3745261899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 msgr2=0x565023f694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.348+0000 7fe26adda740 1 --2- 172.21.15.82:0/3745261899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f694d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe258005e30 tx=0x7fe258032590 comp rx=0 tx=0).stop 2024-03-27T07:35:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.349+0000 7fe26adda740 1 -- 172.21.15.82:0/3745261899 shutdown_connections 2024-03-27T07:35:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.349+0000 7fe26adda740 1 --2- 172.21.15.82:0/3745261899 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 0x565023f74bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.349+0000 7fe26adda740 1 --2- 172.21.15.82:0/3745261899 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f69a10 0x565023f722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.349+0000 7fe26adda740 1 --2- 172.21.15.82:0/3745261899 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f694d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.349+0000 7fe26adda740 1 -- 172.21.15.82:0/3745261899 >> 172.21.15.82:0/3745261899 conn(0x565023f63a10 msgr2=0x565023f63df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.349+0000 7fe26adda740 1 -- 172.21.15.82:0/3745261899 shutdown_connections 2024-03-27T07:35:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.349+0000 7fe26adda740 1 -- 172.21.15.82:0/3745261899 wait complete. 2024-03-27T07:35:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.349+0000 7fe26adda740 1 -- start start 2024-03-27T07:35:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.349+0000 7fe26adda740 1 Processor -- start 2024-03-27T07:35:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe26adda740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f6f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe26adda740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f69a10 0x565023f6fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe26adda740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f727e0 0x565023f702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe26adda740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x565023ec8e00 con 0x565023f690f0 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe26adda740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x565023e75520 con 0x565023f69a10 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe26adda740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x565023e888e0 con 0x565023f727e0 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe265eaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f6f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe26adda740 10 client.0 _ll_register_callbacks cb 0x565023ec3a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe265eaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f6f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33548/0 (socket says 172.21.15.82:33548) 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe265eaf640 1 -- 172.21.15.82:0/1833595446 learned_addr learned my addr 172.21.15.82:0/1833595446 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe2656ae640 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f69a10 0x565023f6fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe2666b0640 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f727e0 0x565023f702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe265eaf640 1 -- 172.21.15.82:0/1833595446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f727e0 msgr2=0x565023f702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe265eaf640 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f727e0 0x565023f702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe265eaf640 1 -- 172.21.15.82:0/1833595446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f69a10 msgr2=0x565023f6fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe265eaf640 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f69a10 0x565023f6fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe265eaf640 1 -- 172.21.15.82:0/1833595446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565023cad620 con 0x565023f690f0 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe265eaf640 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f6f820 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0134e0 tx=0x7fe25c0139a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44889f45b900293 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.350+0000 7fe2497fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.351+0000 7fe2497fa640 1 -- 172.21.15.82:0/1833595446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c020060 con 0x565023f690f0 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.351+0000 7fe26adda740 1 -- 172.21.15.82:0/1833595446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe258032d90 con 0x565023f690f0 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.351+0000 7fe2497fa640 1 -- 172.21.15.82:0/1833595446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8484+0+0 (secure 0 0 0) 0x7fe25c0117f0 con 0x565023f690f0 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.351+0000 7fe2497fa640 1 -- 172.21.15.82:0/1833595446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe25c0119f0 con 0x565023f690f0 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.351+0000 7fe26adda740 10 client.17232 fetch_fsmap learned FSMap version 39 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.351+0000 7fe26adda740 1 -- 172.21.15.82:0/1833595446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x565023f813e0 con 0x565023f690f0 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.351+0000 7fe2497fa640 1 -- 172.21.15.82:0/1833595446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe258032d90 con 0x565023f690f0 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.351+0000 7fe2497fa640 1 -- 172.21.15.82:0/1833595446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fe25c00f040 con 0x565023f690f0 2024-03-27T07:35:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.351+0000 7fe26adda740 10 client.17232 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.352+0000 7fe26adda740 10 client.17232 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.352+0000 7fe26adda740 20 client.17232 populate_metadata read hostname 'smithi082' 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.352+0000 7fe26adda740 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565023f828f0 0x565023f84d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.352+0000 7fe26adda740 4 client.17232 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.352+0000 7fe26adda740 1 -- 172.21.15.82:0/1833595446 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565023eda390 con 0x565023f828f0 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.352+0000 7fe2656ae640 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565023f828f0 0x565023f84d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.353+0000 7fe2656ae640 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565023f828f0 0x565023f84d90 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbd7e443c63a9c1f server_cookie=14865028a9d83be9 in_seq=0 out_seq=0 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.353+0000 7fe2497fa640 10 client.17232 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.354+0000 7fe2497fa640 1 -- 172.21.15.82:0/1833595446 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x565023eda390 con 0x565023f828f0 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.354+0000 7fe2497fa640 10 client.17232 handle_command_reply: tid=0 2024-03-27T07:35:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.354+0000 7fe26adda740 1 client.17232 shutdown 2024-03-27T07:35:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.355+0000 7fe26adda740 1 -- 172.21.15.82:0/1833595446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 msgr2=0x565023f6f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.355+0000 7fe26adda740 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f6f820 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fe25c0134e0 tx=0x7fe25c0139a0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.358+0000 7fe26adda740 1 -- 172.21.15.82:0/1833595446 shutdown_connections 2024-03-27T07:35:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.358+0000 7fe26adda740 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f727e0 0x565023f702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.358+0000 7fe26adda740 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f69a10 0x565023f6fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.358+0000 7fe26adda740 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565023f828f0 0x565023f84d90 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.358+0000 7fe2497fa640 0 client.17232 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.358+0000 7fe26adda740 1 --2- 172.21.15.82:0/1833595446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f690f0 0x565023f6f820 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.358+0000 7fe26adda740 1 -- 172.21.15.82:0/1833595446 >> 172.21.15.82:0/1833595446 conn(0x565023f63a10 msgr2=0x565023f65760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.360+0000 7fe26adda740 1 -- 172.21.15.82:0/1833595446 shutdown_connections 2024-03-27T07:35:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.360+0000 7fe26adda740 1 -- 172.21.15.82:0/1833595446 wait complete. 2024-03-27T07:35:29.360 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.360+0000 7fe26adda740 20 client.17232 trim_cache size 0 max 16384 2024-03-27T07:35:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe26adda740 1 Processor -- start 2024-03-27T07:35:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe26adda740 1 -- start start 2024-03-27T07:35:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe26adda740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f690f0 0x565023f71f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe26adda740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f7de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe26adda740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 0x565023f8a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe26adda740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601c7460 con 0x565023f69a10 2024-03-27T07:35:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe26adda740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601c4c70 con 0x565023f727e0 2024-03-27T07:35:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe26adda740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601c2ae0 con 0x565023f690f0 2024-03-27T07:35:29.386 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe2656ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f7de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe2656ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f7de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33560/0 (socket says 172.21.15.82:33560) 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe2656ae640 1 -- 172.21.15.82:0/496970313 learned_addr learned my addr 172.21.15.82:0/496970313 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe265eaf640 1 --2- 172.21.15.82:0/496970313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f690f0 0x565023f71f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe2666b0640 1 --2- 172.21.15.82:0/496970313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 0x565023f8a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe2656ae640 1 -- 172.21.15.82:0/496970313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f690f0 msgr2=0x565023f71f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe2656ae640 1 --2- 172.21.15.82:0/496970313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f690f0 0x565023f71f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe2656ae640 1 -- 172.21.15.82:0/496970313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 msgr2=0x565023f8a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe2656ae640 1 --2- 172.21.15.82:0/496970313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 0x565023f8a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.384+0000 7fe2656ae640 1 -- 172.21.15.82:0/496970313 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565023f74f40 con 0x565023f69a10 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.385+0000 7fe2656ae640 1 --2- 172.21.15.82:0/496970313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f7de50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe250018490 tx=0x7fe2500d28d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47c3b66be51a719 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:29.387 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.385+0000 7fe24b7fe640 1 -- 172.21.15.82:0/496970313 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25009cc70 con 0x565023f69a10 2024-03-27T07:35:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.385+0000 7fe24b7fe640 1 -- 172.21.15.82:0/496970313 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe25009c570 con 0x565023f69a10 2024-03-27T07:35:29.388 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.385+0000 7fe24b7fe640 1 -- 172.21.15.82:0/496970313 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25009c7d0 con 0x565023f69a10 2024-03-27T07:35:29.391 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 -- 172.21.15.82:0/496970313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 msgr2=0x565023f7de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 --2- 172.21.15.82:0/496970313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f7de50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fe250018490 tx=0x7fe2500d28d0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 -- 172.21.15.82:0/496970313 shutdown_connections 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 --2- 172.21.15.82:0/496970313 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f7de50 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 --2- 172.21.15.82:0/496970313 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f727e0 0x565023f8a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 --2- 172.21.15.82:0/496970313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f690f0 0x565023f71f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 -- 172.21.15.82:0/496970313 >> 172.21.15.82:0/496970313 conn(0x565023f63a10 msgr2=0x565023f64df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 -- 172.21.15.82:0/496970313 shutdown_connections 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 -- 172.21.15.82:0/496970313 wait complete. 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 -- start start 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.386+0000 7fe26adda740 1 Processor -- start 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe26adda740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f690f0 0x565023f6cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.392 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe26adda740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f6d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe265eaf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f690f0 0x565023f6cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe265eaf640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f690f0 0x565023f6cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:54584/0 (socket says 172.21.15.82:54584) 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe2656ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f6d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe2656ae640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f6d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33564/0 (socket says 172.21.15.82:33564) 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe26adda740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f727e0 0x565023fe7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe265eaf640 1 -- 172.21.15.82:0/4170627097 learned_addr learned my addr 172.21.15.82:0/4170627097 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601c3130 con 0x565023f69a10 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601c45a0 con 0x565023f690f0 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe2601c3800 con 0x565023f727e0 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe2666b0640 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f727e0 0x565023fe7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.393 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.387+0000 7fe26adda740 10 client.0 _ll_register_callbacks cb 0x7fe25c005a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:35:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.388+0000 7fe2656ae640 1 -- 172.21.15.82:0/4170627097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f727e0 msgr2=0x565023fe7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.388+0000 7fe2656ae640 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f727e0 0x565023fe7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.388+0000 7fe2656ae640 1 -- 172.21.15.82:0/4170627097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f690f0 msgr2=0x565023f6cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.388+0000 7fe2656ae640 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f690f0 0x565023f6cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.388+0000 7fe2656ae640 1 -- 172.21.15.82:0/4170627097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565023fe81d0 con 0x565023f69a10 2024-03-27T07:35:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.388+0000 7fe2656ae640 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f6d060 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x565023f7e490 tx=0x7fe2500d3f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bae60e39bfec715 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.388+0000 7fe2497fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:35:29.394 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.388+0000 7fe2497fa640 1 -- 172.21.15.82:0/4170627097 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2500b9020 con 0x565023f69a10 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.388+0000 7fe2497fa640 1 -- 172.21.15.82:0/4170627097 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8484+0+0 (secure 0 0 0) 0x7fe2500cddb0 con 0x565023f69a10 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.388+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe25009c570 con 0x565023f69a10 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe2497fa640 1 -- 172.21.15.82:0/4170627097 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe2500a0920 con 0x565023f69a10 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe26adda740 10 client.17238 fetch_fsmap learned FSMap version 39 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x565023fe94f0 con 0x565023f69a10 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe2497fa640 1 -- 172.21.15.82:0/4170627097 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe25009c570 con 0x565023f69a10 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe2497fa640 1 -- 172.21.15.82:0/4170627097 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fe2500ac020 con 0x565023f69a10 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe26adda740 10 client.17238 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe26adda740 10 client.17238 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe26adda740 20 client.17238 populate_metadata read hostname 'smithi082' 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe26adda740 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565023f828f0 0x565023febcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe26adda740 4 client.17238 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:35:29.395 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.389+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565023ed46e0 con 0x565023f828f0 2024-03-27T07:35:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.390+0000 7fe265eaf640 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565023f828f0 0x565023febcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.390+0000 7fe265eaf640 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565023f828f0 0x565023febcb0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98d114e52a23e323 server_cookie=6086ae9ad249336a in_seq=0 out_seq=0 2024-03-27T07:35:29.396 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.390+0000 7fe2497fa640 10 client.17238 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.456+0000 7fe2497fa640 1 -- 172.21.15.82:0/4170627097 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565023ed46e0 con 0x565023f828f0 2024-03-27T07:35:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.456+0000 7fe2497fa640 10 client.17238 handle_command_reply: tid=0 2024-03-27T07:35:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.456+0000 7fe26adda740 1 client.17238 shutdown 2024-03-27T07:35:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.457+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 msgr2=0x565023f6d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:29.457 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.457+0000 7fe26adda740 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f6d060 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x565023f7e490 tx=0x7fe2500d3f10 comp rx=0 tx=0).stop 2024-03-27T07:35:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.457+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 shutdown_connections 2024-03-27T07:35:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.457+0000 7fe26adda740 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x565023f828f0 0x565023febcb0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.457+0000 7fe26adda740 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x565023f69a10 0x565023f6d060 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.458 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.457+0000 7fe2497fa640 0 client.17238 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:29.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.457+0000 7fe26adda740 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x565023f727e0 0x565023fe7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.457+0000 7fe26adda740 1 --2- 172.21.15.82:0/4170627097 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x565023f690f0 0x565023f6cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.457+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 >> 172.21.15.82:0/4170627097 conn(0x565023f63a10 msgr2=0x565023f70050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:29.459 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.459+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 shutdown_connections 2024-03-27T07:35:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.459+0000 7fe26adda740 1 -- 172.21.15.82:0/4170627097 wait complete. 2024-03-27T07:35:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.459+0000 7fe26adda740 20 client.17238 trim_cache size 0 max 16384 2024-03-27T07:35:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:35:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:35:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:35:29.460 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:35:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 -- 172.21.15.82:0/1054411177 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe24c0a3850 msgr2=0x7fe24c0a5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe24c0a3850 0x7fe24c0a5d10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe258045000 tx=0x7fe258047000 comp rx=0 tx=0).stop 2024-03-27T07:35:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 -- 172.21.15.82:0/1054411177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe260101640 msgr2=0x7fe2601103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe260101640 0x7fe2601103f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe25000e9f0 tx=0x7fe25000eeb0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 -- 172.21.15.82:0/1054411177 shutdown_connections 2024-03-27T07:35:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe24c0a3850 0x7fe24c0a5d10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe2601059d0 0x7fe260110930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe260101640 0x7fe2601103f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.461 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 --2- 172.21.15.82:0/1054411177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe260100ca0 0x7fe260116330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 -- 172.21.15.82:0/1054411177 >> 172.21.15.82:0/1054411177 conn(0x7fe260077820 msgr2=0x7fe2600fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 -- 172.21.15.82:0/1054411177 shutdown_connections 2024-03-27T07:35:29.462 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:29.460+0000 7fe268113640 1 -- 172.21.15.82:0/1054411177 wait complete. 2024-03-27T07:35:31.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:30 smithi082 ceph-mon[32178]: pgmap v373: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 1013 KiB/s wr, 104 op/s 2024-03-27T07:35:31.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:30 smithi149 ceph-mon[36065]: pgmap v373: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 1013 KiB/s wr, 104 op/s 2024-03-27T07:35:31.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:30 smithi153 ceph-mon[36179]: pgmap v373: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 905 KiB/s rd, 1013 KiB/s wr, 104 op/s 2024-03-27T07:35:33.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:32 smithi082 ceph-mon[32178]: pgmap v374: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 960 KiB/s wr, 85 op/s 2024-03-27T07:35:33.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:32 smithi149 ceph-mon[36065]: pgmap v374: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 960 KiB/s wr, 85 op/s 2024-03-27T07:35:33.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:32 smithi153 ceph-mon[36179]: pgmap v374: 97 pgs: 14 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 57 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 960 KiB/s wr, 85 op/s 2024-03-27T07:35:35.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:34 smithi082 ceph-mon[32178]: pgmap v375: 97 pgs: 8 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 66 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 148 op/s 2024-03-27T07:35:35.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:34 smithi149 ceph-mon[36065]: pgmap v375: 97 pgs: 8 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 66 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 148 op/s 2024-03-27T07:35:35.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:34 smithi153 ceph-mon[36179]: pgmap v375: 97 pgs: 8 active+clean+snaptrim, 23 active+clean+snaptrim_wait, 66 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 148 op/s 2024-03-27T07:35:37.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:36 smithi082 ceph-mon[32178]: pgmap v376: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-03-27T07:35:37.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:36 smithi149 ceph-mon[36065]: pgmap v376: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-03-27T07:35:37.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:36 smithi153 ceph-mon[36179]: pgmap v376: 97 pgs: 6 active+clean+snaptrim, 11 active+clean+snaptrim_wait, 80 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 135 op/s 2024-03-27T07:35:39.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:38 smithi082 ceph-mon[32178]: pgmap v377: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 182 op/s 2024-03-27T07:35:39.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:38 smithi149 ceph-mon[36065]: pgmap v377: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 182 op/s 2024-03-27T07:35:39.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:38 smithi153 ceph-mon[36179]: pgmap v377: 97 pgs: 2 active+clean+snaptrim, 95 active+clean; 1.9 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 182 op/s 2024-03-27T07:35:41.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:40 smithi082 ceph-mon[32178]: pgmap v378: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 192 op/s 2024-03-27T07:35:41.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:40 smithi149 ceph-mon[36065]: pgmap v378: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 192 op/s 2024-03-27T07:35:41.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:40 smithi153 ceph-mon[36179]: pgmap v378: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 192 op/s 2024-03-27T07:35:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.552+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/2720483638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1c0101660 msgr2=0x7ff1c010d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.552+0000 7ff1c4fbd640 1 --2- 172.21.15.82:0/2720483638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1c0101660 0x7ff1c010d880 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009ca0 tx=0x7ff1b802c0f0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.552+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/2720483638 shutdown_connections 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.552+0000 7ff1c4fbd640 1 --2- 172.21.15.82:0/2720483638 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1c0101660 0x7ff1c010d880 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.552+0000 7ff1c4fbd640 1 --2- 172.21.15.82:0/2720483638 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1c0100ca0 0x7ff1c0101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.552+0000 7ff1c4fbd640 1 --2- 172.21.15.82:0/2720483638 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c01059f0 0x7ff1c0105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.552+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/2720483638 >> 172.21.15.82:0/2720483638 conn(0x7ff1c00778a0 msgr2=0x7ff1c0077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.552+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/2720483638 shutdown_connections 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.552+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/2720483638 wait complete. 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1c4fbd640 1 Processor -- start 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1c4fbd640 1 -- start start 2024-03-27T07:35:42.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1c4fbd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0100ca0 0x7ff1c01991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1c4fbd640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1c0101660 0x7ff1c0199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1c4fbd640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1c01059f0 0x7ff1c01a4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1c4fbd640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0110ed0 con 0x7ff1c0101660 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1c4fbd640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0110d50 con 0x7ff1c01059f0 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1c4fbd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1c0111050 con 0x7ff1c0100ca0 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bdd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1c0101660 0x7ff1c0199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1be59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0100ca0 0x7ff1c01991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bed9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1c01059f0 0x7ff1c01a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bdd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1c0101660 0x7ff1c0199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51192/0 (socket says 172.21.15.82:51192) 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bdd9b640 1 -- 172.21.15.82:0/1037720601 learned_addr learned my addr 172.21.15.82:0/1037720601 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bed9d640 1 -- 172.21.15.82:0/1037720601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0100ca0 msgr2=0x7ff1c01991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:42.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bed9d640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0100ca0 0x7ff1c01991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bed9d640 1 -- 172.21.15.82:0/1037720601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1c0101660 msgr2=0x7ff1c0199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bed9d640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1c0101660 0x7ff1c0199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bed9d640 1 -- 172.21.15.82:0/1037720601 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c01a4790 con 0x7ff1c01059f0 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1c0101660 0x7ff1c0199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1be59c640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0100ca0 0x7ff1c01991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.553+0000 7ff1bed9d640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1c01059f0 0x7ff1c01a4250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff1b802c700 tx=0x7ff1b8032f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.554+0000 7ff1af7fe640 1 -- 172.21.15.82:0/1037720601 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8042020 con 0x7ff1c01059f0 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.554+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/1037720601 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c01a4960 con 0x7ff1c01059f0 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.554+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/1037720601 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1c01a4e20 con 0x7ff1c01059f0 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.554+0000 7ff1af7fe640 1 -- 172.21.15.82:0/1037720601 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b8034640 con 0x7ff1c01059f0 2024-03-27T07:35:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.554+0000 7ff1af7fe640 1 -- 172.21.15.82:0/1037720601 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8039040 con 0x7ff1c01059f0 2024-03-27T07:35:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1c7b9d740 1 Processor -- start 2024-03-27T07:35:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1af7fe640 1 -- 172.21.15.82:0/1037720601 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7ff1b8045020 con 0x7ff1c01059f0 2024-03-27T07:35:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1c7b9d740 1 -- start start 2024-03-27T07:35:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c6230f0 0x56131c6234d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c62c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c62c7e0 0x56131c62ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56131c5e9cd0 con 0x56131c623a10 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56131c52e950 con 0x56131c62c7e0 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56131c586e50 con 0x56131c6230f0 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1be59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c62c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1be59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c62c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51208/0 (socket says 172.21.15.82:51208) 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1be59c640 1 -- 172.21.15.82:0/2267745510 learned_addr learned my addr 172.21.15.82:0/2267745510 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/2267745510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c6230f0 0x56131c6234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1af7fe640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff1a80a3820 0x7ff1a80a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/2267745510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c62c7e0 0x56131c62ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1bed9d640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff1a80a3820 0x7ff1a80a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1be59c640 1 -- 172.21.15.82:0/2267745510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c6230f0 msgr2=0x56131c6234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1be59c640 1 --2- 172.21.15.82:0/2267745510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c6230f0 0x56131c6234d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.566 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1be59c640 1 -- 172.21.15.82:0/2267745510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c62c7e0 msgr2=0x56131c62ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.557+0000 7ff1be59c640 1 --2- 172.21.15.82:0/2267745510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c62c7e0 0x56131c62ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.558+0000 7ff1be59c640 1 -- 172.21.15.82:0/2267745510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56131c29b210 con 0x56131c623a10 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.558+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/2267745510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c6230f0 0x56131c6234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.558+0000 7ff1af7fe640 1 -- 172.21.15.82:0/1037720601 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 8484+0+0 (secure 0 0 0) 0x7ff1b80f17a0 con 0x7ff1c01059f0 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.558+0000 7ff1be59c640 1 --2- 172.21.15.82:0/2267745510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c62c2a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00114f0 tx=0x7ff1b00119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d026e0258ff36157 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.558+0000 7ff1bed9d640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff1a80a3820 0x7ff1a80a5ce0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80b9f70 tx=0x7ff1b80098c0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.558+0000 7ff1acff9640 1 -- 172.21.15.82:0/2267745510 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b001e070 con 0x56131c623a10 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.558+0000 7ff1acff9640 1 -- 172.21.15.82:0/2267745510 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b0011250 con 0x56131c623a10 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.558+0000 7ff1acff9640 1 -- 172.21.15.82:0/2267745510 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0019990 con 0x56131c623a10 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/2267745510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 msgr2=0x56131c62c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/2267745510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c62c2a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00114f0 tx=0x7ff1b00119b0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.567 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/2267745510 shutdown_connections 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/2267745510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c62c2a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/2267745510 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c62c7e0 0x56131c62ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/2267745510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c6230f0 0x56131c6234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/2267745510 >> 172.21.15.82:0/2267745510 conn(0x56131c61da10 msgr2=0x56131c61ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/2267745510 shutdown_connections 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/2267745510 wait complete. 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 -- start start 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 Processor -- start 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c6230f0 0x56131c6297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c623a10 0x56131c629cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c62c7e0 0x56131c62a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.568 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56131c582e00 con 0x56131c6230f0 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56131c52f520 con 0x56131c62c7e0 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.559+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56131c5428e0 con 0x56131c623a10 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1c7b9d740 10 client.0 _ll_register_callbacks cb 0x56131c57da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1bdd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c6230f0 0x56131c6297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1bdd9b640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c6230f0 0x56131c6297b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51218/0 (socket says 172.21.15.82:51218) 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1bdd9b640 1 -- 172.21.15.82:0/442935711 learned_addr learned my addr 172.21.15.82:0/442935711 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1be59c640 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c623a10 0x56131c629cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c62c7e0 0x56131c62a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1bdd9b640 1 -- 172.21.15.82:0/442935711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c623a10 msgr2=0x56131c629cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c623a10 0x56131c629cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1bdd9b640 1 -- 172.21.15.82:0/442935711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c62c7e0 msgr2=0x56131c62a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c62c7e0 0x56131c62a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.569 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1bdd9b640 1 -- 172.21.15.82:0/442935711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56131c367620 con 0x56131c6230f0 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c6230f0 0x56131c6297b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4004590 tx=0x7ff1b4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a1779962e22ec3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/442935711 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4005020 con 0x56131c6230f0 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/442935711 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8484+0+0 (secure 0 0 0) 0x7ff1b40051c0 con 0x56131c6230f0 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/442935711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b0011250 con 0x56131c6230f0 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/442935711 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff1b40053c0 con 0x56131c6230f0 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1c7b9d740 10 client.17250 fetch_fsmap learned FSMap version 39 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/442935711 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56131c63b410 con 0x56131c6230f0 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.560+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/442935711 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b0011250 con 0x56131c6230f0 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.561+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/442935711 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7ff1b4021550 con 0x56131c6230f0 2024-03-27T07:35:42.570 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.561+0000 7ff1c7b9d740 10 client.17250 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.561+0000 7ff1c7b9d740 10 client.17250 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.561+0000 7ff1c7b9d740 20 client.17250 populate_metadata read hostname 'smithi082' 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.561+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56131c63c970 0x56131c63edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.561+0000 7ff1c7b9d740 4 client.17250 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.561+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/442935711 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56131c594390 con 0x56131c63c970 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.561+0000 7ff1be59c640 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56131c63c970 0x56131c63edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.561+0000 7ff1be59c640 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56131c63c970 0x56131c63edf0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dd5f8d2fe304306 server_cookie=5eb0f16c6ab1b697 in_seq=0 out_seq=0 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.561+0000 7ff1a5ffb640 10 client.17250 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/442935711 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56131c594390 con 0x56131c63c970 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1a5ffb640 10 client.17250 handle_command_reply: tid=0 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 client.17250 shutdown 2024-03-27T07:35:42.571 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/442935711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c6230f0 msgr2=0x56131c6297b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c6230f0 0x56131c6297b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4004590 tx=0x7ff1b4005f90 comp rx=0 tx=0).stop 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/442935711 shutdown_connections 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c62c7e0 0x56131c62a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c623a10 0x56131c629cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56131c63c970 0x56131c63edf0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/442935711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c6230f0 0x56131c6297b0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1a5ffb640 0 client.17250 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/442935711 >> 172.21.15.82:0/442935711 conn(0x56131c61da10 msgr2=0x56131c61f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/442935711 shutdown_connections 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/442935711 wait complete. 2024-03-27T07:35:42.572 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.562+0000 7ff1c7b9d740 20 client.17250 trim_cache size 0 max 16384 2024-03-27T07:35:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1c7b9d740 1 Processor -- start 2024-03-27T07:35:42.582 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1c7b9d740 1 -- start start 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c6230f0 0x56131c62bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c637f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 0x56131c6446c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a0011060 con 0x56131c623a10 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a000e870 con 0x56131c6230f0 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a000c6c0 con 0x56131c62c7e0 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1be59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c637f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1be59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c637f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51222/0 (socket says 172.21.15.82:51222) 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1bdd9b640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c6230f0 0x56131c62bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1be59c640 1 -- 172.21.15.82:0/3226300546 learned_addr learned my addr 172.21.15.82:0/3226300546 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:42.583 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/3226300546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 0x56131c6446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1be59c640 1 -- 172.21.15.82:0/3226300546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 msgr2=0x56131c6446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1be59c640 1 --2- 172.21.15.82:0/3226300546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 0x56131c6446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1be59c640 1 -- 172.21.15.82:0/3226300546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c6230f0 msgr2=0x56131c62bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1be59c640 1 --2- 172.21.15.82:0/3226300546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c6230f0 0x56131c62bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1be59c640 1 -- 172.21.15.82:0/3226300546 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56131c627d60 con 0x56131c623a10 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.577+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/3226300546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 0x56131c6446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1be59c640 1 --2- 172.21.15.82:0/3226300546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c637f10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0011eb0 tx=0x7ff1b0019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7367e64f86e813f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1a7fff640 1 -- 172.21.15.82:0/3226300546 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0030070 con 0x56131c623a10 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1a7fff640 1 -- 172.21.15.82:0/3226300546 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b002a030 con 0x56131c623a10 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1a7fff640 1 -- 172.21.15.82:0/3226300546 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b001e040 con 0x56131c623a10 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/3226300546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 msgr2=0x56131c637f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/3226300546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c637f10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0011eb0 tx=0x7ff1b0019570 comp rx=0 tx=0).stop 2024-03-27T07:35:42.584 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/3226300546 shutdown_connections 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/3226300546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c637f10 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/3226300546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 0x56131c6446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/3226300546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c6230f0 0x56131c62bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.578+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/3226300546 >> 172.21.15.82:0/3226300546 conn(0x56131c61da10 msgr2=0x56131c61ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/3226300546 shutdown_connections 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/3226300546 wait complete. 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 1 -- start start 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 1 Processor -- start 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c6230f0 0x56131c626650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c626b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.585 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 0x56131c6270d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a000cd30 con 0x56131c623a10 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a000e1a0 con 0x56131c6230f0 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a000d400 con 0x56131c62c7e0 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1c7b9d740 10 client.0 _ll_register_callbacks cb 0x7ff1b40115b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1be59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c626b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1be59c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c626b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51238/0 (socket says 172.21.15.82:51238) 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1be59c640 1 -- 172.21.15.82:0/4914301 learned_addr learned my addr 172.21.15.82:0/4914301 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 0x56131c6270d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c6230f0 0x56131c626650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1be59c640 1 -- 172.21.15.82:0/4914301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 msgr2=0x56131c6270d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:42.586 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1be59c640 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 0x56131c6270d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1be59c640 1 -- 172.21.15.82:0/4914301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c6230f0 msgr2=0x56131c626650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1be59c640 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c6230f0 0x56131c626650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1be59c640 1 -- 172.21.15.82:0/4914301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56131c6a1f90 con 0x56131c623a10 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.579+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 0x56131c6270d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1be59c640 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c626b90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0009e20 tx=0x7ff1b00194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2a7cd36228ae2e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/4914301 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b001e070 con 0x56131c623a10 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/4914301 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 8484+0+0 (secure 0 0 0) 0x7ff1b002b740 con 0x56131c623a10 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/4914301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b002a030 con 0x56131c623a10 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/4914301 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff1b0030040 con 0x56131c623a10 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1c7b9d740 10 client.17256 fetch_fsmap learned FSMap version 39 2024-03-27T07:35:42.587 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/4914301 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56131c6a32a0 con 0x56131c623a10 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/4914301 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1b002a030 con 0x56131c623a10 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/4914301 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7ff1b0019980 con 0x56131c623a10 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1c7b9d740 10 client.17256 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1c7b9d740 10 client.17256 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1c7b9d740 20 client.17256 populate_metadata read hostname 'smithi082' 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56131c6a37c0 0x56131c6a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1c7b9d740 4 client.17256 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/4914301 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56131c58e6e0 con 0x56131c6a37c0 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.580+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56131c6a37c0 0x56131c6a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.581+0000 7ff1a5ffb640 10 client.17256 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:42.588 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.581+0000 7ff1bdd9b640 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56131c6a37c0 0x56131c6a5be0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcefd02a94dba08c server_cookie=33bcfa9428dae326 in_seq=0 out_seq=0 2024-03-27T07:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1a5ffb640 1 -- 172.21.15.82:0/4914301 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56131c58e6e0 con 0x56131c6a37c0 2024-03-27T07:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1a5ffb640 10 client.17256 handle_command_reply: tid=0 2024-03-27T07:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1c7b9d740 1 client.17256 shutdown 2024-03-27T07:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/4914301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 msgr2=0x56131c626b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c626b90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0009e20 tx=0x7ff1b00194a0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/4914301 shutdown_connections 2024-03-27T07:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56131c6a37c0 0x56131c6a5be0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56131c623a10 0x56131c626b90 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.590 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56131c62c7e0 0x56131c6270d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1a5ffb640 0 client.17256 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.588+0000 7ff1c7b9d740 1 --2- 172.21.15.82:0/4914301 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56131c6230f0 0x56131c626650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/4914301 >> 172.21.15.82:0/4914301 conn(0x56131c61da10 msgr2=0x56131c629770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/4914301 shutdown_connections 2024-03-27T07:35:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c7b9d740 1 -- 172.21.15.82:0/4914301 wait complete. 2024-03-27T07:35:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c7b9d740 20 client.17256 trim_cache size 0 max 16384 2024-03-27T07:35:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:35:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:35:42.591 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:35:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:35:42.592 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/1037720601 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff1a80a3820 msgr2=0x7ff1a80a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff1a80a3820 0x7ff1a80a5ce0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80b9f70 tx=0x7ff1b80098c0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/1037720601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1c01059f0 msgr2=0x7ff1c01a4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1c01059f0 0x7ff1c01a4250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff1b802c700 tx=0x7ff1b8032f20 comp rx=0 tx=0).stop 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/1037720601 shutdown_connections 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff1a80a3820 0x7ff1a80a5ce0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1c0101660 0x7ff1c0199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff1c01059f0 0x7ff1c01a4250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 --2- 172.21.15.82:0/1037720601 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1c0100ca0 0x7ff1c01991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/1037720601 >> 172.21.15.82:0/1037720601 conn(0x7ff1c00778a0 msgr2=0x7ff1c00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/1037720601 shutdown_connections 2024-03-27T07:35:42.593 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:42.589+0000 7ff1c4fbd640 1 -- 172.21.15.82:0/1037720601 wait complete. 2024-03-27T07:35:43.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:42 smithi082 ceph-mon[32178]: pgmap v379: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 176 op/s 2024-03-27T07:35:43.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:42 smithi082 ceph-mon[32178]: osdmap e103: 12 total, 12 up, 12 in 2024-03-27T07:35:43.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:42 smithi149 ceph-mon[36065]: pgmap v379: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 176 op/s 2024-03-27T07:35:43.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:42 smithi149 ceph-mon[36065]: osdmap e103: 12 total, 12 up, 12 in 2024-03-27T07:35:43.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:42 smithi153 ceph-mon[36179]: pgmap v379: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 176 op/s 2024-03-27T07:35:43.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:42 smithi153 ceph-mon[36179]: osdmap e103: 12 total, 12 up, 12 in 2024-03-27T07:35:45.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:44 smithi082 ceph-mon[32178]: pgmap v381: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 235 op/s 2024-03-27T07:35:45.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:44 smithi149 ceph-mon[36065]: pgmap v381: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 235 op/s 2024-03-27T07:35:45.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:44 smithi153 ceph-mon[36179]: pgmap v381: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.7 MiB/s wr, 235 op/s 2024-03-27T07:35:47.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:46 smithi082 ceph-mon[32178]: pgmap v382: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 241 op/s 2024-03-27T07:35:47.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:46 smithi149 ceph-mon[36065]: pgmap v382: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 241 op/s 2024-03-27T07:35:47.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:46 smithi153 ceph-mon[36179]: pgmap v382: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.4 MiB/s wr, 241 op/s 2024-03-27T07:35:49.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:48 smithi082 ceph-mon[32178]: pgmap v383: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 256 op/s 2024-03-27T07:35:49.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:48 smithi149 ceph-mon[36065]: pgmap v383: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 256 op/s 2024-03-27T07:35:49.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:48 smithi153 ceph-mon[36179]: pgmap v383: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 256 op/s 2024-03-27T07:35:51.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:50 smithi082 ceph-mon[32178]: pgmap v384: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2024-03-27T07:35:51.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:50 smithi149 ceph-mon[36065]: pgmap v384: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2024-03-27T07:35:51.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:50 smithi153 ceph-mon[36179]: pgmap v384: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2024-03-27T07:35:53.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:52 smithi082 ceph-mon[32178]: pgmap v385: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2024-03-27T07:35:53.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:52 smithi149 ceph-mon[36065]: pgmap v385: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2024-03-27T07:35:53.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:52 smithi153 ceph-mon[36179]: pgmap v385: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2024-03-27T07:35:55.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:54 smithi082 ceph-mon[32178]: pgmap v386: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 261 op/s 2024-03-27T07:35:55.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:54 smithi149 ceph-mon[36065]: pgmap v386: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 261 op/s 2024-03-27T07:35:55.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:54 smithi153 ceph-mon[36179]: pgmap v386: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.0 MiB/s wr, 261 op/s 2024-03-27T07:35:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.699+0000 7f6137088640 1 -- 172.21.15.82:0/914710151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6130069b70 msgr2=0x7f613010e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.699+0000 7f6137088640 1 --2- 172.21.15.82:0/914710151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6130069b70 0x7f613010e9e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f6128009ca0 tx=0x7f612802c180 comp rx=0 tx=0).stop 2024-03-27T07:35:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.699+0000 7f6137088640 1 -- 172.21.15.82:0/914710151 shutdown_connections 2024-03-27T07:35:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.699+0000 7f6137088640 1 --2- 172.21.15.82:0/914710151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6130069b70 0x7f613010e9e0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.699+0000 7f6137088640 1 --2- 172.21.15.82:0/914710151 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300691d0 0x7f6130069630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.699+0000 7f6137088640 1 --2- 172.21.15.82:0/914710151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6130107c40 0x7f6130108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.699+0000 7f6137088640 1 -- 172.21.15.82:0/914710151 >> 172.21.15.82:0/914710151 conn(0x7f61300778a0 msgr2=0x7f6130077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.699+0000 7f6137088640 1 -- 172.21.15.82:0/914710151 shutdown_connections 2024-03-27T07:35:55.700 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.699+0000 7f6137088640 1 -- 172.21.15.82:0/914710151 wait complete. 2024-03-27T07:35:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.700+0000 7f6137088640 1 Processor -- start 2024-03-27T07:35:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.700+0000 7f6137088640 1 -- start start 2024-03-27T07:35:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.700+0000 7f6137088640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300691d0 0x7f613010dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.700+0000 7f6137088640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6130069b70 0x7f613010e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.700+0000 7f6137088640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6130107c40 0x7f613019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.700+0000 7f6137088640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6130111f00 con 0x7f6130107c40 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.700+0000 7f6137088640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f6130111d80 con 0x7f61300691d0 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.700+0000 7f6137088640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6130112080 con 0x7f6130069b70 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.701+0000 7f6134e24640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300691d0 0x7f613010dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.701+0000 7f6134e24640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300691d0 0x7f613010dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:51136/0 (socket says 172.21.15.82:51136) 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.701+0000 7f6134e24640 1 -- 172.21.15.82:0/3925150352 learned_addr learned my addr 172.21.15.82:0/3925150352 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.702+0000 7f6135625640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6130107c40 0x7f613019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.702+0000 7f6135625640 1 -- 172.21.15.82:0/3925150352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6130069b70 msgr2=0x7f613010e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.702+0000 7f6135625640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6130069b70 0x7f613010e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.702+0000 7f6135625640 1 -- 172.21.15.82:0/3925150352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300691d0 msgr2=0x7f613010dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.702+0000 7f6135625640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300691d0 0x7f613010dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.702+0000 7f6135625640 1 -- 172.21.15.82:0/3925150352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613019b0d0 con 0x7f6130107c40 2024-03-27T07:35:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.702+0000 7f6135625640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6130107c40 0x7f613019a9a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6128009bf0 tx=0x7f6128035d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.703+0000 7f612dffb640 1 -- 172.21.15.82:0/3925150352 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128039040 con 0x7f6130107c40 2024-03-27T07:35:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.703+0000 7f612dffb640 1 -- 172.21.15.82:0/3925150352 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6128044070 con 0x7f6130107c40 2024-03-27T07:35:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.703+0000 7f612dffb640 1 -- 172.21.15.82:0/3925150352 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61280328d0 con 0x7f6130107c40 2024-03-27T07:35:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.703+0000 7f6137088640 1 -- 172.21.15.82:0/3925150352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613019b360 con 0x7f6130107c40 2024-03-27T07:35:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.703+0000 7f6137088640 1 -- 172.21.15.82:0/3925150352 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61301978d0 con 0x7f6130107c40 2024-03-27T07:35:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.706+0000 7f612dffb640 1 -- 172.21.15.82:0/3925150352 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f6128032a70 con 0x7f6130107c40 2024-03-27T07:35:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.706+0000 7f612dffb640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61200a3980 0x7f61200a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.706+0000 7f6139c7c740 1 Processor -- start 2024-03-27T07:35:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6139c7c740 1 -- start start 2024-03-27T07:35:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f612dffb640 1 -- 172.21.15.82:0/3925150352 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8484+0+0 (secure 0 0 0) 0x7f61280f21a0 con 0x7f6130107c40 2024-03-27T07:35:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6134e24640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61200a3980 0x7f61200a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ff2a10 0x556e60ffb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ffb7e0 0x556e60ffdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6139c7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556e60fb8cd0 con 0x556e60ff20f0 2024-03-27T07:35:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6139c7c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556e60efd950 con 0x556e60ffb7e0 2024-03-27T07:35:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6139c7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556e60f55e50 con 0x556e60ff2a10 2024-03-27T07:35:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6134e24640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6135625640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ffb7e0 0x556e60ffdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6134e24640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48570/0 (socket says 172.21.15.82:48570) 2024-03-27T07:35:55.710 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6134e24640 1 -- 172.21.15.82:0/73783355 learned_addr learned my addr 172.21.15.82:0/73783355 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f612ffff640 1 --2- 172.21.15.82:0/73783355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ff2a10 0x556e60ffb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6134e24640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61200a3980 0x7f61200a5e40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6124013510 tx=0x7f6124013910 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6135625640 1 -- 172.21.15.82:0/73783355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ff2a10 msgr2=0x556e60ffb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.707+0000 7f6135625640 1 --2- 172.21.15.82:0/73783355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ff2a10 0x556e60ffb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.708+0000 7f6135625640 1 -- 172.21.15.82:0/73783355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 msgr2=0x556e60ff24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:55.711 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.708+0000 7f6135625640 1 --2- 172.21.15.82:0/73783355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.708+0000 7f6135625640 1 -- 172.21.15.82:0/73783355 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e60c6a210 con 0x556e60ffb7e0 2024-03-27T07:35:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.708+0000 7f6134e24640 1 --2- 172.21.15.82:0/73783355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:35:55.712 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.708+0000 7f6135625640 1 --2- 172.21.15.82:0/73783355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ffb7e0 0x556e60ffdbd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f61280efa20 tx=0x7f6128004990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb6c75a72d928cf4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.710+0000 7f611affd640 1 -- 172.21.15.82:0/73783355 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612803ece0 con 0x556e60ffb7e0 2024-03-27T07:35:55.717 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.710+0000 7f611affd640 1 -- 172.21.15.82:0/73783355 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61280beac0 con 0x556e60ffb7e0 2024-03-27T07:35:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.710+0000 7f611affd640 1 -- 172.21.15.82:0/73783355 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128003d70 con 0x556e60ffb7e0 2024-03-27T07:35:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.710+0000 7f6139c7c740 1 -- 172.21.15.82:0/73783355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ffb7e0 msgr2=0x556e60ffdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.710+0000 7f6139c7c740 1 --2- 172.21.15.82:0/73783355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ffb7e0 0x556e60ffdbd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f61280efa20 tx=0x7f6128004990 comp rx=0 tx=0).stop 2024-03-27T07:35:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.711+0000 7f6139c7c740 1 -- 172.21.15.82:0/73783355 shutdown_connections 2024-03-27T07:35:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.711+0000 7f6139c7c740 1 --2- 172.21.15.82:0/73783355 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ffb7e0 0x556e60ffdbd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.711+0000 7f6139c7c740 1 --2- 172.21.15.82:0/73783355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ff2a10 0x556e60ffb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.711+0000 7f6139c7c740 1 --2- 172.21.15.82:0/73783355 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.718 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.711+0000 7f6139c7c740 1 -- 172.21.15.82:0/73783355 >> 172.21.15.82:0/73783355 conn(0x556e60feca10 msgr2=0x556e60fecdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.711+0000 7f6139c7c740 1 -- 172.21.15.82:0/73783355 shutdown_connections 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.711+0000 7f6139c7c740 1 -- 172.21.15.82:0/73783355 wait complete. 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.711+0000 7f6139c7c740 1 -- start start 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.711+0000 7f6139c7c740 1 Processor -- start 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff2a10 0x556e60ff8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e60ff9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6139c7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556e60f51e00 con 0x556e60ff20f0 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6139c7c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x556e60efe520 con 0x556e60ff2a10 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6139c7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x556e60f118e0 con 0x556e60ffb7e0 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6139c7c740 10 client.0 _ll_register_callbacks cb 0x556e60f4ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6134e24640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.719 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6134e24640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48586/0 (socket says 172.21.15.82:48586) 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6134e24640 1 -- 172.21.15.82:0/464274960 learned_addr learned my addr 172.21.15.82:0/464274960 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f612ffff640 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff2a10 0x556e60ff8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6135625640 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e60ff9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6134e24640 1 -- 172.21.15.82:0/464274960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 msgr2=0x556e60ff9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.712+0000 7f6134e24640 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e60ff9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f6134e24640 1 -- 172.21.15.82:0/464274960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff2a10 msgr2=0x556e60ff8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f6134e24640 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff2a10 0x556e60ff8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f6134e24640 1 -- 172.21.15.82:0/464274960 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e60d36620 con 0x556e60ff20f0 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f6135625640 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e60ff9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f6134e24640 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff8780 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f612400fea0 tx=0x7f6124004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ae8372d1b79933 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:55.720 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f610ffff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f610ffff640 1 -- 172.21.15.82:0/464274960 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124029430 con 0x556e60ff20f0 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f610ffff640 1 -- 172.21.15.82:0/464274960 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8484+0+0 (secure 0 0 0) 0x7f6124020430 con 0x556e60ff20f0 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f6139c7c740 1 -- 172.21.15.82:0/464274960 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61280beac0 con 0x556e60ff20f0 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f610ffff640 1 -- 172.21.15.82:0/464274960 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6124020630 con 0x556e60ff20f0 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f6139c7c740 10 client.17268 fetch_fsmap learned FSMap version 39 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.713+0000 7f6139c7c740 1 -- 172.21.15.82:0/464274960 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556e6100a000 con 0x556e60ff20f0 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.714+0000 7f610ffff640 1 -- 172.21.15.82:0/464274960 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61280beac0 con 0x556e60ff20f0 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.714+0000 7f610ffff640 1 -- 172.21.15.82:0/464274960 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f6124030070 con 0x556e60ff20f0 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.714+0000 7f6139c7c740 10 client.17268 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.714+0000 7f6139c7c740 10 client.17268 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.714+0000 7f6139c7c740 20 client.17268 populate_metadata read hostname 'smithi082' 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.714+0000 7f6139c7c740 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556e6100b5d0 0x556e6100da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.721 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.714+0000 7f6139c7c740 4 client.17268 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:35:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.714+0000 7f6139c7c740 1 -- 172.21.15.82:0/464274960 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e60f63390 con 0x556e6100b5d0 2024-03-27T07:35:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.714+0000 7f612ffff640 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556e6100b5d0 0x556e6100da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.715+0000 7f612ffff640 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556e6100b5d0 0x556e6100da20 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b17dafa51f38f7f2 server_cookie=7b277e454f09d729 in_seq=0 out_seq=0 2024-03-27T07:35:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.715+0000 7f610ffff640 10 client.17268 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f610ffff640 1 -- 172.21.15.82:0/464274960 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556e60f63390 con 0x556e6100b5d0 2024-03-27T07:35:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f610ffff640 10 client.17268 handle_command_reply: tid=0 2024-03-27T07:35:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 client.17268 shutdown 2024-03-27T07:35:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 -- 172.21.15.82:0/464274960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 msgr2=0x556e60ff8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff8780 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f612400fea0 tx=0x7f6124004730 comp rx=0 tx=0).stop 2024-03-27T07:35:55.722 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 -- 172.21.15.82:0/464274960 shutdown_connections 2024-03-27T07:35:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e60ff9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff2a10 0x556e60ff8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556e6100b5d0 0x556e6100da20 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 --2- 172.21.15.82:0/464274960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff20f0 0x556e60ff8780 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 -- 172.21.15.82:0/464274960 >> 172.21.15.82:0/464274960 conn(0x556e60feca10 msgr2=0x556e60fee760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f610ffff640 0 client.17268 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 -- 172.21.15.82:0/464274960 shutdown_connections 2024-03-27T07:35:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 1 -- 172.21.15.82:0/464274960 wait complete. 2024-03-27T07:35:55.723 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.716+0000 7f6139c7c740 20 client.17268 trim_cache size 0 max 16384 2024-03-27T07:35:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.736+0000 7f6139c7c740 1 Processor -- start 2024-03-27T07:35:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.736+0000 7f6139c7c740 1 -- start start 2024-03-27T07:35:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.736+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff20f0 0x556e61006be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.736+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff2a10 0x556e610132f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.737+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61003200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.737+0000 7f6139c7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61301bedc0 con 0x556e60ff2a10 2024-03-27T07:35:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.737+0000 7f6139c7c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61301bc5d0 con 0x556e60ff20f0 2024-03-27T07:35:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.737+0000 7f6139c7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61301ba440 con 0x556e60ffb7e0 2024-03-27T07:35:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.737+0000 7f6135625640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61003200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.737+0000 7f6135625640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61003200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37756/0 (socket says 172.21.15.82:37756) 2024-03-27T07:35:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.737+0000 7f6135625640 1 -- 172.21.15.82:0/2013133349 learned_addr learned my addr 172.21.15.82:0/2013133349 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.738+0000 7f6135625640 1 -- 172.21.15.82:0/2013133349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff20f0 msgr2=0x556e61006be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T07:35:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.738+0000 7f6135625640 1 --2- 172.21.15.82:0/2013133349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff20f0 0x556e61006be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.738+0000 7f6135625640 1 -- 172.21.15.82:0/2013133349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff2a10 msgr2=0x556e610132f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.738+0000 7f6135625640 1 --2- 172.21.15.82:0/2013133349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff2a10 0x556e610132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.738+0000 7f6135625640 1 -- 172.21.15.82:0/2013133349 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e60feed10 con 0x556e60ffb7e0 2024-03-27T07:35:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.738+0000 7f6135625640 1 --2- 172.21.15.82:0/2013133349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61003200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f61280eff10 tx=0x7f6128009900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88e7e23e3bd2cd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.738+0000 7f611a7fc640 1 -- 172.21.15.82:0/2013133349 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61280be3c0 con 0x556e60ffb7e0 2024-03-27T07:35:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.738+0000 7f611a7fc640 1 -- 172.21.15.82:0/2013133349 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6128003b70 con 0x556e60ffb7e0 2024-03-27T07:35:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.738+0000 7f611a7fc640 1 -- 172.21.15.82:0/2013133349 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612803ea00 con 0x556e60ffb7e0 2024-03-27T07:35:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.739+0000 7f6139c7c740 1 -- 172.21.15.82:0/2013133349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 msgr2=0x556e61003200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.739+0000 7f6139c7c740 1 --2- 172.21.15.82:0/2013133349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61003200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f61280eff10 tx=0x7f6128009900 comp rx=0 tx=0).stop 2024-03-27T07:35:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.740+0000 7f6139c7c740 1 -- 172.21.15.82:0/2013133349 shutdown_connections 2024-03-27T07:35:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.740+0000 7f6139c7c740 1 --2- 172.21.15.82:0/2013133349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff2a10 0x556e610132f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.740+0000 7f6139c7c740 1 --2- 172.21.15.82:0/2013133349 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61003200 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.740+0000 7f6139c7c740 1 --2- 172.21.15.82:0/2013133349 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff20f0 0x556e61006be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.740+0000 7f6139c7c740 1 -- 172.21.15.82:0/2013133349 >> 172.21.15.82:0/2013133349 conn(0x556e60feca10 msgr2=0x556e60feb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.740+0000 7f6139c7c740 1 -- 172.21.15.82:0/2013133349 shutdown_connections 2024-03-27T07:35:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.740+0000 7f6139c7c740 1 -- 172.21.15.82:0/2013133349 wait complete. 2024-03-27T07:35:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.740+0000 7f6139c7c740 1 -- start start 2024-03-27T07:35:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.740+0000 7f6139c7c740 1 Processor -- start 2024-03-27T07:35:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff20f0 0x556e61003210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff2a10 0x556e610001e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6139c7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61000720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6139c7c740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61301baa90 con 0x556e60ff2a10 2024-03-27T07:35:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6139c7c740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f61301bbf00 con 0x556e60ff20f0 2024-03-27T07:35:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6139c7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f61301bb160 con 0x556e60ffb7e0 2024-03-27T07:35:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6139c7c740 10 client.0 _ll_register_callbacks cb 0x7f612400faa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:35:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6135625640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61000720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6135625640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61000720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:37766/0 (socket says 172.21.15.82:37766) 2024-03-27T07:35:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f612ffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff2a10 0x556e610001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6135625640 1 -- 172.21.15.82:0/1081202218 learned_addr learned my addr 172.21.15.82:0/1081202218 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f6134e24640 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff20f0 0x556e61003210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f612ffff640 1 -- 172.21.15.82:0/1081202218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 msgr2=0x556e61000720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f612ffff640 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61000720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f612ffff640 1 -- 172.21.15.82:0/1081202218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff20f0 msgr2=0x556e61003210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.741+0000 7f612ffff640 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff20f0 0x556e61003210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.742+0000 7f612ffff640 1 -- 172.21.15.82:0/1081202218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e61000c60 con 0x556e60ff2a10 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.742+0000 7f6135625640 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61000720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.742+0000 7f612ffff640 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff2a10 0x556e610001e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x556e6100e260 tx=0x7f611c01df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29a25b381dc84c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.742+0000 7f610ffff640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.742+0000 7f610ffff640 1 -- 172.21.15.82:0/1081202218 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c023060 con 0x556e60ff2a10 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.742+0000 7f6139c7c740 1 -- 172.21.15.82:0/1081202218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6128003b70 con 0x556e60ff2a10 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.742+0000 7f610ffff640 1 -- 172.21.15.82:0/1081202218 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8484+0+0 (secure 0 0 0) 0x7f611c01d430 con 0x556e60ff2a10 2024-03-27T07:35:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.742+0000 7f610ffff640 1 -- 172.21.15.82:0/1081202218 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f611c01d630 con 0x556e60ff2a10 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.742+0000 7f6139c7c740 10 client.17271 fetch_fsmap learned FSMap version 39 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.742+0000 7f6139c7c740 1 -- 172.21.15.82:0/1081202218 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556e61072660 con 0x556e60ff2a10 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.743+0000 7f610ffff640 1 -- 172.21.15.82:0/1081202218 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6128003b70 con 0x556e60ff2a10 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.743+0000 7f610ffff640 1 -- 172.21.15.82:0/1081202218 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f611c003ae0 con 0x556e60ff2a10 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.743+0000 7f6139c7c740 10 client.17271 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.743+0000 7f6139c7c740 10 client.17271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.743+0000 7f6139c7c740 20 client.17271 populate_metadata read hostname 'smithi082' 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.743+0000 7f6139c7c740 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556e61072d30 0x556e61075120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.743+0000 7f6139c7c740 4 client.17271 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.743+0000 7f6139c7c740 1 -- 172.21.15.82:0/1081202218 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556e60f5d6e0 con 0x556e61072d30 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.743+0000 7f6134e24640 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556e61072d30 0x556e61075120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.744+0000 7f6134e24640 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556e61072d30 0x556e61075120 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94ce3cdc8cc4d16b server_cookie=fd8c28280315321 in_seq=0 out_seq=0 2024-03-27T07:35:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.744+0000 7f610ffff640 10 client.17271 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f610ffff640 1 -- 172.21.15.82:0/1081202218 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556e60f5d6e0 con 0x556e61072d30 2024-03-27T07:35:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f610ffff640 10 client.17271 handle_command_reply: tid=0 2024-03-27T07:35:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 client.17271 shutdown 2024-03-27T07:35:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 -- 172.21.15.82:0/1081202218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff2a10 msgr2=0x556e610001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff2a10 0x556e610001e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x556e6100e260 tx=0x7f611c01df60 comp rx=0 tx=0).stop 2024-03-27T07:35:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 -- 172.21.15.82:0/1081202218 shutdown_connections 2024-03-27T07:35:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x556e61072d30 0x556e61075120 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.766 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556e60ff2a10 0x556e610001e0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556e60ffb7e0 0x556e61000720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f610ffff640 0 client.17271 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:35:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 --2- 172.21.15.82:0/1081202218 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x556e60ff20f0 0x556e61003210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 -- 172.21.15.82:0/1081202218 >> 172.21.15.82:0/1081202218 conn(0x556e60feca10 msgr2=0x556e60ff8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 -- 172.21.15.82:0/1081202218 shutdown_connections 2024-03-27T07:35:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 1 -- 172.21.15.82:0/1081202218 wait complete. 2024-03-27T07:35:55.767 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.765+0000 7f6139c7c740 20 client.17271 trim_cache size 0 max 16384 2024-03-27T07:35:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:35:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:35:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:35:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:35:55.768 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 -- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61200a3980 msgr2=0x7f61200a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61200a3980 0x7f61200a5e40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6124013510 tx=0x7f6124013910 comp rx=0 tx=0).stop 2024-03-27T07:35:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 -- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6130107c40 msgr2=0x7f613019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:35:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6130107c40 0x7f613019a9a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6128009bf0 tx=0x7f6128035d80 comp rx=0 tx=0).stop 2024-03-27T07:35:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 -- 172.21.15.82:0/3925150352 shutdown_connections 2024-03-27T07:35:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f61200a3980 0x7f61200a5e40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6130107c40 0x7f613019a9a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6130069b70 0x7f613010e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 --2- 172.21.15.82:0/3925150352 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f61300691d0 0x7f613010dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:35:55.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 -- 172.21.15.82:0/3925150352 >> 172.21.15.82:0/3925150352 conn(0x7f61300778a0 msgr2=0x7f6130103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:35:55.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 -- 172.21.15.82:0/3925150352 shutdown_connections 2024-03-27T07:35:55.770 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:35:55.768+0000 7f6137088640 1 -- 172.21.15.82:0/3925150352 wait complete. 2024-03-27T07:35:57.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:56 smithi082 ceph-mon[32178]: pgmap v387: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 253 op/s 2024-03-27T07:35:57.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:56 smithi149 ceph-mon[36065]: pgmap v387: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 253 op/s 2024-03-27T07:35:57.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:56 smithi153 ceph-mon[36179]: pgmap v387: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 253 op/s 2024-03-27T07:35:59.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:35:58 smithi082 ceph-mon[32178]: pgmap v388: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 298 op/s 2024-03-27T07:35:59.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:35:58 smithi149 ceph-mon[36065]: pgmap v388: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 298 op/s 2024-03-27T07:35:59.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:35:58 smithi153 ceph-mon[36179]: pgmap v388: 97 pgs: 97 active+clean; 1.9 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 298 op/s 2024-03-27T07:36:01.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:00 smithi082 ceph-mon[32178]: pgmap v389: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 273 op/s 2024-03-27T07:36:01.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:00 smithi149 ceph-mon[36065]: pgmap v389: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 273 op/s 2024-03-27T07:36:01.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:00 smithi153 ceph-mon[36179]: pgmap v389: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 273 op/s 2024-03-27T07:36:03.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:02 smithi082 ceph-mon[32178]: pgmap v390: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 230 op/s 2024-03-27T07:36:03.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:02 smithi149 ceph-mon[36065]: pgmap v390: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 230 op/s 2024-03-27T07:36:03.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:02 smithi153 ceph-mon[36179]: pgmap v390: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.7 MiB/s wr, 230 op/s 2024-03-27T07:36:04.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:03 smithi082 ceph-mon[32178]: pgmap v391: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 313 op/s 2024-03-27T07:36:04.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:03 smithi149 ceph-mon[36065]: pgmap v391: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 313 op/s 2024-03-27T07:36:04.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:03 smithi153 ceph-mon[36179]: pgmap v391: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.6 MiB/s wr, 313 op/s 2024-03-27T07:36:06.503 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:06 smithi149 ceph-mon[36065]: pgmap v392: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 240 op/s 2024-03-27T07:36:06.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:06 smithi153 ceph-mon[36179]: pgmap v392: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 240 op/s 2024-03-27T07:36:06.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:06 smithi082 ceph-mon[32178]: pgmap v392: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.3 MiB/s wr, 240 op/s 2024-03-27T07:36:08.503 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:08 smithi149 ceph-mon[36065]: pgmap v393: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-03-27T07:36:08.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:08 smithi153 ceph-mon[36179]: pgmap v393: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-03-27T07:36:08.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:08 smithi082 ceph-mon[32178]: pgmap v393: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 271 op/s 2024-03-27T07:36:08.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.885+0000 7f850a32c640 1 -- 172.21.15.82:0/4256412865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8504103690 msgr2=0x7f850410bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:08.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.885+0000 7f850a32c640 1 --2- 172.21.15.82:0/4256412865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8504103690 0x7f850410bb70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009900 tx=0x7f84f802bcd0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.885+0000 7f850a32c640 1 -- 172.21.15.82:0/4256412865 shutdown_connections 2024-03-27T07:36:08.885 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.885+0000 7f850a32c640 1 --2- 172.21.15.82:0/4256412865 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8504103690 0x7f850410bb70 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.885+0000 7f850a32c640 1 --2- 172.21.15.82:0/4256412865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f850410c140 0x7f850410e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.885+0000 7f850a32c640 1 --2- 172.21.15.82:0/4256412865 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8504102d70 0x7f8504103150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.885+0000 7f850a32c640 1 -- 172.21.15.82:0/4256412865 >> 172.21.15.82:0/4256412865 conn(0x7f8504077c60 msgr2=0x7f8504078070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.885+0000 7f850a32c640 1 -- 172.21.15.82:0/4256412865 shutdown_connections 2024-03-27T07:36:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.885+0000 7f850a32c640 1 -- 172.21.15.82:0/4256412865 wait complete. 2024-03-27T07:36:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.885+0000 7f850a32c640 1 Processor -- start 2024-03-27T07:36:08.886 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f850a32c640 1 -- start start 2024-03-27T07:36:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f850a32c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8504102d70 0x7f85041984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f850a32c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8504103690 0x7f85041989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f850a32c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f850410c140 0x7f850419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f850a32c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8504111f20 con 0x7f8504102d70 2024-03-27T07:36:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f850a32c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8504111da0 con 0x7f850410c140 2024-03-27T07:36:08.887 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f850a32c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f85041120a0 con 0x7f8504103690 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f8503fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8504102d70 0x7f85041984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f8503fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8504102d70 0x7f85041984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53470/0 (socket says 172.21.15.82:53470) 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f8503fff640 1 -- 172.21.15.82:0/2909870478 learned_addr learned my addr 172.21.15.82:0/2909870478 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.886+0000 7f85037fe640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8504103690 0x7f85041989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.887+0000 7f8503fff640 1 -- 172.21.15.82:0/2909870478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8504103690 msgr2=0x7f85041989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.887+0000 7f8503fff640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8504103690 0x7f85041989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.887+0000 7f8503fff640 1 -- 172.21.15.82:0/2909870478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f850410c140 msgr2=0x7f850419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.887+0000 7f8503fff640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f850410c140 0x7f850419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.887+0000 7f8503fff640 1 -- 172.21.15.82:0/2909870478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850419d440 con 0x7f8504102d70 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.887+0000 7f8503fff640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8504102d70 0x7f85041984a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f84f400e9f0 tx=0x7f84f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.887+0000 7f85017fa640 1 -- 172.21.15.82:0/2909870478 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f400cd80 con 0x7f8504102d70 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.887+0000 7f850a32c640 1 -- 172.21.15.82:0/2909870478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850419d730 con 0x7f8504102d70 2024-03-27T07:36:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.887+0000 7f85017fa640 1 -- 172.21.15.82:0/2909870478 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84f4010910 con 0x7f8504102d70 2024-03-27T07:36:08.890 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.888+0000 7f850a32c640 1 -- 172.21.15.82:0/2909870478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85041a4fc0 con 0x7f8504102d70 2024-03-27T07:36:08.891 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.891+0000 7f85017fa640 1 -- 172.21.15.82:0/2909870478 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f4010630 con 0x7f8504102d70 2024-03-27T07:36:08.892 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.892+0000 7f85017fa640 1 -- 172.21.15.82:0/2909870478 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f84f40173d0 con 0x7f8504102d70 2024-03-27T07:36:08.894 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.894+0000 7f850cff2740 1 Processor -- start 2024-03-27T07:36:08.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.896+0000 7f85017fa640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f84ec0a3820 0x7f84ec0a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.897+0000 7f85017fa640 1 -- 172.21.15.82:0/2909870478 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8484+0+0 (secure 0 0 0) 0x7f84f40d4170 con 0x7f8504102d70 2024-03-27T07:36:08.897 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.897+0000 7f850cff2740 1 -- start start 2024-03-27T07:36:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.897+0000 7f850cff2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.899 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f850cff2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 0x56230a7ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f850cff2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f850cff2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56230a787cd0 con 0x56230a7ca7e0 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f85088c9640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f84ec0a3820 0x7f84ec0a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f850cff2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56230a6cc950 con 0x56230a7c1a10 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f8503fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f8503fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:34666/0 (socket says 172.21.15.82:34666) 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f8503fff640 1 -- 172.21.15.82:0/39501024 learned_addr learned my addr 172.21.15.82:0/39501024 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f85037fe640 1 --2- 172.21.15.82:0/39501024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 0x56230a7ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f850cff2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56230a724e50 con 0x56230a7c10f0 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f85037fe640 1 -- 172.21.15.82:0/39501024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 msgr2=0x56230a7c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.898+0000 7f85037fe640 1 --2- 172.21.15.82:0/39501024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.899+0000 7f85037fe640 1 -- 172.21.15.82:0/39501024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 msgr2=0x56230a7ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:08.900 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.899+0000 7f85037fe640 1 --2- 172.21.15.82:0/39501024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.899+0000 7f85037fe640 1 -- 172.21.15.82:0/39501024 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56230a439210 con 0x56230a7c1a10 2024-03-27T07:36:08.901 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.899+0000 7f85088c9640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f84ec0a3820 0x7f84ec0a5ce0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f84fc005fd0 tx=0x7f84fc009aa0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:08.902 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.903+0000 7f85037fe640 1 --2- 172.21.15.82:0/39501024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 0x56230a7ca2a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009230 tx=0x7f84f8005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=456558f6ebd36a2e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.904+0000 7f84ea7fc640 1 -- 172.21.15.82:0/39501024 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8042070 con 0x56230a7c1a10 2024-03-27T07:36:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.904+0000 7f84ea7fc640 1 -- 172.21.15.82:0/39501024 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84f8004040 con 0x56230a7c1a10 2024-03-27T07:36:08.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.904+0000 7f84ea7fc640 1 -- 172.21.15.82:0/39501024 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f80046c0 con 0x56230a7c1a10 2024-03-27T07:36:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.905+0000 7f850cff2740 1 -- 172.21.15.82:0/39501024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 msgr2=0x56230a7ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:08.909 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.905+0000 7f850cff2740 1 --2- 172.21.15.82:0/39501024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 0x56230a7ca2a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009230 tx=0x7f84f8005d50 comp rx=0 tx=0).stop 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.906+0000 7f850cff2740 1 -- 172.21.15.82:0/39501024 shutdown_connections 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.906+0000 7f850cff2740 1 --2- 172.21.15.82:0/39501024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.906+0000 7f850cff2740 1 --2- 172.21.15.82:0/39501024 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 0x56230a7ca2a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.906+0000 7f850cff2740 1 --2- 172.21.15.82:0/39501024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.906+0000 7f850cff2740 1 -- 172.21.15.82:0/39501024 >> 172.21.15.82:0/39501024 conn(0x56230a7bba10 msgr2=0x56230a7bbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.906+0000 7f850cff2740 1 -- 172.21.15.82:0/39501024 shutdown_connections 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.906+0000 7f850cff2740 1 -- 172.21.15.82:0/39501024 wait complete. 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.906+0000 7f850cff2740 1 -- start start 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f850cff2740 1 Processor -- start 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f850cff2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f850cff2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7c1a10 0x56230a7c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f850cff2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7ca7e0 0x56230a7c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f850cff2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56230a720e00 con 0x56230a7c1a10 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f850cff2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x56230a6cd520 con 0x56230a7ca7e0 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f850cff2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x56230a6e08e0 con 0x56230a7c10f0 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f850cff2740 10 client.0 _ll_register_callbacks cb 0x56230a71ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f8503fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f8503fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:34676/0 (socket says 172.21.15.82:34676) 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.907+0000 7f8503fff640 1 -- 172.21.15.82:0/2504193233 learned_addr learned my addr 172.21.15.82:0/2504193233 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f85088c9640 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7ca7e0 0x56230a7c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f85037fe640 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7c1a10 0x56230a7c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f8503fff640 1 -- 172.21.15.82:0/2504193233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7ca7e0 msgr2=0x56230a7c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f8503fff640 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7ca7e0 0x56230a7c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f8503fff640 1 -- 172.21.15.82:0/2504193233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7c1a10 msgr2=0x56230a7c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f8503fff640 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7c1a10 0x56230a7c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f8503fff640 1 -- 172.21.15.82:0/2504193233 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56230a505620 con 0x56230a7c10f0 2024-03-27T07:36:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f8503fff640 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c7860 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f84f40097b0 tx=0x7f84f409c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14feeec785e1735b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f84e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f84e37fe640 1 -- 172.21.15.82:0/2504193233 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f40d5060 con 0x56230a7c10f0 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f850cff2740 1 -- 172.21.15.82:0/2504193233 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84f8004040 con 0x56230a7c10f0 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.908+0000 7f84e37fe640 1 -- 172.21.15.82:0/2504193233 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8484+0+0 (secure 0 0 0) 0x7f84f409cb00 con 0x56230a7c10f0 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.909+0000 7f84e37fe640 1 -- 172.21.15.82:0/2504193233 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f84f4010ac0 con 0x56230a7c10f0 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.909+0000 7f850cff2740 10 client.27130 fetch_fsmap learned FSMap version 39 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.909+0000 7f850cff2740 1 -- 172.21.15.82:0/2504193233 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56230a7e1bc0 con 0x56230a7c10f0 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.909+0000 7f84e37fe640 1 -- 172.21.15.82:0/2504193233 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84f8004040 con 0x56230a7c10f0 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.909+0000 7f84e37fe640 1 -- 172.21.15.82:0/2504193233 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f84f40bb2a0 con 0x56230a7c10f0 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.909+0000 7f850cff2740 10 client.27130 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.909+0000 7f850cff2740 10 client.27130 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.909+0000 7f850cff2740 20 client.27130 populate_metadata read hostname 'smithi082' 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.909+0000 7f850cff2740 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56230a7e3080 0x56230a7e5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.910+0000 7f850cff2740 4 client.27130 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:36:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.910+0000 7f850cff2740 1 -- 172.21.15.82:0/2504193233 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56230a732390 con 0x56230a7e3080 2024-03-27T07:36:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.910+0000 7f85037fe640 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56230a7e3080 0x56230a7e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.911+0000 7f85037fe640 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56230a7e3080 0x56230a7e5470 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25f96f5a9e1629e9 server_cookie=490b343758f68e6b in_seq=0 out_seq=0 2024-03-27T07:36:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.911+0000 7f84e37fe640 10 client.27130 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f84e37fe640 1 -- 172.21.15.82:0/2504193233 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56230a732390 con 0x56230a7e3080 2024-03-27T07:36:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f84e37fe640 10 client.27130 handle_command_reply: tid=0 2024-03-27T07:36:08.915 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 client.27130 shutdown 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 -- 172.21.15.82:0/2504193233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 msgr2=0x56230a7c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c7860 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f84f40097b0 tx=0x7f84f409c470 comp rx=0 tx=0).stop 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 -- 172.21.15.82:0/2504193233 shutdown_connections 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56230a7e3080 0x56230a7e5470 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7c1a10 0x56230a7c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f84e37fe640 0 client.27130 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7ca7e0 0x56230a7c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 --2- 172.21.15.82:0/2504193233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7c7860 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 -- 172.21.15.82:0/2504193233 >> 172.21.15.82:0/2504193233 conn(0x56230a7bba10 msgr2=0x56230a7bd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 -- 172.21.15.82:0/2504193233 shutdown_connections 2024-03-27T07:36:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 1 -- 172.21.15.82:0/2504193233 wait complete. 2024-03-27T07:36:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.912+0000 7f850cff2740 20 client.27130 trim_cache size 0 max 16384 2024-03-27T07:36:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.931+0000 7f850cff2740 1 Processor -- start 2024-03-27T07:36:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.931+0000 7f850cff2740 1 -- start start 2024-03-27T07:36:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.931+0000 7f850cff2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c10f0 0x56230a7c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f850cff2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c1a10 0x56230a7de6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f850cff2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7bd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f850cff2740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f85041ade50 con 0x56230a7ca7e0 2024-03-27T07:36:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f850cff2740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85041ab660 con 0x56230a7c10f0 2024-03-27T07:36:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f85088c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7bd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f85088c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7bd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53512/0 (socket says 172.21.15.82:53512) 2024-03-27T07:36:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f85088c9640 1 -- 172.21.15.82:0/2369820571 learned_addr learned my addr 172.21.15.82:0/2369820571 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f8503fff640 1 --2- 172.21.15.82:0/2369820571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c10f0 0x56230a7c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f850cff2740 1 -- 172.21.15.82:0/2369820571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f85041a94d0 con 0x56230a7c1a10 2024-03-27T07:36:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f85088c9640 1 -- 172.21.15.82:0/2369820571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c1a10 msgr2=0x56230a7de6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f85088c9640 1 --2- 172.21.15.82:0/2369820571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c1a10 0x56230a7de6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f85088c9640 1 -- 172.21.15.82:0/2369820571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c10f0 msgr2=0x56230a7c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f85088c9640 1 --2- 172.21.15.82:0/2369820571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c10f0 0x56230a7c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.932+0000 7f85088c9640 1 -- 172.21.15.82:0/2369820571 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56230a7ccf40 con 0x56230a7ca7e0 2024-03-27T07:36:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.933+0000 7f85088c9640 1 --2- 172.21.15.82:0/2369820571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7bd570 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f84fc012530 tx=0x7f84fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f11be118f886f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.933+0000 7f84e9ffb640 1 -- 172.21.15.82:0/2369820571 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc004d20 con 0x56230a7ca7e0 2024-03-27T07:36:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.933+0000 7f84e9ffb640 1 -- 172.21.15.82:0/2369820571 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84fc005500 con 0x56230a7ca7e0 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.933+0000 7f84e9ffb640 1 -- 172.21.15.82:0/2369820571 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc01fab0 con 0x56230a7ca7e0 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.934+0000 7f850cff2740 1 -- 172.21.15.82:0/2369820571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 msgr2=0x56230a7bd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.934+0000 7f850cff2740 1 --2- 172.21.15.82:0/2369820571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7bd570 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f84fc012530 tx=0x7f84fc013000 comp rx=0 tx=0).stop 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.934+0000 7f850cff2740 1 -- 172.21.15.82:0/2369820571 shutdown_connections 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.934+0000 7f850cff2740 1 --2- 172.21.15.82:0/2369820571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7bd570 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.934+0000 7f850cff2740 1 --2- 172.21.15.82:0/2369820571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c1a10 0x56230a7de6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.934+0000 7f850cff2740 1 --2- 172.21.15.82:0/2369820571 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c10f0 0x56230a7c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.934+0000 7f850cff2740 1 -- 172.21.15.82:0/2369820571 >> 172.21.15.82:0/2369820571 conn(0x56230a7bba10 msgr2=0x56230a7bce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.934+0000 7f850cff2740 1 -- 172.21.15.82:0/2369820571 shutdown_connections 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.934+0000 7f850cff2740 1 -- 172.21.15.82:0/2369820571 wait complete. 2024-03-27T07:36:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.934+0000 7f850cff2740 1 -- start start 2024-03-27T07:36:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f850cff2740 1 Processor -- start 2024-03-27T07:36:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f850cff2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7dacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f850cff2740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 0x56230a7d7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f850cff2740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7d81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f8503fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7dacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f8503fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7dacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:34694/0 (socket says 172.21.15.82:34694) 2024-03-27T07:36:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f8503fff640 1 -- 172.21.15.82:0/3256440149 learned_addr learned my addr 172.21.15.82:0/3256440149 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f85037fe640 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 0x56230a7d7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f85041a9b20 con 0x56230a7ca7e0 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f85041aaf90 con 0x56230a7c1a10 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f85041aa1f0 con 0x56230a7c10f0 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.935+0000 7f85088c9640 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7d81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.936+0000 7f850cff2740 10 client.0 _ll_register_callbacks cb 0x7f84f4098280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.936+0000 7f85037fe640 1 -- 172.21.15.82:0/3256440149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 msgr2=0x56230a7dacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.936+0000 7f85037fe640 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7dacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.936+0000 7f85037fe640 1 -- 172.21.15.82:0/3256440149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 msgr2=0x56230a7d81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.936+0000 7f85037fe640 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7d81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.936+0000 7f85037fe640 1 -- 172.21.15.82:0/3256440149 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56230a7d8720 con 0x56230a7c1a10 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.936+0000 7f85088c9640 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7d81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:36:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.936+0000 7f85037fe640 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 0x56230a7d7ca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f84f8036040 tx=0x7f84f802c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a2883700af90d54 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.936+0000 7f84e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.937+0000 7f84e37fe640 1 -- 172.21.15.82:0/3256440149 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8042040 con 0x56230a7c1a10 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.937+0000 7f84e37fe640 1 -- 172.21.15.82:0/3256440149 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 8484+0+0 (secure 0 0 0) 0x7f84f8051b80 con 0x56230a7c1a10 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.937+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84fc005500 con 0x56230a7c1a10 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.937+0000 7f84e37fe640 1 -- 172.21.15.82:0/3256440149 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f84f8051d80 con 0x56230a7c1a10 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.937+0000 7f850cff2740 10 client.27116 fetch_fsmap learned FSMap version 39 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.937+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56230a84a050 con 0x56230a7c1a10 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.938+0000 7f84e37fe640 1 -- 172.21.15.82:0/3256440149 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f84fc005500 con 0x56230a7c1a10 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.938+0000 7f84e37fe640 1 -- 172.21.15.82:0/3256440149 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f84f8059070 con 0x56230a7c1a10 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.938+0000 7f850cff2740 10 client.27116 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.938+0000 7f850cff2740 10 client.27116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.938+0000 7f850cff2740 20 client.27116 populate_metadata read hostname 'smithi082' 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.938+0000 7f850cff2740 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56230a7e3080 0x56230a84c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.938+0000 7f850cff2740 4 client.27116 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:36:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.938+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56230a72c6e0 con 0x56230a7e3080 2024-03-27T07:36:08.941 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.941+0000 7f8503fff640 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56230a7e3080 0x56230a84c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:08.941 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.942+0000 7f8503fff640 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56230a7e3080 0x56230a84c370 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2aa627ad5a82d03 server_cookie=5d85c820fe162311 in_seq=0 out_seq=0 2024-03-27T07:36:08.941 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.942+0000 7f84e37fe640 10 client.27116 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.959+0000 7f84e37fe640 1 -- 172.21.15.82:0/3256440149 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56230a72c6e0 con 0x56230a7e3080 2024-03-27T07:36:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.959+0000 7f84e37fe640 10 client.27116 handle_command_reply: tid=0 2024-03-27T07:36:08.959 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.959+0000 7f850cff2740 1 client.27116 shutdown 2024-03-27T07:36:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.961+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 msgr2=0x56230a7d7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:08.960 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.961+0000 7f850cff2740 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 0x56230a7d7ca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f84f8036040 tx=0x7f84f802c290 comp rx=0 tx=0).stop 2024-03-27T07:36:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.962+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 shutdown_connections 2024-03-27T07:36:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.962+0000 7f850cff2740 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x56230a7e3080 0x56230a84c370 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.962+0000 7f850cff2740 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56230a7ca7e0 0x56230a7d81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.962+0000 7f850cff2740 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x56230a7c1a10 0x56230a7d7ca0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.962+0000 7f850cff2740 1 --2- 172.21.15.82:0/3256440149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x56230a7c10f0 0x56230a7dacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.962+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 >> 172.21.15.82:0/3256440149 conn(0x56230a7bba10 msgr2=0x56230a7c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.962+0000 7f84e37fe640 0 client.27116 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.962+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 shutdown_connections 2024-03-27T07:36:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.962+0000 7f850cff2740 1 -- 172.21.15.82:0/3256440149 wait complete. 2024-03-27T07:36:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.962+0000 7f850cff2740 20 client.27116 trim_cache size 0 max 16384 2024-03-27T07:36:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:36:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:36:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:36:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:36:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.963+0000 7f850a32c640 1 -- 172.21.15.82:0/2909870478 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f84ec0a3820 msgr2=0x7f84ec0a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.963+0000 7f850a32c640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f84ec0a3820 0x7f84ec0a5ce0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f84fc005fd0 tx=0x7f84fc009aa0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.963+0000 7f850a32c640 1 -- 172.21.15.82:0/2909870478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8504102d70 msgr2=0x7f85041984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.963+0000 7f850a32c640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8504102d70 0x7f85041984a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f84f400e9f0 tx=0x7f84f400eeb0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.963+0000 7f850a32c640 1 -- 172.21.15.82:0/2909870478 shutdown_connections 2024-03-27T07:36:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.964+0000 7f850a32c640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f84ec0a3820 0x7f84ec0a5ce0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.964+0000 7f850a32c640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f850410c140 0x7f850419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.964+0000 7f850a32c640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8504103690 0x7f85041989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.964+0000 7f850a32c640 1 --2- 172.21.15.82:0/2909870478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8504102d70 0x7f85041984a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.964+0000 7f850a32c640 1 -- 172.21.15.82:0/2909870478 >> 172.21.15.82:0/2909870478 conn(0x7f8504077c60 msgr2=0x7f85040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.964+0000 7f850a32c640 1 -- 172.21.15.82:0/2909870478 shutdown_connections 2024-03-27T07:36:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:08.964+0000 7f850a32c640 1 -- 172.21.15.82:0/2909870478 wait complete. 2024-03-27T07:36:10.503 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:10 smithi149 ceph-mon[36065]: pgmap v394: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 240 op/s 2024-03-27T07:36:10.503 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:10 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:36:10.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:10 smithi153 ceph-mon[36179]: pgmap v394: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 240 op/s 2024-03-27T07:36:10.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:10 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:36:10.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:10 smithi082 ceph-mon[32178]: pgmap v394: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 240 op/s 2024-03-27T07:36:10.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:10 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:36:11.503 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:11 smithi149 ceph-mon[36065]: osdmap e104: 12 total, 12 up, 12 in 2024-03-27T07:36:11.503 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:11 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.503 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:11 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.503 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:11 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.504 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:11 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:11 smithi153 ceph-mon[36179]: osdmap e104: 12 total, 12 up, 12 in 2024-03-27T07:36:11.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:11 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:11 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:11 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:11 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:11 smithi082 ceph-mon[32178]: osdmap e104: 12 total, 12 up, 12 in 2024-03-27T07:36:11.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:11 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:11 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:11 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:11.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:11 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:12.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:12 smithi153 ceph-mon[36179]: pgmap v396: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 232 op/s 2024-03-27T07:36:12.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:12 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:36:12.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:12 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:36:12.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:12 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:12.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:12 smithi082 ceph-mon[32178]: pgmap v396: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 232 op/s 2024-03-27T07:36:12.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:12 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:36:12.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:12 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:36:12.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:12 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:12.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:12 smithi149 ceph-mon[36065]: pgmap v396: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 2.6 MiB/s wr, 232 op/s 2024-03-27T07:36:12.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:12 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:36:12.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:12 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:36:12.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:12 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:36:14.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:14 smithi153 ceph-mon[36179]: pgmap v397: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 225 op/s 2024-03-27T07:36:14.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:14 smithi082 ceph-mon[32178]: pgmap v397: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 225 op/s 2024-03-27T07:36:14.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:14 smithi149 ceph-mon[36065]: pgmap v397: 97 pgs: 18 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 49 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 225 op/s 2024-03-27T07:36:16.535 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:16 smithi153 ceph-mon[36179]: pgmap v398: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 229 op/s 2024-03-27T07:36:16.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:16 smithi082 ceph-mon[32178]: pgmap v398: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 229 op/s 2024-03-27T07:36:16.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:16 smithi149 ceph-mon[36065]: pgmap v398: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 229 op/s 2024-03-27T07:36:18.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:18 smithi153 ceph-mon[36179]: pgmap v399: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2024-03-27T07:36:18.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:18 smithi082 ceph-mon[32178]: pgmap v399: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2024-03-27T07:36:18.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:18 smithi149 ceph-mon[36065]: pgmap v399: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2024-03-27T07:36:20.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:20 smithi153 ceph-mon[36179]: pgmap v400: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-03-27T07:36:20.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:20 smithi082 ceph-mon[32178]: pgmap v400: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-03-27T07:36:20.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:20 smithi149 ceph-mon[36065]: pgmap v400: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 162 op/s 2024-03-27T07:36:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.098+0000 7f80a2a6f640 1 -- 172.21.15.82:0/1874979889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c104630 msgr2=0x7f809c104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:22.098 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.098+0000 7f80a2a6f640 1 --2- 172.21.15.82:0/1874979889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c104630 0x7f809c104ab0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f8090009890 tx=0x7f809002bb70 comp rx=0 tx=0).stop 2024-03-27T07:36:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.099+0000 7f80a2a6f640 1 -- 172.21.15.82:0/1874979889 shutdown_connections 2024-03-27T07:36:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.099+0000 7f80a2a6f640 1 --2- 172.21.15.82:0/1874979889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c104630 0x7f809c104ab0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.099+0000 7f80a2a6f640 1 --2- 172.21.15.82:0/1874979889 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f809c06a930 0x7f809c06ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.099+0000 7f80a2a6f640 1 --2- 172.21.15.82:0/1874979889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f809c106ac0 0x7f809c06a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.099+0000 7f80a2a6f640 1 -- 172.21.15.82:0/1874979889 >> 172.21.15.82:0/1874979889 conn(0x7f809c077b10 msgr2=0x7f809c077f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.099+0000 7f80a2a6f640 1 -- 172.21.15.82:0/1874979889 shutdown_connections 2024-03-27T07:36:22.099 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.099+0000 7f80a2a6f640 1 -- 172.21.15.82:0/1874979889 wait complete. 2024-03-27T07:36:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.100+0000 7f80a2a6f640 1 Processor -- start 2024-03-27T07:36:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.100+0000 7f80a2a6f640 1 -- start start 2024-03-27T07:36:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.100+0000 7f80a2a6f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c06a930 0x7f809c1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.100+0000 7f80a2a6f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f809c104630 0x7f809c1a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.100+0000 7f80a2a6f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f809c106ac0 0x7f809c19e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.100+0000 7f80a2a6f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f809c1184c0 con 0x7f809c06a930 2024-03-27T07:36:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.100+0000 7f80a2a6f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f809c118340 con 0x7f809c104630 2024-03-27T07:36:22.100 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.100+0000 7f80a2a6f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f809c118640 con 0x7f809c106ac0 2024-03-27T07:36:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.101+0000 7f80a100c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f809c106ac0 0x7f809c19e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.101+0000 7f80a100c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f809c106ac0 0x7f809c19e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36034/0 (socket says 172.21.15.82:36034) 2024-03-27T07:36:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.101+0000 7f80a100c640 1 -- 172.21.15.82:0/3347021049 learned_addr learned my addr 172.21.15.82:0/3347021049 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.101+0000 7f809bfff640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f809c104630 0x7f809c1a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.102+0000 7f80a100c640 1 -- 172.21.15.82:0/3347021049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f809c104630 msgr2=0x7f809c1a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:22.101 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.102+0000 7f80a100c640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f809c104630 0x7f809c1a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.102+0000 7f80a100c640 1 -- 172.21.15.82:0/3347021049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c06a930 msgr2=0x7f809c1a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.102+0000 7f80a100c640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c06a930 0x7f809c1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.102+0000 7f80a100c640 1 -- 172.21.15.82:0/3347021049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c19ef70 con 0x7f809c106ac0 2024-03-27T07:36:22.102 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.102+0000 7f80a100c640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f809c106ac0 0x7f809c19e760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f809002c180 tx=0x7f8090034670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.102+0000 7f8099ffb640 1 -- 172.21.15.82:0/3347021049 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090041030 con 0x7f809c106ac0 2024-03-27T07:36:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.103+0000 7f80a2a6f640 1 -- 172.21.15.82:0/3347021049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c19f200 con 0x7f809c106ac0 2024-03-27T07:36:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.103+0000 7f80a2a6f640 1 -- 172.21.15.82:0/3347021049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c06b570 con 0x7f809c106ac0 2024-03-27T07:36:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.103+0000 7f8099ffb640 1 -- 172.21.15.82:0/3347021049 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f809002c9f0 con 0x7f809c106ac0 2024-03-27T07:36:22.103 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.103+0000 7f8099ffb640 1 -- 172.21.15.82:0/3347021049 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8090039040 con 0x7f809c106ac0 2024-03-27T07:36:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.107+0000 7f8099ffb640 1 -- 172.21.15.82:0/3347021049 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f8090044070 con 0x7f809c106ac0 2024-03-27T07:36:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.107+0000 7f80a5658740 1 Processor -- start 2024-03-27T07:36:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.108+0000 7f8099ffb640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80840a3920 0x7f80840a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.108+0000 7f80a5658740 1 -- start start 2024-03-27T07:36:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.108+0000 7f80a5658740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 0x55fe2dbe94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.108+0000 7f80a5658740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbf22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.108+0000 7f80a5658740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.108+0000 7f80a5658740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fe2dbafcd0 con 0x55fe2dbf27e0 2024-03-27T07:36:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.108+0000 7f80a5658740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55fe2daf4950 con 0x55fe2dbe90f0 2024-03-27T07:36:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.108+0000 7f80a5658740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fe2db4ce50 con 0x55fe2dbe9a10 2024-03-27T07:36:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.108+0000 7f8099ffb640 1 -- 172.21.15.82:0/3347021049 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f80900f1510 con 0x7f809c106ac0 2024-03-27T07:36:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.108+0000 7f809bfff640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80840a3920 0x7f80840a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.109+0000 7f80a100c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.109+0000 7f80a100c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35808/0 (socket says 172.21.15.82:35808) 2024-03-27T07:36:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.109+0000 7f80a100c640 1 -- 172.21.15.82:0/3717113569 learned_addr learned my addr 172.21.15.82:0/3717113569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.109+0000 7f80a080b640 1 --2- 172.21.15.82:0/3717113569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 0x55fe2dbe94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.109+0000 7f809bfff640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80840a3920 0x7f80840a5de0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f809c19ffb0 tx=0x7f808c005ef0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.109+0000 7f80a100c640 1 -- 172.21.15.82:0/3717113569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe9a10 msgr2=0x55fe2dbf22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.109+0000 7f80a100c640 1 --2- 172.21.15.82:0/3717113569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbf22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.109+0000 7f80a100c640 1 -- 172.21.15.82:0/3717113569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 msgr2=0x55fe2dbe94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.109+0000 7f80a100c640 1 --2- 172.21.15.82:0/3717113569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 0x55fe2dbe94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.109+0000 7f80a100c640 1 -- 172.21.15.82:0/3717113569 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2d861210 con 0x55fe2dbf27e0 2024-03-27T07:36:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.110+0000 7f80a100c640 1 --2- 172.21.15.82:0/3717113569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf4bd0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f80900b9bd0 tx=0x7f80900bd600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd51c0f18f6171ef server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.111+0000 7f8082ffd640 1 -- 172.21.15.82:0/3717113569 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80900bde70 con 0x55fe2dbf27e0 2024-03-27T07:36:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.111+0000 7f8082ffd640 1 -- 172.21.15.82:0/3717113569 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80900bd770 con 0x55fe2dbf27e0 2024-03-27T07:36:22.111 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.111+0000 7f8082ffd640 1 -- 172.21.15.82:0/3717113569 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80900eeea0 con 0x55fe2dbf27e0 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 -- 172.21.15.82:0/3717113569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbf27e0 msgr2=0x55fe2dbf4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 --2- 172.21.15.82:0/3717113569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf4bd0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f80900b9bd0 tx=0x7f80900bd600 comp rx=0 tx=0).stop 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 -- 172.21.15.82:0/3717113569 shutdown_connections 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 --2- 172.21.15.82:0/3717113569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf4bd0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 --2- 172.21.15.82:0/3717113569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbf22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 --2- 172.21.15.82:0/3717113569 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 0x55fe2dbe94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 -- 172.21.15.82:0/3717113569 >> 172.21.15.82:0/3717113569 conn(0x55fe2dbe3a10 msgr2=0x55fe2dbe3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 -- 172.21.15.82:0/3717113569 shutdown_connections 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 -- 172.21.15.82:0/3717113569 wait complete. 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 -- start start 2024-03-27T07:36:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.112+0000 7f80a5658740 1 Processor -- start 2024-03-27T07:36:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f80a5658740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 0x55fe2dbef7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f80a5658740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbefce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f80a5658740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f80a5658740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fe2db48e00 con 0x55fe2dbe9a10 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f809bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbefce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f809bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbefce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35822/0 (socket says 172.21.15.82:35822) 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f809bfff640 1 -- 172.21.15.82:0/1954664977 learned_addr learned my addr 172.21.15.82:0/1954664977 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f80a5658740 1 -- 172.21.15.82:0/1954664977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55fe2daf5520 con 0x55fe2dbe90f0 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f80a080b640 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 0x55fe2dbef7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f80a5658740 1 -- 172.21.15.82:0/1954664977 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55fe2db088e0 con 0x55fe2dbf27e0 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f80a5658740 10 client.0 _ll_register_callbacks cb 0x55fe2db43a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.113+0000 7f80a100c640 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.114+0000 7f80a080b640 1 -- 172.21.15.82:0/1954664977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbf27e0 msgr2=0x55fe2dbf0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.114+0000 7f80a080b640 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.114+0000 7f80a080b640 1 -- 172.21.15.82:0/1954664977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 msgr2=0x55fe2dbefce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.114+0000 7f80a080b640 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbefce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.114+0000 7f80a080b640 1 -- 172.21.15.82:0/1954664977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2d92d620 con 0x55fe2dbe90f0 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.114+0000 7f809bfff640 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbefce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.114+0000 7f80a080b640 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 0x55fe2dbef7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f809400fb40 tx=0x7f809400c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b251c88565955d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.114+0000 7f807bfff640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.114+0000 7f807bfff640 1 -- 172.21.15.82:0/1954664977 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809401d060 con 0x55fe2dbe90f0 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.114+0000 7f80a5658740 1 -- 172.21.15.82:0/1954664977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80900bd770 con 0x55fe2dbe90f0 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.115+0000 7f807bfff640 1 -- 172.21.15.82:0/1954664977 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f809400cc50 con 0x55fe2dbe90f0 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.115+0000 7f807bfff640 1 -- 172.21.15.82:0/1954664977 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f809400ce90 con 0x55fe2dbe90f0 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.115+0000 7f80a5658740 10 client.27125 fetch_fsmap learned FSMap version 39 2024-03-27T07:36:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.115+0000 7f80a5658740 1 -- 172.21.15.82:0/1954664977 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55fe2dc12070 con 0x55fe2dbe90f0 2024-03-27T07:36:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.115+0000 7f807bfff640 1 -- 172.21.15.82:0/1954664977 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80900bd770 con 0x55fe2dbe90f0 2024-03-27T07:36:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.117+0000 7f807bfff640 1 -- 172.21.15.82:0/1954664977 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f809400b040 con 0x55fe2dbe90f0 2024-03-27T07:36:22.119 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.117+0000 7f80a5658740 10 client.27125 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:36:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.117+0000 7f80a5658740 10 client.27125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:36:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.117+0000 7f80a5658740 20 client.27125 populate_metadata read hostname 'smithi082' 2024-03-27T07:36:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.117+0000 7f80a5658740 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fe2dc13620 0x55fe2dc15ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.117+0000 7f80a5658740 4 client.27125 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:36:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.117+0000 7f80a5658740 1 -- 172.21.15.82:0/1954664977 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe2db5a390 con 0x55fe2dc13620 2024-03-27T07:36:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.120+0000 7f809bfff640 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fe2dc13620 0x55fe2dc15ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.121+0000 7f809bfff640 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fe2dc13620 0x55fe2dc15ae0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d52a495c41dbbaf server_cookie=a08db34f6bb9f3b6 in_seq=0 out_seq=0 2024-03-27T07:36:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.121+0000 7f807bfff640 10 client.27125 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.122+0000 7f807bfff640 1 -- 172.21.15.82:0/1954664977 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55fe2db5a390 con 0x55fe2dc13620 2024-03-27T07:36:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.122+0000 7f807bfff640 10 client.27125 handle_command_reply: tid=0 2024-03-27T07:36:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.122+0000 7f80a5658740 1 client.27125 shutdown 2024-03-27T07:36:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.122+0000 7f80a5658740 1 -- 172.21.15.82:0/1954664977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 msgr2=0x55fe2dbef7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.122+0000 7f80a5658740 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 0x55fe2dbef7a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f809400fb40 tx=0x7f809400c370 comp rx=0 tx=0).stop 2024-03-27T07:36:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.123+0000 7f80a5658740 1 -- 172.21.15.82:0/1954664977 shutdown_connections 2024-03-27T07:36:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.123+0000 7f80a5658740 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fe2dc13620 0x55fe2dc15ae0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.123+0000 7f80a5658740 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbefce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.123+0000 7f80a5658740 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.123+0000 7f80a5658740 1 --2- 172.21.15.82:0/1954664977 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbe90f0 0x55fe2dbef7a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.123+0000 7f80a5658740 1 -- 172.21.15.82:0/1954664977 >> 172.21.15.82:0/1954664977 conn(0x55fe2dbe3a10 msgr2=0x55fe2dbe5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.123+0000 7f807bfff640 0 client.27125 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.123+0000 7f80a5658740 1 -- 172.21.15.82:0/1954664977 shutdown_connections 2024-03-27T07:36:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.123+0000 7f80a5658740 1 -- 172.21.15.82:0/1954664977 wait complete. 2024-03-27T07:36:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.124+0000 7f80a5658740 20 client.27125 trim_cache size 0 max 16384 2024-03-27T07:36:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.143+0000 7f80a5658740 1 Processor -- start 2024-03-27T07:36:22.145 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.143+0000 7f80a5658740 1 -- start start 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.143+0000 7f80a5658740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 0x55fe2dc0ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.143+0000 7f80a5658740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbee900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.143+0000 7f80a5658740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.143+0000 7f80a5658740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8088011100 con 0x55fe2dbe9a10 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.143+0000 7f80a5658740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f808800e910 con 0x55fe2dbf27e0 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.143+0000 7f80a5658740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f808800c760 con 0x55fe2dbe90f0 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.143+0000 7f809bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.144+0000 7f809bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbee900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35824/0 (socket says 172.21.15.82:35824) 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.144+0000 7f809bfff640 1 -- 172.21.15.82:0/3092795126 learned_addr learned my addr 172.21.15.82:0/3092795126 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.144+0000 7f80a080b640 1 --2- 172.21.15.82:0/3092795126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 0x55fe2dc0ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.144+0000 7f80a100c640 1 --2- 172.21.15.82:0/3092795126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.144+0000 7f809bfff640 1 -- 172.21.15.82:0/3092795126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 msgr2=0x55fe2dc0ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.144+0000 7f809bfff640 1 --2- 172.21.15.82:0/3092795126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 0x55fe2dc0ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.144+0000 7f809bfff640 1 -- 172.21.15.82:0/3092795126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbf27e0 msgr2=0x55fe2dbf0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.144+0000 7f809bfff640 1 --2- 172.21.15.82:0/3092795126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.144+0000 7f809bfff640 1 -- 172.21.15.82:0/3092795126 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2dbe8a90 con 0x55fe2dbe9a10 2024-03-27T07:36:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.145+0000 7f809bfff640 1 --2- 172.21.15.82:0/3092795126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbee900 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f808c0058c0 tx=0x7f808c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1b2a859c9ef552 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.146+0000 7f80827fc640 1 -- 172.21.15.82:0/3092795126 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c011c20 con 0x55fe2dbe9a10 2024-03-27T07:36:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.146+0000 7f80827fc640 1 -- 172.21.15.82:0/3092795126 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f808c0257b0 con 0x55fe2dbe9a10 2024-03-27T07:36:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.146+0000 7f80827fc640 1 -- 172.21.15.82:0/3092795126 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c004a00 con 0x55fe2dbe9a10 2024-03-27T07:36:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.148+0000 7f80a5658740 1 -- 172.21.15.82:0/3092795126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 msgr2=0x55fe2dbee900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.149+0000 7f80a5658740 1 --2- 172.21.15.82:0/3092795126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbee900 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f808c0058c0 tx=0x7f808c013000 comp rx=0 tx=0).stop 2024-03-27T07:36:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.149+0000 7f80a5658740 1 -- 172.21.15.82:0/3092795126 shutdown_connections 2024-03-27T07:36:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.149+0000 7f80a5658740 1 --2- 172.21.15.82:0/3092795126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dbee900 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.149+0000 7f80a5658740 1 --2- 172.21.15.82:0/3092795126 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbf27e0 0x55fe2dbf0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.149+0000 7f80a5658740 1 --2- 172.21.15.82:0/3092795126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 0x55fe2dc0ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.149+0000 7f80a5658740 1 -- 172.21.15.82:0/3092795126 >> 172.21.15.82:0/3092795126 conn(0x55fe2dbe3a10 msgr2=0x55fe2dbe21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.149+0000 7f80a5658740 1 -- 172.21.15.82:0/3092795126 shutdown_connections 2024-03-27T07:36:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.149+0000 7f80a5658740 1 -- 172.21.15.82:0/3092795126 wait complete. 2024-03-27T07:36:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.150+0000 7f80a5658740 1 -- start start 2024-03-27T07:36:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.150+0000 7f80a5658740 1 Processor -- start 2024-03-27T07:36:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.150+0000 7f80a5658740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 0x55fe2dc0b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a5658740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dc06760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a080b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 0x55fe2dc0b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a080b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 0x55fe2dc0b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:36074/0 (socket says 172.21.15.82:36074) 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a5658740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbf27e0 0x55fe2dc06ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a080b640 1 -- 172.21.15.82:0/2953264892 learned_addr learned my addr 172.21.15.82:0/2953264892 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f808800cdd0 con 0x55fe2dbe9a10 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f808800e240 con 0x55fe2dbf27e0 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f808800d4a0 con 0x55fe2dbe90f0 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a5658740 10 client.0 _ll_register_callbacks cb 0x7f80940099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a100c640 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbf27e0 0x55fe2dc06ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f809bfff640 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dc06760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a080b640 1 -- 172.21.15.82:0/2953264892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbf27e0 msgr2=0x55fe2dc06ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a080b640 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbf27e0 0x55fe2dc06ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a080b640 1 -- 172.21.15.82:0/2953264892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 msgr2=0x55fe2dc06760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a080b640 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dc06760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f80a080b640 1 -- 172.21.15.82:0/2953264892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2dc072e0 con 0x55fe2dbe90f0 2024-03-27T07:36:22.152 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.151+0000 7f809bfff640 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dc06760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:36:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.152+0000 7f80a080b640 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 0x55fe2dc0b2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f809400fb40 tx=0x7f809400f7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=213756176b0d4d04 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:22.153 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.152+0000 7f807bfff640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:36:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.152+0000 7f807bfff640 1 -- 172.21.15.82:0/2953264892 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8094027080 con 0x55fe2dbe90f0 2024-03-27T07:36:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.152+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f808c0257b0 con 0x55fe2dbe90f0 2024-03-27T07:36:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.153+0000 7f807bfff640 1 -- 172.21.15.82:0/2953264892 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f8094004b20 con 0x55fe2dbe90f0 2024-03-27T07:36:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.153+0000 7f807bfff640 1 -- 172.21.15.82:0/2953264892 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8094031050 con 0x55fe2dbe90f0 2024-03-27T07:36:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.153+0000 7f80a5658740 10 client.27148 fetch_fsmap learned FSMap version 39 2024-03-27T07:36:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.153+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55fe2dc79840 con 0x55fe2dbe90f0 2024-03-27T07:36:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.153+0000 7f807bfff640 1 -- 172.21.15.82:0/2953264892 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f808c0257b0 con 0x55fe2dbe90f0 2024-03-27T07:36:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.154+0000 7f807bfff640 1 -- 172.21.15.82:0/2953264892 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f8094034020 con 0x55fe2dbe90f0 2024-03-27T07:36:22.154 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.154+0000 7f80a5658740 10 client.27148 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:36:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.154+0000 7f80a5658740 10 client.27148 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:36:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.154+0000 7f80a5658740 20 client.27148 populate_metadata read hostname 'smithi082' 2024-03-27T07:36:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.154+0000 7f80a5658740 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fe2dc7a0a0 0x55fe2dc7c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.154+0000 7f80a5658740 4 client.27148 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:36:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.154+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe2db546e0 con 0x55fe2dc7a0a0 2024-03-27T07:36:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.154+0000 7f809bfff640 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fe2dc7a0a0 0x55fe2dc7c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.155+0000 7f807bfff640 10 client.27148 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:22.155 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.155+0000 7f809bfff640 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fe2dc7a0a0 0x55fe2dc7c490 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ba616b4fba293ed server_cookie=d63e6f3860f97c15 in_seq=0 out_seq=0 2024-03-27T07:36:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.340+0000 7f807bfff640 1 -- 172.21.15.82:0/2953264892 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe2db546e0 con 0x55fe2dc7a0a0 2024-03-27T07:36:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.340+0000 7f807bfff640 10 client.27148 handle_command_reply: tid=0 2024-03-27T07:36:22.406 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.340+0000 7f80a5658740 1 client.27148 shutdown 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.340+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 msgr2=0x55fe2dc0b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.340+0000 7f80a5658740 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 0x55fe2dc0b2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f809400fb40 tx=0x7f809400f7b0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.341+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 shutdown_connections 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.341+0000 7f80a5658740 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55fe2dc7a0a0 0x55fe2dc7c490 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.341+0000 7f80a5658740 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fe2dbe9a10 0x55fe2dc06760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.341+0000 7f80a5658740 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55fe2dbf27e0 0x55fe2dc06ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.341+0000 7f807bfff640 0 client.27148 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.341+0000 7f80a5658740 1 --2- 172.21.15.82:0/2953264892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55fe2dbe90f0 0x55fe2dc0b2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.341+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 >> 172.21.15.82:0/2953264892 conn(0x55fe2dbe3a10 msgr2=0x55fe2dbe2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.341+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 shutdown_connections 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.341+0000 7f80a5658740 1 -- 172.21.15.82:0/2953264892 wait complete. 2024-03-27T07:36:22.407 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.341+0000 7f80a5658740 20 client.27148 trim_cache size 0 max 16384 2024-03-27T07:36:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:36:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:36:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:36:22.408 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.342+0000 7f80a2a6f640 1 -- 172.21.15.82:0/3347021049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80840a3920 msgr2=0x7f80840a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.342+0000 7f80a2a6f640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80840a3920 0x7f80840a5de0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f809c19ffb0 tx=0x7f808c005ef0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.343+0000 7f80a2a6f640 1 -- 172.21.15.82:0/3347021049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f809c106ac0 msgr2=0x7f809c19e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.343+0000 7f80a2a6f640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f809c106ac0 0x7f809c19e760 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f809002c180 tx=0x7f8090034670 comp rx=0 tx=0).stop 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.343+0000 7f80a2a6f640 1 -- 172.21.15.82:0/3347021049 shutdown_connections 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.343+0000 7f80a2a6f640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f80840a3920 0x7f80840a5de0 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f809c19ffb0 tx=0x7f808c005ef0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.343+0000 7f80a2a6f640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f809c106ac0 0x7f809c19e760 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.343+0000 7f80a2a6f640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f809c104630 0x7f809c1a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.343+0000 7f80a2a6f640 1 --2- 172.21.15.82:0/3347021049 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f809c06a930 0x7f809c1a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.343+0000 7f80a2a6f640 1 -- 172.21.15.82:0/3347021049 >> 172.21.15.82:0/3347021049 conn(0x7f809c077b10 msgr2=0x7f809c1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.343+0000 7f80a2a6f640 1 -- 172.21.15.82:0/3347021049 shutdown_connections 2024-03-27T07:36:22.410 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:22.343+0000 7f80a2a6f640 1 -- 172.21.15.82:0/3347021049 wait complete. 2024-03-27T07:36:22.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:22 smithi153 ceph-mon[36179]: pgmap v401: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-03-27T07:36:22.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:22 smithi082 ceph-mon[32178]: pgmap v401: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-03-27T07:36:22.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:22 smithi149 ceph-mon[36065]: pgmap v401: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.4 MiB/s wr, 148 op/s 2024-03-27T07:36:24.519 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:24 smithi153 ceph-mon[36179]: pgmap v402: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-03-27T07:36:24.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:24 smithi082 ceph-mon[32178]: pgmap v402: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-03-27T07:36:24.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:24 smithi149 ceph-mon[36065]: pgmap v402: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 180 op/s 2024-03-27T07:36:26.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:26 smithi153 ceph-mon[36179]: pgmap v403: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 909 KiB/s wr, 115 op/s 2024-03-27T07:36:26.554 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:26 smithi149 ceph-mon[36065]: pgmap v403: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 909 KiB/s wr, 115 op/s 2024-03-27T07:36:26.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:26 smithi082 ceph-mon[32178]: pgmap v403: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 909 KiB/s wr, 115 op/s 2024-03-27T07:36:28.536 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:28 smithi153 ceph-mon[36179]: pgmap v404: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 129 op/s 2024-03-27T07:36:28.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:28 smithi082 ceph-mon[32178]: pgmap v404: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 129 op/s 2024-03-27T07:36:28.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:28 smithi149 ceph-mon[36065]: pgmap v404: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 129 op/s 2024-03-27T07:36:30.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:30 smithi082 ceph-mon[32178]: pgmap v405: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-03-27T07:36:30.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:30 smithi149 ceph-mon[36065]: pgmap v405: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-03-27T07:36:30.786 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:30 smithi153 ceph-mon[36179]: pgmap v405: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-03-27T07:36:32.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:32 smithi082 ceph-mon[32178]: pgmap v406: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 885 KiB/s wr, 100 op/s 2024-03-27T07:36:32.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:32 smithi149 ceph-mon[36065]: pgmap v406: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 885 KiB/s wr, 100 op/s 2024-03-27T07:36:32.786 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:32 smithi153 ceph-mon[36179]: pgmap v406: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 870 KiB/s rd, 885 KiB/s wr, 100 op/s 2024-03-27T07:36:34.502 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:34 smithi149 ceph-mon[36065]: pgmap v407: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 130 op/s 2024-03-27T07:36:34.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:34 smithi082 ceph-mon[32178]: pgmap v407: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 130 op/s 2024-03-27T07:36:34.786 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:34 smithi153 ceph-mon[36179]: pgmap v407: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 130 op/s 2024-03-27T07:36:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.476+0000 7fb893ceb640 1 -- 172.21.15.82:0/374915111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb88c1059f0 msgr2=0x7fb88c105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.476+0000 7fb893ceb640 1 --2- 172.21.15.82:0/374915111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb88c1059f0 0x7fb88c105dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb88800ba20 tx=0x7fb88802d8d0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.477+0000 7fb893ceb640 1 -- 172.21.15.82:0/374915111 shutdown_connections 2024-03-27T07:36:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.477+0000 7fb893ceb640 1 --2- 172.21.15.82:0/374915111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb88c101660 0x7fb88c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.477+0000 7fb893ceb640 1 --2- 172.21.15.82:0/374915111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb88c100ca0 0x7fb88c101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.477 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.477+0000 7fb893ceb640 1 --2- 172.21.15.82:0/374915111 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb88c1059f0 0x7fb88c105dd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.478 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.477+0000 7fb893ceb640 1 -- 172.21.15.82:0/374915111 >> 172.21.15.82:0/374915111 conn(0x7fb88c0778a0 msgr2=0x7fb88c077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:35.480 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.481+0000 7fb893ceb640 1 -- 172.21.15.82:0/374915111 shutdown_connections 2024-03-27T07:36:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.481+0000 7fb893ceb640 1 -- 172.21.15.82:0/374915111 wait complete. 2024-03-27T07:36:35.481 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.482+0000 7fb893ceb640 1 Processor -- start 2024-03-27T07:36:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.483+0000 7fb893ceb640 1 -- start start 2024-03-27T07:36:35.482 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.483+0000 7fb893ceb640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb88c100ca0 0x7fb88c073630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.483+0000 7fb893ceb640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb88c101660 0x7fb88c06d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.483+0000 7fb893ceb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb88c06dbe0 0x7fb88c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.483+0000 7fb893ceb640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c06bf80 con 0x7fb88c101660 2024-03-27T07:36:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.483+0000 7fb893ceb640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c06be00 con 0x7fb88c100ca0 2024-03-27T07:36:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.483+0000 7fb893ceb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c06c100 con 0x7fb88c06dbe0 2024-03-27T07:36:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.483+0000 7fb891286640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb88c101660 0x7fb88c06d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.483+0000 7fb891286640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb88c101660 0x7fb88c06d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58756/0 (socket says 172.21.15.82:58756) 2024-03-27T07:36:35.483 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.483+0000 7fb891286640 1 -- 172.21.15.82:0/617853796 learned_addr learned my addr 172.21.15.82:0/617853796 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.484+0000 7fb891286640 1 -- 172.21.15.82:0/617853796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb88c06dbe0 msgr2=0x7fb88c06e090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T07:36:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.484+0000 7fb891286640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb88c06dbe0 0x7fb88c06e090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.484+0000 7fb891286640 1 -- 172.21.15.82:0/617853796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb88c100ca0 msgr2=0x7fb88c073630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T07:36:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.484+0000 7fb891286640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb88c100ca0 0x7fb88c073630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.484+0000 7fb891286640 1 -- 172.21.15.82:0/617853796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c1ab380 con 0x7fb88c101660 2024-03-27T07:36:35.484 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.484+0000 7fb891286640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb88c101660 0x7fb88c06d6a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00b4a0 tx=0x7fb87c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.485+0000 7fb882ffd640 1 -- 172.21.15.82:0/617853796 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c014070 con 0x7fb88c101660 2024-03-27T07:36:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.485+0000 7fb882ffd640 1 -- 172.21.15.82:0/617853796 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb87c010af0 con 0x7fb88c101660 2024-03-27T07:36:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.485+0000 7fb882ffd640 1 -- 172.21.15.82:0/617853796 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c017cc0 con 0x7fb88c101660 2024-03-27T07:36:35.485 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.485+0000 7fb893ceb640 1 -- 172.21.15.82:0/617853796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c1ab670 con 0x7fb88c101660 2024-03-27T07:36:35.486 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.485+0000 7fb893ceb640 1 -- 172.21.15.82:0/617853796 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c1abb70 con 0x7fb88c101660 2024-03-27T07:36:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.489+0000 7fb8969aa740 1 Processor -- start 2024-03-27T07:36:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.490+0000 7fb8969aa740 1 -- start start 2024-03-27T07:36:35.489 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.490+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e2304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.490+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 0x55ed5e2392a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.490+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e2397e0 0x55ed5e23bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.490+0000 7fb8969aa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ed5e1f6cd0 con 0x55ed5e2300f0 2024-03-27T07:36:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.490+0000 7fb8969aa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ed5e13b950 con 0x55ed5e230a10 2024-03-27T07:36:35.490 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.490+0000 7fb8969aa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ed5e193e50 con 0x55ed5e2397e0 2024-03-27T07:36:35.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.490+0000 7fb882ffd640 1 -- 172.21.15.82:0/617853796 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fb87c017070 con 0x7fb88c101660 2024-03-27T07:36:35.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.491+0000 7fb891a87640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 0x55ed5e2392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.491+0000 7fb891a87640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 0x55ed5e2392a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:51676/0 (socket says 172.21.15.82:51676) 2024-03-27T07:36:35.491 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.491+0000 7fb891a87640 1 -- 172.21.15.82:0/1577163778 learned_addr learned my addr 172.21.15.82:0/1577163778 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.491+0000 7fb882ffd640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8780a3a00 0x7fb8780a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.491+0000 7fb891a87640 1 -- 172.21.15.82:0/1577163778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e2397e0 msgr2=0x55ed5e23bbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T07:36:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.491+0000 7fb891a87640 1 --2- 172.21.15.82:0/1577163778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e2397e0 0x55ed5e23bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.491+0000 7fb891a87640 1 -- 172.21.15.82:0/1577163778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 msgr2=0x55ed5e2304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.491+0000 7fb891a87640 1 --2- 172.21.15.82:0/1577163778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e2304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.491+0000 7fb891a87640 1 -- 172.21.15.82:0/1577163778 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed5dea8210 con 0x55ed5e230a10 2024-03-27T07:36:35.492 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.491+0000 7fb882ffd640 1 -- 172.21.15.82:0/617853796 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7fb87c0cf420 con 0x7fb88c101660 2024-03-27T07:36:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.492+0000 7fb891a87640 1 --2- 172.21.15.82:0/1577163778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 0x55ed5e2392a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb88800e090 tx=0x7fb888009b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a37f57266c6a57e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:35.493 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.493+0000 7fb877fff640 1 -- 172.21.15.82:0/1577163778 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888037070 con 0x55ed5e230a10 2024-03-27T07:36:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.493+0000 7fb877fff640 1 -- 172.21.15.82:0/1577163778 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb888005040 con 0x55ed5e230a10 2024-03-27T07:36:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.493+0000 7fb877fff640 1 -- 172.21.15.82:0/1577163778 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8880095c0 con 0x55ed5e230a10 2024-03-27T07:36:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.494+0000 7fb8969aa740 1 -- 172.21.15.82:0/1577163778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 msgr2=0x55ed5e2392a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:35.494 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.494+0000 7fb8969aa740 1 --2- 172.21.15.82:0/1577163778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 0x55ed5e2392a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb88800e090 tx=0x7fb888009b70 comp rx=0 tx=0).stop 2024-03-27T07:36:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.496+0000 7fb892288640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8780a3a00 0x7fb8780a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.497+0000 7fb8969aa740 1 -- 172.21.15.82:0/1577163778 shutdown_connections 2024-03-27T07:36:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.497+0000 7fb8969aa740 1 --2- 172.21.15.82:0/1577163778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e2397e0 0x55ed5e23bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.497+0000 7fb8969aa740 1 --2- 172.21.15.82:0/1577163778 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 0x55ed5e2392a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.496 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.497+0000 7fb8969aa740 1 --2- 172.21.15.82:0/1577163778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e2304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.497+0000 7fb8969aa740 1 -- 172.21.15.82:0/1577163778 >> 172.21.15.82:0/1577163778 conn(0x55ed5e22aa10 msgr2=0x55ed5e22adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:35.497 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.497+0000 7fb892288640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8780a3a00 0x7fb8780a5ec0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb884005c40 tx=0x7fb884009280 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.500+0000 7fb8969aa740 1 -- 172.21.15.82:0/1577163778 shutdown_connections 2024-03-27T07:36:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.500+0000 7fb8969aa740 1 -- 172.21.15.82:0/1577163778 wait complete. 2024-03-27T07:36:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.501+0000 7fb8969aa740 1 -- start start 2024-03-27T07:36:35.500 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.501+0000 7fb8969aa740 1 Processor -- start 2024-03-27T07:36:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e2300f0 0x55ed5e236840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e230a10 0x55ed5e236d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2397e0 0x55ed5e2372c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb8969aa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ed5e18fe00 con 0x55ed5e2397e0 2024-03-27T07:36:35.501 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb8969aa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x55ed5e13c520 con 0x55ed5e2300f0 2024-03-27T07:36:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb8969aa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x55ed5e14f8e0 con 0x55ed5e230a10 2024-03-27T07:36:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb8969aa740 10 client.0 _ll_register_callbacks cb 0x55ed5e18aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:36:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb892288640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2397e0 0x55ed5e2372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb892288640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2397e0 0x55ed5e2372c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58772/0 (socket says 172.21.15.82:58772) 2024-03-27T07:36:35.502 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb892288640 1 -- 172.21.15.82:0/255153728 learned_addr learned my addr 172.21.15.82:0/255153728 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb891286640 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e230a10 0x55ed5e236d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb891a87640 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e2300f0 0x55ed5e236840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb892288640 1 -- 172.21.15.82:0/255153728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e230a10 msgr2=0x55ed5e236d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb892288640 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e230a10 0x55ed5e236d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb892288640 1 -- 172.21.15.82:0/255153728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e2300f0 msgr2=0x55ed5e236840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:35.503 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb892288640 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e2300f0 0x55ed5e236840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.502+0000 7fb892288640 1 -- 172.21.15.82:0/255153728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed5df74620 con 0x55ed5e2397e0 2024-03-27T07:36:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.503+0000 7fb892288640 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2397e0 0x55ed5e2372c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb88400dd60 tx=0x7fb8840095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3212479f53f00944 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.503+0000 7fb8757fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:36:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.503+0000 7fb8757fa640 1 -- 172.21.15.82:0/255153728 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb884024670 con 0x55ed5e2397e0 2024-03-27T07:36:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.503+0000 7fb8969aa740 1 -- 172.21.15.82:0/255153728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb888005040 con 0x55ed5e2397e0 2024-03-27T07:36:35.504 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.504+0000 7fb8757fa640 1 -- 172.21.15.82:0/255153728 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7fb884024810 con 0x55ed5e2397e0 2024-03-27T07:36:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.504+0000 7fb8757fa640 1 -- 172.21.15.82:0/255153728 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb88400de50 con 0x55ed5e2397e0 2024-03-27T07:36:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.505+0000 7fb8969aa740 10 client.17307 fetch_fsmap learned FSMap version 39 2024-03-27T07:36:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.505+0000 7fb8969aa740 1 -- 172.21.15.82:0/255153728 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ed5e248430 con 0x55ed5e2397e0 2024-03-27T07:36:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.507+0000 7fb8757fa640 1 -- 172.21.15.82:0/255153728 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb888005040 con 0x55ed5e2397e0 2024-03-27T07:36:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.507+0000 7fb8757fa640 1 -- 172.21.15.82:0/255153728 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fb88400b030 con 0x55ed5e2397e0 2024-03-27T07:36:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.507+0000 7fb8969aa740 10 client.17307 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:36:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.507+0000 7fb8969aa740 10 client.17307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:36:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.507+0000 7fb8969aa740 20 client.17307 populate_metadata read hostname 'smithi082' 2024-03-27T07:36:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.507+0000 7fb8969aa740 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ed5e249cf0 0x55ed5e24c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.507+0000 7fb8969aa740 4 client.17307 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:36:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.507+0000 7fb8969aa740 1 -- 172.21.15.82:0/255153728 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed5e1a1390 con 0x55ed5e249cf0 2024-03-27T07:36:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.507+0000 7fb891a87640 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ed5e249cf0 0x55ed5e24c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.509+0000 7fb891a87640 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ed5e249cf0 0x55ed5e24c130 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75f912cf0ea11e17 server_cookie=4825f22845e6dc0 in_seq=0 out_seq=0 2024-03-27T07:36:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.510+0000 7fb8757fa640 10 client.17307 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.511+0000 7fb8757fa640 1 -- 172.21.15.82:0/255153728 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ed5e1a1390 con 0x55ed5e249cf0 2024-03-27T07:36:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.511+0000 7fb8757fa640 10 client.17307 handle_command_reply: tid=0 2024-03-27T07:36:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.512+0000 7fb8969aa740 1 client.17307 shutdown 2024-03-27T07:36:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.514+0000 7fb8969aa740 1 -- 172.21.15.82:0/255153728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2397e0 msgr2=0x55ed5e2372c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.514+0000 7fb8969aa740 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2397e0 0x55ed5e2372c0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb88400dd60 tx=0x7fb8840095c0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.514+0000 7fb8969aa740 1 -- 172.21.15.82:0/255153728 shutdown_connections 2024-03-27T07:36:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.514+0000 7fb8969aa740 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ed5e249cf0 0x55ed5e24c130 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.514+0000 7fb8969aa740 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2397e0 0x55ed5e2372c0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.514+0000 7fb8969aa740 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e230a10 0x55ed5e236d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.514+0000 7fb8969aa740 1 --2- 172.21.15.82:0/255153728 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e2300f0 0x55ed5e236840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.514+0000 7fb8969aa740 1 -- 172.21.15.82:0/255153728 >> 172.21.15.82:0/255153728 conn(0x55ed5e22aa10 msgr2=0x55ed5e22c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.514+0000 7fb8757fa640 0 client.17307 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.520+0000 7fb8969aa740 1 -- 172.21.15.82:0/255153728 shutdown_connections 2024-03-27T07:36:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.522+0000 7fb8969aa740 1 -- 172.21.15.82:0/255153728 wait complete. 2024-03-27T07:36:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.523+0000 7fb8969aa740 20 client.17307 trim_cache size 0 max 16384 2024-03-27T07:36:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.547+0000 7fb8969aa740 1 Processor -- start 2024-03-27T07:36:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.547+0000 7fb8969aa740 1 -- start start 2024-03-27T07:36:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.547+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e231b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.547+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 0x55ed5e244e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.547+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e2397e0 0x55ed5e251a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.547+0000 7fb8969aa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1c7df0 con 0x55ed5e2300f0 2024-03-27T07:36:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.547+0000 7fb8969aa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1c5600 con 0x55ed5e230a10 2024-03-27T07:36:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.547+0000 7fb8969aa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1c3450 con 0x55ed5e2397e0 2024-03-27T07:36:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb891a87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e231b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb891a87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e231b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58778/0 (socket says 172.21.15.82:58778) 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb891a87640 1 -- 172.21.15.82:0/2360296166 learned_addr learned my addr 172.21.15.82:0/2360296166 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb891286640 1 --2- 172.21.15.82:0/2360296166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 0x55ed5e244e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb892288640 1 --2- 172.21.15.82:0/2360296166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e2397e0 0x55ed5e251a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb891a87640 1 -- 172.21.15.82:0/2360296166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e2397e0 msgr2=0x55ed5e251a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb891a87640 1 --2- 172.21.15.82:0/2360296166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e2397e0 0x55ed5e251a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb891a87640 1 -- 172.21.15.82:0/2360296166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 msgr2=0x55ed5e244e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb891a87640 1 --2- 172.21.15.82:0/2360296166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 0x55ed5e244e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb891a87640 1 -- 172.21.15.82:0/2360296166 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed5e22b390 con 0x55ed5e2300f0 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb891a87640 1 --2- 172.21.15.82:0/2360296166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e231b60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb88800b440 tx=0x7fb88802df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff30a9922adad3bf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.548+0000 7fb8777fe640 1 -- 172.21.15.82:0/2360296166 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888000e60 con 0x55ed5e2300f0 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.549+0000 7fb8777fe640 1 -- 172.21.15.82:0/2360296166 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb888057070 con 0x55ed5e2300f0 2024-03-27T07:36:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.549+0000 7fb8777fe640 1 -- 172.21.15.82:0/2360296166 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888037040 con 0x55ed5e2300f0 2024-03-27T07:36:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.549+0000 7fb8969aa740 1 -- 172.21.15.82:0/2360296166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 msgr2=0x55ed5e231b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.549+0000 7fb8969aa740 1 --2- 172.21.15.82:0/2360296166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e231b60 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb88800b440 tx=0x7fb88802df50 comp rx=0 tx=0).stop 2024-03-27T07:36:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.549+0000 7fb8969aa740 1 -- 172.21.15.82:0/2360296166 shutdown_connections 2024-03-27T07:36:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.549+0000 7fb8969aa740 1 --2- 172.21.15.82:0/2360296166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e2397e0 0x55ed5e251a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.549+0000 7fb8969aa740 1 --2- 172.21.15.82:0/2360296166 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e230a10 0x55ed5e244e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.549+0000 7fb8969aa740 1 --2- 172.21.15.82:0/2360296166 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e231b60 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.549+0000 7fb8969aa740 1 -- 172.21.15.82:0/2360296166 >> 172.21.15.82:0/2360296166 conn(0x55ed5e22aa10 msgr2=0x55ed5e22c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.549+0000 7fb8969aa740 1 -- 172.21.15.82:0/2360296166 shutdown_connections 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.550+0000 7fb8969aa740 1 -- 172.21.15.82:0/2360296166 wait complete. 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.550+0000 7fb8969aa740 1 -- start start 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.550+0000 7fb8969aa740 1 Processor -- start 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.550+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e241850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e230a10 0x55ed5e2331c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb8969aa740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e2397e0 0x55ed5e2337d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb8969aa740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1c3ac0 con 0x55ed5e2300f0 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb8969aa740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1c4f30 con 0x55ed5e2397e0 2024-03-27T07:36:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb8969aa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c1c4190 con 0x55ed5e230a10 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb8969aa740 10 client.0 _ll_register_callbacks cb 0x7fb88c073cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb891a87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e241850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb891a87640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e241850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:58786/0 (socket says 172.21.15.82:58786) 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb891a87640 1 -- 172.21.15.82:0/1369560602 learned_addr learned my addr 172.21.15.82:0/1369560602 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb891286640 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e230a10 0x55ed5e2331c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb891a87640 1 -- 172.21.15.82:0/1369560602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e230a10 msgr2=0x55ed5e2331c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb891a87640 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e230a10 0x55ed5e2331c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb891a87640 1 -- 172.21.15.82:0/1369560602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e2397e0 msgr2=0x55ed5e2337d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb891a87640 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e2397e0 0x55ed5e2337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb891a87640 1 -- 172.21.15.82:0/1369560602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed5e233fd0 con 0x55ed5e2300f0 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb891a87640 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e241850 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb8880521f0 tx=0x7fb88800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02f9f4b6c4ac24d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb8757fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:36:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.551+0000 7fb8757fa640 1 -- 172.21.15.82:0/1369560602 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888061030 con 0x55ed5e2300f0 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8969aa740 1 -- 172.21.15.82:0/1369560602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb888057070 con 0x55ed5e2300f0 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8757fa640 1 -- 172.21.15.82:0/1369560602 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7fb8880052f0 con 0x55ed5e2300f0 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8757fa640 1 -- 172.21.15.82:0/1369560602 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb88806b050 con 0x55ed5e2300f0 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8969aa740 10 client.17313 fetch_fsmap learned FSMap version 39 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8969aa740 1 -- 172.21.15.82:0/1369560602 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ed5e2b00e0 con 0x55ed5e2300f0 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8757fa640 1 -- 172.21.15.82:0/1369560602 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb888057070 con 0x55ed5e2300f0 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8757fa640 1 -- 172.21.15.82:0/1369560602 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fb888009680 con 0x55ed5e2300f0 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8969aa740 10 client.17313 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8969aa740 10 client.17313 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8969aa740 20 client.17313 populate_metadata read hostname 'smithi082' 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8969aa740 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ed5e2b03d0 0x55ed5e2b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8969aa740 4 client.17313 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:36:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.552+0000 7fb8969aa740 1 -- 172.21.15.82:0/1369560602 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ed5e19b6e0 con 0x55ed5e2b03d0 2024-03-27T07:36:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.556+0000 7fb891286640 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ed5e2b03d0 0x55ed5e2b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.557+0000 7fb891286640 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ed5e2b03d0 0x55ed5e2b27c0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac3184be1d4056bd server_cookie=fdb687f5be5c546 in_seq=0 out_seq=0 2024-03-27T07:36:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.557+0000 7fb8757fa640 10 client.17313 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.640+0000 7fb8757fa640 1 -- 172.21.15.82:0/1369560602 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ed5e19b6e0 con 0x55ed5e2b03d0 2024-03-27T07:36:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.640+0000 7fb8757fa640 10 client.17313 handle_command_reply: tid=0 2024-03-27T07:36:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.640+0000 7fb8969aa740 1 client.17313 shutdown 2024-03-27T07:36:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.640+0000 7fb8969aa740 1 -- 172.21.15.82:0/1369560602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 msgr2=0x55ed5e241850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.640+0000 7fb8969aa740 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e241850 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb8880521f0 tx=0x7fb88800e000 comp rx=0 tx=0).stop 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.640+0000 7fb8969aa740 1 -- 172.21.15.82:0/1369560602 shutdown_connections 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.640+0000 7fb8969aa740 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x55ed5e2397e0 0x55ed5e2337d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.640+0000 7fb8969aa740 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55ed5e230a10 0x55ed5e2331c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.640+0000 7fb8969aa740 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x55ed5e2b03d0 0x55ed5e2b27c0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.641+0000 7fb8969aa740 1 --2- 172.21.15.82:0/1369560602 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ed5e2300f0 0x55ed5e241850 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.641+0000 7fb8757fa640 0 client.17313 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.641+0000 7fb8969aa740 1 -- 172.21.15.82:0/1369560602 >> 172.21.15.82:0/1369560602 conn(0x55ed5e22aa10 msgr2=0x55ed5e2291e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.641+0000 7fb8969aa740 1 -- 172.21.15.82:0/1369560602 shutdown_connections 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.641+0000 7fb8969aa740 1 -- 172.21.15.82:0/1369560602 wait complete. 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.641+0000 7fb8969aa740 20 client.17313 trim_cache size 0 max 16384 2024-03-27T07:36:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:36:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:36:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:36:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:36:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 -- 172.21.15.82:0/617853796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8780a3a00 msgr2=0x7fb8780a5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8780a3a00 0x7fb8780a5ec0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb884005c40 tx=0x7fb884009280 comp rx=0 tx=0).stop 2024-03-27T07:36:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 -- 172.21.15.82:0/617853796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb88c101660 msgr2=0x7fb88c06d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb88c101660 0x7fb88c06d6a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00b4a0 tx=0x7fb87c00b960 comp rx=0 tx=0).stop 2024-03-27T07:36:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 -- 172.21.15.82:0/617853796 shutdown_connections 2024-03-27T07:36:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8780a3a00 0x7fb8780a5ec0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb88c101660 0x7fb88c06d6a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb88c06dbe0 0x7fb88c06e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 --2- 172.21.15.82:0/617853796 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb88c100ca0 0x7fb88c073630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 -- 172.21.15.82:0/617853796 >> 172.21.15.82:0/617853796 conn(0x7fb88c0778a0 msgr2=0x7fb88c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 -- 172.21.15.82:0/617853796 shutdown_connections 2024-03-27T07:36:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:35.643+0000 7fb893ceb640 1 -- 172.21.15.82:0/617853796 wait complete. 2024-03-27T07:36:35.685 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:36:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:36:35.246+0000 7fa9cef3c700 -1 calc_pg_upmaps abort due to max <= 0 2024-03-27T07:36:36.586 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:36 smithi082 ceph-mon[32178]: pgmap v408: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1.1 MiB/s wr, 98 op/s 2024-03-27T07:36:36.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:36 smithi149 ceph-mon[36065]: pgmap v408: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1.1 MiB/s wr, 98 op/s 2024-03-27T07:36:36.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:36 smithi153 ceph-mon[36179]: pgmap v408: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 968 KiB/s rd, 1.1 MiB/s wr, 98 op/s 2024-03-27T07:36:38.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:38 smithi082 ceph-mon[32178]: pgmap v409: 97 pgs: 21 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 36 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-03-27T07:36:38.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:38 smithi149 ceph-mon[36065]: pgmap v409: 97 pgs: 21 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 36 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-03-27T07:36:38.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:38 smithi153 ceph-mon[36179]: pgmap v409: 97 pgs: 21 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 36 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-03-27T07:36:40.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:40 smithi082 ceph-mon[32178]: pgmap v410: 97 pgs: 21 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 36 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 115 op/s 2024-03-27T07:36:40.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:40 smithi149 ceph-mon[36065]: pgmap v410: 97 pgs: 21 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 36 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 115 op/s 2024-03-27T07:36:40.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:40 smithi153 ceph-mon[36179]: pgmap v410: 97 pgs: 21 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 36 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 115 op/s 2024-03-27T07:36:42.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:42 smithi082 ceph-mon[32178]: pgmap v411: 97 pgs: 21 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 36 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 102 op/s 2024-03-27T07:36:42.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:42 smithi149 ceph-mon[36065]: pgmap v411: 97 pgs: 21 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 36 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 102 op/s 2024-03-27T07:36:42.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:42 smithi153 ceph-mon[36179]: pgmap v411: 97 pgs: 21 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 36 active+clean; 1.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 102 op/s 2024-03-27T07:36:44.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:44 smithi082 ceph-mon[32178]: pgmap v412: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 151 op/s 2024-03-27T07:36:44.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:44 smithi149 ceph-mon[36065]: pgmap v412: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 151 op/s 2024-03-27T07:36:44.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:44 smithi153 ceph-mon[36179]: pgmap v412: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 151 op/s 2024-03-27T07:36:46.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:46 smithi082 ceph-mon[32178]: pgmap v413: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 138 op/s 2024-03-27T07:36:46.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:46 smithi149 ceph-mon[36065]: pgmap v413: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 138 op/s 2024-03-27T07:36:46.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:46 smithi153 ceph-mon[36179]: pgmap v413: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 138 op/s 2024-03-27T07:36:48.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:48 smithi082 ceph-mon[32178]: pgmap v414: 97 pgs: 15 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 157 op/s 2024-03-27T07:36:48.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:48 smithi149 ceph-mon[36065]: pgmap v414: 97 pgs: 15 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 157 op/s 2024-03-27T07:36:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.769+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/2597479348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf4107c60 msgr2=0x7f5cf4108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.769+0000 7f5cfbfc7640 1 --2- 172.21.15.82:0/2597479348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf4107c60 0x7f5cf4108040 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000fb10 tx=0x7f5cf002fe50 comp rx=0 tx=0).stop 2024-03-27T07:36:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.769+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/2597479348 shutdown_connections 2024-03-27T07:36:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.769+0000 7f5cfbfc7640 1 --2- 172.21.15.82:0/2597479348 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf4069b90 0x7f5cf410e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.769+0000 7f5cfbfc7640 1 --2- 172.21.15.82:0/2597479348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cf40691d0 0x7f5cf4069650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.769+0000 7f5cfbfc7640 1 --2- 172.21.15.82:0/2597479348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf4107c60 0x7f5cf4108040 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.769+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/2597479348 >> 172.21.15.82:0/2597479348 conn(0x7f5cf40778a0 msgr2=0x7f5cf4077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.769+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/2597479348 shutdown_connections 2024-03-27T07:36:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.769+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/2597479348 wait complete. 2024-03-27T07:36:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.770+0000 7f5cfbfc7640 1 Processor -- start 2024-03-27T07:36:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.770+0000 7f5cfbfc7640 1 -- start start 2024-03-27T07:36:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.770+0000 7f5cfbfc7640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf40691d0 0x7f5cf41a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.770+0000 7f5cfbfc7640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf4069b90 0x7f5cf41a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cfbfc7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cf4107c60 0x7f5cf419e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cfbfc7640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf410fd10 con 0x7f5cf4069b90 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cfbfc7640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf410fb90 con 0x7f5cf40691d0 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cfbfc7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf410fe90 con 0x7f5cf4107c60 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cf9562640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf4069b90 0x7f5cf41a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cf9562640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf4069b90 0x7f5cf41a4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42738/0 (socket says 172.21.15.82:42738) 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cf9562640 1 -- 172.21.15.82:0/133166164 learned_addr learned my addr 172.21.15.82:0/133166164 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cf9d63640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf40691d0 0x7f5cf41a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cfa564640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cf4107c60 0x7f5cf419e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cf9562640 1 -- 172.21.15.82:0/133166164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cf4107c60 msgr2=0x7f5cf419e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cf9562640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cf4107c60 0x7f5cf419e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cf9562640 1 -- 172.21.15.82:0/133166164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf40691d0 msgr2=0x7f5cf41a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cf9562640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf40691d0 0x7f5cf41a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cf9562640 1 -- 172.21.15.82:0/133166164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cf419f060 con 0x7f5cf4069b90 2024-03-27T07:36:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5cf9562640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf4069b90 0x7f5cf41a4bd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400e9f0 tx=0x7f5ce400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.771+0000 7f5ceaffd640 1 -- 172.21.15.82:0/133166164 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400cd80 con 0x7f5cf4069b90 2024-03-27T07:36:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.772+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/133166164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cf419f350 con 0x7f5cf4069b90 2024-03-27T07:36:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.772+0000 7f5ceaffd640 1 -- 172.21.15.82:0/133166164 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce4005500 con 0x7f5cf4069b90 2024-03-27T07:36:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.772+0000 7f5ceaffd640 1 -- 172.21.15.82:0/133166164 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4010690 con 0x7f5cf4069b90 2024-03-27T07:36:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.772+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/133166164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cf41ab610 con 0x7f5cf4069b90 2024-03-27T07:36:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.775+0000 7f5ceaffd640 1 -- 172.21.15.82:0/133166164 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f5ce40046c0 con 0x7f5cf4069b90 2024-03-27T07:36:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.775+0000 7f5cfebaf740 1 Processor -- start 2024-03-27T07:36:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.775+0000 7f5cfebaf740 1 -- start start 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.775+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f01660f0 0x5579f01664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.775+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f0166a10 0x5579f016f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f0171bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5579f012ccd0 con 0x5579f01660f0 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5579f0071950 con 0x5579f016f7e0 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5579f00c9e50 con 0x5579f0166a10 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cfa564640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f01660f0 0x5579f01664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cfa564640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f01660f0 0x5579f01664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42744/0 (socket says 172.21.15.82:42744) 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cfa564640 1 -- 172.21.15.82:0/1281172988 learned_addr learned my addr 172.21.15.82:0/1281172988 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5ceaffd640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5ce00a3820 0x7f5ce00a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cf9d63640 1 --2- 172.21.15.82:0/1281172988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f0166a10 0x5579f016f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cf9562640 1 --2- 172.21.15.82:0/1281172988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f0171bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5ceaffd640 1 -- 172.21.15.82:0/133166164 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f5ce40d0550 con 0x7f5cf4069b90 2024-03-27T07:36:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cf9d63640 1 -- 172.21.15.82:0/1281172988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 msgr2=0x5579f0171bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cf9d63640 1 --2- 172.21.15.82:0/1281172988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f0171bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cf9d63640 1 -- 172.21.15.82:0/1281172988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f01660f0 msgr2=0x5579f01664d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cf9d63640 1 --2- 172.21.15.82:0/1281172988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f01660f0 0x5579f01664d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cf9d63640 1 -- 172.21.15.82:0/1281172988 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579efdde210 con 0x5579f0166a10 2024-03-27T07:36:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.776+0000 7f5cfa564640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5ce00a3820 0x7f5ce00a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.777+0000 7f5cf9d63640 1 --2- 172.21.15.82:0/1281172988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f0166a10 0x5579f016f2a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009230 tx=0x7f5cf00308f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb788753de1aee5d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.777+0000 7f5cfa564640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5ce00a3820 0x7f5ce00a5ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009fd0 tx=0x7f5cec004ab0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.777+0000 7f5cdffff640 1 -- 172.21.15.82:0/1281172988 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00046c0 con 0x5579f0166a10 2024-03-27T07:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.777+0000 7f5cdffff640 1 -- 172.21.15.82:0/1281172988 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5cf0034030 con 0x5579f0166a10 2024-03-27T07:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.777+0000 7f5cdffff640 1 -- 172.21.15.82:0/1281172988 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000f530 con 0x5579f0166a10 2024-03-27T07:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.778+0000 7f5cfebaf740 1 -- 172.21.15.82:0/1281172988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f0166a10 msgr2=0x5579f016f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.778+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/1281172988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f0166a10 0x5579f016f2a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0009230 tx=0x7f5cf00308f0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.778+0000 7f5cfebaf740 1 -- 172.21.15.82:0/1281172988 shutdown_connections 2024-03-27T07:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.778+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/1281172988 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f0171bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.778+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/1281172988 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f0166a10 0x5579f016f2a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.778+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/1281172988 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f01660f0 0x5579f01664d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.778+0000 7f5cfebaf740 1 -- 172.21.15.82:0/1281172988 >> 172.21.15.82:0/1281172988 conn(0x5579f0160a10 msgr2=0x5579f0160df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.778+0000 7f5cfebaf740 1 -- 172.21.15.82:0/1281172988 shutdown_connections 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.778+0000 7f5cfebaf740 1 -- 172.21.15.82:0/1281172988 wait complete. 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cfebaf740 1 -- start start 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cfebaf740 1 Processor -- start 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 0x5579f016c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f016cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f016d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5579f00c5e00 con 0x5579f0166a10 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x5579f0072520 con 0x5579f016f7e0 2024-03-27T07:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x5579f00858e0 con 0x5579f01660f0 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cfebaf740 10 client.0 _ll_register_callbacks cb 0x5579f00c0a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cf9d63640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 0x5579f016c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cf9d63640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 0x5579f016c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:55806/0 (socket says 172.21.15.82:55806) 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.779+0000 7f5cf9d63640 1 -- 172.21.15.82:0/3880157066 learned_addr learned my addr 172.21.15.82:0/3880157066 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cf9562640 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f016cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cfa564640 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f016d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cf9562640 1 -- 172.21.15.82:0/3880157066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 msgr2=0x5579f016c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cf9562640 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 0x5579f016c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cf9562640 1 -- 172.21.15.82:0/3880157066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 msgr2=0x5579f016d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cf9562640 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f016d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cf9562640 1 -- 172.21.15.82:0/3880157066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579efeaa620 con 0x5579f0166a10 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cf9d63640 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 0x5579f016c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cf9562640 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f016cd20 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40cdca0 tx=0x7f5ce401da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd273ac9c070324 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cdd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/3880157066 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce409c040 con 0x5579f0166a10 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/3880157066 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f5ce400ad40 con 0x5579f0166a10 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.780+0000 7f5cfebaf740 1 -- 172.21.15.82:0/3880157066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5cf0034030 con 0x5579f0166a10 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/3880157066 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5ce409cde0 con 0x5579f0166a10 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cfebaf740 10 client.17325 fetch_fsmap learned FSMap version 39 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cfebaf740 1 -- 172.21.15.82:0/3880157066 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5579f017e2b0 con 0x5579f0166a10 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/3880157066 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce40071c0 con 0x5579f0166a10 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/3880157066 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f5ce40a4ec0 con 0x5579f0166a10 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cfebaf740 10 client.17325 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cfebaf740 10 client.17325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cfebaf740 20 client.17325 populate_metadata read hostname 'smithi082' 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579f017f720 0x5579f0181b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cfebaf740 4 client.17325 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.781+0000 7f5cfebaf740 1 -- 172.21.15.82:0/3880157066 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5cf0034030 con 0x5579f017f720 2024-03-27T07:36:48.785 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.782+0000 7f5cf9d63640 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579f017f720 0x5579f0181b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:48 smithi153 ceph-mon[36179]: pgmap v414: 97 pgs: 15 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 53 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 157 op/s 2024-03-27T07:36:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.782+0000 7f5cdd7fa640 10 client.17325 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.782+0000 7f5cf9d63640 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579f017f720 0x5579f0181b10 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4694c9fe0a60ac6b server_cookie=1aace3f82ea26c59 in_seq=0 out_seq=0 2024-03-27T07:36:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.783+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/3880157066 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7f5cf0034030 con 0x5579f017f720 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.783+0000 7f5cdd7fa640 10 client.17325 handle_command_reply: tid=0 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.783+0000 7f5cfebaf740 1 client.17325 shutdown 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 1 -- 172.21.15.82:0/3880157066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 msgr2=0x5579f016cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f016cd20 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40cdca0 tx=0x7f5ce401da50 comp rx=0 tx=0).stop 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 1 -- 172.21.15.82:0/3880157066 shutdown_connections 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579f017f720 0x5579f0181b10 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cdd7fa640 0 client.17325 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f016cd20 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f016d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/3880157066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 0x5579f016c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 1 -- 172.21.15.82:0/3880157066 >> 172.21.15.82:0/3880157066 conn(0x5579f0160a10 msgr2=0x5579f0162760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 1 -- 172.21.15.82:0/3880157066 shutdown_connections 2024-03-27T07:36:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 1 -- 172.21.15.82:0/3880157066 wait complete. 2024-03-27T07:36:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.784+0000 7f5cfebaf740 20 client.17325 trim_cache size 0 max 16384 2024-03-27T07:36:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cfebaf740 1 Processor -- start 2024-03-27T07:36:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cfebaf740 1 -- start start 2024-03-27T07:36:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 0x5579f016ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f017adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f0187420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41adf50 con 0x5579f0166a10 2024-03-27T07:36:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf41ab7e0 con 0x5579f016f7e0 2024-03-27T07:36:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf419c490 con 0x5579f01660f0 2024-03-27T07:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cf9562640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f017adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cf9562640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f017adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42758/0 (socket says 172.21.15.82:42758) 2024-03-27T07:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cf9562640 1 -- 172.21.15.82:0/4150183206 learned_addr learned my addr 172.21.15.82:0/4150183206 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.803+0000 7f5cfa564640 1 --2- 172.21.15.82:0/4150183206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f0187420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.804+0000 7f5cf9562640 1 -- 172.21.15.82:0/4150183206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 msgr2=0x5579f016ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.804+0000 7f5cf9562640 1 --2- 172.21.15.82:0/4150183206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 0x5579f016ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.804+0000 7f5cf9562640 1 -- 172.21.15.82:0/4150183206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 msgr2=0x5579f0187420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.804+0000 7f5cf9562640 1 --2- 172.21.15.82:0/4150183206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f0187420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.804+0000 7f5cf9562640 1 -- 172.21.15.82:0/4150183206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f016ad50 con 0x5579f0166a10 2024-03-27T07:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.804+0000 7f5cf9562640 1 --2- 172.21.15.82:0/4150183206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f017adf0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40990b0 tx=0x7f5ce409abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57905c852f146f82 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.805+0000 7f5cdf7fe640 1 -- 172.21.15.82:0/4150183206 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce409c040 con 0x5579f0166a10 2024-03-27T07:36:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.805+0000 7f5cdf7fe640 1 -- 172.21.15.82:0/4150183206 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce40071c0 con 0x5579f0166a10 2024-03-27T07:36:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.805+0000 7f5cdf7fe640 1 -- 172.21.15.82:0/4150183206 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40056b0 con 0x5579f0166a10 2024-03-27T07:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.806+0000 7f5cfebaf740 1 -- 172.21.15.82:0/4150183206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 msgr2=0x5579f017adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.806+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/4150183206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f017adf0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40990b0 tx=0x7f5ce409abf0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.806+0000 7f5cfebaf740 1 -- 172.21.15.82:0/4150183206 shutdown_connections 2024-03-27T07:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.806+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/4150183206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f017adf0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.806+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/4150183206 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f016f7e0 0x5579f0187420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.806+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/4150183206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f01660f0 0x5579f016ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.806+0000 7f5cfebaf740 1 -- 172.21.15.82:0/4150183206 >> 172.21.15.82:0/4150183206 conn(0x5579f0160a10 msgr2=0x5579f016b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.806+0000 7f5cfebaf740 1 -- 172.21.15.82:0/4150183206 shutdown_connections 2024-03-27T07:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.806+0000 7f5cfebaf740 1 -- 172.21.15.82:0/4150183206 wait complete. 2024-03-27T07:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.806+0000 7f5cfebaf740 1 -- start start 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.807+0000 7f5cfebaf740 1 Processor -- start 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.807+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f01660f0 0x5579f0177610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.807+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f0168e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.807+0000 7f5cfebaf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f016f7e0 0x5579f01693a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.807+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf419cb00 con 0x5579f0166a10 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf419df70 con 0x5579f01660f0 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cfebaf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5cf419d1d0 con 0x5579f016f7e0 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cf9562640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f0168e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cf9562640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f0168e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42764/0 (socket says 172.21.15.82:42764) 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cf9562640 1 -- 172.21.15.82:0/328268015 learned_addr learned my addr 172.21.15.82:0/328268015 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cfebaf740 10 client.0 _ll_register_callbacks cb 0x7f5ce400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:36:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cfa564640 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f016f7e0 0x5579f01693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cfa564640 1 -- 172.21.15.82:0/328268015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f01660f0 msgr2=0x5579f0177610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cfa564640 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f01660f0 0x5579f0177610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cfa564640 1 -- 172.21.15.82:0/328268015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 msgr2=0x5579f0168e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cfa564640 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f0168e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.808+0000 7f5cfa564640 1 -- 172.21.15.82:0/328268015 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579f0169990 con 0x5579f016f7e0 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.809+0000 7f5cfa564640 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f016f7e0 0x5579f01693a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5579f01659d0 tx=0x7f5cec004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8dab2001850e2ed server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.809+0000 7f5cdd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.809+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/328268015 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cec031060 con 0x5579f016f7e0 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.809+0000 7f5cfebaf740 1 -- 172.21.15.82:0/328268015 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ce40071c0 con 0x5579f016f7e0 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.809+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/328268015 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f5cec010430 con 0x5579f016f7e0 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.809+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/328268015 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5cec010630 con 0x5579f016f7e0 2024-03-27T07:36:48.810 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.809+0000 7f5cfebaf740 10 client.27172 fetch_fsmap learned FSMap version 39 2024-03-27T07:36:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.809+0000 7f5cfebaf740 1 -- 172.21.15.82:0/328268015 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5579f01e58b0 con 0x5579f016f7e0 2024-03-27T07:36:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.810+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/328268015 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5ce40071c0 con 0x5579f016f7e0 2024-03-27T07:36:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.810+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/328268015 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f5cec01f040 con 0x5579f016f7e0 2024-03-27T07:36:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.810+0000 7f5cfebaf740 10 client.27172 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:36:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.810+0000 7f5cfebaf740 10 client.27172 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:36:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.810+0000 7f5cfebaf740 20 client.27172 populate_metadata read hostname 'smithi082' 2024-03-27T07:36:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.810+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579f017f720 0x5579f01e8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:36:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.810+0000 7f5cfebaf740 4 client.27172 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:36:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.810+0000 7f5cfebaf740 1 -- 172.21.15.82:0/328268015 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5579f00d7390 con 0x5579f017f720 2024-03-27T07:36:48.811 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.810+0000 7f5cf9d63640 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579f017f720 0x5579f01e8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:36:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.817+0000 7f5cf9d63640 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579f017f720 0x5579f01e8070 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672c198563d0632a server_cookie=f0df7c37fd2e5966 in_seq=0 out_seq=0 2024-03-27T07:36:48.816 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.817+0000 7f5cdd7fa640 10 client.27172 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:48.903 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.903+0000 7f5cdd7fa640 1 -- 172.21.15.82:0/328268015 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5579f00d7390 con 0x5579f017f720 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.903+0000 7f5cdd7fa640 10 client.27172 handle_command_reply: tid=0 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.903+0000 7f5cfebaf740 1 client.27172 shutdown 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 1 -- 172.21.15.82:0/328268015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f016f7e0 msgr2=0x5579f01693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f016f7e0 0x5579f01693a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x5579f01659d0 tx=0x7f5cec004a40 comp rx=0 tx=0).stop 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 1 -- 172.21.15.82:0/328268015 shutdown_connections 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x5579f017f720 0x5579f01e8070 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5579f0166a10 0x5579f0168e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5579f016f7e0 0x5579f01693a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 1 --2- 172.21.15.82:0/328268015 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x5579f01660f0 0x5579f0177610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 1 -- 172.21.15.82:0/328268015 >> 172.21.15.82:0/328268015 conn(0x5579f0160a10 msgr2=0x5579f015f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cdd7fa640 0 client.27172 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 1 -- 172.21.15.82:0/328268015 shutdown_connections 2024-03-27T07:36:48.904 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 1 -- 172.21.15.82:0/328268015 wait complete. 2024-03-27T07:36:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.904+0000 7f5cfebaf740 20 client.27172 trim_cache size 0 max 16384 2024-03-27T07:36:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:36:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:36:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:36:48.905 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/133166164 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5ce00a3820 msgr2=0x7f5ce00a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5ce00a3820 0x7f5ce00a5ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009fd0 tx=0x7f5cec004ab0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/133166164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf4069b90 msgr2=0x7f5cf41a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf4069b90 0x7f5cf41a4bd0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400e9f0 tx=0x7f5ce400edf0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/133166164 shutdown_connections 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f5ce00a3820 0x7f5ce00a5ce0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5cf4069b90 0x7f5cf41a4bd0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5cf4107c60 0x7f5cf419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 --2- 172.21.15.82:0/133166164 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f5cf40691d0 0x7f5cf41a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/133166164 >> 172.21.15.82:0/133166164 conn(0x7f5cf40778a0 msgr2=0x7f5cf40ff8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/133166164 shutdown_connections 2024-03-27T07:36:48.906 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:36:48.906+0000 7f5cfbfc7640 1 -- 172.21.15.82:0/133166164 wait complete. 2024-03-27T07:36:50.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:50 smithi082 ceph-mon[32178]: pgmap v415: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 150 op/s 2024-03-27T07:36:50.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:50 smithi149 ceph-mon[36065]: pgmap v415: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 150 op/s 2024-03-27T07:36:50.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:50 smithi153 ceph-mon[36179]: pgmap v415: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 150 op/s 2024-03-27T07:36:52.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:52 smithi082 ceph-mon[32178]: pgmap v416: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-03-27T07:36:52.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:52 smithi149 ceph-mon[36065]: pgmap v416: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-03-27T07:36:52.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:52 smithi153 ceph-mon[36179]: pgmap v416: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.9 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-03-27T07:36:54.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:54 smithi082 ceph-mon[32178]: pgmap v417: 97 pgs: 13 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 57 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 179 op/s 2024-03-27T07:36:54.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:54 smithi149 ceph-mon[36065]: pgmap v417: 97 pgs: 13 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 57 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 179 op/s 2024-03-27T07:36:54.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:54 smithi153 ceph-mon[36179]: pgmap v417: 97 pgs: 13 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 57 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 179 op/s 2024-03-27T07:36:56.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:56 smithi082 ceph-mon[32178]: pgmap v418: 97 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 64 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 147 op/s 2024-03-27T07:36:56.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:56 smithi149 ceph-mon[36065]: pgmap v418: 97 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 64 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 147 op/s 2024-03-27T07:36:56.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:56 smithi153 ceph-mon[36179]: pgmap v418: 97 pgs: 12 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 64 active+clean; 1.8 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 147 op/s 2024-03-27T07:36:58.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:36:58 smithi082 ceph-mon[32178]: pgmap v419: 97 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 66 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 184 op/s 2024-03-27T07:36:58.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:36:58 smithi149 ceph-mon[36065]: pgmap v419: 97 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 66 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 184 op/s 2024-03-27T07:36:58.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:36:58 smithi153 ceph-mon[36179]: pgmap v419: 97 pgs: 10 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 66 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 184 op/s 2024-03-27T07:37:00.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:00 smithi082 ceph-mon[32178]: pgmap v420: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2024-03-27T07:37:00.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:00 smithi149 ceph-mon[36065]: pgmap v420: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2024-03-27T07:37:00.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:00 smithi153 ceph-mon[36179]: pgmap v420: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2024-03-27T07:37:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 -- 172.21.15.82:0/712057182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7478107c60 msgr2=0x7f7478108040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 --2- 172.21.15.82:0/712057182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7478107c60 0x7f7478108040 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f7468009900 tx=0x7f746802bc30 comp rx=0 tx=0).stop 2024-03-27T07:37:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 -- 172.21.15.82:0/712057182 shutdown_connections 2024-03-27T07:37:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 --2- 172.21.15.82:0/712057182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478069b70 0x7f747810e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 --2- 172.21.15.82:0/712057182 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f74780691d0 0x7f7478069630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 --2- 172.21.15.82:0/712057182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7478107c60 0x7f7478108040 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 -- 172.21.15.82:0/712057182 >> 172.21.15.82:0/712057182 conn(0x7f74780778a0 msgr2=0x7f7478077cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 -- 172.21.15.82:0/712057182 shutdown_connections 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 -- 172.21.15.82:0/712057182 wait complete. 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 Processor -- start 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.006+0000 7f747e93e640 1 -- start start 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f747e93e640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780691d0 0x7f7478198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f747e93e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478069b70 0x7f74781988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f747e93e640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7478107c60 0x7f747819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f747e93e640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7478111ed0 con 0x7f74780691d0 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f747e93e640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f7478111d50 con 0x7f7478107c60 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f747e93e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7478112050 con 0x7f7478069b70 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f7477fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780691d0 0x7f7478198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f74777fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478069b70 0x7f74781988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f7477fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780691d0 0x7f7478198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33422/0 (socket says 172.21.15.82:33422) 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f7477fff640 1 -- 172.21.15.82:0/1153264785 learned_addr learned my addr 172.21.15.82:0/1153264785 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f747cedb640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7478107c60 0x7f747819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f7477fff640 1 -- 172.21.15.82:0/1153264785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478069b70 msgr2=0x7f74781988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f7477fff640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478069b70 0x7f74781988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f7477fff640 1 -- 172.21.15.82:0/1153264785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7478107c60 msgr2=0x7f747819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f7477fff640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7478107c60 0x7f747819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f7477fff640 1 -- 172.21.15.82:0/1153264785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747819d310 con 0x7f74780691d0 2024-03-27T07:37:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.007+0000 7f7477fff640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780691d0 0x7f7478198370 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7468006010 tx=0x7f746802cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.008+0000 7f74757fa640 1 -- 172.21.15.82:0/1153264785 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468041070 con 0x7f74780691d0 2024-03-27T07:37:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.008+0000 7f747e93e640 1 -- 172.21.15.82:0/1153264785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747819d5a0 con 0x7f74780691d0 2024-03-27T07:37:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.008+0000 7f74757fa640 1 -- 172.21.15.82:0/1153264785 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7468004450 con 0x7f74780691d0 2024-03-27T07:37:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.008+0000 7f74757fa640 1 -- 172.21.15.82:0/1153264785 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7468003e00 con 0x7f74780691d0 2024-03-27T07:37:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.008+0000 7f747e93e640 1 -- 172.21.15.82:0/1153264785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74781a4e90 con 0x7f74780691d0 2024-03-27T07:37:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.010+0000 7f74757fa640 1 -- 172.21.15.82:0/1153264785 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f7468044070 con 0x7f74780691d0 2024-03-27T07:37:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f74757fa640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74600a38a0 0x7f74600a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f74757fa640 1 -- 172.21.15.82:0/1153264785 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f74680f19a0 con 0x7f74780691d0 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f74777fe640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74600a38a0 0x7f74600a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f7481602740 1 Processor -- start 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f7481602740 1 -- start start 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f7481602740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f7481602740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f89f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f7481602740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f89ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f7481602740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561b0f86bcd0 con 0x561b0f8b2770 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f7481602740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561b0f7b0950 con 0x561b0f89fae0 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f7481602740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561b0f808e50 con 0x561b0f8b3120 2024-03-27T07:37:02.012 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f74777fe640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74600a38a0 0x7f74600a5d60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7478077f10 tx=0x7f746c005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.011+0000 7f7477fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f74777fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f89f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f74777fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f89f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:34072/0 (socket says 172.21.15.82:34072) 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f74777fe640 1 -- 172.21.15.82:0/4032396104 learned_addr learned my addr 172.21.15.82:0/4032396104 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f747cedb640 1 --2- 172.21.15.82:0/4032396104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f89ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f7477fff640 1 -- 172.21.15.82:0/4032396104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 msgr2=0x561b0f89f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f7477fff640 1 --2- 172.21.15.82:0/4032396104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f89f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f7477fff640 1 -- 172.21.15.82:0/4032396104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 msgr2=0x561b0f89ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f7477fff640 1 --2- 172.21.15.82:0/4032396104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f89ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f7477fff640 1 -- 172.21.15.82:0/4032396104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b0f51d210 con 0x561b0f8b2770 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f747cedb640 1 --2- 172.21.15.82:0/4032396104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f89ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f7477fff640 1 --2- 172.21.15.82:0/4032396104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8b2b50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f74680ef200 tx=0x7f74680bdb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36c547a0c8e429f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f745e7fc640 1 -- 172.21.15.82:0/4032396104 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746804b040 con 0x561b0f8b2770 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f745e7fc640 1 -- 172.21.15.82:0/4032396104 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74680bdcf0 con 0x561b0f8b2770 2024-03-27T07:37:02.013 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.012+0000 7f745e7fc640 1 -- 172.21.15.82:0/4032396104 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74680ef370 con 0x561b0f8b2770 2024-03-27T07:37:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.013+0000 7f7481602740 1 -- 172.21.15.82:0/4032396104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 msgr2=0x561b0f8b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.013+0000 7f7481602740 1 --2- 172.21.15.82:0/4032396104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8b2b50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f74680ef200 tx=0x7f74680bdb80 comp rx=0 tx=0).stop 2024-03-27T07:37:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.013+0000 7f7481602740 1 -- 172.21.15.82:0/4032396104 shutdown_connections 2024-03-27T07:37:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.013+0000 7f7481602740 1 --2- 172.21.15.82:0/4032396104 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f89ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.013+0000 7f7481602740 1 --2- 172.21.15.82:0/4032396104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f89f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.020 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.013+0000 7f7481602740 1 --2- 172.21.15.82:0/4032396104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8b2b50 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.013+0000 7f7481602740 1 -- 172.21.15.82:0/4032396104 >> 172.21.15.82:0/4032396104 conn(0x561b0f8a1f80 msgr2=0x561b0f8a2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.013+0000 7f7481602740 1 -- 172.21.15.82:0/4032396104 shutdown_connections 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.013+0000 7f7481602740 1 -- 172.21.15.82:0/4032396104 wait complete. 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.014+0000 7f7481602740 1 -- start start 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.014+0000 7f7481602740 1 Processor -- start 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.014+0000 7f7481602740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f89fae0 0x561b0f8b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.014+0000 7f7481602740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f8b2770 0x561b0f8b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.014+0000 7f7481602740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b3120 0x561b0f8b7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.014+0000 7f7481602740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561b0f804e00 con 0x561b0f8b3120 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.014+0000 7f7481602740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x561b0f7b1520 con 0x561b0f8b2770 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.014+0000 7f7481602740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x561b0f7c48e0 con 0x561b0f89fae0 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f7481602740 10 client.0 _ll_register_callbacks cb 0x561b0f7ffa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74777fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f8b2770 0x561b0f8b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.021 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74777fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f8b2770 0x561b0f8b6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:34798/0 (socket says 172.21.15.82:34798) 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74777fe640 1 -- 172.21.15.82:0/2296214439 learned_addr learned my addr 172.21.15.82:0/2296214439 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f7477fff640 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f89fae0 0x561b0f8b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f747cedb640 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b3120 0x561b0f8b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74777fe640 1 -- 172.21.15.82:0/2296214439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f89fae0 msgr2=0x561b0f8b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74777fe640 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f89fae0 0x561b0f8b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74777fe640 1 -- 172.21.15.82:0/2296214439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b3120 msgr2=0x561b0f8b7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74777fe640 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b3120 0x561b0f8b7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74777fe640 1 -- 172.21.15.82:0/2296214439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b0f5e9620 con 0x561b0f8b2770 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f7477fff640 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f89fae0 0x561b0f8b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74777fe640 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f8b2770 0x561b0f8b6ce0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f746c003880 tx=0x7f746c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c5759c3845561 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74577fe640 10 client.0 ms_handle_connect on v2:172.21.15.149:3300/0 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74577fe640 1 -- 172.21.15.82:0/2296214439 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c00e720 con 0x561b0f8b2770 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f7481602740 1 -- 172.21.15.82:0/2296214439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74680bdcf0 con 0x561b0f8b2770 2024-03-27T07:37:02.022 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.015+0000 7f74577fe640 1 -- 172.21.15.82:0/2296214439 <== mon.2 v2:172.21.15.149:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f746c00e8c0 con 0x561b0f8b2770 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f74577fe640 1 -- 172.21.15.82:0/2296214439 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f746c00eb00 con 0x561b0f8b2770 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f7481602740 10 client.27170 fetch_fsmap learned FSMap version 39 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f7481602740 1 -- 172.21.15.82:0/2296214439 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561b0f8c59a0 con 0x561b0f8b2770 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f74577fe640 1 -- 172.21.15.82:0/2296214439 <== mon.2 v2:172.21.15.149:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74680bdcf0 con 0x561b0f8b2770 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f74577fe640 1 -- 172.21.15.82:0/2296214439 <== mon.2 v2:172.21.15.149:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f746c01d410 con 0x561b0f8b2770 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f7481602740 10 client.27170 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f7481602740 10 client.27170 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f7481602740 20 client.27170 populate_metadata read hostname 'smithi082' 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f7481602740 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561b0f8c6f20 0x561b0f8c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f7481602740 4 client.27170 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f7481602740 1 -- 172.21.15.82:0/2296214439 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b0f816390 con 0x561b0f8c6f20 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.016+0000 7f7477fff640 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561b0f8c6f20 0x561b0f8c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.017+0000 7f74577fe640 10 client.27170 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:37:02.023 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.017+0000 7f7477fff640 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561b0f8c6f20 0x561b0f8c9310 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9db2e2161f94604 server_cookie=5d03603d1d3ab049 in_seq=0 out_seq=0 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f74577fe640 1 -- 172.21.15.82:0/2296214439 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561b0f816390 con 0x561b0f8c6f20 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f74577fe640 10 client.27170 handle_command_reply: tid=0 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 client.27170 shutdown 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 -- 172.21.15.82:0/2296214439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f8b2770 msgr2=0x561b0f8b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f8b2770 0x561b0f8b6ce0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f746c003880 tx=0x7f746c004730 comp rx=0 tx=0).stop 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 -- 172.21.15.82:0/2296214439 shutdown_connections 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561b0f8c6f20 0x561b0f8c9310 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b3120 0x561b0f8b7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f8b2770 0x561b0f8b6ce0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 --2- 172.21.15.82:0/2296214439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f89fae0 0x561b0f8b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f74577fe640 0 client.27170 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 -- 172.21.15.82:0/2296214439 >> 172.21.15.82:0/2296214439 conn(0x561b0f8a1f80 msgr2=0x561b0f8a16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 -- 172.21.15.82:0/2296214439 shutdown_connections 2024-03-27T07:37:02.024 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 1 -- 172.21.15.82:0/2296214439 wait complete. 2024-03-27T07:37:02.025 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.018+0000 7f7481602740 20 client.27170 trim_cache size 0 max 16384 2024-03-27T07:37:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f7481602740 1 Processor -- start 2024-03-27T07:37:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f7481602740 1 -- start start 2024-03-27T07:37:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f7481602740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f8b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f7481602740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8c2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f7481602740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f8b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f7481602740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f74781adf80 con 0x561b0f8b2770 2024-03-27T07:37:02.036 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f7481602740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f74781ab790 con 0x561b0f89fae0 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f7481602740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f74781a95e0 con 0x561b0f8b3120 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f74777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f747cedb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f8b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f74777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8c2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33442/0 (socket says 172.21.15.82:33442) 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f74777fe640 1 -- 172.21.15.82:0/1021881249 learned_addr learned my addr 172.21.15.82:0/1021881249 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f7477fff640 1 --2- 172.21.15.82:0/1021881249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f8b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f74777fe640 1 -- 172.21.15.82:0/1021881249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 msgr2=0x561b0f8b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f74777fe640 1 --2- 172.21.15.82:0/1021881249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f8b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f74777fe640 1 -- 172.21.15.82:0/1021881249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 msgr2=0x561b0f8b8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f74777fe640 1 --2- 172.21.15.82:0/1021881249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f8b8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.036+0000 7f74777fe640 1 -- 172.21.15.82:0/1021881249 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b0f8c9680 con 0x561b0f8b2770 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.037+0000 7f74777fe640 1 --2- 172.21.15.82:0/1021881249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8c2410 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f746c0118d0 tx=0x7f746c004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec10184df91ab4d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.037+0000 7f745dffb640 1 -- 172.21.15.82:0/1021881249 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c003f70 con 0x561b0f8b2770 2024-03-27T07:37:02.037 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.037+0000 7f745dffb640 1 -- 172.21.15.82:0/1021881249 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f746c00eca0 con 0x561b0f8b2770 2024-03-27T07:37:02.038 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.037+0000 7f745dffb640 1 -- 172.21.15.82:0/1021881249 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f746c027420 con 0x561b0f8b2770 2024-03-27T07:37:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.037+0000 7f7481602740 1 -- 172.21.15.82:0/1021881249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 msgr2=0x561b0f8c2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.038+0000 7f7481602740 1 --2- 172.21.15.82:0/1021881249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8c2410 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f746c0118d0 tx=0x7f746c004520 comp rx=0 tx=0).stop 2024-03-27T07:37:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.038+0000 7f7481602740 1 -- 172.21.15.82:0/1021881249 shutdown_connections 2024-03-27T07:37:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.038+0000 7f7481602740 1 --2- 172.21.15.82:0/1021881249 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8c2410 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.038+0000 7f7481602740 1 --2- 172.21.15.82:0/1021881249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f8b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.038+0000 7f7481602740 1 --2- 172.21.15.82:0/1021881249 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f8b8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.038+0000 7f7481602740 1 -- 172.21.15.82:0/1021881249 >> 172.21.15.82:0/1021881249 conn(0x561b0f8a1f80 msgr2=0x561b0f8b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.038+0000 7f7481602740 1 -- 172.21.15.82:0/1021881249 shutdown_connections 2024-03-27T07:37:02.041 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.038+0000 7f7481602740 1 -- 172.21.15.82:0/1021881249 wait complete. 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.038+0000 7f7481602740 1 -- start start 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.038+0000 7f7481602740 1 Processor -- start 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f7481602740 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f8bed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f7481602740 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f7481602740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f8ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f7481602740 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f74781a9c50 con 0x561b0f8b2770 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f7481602740 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f74781ab0c0 con 0x561b0f89fae0 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f74777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f7481602740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f74781aa320 con 0x561b0f8b3120 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f7477fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f8bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f74777fe640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33450/0 (socket says 172.21.15.82:33450) 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f74777fe640 1 -- 172.21.15.82:0/1899443557 learned_addr learned my addr 172.21.15.82:0/1899443557 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:02.042 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f747cedb640 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f8ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f7481602740 10 client.0 _ll_register_callbacks cb 0x7f746c004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f747cedb640 1 -- 172.21.15.82:0/1899443557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 msgr2=0x561b0f8bed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f747cedb640 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f8bed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f747cedb640 1 -- 172.21.15.82:0/1899443557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 msgr2=0x561b0f8cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f747cedb640 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f747cedb640 1 -- 172.21.15.82:0/1899443557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b0f8ce9c0 con 0x561b0f8b3120 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f74777fe640 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f747cedb640 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f8ce190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x561b0f89f960 tx=0x7f7470003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30dc5cab631f417e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.039+0000 7f74577fe640 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f74577fe640 1 -- 172.21.15.82:0/1899443557 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470022060 con 0x561b0f8b3120 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f7481602740 1 -- 172.21.15.82:0/1899443557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f746c00eca0 con 0x561b0f8b3120 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f74577fe640 1 -- 172.21.15.82:0/1899443557 <== mon.1 v2:172.21.15.153:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f7470012b20 con 0x561b0f8b3120 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f74577fe640 1 -- 172.21.15.82:0/1899443557 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7470012d20 con 0x561b0f8b3120 2024-03-27T07:37:02.043 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f7481602740 10 client.27190 fetch_fsmap learned FSMap version 39 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f7481602740 1 -- 172.21.15.82:0/1899443557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561b0f92d310 con 0x561b0f8b3120 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f74577fe640 1 -- 172.21.15.82:0/1899443557 <== mon.1 v2:172.21.15.153:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f746c00eca0 con 0x561b0f8b3120 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f74577fe640 1 -- 172.21.15.82:0/1899443557 <== mon.1 v2:172.21.15.153:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f7470010430 con 0x561b0f8b3120 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f7481602740 10 client.27190 fetch_fsmap finished waiting for FSMap version 39 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f7481602740 10 client.27190 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f7481602740 20 client.27190 populate_metadata read hostname 'smithi082' 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f7481602740 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561b0f92db00 0x561b0f92ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f7481602740 4 client.27190 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.040+0000 7f7481602740 1 -- 172.21.15.82:0/1899443557 --> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b0f8106e0 con 0x561b0f92db00 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.041+0000 7f7477fff640 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561b0f92db00 0x561b0f92ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.041+0000 7f74577fe640 10 client.27190 ms_handle_connect on v2:172.21.15.149:6838/3930771704 2024-03-27T07:37:02.044 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.041+0000 7f7477fff640 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561b0f92db00 0x561b0f92ff20 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2e67b5987c22f40 server_cookie=4033c06f0a6fb58a in_seq=0 out_seq=0 2024-03-27T07:37:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.055+0000 7f74577fe640 1 -- 172.21.15.82:0/1899443557 <== mds.0 v2:172.21.15.149:6838/3930771704 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b0f8106e0 con 0x561b0f92db00 2024-03-27T07:37:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.055+0000 7f74577fe640 10 client.27190 handle_command_reply: tid=0 2024-03-27T07:37:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.055+0000 7f7481602740 1 client.27190 shutdown 2024-03-27T07:37:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.055+0000 7f7481602740 1 -- 172.21.15.82:0/1899443557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 msgr2=0x561b0f8ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.055+0000 7f7481602740 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f8ce190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x561b0f89f960 tx=0x7f7470003f90 comp rx=0 tx=0).stop 2024-03-27T07:37:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f7481602740 1 -- 172.21.15.82:0/1899443557 shutdown_connections 2024-03-27T07:37:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f7481602740 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.149:6838/3930771704,v1:172.21.15.149:6839/3930771704] conn(0x561b0f92db00 0x561b0f92ff20 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f7481602740 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561b0f8b2770 0x561b0f8cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f7481602740 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561b0f8b3120 0x561b0f8ce190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.055 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f7481602740 1 --2- 172.21.15.82:0/1899443557 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x561b0f89fae0 0x561b0f8bed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f74577fe640 0 client.27190 ms_handle_reset on v2:172.21.15.149:6838/3930771704 2024-03-27T07:37:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f7481602740 1 -- 172.21.15.82:0/1899443557 >> 172.21.15.82:0/1899443557 conn(0x561b0f8a1f80 msgr2=0x561b0f8b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f7481602740 1 -- 172.21.15.82:0/1899443557 shutdown_connections 2024-03-27T07:37:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f7481602740 1 -- 172.21.15.82:0/1899443557 wait complete. 2024-03-27T07:37:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f7481602740 20 client.27190 trim_cache size 0 max 16384 2024-03-27T07:37:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:{ 2024-03-27T07:37:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "message": "", 2024-03-27T07:37:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout: "return_code": 0 2024-03-27T07:37:02.056 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stdout:} 2024-03-27T07:37:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 -- 172.21.15.82:0/1153264785 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74600a38a0 msgr2=0x7f74600a5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74600a38a0 0x7f74600a5d60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7478077f10 tx=0x7f746c005f90 comp rx=0 tx=0).stop 2024-03-27T07:37:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 -- 172.21.15.82:0/1153264785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780691d0 msgr2=0x7f7478198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:02.057 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780691d0 0x7f7478198370 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7468006010 tx=0x7f746802cb30 comp rx=0 tx=0).stop 2024-03-27T07:37:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 -- 172.21.15.82:0/1153264785 shutdown_connections 2024-03-27T07:37:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f74600a38a0 0x7f74600a5d60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f7478107c60 0x7f747819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7478069b70 0x7f74781988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 --2- 172.21.15.82:0/1153264785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74780691d0 0x7f7478198370 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 -- 172.21.15.82:0/1153264785 >> 172.21.15.82:0/1153264785 conn(0x7f74780778a0 msgr2=0x7f74780ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 -- 172.21.15.82:0/1153264785 shutdown_connections 2024-03-27T07:37:02.058 INFO:teuthology.task.background_exec.ubuntu@smithi082.front.sepia.ceph.com.smithi082.stderr:2024-03-27T07:37:02.056+0000 7f747e93e640 1 -- 172.21.15.82:0/1153264785 wait complete. 2024-03-27T07:37:02.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:02 smithi082 ceph-mon[32178]: pgmap v421: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-03-27T07:37:02.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:02 smithi149 ceph-mon[36065]: pgmap v421: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-03-27T07:37:02.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:02 smithi153 ceph-mon[36179]: pgmap v421: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 153 op/s 2024-03-27T07:37:03.491 INFO:tasks.workunit:Stopping ['suites/blogbench.sh'] on client.0... 2024-03-27T07:37:03.491 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-27T07:37:03.803 DEBUG:teuthology.parallel:result is None 2024-03-27T07:37:03.804 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-27T07:37:03.841 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-27T07:37:03.841 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-03-27T07:37:03.853 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T07:37:03.889 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-03-27T07:37:03.900 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-03-27T07:37:03.900 INFO:teuthology.task.exec:Executing custom commands... 2024-03-27T07:37:03.900 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T07:37:03.900 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-03-27T07:37:03.958 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-03-27T07:37:04.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-03-27T07:37:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.170+0000 7f01fae9d640 1 -- 172.21.15.82:0/165830756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f4101640 msgr2=0x7f01f410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.170+0000 7f01fae9d640 1 --2- 172.21.15.82:0/165830756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f4101640 0x7f01f410d870 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009ca0 tx=0x7f01ec02c0f0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 -- 172.21.15.82:0/165830756 shutdown_connections 2024-03-27T07:37:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 --2- 172.21.15.82:0/165830756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f4101640 0x7f01f410d870 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 --2- 172.21.15.82:0/165830756 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01f4100ca0 0x7f01f4101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 --2- 172.21.15.82:0/165830756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f4106ad0 0x7f01f4106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 -- 172.21.15.82:0/165830756 >> 172.21.15.82:0/165830756 conn(0x7f01f40778b0 msgr2=0x7f01f4077cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 -- 172.21.15.82:0/165830756 shutdown_connections 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 -- 172.21.15.82:0/165830756 wait complete. 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 Processor -- start 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 -- start start 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f4100ca0 0x7f01f41982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f4101640 0x7f01f4198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01f4106ad0 0x7f01f419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4110e50 con 0x7f01f4100ca0 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4110cd0 con 0x7f01f4106ad0 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01fae9d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4110fd0 con 0x7f01f4101640 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01f8c39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f4100ca0 0x7f01f41982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01f8c39640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f4100ca0 0x7f01f41982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33476/0 (socket says 172.21.15.82:33476) 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.171+0000 7f01f8c39640 1 -- 172.21.15.82:0/2804646500 learned_addr learned my addr 172.21.15.82:0/2804646500 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f3fff640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f4101640 0x7f01f4198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f943a640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01f4106ad0 0x7f01f419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f8c39640 1 -- 172.21.15.82:0/2804646500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f4101640 msgr2=0x7f01f4198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f8c39640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f4101640 0x7f01f4198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f8c39640 1 -- 172.21.15.82:0/2804646500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01f4106ad0 msgr2=0x7f01f419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f8c39640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01f4106ad0 0x7f01f419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f8c39640 1 -- 172.21.15.82:0/2804646500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f419d2d0 con 0x7f01f4100ca0 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f8c39640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f4100ca0 0x7f01f41982e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f01e400e9f0 tx=0x7f01e400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f1ffb640 1 -- 172.21.15.82:0/2804646500 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e400cd80 con 0x7f01f4100ca0 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01fae9d640 1 -- 172.21.15.82:0/2804646500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f419d5c0 con 0x7f01f4100ca0 2024-03-27T07:37:04.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f1ffb640 1 -- 172.21.15.82:0/2804646500 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01e4005500 con 0x7f01f4100ca0 2024-03-27T07:37:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01f1ffb640 1 -- 172.21.15.82:0/2804646500 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e4010690 con 0x7f01f4100ca0 2024-03-27T07:37:04.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.172+0000 7f01fae9d640 1 -- 172.21.15.82:0/2804646500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f41a4e50 con 0x7f01f4100ca0 2024-03-27T07:37:04.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.173+0000 7f01fae9d640 1 -- 172.21.15.82:0/2804646500 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f41021b0 con 0x7f01f4100ca0 2024-03-27T07:37:04.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.175+0000 7f01f1ffb640 1 -- 172.21.15.82:0/2804646500 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f01e40046c0 con 0x7f01f4100ca0 2024-03-27T07:37:04.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.175+0000 7f01f1ffb640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01dc0a3820 0x7f01dc0a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.176+0000 7f01f1ffb640 1 -- 172.21.15.82:0/2804646500 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f01e40d04c0 con 0x7f01f4100ca0 2024-03-27T07:37:04.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.176+0000 7f01f3fff640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01dc0a3820 0x7f01dc0a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.176+0000 7f01f3fff640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01dc0a3820 0x7f01dc0a5ce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01f41058a0 tx=0x7f01e8005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:04.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.180+0000 7f01f1ffb640 1 -- 172.21.15.82:0/2804646500 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f01e409cd50 con 0x7f01f4100ca0 2024-03-27T07:37:04.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.477+0000 7f01fae9d640 1 -- 172.21.15.82:0/2804646500 --> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f01f406a370 con 0x7f01dc0a3820 2024-03-27T07:37:04.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.485+0000 7f01f1ffb640 1 -- 172.21.15.82:0/2804646500 <== mgr.15273 v2:172.21.15.82:6800/573513718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f01f406a370 con 0x7f01dc0a3820 2024-03-27T07:37:04.484 INFO:teuthology.orchestra.run.smithi082.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-03-27T00:00:00", "created": "2024-03-27T07:23:40", "first": "2024-03-27T07:24:00", "last": "2024-03-27T07:37:00", "last_pruned": "2024-03-27T07:37:01", "created_count": 14, "pruned_count": 8, "active": true} 2024-03-27T07:37:04.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 -- 172.21.15.82:0/2804646500 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01dc0a3820 msgr2=0x7f01dc0a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01dc0a3820 0x7f01dc0a5ce0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f01f41058a0 tx=0x7f01e8005f90 comp rx=0 tx=0).stop 2024-03-27T07:37:04.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 -- 172.21.15.82:0/2804646500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f4100ca0 msgr2=0x7f01f41982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f4100ca0 0x7f01f41982e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f01e400e9f0 tx=0x7f01e400edf0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 -- 172.21.15.82:0/2804646500 shutdown_connections 2024-03-27T07:37:04.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f01dc0a3820 0x7f01dc0a5ce0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f01f4106ad0 0x7f01f419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01f4101640 0x7f01f4198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 --2- 172.21.15.82:0/2804646500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f01f4100ca0 0x7f01f41982e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 -- 172.21.15.82:0/2804646500 >> 172.21.15.82:0/2804646500 conn(0x7f01f40778b0 msgr2=0x7f01f40ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:04.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 -- 172.21.15.82:0/2804646500 shutdown_connections 2024-03-27T07:37:04.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.487+0000 7f01fae9d640 1 -- 172.21.15.82:0/2804646500 wait complete. 2024-03-27T07:37:04.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-03-27T07:37:04.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.603+0000 7fab4312c640 1 -- 172.21.15.82:0/3233724438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab3c106f10 msgr2=0x7fab3c10ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.603+0000 7fab4312c640 1 --2- 172.21.15.82:0/3233724438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab3c106f10 0x7fab3c10ea50 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fab34009ca0 tx=0x7fab3402c0f0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.603+0000 7fab4312c640 1 -- 172.21.15.82:0/3233724438 shutdown_connections 2024-03-27T07:37:04.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.603+0000 7fab4312c640 1 --2- 172.21.15.82:0/3233724438 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab3c106f10 0x7fab3c10ea50 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.603+0000 7fab4312c640 1 --2- 172.21.15.82:0/3233724438 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab3c06af70 0x7fab3c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.603+0000 7fab4312c640 1 --2- 172.21.15.82:0/3233724438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab3c06a5c0 0x7fab3c06a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.603+0000 7fab4312c640 1 -- 172.21.15.82:0/3233724438 >> 172.21.15.82:0/3233724438 conn(0x7fab3c077820 msgr2=0x7fab3c077c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:04.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.603+0000 7fab4312c640 1 -- 172.21.15.82:0/3233724438 shutdown_connections 2024-03-27T07:37:04.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.603+0000 7fab4312c640 1 -- 172.21.15.82:0/3233724438 wait complete. 2024-03-27T07:37:04.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab4312c640 1 Processor -- start 2024-03-27T07:37:04.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab4312c640 1 -- start start 2024-03-27T07:37:04.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab4312c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab3c06a5c0 0x7fab3c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab4312c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab3c106f10 0x7fab3c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab4312c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab3c19cbe0 0x7fab3c19d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab4312c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c111f50 con 0x7fab3c19cbe0 2024-03-27T07:37:04.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab4312c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c111dd0 con 0x7fab3c06a5c0 2024-03-27T07:37:04.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab4312c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c1120d0 con 0x7fab3c106f10 2024-03-27T07:37:04.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab416c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab3c19cbe0 0x7fab3c19d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab416c9640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab3c19cbe0 0x7fab3c19d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33496/0 (socket says 172.21.15.82:33496) 2024-03-27T07:37:04.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab416c9640 1 -- 172.21.15.82:0/663335210 learned_addr learned my addr 172.21.15.82:0/663335210 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:04.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab33fff640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab3c106f10 0x7fab3c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab40ec8640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab3c06a5c0 0x7fab3c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab416c9640 1 -- 172.21.15.82:0/663335210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab3c106f10 msgr2=0x7fab3c1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab416c9640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab3c106f10 0x7fab3c1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab416c9640 1 -- 172.21.15.82:0/663335210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab3c06a5c0 msgr2=0x7fab3c198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab416c9640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab3c06a5c0 0x7fab3c198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.604+0000 7fab416c9640 1 -- 172.21.15.82:0/663335210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3c19d6d0 con 0x7fab3c19cbe0 2024-03-27T07:37:04.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.605+0000 7fab416c9640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab3c19cbe0 0x7fab3c19d090 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fab3402c700 tx=0x7fab34032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:04.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.605+0000 7fab31ffb640 1 -- 172.21.15.82:0/663335210 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34041020 con 0x7fab3c19cbe0 2024-03-27T07:37:04.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.605+0000 7fab31ffb640 1 -- 172.21.15.82:0/663335210 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab34034cd0 con 0x7fab3c19cbe0 2024-03-27T07:37:04.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.605+0000 7fab4312c640 1 -- 172.21.15.82:0/663335210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3c19d960 con 0x7fab3c19cbe0 2024-03-27T07:37:04.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.605+0000 7fab31ffb640 1 -- 172.21.15.82:0/663335210 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab34039040 con 0x7fab3c19cbe0 2024-03-27T07:37:04.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.605+0000 7fab4312c640 1 -- 172.21.15.82:0/663335210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3c1a5120 con 0x7fab3c19cbe0 2024-03-27T07:37:04.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.606+0000 7fab4312c640 1 -- 172.21.15.82:0/663335210 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab3c103250 con 0x7fab3c19cbe0 2024-03-27T07:37:04.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.607+0000 7fab31ffb640 1 -- 172.21.15.82:0/663335210 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fab34044020 con 0x7fab3c19cbe0 2024-03-27T07:37:04.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.608+0000 7fab31ffb640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab240a3820 0x7fab240a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.608+0000 7fab40ec8640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab240a3820 0x7fab240a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.608+0000 7fab31ffb640 1 -- 172.21.15.82:0/663335210 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7fab340f1cc0 con 0x7fab3c19cbe0 2024-03-27T07:37:04.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.608+0000 7fab40ec8640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab240a3820 0x7fab240a5ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fab38009bd0 tx=0x7fab38005f90 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:04.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.612+0000 7fab31ffb640 1 -- 172.21.15.82:0/663335210 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fab3404b020 con 0x7fab3c19cbe0 2024-03-27T07:37:04.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:04 smithi082 ceph-mon[32178]: pgmap v422: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 236 op/s 2024-03-27T07:37:04.753 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:04 smithi149 ceph-mon[36065]: pgmap v422: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 236 op/s 2024-03-27T07:37:04.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:04 smithi153 ceph-mon[36179]: pgmap v422: 97 pgs: 4 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 81 active+clean; 1.8 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 236 op/s 2024-03-27T07:37:04.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.811+0000 7fab4312c640 1 -- 172.21.15.82:0/663335210 --> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fab3c06afe0 con 0x7fab240a3820 2024-03-27T07:37:04.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.819+0000 7fab31ffb640 1 -- 172.21.15.82:0/663335210 <== mgr.15273 v2:172.21.15.82:6800/573513718 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fab3c06afe0 con 0x7fab240a3820 2024-03-27T07:37:04.819 INFO:teuthology.orchestra.run.smithi082.stdout:/ 1m 6m3h 2024-03-27T07:37:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 -- 172.21.15.82:0/663335210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab240a3820 msgr2=0x7fab240a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab240a3820 0x7fab240a5ce0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fab38009bd0 tx=0x7fab38005f90 comp rx=0 tx=0).stop 2024-03-27T07:37:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 -- 172.21.15.82:0/663335210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab3c19cbe0 msgr2=0x7fab3c19d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab3c19cbe0 0x7fab3c19d090 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fab3402c700 tx=0x7fab34032f20 comp rx=0 tx=0).stop 2024-03-27T07:37:04.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 -- 172.21.15.82:0/663335210 shutdown_connections 2024-03-27T07:37:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fab240a3820 0x7fab240a5ce0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab3c19cbe0 0x7fab3c19d090 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab3c106f10 0x7fab3c1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 --2- 172.21.15.82:0/663335210 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fab3c06a5c0 0x7fab3c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 -- 172.21.15.82:0/663335210 >> 172.21.15.82:0/663335210 conn(0x7fab3c077820 msgr2=0x7fab3c0fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:04.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 -- 172.21.15.82:0/663335210 shutdown_connections 2024-03-27T07:37:04.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.821+0000 7fab4312c640 1 -- 172.21.15.82:0/663335210 wait complete. 2024-03-27T07:37:04.831 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-03-27T07:37:04.844 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-03-27T07:37:04.845 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-03-27T07:37:04.846 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-03-27T07:37:04.859 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:37:04.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 -- 172.21.15.82:0/2193859190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c38100a50 msgr2=0x7f1c38100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 --2- 172.21.15.82:0/2193859190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c38100a50 0x7f1c38100ed0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c009930 tx=0x7f1c2c02bc30 comp rx=0 tx=0).stop 2024-03-27T07:37:04.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 -- 172.21.15.82:0/2193859190 shutdown_connections 2024-03-27T07:37:04.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 --2- 172.21.15.82:0/2193859190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c38100a50 0x7f1c38100ed0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 --2- 172.21.15.82:0/2193859190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c38101410 0x7f1c3810d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 --2- 172.21.15.82:0/2193859190 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c38106a60 0x7f1c38106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 -- 172.21.15.82:0/2193859190 >> 172.21.15.82:0/2193859190 conn(0x7f1c38077b50 msgr2=0x7f1c38077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 -- 172.21.15.82:0/2193859190 shutdown_connections 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 -- 172.21.15.82:0/2193859190 wait complete. 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 Processor -- start 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.962+0000 7f1c3e264640 1 -- start start 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c3e264640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c38100a50 0x7f1c38199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c3e264640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c38101410 0x7f1c38199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c3e264640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c38106a60 0x7f1c381a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c3e264640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38110e70 con 0x7f1c38100a50 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c3e264640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38110cf0 con 0x7f1c38101410 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c3e264640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1c38110ff0 con 0x7f1c38106a60 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c37fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c38100a50 0x7f1c38199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c37fff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c38100a50 0x7f1c38199210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33520/0 (socket says 172.21.15.82:33520) 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c37fff640 1 -- 172.21.15.82:0/1715465941 learned_addr learned my addr 172.21.15.82:0/1715465941 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:04.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c3c801640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c38106a60 0x7f1c381a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c377fe640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c38101410 0x7f1c38199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c37fff640 1 -- 172.21.15.82:0/1715465941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c38106a60 msgr2=0x7f1c381a4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c37fff640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c38106a60 0x7f1c381a4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c37fff640 1 -- 172.21.15.82:0/1715465941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c38101410 msgr2=0x7f1c38199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c37fff640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c38101410 0x7f1c38199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c37fff640 1 -- 172.21.15.82:0/1715465941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c381a47d0 con 0x7f1c38100a50 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c3c801640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c38106a60 0x7f1c381a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c377fe640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c38101410 0x7f1c38199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c37fff640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c38100a50 0x7f1c38199210 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800e9f0 tx=0x7f1c2800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c357fa640 1 -- 172.21.15.82:0/1715465941 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c2800cd80 con 0x7f1c38100a50 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c357fa640 1 -- 172.21.15.82:0/1715465941 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c28010910 con 0x7f1c38100a50 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c3e264640 1 -- 172.21.15.82:0/1715465941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c381a49a0 con 0x7f1c38100a50 2024-03-27T07:37:04.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c357fa640 1 -- 172.21.15.82:0/1715465941 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28018990 con 0x7f1c38100a50 2024-03-27T07:37:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.963+0000 7f1c3e264640 1 -- 172.21.15.82:0/1715465941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c381a4ec0 con 0x7f1c38100a50 2024-03-27T07:37:04.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.964+0000 7f1c3e264640 1 -- 172.21.15.82:0/1715465941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c38068940 con 0x7f1c38100a50 2024-03-27T07:37:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.966+0000 7f1c357fa640 1 -- 172.21.15.82:0/1715465941 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f1c28010ac0 con 0x7f1c38100a50 2024-03-27T07:37:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.967+0000 7f1c357fa640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1c200a3780 0x7f1c200a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.967+0000 7f1c377fe640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1c200a3780 0x7f1c200a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.967+0000 7f1c357fa640 1 -- 172.21.15.82:0/1715465941 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f1c280d08f0 con 0x7f1c38100a50 2024-03-27T07:37:04.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.967+0000 7f1c377fe640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1c200a3780 0x7f1c200a5c40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c006010 tx=0x7f1c2c02c7d0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:04.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:04.970+0000 7f1c357fa640 1 -- 172.21.15.82:0/1715465941 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1c2809d180 con 0x7f1c38100a50 2024-03-27T07:37:05.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.148+0000 7f1c3e264640 1 -- 172.21.15.82:0/1715465941 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c380692a0 con 0x7f1c38100a50 2024-03-27T07:37:05.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.150+0000 7f1c357fa640 1 -- 172.21.15.82:0/1715465941 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+23040 (secure 0 0 0) 0x7f1c2809ca80 con 0x7f1c38100a50 2024-03-27T07:37:05.149 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:37:05.150 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":104,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:36:10.231132+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":21,"snap_epoch":104,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1643774131":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3910998089":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6801/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2476913094":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/1969604742":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6800/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":8,"length":1},{"begin":21,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":8,"length":1},{"begin":21,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:37:05.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 -- 172.21.15.82:0/1715465941 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1c200a3780 msgr2=0x7f1c200a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1c200a3780 0x7f1c200a5c40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c006010 tx=0x7f1c2c02c7d0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 -- 172.21.15.82:0/1715465941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c38100a50 msgr2=0x7f1c38199210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c38100a50 0x7f1c38199210 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f1c2800e9f0 tx=0x7f1c2800eeb0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 -- 172.21.15.82:0/1715465941 shutdown_connections 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1c200a3780 0x7f1c200a5c40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c38106a60 0x7f1c381a4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1c38101410 0x7f1c38199750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 --2- 172.21.15.82:0/1715465941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1c38100a50 0x7f1c38199210 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 -- 172.21.15.82:0/1715465941 >> 172.21.15.82:0/1715465941 conn(0x7f1c38077b50 msgr2=0x7f1c381031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 -- 172.21.15.82:0/1715465941 shutdown_connections 2024-03-27T07:37:05.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.152+0000 7f1c3e264640 1 -- 172.21.15.82:0/1715465941 wait complete. 2024-03-27T07:37:05.163 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T07:21:32.592597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T07:21:33.858606+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '104', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 21, 'snap_epoch': 104, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:37:05.164 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:37:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.270+0000 7f1eceff6640 1 -- 172.21.15.82:0/2247734696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec81069d0 msgr2=0x7f1ec8106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.270+0000 7f1eceff6640 1 --2- 172.21.15.82:0/2247734696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec81069d0 0x7f1ec8106db0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8009930 tx=0x7f1eb802bc30 comp rx=0 tx=0).stop 2024-03-27T07:37:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.270+0000 7f1eceff6640 1 -- 172.21.15.82:0/2247734696 shutdown_connections 2024-03-27T07:37:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.270+0000 7f1eceff6640 1 --2- 172.21.15.82:0/2247734696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ec8101380 0x7f1ec810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.270+0000 7f1eceff6640 1 --2- 172.21.15.82:0/2247734696 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec81009c0 0x7f1ec8100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.270+0000 7f1eceff6640 1 --2- 172.21.15.82:0/2247734696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec81069d0 0x7f1ec8106db0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.270+0000 7f1eceff6640 1 -- 172.21.15.82:0/2247734696 >> 172.21.15.82:0/2247734696 conn(0x7f1ec8077b50 msgr2=0x7f1ec8077f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:05.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eceff6640 1 -- 172.21.15.82:0/2247734696 shutdown_connections 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eceff6640 1 -- 172.21.15.82:0/2247734696 wait complete. 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eceff6640 1 Processor -- start 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eceff6640 1 -- start start 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eceff6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec81009c0 0x7f1ec8199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eceff6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ec8101380 0x7f1ec8199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eceff6640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec81069d0 0x7f1ec81a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eceff6640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8110de0 con 0x7f1ec81069d0 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eceff6640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8110c60 con 0x7f1ec81009c0 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eceff6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8110f60 con 0x7f1ec8101380 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1ecd593640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec81069d0 0x7f1ec81a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1ecd593640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec81069d0 0x7f1ec81a42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33540/0 (socket says 172.21.15.82:33540) 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1ecd593640 1 -- 172.21.15.82:0/1436289512 learned_addr learned my addr 172.21.15.82:0/1436289512 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:05.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1eccd92640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec81009c0 0x7f1ec8199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.271+0000 7f1ec7fff640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ec8101380 0x7f1ec8199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1ecd593640 1 -- 172.21.15.82:0/1436289512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ec8101380 msgr2=0x7f1ec8199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1ecd593640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ec8101380 0x7f1ec8199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1ecd593640 1 -- 172.21.15.82:0/1436289512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec81009c0 msgr2=0x7f1ec8199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1ecd593640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec81009c0 0x7f1ec8199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1ecd593640 1 -- 172.21.15.82:0/1436289512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec81a4800 con 0x7f1ec81069d0 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1ecd593640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec81069d0 0x7f1ec81a42c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000eb10 tx=0x7f1ec000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1ec5ffb640 1 -- 172.21.15.82:0/1436289512 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0004b20 con 0x7f1ec81069d0 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1eceff6640 1 -- 172.21.15.82:0/1436289512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec81a49d0 con 0x7f1ec81069d0 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1ec5ffb640 1 -- 172.21.15.82:0/1436289512 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ec0004cc0 con 0x7f1ec81069d0 2024-03-27T07:37:05.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1ec5ffb640 1 -- 172.21.15.82:0/1436289512 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0010760 con 0x7f1ec81069d0 2024-03-27T07:37:05.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.272+0000 7f1eceff6640 1 -- 172.21.15.82:0/1436289512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec81a4f20 con 0x7f1ec81069d0 2024-03-27T07:37:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.273+0000 7f1eceff6640 1 -- 172.21.15.82:0/1436289512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec8068940 con 0x7f1ec81069d0 2024-03-27T07:37:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.274+0000 7f1ec5ffb640 1 -- 172.21.15.82:0/1436289512 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f1ec0005020 con 0x7f1ec81069d0 2024-03-27T07:37:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.275+0000 7f1ec5ffb640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1eb00a3780 0x7f1eb00a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.275+0000 7f1eccd92640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1eb00a3780 0x7f1eb00a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.275+0000 7f1ec5ffb640 1 -- 172.21.15.82:0/1436289512 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 8528+0+0 (secure 0 0 0) 0x7f1ec00d0740 con 0x7f1ec81069d0 2024-03-27T07:37:05.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.276+0000 7f1eccd92640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1eb00a3780 0x7f1eb00a5c40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8005ab0 tx=0x7f1eb8005fd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:05.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.280+0000 7f1ec5ffb640 1 -- 172.21.15.82:0/1436289512 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1ec009cfd0 con 0x7f1ec81069d0 2024-03-27T07:37:05.435 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:05 smithi082 ceph-mon[32178]: from='client.17355 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:37:05.435 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:05 smithi082 ceph-mon[32178]: from='client.17361 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:37:05.435 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:05 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1715465941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:37:05.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.544+0000 7f1eceff6640 1 -- 172.21.15.82:0/1436289512 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1ec8108f30 con 0x7f1ec81069d0 2024-03-27T07:37:05.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.545+0000 7f1ec5ffb640 1 -- 172.21.15.82:0/1436289512 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) ==== 93+0+10 (secure 0 0 0) 0x7f1ec009c8d0 con 0x7f1ec81069d0 2024-03-27T07:37:05.544 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:37:05.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.549+0000 7f1eceff6640 1 -- 172.21.15.82:0/1436289512 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1eb00a3780 msgr2=0x7f1eb00a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:05.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.549+0000 7f1eceff6640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1eb00a3780 0x7f1eb00a5c40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8005ab0 tx=0x7f1eb8005fd0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.549+0000 7f1eceff6640 1 -- 172.21.15.82:0/1436289512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec81069d0 msgr2=0x7f1ec81a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:05.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.549+0000 7f1eceff6640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec81069d0 0x7f1ec81a42c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000eb10 tx=0x7f1ec000c2d0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.549+0000 7f1eceff6640 1 -- 172.21.15.82:0/1436289512 shutdown_connections 2024-03-27T07:37:05.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.549+0000 7f1eceff6640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f1eb00a3780 0x7f1eb00a5c40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.549+0000 7f1eceff6640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ec81069d0 0x7f1ec81a42c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.549+0000 7f1eceff6640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ec8101380 0x7f1ec8199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.549+0000 7f1eceff6640 1 --2- 172.21.15.82:0/1436289512 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1ec81009c0 0x7f1ec8199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.549+0000 7f1eceff6640 1 -- 172.21.15.82:0/1436289512 >> 172.21.15.82:0/1436289512 conn(0x7f1ec8077b50 msgr2=0x7f1ec8103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:05.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.551+0000 7f1eceff6640 1 -- 172.21.15.82:0/1436289512 shutdown_connections 2024-03-27T07:37:05.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.551+0000 7f1eceff6640 1 -- 172.21.15.82:0/1436289512 wait complete. 2024-03-27T07:37:05.567 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T07:37:05.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:05 smithi149 ceph-mon[36065]: from='client.17355 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:37:05.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:05 smithi149 ceph-mon[36065]: from='client.17361 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:37:05.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:05 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1715465941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:37:05.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.756+0000 7f5011e8f640 1 -- 172.21.15.82:0/2499602909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500c108b50 msgr2=0x7f500c108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:05.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.756+0000 7f5011e8f640 1 --2- 172.21.15.82:0/2499602909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500c108b50 0x7f500c108fd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f50000085a0 tx=0x7f500002ba50 comp rx=0 tx=0).stop 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.762+0000 7f5011e8f640 1 -- 172.21.15.82:0/2499602909 shutdown_connections 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.762+0000 7f5011e8f640 1 --2- 172.21.15.82:0/2499602909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c109510 0x7f500c1153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.762+0000 7f5011e8f640 1 --2- 172.21.15.82:0/2499602909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500c108b50 0x7f500c108fd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.762+0000 7f5011e8f640 1 --2- 172.21.15.82:0/2499602909 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c10e5e0 0x7f500c10e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.762+0000 7f5011e8f640 1 -- 172.21.15.82:0/2499602909 >> 172.21.15.82:0/2499602909 conn(0x7f500c06d090 msgr2=0x7f500c06d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.762+0000 7f5011e8f640 1 -- 172.21.15.82:0/2499602909 shutdown_connections 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.762+0000 7f5011e8f640 1 -- 172.21.15.82:0/2499602909 wait complete. 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.763+0000 7f5011e8f640 1 Processor -- start 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.764+0000 7f5011e8f640 1 -- start start 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.764+0000 7f5011e8f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500c108b50 0x7f500c1a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:05.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.764+0000 7f5011e8f640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c109510 0x7f500c19e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.764+0000 7f5011e8f640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c10e5e0 0x7f500c19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.764+0000 7f5011e8f640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f500c118450 con 0x7f500c10e5e0 2024-03-27T07:37:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.764+0000 7f5011e8f640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f500c1182d0 con 0x7f500c109510 2024-03-27T07:37:05.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.764+0000 7f5011e8f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f500c1185d0 con 0x7f500c108b50 2024-03-27T07:37:05.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.764+0000 7f500bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c10e5e0 0x7f500c19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.764+0000 7f500bfff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c10e5e0 0x7f500c19ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33556/0 (socket says 172.21.15.82:33556) 2024-03-27T07:37:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.764+0000 7f500bfff640 1 -- 172.21.15.82:0/317336575 learned_addr learned my addr 172.21.15.82:0/317336575 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.767+0000 7f500affd640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c109510 0x7f500c19e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.768+0000 7f500b7fe640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500c108b50 0x7f500c1a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.770+0000 7f500bfff640 1 -- 172.21.15.82:0/317336575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500c108b50 msgr2=0x7f500c1a5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:05.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.770+0000 7f500bfff640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500c108b50 0x7f500c1a5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.770+0000 7f500bfff640 1 -- 172.21.15.82:0/317336575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c109510 msgr2=0x7f500c19e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.770+0000 7f500bfff640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c109510 0x7f500c19e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.770+0000 7f500bfff640 1 -- 172.21.15.82:0/317336575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500c19f320 con 0x7f500c10e5e0 2024-03-27T07:37:05.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.772+0000 7f500bfff640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c10e5e0 0x7f500c19ed30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f500400d680 tx=0x7f5004007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.773+0000 7f5008ff9640 1 -- 172.21.15.82:0/317336575 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5004019020 con 0x7f500c10e5e0 2024-03-27T07:37:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.773+0000 7f5008ff9640 1 -- 172.21.15.82:0/317336575 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f500400ae10 con 0x7f500c10e5e0 2024-03-27T07:37:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.773+0000 7f5008ff9640 1 -- 172.21.15.82:0/317336575 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5004015660 con 0x7f500c10e5e0 2024-03-27T07:37:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.775+0000 7f5011e8f640 1 -- 172.21.15.82:0/317336575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f500c19f610 con 0x7f500c10e5e0 2024-03-27T07:37:05.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.775+0000 7f5011e8f640 1 -- 172.21.15.82:0/317336575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f500c1a3540 con 0x7f500c10e5e0 2024-03-27T07:37:05.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.777+0000 7f5011e8f640 1 -- 172.21.15.82:0/317336575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500c109d70 con 0x7f500c10e5e0 2024-03-27T07:37:05.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.778+0000 7f5008ff9640 1 -- 172.21.15.82:0/317336575 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f500401c070 con 0x7f500c10e5e0 2024-03-27T07:37:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.779+0000 7f5008ff9640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4ff40a3800 0x7f4ff40a5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:05.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.779+0000 7f5008ff9640 1 -- 172.21.15.82:0/317336575 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8560+0+0 (secure 0 0 0) 0x7f50040cfce0 con 0x7f500c10e5e0 2024-03-27T07:37:05.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.781+0000 7f500b7fe640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4ff40a3800 0x7f4ff40a5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:05.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.782+0000 7f500b7fe640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4ff40a3800 0x7f4ff40a5cc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc005fd0 tx=0x7f4ffc005850 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:05.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:05 smithi153 ceph-mon[36179]: from='client.17355 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:37:05.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:05 smithi153 ceph-mon[36179]: from='client.17361 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T07:37:05.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:05 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1715465941' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:37:05.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:05.787+0000 7f5008ff9640 1 -- 172.21.15.82:0/317336575 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f5004050cb0 con 0x7f500c10e5e0 2024-03-27T07:37:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.136+0000 7f5011e8f640 1 -- 172.21.15.82:0/317336575 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f500c1a4020 con 0x7f500c10e5e0 2024-03-27T07:37:06.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.137+0000 7f5008ff9640 1 -- 172.21.15.82:0/317336575 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v105) ==== 104+0+11 (secure 0 0 0) 0x7f500409c510 con 0x7f500c10e5e0 2024-03-27T07:37:06.139 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-27T07:37:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.141+0000 7f5011e8f640 1 -- 172.21.15.82:0/317336575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4ff40a3800 msgr2=0x7f4ff40a5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.141+0000 7f5011e8f640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4ff40a3800 0x7f4ff40a5cc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc005fd0 tx=0x7f4ffc005850 comp rx=0 tx=0).stop 2024-03-27T07:37:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.141+0000 7f5011e8f640 1 -- 172.21.15.82:0/317336575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c10e5e0 msgr2=0x7f500c19ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.141+0000 7f5011e8f640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c10e5e0 0x7f500c19ed30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f500400d680 tx=0x7f5004007590 comp rx=0 tx=0).stop 2024-03-27T07:37:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.142+0000 7f5011e8f640 1 -- 172.21.15.82:0/317336575 shutdown_connections 2024-03-27T07:37:06.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.142+0000 7f5011e8f640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f4ff40a3800 0x7f4ff40a5cc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.142+0000 7f5011e8f640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f500c10e5e0 0x7f500c19ed30 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.142+0000 7f5011e8f640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f500c109510 0x7f500c19e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.142+0000 7f5011e8f640 1 --2- 172.21.15.82:0/317336575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f500c108b50 0x7f500c1a5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.142+0000 7f5011e8f640 1 -- 172.21.15.82:0/317336575 >> 172.21.15.82:0/317336575 conn(0x7f500c06d090 msgr2=0x7f500c072460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:06.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.143+0000 7f5011e8f640 1 -- 172.21.15.82:0/317336575 shutdown_connections 2024-03-27T07:37:06.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.143+0000 7f5011e8f640 1 -- 172.21.15.82:0/317336575 wait complete. 2024-03-27T07:37:06.162 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T07:37:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.339+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2176226921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc094e40 msgr2=0x7fe9dc0952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:06.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.339+0000 7fe9eb34a640 1 --2- 172.21.15.82:0/2176226921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc094e40 0x7fe9dc0952a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009930 tx=0x7fe9e002bc60 comp rx=0 tx=0).stop 2024-03-27T07:37:06.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.341+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2176226921 shutdown_connections 2024-03-27T07:37:06.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.341+0000 7fe9eb34a640 1 --2- 172.21.15.82:0/2176226921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc0957e0 0x7fe9dc0a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.341+0000 7fe9eb34a640 1 --2- 172.21.15.82:0/2176226921 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc094e40 0x7fe9dc0952a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.341+0000 7fe9eb34a640 1 --2- 172.21.15.82:0/2176226921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9dc099bb0 0x7fe9dc099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.341+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2176226921 >> 172.21.15.82:0/2176226921 conn(0x7fe9dc00a730 msgr2=0x7fe9dc00ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:06.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.341+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2176226921 shutdown_connections 2024-03-27T07:37:06.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.341+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2176226921 wait complete. 2024-03-27T07:37:06.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.342+0000 7fe9eb34a640 1 Processor -- start 2024-03-27T07:37:06.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.342+0000 7fe9eb34a640 1 -- start start 2024-03-27T07:37:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.342+0000 7fe9eb34a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc094e40 0x7fe9dc12a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.342+0000 7fe9eb34a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0957e0 0x7fe9dc12aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.342+0000 7fe9eb34a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9dc099bb0 0x7fe9dc12aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.342+0000 7fe9eb34a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe9dc0a5060 con 0x7fe9dc094e40 2024-03-27T07:37:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.342+0000 7fe9eb34a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fe9dc0a4ee0 con 0x7fe9dc0957e0 2024-03-27T07:37:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.342+0000 7fe9eb34a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe9dc0a51e0 con 0x7fe9dc099bb0 2024-03-27T07:37:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.343+0000 7fe9eab49640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9dc099bb0 0x7fe9dc12aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.343+0000 7fe9e9b47640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0957e0 0x7fe9dc12aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.343+0000 7fe9eab49640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9dc099bb0 0x7fe9dc12aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:34170/0 (socket says 172.21.15.82:34170) 2024-03-27T07:37:06.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.343+0000 7fe9eab49640 1 -- 172.21.15.82:0/2696502665 learned_addr learned my addr 172.21.15.82:0/2696502665 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:06.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.345+0000 7fe9ea348640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc094e40 0x7fe9dc12a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.346+0000 7fe9ea348640 1 -- 172.21.15.82:0/2696502665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9dc099bb0 msgr2=0x7fe9dc12aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.346+0000 7fe9ea348640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9dc099bb0 0x7fe9dc12aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.346+0000 7fe9ea348640 1 -- 172.21.15.82:0/2696502665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0957e0 msgr2=0x7fe9dc12aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.346+0000 7fe9ea348640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0957e0 0x7fe9dc12aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.346+0000 7fe9ea348640 1 -- 172.21.15.82:0/2696502665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9dc136600 con 0x7fe9dc094e40 2024-03-27T07:37:06.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.348+0000 7fe9ea348640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc094e40 0x7fe9dc12a530 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400e9f0 tx=0x7fe9d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.349+0000 7fe9db7fe640 1 -- 172.21.15.82:0/2696502665 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400ccc0 con 0x7fe9dc094e40 2024-03-27T07:37:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.349+0000 7fe9db7fe640 1 -- 172.21.15.82:0/2696502665 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9d4010910 con 0x7fe9dc094e40 2024-03-27T07:37:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.349+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2696502665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9dc1368f0 con 0x7fe9dc094e40 2024-03-27T07:37:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.349+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2696502665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9dc136e10 con 0x7fe9dc094e40 2024-03-27T07:37:06.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.349+0000 7fe9db7fe640 1 -- 172.21.15.82:0/2696502665 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4018960 con 0x7fe9dc094e40 2024-03-27T07:37:06.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.351+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2696502665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c8005290 con 0x7fe9dc094e40 2024-03-27T07:37:06.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.353+0000 7fe9db7fe640 1 -- 172.21.15.82:0/2696502665 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fe9d4010ac0 con 0x7fe9dc094e40 2024-03-27T07:37:06.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.354+0000 7fe9db7fe640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9d00a3950 0x7fe9d00a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:06.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.354+0000 7fe9db7fe640 1 -- 172.21.15.82:0/2696502665 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8560+0+0 (secure 0 0 0) 0x7fe9d40d0490 con 0x7fe9dc094e40 2024-03-27T07:37:06.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.356+0000 7fe9e9b47640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9d00a3950 0x7fe9d00a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:06.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.357+0000 7fe9e9b47640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9d00a3950 0x7fe9d00a5e10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0005ab0 tx=0x7fe9e0005a20 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:06.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.364+0000 7fe9db7fe640 1 -- 172.21.15.82:0/2696502665 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe9d409ccc0 con 0x7fe9dc094e40 2024-03-27T07:37:06.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:06 smithi082 ceph-mon[32178]: pgmap v423: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 206 op/s 2024-03-27T07:37:06.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:06 smithi082 ceph-mon[32178]: osdmap e105: 12 total, 12 up, 12 in 2024-03-27T07:37:06.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:06 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1436289512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:37:06.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:06 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/317336575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:37:06.714 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-27T07:37:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.713+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2696502665 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe9c8005850 con 0x7fe9dc094e40 2024-03-27T07:37:06.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.714+0000 7fe9db7fe640 1 -- 172.21.15.82:0/2696502665 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v105) ==== 100+0+11 (secure 0 0 0) 0x7fe9d409c5c0 con 0x7fe9dc094e40 2024-03-27T07:37:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.717+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9d00a3950 msgr2=0x7fe9d00a5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.717+0000 7fe9eb34a640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9d00a3950 0x7fe9d00a5e10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0005ab0 tx=0x7fe9e0005a20 comp rx=0 tx=0).stop 2024-03-27T07:37:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.717+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc094e40 msgr2=0x7fe9dc12a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.717+0000 7fe9eb34a640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc094e40 0x7fe9dc12a530 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400e9f0 tx=0x7fe9d400eeb0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.717+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2696502665 shutdown_connections 2024-03-27T07:37:06.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.717+0000 7fe9eb34a640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fe9d00a3950 0x7fe9d00a5e10 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0005ab0 tx=0x7fe9e0005a20 comp rx=0 tx=0).stop 2024-03-27T07:37:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.717+0000 7fe9eb34a640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe9dc099bb0 0x7fe9dc12aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.717+0000 7fe9eb34a640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fe9dc0957e0 0x7fe9dc12aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.717+0000 7fe9eb34a640 1 --2- 172.21.15.82:0/2696502665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe9dc094e40 0x7fe9dc12a530 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.717+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2696502665 >> 172.21.15.82:0/2696502665 conn(0x7fe9dc00a730 msgr2=0x7fe9dc0930b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:06.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.718+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2696502665 shutdown_connections 2024-03-27T07:37:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.719+0000 7fe9eb34a640 1 -- 172.21.15.82:0/2696502665 wait complete. 2024-03-27T07:37:06.737 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-03-27T07:37:06.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:06 smithi149 ceph-mon[36065]: pgmap v423: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 206 op/s 2024-03-27T07:37:06.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:06 smithi149 ceph-mon[36065]: osdmap e105: 12 total, 12 up, 12 in 2024-03-27T07:37:06.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:06 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1436289512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:37:06.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:06 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/317336575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:37:06.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:06 smithi153 ceph-mon[36179]: pgmap v423: 97 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 89 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 206 op/s 2024-03-27T07:37:06.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:06 smithi153 ceph-mon[36179]: osdmap e105: 12 total, 12 up, 12 in 2024-03-27T07:37:06.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:06 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1436289512' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:37:06.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:06 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/317336575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:37:06.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.916+0000 7ff72de29640 1 -- 172.21.15.82:0/297387620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff72810d460 msgr2=0x7ff728115030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:06.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.916+0000 7ff7267fc640 1 -- 172.21.15.82:0/297387620 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff720005220 con 0x7ff72810d460 2024-03-27T07:37:06.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.916+0000 7ff72de29640 1 --2- 172.21.15.82:0/297387620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff72810d460 0x7ff728115030 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff720009900 tx=0x7ff72002bc40 comp rx=0 tx=0).stop 2024-03-27T07:37:06.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.917+0000 7ff72de29640 1 -- 172.21.15.82:0/297387620 shutdown_connections 2024-03-27T07:37:06.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.917+0000 7ff72de29640 1 --2- 172.21.15.82:0/297387620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff72810d460 0x7ff728115030 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.917+0000 7ff72de29640 1 --2- 172.21.15.82:0/297387620 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff728108d40 0x7ff72810cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.917+0000 7ff72de29640 1 --2- 172.21.15.82:0/297387620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff728108390 0x7ff728108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.917+0000 7ff72de29640 1 -- 172.21.15.82:0/297387620 >> 172.21.15.82:0/297387620 conn(0x7ff7280760a0 msgr2=0x7ff7280784c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:06.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.921+0000 7ff72de29640 1 -- 172.21.15.82:0/297387620 shutdown_connections 2024-03-27T07:37:06.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.925+0000 7ff72de29640 1 -- 172.21.15.82:0/297387620 wait complete. 2024-03-27T07:37:06.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.925+0000 7ff72de29640 1 Processor -- start 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.927+0000 7ff72de29640 1 -- start start 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.927+0000 7ff72de29640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff728108390 0x7ff7280732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.927+0000 7ff72de29640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72810d460 0x7ff728073830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.927+0000 7ff72de29640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff72806c4d0 0x7ff72806c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.927+0000 7ff72de29640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff728118550 con 0x7ff72806c4d0 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.927+0000 7ff72de29640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7ff7281183d0 con 0x7ff72810d460 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.927+0000 7ff72de29640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff7281186d0 con 0x7ff728108390 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.928+0000 7ff7277fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff728108390 0x7ff7280732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.928+0000 7ff7277fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff728108390 0x7ff7280732f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:34174/0 (socket says 172.21.15.82:34174) 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.928+0000 7ff7277fe640 1 -- 172.21.15.82:0/3969493814 learned_addr learned my addr 172.21.15.82:0/3969493814 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.928+0000 7ff727fff640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff72806c4d0 0x7ff72806c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:06.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.928+0000 7ff726ffd640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72810d460 0x7ff728073830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:06.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.928+0000 7ff7277fe640 1 -- 172.21.15.82:0/3969493814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72810d460 msgr2=0x7ff728073830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:06.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.928+0000 7ff7277fe640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72810d460 0x7ff728073830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.928+0000 7ff7277fe640 1 -- 172.21.15.82:0/3969493814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff72806c4d0 msgr2=0x7ff72806c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:06.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.928+0000 7ff7277fe640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff72806c4d0 0x7ff72806c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:06.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.928+0000 7ff7277fe640 1 -- 172.21.15.82:0/3969493814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff728070e10 con 0x7ff728108390 2024-03-27T07:37:06.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.929+0000 7ff7277fe640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff728108390 0x7ff7280732f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff71800e9f0 tx=0x7ff71800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:06.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.929+0000 7ff724ff9640 1 -- 172.21.15.82:0/3969493814 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71800cd80 con 0x7ff728108390 2024-03-27T07:37:06.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.929+0000 7ff72de29640 1 -- 172.21.15.82:0/3969493814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff728071100 con 0x7ff728108390 2024-03-27T07:37:06.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.929+0000 7ff72de29640 1 -- 172.21.15.82:0/3969493814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7280716a0 con 0x7ff728108390 2024-03-27T07:37:06.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.929+0000 7ff724ff9640 1 -- 172.21.15.82:0/3969493814 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff718010910 con 0x7ff728108390 2024-03-27T07:37:06.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.929+0000 7ff724ff9640 1 -- 172.21.15.82:0/3969493814 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff718018980 con 0x7ff728108390 2024-03-27T07:37:06.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.932+0000 7ff72de29640 1 -- 172.21.15.82:0/3969493814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70c005290 con 0x7ff728108390 2024-03-27T07:37:06.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.932+0000 7ff724ff9640 1 -- 172.21.15.82:0/3969493814 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7ff718018b20 con 0x7ff728108390 2024-03-27T07:37:06.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.933+0000 7ff724ff9640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff7080a38c0 0x7ff7080a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:37:06.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.933+0000 7ff724ff9640 1 -- 172.21.15.82:0/3969493814 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 8560+0+0 (secure 0 0 0) 0x7ff7180d04b0 con 0x7ff728108390 2024-03-27T07:37:06.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.934+0000 7ff726ffd640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff7080a38c0 0x7ff7080a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:37:06.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.940+0000 7ff726ffd640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff7080a38c0 0x7ff7080a5d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff710005fd0 tx=0x7ff710005f60 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:37:06.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:06.941+0000 7ff724ff9640 1 -- 172.21.15.82:0/3969493814 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ff71809cce0 con 0x7ff728108390 2024-03-27T07:37:07.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.383+0000 7ff72de29640 1 -- 172.21.15.82:0/3969493814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ff70c005850 con 0x7ff728108390 2024-03-27T07:37:07.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.406+0000 7ff724ff9640 1 -- 172.21.15.82:0/3969493814 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+744334 (secure 0 0 0) 0x7ff71809c5e0 con 0x7ff728108390 2024-03-27T07:37:07.416 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:37:07.416 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:37:07.416 INFO:teuthology.orchestra.run.smithi082.stdout: "epoch": 25, 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: "active_gid": 15273, 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: "active_name": "x", 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addrs": { 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6800", 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 573513718 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-03-27T07:37:07.417 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6801", 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 573513718 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addr": "172.21.15.82:6801/573513718", 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: "active_change": "2024-03-27T07:23:34.942192+0000", 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: "active_mgr_features": 4540701547738038271, 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: "available": true, 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: "standbys": [ 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 25106, 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "y", 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540701547738038271, 2024-03-27T07:37:07.418 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.419 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.420 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.421 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.422 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.423 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.424 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.425 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.425 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.427 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-03-27T07:37:07.428 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.429 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.430 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-03-27T07:37:07.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.432 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-03-27T07:37:07.434 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-03-27T07:37:07.435 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T07:37:07.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.437 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-27T07:37:07.438 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.439 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.441 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.442 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.443 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.444 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.446 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.447 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-03-27T07:37:07.448 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.449 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:07.450 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.451 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.451 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.451 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-27T07:37:07.451 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.451 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.451 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.451 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-03-27T07:37:07.452 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.453 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.454 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-27T07:37:07.455 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-27T07:37:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.457 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.460 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.461 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.462 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.463 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.464 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.465 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-03-27T07:37:07.466 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.467 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.468 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.468 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-27T07:37:07.468 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.468 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.468 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.468 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-03-27T07:37:07.468 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.469 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.469 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.469 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-03-27T07:37:07.469 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-03-27T07:37:07.469 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.469 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.470 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.470 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-03-27T07:37:07.470 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.470 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.470 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.470 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:07.471 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.471 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.471 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-03-27T07:37:07.471 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-03-27T07:37:07.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.472 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.472 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-27T07:37:07.473 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.473 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.473 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.473 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-03-27T07:37:07.473 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.474 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.474 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-03-27T07:37:07.474 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-03-27T07:37:07.474 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.474 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.475 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-27T07:37:07.475 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.475 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.475 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.475 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-03-27T07:37:07.476 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.476 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.476 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-03-27T07:37:07.476 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-03-27T07:37:07.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.477 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-27T07:37:07.477 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.477 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.478 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.478 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-03-27T07:37:07.478 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.478 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.478 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.479 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-03-27T07:37:07.479 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-03-27T07:37:07.479 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.479 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.479 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.479 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-27T07:37:07.479 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.480 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.480 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.480 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-03-27T07:37:07.480 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.480 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.480 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.481 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-03-27T07:37:07.481 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-03-27T07:37:07.481 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.481 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.481 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.482 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-27T07:37:07.482 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.482 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.482 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.482 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-03-27T07:37:07.482 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.483 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.483 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.483 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-03-27T07:37:07.483 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-03-27T07:37:07.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.484 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.484 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.484 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-27T07:37:07.484 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.484 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.484 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.485 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-03-27T07:37:07.485 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.485 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.485 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.485 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-03-27T07:37:07.486 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-03-27T07:37:07.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.486 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-27T07:37:07.486 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.486 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.487 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.487 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:07.487 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.487 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.487 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.488 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-03-27T07:37:07.488 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-03-27T07:37:07.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.488 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.488 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.488 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-27T07:37:07.489 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.489 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.489 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.489 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-03-27T07:37:07.489 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.489 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.490 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.490 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-03-27T07:37:07.490 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-03-27T07:37:07.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.490 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.491 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.491 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-27T07:37:07.491 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.491 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.491 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.491 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:07.491 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.492 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.492 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-03-27T07:37:07.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-03-27T07:37:07.492 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.492 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.492 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.492 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-27T07:37:07.493 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.493 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.493 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-03-27T07:37:07.493 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.493 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.493 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.493 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-03-27T07:37:07.494 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-03-27T07:37:07.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.494 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.494 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-03-27T07:37:07.494 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.494 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.495 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-03-27T07:37:07.495 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.495 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.495 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.495 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-03-27T07:37:07.495 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-03-27T07:37:07.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.498 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.500 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-03-27T07:37:07.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-03-27T07:37:07.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.501 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-03-27T07:37:07.501 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.502 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-03-27T07:37:07.502 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.502 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.502 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.502 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-03-27T07:37:07.502 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-03-27T07:37:07.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.503 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.503 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.503 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.503 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.503 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.503 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.503 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-27T07:37:07.504 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.504 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.504 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.504 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-03-27T07:37:07.504 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-03-27T07:37:07.504 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.504 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.504 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.505 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:07.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.505 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.505 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.505 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-03-27T07:37:07.505 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.505 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.505 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.506 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-03-27T07:37:07.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-03-27T07:37:07.506 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.506 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.506 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.506 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-03-27T07:37:07.506 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.509 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.510 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.511 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.512 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-27T07:37:07.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.514 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.515 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.516 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.516 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.516 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.516 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.516 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.516 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.516 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.516 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.516 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.517 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-27T07:37:07.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.520 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.521 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.522 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-27T07:37:07.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.524 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.525 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.526 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.527 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.531 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-03-27T07:37:07.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-03-27T07:37:07.533 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-03-27T07:37:07.534 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-03-27T07:37:07.536 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.537 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.540 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.543 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.544 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.545 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.546 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.547 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.548 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.549 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.551 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.552 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.554 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-27T07:37:07.555 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-27T07:37:07.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.557 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.558 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.559 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-27T07:37:07.560 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.562 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.563 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.565 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.566 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.567 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.568 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.569 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.572 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.574 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.574 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-27T07:37:07.574 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-27T07:37:07.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.574 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.574 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.575 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.575 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.575 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.576 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-03-27T07:37:07.576 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-27T07:37:07.576 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.576 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.576 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.576 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.576 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.577 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.577 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.577 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.577 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.577 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.577 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.577 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-27T07:37:07.577 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-27T07:37:07.578 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-27T07:37:07.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-27T07:37:07.580 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.582 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.583 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.584 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.586 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.589 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.590 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.591 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.593 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.594 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.595 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.596 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.598 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.599 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-27T07:37:07.600 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-27T07:37:07.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-27T07:37:07.602 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-03-27T07:37:07.603 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-27T07:37:07.604 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.605 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.606 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.608 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.609 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.610 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.611 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.613 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.614 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.617 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.618 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-03-27T07:37:07.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.621 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.622 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.623 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.624 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.627 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.628 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.629 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.630 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.631 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.632 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.633 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.634 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.635 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.636 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.639 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-03-27T07:37:07.640 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.641 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-03-27T07:37:07.642 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.644 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.645 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.646 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.647 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.648 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.649 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.650 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.651 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.652 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.653 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-03-27T07:37:07.654 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-03-27T07:37:07.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.656 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.658 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.659 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.660 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.661 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.663 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.664 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.665 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-03-27T07:37:07.667 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-03-27T07:37:07.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-03-27T07:37:07.669 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-03-27T07:37:07.670 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.671 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-03-27T07:37:07.672 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.673 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.674 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.675 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.676 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.678 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.679 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.680 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.681 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.682 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.684 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.686 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.687 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-03-27T07:37:07.688 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.690 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.691 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.692 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.693 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.696 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.697 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.698 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.699 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.700 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.701 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.702 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.703 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.704 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.705 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.706 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.707 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.708 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.709 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.711 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-03-27T07:37:07.712 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.714 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.715 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.716 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.717 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.718 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.719 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.720 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.721 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.722 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-03-27T07:37:07.723 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-03-27T07:37:07.724 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.725 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.726 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.727 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.728 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.729 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.731 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-03-27T07:37:07.732 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.733 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.734 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-03-27T07:37:07.735 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-03-27T07:37:07.736 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-03-27T07:37:07.738 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.739 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.740 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.741 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.742 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-03-27T07:37:07.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-03-27T07:37:07.744 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-03-27T07:37:07.745 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.746 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-03-27T07:37:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-03-27T07:37:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-03-27T07:37:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.748 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.749 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.750 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.751 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.752 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.753 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.754 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.755 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.757 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.758 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.759 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.759 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.759 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.759 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.759 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.759 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.759 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.760 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.760 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.760 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.760 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.760 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.760 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.760 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.760 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.761 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.761 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.761 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.761 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.761 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.761 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.761 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.762 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.762 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.762 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.762 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.762 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.762 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.762 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.763 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.764 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.765 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.766 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.767 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.768 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.769 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.770 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.771 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.772 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.773 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.774 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-03-27T07:37:07.775 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.777 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.778 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-03-27T07:37:07.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-03-27T07:37:07.780 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.781 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.782 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.783 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.784 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.785 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.786 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-03-27T07:37:07.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.788 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.789 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.790 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.791 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.793 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.794 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.795 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.796 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.797 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.798 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.799 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.800 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.801 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.802 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.803 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-27T07:37:07.804 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.805 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.806 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.807 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.808 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.809 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.810 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.811 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.812 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.813 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.814 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.815 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.816 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.817 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.818 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.819 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.820 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.820 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.822 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.823 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.824 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.825 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.826 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.827 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.828 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.829 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-03-27T07:37:07.830 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.831 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.832 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-03-27T07:37:07.833 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.834 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.835 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.836 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.837 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.839 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.840 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.841 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.842 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.843 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.844 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.845 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.846 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.847 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.848 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.849 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:07.850 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.851 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.852 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.853 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.854 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.855 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.856 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-03-27T07:37:07.857 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-27T07:37:07.858 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 25108, 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "z", 2024-03-27T07:37:07.859 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540701547738038271, 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:07.860 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.861 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.863 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.864 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.865 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.866 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-03-27T07:37:07.867 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.868 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.869 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.870 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.871 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.872 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.873 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.874 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.875 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-03-27T07:37:07.876 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-03-27T07:37:07.877 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.878 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.879 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.880 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.881 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.882 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.883 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.884 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.885 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.886 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.887 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.888 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.889 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.890 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.891 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.892 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.893 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.895 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.896 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-27T07:37:07.900 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.901 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.902 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.903 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.905 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.906 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.908 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.909 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.910 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.911 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-03-27T07:37:07.912 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-03-27T07:37:07.913 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-03-27T07:37:07.914 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-03-27T07:37:07.915 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.916 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.917 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.918 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.919 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.920 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.921 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.922 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-03-27T07:37:07.923 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.924 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.925 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.926 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-03-27T07:37:07.927 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.928 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.929 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.930 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.931 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.932 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.933 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.934 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-27T07:37:07.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-27T07:37:07.936 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.937 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.938 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.939 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-03-27T07:37:07.940 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.941 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-03-27T07:37:07.942 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-03-27T07:37:07.943 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-03-27T07:37:07.944 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-03-27T07:37:07.945 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.946 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-03-27T07:37:07.947 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.948 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.949 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.950 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.951 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.952 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.953 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.954 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.955 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.956 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.957 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.958 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:07.959 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-03-27T07:37:07.960 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.961 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-03-27T07:37:07.962 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.964 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-03-27T07:37:07.965 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-27T07:37:07.966 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-03-27T07:37:07.967 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-27T07:37:07.968 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-27T07:37:07.969 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-27T07:37:07.970 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-27T07:37:07.971 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.972 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.973 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.974 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.975 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-27T07:37:07.976 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.977 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.978 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-27T07:37:07.979 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.981 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.982 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.983 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-03-27T07:37:07.984 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.985 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.986 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.987 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.988 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.989 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.990 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.991 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.992 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.993 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.994 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.995 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.996 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.997 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.998 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:07.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.000 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.001 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.003 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.004 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.005 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.007 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.008 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.009 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.010 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.011 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.012 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.013 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.014 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.015 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.016 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.017 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.018 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-03-27T07:37:08.019 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.020 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.021 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.022 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.023 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.024 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-03-27T07:37:08.025 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.026 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.027 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.028 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.029 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.030 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-03-27T07:37:08.031 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.032 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-03-27T07:37:08.033 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-27T07:37:08.034 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.035 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.036 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.037 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.038 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.039 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.040 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.041 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.042 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.043 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.044 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:08.045 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-03-27T07:37:08.046 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.047 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.048 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:08.049 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.050 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.051 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.052 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.053 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.054 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.055 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-03-27T07:37:08.056 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-03-27T07:37:08.057 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:08.058 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.059 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.060 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.061 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.062 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.063 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.064 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.064 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.064 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.064 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.064 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.065 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.066 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.066 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.066 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.066 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.066 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.066 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.067 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.068 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.069 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.070 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.071 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.072 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.073 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.074 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.075 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.076 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.078 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.079 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.080 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.081 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.082 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.083 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.084 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.085 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.086 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.086 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.086 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.086 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.086 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.086 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.086 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.086 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-03-27T07:37:08.087 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-03-27T07:37:08.088 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.089 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.090 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.091 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.092 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.093 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.094 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.095 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.096 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.097 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.098 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.100 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.101 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.102 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.103 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.104 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.106 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.107 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.108 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.109 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.110 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.111 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.112 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.113 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-03-27T07:37:08.114 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.115 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.116 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.117 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.118 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.119 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.120 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.121 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.122 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.123 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.123 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.123 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.123 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.123 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.123 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.123 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.123 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.123 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.123 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.125 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.126 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.127 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.128 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.129 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.130 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.131 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.132 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-03-27T07:37:08.133 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.134 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.135 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.136 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.137 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.138 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.139 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.140 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.141 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.142 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.143 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.144 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.145 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.146 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.147 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.148 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.149 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.150 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.152 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.153 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.154 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.155 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.156 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.157 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-27T07:37:08.158 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.159 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.160 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.161 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.162 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.163 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.164 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.165 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.166 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.167 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.169 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.170 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.171 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.172 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.173 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-27T07:37:08.174 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-27T07:37:08.175 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.176 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.177 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.178 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.179 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.180 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.181 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.182 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.184 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.185 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.186 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-27T07:37:08.187 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.188 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.189 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.190 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.191 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.192 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.193 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.194 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.195 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.196 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.197 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.198 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.199 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.200 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.205 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.206 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.207 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.208 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.209 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.210 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.211 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.212 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.213 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.215 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.216 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.217 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.218 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.219 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.220 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.221 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.223 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.224 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.225 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.227 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.228 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.228 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.228 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.228 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.228 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.228 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.228 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.228 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.228 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.229 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.229 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.230 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-03-27T07:37:08.231 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-03-27T07:37:08.232 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-03-27T07:37:08.233 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-03-27T07:37:08.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-03-27T07:37:08.235 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-03-27T07:37:08.236 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-03-27T07:37:08.237 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-03-27T07:37:08.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.239 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.240 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.241 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.242 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.243 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.244 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.245 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.246 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.247 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.248 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.249 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.250 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.251 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.252 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.253 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.254 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.255 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.256 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.257 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.258 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.259 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.260 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.261 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-03-27T07:37:08.262 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-03-27T07:37:08.263 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.264 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.265 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.266 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.267 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.268 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.269 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.270 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.271 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.272 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.274 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.277 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "modules": [ 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard", 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "iostat", 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "nfs", 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "restful", 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "snap_schedule" 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.278 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.279 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.280 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.281 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.282 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.283 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.284 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.285 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.286 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.290 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.291 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.292 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.293 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.294 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-27T07:37:08.295 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:08.296 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.297 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-03-27T07:37:08.298 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.299 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.300 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.301 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.302 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.303 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.304 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.305 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-27T07:37:08.306 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-03-27T07:37:08.307 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.308 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.310 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.311 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.312 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.314 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-03-27T07:37:08.315 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-03-27T07:37:08.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-03-27T07:37:08.317 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.318 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.319 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.320 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.321 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.322 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-03-27T07:37:08.323 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-03-27T07:37:08.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-03-27T07:37:08.325 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-03-27T07:37:08.326 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-03-27T07:37:08.327 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-03-27T07:37:08.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.329 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.330 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.331 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.332 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.333 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.335 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.336 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.337 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.338 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.339 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-03-27T07:37:08.340 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.341 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-03-27T07:37:08.342 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.343 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.344 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.345 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-03-27T07:37:08.346 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-27T07:37:08.347 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-27T07:37:08.348 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.349 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.351 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.352 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.355 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.356 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-03-27T07:37:08.357 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-03-27T07:37:08.358 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-03-27T07:37:08.359 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.361 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-03-27T07:37:08.362 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-03-27T07:37:08.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-03-27T07:37:08.364 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.365 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.366 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.368 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.369 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.370 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.371 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.372 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.373 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.374 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.375 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.376 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.377 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.378 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.379 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.381 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.382 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.384 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-27T07:37:08.385 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-03-27T07:37:08.386 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.387 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.388 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.389 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.390 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.391 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.392 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.393 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.394 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.395 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.396 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.397 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.398 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.399 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.400 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.401 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.402 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.403 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.405 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.406 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-27T07:37:08.407 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-27T07:37:08.408 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-27T07:37:08.409 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-27T07:37:08.410 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-27T07:37:08.411 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.412 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.414 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.415 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-03-27T07:37:08.416 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.417 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.418 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.419 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.420 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.421 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.422 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.423 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.424 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.425 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.426 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.428 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.429 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.430 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.431 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.432 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.433 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.434 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-03-27T07:37:08.435 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.437 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.437 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.438 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-03-27T07:37:08.439 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.440 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.441 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.442 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-27T07:37:08.443 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.444 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.445 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.447 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.448 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.449 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.450 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.451 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.454 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.455 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:08.456 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-03-27T07:37:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-03-27T07:37:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-03-27T07:37:08.457 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.459 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.460 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.461 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.462 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.463 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.465 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.466 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.467 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-27T07:37:08.468 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.469 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.470 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.471 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.472 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.473 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.476 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.477 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.478 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.480 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.482 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.483 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.484 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.485 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.486 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.487 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.488 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.490 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.491 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.492 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.493 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.494 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.495 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.496 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.497 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.498 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.499 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-27T07:37:08.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.501 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.502 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.503 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.505 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.506 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.510 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.511 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.514 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.515 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.516 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.517 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.518 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.519 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.521 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.522 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.523 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.524 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.525 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.526 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.528 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.531 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.532 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-03-27T07:37:08.534 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.535 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.539 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.541 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.542 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.543 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.544 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.545 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.546 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.547 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.548 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.549 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.550 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-03-27T07:37:08.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.552 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-27T07:37:08.553 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.554 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.555 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.556 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.557 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.558 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.560 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.561 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.563 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.564 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.565 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.566 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.567 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-03-27T07:37:08.568 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.570 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.571 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-03-27T07:37:08.575 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.576 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.577 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.578 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.581 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-03-27T07:37:08.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-03-27T07:37:08.583 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.584 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.586 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.587 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.589 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.590 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-03-27T07:37:08.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-03-27T07:37:08.592 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.593 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.594 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.596 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.597 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.598 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.599 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.600 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.602 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.603 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-27T07:37:08.604 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.607 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.608 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.610 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.611 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.613 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.614 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.615 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.616 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.617 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.621 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.622 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.623 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.624 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.625 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.626 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.627 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.628 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.629 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.630 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.631 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.632 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.633 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.634 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.635 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.636 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.637 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.638 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.640 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.641 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.642 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.643 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.643 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.643 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.643 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.643 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.643 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.643 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.643 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.643 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.645 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.645 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.645 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.646 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.647 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.648 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.650 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.651 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.652 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.653 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.654 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.655 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.656 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.657 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-03-27T07:37:08.658 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.659 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.660 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.661 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.662 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.663 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.664 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.665 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.667 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-03-27T07:37:08.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.669 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.670 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.671 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.673 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.675 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.676 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.678 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.679 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.680 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.681 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.682 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-27T07:37:08.683 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.684 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.685 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.686 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.687 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.688 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-03-27T07:37:08.690 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.691 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.692 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.693 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-03-27T07:37:08.694 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "services": { 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard": "https://172.21.15.82:8443/" 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "always_on_modules": { 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "octopus": [ 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-03-27T07:37:08.695 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-03-27T07:37:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-03-27T07:37:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-03-27T07:37:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-03-27T07:37:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-03-27T07:37:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-03-27T07:37:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-03-27T07:37:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-03-27T07:37:08.696 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "pacific": [ 2024-03-27T07:37:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-03-27T07:37:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-03-27T07:37:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-03-27T07:37:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-03-27T07:37:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-03-27T07:37:08.697 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-03-27T07:37:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-03-27T07:37:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-03-27T07:37:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-03-27T07:37:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-03-27T07:37:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "quincy": [ 2024-03-27T07:37:08.698 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-03-27T07:37:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-03-27T07:37:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-03-27T07:37:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-03-27T07:37:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-03-27T07:37:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-03-27T07:37:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-03-27T07:37:08.699 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-03-27T07:37:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-03-27T07:37:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-03-27T07:37:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "reef": [ 2024-03-27T07:37:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-03-27T07:37:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-03-27T07:37:08.700 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-03-27T07:37:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-03-27T07:37:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-03-27T07:37:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-03-27T07:37:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-03-27T07:37:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-03-27T07:37:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-03-27T07:37:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-03-27T07:37:08.701 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-03-27T07:37:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "squid": [ 2024-03-27T07:37:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-03-27T07:37:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-03-27T07:37:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-03-27T07:37:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-03-27T07:37:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-03-27T07:37:08.702 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-03-27T07:37:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-03-27T07:37:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-03-27T07:37:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-03-27T07:37:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-03-27T07:37:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.703 INFO:teuthology.orchestra.run.smithi082.stdout: "last_failure_osd_epoch": 89, 2024-03-27T07:37:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: "active_clients": [ 2024-03-27T07:37:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-03-27T07:37:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-27T07:37:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-27T07:37:08.704 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 4025359556 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "libcephsqlite", 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 418347944 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.705 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 425790006 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-27T07:37:08.706 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3776924188 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 2440621809 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.707 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1799100563 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-03-27T07:37:08.708 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:37:08.710 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:07 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2696502665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:37:08.710 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:07 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2696502665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:37:08.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 -- 172.21.15.82:0/3969493814 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff7080a38c0 msgr2=0x7ff7080a5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff7080a38c0 0x7ff7080a5d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff710005fd0 tx=0x7ff710005f60 comp rx=0 tx=0).stop 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 -- 172.21.15.82:0/3969493814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff728108390 msgr2=0x7ff7280732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff728108390 0x7ff7280732f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff71800e9f0 tx=0x7ff71800eeb0 comp rx=0 tx=0).stop 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 -- 172.21.15.82:0/3969493814 shutdown_connections 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7ff7080a38c0 0x7ff7080a5d80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff72806c4d0 0x7ff72806c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7ff72810d460 0x7ff728073830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 --2- 172.21.15.82:0/3969493814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff728108390 0x7ff7280732f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 -- 172.21.15.82:0/3969493814 >> 172.21.15.82:0/3969493814 conn(0x7ff7280760a0 msgr2=0x7ff7280783b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 -- 172.21.15.82:0/3969493814 shutdown_connections 2024-03-27T07:37:08.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:37:07.413+0000 7ff72de29640 1 -- 172.21.15.82:0/3969493814 wait complete. 2024-03-27T07:37:08.762 DEBUG:tasks.check_counter:Getting stats from a 2024-03-27T07:37:08.762 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.a perf dump 2024-03-27T07:37:08.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:07 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2696502665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:37:08.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:08 smithi082 ceph-mon[32178]: pgmap v425: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 220 op/s 2024-03-27T07:37:08.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:08 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3969493814' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-27T07:37:08.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:08 smithi082 ceph-mon[32178]: osdmap e106: 12 total, 12 up, 12 in 2024-03-27T07:37:08.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:08 smithi149 ceph-mon[36065]: pgmap v425: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 220 op/s 2024-03-27T07:37:08.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:08 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3969493814' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-27T07:37:08.764 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:08 smithi149 ceph-mon[36065]: osdmap e106: 12 total, 12 up, 12 in 2024-03-27T07:37:08.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:08 smithi153 ceph-mon[36179]: pgmap v425: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 220 op/s 2024-03-27T07:37:08.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:08 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3969493814' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-27T07:37:08.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:08 smithi153 ceph-mon[36179]: osdmap e106: 12 total, 12 up, 12 in 2024-03-27T07:37:09.260 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:37:10.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:10 smithi082 ceph-mon[32178]: pgmap v427: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 246 op/s 2024-03-27T07:37:10.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:10 smithi149 ceph-mon[36065]: pgmap v427: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 246 op/s 2024-03-27T07:37:10.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:10 smithi153 ceph-mon[36179]: pgmap v427: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.0 MiB/s wr, 246 op/s 2024-03-27T07:37:12.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:12 smithi082 ceph-mon[32178]: pgmap v428: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 690 KiB/s wr, 122 op/s 2024-03-27T07:37:12.626 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:12 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:37:12.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:12 smithi149 ceph-mon[36065]: pgmap v428: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 690 KiB/s wr, 122 op/s 2024-03-27T07:37:12.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:12 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:37:12.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:12 smithi153 ceph-mon[36179]: pgmap v428: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 690 KiB/s wr, 122 op/s 2024-03-27T07:37:12.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:12 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:37:12.853 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 4, 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 4, 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3024, 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 448, 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.001457921, 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000034235, 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000475688, 2024-03-27T07:37:12.854 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3, 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000744936, 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000248312 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 448 2024-03-27T07:37:12.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 2, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 194, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 320, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 189776, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.014873076, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.009933138, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.002325689, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 191, 2024-03-27T07:37:12.856 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.011598734, 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000060726 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 189776 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 263, 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 253, 2024-03-27T07:37:12.857 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1460320, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 155904, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.044167445, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.014440820, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.032872854, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.005316510, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 252, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.018370331, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000072898 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.858 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1460320, 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 155904 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-03-27T07:37:12.859 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:37:12.860 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:37:12.861 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:37:12.862 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-03-27T07:37:12.862 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-03-27T07:37:12.862 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-03-27T07:37:12.862 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:37:12.862 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:37:12.862 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:37:12.862 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:37:12.862 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148994, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 31, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-03-27T07:37:12.863 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:37:12.864 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 265, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1423180, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 265, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 265, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1423180, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:12.865 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:12.866 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:12.866 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:37:13.775 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-03-27T07:37:13.776 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-03-27T07:37:13.776 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-03-27T07:37:13.776 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-03-27T07:37:13.776 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-03-27T07:37:13.776 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-03-27T07:37:13.776 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-03-27T07:37:13.776 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-03-27T07:37:13.776 DEBUG:tasks.check_counter:Getting stats from d 2024-03-27T07:37:13.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.d perf dump 2024-03-27T07:37:14.261 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:37:14.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:14 smithi082 ceph-mon[32178]: pgmap v429: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 715 KiB/s wr, 96 op/s 2024-03-27T07:37:14.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:14 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:37:14.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:14 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:37:14.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:14 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:37:14.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:14 smithi149 ceph-mon[36065]: pgmap v429: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 715 KiB/s wr, 96 op/s 2024-03-27T07:37:14.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:14 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:37:14.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:14 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:37:14.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:14 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:37:14.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:14 smithi153 ceph-mon[36179]: pgmap v429: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 715 KiB/s wr, 96 op/s 2024-03-27T07:37:14.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:14 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:37:14.786 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:14 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:37:14.786 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:14 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:37:16.255 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.001284908, 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000327119, 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:16.256 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 6, 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 201, 2024-03-27T07:37:16.257 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3344, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 191104, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.014485731, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.009650374, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.002570144, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 199, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.016197143, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000081392 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.258 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 191104 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 269, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 259, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1461952, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 159760, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-03-27T07:37:16.259 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.049436108, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.015696931, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.036215631, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.005512183, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 258, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.017957246, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000069601 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1461952, 2024-03-27T07:37:16.260 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 159760 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:37:16.261 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:37:16.262 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:37:16.263 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:37:16.264 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148972, 2024-03-27T07:37:16.264 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 31, 2024-03-27T07:37:16.264 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-03-27T07:37:16.264 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-03-27T07:37:16.264 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-03-27T07:37:16.264 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-03-27T07:37:16.264 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-03-27T07:37:16.265 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 271, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1423960, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 271, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 271, 2024-03-27T07:37:16.266 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1423960, 2024-03-27T07:37:16.267 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-27T07:37:16.267 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:16.267 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:16.267 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:16.267 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:16.267 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:16.267 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:37:16.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:16 smithi082 ceph-mon[32178]: pgmap v430: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 583 KiB/s wr, 78 op/s 2024-03-27T07:37:16.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:16 smithi149 ceph-mon[36065]: pgmap v430: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 583 KiB/s wr, 78 op/s 2024-03-27T07:37:16.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:16 smithi153 ceph-mon[36179]: pgmap v430: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 583 KiB/s wr, 78 op/s 2024-03-27T07:37:17.008 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-03-27T07:37:17.008 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-03-27T07:37:17.008 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-03-27T07:37:17.009 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-03-27T07:37:17.009 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-03-27T07:37:17.009 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-03-27T07:37:17.009 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-03-27T07:37:17.009 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-03-27T07:37:17.009 DEBUG:tasks.check_counter:Getting stats from g 2024-03-27T07:37:17.009 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.g perf dump 2024-03-27T07:37:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:37:18.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:18 smithi082 ceph-mon[32178]: pgmap v431: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 21 op/s 2024-03-27T07:37:18.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:18 smithi149 ceph-mon[36065]: pgmap v431: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 21 op/s 2024-03-27T07:37:18.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:18 smithi153 ceph-mon[36179]: pgmap v431: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 21 op/s 2024-03-27T07:37:20.282 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:37:20.282 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:37:20.282 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.001114096, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000175808, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:20.283 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 266, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 256, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1461136, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 157840, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-03-27T07:37:20.284 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.046387195, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.015260752, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.033388595, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.005247172, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 255, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.009932618, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000038951 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.285 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1461136, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 157840 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 6, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 197, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3344, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 190400, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.014444213, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.009539674, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.002489118, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:37:20.286 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 195, 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.013176301, 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000067570 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 190400 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-03-27T07:37:20.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:37:20.288 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:37:20.289 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148977, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 30, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-03-27T07:37:20.290 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-03-27T07:37:20.291 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 268, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1423570, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 268, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-27T07:37:20.292 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 268, 2024-03-27T07:37:20.293 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1423570, 2024-03-27T07:37:20.293 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-27T07:37:20.293 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:20.293 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:20.293 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:20.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:20.293 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:20.293 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:37:20.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:20 smithi082 ceph-mon[32178]: pgmap v432: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 16 op/s 2024-03-27T07:37:20.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:20 smithi149 ceph-mon[36065]: pgmap v432: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 16 op/s 2024-03-27T07:37:20.787 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:20 smithi153 ceph-mon[36179]: pgmap v432: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 16 op/s 2024-03-27T07:37:21.561 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-03-27T07:37:21.561 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-03-27T07:37:21.561 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-03-27T07:37:21.561 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-03-27T07:37:21.561 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-03-27T07:37:21.561 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-03-27T07:37:21.561 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-03-27T07:37:21.561 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-03-27T07:37:21.561 DEBUG:tasks.check_counter:Getting stats from j 2024-03-27T07:37:21.562 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.j perf dump 2024-03-27T07:37:21.944 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T07:37:22.628 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:22 smithi082 ceph-mon[32178]: pgmap v433: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-03-27T07:37:22.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:22 smithi149 ceph-mon[36065]: pgmap v433: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-03-27T07:37:22.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:22 smithi153 ceph-mon[36179]: pgmap v433: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-03-27T07:37:24.068 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-03-27T07:37:24.068 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:37:24.068 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.001128360, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000283538, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:24.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 6, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 203, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3344, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 191456, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-03-27T07:37:24.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.015298972, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.010469678, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.002098518, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 201, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.011193697, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000055690 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3344, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 191456 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 272, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 262, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1462768, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 161680, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.046059871, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.015652494, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.034076365, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.005308418, 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:24.072 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 261, 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.011872986, 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000045490 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1462768, 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 161680 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-03-27T07:37:24.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.074 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-03-27T07:37:24.074 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-03-27T07:37:24.074 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-03-27T07:37:24.074 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:37:24.074 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:37:24.074 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:37:24.075 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:37:24.076 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 149034, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 32, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-03-27T07:37:24.077 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-03-27T07:37:24.078 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 274, 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1424350, 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 274, 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 274, 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1424350, 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-03-27T07:37:24.079 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-03-27T07:37:24.685 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:24 smithi082 ceph-mon[32178]: pgmap v434: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 8 op/s 2024-03-27T07:37:24.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:24 smithi149 ceph-mon[36065]: pgmap v434: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 8 op/s 2024-03-27T07:37:24.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:24 smithi153 ceph-mon[36179]: pgmap v434: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 8 op/s 2024-03-27T07:37:24.809 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-03-27T07:37:24.809 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-03-27T07:37:24.809 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-03-27T07:37:24.809 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-03-27T07:37:24.810 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-03-27T07:37:24.810 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-03-27T07:37:24.810 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-03-27T07:37:24.810 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-03-27T07:37:24.810 DEBUG:tasks.check_counter:Getting stats from b 2024-03-27T07:37:24.810 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.b perf dump 2024-03-27T07:37:26.356 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:37:26.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:26 smithi149 ceph-mon[36065]: pgmap v435: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-03-27T07:37:26.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:26 smithi153 ceph-mon[36179]: pgmap v435: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-03-27T07:37:26.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:26 smithi082 ceph-mon[32178]: pgmap v435: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-03-27T07:37:29.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:28 smithi082 ceph-mon[32178]: pgmap v436: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-03-27T07:37:29.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:28 smithi149 ceph-mon[36065]: pgmap v436: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-03-27T07:37:29.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:28 smithi153 ceph-mon[36179]: pgmap v436: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-03-27T07:37:31.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:30 smithi082 ceph-mon[32178]: pgmap v437: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-03-27T07:37:31.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:30 smithi149 ceph-mon[36065]: pgmap v437: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-03-27T07:37:31.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:30 smithi153 ceph-mon[36179]: pgmap v437: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-03-27T07:37:32.537 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-03-27T07:37:32.537 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:37:32.537 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 105271, 2024-03-27T07:37:32.537 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 136831, 2024-03-27T07:37:32.537 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 81652528, 2024-03-27T07:37:32.537 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 205382930, 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 183, 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 3, 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 8.087418601, 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 3.197640859, 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 3.754187754, 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 1.608004444, 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 136833, 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 44.309905168, 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000323824 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:32.538 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 175227, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.029988620, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000171 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 1633024, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 327472 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 82304, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 74051, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 39756985, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 190088331, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 13, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 5, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 6.430417767, 2024-03-27T07:37:32.539 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 2.358957575, 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 2.295967987, 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 1.948272622, 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 74052, 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 57.371090164, 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000774740 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 66351, 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.010910960, 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000164 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 43472, 2024-03-27T07:37:32.540 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 523264 2024-03-27T07:37:32.541 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.541 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:37:32.541 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 288594, 2024-03-27T07:37:32.541 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 441081, 2024-03-27T07:37:32.541 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 94230826, 2024-03-27T07:37:32.541 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 325732783, 2024-03-27T07:37:32.541 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 22, 2024-03-27T07:37:32.541 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 9, 2024-03-27T07:37:32.541 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 15.872059678, 2024-03-27T07:37:32.541 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 7.568169384, 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 11.823329794, 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 1.999075486, 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 441073, 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 90.609164354, 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000205428 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 351566, 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.080832440, 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000229 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.542 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 484928, 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 162464 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: "cct": { 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: "total_workers": 1, 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: "unhealthy_workers": 0 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-MDSRank": { 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 23121, 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 147.646015579, 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.006385797 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:32.543 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-PurgeQueue": { 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 29656, 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 10.935861269, 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000368757 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": { 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "request": 141223, 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "reply": 134147, 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "reply_latency": { 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 134147, 2024-03-27T07:37:32.544 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 4295.577177314, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.032021418 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_reply": 0, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "forward": 7073, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_complete": 332, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_keys": 2, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_commit": 7327, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_split": 95, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_merge": 1, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes": 24227, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_top": 16886, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_bottom": 7244, 2024-03-27T07:37:32.545 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pin_tail": 97, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pinned": 102, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_expired": 80358, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_with_caps": 1, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": 1, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "subtrees": 5, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse": 252579, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_hit": 213983, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_forward": 6790, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_discover": 1542, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_dir_fetch": 58, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_remote_ino": 0, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_lock": 1201, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "load_cent": 10, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "q": 0, 2024-03-27T07:37:32.546 INFO:teuthology.orchestra.run.smithi149.stdout: "exported": 219, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "exported_inodes": 59490, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "imported": 247, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "imported_inodes": 53615, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_dir_fetch": 0, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_backtrace_fetch": 34147, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_peer_discover": 0, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rfiles": 4, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rbytes": 234, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rsnaps": 6, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_fetch": 34147, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_set_tag": 0, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_inotable_repaired": 0, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_inodes": 281, 2024-03-27T07:37:32.547 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_base_inodes": 9, 2024-03-27T07:37:32.548 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dirfrag_rstats": 272, 2024-03-27T07:37:32.548 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_file_inodes": 33866, 2024-03-27T07:37:32.548 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_inode_file_caps": 143, 2024-03-27T07:37:32.548 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_revoke": 22431, 2024-03-27T07:37:32.548 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_grant": 47319, 2024-03-27T07:37:32.548 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_trunc": 5, 2024-03-27T07:37:32.548 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T07:37:32.548 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T07:37:32.548 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps": 47925, 2024-03-27T07:37:32.548 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps_dirty": 23213, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_cap_release": 1562, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "process_request_cap_release": 49139 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache": { 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update": 1840, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update_receipt": 5942, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_try_discover": 3471, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_send_discover": 4962, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_handle_discover": 3908, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays": 89, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_delayed": 0, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_enqueuing": 0, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_created": 18552, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_enqueued": 18463, 2024-03-27T07:37:32.549 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_reintegrated": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_migrated": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_processing": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_enqueued": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_prioritized": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_started": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_completed": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_quiesce_path": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_quiesce_inode": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_enqueue_scrub": 9, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_exportdir": 219, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_flush": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragmentdir": 96, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragstats": 0, 2024-03-27T07:37:32.550 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_inodestats": 0 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log": { 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "evlrg": 5, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "evadd": 112485, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "evex": 112478, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "evtrm": 112478, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "ev": 7, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "evexg": 0, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "evexd": 241, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "segadd": 202, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "segex": 201, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "segtrm": 201, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "seg": 1, 2024-03-27T07:37:32.551 INFO:teuthology.orchestra.run.smithi149.stdout: "segmjr": 1, 2024-03-27T07:37:32.552 INFO:teuthology.orchestra.run.smithi149.stdout: "segexg": 0, 2024-03-27T07:37:32.552 INFO:teuthology.orchestra.run.smithi149.stdout: "segexd": 1, 2024-03-27T07:37:32.552 INFO:teuthology.orchestra.run.smithi149.stdout: "expos": 342502364, 2024-03-27T07:37:32.552 INFO:teuthology.orchestra.run.smithi149.stdout: "wrpos": 342525863, 2024-03-27T07:37:32.552 INFO:teuthology.orchestra.run.smithi149.stdout: "rdpos": 0, 2024-03-27T07:37:32.552 INFO:teuthology.orchestra.run.smithi149.stdout: "jlat": { 2024-03-27T07:37:32.552 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 3942, 2024-03-27T07:37:32.552 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 171.657620471, 2024-03-27T07:37:32.552 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.043545819 2024-03-27T07:37:32.552 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "replayed": 0 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_mem": { 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "ino": 11261, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "ino+": 79128, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "ino-": 67867, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "dir": 648, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "dir+": 4564, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "dir-": 3916, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "dn": 24227, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "dn+": 128485, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "dn-": 104258, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "cap": 1, 2024-03-27T07:37:32.553 INFO:teuthology.orchestra.run.smithi149.stdout: "cap+": 50239, 2024-03-27T07:37:32.554 INFO:teuthology.orchestra.run.smithi149.stdout: "cap-": 50238, 2024-03-27T07:37:32.554 INFO:teuthology.orchestra.run.smithi149.stdout: "rss": 207312, 2024-03-27T07:37:32.554 INFO:teuthology.orchestra.run.smithi149.stdout: "heap": 231800 2024-03-27T07:37:32.554 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.554 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_server": { 2024-03-27T07:37:32.554 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_client_request": 176324, 2024-03-27T07:37:32.554 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_server_request": 8760, 2024-03-27T07:37:32.554 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_request": 141223, 2024-03-27T07:37:32.554 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_session": 347, 2024-03-27T07:37:32.554 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_peer_request": 27779, 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "req_create_latency": { 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 21504, 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 255.511325470, 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.011882037 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getattr_latency": { 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 9789, 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 870.848888605, 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.088961986 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getfilelock_latency": { 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.555 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "req_link_latency": { 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookup_latency": { 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 60102, 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 2552.188616730, 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.042464287 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookuphash_latency": { 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.556 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupino_latency": { 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1, 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000210136, 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000210136 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupname_latency": { 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupparent_latency": { 2024-03-27T07:37:32.557 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.558 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.558 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.558 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.558 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupsnap_latency": { 2024-03-27T07:37:32.558 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.559 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.559 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.559 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lssnap_latency": { 2024-03-27T07:37:32.559 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 14, 2024-03-27T07:37:32.559 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.009638392, 2024-03-27T07:37:32.559 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000688456 2024-03-27T07:37:32.559 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.559 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mkdir_latency": { 2024-03-27T07:37:32.559 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 115, 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 6.676294389, 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.058054733 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mknod_latency": { 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mksnap_latency": { 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 14, 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 12.726163033, 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.909011645 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "req_open_latency": { 2024-03-27T07:37:32.560 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 7249, 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 88.516484421, 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.012210854 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "req_readdir_latency": { 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 678, 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 5.644574534, 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.008325331 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rename_latency": { 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 21135, 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 432.566547977, 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.020466834 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.561 INFO:teuthology.orchestra.run.smithi149.stdout: "req_renamesnap_latency": { 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: "req_snapdiff_latency": { 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmdir_latency": { 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 95, 2024-03-27T07:37:32.562 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 27.615006096, 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.290684274 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmsnap_latency": { 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 8, 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 3.048512330, 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.381064041 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmxattr_latency": { 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setattr_latency": { 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 6, 2024-03-27T07:37:32.563 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.040784801, 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.006797466 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setdirlayout_latency": { 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setfilelock_latency": { 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setlayout_latency": { 2024-03-27T07:37:32.564 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setxattr_latency": { 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 7, 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.019469678, 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.002781382 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "req_symlink_latency": { 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 3, 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.001992378, 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000664126 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "req_unlink_latency": { 2024-03-27T07:37:32.565 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 13427, 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 40.162668344, 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.002991187 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_revoke_eviction": 0, 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_acquisition_throttle": 0, 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getvxattr_latency": { 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_sessions": { 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "session_count": 2, 2024-03-27T07:37:32.566 INFO:teuthology.orchestra.run.smithi149.stdout: "session_add": 5, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "session_remove": 3, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_open": 2, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_stale": 0, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "total_load": 1738, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "average_load": 869, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "avg_session_uptime": 822, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "mdthresh_evicted": 0 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "mempool": { 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_bytes": 240, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_items": 240, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:37:32.567 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_items": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_items": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:37:32.568 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:37:32.569 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:37:32.569 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:37:32.569 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:37:32.569 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:37:32.569 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_items": 0, 2024-03-27T07:37:32.569 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:37:32.569 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:37:32.569 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:37:32.569 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_items": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_bytes": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_items": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_bytes": 1443743, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_items": 11615, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_bytes": 88, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_items": 1, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_bytes": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_items": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_items": 0, 2024-03-27T07:37:32.570 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_items": 0, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_bytes": 8088, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_items": 170, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_bytes": 0, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_items": 0, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_bytes": 44832637, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_items": 450787, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_bytes": 0, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_items": 0, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_bytes": 0, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_items": 0 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.571 INFO:teuthology.orchestra.run.smithi149.stdout: "objecter": { 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "op_active": 0, 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "op_laggy": 0, 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send": 111081, 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send_bytes": 428297947, 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "op_resend": 37, 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "op_reply": 111081, 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "op_latency": { 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 111081, 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 39139.730050874, 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.352353058 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "op_inflight": 0, 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "oplen_avg": { 2024-03-27T07:37:32.572 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 111081, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 215175 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "op": 111081, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "op_r": 35281, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "op_w": 75800, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "op_rmw": 0, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "op_pg": 0, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_stat": 6388, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_create": 43336, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_read": 791, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_write": 4726, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writefull": 631, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writesame": 0, 2024-03-27T07:37:32.573 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_append": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_zero": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_truncate": 95, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_delete": 19151, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_mapext": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_sparse_read": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_clonerange": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_getxattr": 34172, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_setxattr": 86673, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_cmpxattr": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_rmxattr": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_resetxattrs": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_call": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_watch": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_notify": 0, 2024-03-27T07:37:32.574 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls_filter": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_other": 5, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_active": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_send": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_resend": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_ping": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_active": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_send": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_resend": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_active": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_send": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_resend": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_active": 0, 2024-03-27T07:37:32.575 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_send": 0, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_resend": 0, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "command_active": 0, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "command_send": 0, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "command_resend": 0, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "map_epoch": 106, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "map_full": 0, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "map_inc": 21, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_sessions": 12, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_open": 12, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_close": 0, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_laggy": 0, 2024-03-27T07:37:32.576 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_wr": 14703, 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_rd": 668, 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_del": 3836 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "oft": { 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_objs": 1, 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_kv_pairs": 0, 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_updates": 0, 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_removes": 0 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "osd-slow-ops": { 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_ops_count": 0 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "purge_queue": { 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops": 0, 2024-03-27T07:37:32.577 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops_high_water": 10, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing": 0, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_high_water": 10, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed_ops": 18471, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed": 18463, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_item_in_journal": 0 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 476165, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 176719351, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 476165, 2024-03-27T07:37:32.578 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 476165, 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 176719351, 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_bytes": { 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:32.579 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 111081, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 430600054, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 111081, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 430600054, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_ops": { 2024-03-27T07:37:32.580 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 1024, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 111081, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 111081, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 111081, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 111081, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.581 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle": { 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 18463, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 2307427, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 18463, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 783, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 2307427, 2024-03-27T07:37:32.582 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:32.583 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.583 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.583 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.583 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:32.583 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:32.583 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle-0x559953db0500": { 2024-03-27T07:37:32.583 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:32.583 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-03-27T07:37:32.583 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:32.583 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 112485, 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 338331559, 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 112485, 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 3942, 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 338331559, 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:32.584 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-03-27T07:37:33.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:32 smithi082 ceph-mon[32178]: pgmap v438: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-03-27T07:37:33.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:32 smithi149 ceph-mon[36065]: pgmap v438: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-03-27T07:37:33.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:32 smithi153 ceph-mon[36179]: pgmap v438: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.8 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-03-27T07:37:34.684 INFO:tasks.check_counter:Daemon mds.b mds.exported=219 2024-03-27T07:37:34.684 INFO:tasks.check_counter:Daemon mds.b mds.imported=247 2024-03-27T07:37:34.684 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1840 2024-03-27T07:37:34.684 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=5942 2024-03-27T07:37:34.684 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-03-27T07:37:34.684 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=14 2024-03-27T07:37:34.685 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=8 2024-03-27T07:37:34.685 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=95 2024-03-27T07:37:34.685 DEBUG:tasks.check_counter:Getting stats from e 2024-03-27T07:37:34.685 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.e perf dump 2024-03-27T07:37:35.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:34 smithi082 ceph-mon[32178]: pgmap v439: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-03-27T07:37:35.224 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:37:35.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:34 smithi149 ceph-mon[36065]: pgmap v439: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-03-27T07:37:35.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:34 smithi153 ceph-mon[36179]: pgmap v439: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-03-27T07:37:37.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:36 smithi082 ceph-mon[32178]: pgmap v440: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-03-27T07:37:37.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:36 smithi149 ceph-mon[36065]: pgmap v440: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-03-27T07:37:37.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:36 smithi153 ceph-mon[36179]: pgmap v440: 97 pgs: 20 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 39 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 6 op/s 2024-03-27T07:37:39.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:38 smithi149 ceph-mon[36065]: pgmap v441: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:37:39.121 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-03-27T07:37:39.121 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:37:39.121 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 1088, 2024-03-27T07:37:39.121 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 1090, 2024-03-27T07:37:39.121 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 168070289, 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 346048, 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 8, 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 4, 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.173744146, 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.022105689, 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.117801758, 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.026853174, 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1088, 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.042856810, 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000039390 2024-03-27T07:37:39.122 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 1018, 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 1157, 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 131795760, 2024-03-27T07:37:39.123 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 779463, 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 6, 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 5, 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.180034062, 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.031474374, 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.131776103, 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.022054190, 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1157, 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.049069309, 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000042410 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:39.124 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 1569936, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 558448 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 1819, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 1850, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 123097442, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 704524, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 8, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 6, 2024-03-27T07:37:39.125 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.215377796, 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.037271251, 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.113304718, 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.053183365, 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 1847, 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.069351574, 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000037548 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.126 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 126400 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "cct": { 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "total_workers": 1, 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "unhealthy_workers": 0 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-MDSRank": { 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 5796, 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.134705926, 2024-03-27T07:37:39.127 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000023241 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-PurgeQueue": { 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": { 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: "request": 0, 2024-03-27T07:37:39.128 INFO:teuthology.orchestra.run.smithi149.stdout: "reply": 0, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "reply_latency": { 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_reply": 0, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "forward": 0, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_complete": 0, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_keys": 0, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_commit": 0, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_split": 0, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_merge": 0, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes": 65460, 2024-03-27T07:37:39.129 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_top": 6665, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_bottom": 58795, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pin_tail": 0, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pinned": 55938, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_expired": 2, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_with_caps": 0, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": 0, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "subtrees": 1, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse": 0, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_hit": 0, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_forward": 0, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_discover": 0, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_dir_fetch": 0, 2024-03-27T07:37:39.130 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_remote_ino": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_lock": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "load_cent": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "q": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "exported": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "exported_inodes": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "imported": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "imported_inodes": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_dir_fetch": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_backtrace_fetch": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_peer_discover": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rfiles": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rbytes": 0, 2024-03-27T07:37:39.131 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rsnaps": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_fetch": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_set_tag": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_inotable_repaired": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_inodes": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_base_inodes": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dirfrag_rstats": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_file_inodes": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_inode_file_caps": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_revoke": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_grant": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_trunc": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T07:37:39.132 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps_dirty": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_cap_release": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "process_request_cap_release": 0 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache": { 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update_receipt": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_try_discover": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_send_discover": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_handle_discover": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_delayed": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_enqueuing": 0, 2024-03-27T07:37:39.133 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_created": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_enqueued": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_reintegrated": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_migrated": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_processing": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_enqueued": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_prioritized": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_started": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_completed": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_quiesce_path": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_quiesce_inode": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_enqueue_scrub": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_exportdir": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_flush": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragmentdir": 0, 2024-03-27T07:37:39.134 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragstats": 0, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_inodestats": 0 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log": { 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "evlrg": 0, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "evadd": 0, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "evex": 0, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "evtrm": 0, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "ev": 116035, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "evexg": 0, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "evexd": 0, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "segadd": 0, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "segex": 0, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "segtrm": 0, 2024-03-27T07:37:39.135 INFO:teuthology.orchestra.run.smithi149.stdout: "seg": 129, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "segmjr": 11, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "segexg": 0, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "segexd": 0, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "expos": 61402369, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "wrpos": 424523746, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "rdpos": 424510614, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "jlat": { 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "replayed": 116035 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_mem": { 2024-03-27T07:37:39.136 INFO:teuthology.orchestra.run.smithi149.stdout: "ino": 20359, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "ino+": 86321, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "ino-": 65962, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "dir": 671, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "dir+": 2265, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "dir-": 1594, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "dn": 65460, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "dn+": 142422, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "dn-": 76962, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "cap": 0, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "cap+": 0, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "cap-": 0, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "rss": 170272, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "heap": 215416 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.137 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_server": { 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_client_request": 0, 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_server_request": 0, 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_request": 0, 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_session": 0, 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_peer_request": 0, 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "req_create_latency": { 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getattr_latency": { 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.138 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getfilelock_latency": { 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "req_link_latency": { 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookup_latency": { 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.139 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookuphash_latency": { 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupino_latency": { 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupname_latency": { 2024-03-27T07:37:39.140 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupparent_latency": { 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupsnap_latency": { 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lssnap_latency": { 2024-03-27T07:37:39.141 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.142 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mkdir_latency": { 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mknod_latency": { 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mksnap_latency": { 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.143 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "req_open_latency": { 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "req_readdir_latency": { 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rename_latency": { 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.144 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "req_renamesnap_latency": { 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "req_snapdiff_latency": { 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmdir_latency": { 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.145 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmsnap_latency": { 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmxattr_latency": { 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setattr_latency": { 2024-03-27T07:37:39.146 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setdirlayout_latency": { 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setfilelock_latency": { 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.147 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setlayout_latency": { 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setxattr_latency": { 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "req_symlink_latency": { 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.148 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "req_unlink_latency": { 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_revoke_eviction": 0, 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_acquisition_throttle": 0, 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getvxattr_latency": { 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.149 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_sessions": { 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "session_count": 2, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "session_add": 3, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "session_remove": 1, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_open": 2, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_stale": 0, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "total_load": 0, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "average_load": 0, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "avg_session_uptime": 3494, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "mdthresh_evicted": 0 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "mempool": { 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_bytes": 0, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_items": 0, 2024-03-27T07:37:39.150 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_items": 0, 2024-03-27T07:37:39.151 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_items": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_items": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_items": 0, 2024-03-27T07:37:39.152 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_bytes": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_items": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_bytes": 1005748, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_items": 20770, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_bytes": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_items": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_bytes": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_items": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_items": 0, 2024-03-27T07:37:39.153 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_items": 0, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_bytes": 8088, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_items": 170, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_bytes": 0, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_items": 0, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_bytes": 94099339, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_items": 900401, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_bytes": 0, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_items": 0, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_bytes": 0, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_items": 0 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.154 INFO:teuthology.orchestra.run.smithi149.stdout: "objecter": { 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "op_active": 0, 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "op_laggy": 0, 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send": 3601, 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send_bytes": 21, 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "op_resend": 3, 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "op_reply": 3601, 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "op_latency": { 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 3601, 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 12.300760432, 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.003415929 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "op_inflight": 0, 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "oplen_avg": { 2024-03-27T07:37:39.155 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 3601, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 3602 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "op": 3601, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "op_r": 3601, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "op_w": 0, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "op_rmw": 0, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "op_pg": 0, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_stat": 2180, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_create": 0, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_read": 1419, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_write": 0, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writefull": 0, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writesame": 0, 2024-03-27T07:37:39.156 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_append": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_zero": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_truncate": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_delete": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_mapext": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_sparse_read": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_clonerange": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_getxattr": 1, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_setxattr": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_cmpxattr": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_rmxattr": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_resetxattrs": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_call": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_watch": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_notify": 0, 2024-03-27T07:37:39.157 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls_filter": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_other": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_active": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_send": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_resend": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_ping": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_active": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_send": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_resend": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_active": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_send": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_resend": 0, 2024-03-27T07:37:39.158 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_active": 0, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_send": 0, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_resend": 0, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "command_active": 0, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "command_send": 0, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "command_resend": 0, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "map_epoch": 106, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "map_full": 0, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "map_inc": 20, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_sessions": 11, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_open": 11, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_close": 0, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_laggy": 0, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_wr": 0, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_rd": 2, 2024-03-27T07:37:39.159 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_del": 0 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "oft": { 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_objs": 0, 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_kv_pairs": 0, 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_updates": 0, 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_removes": 0 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "osd-slow-ops": { 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_ops_count": 0 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "purge_queue": { 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops": 0, 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops_high_water": 0, 2024-03-27T07:37:39.160 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing": 0, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_high_water": 0, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed_ops": 0, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed": 0, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_item_in_journal": 0 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 3921, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 422591329, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 3921, 2024-03-27T07:37:39.161 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 3921, 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 422591329, 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_bytes": { 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-03-27T07:37:39.162 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 3601, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 420396193, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 3601, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 420396193, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:39.163 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_ops": { 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 1024, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 3601, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 3601, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 3601, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 3601, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.164 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle": { 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:39.165 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 0, 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 0, 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle-0x559895efc6e0": { 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:39.166 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 0, 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 0, 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:39.167 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-03-27T07:37:39.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:38 smithi082 ceph-mon[32178]: pgmap v441: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:37:39.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:38 smithi153 ceph-mon[36179]: pgmap v441: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:37:40.411 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-03-27T07:37:40.412 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-03-27T07:37:40.412 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-03-27T07:37:40.412 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-03-27T07:37:40.412 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-03-27T07:37:40.412 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-03-27T07:37:40.412 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-03-27T07:37:40.412 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-03-27T07:37:40.412 DEBUG:tasks.check_counter:Getting stats from h 2024-03-27T07:37:40.412 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.h perf dump 2024-03-27T07:37:40.942 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:37:41.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:40 smithi082 ceph-mon[32178]: pgmap v442: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:37:41.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:40 smithi149 ceph-mon[36065]: pgmap v442: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:37:41.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:40 smithi153 ceph-mon[36179]: pgmap v442: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T07:37:43.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:42 smithi082 ceph-mon[32178]: pgmap v443: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-27T07:37:43.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:42 smithi149 ceph-mon[36065]: pgmap v443: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-27T07:37:43.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:42 smithi153 ceph-mon[36179]: pgmap v443: 97 pgs: 19 active+clean+snaptrim, 38 active+clean+snaptrim_wait, 40 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-27T07:37:44.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:43 smithi149 ceph-mon[36065]: pgmap v444: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-27T07:37:44.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:43 smithi153 ceph-mon[36179]: pgmap v444: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-27T07:37:44.312 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-03-27T07:37:44.312 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:37:44.313 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 17352, 2024-03-27T07:37:44.313 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 17524, 2024-03-27T07:37:44.313 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 6007468, 2024-03-27T07:37:44.313 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 205694909, 2024-03-27T07:37:44.313 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 23, 2024-03-27T07:37:44.313 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 4, 2024-03-27T07:37:44.313 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 2.167776172, 2024-03-27T07:37:44.313 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.931554694, 2024-03-27T07:37:44.313 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.335641226, 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.773106923, 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 17522, 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 2.119204021, 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000120945 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 12, 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000001141, 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000095 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.314 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 392784 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 267300, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 394150, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 81857841, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 351378146, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 22, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 10, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 13.068304087, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 6.508662706, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 44.755483191, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.651793517, 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:44.315 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 394146, 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 48.702244836, 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000123563 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 321453, 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.089767215, 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000279 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 8944, 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 147664 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 93085, 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 99062, 2024-03-27T07:37:44.316 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 86768937, 2024-03-27T07:37:44.317 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 134222227, 2024-03-27T07:37:44.317 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 7, 2024-03-27T07:37:44.317 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 5, 2024-03-27T07:37:44.317 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 6.752741587, 2024-03-27T07:37:44.317 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 3.224063179, 2024-03-27T07:37:44.317 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 3.536335123, 2024-03-27T07:37:44.317 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.559122320, 2024-03-27T07:37:44.317 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:44.317 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 99063, 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 7.887576898, 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000079621 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 154552, 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.026295005, 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000170 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 1578784, 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 682432 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "cct": { 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "total_workers": 1, 2024-03-27T07:37:44.318 INFO:teuthology.orchestra.run.smithi149.stdout: "unhealthy_workers": 0 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-MDSRank": { 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 21691, 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 124.520284472, 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.005740642 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "finisher-PurgeQueue": { 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "queue_len": 0, 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "complete_latency": { 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 32189, 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 12.745623168, 2024-03-27T07:37:44.319 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000395962 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "mds": { 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "request": 140307, 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "reply": 136453, 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "reply_latency": { 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 136453, 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 5019.861179752, 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.036788206 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_reply": 0, 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "forward": 3853, 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_complete": 213, 2024-03-27T07:37:44.320 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_fetch_keys": 0, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_commit": 670, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_split": 74, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_merge": 0, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes": 37470, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_top": 6, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_bottom": 8, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pin_tail": 37456, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_pinned": 37459, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_expired": 84145, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "inodes_with_caps": 1, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "caps": 1, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "subtrees": 4, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse": 263498, 2024-03-27T07:37:44.321 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_hit": 213945, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_forward": 3509, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_discover": 832, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_dir_fetch": 8, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_remote_ino": 0, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "traverse_lock": 1379, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "load_cent": 0, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "q": 0, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "exported": 170, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "exported_inodes": 69332, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "imported": 145, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "imported_inodes": 76372, 2024-03-27T07:37:44.322 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_dir_fetch": 0, 2024-03-27T07:37:44.323 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_backtrace_fetch": 26408, 2024-03-27T07:37:44.323 INFO:teuthology.orchestra.run.smithi149.stdout: "openino_peer_discover": 0, 2024-03-27T07:37:44.323 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rfiles": 35443, 2024-03-27T07:37:44.323 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rbytes": 652254398, 2024-03-27T07:37:44.323 INFO:teuthology.orchestra.run.smithi149.stdout: "root_rsnaps": 5, 2024-03-27T07:37:44.323 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_fetch": 26408, 2024-03-27T07:37:44.323 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_set_tag": 0, 2024-03-27T07:37:44.323 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T07:37:44.323 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_inotable_repaired": 0, 2024-03-27T07:37:44.323 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_inodes": 83, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dir_base_inodes": 0, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_dirfrag_rstats": 83, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "scrub_file_inodes": 26325, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_inode_file_caps": 250, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_revoke": 17272, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_grant": 37787, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_trunc": 0, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps": 50611, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_caps_dirty": 20417, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_cap_release": 1285, 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: "process_request_cap_release": 46651 2024-03-27T07:37:44.324 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.325 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_cache": { 2024-03-27T07:37:44.325 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update": 2284, 2024-03-27T07:37:44.325 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_update_receipt": 6487, 2024-03-27T07:37:44.325 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_try_discover": 3736, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_send_discover": 4532, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "dir_handle_discover": 3691, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays": 100, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_delayed": 0, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "num_strays_enqueuing": 0, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_created": 19904, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_enqueued": 19804, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_reintegrated": 0, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "strays_migrated": 0, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_processing": 0, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_enqueued": 0, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "num_recovering_prioritized": 0, 2024-03-27T07:37:44.326 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_started": 0, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "recovery_completed": 0, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_quiesce_path": 0, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_quiesce_inode": 0, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_enqueue_scrub": 0, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_exportdir": 172, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_flush": 0, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragmentdir": 74, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_fragstats": 0, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "ireq_inodestats": 0 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_log": { 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "evlrg": 6, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "evadd": 116035, 2024-03-27T07:37:44.327 INFO:teuthology.orchestra.run.smithi149.stdout: "evex": 25093, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "evtrm": 24581, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "ev": 91454, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "evexg": 0, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "evexd": 512, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "segadd": 161, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "segex": 33, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "segtrm": 32, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "seg": 129, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "segmjr": 8, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "segexg": 0, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "segexd": 1, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "expos": 61402369, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "wrpos": 424523746, 2024-03-27T07:37:44.328 INFO:teuthology.orchestra.run.smithi149.stdout: "rdpos": 0, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "jlat": { 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 3266, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 108.921143983, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.033350013 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "replayed": 0 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_mem": { 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "ino": 19512, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "ino+": 87976, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "ino-": 68464, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "dir": 687, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "dir+": 4860, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "dir-": 4173, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "dn": 37470, 2024-03-27T07:37:44.329 INFO:teuthology.orchestra.run.smithi149.stdout: "dn+": 146395, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "dn-": 108925, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "cap": 1, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "cap+": 52613, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "cap-": 52612, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "rss": 201772, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "heap": 223608 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_server": { 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_client_request": 161386, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "dispatch_server_request": 4013, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_request": 140307, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_client_session": 209, 2024-03-27T07:37:44.330 INFO:teuthology.orchestra.run.smithi149.stdout: "handle_peer_request": 17909, 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "req_create_latency": { 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 15583, 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 219.702007172, 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.014098826 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getattr_latency": { 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 509, 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 171.381316572, 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.336701997 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getfilelock_latency": { 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.331 INFO:teuthology.orchestra.run.smithi149.stdout: "req_link_latency": { 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookup_latency": { 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 82396, 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 4081.372556928, 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.049533624 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookuphash_latency": { 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.332 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupino_latency": { 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupname_latency": { 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupparent_latency": { 2024-03-27T07:37:44.333 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.334 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.334 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.334 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.334 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lookupsnap_latency": { 2024-03-27T07:37:44.334 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.334 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.334 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "req_lssnap_latency": { 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mkdir_latency": { 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 59, 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 4.104939955, 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.069575253 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mknod_latency": { 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.335 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "req_mksnap_latency": { 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "req_open_latency": { 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 6620, 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 55.254447871, 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.008346593 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "req_readdir_latency": { 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 687, 2024-03-27T07:37:44.336 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 3.838156704, 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.005586836 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rename_latency": { 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 15572, 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 420.546542177, 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.027006585 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "req_renamesnap_latency": { 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "req_snapdiff_latency": { 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.337 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmdir_latency": { 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 100, 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 23.110575184, 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.231105751 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmsnap_latency": { 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.338 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: "req_rmxattr_latency": { 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setattr_latency": { 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setdirlayout_latency": { 2024-03-27T07:37:44.339 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setfilelock_latency": { 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setlayout_latency": { 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.340 INFO:teuthology.orchestra.run.smithi149.stdout: "req_setxattr_latency": { 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "req_symlink_latency": { 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "req_unlink_latency": { 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 14927, 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 40.550637189, 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.002716596 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.341 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_revoke_eviction": 0, 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "cap_acquisition_throttle": 0, 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "req_getvxattr_latency": { 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_sessions": { 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "session_count": 2, 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "session_add": 3, 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "session_remove": 1, 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_open": 2, 2024-03-27T07:37:44.342 INFO:teuthology.orchestra.run.smithi149.stdout: "sessions_stale": 0, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "total_load": 5919, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "average_load": 2959, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "avg_session_uptime": 787, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "mdthresh_evicted": 0 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "mempool": { 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_bytes": 0, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_items": 0, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:37:44.343 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_items": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_items": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:37:44.344 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_items": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_items": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_bytes": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_items": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_bytes": 1844816, 2024-03-27T07:37:44.345 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_items": 19138, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_bytes": 88, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_items": 1, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_bytes": 0, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_items": 0, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_items": 0, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_items": 0, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_bytes": 8088, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_items": 170, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_bytes": 0, 2024-03-27T07:37:44.346 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_items": 0, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_bytes": 73260360, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_items": 762173, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_bytes": 0, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_items": 0, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_bytes": 0, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_items": 0 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "objecter": { 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "op_active": 0, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "op_laggy": 0, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send": 52939, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "op_send_bytes": 438967225, 2024-03-27T07:37:44.347 INFO:teuthology.orchestra.run.smithi149.stdout: "op_resend": 28, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "op_reply": 52939, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "op_latency": { 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 52939, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 390.711439274, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.007380408 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "op_inflight": 0, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "oplen_avg": { 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 52939, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 54664 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "op": 52939, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "op_r": 27378, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "op_w": 25561, 2024-03-27T07:37:44.348 INFO:teuthology.orchestra.run.smithi149.stdout: "op_rmw": 0, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "op_pg": 0, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_stat": 0, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_create": 21, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_read": 757, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_write": 4027, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writefull": 393, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_writesame": 0, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_append": 0, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_zero": 0, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_truncate": 74, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_delete": 19929, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_mapext": 0, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_sparse_read": 0, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_clonerange": 0, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_getxattr": 26409, 2024-03-27T07:37:44.349 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_setxattr": 42, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_cmpxattr": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_rmxattr": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_resetxattrs": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_call": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_watch": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_notify": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_pgls_filter": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "osdop_other": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_active": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_send": 0, 2024-03-27T07:37:44.350 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_resend": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "linger_ping": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_active": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_send": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "poolop_resend": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_active": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_send": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "poolstat_resend": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_active": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_send": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "statfs_resend": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "command_active": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "command_send": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "command_resend": 0, 2024-03-27T07:37:44.351 INFO:teuthology.orchestra.run.smithi149.stdout: "map_epoch": 106, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "map_full": 0, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "map_inc": 20, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_sessions": 12, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_open": 12, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_session_close": 0, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_laggy": 0, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_wr": 2179, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_rd": 426, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_del": 407 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "oft": { 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_objs": 1, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_kv_pairs": 0, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_updates": 0, 2024-03-27T07:37:44.352 INFO:teuthology.orchestra.run.smithi149.stdout: "omap_total_removes": 0 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "osd-slow-ops": { 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "slow_ops_count": 0 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "purge_queue": { 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops": 0, 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_ops_high_water": 10, 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing": 0, 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executing_high_water": 10, 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed_ops": 19804, 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_executed": 19804, 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "pq_item_in_journal": 0 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.353 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 377733, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 144585398, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 377733, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 377733, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 144585398, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.354 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_bytes": { 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 52939, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 441561061, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 52939, 2024-03-27T07:37:44.355 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 441561061, 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-objecter_ops": { 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 1024, 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 0, 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 0, 2024-03-27T07:37:44.358 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 52939, 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 52939, 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 52939, 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 52939, 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.359 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle": { 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 19804, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 2597244, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 19804, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 759, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 2597244, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.360 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-write_buf_throttle-0x556618364500": { 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 3758096384, 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 116035, 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 420329442, 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 116035, 2024-03-27T07:37:44.361 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-03-27T07:37:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-03-27T07:37:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 3266, 2024-03-27T07:37:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 420329442, 2024-03-27T07:37:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:44.362 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:44.362 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-03-27T07:37:44.434 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:43 smithi082 ceph-mon[32178]: pgmap v444: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-27T07:37:45.872 INFO:tasks.check_counter:Daemon mds.h mds.exported=170 2024-03-27T07:37:45.873 INFO:tasks.check_counter:Daemon mds.h mds.imported=145 2024-03-27T07:37:45.873 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=2284 2024-03-27T07:37:45.873 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=6487 2024-03-27T07:37:45.873 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=5 2024-03-27T07:37:45.873 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-03-27T07:37:45.873 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-03-27T07:37:45.873 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=74 2024-03-27T07:37:45.873 DEBUG:tasks.check_counter:Getting stats from k 2024-03-27T07:37:45.873 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.k perf dump 2024-03-27T07:37:46.364 INFO:teuthology.orchestra.run.smithi149.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T07:37:46.525 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:46 smithi149 ceph-mon[36065]: pgmap v445: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T07:37:46.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:46 smithi153 ceph-mon[36179]: pgmap v445: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T07:37:46.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:46 smithi082 ceph-mon[32178]: pgmap v445: 97 pgs: 18 active+clean+snaptrim, 36 active+clean+snaptrim_wait, 43 active+clean; 1.8 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T07:37:48.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:48 smithi153 ceph-mon[36179]: pgmap v446: 97 pgs: 16 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 52 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-27T07:37:48.618 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:48 smithi149 ceph-mon[36065]: pgmap v446: 97 pgs: 16 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 52 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-27T07:37:48.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:48 smithi082 ceph-mon[32178]: pgmap v446: 97 pgs: 16 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 52 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-27T07:37:50.228 INFO:teuthology.orchestra.run.smithi149.stdout:{ 2024-03-27T07:37:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:37:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 0, 2024-03-27T07:37:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 2, 2024-03-27T07:37:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 0, 2024-03-27T07:37:50.228 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 0, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 4, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 0, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.001103937, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.000000000, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.000273068, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:50.229 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 284, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 272, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 1468064, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 166912, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 2, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 1, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.044443807, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.012042383, 2024-03-27T07:37:50.230 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.034818294, 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.007184323, 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 272, 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.014983544, 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000055086 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 1468064, 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 166912 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.231 INFO:teuthology.orchestra.run.smithi149.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_messages": 2, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages": 206, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_bytes": 320, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_bytes": 191888, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_created_connections": 5, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_active_connections": 3, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_total_time": 0.013227533, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_send_time": 0.006624506, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_recv_time": 0.004614535, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 203, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.013922290, 2024-03-27T07:37:50.232 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000068582 2024-03-27T07:37:50.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.233 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:50.233 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:50.233 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:50.233 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:50.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.233 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-27T07:37:50.233 INFO:teuthology.orchestra.run.smithi149.stdout: "msgr_send_encrypted_bytes": 191888 2024-03-27T07:37:50.233 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "cct": { 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "total_workers": 0, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "unhealthy_workers": 0 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "mempool": { 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_bytes": 0, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "bloom_filter_items": 0, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:37:50.234 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_extent_items": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_blob_items": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:37:50.235 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_txc_items": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluestore_writing_items": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_bytes": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_items": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:37:50.236 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_bytes": 149001, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_anon_items": 31, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_bytes": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "buffer_meta_items": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_bytes": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_items": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_mapbl_items": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "osd_pglog_items": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_bytes": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_items": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_bytes": 0, 2024-03-27T07:37:50.237 INFO:teuthology.orchestra.run.smithi149.stdout: "pgmap_items": 0, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_bytes": 928, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "mds_co_items": 2, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_bytes": 0, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_1_items": 0, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_bytes": 0, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "unittest_2_items": 0 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: }, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "val": 0, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "max": 104857600, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "get_started": 0, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "get": 282, 2024-03-27T07:37:50.238 INFO:teuthology.orchestra.run.smithi149.stdout: "get_sum": 1425493, 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: "get_or_fail_success": 282, 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: "take": 0, 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: "take_sum": 0, 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: "put": 282, 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: "put_sum": 1425493, 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: "wait": { 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: "avgcount": 0, 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: "sum": 0.000000000, 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: "avgtime": 0.000000000 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout: } 2024-03-27T07:37:50.239 INFO:teuthology.orchestra.run.smithi149.stdout:} 2024-03-27T07:37:50.502 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:50 smithi149 ceph-mon[36065]: pgmap v447: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-03-27T07:37:50.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:50 smithi153 ceph-mon[36179]: pgmap v447: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-03-27T07:37:50.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:50 smithi082 ceph-mon[32178]: pgmap v447: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-03-27T07:37:51.661 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-03-27T07:37:51.661 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-03-27T07:37:51.661 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-03-27T07:37:51.661 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-03-27T07:37:51.661 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-03-27T07:37:51.661 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-03-27T07:37:51.662 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-03-27T07:37:51.662 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-03-27T07:37:51.662 DEBUG:tasks.check_counter:Getting stats from c 2024-03-27T07:37:51.662 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.c perf dump 2024-03-27T07:37:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:37:52.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:52 smithi153 ceph-mon[36179]: pgmap v448: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-27T07:37:52.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:52 smithi082 ceph-mon[32178]: pgmap v448: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-27T07:37:52.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:52 smithi149 ceph-mon[36065]: pgmap v448: 97 pgs: 14 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 56 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-03-27T07:37:54.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:54 smithi153 ceph-mon[36179]: pgmap v449: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-27T07:37:54.535 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:54 smithi153 ceph-mon[36179]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:37:54.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:54 smithi082 ceph-mon[32178]: pgmap v449: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-27T07:37:54.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:54 smithi082 ceph-mon[32178]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:37:54.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:54 smithi149 ceph-mon[36065]: pgmap v449: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-27T07:37:54.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:54 smithi149 ceph-mon[36065]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T07:37:55.654 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-27T07:37:55.654 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:37:55.654 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 414, 2024-03-27T07:37:55.654 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 409, 2024-03-27T07:37:55.654 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 2014855, 2024-03-27T07:37:55.654 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 141140, 2024-03-27T07:37:55.654 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-03-27T07:37:55.654 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 1, 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.044611358, 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.014498023, 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.015635025, 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.012424828, 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 409, 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.040727302, 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000099577 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.655 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 177392, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 29200 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 160, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 194, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 40079, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 195499, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.016821390, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.004268005, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.004469751, 2024-03-27T07:37:55.656 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.006985833, 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 192, 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.029690203, 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000154636 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 144880 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:37:55.657 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 5, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 7, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 2420, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 1606, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.004401624, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.000094610, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.004074912, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000135665, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 5, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.025008054, 2024-03-27T07:37:55.658 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.005001610 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-03-27T07:37:55.659 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-03-27T07:37:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-03-27T07:37:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 856, 2024-03-27T07:37:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.024470661, 2024-03-27T07:37:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000028587 2024-03-27T07:37:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:37:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-03-27T07:37:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-03-27T07:37:55.660 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 0, 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 0, 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.661 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 100, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 100, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 3, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2024-03-27T07:37:55.662 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 3, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2024-03-27T07:37:55.663 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 4, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 234, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 6, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2024-03-27T07:37:55.664 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 0 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 0, 2024-03-27T07:37:55.665 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 0, 2024-03-27T07:37:55.666 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 0, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 0, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 302, 2024-03-27T07:37:55.667 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 0, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 2, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 9, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 342502364, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 342525863, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 342518029, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.668 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 302 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 5, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 534, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 529, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 4, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 82, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 78, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 100, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 1457, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 1357, 2024-03-27T07:37:55.669 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 0, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 0, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 49040, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 215416 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 0, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 0, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 0, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.670 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.671 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.672 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.673 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-03-27T07:37:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-03-27T07:37:55.674 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-03-27T07:37:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.675 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.676 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.677 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-03-27T07:37:55.678 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.679 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.680 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-03-27T07:37:55.681 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 2, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 0, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 0, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 0, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 2168, 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-03-27T07:37:55.682 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:37:55.683 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:37:55.684 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 196455, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 47, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-03-27T07:37:55.685 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8088, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 170, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 97248, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 460, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-03-27T07:37:55.686 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 516, 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 26, 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 3, 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 516, 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 516, 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2.263963314, 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.004387525 2024-03-27T07:37:55.687 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 516, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 517 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 516, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 516, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 0, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 314, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 0, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 199, 2024-03-27T07:37:55.688 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 2, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-03-27T07:37:55.689 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-03-27T07:37:55.690 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 106, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 4, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 6, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 6, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-03-27T07:37:55.691 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 0, 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 2, 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 0 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 0, 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.692 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 0, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 0, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 0, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 0, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 575, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 1999675, 2024-03-27T07:37:55.693 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 575, 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 575, 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 1999675, 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:37:55.694 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 516, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 1729895, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 516, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 1729895, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.695 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 516, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 516, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 516, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 516, 2024-03-27T07:37:55.696 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-03-27T07:37:55.697 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x55b99cc3a6e0": { 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-03-27T07:37:55.698 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:37:55.699 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-27T07:37:56.545 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:56 smithi153 ceph-mon[36179]: pgmap v450: 97 pgs: 11 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 65 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-27T07:37:56.553 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:56 smithi149 ceph-mon[36065]: pgmap v450: 97 pgs: 11 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 65 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-27T07:37:56.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:56 smithi082 ceph-mon[32178]: pgmap v450: 97 pgs: 11 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 65 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-27T07:37:58.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:37:58 smithi082 ceph-mon[32178]: pgmap v451: 97 pgs: 9 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 67 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-03-27T07:37:58.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:37:58 smithi149 ceph-mon[36065]: pgmap v451: 97 pgs: 9 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 67 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-03-27T07:37:58.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:37:58 smithi153 ceph-mon[36179]: pgmap v451: 97 pgs: 9 active+clean+snaptrim, 21 active+clean+snaptrim_wait, 67 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-03-27T07:38:00.076 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-03-27T07:38:00.077 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-03-27T07:38:00.077 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-03-27T07:38:00.077 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-03-27T07:38:00.077 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-03-27T07:38:00.077 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-03-27T07:38:00.077 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-03-27T07:38:00.077 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-03-27T07:38:00.077 DEBUG:tasks.check_counter:Getting stats from f 2024-03-27T07:38:00.077 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.f perf dump 2024-03-27T07:38:00.458 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:38:00.502 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:00 smithi149 ceph-mon[36065]: pgmap v452: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-27T07:38:00.589 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:00 smithi153 ceph-mon[36179]: pgmap v452: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-27T07:38:00.686 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:00 smithi082 ceph-mon[32178]: pgmap v452: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-03-27T07:38:02.483 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:02 smithi153 ceph-mon[36179]: pgmap v453: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:38:02.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:02 smithi082 ceph-mon[32178]: pgmap v453: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:38:02.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:02 smithi149 ceph-mon[36065]: pgmap v453: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 2265, 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 2265, 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 269139967, 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 719453, 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 8, 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.277241363, 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.045304071, 2024-03-27T07:38:03.040 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.162922738, 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.055920689, 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2264, 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.079232392, 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000034996 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-03-27T07:38:03.041 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 448 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 964, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 1169, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 277143578, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 833338, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 9, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 7, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.218065478, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.023452866, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.164603371, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.022627142, 2024-03-27T07:38:03.042 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1166, 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.054689424, 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000046903 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 527360 2024-03-27T07:38:03.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 1497, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 1468, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 317605236, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 543672, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.268864106, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.035166695, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.206156104, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.031161238, 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:38:03.044 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1467, 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.046010613, 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000031363 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1572816, 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 170976 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-03-27T07:38:03.045 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6731, 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.194608691, 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000028912 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-03-27T07:38:03.046 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 0, 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 0, 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-03-27T07:38:03.047 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 0, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 0, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 118265, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 14257, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 104008, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 97898, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 2, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 0, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 0, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 3, 2024-03-27T07:38:03.048 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2024-03-27T07:38:03.049 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 0, 2024-03-27T07:38:03.050 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 0 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 0, 2024-03-27T07:38:03.051 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-03-27T07:38:03.052 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 227526, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 0, 2024-03-27T07:38:03.053 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 0, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 0, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 135, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 20, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 0, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 413781903, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 865096681, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 865096107, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.054 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 227526 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 39191, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 148709, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 109518, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 1337, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 4159, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 2822, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 118265, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 245679, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 127414, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 0, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 0, 2024-03-27T07:38:03.055 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 0, 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 253088, 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 215416 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 0, 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 0, 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 0, 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.056 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.057 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.058 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.059 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-03-27T07:38:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.060 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.061 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.062 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-03-27T07:38:03.063 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.064 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.065 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.066 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-03-27T07:38:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 4, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 2, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 3, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 0, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 0, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 2835, 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-03-27T07:38:03.068 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:38:03.069 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:38:03.070 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 1718909, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 40083, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-03-27T07:38:03.071 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8088, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 170, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 174754560, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 1544186, 2024-03-27T07:38:03.072 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 4395, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 21, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 3, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 4395, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4395, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 22.011636951, 2024-03-27T07:38:03.073 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.005008336 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4395, 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4396 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 4395, 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 4395, 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 0, 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 2732, 2024-03-27T07:38:03.074 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 1661, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 1, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-03-27T07:38:03.075 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-03-27T07:38:03.076 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 106, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 20, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 11, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 11, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-03-27T07:38:03.077 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 0, 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 2, 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 0 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 0, 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 0 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-03-27T07:38:03.078 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 0, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 0, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 0, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 0, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 4722, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 863444168, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 4722, 2024-03-27T07:38:03.079 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 4722, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 863444168, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-03-27T07:38:03.080 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 4395, 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 861110985, 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 4395, 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 861110985, 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:03.081 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 4395, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 4395, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 4395, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 4395, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.082 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-03-27T07:38:03.083 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x55a0c07fa6e0": { 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-03-27T07:38:03.084 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-03-27T07:38:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 0, 2024-03-27T07:38:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 0, 2024-03-27T07:38:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:03.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:03.085 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-27T07:38:03.931 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-03-27T07:38:03.931 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-03-27T07:38:03.931 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-03-27T07:38:03.931 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-03-27T07:38:03.931 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-03-27T07:38:03.931 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-03-27T07:38:03.931 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-03-27T07:38:03.931 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-03-27T07:38:03.931 DEBUG:tasks.check_counter:Getting stats from i 2024-03-27T07:38:03.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.i perf dump 2024-03-27T07:38:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:38:04.550 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:04 smithi153 ceph-mon[36179]: pgmap v454: 97 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 78 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-03-27T07:38:04.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:04 smithi082 ceph-mon[32178]: pgmap v454: 97 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 78 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-03-27T07:38:04.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:04 smithi149 ceph-mon[36065]: pgmap v454: 97 pgs: 7 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 78 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-03-27T07:38:06.344 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:06 smithi153 ceph-mon[36179]: pgmap v455: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-03-27T07:38:06.421 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-27T07:38:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:38:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 88541, 2024-03-27T07:38:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 90900, 2024-03-27T07:38:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 77951275, 2024-03-27T07:38:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 330815023, 2024-03-27T07:38:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 20, 2024-03-27T07:38:06.421 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 7.073507358, 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 2.740573236, 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 2.280180368, 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 2.182980123, 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 90898, 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 15.334859933, 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000168704 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 89004, 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.016298710, 2024-03-27T07:38:06.422 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000183 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 5888, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 3248 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 413043, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 644353, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 159629875, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 568691256, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 22, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 9, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 21.061001885, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 9.961141382, 2024-03-27T07:38:06.423 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 378.216014460, 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 1.329686414, 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 644351, 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 58.115991938, 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000090193 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 659615, 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.132983023, 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000201 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 2208, 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 136096 2024-03-27T07:38:06.424 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 22880, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 23026, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 16566953, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 366512016, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 11, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 6, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 3.001216894, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 1.358638134, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.427094784, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 1.102014638, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 23025, 2024-03-27T07:38:06.425 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.230338923, 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000183728 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4, 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000354, 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000088 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1590624, 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 1215904 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2024-03-27T07:38:06.426 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 30680, 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 227.178638385, 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.007404779 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 61437, 2024-03-27T07:38:06.427 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 19.447356214, 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000316541 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 174832, 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 162420, 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 162420, 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2368.848556946, 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014584709 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 12406, 2024-03-27T07:38:06.428 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_complete": 571, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch_keys": 0, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 1617, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 152, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 3, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 71873, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 2566, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 48538, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 20769, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 68206, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 139833, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 3, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 3, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 5, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 270837, 2024-03-27T07:38:06.429 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 240845, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 12265, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 1448, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 41, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 643, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 0, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 230, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 107973, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 227, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 106808, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2024-03-27T07:38:06.430 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 39081, 2024-03-27T07:38:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2024-03-27T07:38:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 35443, 2024-03-27T07:38:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 652254398, 2024-03-27T07:38:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 5, 2024-03-27T07:38:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 39081, 2024-03-27T07:38:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2024-03-27T07:38:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T07:38:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2024-03-27T07:38:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 454, 2024-03-27T07:38:06.431 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 454, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 38627, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 811, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 32225, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 82682, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 2, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 88324, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 38330, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 2294, 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 80629 2024-03-27T07:38:06.432 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update": 2835, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_update_receipt": 4159, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_try_discover": 2422, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_send_discover": 4155, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_handle_discover": 6355, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 207, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 37082, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 36875, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 0, 2024-03-27T07:38:06.433 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_path": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_quiesce_inode": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 234, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 157, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2024-03-27T07:38:06.434 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "evlrg": 7, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 227526, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 139100, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 135192, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 92334, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 3908, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 326, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 198, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 191, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 135, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "segmjr": 8, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2024-03-27T07:38:06.435 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 7, 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 413781903, 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 865096681, 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4460, 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 514.517085601, 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.115362575 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 37856, 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 148587, 2024-03-27T07:38:06.436 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 110731, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 1358, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 5669, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 4311, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 71873, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 253726, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 181853, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 3, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 91574, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 91571, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 280520, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 223608 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 186011, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 18675, 2024-03-27T07:38:06.437 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 174832, 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 295, 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 36407, 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 38050, 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 255.341395547, 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.006710680 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1137, 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 81.149805523, 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.071371860 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2024-03-27T07:38:06.438 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 45814, 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1343.715311630, 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.029329796 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2024-03-27T07:38:06.439 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000186817, 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000186817 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2024-03-27T07:38:06.440 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.441 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2024-03-27T07:38:06.442 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 235, 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 5.533216125, 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.023545600 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.443 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 7562, 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 86.212927791, 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.011400810 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1329, 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 6.776277792, 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.005098779 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 38051, 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 469.371437495, 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.012335324 2024-03-27T07:38:06.444 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "req_snapdiff_latency": { 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 208, 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 45.106132593, 2024-03-27T07:38:06.445 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.216856406 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2, 2024-03-27T07:38:06.446 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.136356317, 2024-03-27T07:38:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.068178158 2024-03-27T07:38:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2024-03-27T07:38:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2024-03-27T07:38:06.447 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.448 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 30031, 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 75.505509316, 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.002514252 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.449 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 2, 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 4, 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 2, 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 2, 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 22337, 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 11168, 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 855, 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "mdthresh_evicted": 0 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.450 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 120, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 120, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:38:06.451 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:38:06.452 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:38:06.453 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 3420144, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 38692, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 8088, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 170, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:38:06.454 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 141027226, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 1474912, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 91180, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 904221614, 2024-03-27T07:38:06.455 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 33, 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 91180, 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "op_latency": { 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 91180, 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1317.368384564, 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014447997 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "op_inflight": 0, 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 91180, 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 105616 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 91180, 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 40519, 2024-03-27T07:38:06.456 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 50661, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 236, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 5354, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 867, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 5331, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 441, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 0, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 152, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 37215, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2024-03-27T07:38:06.457 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 39091, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 10708, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 2, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2024-03-27T07:38:06.458 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2024-03-27T07:38:06.459 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 106, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 20, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 12, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 12, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 4269, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 1142, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 808 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2024-03-27T07:38:06.460 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "osd-slow-ops": { 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_ops_count": 10 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 10, 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 10, 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed_ops": 36875, 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 36875, 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.461 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 524460, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 211438924, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 524460, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 524460, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 211438924, 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:06.462 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 91180, 2024-03-27T07:38:06.463 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 909316245, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 91180, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 909316245, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2024-03-27T07:38:06.464 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 91180, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 91180, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 91180, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 91180, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-03-27T07:38:06.465 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 36875, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 5103767, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 36875, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 867, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 5103767, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:06.466 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x5607a6e1e500": { 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 227526, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 860902377, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 227526, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 4460, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 860902377, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:06.467 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:06.468 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:06.468 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-27T07:38:06.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:06 smithi082 ceph-mon[32178]: pgmap v455: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-03-27T07:38:06.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:06 smithi149 ceph-mon[36065]: pgmap v455: 97 pgs: 4 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 87 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-03-27T07:38:07.344 INFO:tasks.check_counter:Daemon mds.i mds.exported=230 2024-03-27T07:38:07.344 INFO:tasks.check_counter:Daemon mds.i mds.imported=227 2024-03-27T07:38:07.344 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=2835 2024-03-27T07:38:07.344 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=4159 2024-03-27T07:38:07.345 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=5 2024-03-27T07:38:07.345 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-03-27T07:38:07.345 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-03-27T07:38:07.345 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=152 2024-03-27T07:38:07.345 DEBUG:tasks.check_counter:Getting stats from l 2024-03-27T07:38:07.345 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid 604548c2-ec09-11ee-95d0-87774f69a715 -- ceph daemon mds.l perf dump 2024-03-27T07:38:07.593 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T07:38:08.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:08 smithi082 ceph-mon[32178]: pgmap v456: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-03-27T07:38:08.747 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:08 smithi153 ceph-mon[36179]: pgmap v456: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-03-27T07:38:08.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:08 smithi149 ceph-mon[36065]: pgmap v456: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-03-27T07:38:09.386 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-03-27T07:38:09.386 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T07:38:09.386 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 4, 2024-03-27T07:38:09.386 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 4, 2024-03-27T07:38:09.386 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 3024, 2024-03-27T07:38:09.386 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 448, 2024-03-27T07:38:09.386 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 4, 2024-03-27T07:38:09.386 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 0, 2024-03-27T07:38:09.386 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.001511147, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.000036152, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.000724481, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 3, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000745324, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000248441 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 3024, 2024-03-27T07:38:09.387 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 448 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 287, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 277, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1467008, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 170464, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 2, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 1, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.041922720, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.011882296, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.033321816, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.005247883, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 276, 2024-03-27T07:38:09.388 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.009656069, 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000034985 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 1467008, 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 170464 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 2, 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 211, 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 320, 2024-03-27T07:38:09.389 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 192768, 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 3, 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.010364504, 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.006860831, 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.001596640, 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 208, 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.012201573, 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000058661 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2024-03-27T07:38:09.390 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_encrypted_bytes": 320, 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_encrypted_bytes": 192768 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 0, 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 0, 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 0, 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T07:38:09.391 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_bytes": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_extent_items": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_bytes": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_blob_items": 0, 2024-03-27T07:38:09.392 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2024-03-27T07:38:09.393 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 149057, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 32, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2024-03-27T07:38:09.394 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 0, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 0, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 928, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 2, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T07:38:09.395 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 289, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 1426467, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 289, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 289, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 1426467, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2024-03-27T07:38:09.396 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:09.397 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-03-27T07:38:09.397 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-03-27T07:38:10.173 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-03-27T07:38:10.173 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-03-27T07:38:10.173 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-03-27T07:38:10.173 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-03-27T07:38:10.173 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-03-27T07:38:10.174 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-03-27T07:38:10.174 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-03-27T07:38:10.174 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-03-27T07:38:10.174 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-27T07:38:10.186 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-27T07:38:10.186 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:38:10.186 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T07:38:10.208 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:38:10.208 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T07:38:10.268 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:38:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.488+0000 7f91f7747640 1 -- 172.21.15.82:0/3041792492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f01013a0 msgr2=0x7f91f010d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.488+0000 7f91f7747640 1 --2- 172.21.15.82:0/3041792492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f01013a0 0x7f91f010d8b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009930 tx=0x7f91ec02bc50 comp rx=0 tx=0).stop 2024-03-27T07:38:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.488+0000 7f91f7747640 1 -- 172.21.15.82:0/3041792492 shutdown_connections 2024-03-27T07:38:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.488+0000 7f91f7747640 1 --2- 172.21.15.82:0/3041792492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f01013a0 0x7f91f010d8b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.488+0000 7f91f7747640 1 --2- 172.21.15.82:0/3041792492 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f01009e0 0x7f91f0100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.488+0000 7f91f7747640 1 --2- 172.21.15.82:0/3041792492 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f01069f0 0x7f91f0106dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:10.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.488+0000 7f91f7747640 1 -- 172.21.15.82:0/3041792492 >> 172.21.15.82:0/3041792492 conn(0x7f91f0077b20 msgr2=0x7f91f0077f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.489+0000 7f91f7747640 1 -- 172.21.15.82:0/3041792492 shutdown_connections 2024-03-27T07:38:10.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.489+0000 7f91f7747640 1 -- 172.21.15.82:0/3041792492 wait complete. 2024-03-27T07:38:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.491+0000 7f91f7747640 1 Processor -- start 2024-03-27T07:38:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.491+0000 7f91f7747640 1 -- start start 2024-03-27T07:38:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.491+0000 7f91f7747640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f01009e0 0x7f91f0196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.491+0000 7f91f7747640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f01013a0 0x7f91f0196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.491+0000 7f91f7747640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f01069f0 0x7f91f019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.491+0000 7f91f7747640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f91f010fcf0 con 0x7f91f01013a0 2024-03-27T07:38:10.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.491+0000 7f91f7747640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f91f010fb70 con 0x7f91f01069f0 2024-03-27T07:38:10.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.491+0000 7f91f7747640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f91f010fe70 con 0x7f91f01009e0 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.491+0000 7f91f4ce2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f01013a0 0x7f91f0196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.492+0000 7f91f4ce2640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f01013a0 0x7f91f0196690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33726/0 (socket says 172.21.15.82:33726) 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.492+0000 7f91f4ce2640 1 -- 172.21.15.82:0/884848751 learned_addr learned my addr 172.21.15.82:0/884848751 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.492+0000 7f91f54e3640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f01009e0 0x7f91f0196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.492+0000 7f91f5ce4640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f01069f0 0x7f91f019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.492+0000 7f91f5ce4640 1 -- 172.21.15.82:0/884848751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f01009e0 msgr2=0x7f91f0196150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.492+0000 7f91f5ce4640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f01009e0 0x7f91f0196150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.492+0000 7f91f5ce4640 1 -- 172.21.15.82:0/884848751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f01013a0 msgr2=0x7f91f0196690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.492+0000 7f91f5ce4640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f01013a0 0x7f91f0196690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.492+0000 7f91f5ce4640 1 -- 172.21.15.82:0/884848751 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91f019b140 con 0x7f91f01069f0 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.493+0000 7f91f5ce4640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f01069f0 0x7f91f019aa10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009850 tx=0x7f91ec02ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:10.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.493+0000 7f91e67fc640 1 -- 172.21.15.82:0/884848751 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec043020 con 0x7f91f01069f0 2024-03-27T07:38:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.493+0000 7f91f7747640 1 -- 172.21.15.82:0/884848751 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91f019b3d0 con 0x7f91f01069f0 2024-03-27T07:38:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.493+0000 7f91f7747640 1 -- 172.21.15.82:0/884848751 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91f01a2cc0 con 0x7f91f01069f0 2024-03-27T07:38:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.493+0000 7f91e67fc640 1 -- 172.21.15.82:0/884848751 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91ec009490 con 0x7f91f01069f0 2024-03-27T07:38:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.494+0000 7f91e67fc640 1 -- 172.21.15.82:0/884848751 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0035f0 con 0x7f91f01069f0 2024-03-27T07:38:10.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.495+0000 7f91f7747640 1 -- 172.21.15.82:0/884848751 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91d4005290 con 0x7f91f01069f0 2024-03-27T07:38:10.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.497+0000 7f91e67fc640 1 -- 172.21.15.82:0/884848751 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f91ec046020 con 0x7f91f01069f0 2024-03-27T07:38:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.497+0000 7f91e67fc640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91dc0a7dc0 0x7f91dc0aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.498+0000 7f91e67fc640 1 -- 172.21.15.82:0/884848751 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8560+0+0 (secure 0 0 0) 0x7f91ec004480 con 0x7f91f01069f0 2024-03-27T07:38:10.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.498+0000 7f91f54e3640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91dc0a7dc0 0x7f91dc0aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:10.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.499+0000 7f91f54e3640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91dc0a7dc0 0x7f91dc0aa280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91e800bbb0 tx=0x7f91e800d040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:10.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.507+0000 7f91e67fc640 1 -- 172.21.15.82:0/884848751 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f91ec04d020 con 0x7f91f01069f0 2024-03-27T07:38:10.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:10 smithi153 ceph-mon[36179]: pgmap v457: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-03-27T07:38:10.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:10 smithi082 ceph-mon[32178]: pgmap v457: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-03-27T07:38:10.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:10 smithi149 ceph-mon[36065]: pgmap v457: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-03-27T07:38:10.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.855+0000 7f91f7747640 1 -- 172.21.15.82:0/884848751 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91d4005580 con 0x7f91f01069f0 2024-03-27T07:38:10.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.858+0000 7f91e67fc640 1 -- 172.21.15.82:0/884848751 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) ==== 74+0+23090 (secure 0 0 0) 0x7f91ec04d020 con 0x7f91f01069f0 2024-03-27T07:38:10.857 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:38:10.857 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":107,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:38:10.309945+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1643774131":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3910998089":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6801/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2476913094":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/1969604742":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6800/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":12,"length":1},{"begin":23,"length":1},{"begin":25,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:38:10.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.863+0000 7f91f7747640 1 -- 172.21.15.82:0/884848751 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91dc0a7dc0 msgr2=0x7f91dc0aa280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:10.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.863+0000 7f91f7747640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91dc0a7dc0 0x7f91dc0aa280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91e800bbb0 tx=0x7f91e800d040 comp rx=0 tx=0).stop 2024-03-27T07:38:10.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.863+0000 7f91f7747640 1 -- 172.21.15.82:0/884848751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f01069f0 msgr2=0x7f91f019aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:10.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.863+0000 7f91f7747640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f01069f0 0x7f91f019aa10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f91ec009850 tx=0x7f91ec02ce00 comp rx=0 tx=0).stop 2024-03-27T07:38:10.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.863+0000 7f91f7747640 1 -- 172.21.15.82:0/884848751 shutdown_connections 2024-03-27T07:38:10.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.863+0000 7f91f7747640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f91dc0a7dc0 0x7f91dc0aa280 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91e800bbb0 tx=0x7f91e800d040 comp rx=0 tx=0).stop 2024-03-27T07:38:10.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.863+0000 7f91f7747640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91f01013a0 0x7f91f0196690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:10.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.863+0000 7f91f7747640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f91f01069f0 0x7f91f019aa10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:10.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.863+0000 7f91f7747640 1 --2- 172.21.15.82:0/884848751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91f01009e0 0x7f91f0196150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:10.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.863+0000 7f91f7747640 1 -- 172.21.15.82:0/884848751 >> 172.21.15.82:0/884848751 conn(0x7f91f0077b20 msgr2=0x7f91f01030b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:10.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.865+0000 7f91f7747640 1 -- 172.21.15.82:0/884848751 shutdown_connections 2024-03-27T07:38:10.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:10.865+0000 7f91f7747640 1 -- 172.21.15.82:0/884848751 wait complete. 2024-03-27T07:38:10.880 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T07:16:54.470723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T07:21:32.592597+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T07:21:33.858606+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 25, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T07:38:10.881 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T07:38:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.065+0000 7f231e683640 1 -- 172.21.15.82:0/1449581962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f231810e3a0 msgr2=0x7f231810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.065+0000 7f231e683640 1 --2- 172.21.15.82:0/1449581962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f231810e3a0 0x7f231810e820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2308009860 tx=0x7f230802bb90 comp rx=0 tx=0).stop 2024-03-27T07:38:11.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.068+0000 7f231e683640 1 -- 172.21.15.82:0/1449581962 shutdown_connections 2024-03-27T07:38:11.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.068+0000 7f231e683640 1 --2- 172.21.15.82:0/1449581962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231811b330 0x7f231811d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.068+0000 7f231e683640 1 --2- 172.21.15.82:0/1449581962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f231810e3a0 0x7f231810e820 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.068+0000 7f231e683640 1 --2- 172.21.15.82:0/1449581962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2318110370 0x7f231810de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.068+0000 7f231e683640 1 -- 172.21.15.82:0/1449581962 >> 172.21.15.82:0/1449581962 conn(0x7f231806cc30 msgr2=0x7f231806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.071+0000 7f231e683640 1 -- 172.21.15.82:0/1449581962 shutdown_connections 2024-03-27T07:38:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.071+0000 7f231e683640 1 -- 172.21.15.82:0/1449581962 wait complete. 2024-03-27T07:38:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.072+0000 7f231e683640 1 Processor -- start 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.072+0000 7f231e683640 1 -- start start 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.072+0000 7f231e683640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231810e3a0 0x7f231811aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.072+0000 7f231e683640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2318110370 0x7f2318116b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.072+0000 7f231e683640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f231811b330 0x7f23181170c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.072+0000 7f231e683640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2318113510 con 0x7f2318110370 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.072+0000 7f231e683640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f2318113390 con 0x7f231810e3a0 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.072+0000 7f231e683640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2318113690 con 0x7f231811b330 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.073+0000 7f2317fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231810e3a0 0x7f231811aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.073+0000 7f231cc20640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f231811b330 0x7f23181170c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.073+0000 7f231cc20640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f231811b330 0x7f23181170c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:40518/0 (socket says 172.21.15.82:40518) 2024-03-27T07:38:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.073+0000 7f231cc20640 1 -- 172.21.15.82:0/2434086546 learned_addr learned my addr 172.21.15.82:0/2434086546 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.075+0000 7f23177fe640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2318110370 0x7f2318116b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.075+0000 7f231cc20640 1 -- 172.21.15.82:0/2434086546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231810e3a0 msgr2=0x7f231811aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.075+0000 7f231cc20640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231810e3a0 0x7f231811aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.075+0000 7f231cc20640 1 -- 172.21.15.82:0/2434086546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2318110370 msgr2=0x7f2318116b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.075+0000 7f231cc20640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2318110370 0x7f2318116b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.075+0000 7f231cc20640 1 -- 172.21.15.82:0/2434086546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23181177c0 con 0x7f231811b330 2024-03-27T07:38:11.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.077+0000 7f231cc20640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f231811b330 0x7f23181170c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f231001fd90 tx=0x7f231001d750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:11.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.078+0000 7f23157fa640 1 -- 172.21.15.82:0/2434086546 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231001de60 con 0x7f231811b330 2024-03-27T07:38:11.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.078+0000 7f231e683640 1 -- 172.21.15.82:0/2434086546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23181ab0a0 con 0x7f231811b330 2024-03-27T07:38:11.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.078+0000 7f231e683640 1 -- 172.21.15.82:0/2434086546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23181ab520 con 0x7f231811b330 2024-03-27T07:38:11.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.079+0000 7f23157fa640 1 -- 172.21.15.82:0/2434086546 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2310003970 con 0x7f231811b330 2024-03-27T07:38:11.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.079+0000 7f23157fa640 1 -- 172.21.15.82:0/2434086546 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23100043a0 con 0x7f231811b330 2024-03-27T07:38:11.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.081+0000 7f231e683640 1 -- 172.21.15.82:0/2434086546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2304005290 con 0x7f231811b330 2024-03-27T07:38:11.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.082+0000 7f23157fa640 1 -- 172.21.15.82:0/2434086546 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f231002e020 con 0x7f231811b330 2024-03-27T07:38:11.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.082+0000 7f23157fa640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f23000a3980 0x7f23000a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:11.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.083+0000 7f23157fa640 1 -- 172.21.15.82:0/2434086546 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8560+0+0 (secure 0 0 0) 0x7f23100e0a00 con 0x7f231811b330 2024-03-27T07:38:11.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.084+0000 7f2317fff640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f23000a3980 0x7f23000a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:11.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.089+0000 7f2317fff640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f23000a3980 0x7f23000a5e40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f230c006fd0 tx=0x7f230c008040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:11.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.092+0000 7f23157fa640 1 -- 172.21.15.82:0/2434086546 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f23100ad230 con 0x7f231811b330 2024-03-27T07:38:11.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.431+0000 7f231e683640 1 -- 172.21.15.82:0/2434086546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2304005850 con 0x7f231811b330 2024-03-27T07:38:11.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.436+0000 7f23157fa640 1 -- 172.21.15.82:0/2434086546 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v107) ==== 93+0+10 (secure 0 0 0) 0x7f23100acb30 con 0x7f231811b330 2024-03-27T07:38:11.434 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-03-27T07:38:11.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.439+0000 7f231e683640 1 -- 172.21.15.82:0/2434086546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f23000a3980 msgr2=0x7f23000a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:11.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.439+0000 7f231e683640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f23000a3980 0x7f23000a5e40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f230c006fd0 tx=0x7f230c008040 comp rx=0 tx=0).stop 2024-03-27T07:38:11.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.439+0000 7f231e683640 1 -- 172.21.15.82:0/2434086546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f231811b330 msgr2=0x7f23181170c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:11.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.439+0000 7f231e683640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f231811b330 0x7f23181170c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f231001fd90 tx=0x7f231001d750 comp rx=0 tx=0).stop 2024-03-27T07:38:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.439+0000 7f231e683640 1 -- 172.21.15.82:0/2434086546 shutdown_connections 2024-03-27T07:38:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.439+0000 7f231e683640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f23000a3980 0x7f23000a5e40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.439+0000 7f231e683640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2318110370 0x7f2318116b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.439+0000 7f231e683640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f231811b330 0x7f23181170c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.439+0000 7f231e683640 1 --2- 172.21.15.82:0/2434086546 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f231810e3a0 0x7f231811aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.439+0000 7f231e683640 1 -- 172.21.15.82:0/2434086546 >> 172.21.15.82:0/2434086546 conn(0x7f231806cc30 msgr2=0x7f231811cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.440+0000 7f231e683640 1 -- 172.21.15.82:0/2434086546 shutdown_connections 2024-03-27T07:38:11.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.440+0000 7f231e683640 1 -- 172.21.15.82:0/2434086546 wait complete. 2024-03-27T07:38:11.456 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T07:38:11.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.645+0000 7fba0a8b1640 1 -- 172.21.15.82:0/4263345075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba041132a0 msgr2=0x7fba04115690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:11.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.645+0000 7fba0a8b1640 1 --2- 172.21.15.82:0/4263345075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba041132a0 0x7fba04115690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009860 tx=0x7fb9f402bb90 comp rx=0 tx=0).stop 2024-03-27T07:38:11.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.646+0000 7fba0a8b1640 1 -- 172.21.15.82:0/4263345075 shutdown_connections 2024-03-27T07:38:11.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.646+0000 7fba0a8b1640 1 --2- 172.21.15.82:0/4263345075 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba041132a0 0x7fba04115690 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.646+0000 7fba0a8b1640 1 --2- 172.21.15.82:0/4263345075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba0410eda0 0x7fba04109090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.646+0000 7fba0a8b1640 1 --2- 172.21.15.82:0/4263345075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba040695c0 0x7fba04108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.646+0000 7fba0a8b1640 1 -- 172.21.15.82:0/4263345075 >> 172.21.15.82:0/4263345075 conn(0x7fba0406cf00 msgr2=0x7fba0406d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:11.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.647+0000 7fba0a8b1640 1 -- 172.21.15.82:0/4263345075 shutdown_connections 2024-03-27T07:38:11.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.647+0000 7fba0a8b1640 1 -- 172.21.15.82:0/4263345075 wait complete. 2024-03-27T07:38:11.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.648+0000 7fba0a8b1640 1 Processor -- start 2024-03-27T07:38:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.648+0000 7fba0a8b1640 1 -- start start 2024-03-27T07:38:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.649+0000 7fba0a8b1640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba040695c0 0x7fba0411e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.649+0000 7fba0a8b1640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba0410eda0 0x7fba0411eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.649+0000 7fba0a8b1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba041132a0 0x7fba04124670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.649+0000 7fba0a8b1640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba04118000 con 0x7fba040695c0 2024-03-27T07:38:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.649+0000 7fba0a8b1640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fba04117e80 con 0x7fba0410eda0 2024-03-27T07:38:11.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.649+0000 7fba0a8b1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fba04118180 con 0x7fba041132a0 2024-03-27T07:38:11.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.650+0000 7fba098af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba040695c0 0x7fba0411e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:11.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.650+0000 7fba098af640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba040695c0 0x7fba0411e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33770/0 (socket says 172.21.15.82:33770) 2024-03-27T07:38:11.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.650+0000 7fba098af640 1 -- 172.21.15.82:0/3677188981 learned_addr learned my addr 172.21.15.82:0/3677188981 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.653+0000 7fba090ae640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba0410eda0 0x7fba0411eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.654+0000 7fba0a0b0640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba041132a0 0x7fba04124670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.654+0000 7fba098af640 1 -- 172.21.15.82:0/3677188981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba041132a0 msgr2=0x7fba04124670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.654+0000 7fba098af640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba041132a0 0x7fba04124670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.654+0000 7fba098af640 1 -- 172.21.15.82:0/3677188981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba0410eda0 msgr2=0x7fba0411eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.654+0000 7fba098af640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba0410eda0 0x7fba0411eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:11.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.654+0000 7fba098af640 1 -- 172.21.15.82:0/3677188981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba04124f30 con 0x7fba040695c0 2024-03-27T07:38:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.654+0000 7fba098af640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba040695c0 0x7fba0411e960 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00ed80 tx=0x7fb9fc00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.654+0000 7fb9faffd640 1 -- 172.21.15.82:0/3677188981 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc01c070 con 0x7fba040695c0 2024-03-27T07:38:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.654+0000 7fb9faffd640 1 -- 172.21.15.82:0/3677188981 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb9fc017b20 con 0x7fba040695c0 2024-03-27T07:38:11.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.654+0000 7fb9faffd640 1 -- 172.21.15.82:0/3677188981 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00fc80 con 0x7fba040695c0 2024-03-27T07:38:11.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.659+0000 7fba0a8b1640 1 -- 172.21.15.82:0/3677188981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba04125220 con 0x7fba040695c0 2024-03-27T07:38:11.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.659+0000 7fba0a8b1640 1 -- 172.21.15.82:0/3677188981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba04119c50 con 0x7fba040695c0 2024-03-27T07:38:11.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.663+0000 7fba0a8b1640 1 -- 172.21.15.82:0/3677188981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba04109b60 con 0x7fba040695c0 2024-03-27T07:38:11.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.665+0000 7fb9faffd640 1 -- 172.21.15.82:0/3677188981 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fb9fc017640 con 0x7fba040695c0 2024-03-27T07:38:11.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.666+0000 7fb9faffd640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb9f00a3980 0x7fb9f00a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:11.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.666+0000 7fb9faffd640 1 -- 172.21.15.82:0/3677188981 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8560+0+0 (secure 0 0 0) 0x7fb9fc0d01e0 con 0x7fba040695c0 2024-03-27T07:38:11.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.667+0000 7fba090ae640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb9f00a3980 0x7fb9f00a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:11.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.668+0000 7fba090ae640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb9f00a3980 0x7fb9f00a5e40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba0411b230 tx=0x7fba0000b490 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:11.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:11.676+0000 7fb9faffd640 1 -- 172.21.15.82:0/3677188981 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb9fc09cb20 con 0x7fba040695c0 2024-03-27T07:38:11.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:11 smithi082 ceph-mon[32178]: osdmap e107: 12 total, 12 up, 12 in 2024-03-27T07:38:11.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:11 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/884848751' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:38:11.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:11 smithi149 ceph-mon[36065]: osdmap e107: 12 total, 12 up, 12 in 2024-03-27T07:38:11.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:11 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/884848751' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:38:11.784 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:11 smithi153 ceph-mon[36179]: osdmap e107: 12 total, 12 up, 12 in 2024-03-27T07:38:11.784 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:11 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/884848751' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:38:12.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.020+0000 7fba0a8b1640 1 -- 172.21.15.82:0/3677188981 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fba04119f40 con 0x7fba040695c0 2024-03-27T07:38:12.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.022+0000 7fb9faffd640 1 -- 172.21.15.82:0/3677188981 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v107) ==== 104+0+11 (secure 0 0 0) 0x7fb9fc00fe20 con 0x7fba040695c0 2024-03-27T07:38:12.020 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-03-27T07:38:12.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 -- 172.21.15.82:0/3677188981 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb9f00a3980 msgr2=0x7fb9f00a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:12.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb9f00a3980 0x7fb9f00a5e40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba0411b230 tx=0x7fba0000b490 comp rx=0 tx=0).stop 2024-03-27T07:38:12.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 -- 172.21.15.82:0/3677188981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba040695c0 msgr2=0x7fba0411e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:12.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba040695c0 0x7fba0411e960 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00ed80 tx=0x7fb9fc00c6e0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 -- 172.21.15.82:0/3677188981 shutdown_connections 2024-03-27T07:38:12.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb9f00a3980 0x7fb9f00a5e40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba041132a0 0x7fba04124670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fba0410eda0 0x7fba0411eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 --2- 172.21.15.82:0/3677188981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba040695c0 0x7fba0411e960 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 -- 172.21.15.82:0/3677188981 >> 172.21.15.82:0/3677188981 conn(0x7fba0406cf00 msgr2=0x7fba04071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:12.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 -- 172.21.15.82:0/3677188981 shutdown_connections 2024-03-27T07:38:12.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.028+0000 7fba0a8b1640 1 -- 172.21.15.82:0/3677188981 wait complete. 2024-03-27T07:38:12.044 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T07:38:12.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.229+0000 7f1016b8a640 1 -- 172.21.15.82:0/2206133978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1010101b00 msgr2=0x7f1010101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:12.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.229+0000 7f1016b8a640 1 --2- 172.21.15.82:0/2206133978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1010101b00 0x7f1010101f80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f1004009930 tx=0x7f100402bc50 comp rx=0 tx=0).stop 2024-03-27T07:38:12.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.231+0000 7f1016b8a640 1 -- 172.21.15.82:0/2206133978 shutdown_connections 2024-03-27T07:38:12.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.231+0000 7f1016b8a640 1 --2- 172.21.15.82:0/2206133978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1010101b00 0x7f1010101f80 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.231+0000 7f1016b8a640 1 --2- 172.21.15.82:0/2206133978 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f10101024c0 0x7f101010e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.231+0000 7f1016b8a640 1 --2- 172.21.15.82:0/2206133978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1010107ba0 0x7f1010107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.231+0000 7f1016b8a640 1 -- 172.21.15.82:0/2206133978 >> 172.21.15.82:0/2206133978 conn(0x7f10100fd590 msgr2=0x7f10100ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:12.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.234+0000 7f1016b8a640 1 -- 172.21.15.82:0/2206133978 shutdown_connections 2024-03-27T07:38:12.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.234+0000 7f1016b8a640 1 -- 172.21.15.82:0/2206133978 wait complete. 2024-03-27T07:38:12.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.235+0000 7f1016b8a640 1 Processor -- start 2024-03-27T07:38:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.237+0000 7f1016b8a640 1 -- start start 2024-03-27T07:38:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.237+0000 7f1016b8a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1010101b00 0x7f10100733c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.238+0000 7f1016b8a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10101024c0 0x7f101006c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.238+0000 7f1016b8a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1010107ba0 0x7f101006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.238+0000 7f1016b8a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1010111f90 con 0x7f1010101b00 2024-03-27T07:38:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.238+0000 7f1016b8a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f1010111e10 con 0x7f1010107ba0 2024-03-27T07:38:12.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.238+0000 7f1016b8a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1010112110 con 0x7f10101024c0 2024-03-27T07:38:12.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.239+0000 7f100ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10101024c0 0x7f101006c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.239+0000 7f100ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10101024c0 0x7f101006c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:40554/0 (socket says 172.21.15.82:40554) 2024-03-27T07:38:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.239+0000 7f100ffff640 1 -- 172.21.15.82:0/4118917692 learned_addr learned my addr 172.21.15.82:0/4118917692 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.241+0000 7f1014926640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1010101b00 0x7f10100733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.242+0000 7f1015127640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1010107ba0 0x7f101006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.242+0000 7f100ffff640 1 -- 172.21.15.82:0/4118917692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1010107ba0 msgr2=0x7f101006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.242+0000 7f100ffff640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1010107ba0 0x7f101006c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.242+0000 7f100ffff640 1 -- 172.21.15.82:0/4118917692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1010101b00 msgr2=0x7f10100733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.242+0000 7f100ffff640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1010101b00 0x7f10100733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.242+0000 7f100ffff640 1 -- 172.21.15.82:0/4118917692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101006d010 con 0x7f10101024c0 2024-03-27T07:38:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.244+0000 7f100ffff640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10101024c0 0x7f101006c490 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1004009850 tx=0x7f10040043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.245+0000 7f100dffb640 1 -- 172.21.15.82:0/4118917692 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004041020 con 0x7f10101024c0 2024-03-27T07:38:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.245+0000 7f100dffb640 1 -- 172.21.15.82:0/4118917692 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f100402ccb0 con 0x7f10101024c0 2024-03-27T07:38:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.246+0000 7f100dffb640 1 -- 172.21.15.82:0/4118917692 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1004003e60 con 0x7f10101024c0 2024-03-27T07:38:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.246+0000 7f1016b8a640 1 -- 172.21.15.82:0/4118917692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101006d2a0 con 0x7f10101024c0 2024-03-27T07:38:12.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.246+0000 7f1016b8a640 1 -- 172.21.15.82:0/4118917692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10100711e0 con 0x7f10101024c0 2024-03-27T07:38:12.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.250+0000 7f1016b8a640 1 -- 172.21.15.82:0/4118917692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1010103200 con 0x7f10101024c0 2024-03-27T07:38:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.251+0000 7f100dffb640 1 -- 172.21.15.82:0/4118917692 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f1004044020 con 0x7f10101024c0 2024-03-27T07:38:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.252+0000 7f100dffb640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0ff80a3900 0x7f0ff80a5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:12.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.252+0000 7f100dffb640 1 -- 172.21.15.82:0/4118917692 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8560+0+0 (secure 0 0 0) 0x7f10040f1580 con 0x7f10101024c0 2024-03-27T07:38:12.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.254+0000 7f1014926640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0ff80a3900 0x7f0ff80a5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:12.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.255+0000 7f1014926640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0ff80a3900 0x7f0ff80a5dc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1000006fd0 tx=0x7f1000008040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.263+0000 7f100dffb640 1 -- 172.21.15.82:0/4118917692 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f100404b020 con 0x7f10101024c0 2024-03-27T07:38:12.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.600+0000 7f1016b8a640 1 -- 172.21.15.82:0/4118917692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f101006d970 con 0x7f10101024c0 2024-03-27T07:38:12.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.601+0000 7f100dffb640 1 -- 172.21.15.82:0/4118917692 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v107) ==== 100+0+11 (secure 0 0 0) 0x7f10040bdec0 con 0x7f10101024c0 2024-03-27T07:38:12.599 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-03-27T07:38:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.604+0000 7f1016b8a640 1 -- 172.21.15.82:0/4118917692 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0ff80a3900 msgr2=0x7f0ff80a5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.604+0000 7f1016b8a640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0ff80a3900 0x7f0ff80a5dc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1000006fd0 tx=0x7f1000008040 comp rx=0 tx=0).stop 2024-03-27T07:38:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.605+0000 7f1016b8a640 1 -- 172.21.15.82:0/4118917692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10101024c0 msgr2=0x7f101006c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.605+0000 7f1016b8a640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10101024c0 0x7f101006c490 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1004009850 tx=0x7f10040043b0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.605+0000 7f1016b8a640 1 -- 172.21.15.82:0/4118917692 shutdown_connections 2024-03-27T07:38:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.605+0000 7f1016b8a640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f0ff80a3900 0x7f0ff80a5dc0 secure :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1000006fd0 tx=0x7f1000008040 comp rx=0 tx=0).stop 2024-03-27T07:38:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.605+0000 7f1016b8a640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1010107ba0 0x7f101006c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.605+0000 7f1016b8a640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10101024c0 0x7f101006c490 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.605+0000 7f1016b8a640 1 --2- 172.21.15.82:0/4118917692 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1010101b00 0x7f10100733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.605+0000 7f1016b8a640 1 -- 172.21.15.82:0/4118917692 >> 172.21.15.82:0/4118917692 conn(0x7f10100fd590 msgr2=0x7f10100fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:12.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.606+0000 7f1016b8a640 1 -- 172.21.15.82:0/4118917692 shutdown_connections 2024-03-27T07:38:12.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.606+0000 7f1016b8a640 1 -- 172.21.15.82:0/4118917692 wait complete. 2024-03-27T07:38:12.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:12 smithi082 ceph-mon[32178]: pgmap v459: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-03-27T07:38:12.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:12 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2434086546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:38:12.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:12 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3677188981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:38:12.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T07:38:12.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:12 smithi149 ceph-mon[36065]: pgmap v459: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-03-27T07:38:12.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:12 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2434086546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:38:12.752 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:12 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3677188981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:38:12.784 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:12 smithi153 ceph-mon[36179]: pgmap v459: 97 pgs: 97 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-03-27T07:38:12.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:12 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2434086546' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T07:38:12.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:12 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3677188981' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T07:38:12.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.799+0000 7f1394c33640 1 -- 172.21.15.82:0/2993565353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13901013b0 msgr2=0x7f139010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:12.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.799+0000 7f1394c33640 1 --2- 172.21.15.82:0/2993565353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13901013b0 0x7f139010d870 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f138000d960 tx=0x7f138002fdb0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.802+0000 7f1394c33640 1 -- 172.21.15.82:0/2993565353 shutdown_connections 2024-03-27T07:38:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.802+0000 7f1394c33640 1 --2- 172.21.15.82:0/2993565353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13901013b0 0x7f139010d870 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.802+0000 7f1394c33640 1 --2- 172.21.15.82:0/2993565353 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1390100a10 0x7f1390100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.802+0000 7f1394c33640 1 --2- 172.21.15.82:0/2993565353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13901058f0 0x7f1390105cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.802+0000 7f1394c33640 1 -- 172.21.15.82:0/2993565353 >> 172.21.15.82:0/2993565353 conn(0x7f1390077ae0 msgr2=0x7f1390077ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.809+0000 7f1394c33640 1 -- 172.21.15.82:0/2993565353 shutdown_connections 2024-03-27T07:38:12.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.809+0000 7f1394c33640 1 -- 172.21.15.82:0/2993565353 wait complete. 2024-03-27T07:38:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.810+0000 7f1394c33640 1 Processor -- start 2024-03-27T07:38:12.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.810+0000 7f1394c33640 1 -- start start 2024-03-27T07:38:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.811+0000 7f1394c33640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1390100a10 0x7f13901960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.811+0000 7f1394c33640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13901013b0 0x7f1390196620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.811+0000 7f1394c33640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13901058f0 0x7f139019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.811+0000 7f138e59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1390100a10 0x7f13901960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.811+0000 7f138e59c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1390100a10 0x7f13901960e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:43464/0 (socket says 172.21.15.82:43464) 2024-03-27T07:38:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.811+0000 7f138dd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13901013b0 0x7f1390196620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:12.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.811+0000 7f138dd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13901013b0 0x7f1390196620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:40574/0 (socket says 172.21.15.82:40574) 2024-03-27T07:38:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.812+0000 7f138e59c640 1 -- 172.21.15.82:0/2239894357 learned_addr learned my addr 172.21.15.82:0/2239894357 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.812+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f139010fd40 con 0x7f13901058f0 2024-03-27T07:38:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.812+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f139010fbc0 con 0x7f1390100a10 2024-03-27T07:38:12.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.812+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f139010fec0 con 0x7f13901013b0 2024-03-27T07:38:12.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.815+0000 7f138ed9d640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13901058f0 0x7f139019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.816+0000 7f138ed9d640 1 -- 172.21.15.82:0/2239894357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13901013b0 msgr2=0x7f1390196620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.816+0000 7f138ed9d640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13901013b0 0x7f1390196620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.816+0000 7f138ed9d640 1 -- 172.21.15.82:0/2239894357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1390100a10 msgr2=0x7f13901960e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.816+0000 7f138ed9d640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1390100a10 0x7f13901960e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:12.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.816+0000 7f138ed9d640 1 -- 172.21.15.82:0/2239894357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139019b080 con 0x7f13901058f0 2024-03-27T07:38:12.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.822+0000 7f138ed9d640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13901058f0 0x7f139019a950 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f138000d880 tx=0x7f1380030cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.824+0000 7f13877fe640 1 -- 172.21.15.82:0/2239894357 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1380045020 con 0x7f13901058f0 2024-03-27T07:38:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.824+0000 7f13877fe640 1 -- 172.21.15.82:0/2239894357 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13800035f0 con 0x7f13901058f0 2024-03-27T07:38:12.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.824+0000 7f13877fe640 1 -- 172.21.15.82:0/2239894357 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f138003d040 con 0x7f13901058f0 2024-03-27T07:38:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.826+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139019b310 con 0x7f13901058f0 2024-03-27T07:38:12.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.826+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139019b780 con 0x7f13901058f0 2024-03-27T07:38:12.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.828+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13900680b0 con 0x7f13901058f0 2024-03-27T07:38:12.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.831+0000 7f13877fe640 1 -- 172.21.15.82:0/2239894357 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f1380048020 con 0x7f13901058f0 2024-03-27T07:38:12.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.832+0000 7f13877fe640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f137c0a3980 0x7f137c0a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:12.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.832+0000 7f13877fe640 1 -- 172.21.15.82:0/2239894357 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 8560+0+0 (secure 0 0 0) 0x7f13800f5c30 con 0x7f13901058f0 2024-03-27T07:38:12.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.836+0000 7f138e59c640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f137c0a3980 0x7f137c0a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:12.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.837+0000 7f138e59c640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f137c0a3980 0x7f137c0a5e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1378005fd0 tx=0x7f137800b480 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:12.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:12.839+0000 7f13877fe640 1 -- 172.21.15.82:0/2239894357 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f139019b780 con 0x7f13901058f0 2024-03-27T07:38:13.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.202+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f13901a2d20 con 0x7f13901058f0 2024-03-27T07:38:13.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.205+0000 7f13877fe640 1 -- 172.21.15.82:0/2239894357 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v108) ==== 81+0+945 (secure 0 0 0) 0x7f13800c2670 con 0x7f13901058f0 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1643774131 2024-03-28T07:23:34.941983+0000 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3910998089 2024-03-28T07:23:34.941983+0000 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3599330107 2024-03-28T07:23:34.941983+0000 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3926741310 2024-03-28T07:14:26.375934+0000 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3434341690 2024-03-28T07:14:26.375934+0000 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3359247901 2024-03-28T07:13:59.895783+0000 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/832211049 2024-03-28T07:14:26.375934+0000 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1610502221 2024-03-28T07:14:26.375934+0000 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2722847802 2024-03-28T07:13:59.895783+0000 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2476913094 2024-03-28T07:23:34.941983+0000 2024-03-27T07:38:13.204 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1969604742 2024-03-28T07:23:34.941983+0000 2024-03-27T07:38:13.205 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3599330107 2024-03-28T07:23:34.941983+0000 2024-03-27T07:38:13.205 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2130588958 2024-03-28T07:13:59.895783+0000 2024-03-27T07:38:13.205 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/1919860944 2024-03-28T07:13:59.895783+0000 2024-03-27T07:38:13.205 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/1919860944 2024-03-28T07:13:59.895783+0000 2024-03-27T07:38:13.205 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3434341690 2024-03-28T07:14:26.375934+0000 2024-03-27T07:38:13.205 INFO:teuthology.orchestra.run.smithi082.stderr:listed 16 entries 2024-03-27T07:38:13.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f137c0a3980 msgr2=0x7f137c0a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:13.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f137c0a3980 0x7f137c0a5e40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1378005fd0 tx=0x7f137800b480 comp rx=0 tx=0).stop 2024-03-27T07:38:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13901058f0 msgr2=0x7f139019a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13901058f0 0x7f139019a950 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f138000d880 tx=0x7f1380030cf0 comp rx=0 tx=0).stop 2024-03-27T07:38:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 shutdown_connections 2024-03-27T07:38:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f137c0a3980 0x7f137c0a5e40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f13901058f0 0x7f139019a950 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13901013b0 0x7f1390196620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 --2- 172.21.15.82:0/2239894357 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f1390100a10 0x7f13901960e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 >> 172.21.15.82:0/2239894357 conn(0x7f1390077ae0 msgr2=0x7f13900fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 shutdown_connections 2024-03-27T07:38:13.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:13.210+0000 7f1394c33640 1 -- 172.21.15.82:0/2239894357 wait complete. 2024-03-27T07:38:13.226 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-27T07:38:13.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:38:13.226 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-27T07:38:13.346 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T07:38:13.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:38:13.347 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-27T07:38:13.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:38:13.394 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-03-27T07:38:13.452 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-27T07:38:13.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:38:13.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T07:38:13.528 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:13 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4118917692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:38:13.528 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:13 smithi082 ceph-mon[32178]: osdmap e108: 12 total, 12 up, 12 in 2024-03-27T07:38:13.529 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:13 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/2239894357' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-27T07:38:13.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:38:13.538 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-03-27T07:38:13.639 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-27T07:38:13.639 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-03-27T07:38:13.639 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T07:38:13.688 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056355,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1349 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/b65c4768397d5154c44e69f42dcf90e84a3ed413da5093b25be4d700582d201c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/24WUYXFGKSYV75KSEBOIWRZIVS:/var/lib/containers/storage/overlay/l/QKA4F5PSFIGECTVMGCJTRRRXVG,upperdir=/var/lib/containers/storage/overlay/b65c4768397d5154c44e69f42dcf90e84a3ed413da5093b25be4d700582d201c/diff,workdir=/var/lib/containers/storage/overlay/b65c4768397d5154c44e69f42dcf90e84a3ed413da5093b25be4d700582d201c/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e5711f86b1e76e01acac4f2abf5e0e19b18fb38c14d34240f31d4f46b678c0c9/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/24WUYXFGKSYV75KSEBOIWRZIVS:/var/lib/containers/storage/overlay/l/QKA4F5PSFIGECTVMGCJTRRRXVG,upperdir=/var/lib/containers/storage/overlay/e5711f86b1e76e01acac4f2abf5e0e19b18fb38c14d34240f31d4f46b678c0c9/diff,workdir=/var/lib/containers/storage/overlay/e5711f86b1e76e01acac4f2abf5e0e19b18fb38c14d34240f31d4f46b678c0c9/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/c741d5acd65ea6a95b0a5899bacae29f812ae54f6b40da99cc74ee2baa3407f1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/24WUYXFGKSYV75KSEBOIWRZIVS:/var/lib/containers/storage/overlay/l/QKA4F5PSFIGECTVMGCJTRRRXVG,upperdir=/var/lib/containers/storage/overlay/c741d5acd65ea6a95b0a5899bacae29f812ae54f6b40da99cc74ee2baa3407f1/diff,workdir=/var/lib/containers/storage/overlay/c741d5acd65ea6a95b0a5899bacae29f812ae54f6b40da99cc74ee2baa3407f1/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8613e74300ae87b90d6c7cbcb24833da581bcf7cb79e4c330b99aa0a9f82f235/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/24WUYXFGKSYV75KSEBOIWRZIVS:/var/lib/containers/storage/overlay/l/QKA4F5PSFIGECTVMGCJTRRRXVG,upperdir=/var/lib/containers/storage/overlay/8613e74300ae87b90d6c7cbcb24833da581bcf7cb79e4c330b99aa0a9f82f235/diff,workdir=/var/lib/containers/storage/overlay/8613e74300ae87b90d6c7cbcb24833da581bcf7cb79e4c330b99aa0a9f82f235/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/0b55c66021c1d9f4785cb852cff7f8f03f1c9a29e44cd56604db9efeef1a285c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/24WUYXFGKSYV75KSEBOIWRZIVS:/var/lib/containers/storage/overlay/l/QKA4F5PSFIGECTVMGCJTRRRXVG,upperdir=/var/lib/containers/storage/overlay/0b55c66021c1d9f4785cb852cff7f8f03f1c9a29e44cd56604db9efeef1a285c/diff,workdir=/var/lib/containers/storage/overlay/0b55c66021c1d9f4785cb852cff7f8f03f1c9a29e44cd56604db9efeef1a285c/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d1782f86028316d6dd98d20f40d3fa454c92eb8bbdd568da18d74a2dde2f66f4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/24WUYXFGKSYV75KSEBOIWRZIVS:/var/lib/containers/storage/overlay/l/QKA4F5PSFIGECTVMGCJTRRRXVG,upperdir=/var/lib/containers/storage/overlay/d1782f86028316d6dd98d20f40d3fa454c92eb8bbdd568da18d74a2dde2f66f4/diff,workdir=/var/lib/containers/storage/overlay/d1782f86028316d6dd98d20f40d3fa454c92eb8bbdd568da18d74a2dde2f66f4/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f31f016fe2b70bcac6c96d9e4f7d3c37a8a147ad7fa33b7ee02829aabbddfc88/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/24WUYXFGKSYV75KSEBOIWRZIVS:/var/lib/containers/storage/overlay/l/QKA4F5PSFIGECTVMGCJTRRRXVG,upperdir=/var/lib/containers/storage/overlay/f31f016fe2b70bcac6c96d9e4f7d3c37a8a147ad7fa33b7ee02829aabbddfc88/diff,workdir=/var/lib/containers/storage/overlay/f31f016fe2b70bcac6c96d9e4f7d3c37a8a147ad7fa33b7ee02829aabbddfc88/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/dfdbcacdad9dfd1003f6a8f885af48581342971da87dd5d3c1911fc0e5af9722/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/24WUYXFGKSYV75KSEBOIWRZIVS:/var/lib/containers/storage/overlay/l/QKA4F5PSFIGECTVMGCJTRRRXVG,upperdir=/var/lib/containers/storage/overlay/dfdbcacdad9dfd1003f6a8f885af48581342971da87dd5d3c1911fc0e5af9722/diff,workdir=/var/lib/containers/storage/overlay/dfdbcacdad9dfd1003f6a8f885af48581342971da87dd5d3c1911fc0e5af9722/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/4d5387debfe1f493937cedd30abd5aa6762abb5babeb48fcbac7be4a5dff9443/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/24WUYXFGKSYV75KSEBOIWRZIVS:/var/lib/containers/storage/overlay/l/QKA4F5PSFIGECTVMGCJTRRRXVG,upperdir=/var/lib/containers/storage/overlay/4d5387debfe1f493937cedd30abd5aa6762abb5babeb48fcbac7be4a5dff9443/diff,workdir=/var/lib/containers/storage/overlay/4d5387debfe1f493937cedd30abd5aa6762abb5babeb48fcbac7be4a5dff9443/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a830ec8eb1ac59efd044c820630b15b63913577050da3582b28f17f73939dea0/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/24WUYXFGKSYV75KSEBOIWRZIVS:/var/lib/containers/storage/overlay/l/QKA4F5PSFIGECTVMGCJTRRRXVG,upperdir=/var/lib/containers/storage/overlay/a830ec8eb1ac59efd044c820630b15b63913577050da3582b28f17f73939dea0/diff,workdir=/var/lib/containers/storage/overlay/a830ec8eb1ac59efd044c820630b15b63913577050da3582b28f17f73939dea0/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497664k,nr_inodes=819200,mode=755,inode64 0 0 2024-03-27T07:38:13.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:38:13.689 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-03-27T07:38:13.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T07:38:13.749 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-03-27T07:38:13.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:13 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4118917692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:38:13.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:13 smithi149 ceph-mon[36065]: osdmap e108: 12 total, 12 up, 12 in 2024-03-27T07:38:13.751 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:13 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/2239894357' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-27T07:38:13.784 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:13 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4118917692' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T07:38:13.784 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:13 smithi153 ceph-mon[36179]: osdmap e108: 12 total, 12 up, 12 in 2024-03-27T07:38:13.785 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:13 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/2239894357' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-27T07:38:13.840 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-03-27T07:38:13.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T07:38:13.843 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-27T07:38:13.861 INFO:tasks.cephadm:Teardown begin 2024-03-27T07:38:13.862 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-27T07:38:13.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:38:14.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.080+0000 7f577715c640 1 -- 172.21.15.82:0/387083083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f577011b330 msgr2=0x7f577011d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:14.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.080+0000 7f577715c640 1 --2- 172.21.15.82:0/387083083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f577011b330 0x7f577011d720 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5768009cd0 tx=0x7f576802c120 comp rx=0 tx=0).stop 2024-03-27T07:38:14.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.084+0000 7f577715c640 1 -- 172.21.15.82:0/387083083 shutdown_connections 2024-03-27T07:38:14.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.084+0000 7f577715c640 1 --2- 172.21.15.82:0/387083083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f577010e3b0 0x7f577010e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.084+0000 7f577715c640 1 --2- 172.21.15.82:0/387083083 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f577011b330 0x7f577011d720 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.084+0000 7f577715c640 1 --2- 172.21.15.82:0/387083083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5770110380 0x7f577010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.084+0000 7f577715c640 1 -- 172.21.15.82:0/387083083 >> 172.21.15.82:0/387083083 conn(0x7f577006cc40 msgr2=0x7f577006d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:14.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.092+0000 7f577715c640 1 -- 172.21.15.82:0/387083083 shutdown_connections 2024-03-27T07:38:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.093+0000 7f577715c640 1 -- 172.21.15.82:0/387083083 wait complete. 2024-03-27T07:38:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.094+0000 7f577715c640 1 Processor -- start 2024-03-27T07:38:14.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.098+0000 7f577715c640 1 -- start start 2024-03-27T07:38:14.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.098+0000 7f577715c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f577010e3b0 0x7f577011ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:14.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.098+0000 7f577715c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770110380 0x7f5770114c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:14.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.098+0000 7f577715c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f577011b330 0x7f57701151d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.098+0000 7f577715c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5770111560 con 0x7f5770110380 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.098+0000 7f577715c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f57701113e0 con 0x7f577010e3b0 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.098+0000 7f577715c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f57701116e0 con 0x7f577011b330 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.099+0000 7f57756f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f577011b330 0x7f57701151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.101+0000 7f57756f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f577011b330 0x7f57701151d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.82:40592/0 (socket says 172.21.15.82:40592) 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.101+0000 7f57756f9640 1 -- 172.21.15.82:0/3964284642 learned_addr learned my addr 172.21.15.82:0/3964284642 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.101+0000 7f57756f9640 1 -- 172.21.15.82:0/3964284642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f577010e3b0 msgr2=0x7f577011ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.101+0000 7f57756f9640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f577010e3b0 0x7f577011ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.101+0000 7f57756f9640 1 -- 172.21.15.82:0/3964284642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770110380 msgr2=0x7f5770114c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.101+0000 7f57756f9640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770110380 0x7f5770114c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.101+0000 7f57756f9640 1 -- 172.21.15.82:0/3964284642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5770115a90 con 0x7f577011b330 2024-03-27T07:38:14.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.102+0000 7f57756f9640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f577011b330 0x7f57701151d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f576802c6b0 tx=0x7f5768035d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.104+0000 7f576dffb640 1 -- 172.21.15.82:0/3964284642 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5768039040 con 0x7f577011b330 2024-03-27T07:38:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.104+0000 7f577715c640 1 -- 172.21.15.82:0/3964284642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57701bc120 con 0x7f577011b330 2024-03-27T07:38:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.104+0000 7f577715c640 1 -- 172.21.15.82:0/3964284642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57701bc5e0 con 0x7f577011b330 2024-03-27T07:38:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.104+0000 7f576dffb640 1 -- 172.21.15.82:0/3964284642 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5768044070 con 0x7f577011b330 2024-03-27T07:38:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.104+0000 7f576dffb640 1 -- 172.21.15.82:0/3964284642 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57680043a0 con 0x7f577011b330 2024-03-27T07:38:14.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.108+0000 7f577715c640 1 -- 172.21.15.82:0/3964284642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575c005290 con 0x7f577011b330 2024-03-27T07:38:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.112+0000 7f576dffb640 1 -- 172.21.15.82:0/3964284642 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f5768032800 con 0x7f577011b330 2024-03-27T07:38:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.112+0000 7f576dffb640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f57580a3980 0x7f57580a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.112+0000 7f576dffb640 1 -- 172.21.15.82:0/3964284642 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8528+0+0 (secure 0 0 0) 0x7f57680f2040 con 0x7f577011b330 2024-03-27T07:38:14.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.114+0000 7f5774ef8640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f57580a3980 0x7f57580a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:14.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.119+0000 7f576dffb640 1 -- 172.21.15.82:0/3964284642 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f576804d020 con 0x7f577011b330 2024-03-27T07:38:14.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.123+0000 7f5774ef8640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f57580a3980 0x7f57580a5e40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5764009670 tx=0x7f5764006bd0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:14.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.531+0000 7f577715c640 1 -- 172.21.15.82:0/3964284642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f575c005580 con 0x7f577011b330 2024-03-27T07:38:14.534 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:38:14.534 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:37:52.886744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":108,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":108,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27070":{"gid":27070,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1398740599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1398740599},{"type":"v1","addr":"172.21.15.153:6837","nonce":1398740599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:38:14.534 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 40 2024-03-27T07:38:14.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.535+0000 7f576dffb640 1 -- 172.21.15.82:0/3964284642 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11871 (secure 0 0 0) 0x7f57680bea20 con 0x7f577011b330 2024-03-27T07:38:14.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.538+0000 7f577715c640 1 -- 172.21.15.82:0/3964284642 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f57580a3980 msgr2=0x7f57580a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:14.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.538+0000 7f577715c640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f57580a3980 0x7f57580a5e40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5764009670 tx=0x7f5764006bd0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.538+0000 7f577715c640 1 -- 172.21.15.82:0/3964284642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f577011b330 msgr2=0x7f57701151d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.538+0000 7f577715c640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f577011b330 0x7f57701151d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f576802c6b0 tx=0x7f5768035d10 comp rx=0 tx=0).stop 2024-03-27T07:38:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.538+0000 7f577715c640 1 -- 172.21.15.82:0/3964284642 shutdown_connections 2024-03-27T07:38:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.538+0000 7f577715c640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f57580a3980 0x7f57580a5e40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.538+0000 7f577715c640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5770110380 0x7f5770114c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.538+0000 7f577715c640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f577011b330 0x7f57701151d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.538+0000 7f577715c640 1 --2- 172.21.15.82:0/3964284642 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f577010e3b0 0x7f577011ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.538+0000 7f577715c640 1 -- 172.21.15.82:0/3964284642 >> 172.21.15.82:0/3964284642 conn(0x7f577006cc40 msgr2=0x7f577011c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.539+0000 7f577715c640 1 -- 172.21.15.82:0/3964284642 shutdown_connections 2024-03-27T07:38:14.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.539+0000 7f577715c640 1 -- 172.21.15.82:0/3964284642 wait complete. 2024-03-27T07:38:14.553 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T07:38:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.720+0000 7fdfc77fe640 1 --2- 172.21.15.82:0/2671834693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc8109090 0x7fdfc8109510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T07:38:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.720+0000 7fdfcd667640 1 -- 172.21.15.82:0/2671834693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfc8116b50 msgr2=0x7fdfc8118f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.720+0000 7fdfcd667640 1 --2- 172.21.15.82:0/2671834693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfc8116b50 0x7fdfc8118f40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009860 tx=0x7fdfb802bb90 comp rx=0 tx=0).stop 2024-03-27T07:38:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.722+0000 7fdfcd667640 1 -- 172.21.15.82:0/2671834693 shutdown_connections 2024-03-27T07:38:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.722+0000 7fdfcd667640 1 --2- 172.21.15.82:0/2671834693 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfc8116b50 0x7fdfc8118f40 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.722+0000 7fdfcd667640 1 --2- 172.21.15.82:0/2671834693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc8109090 0x7fdfc8109510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.722+0000 7fdfcd667640 1 --2- 172.21.15.82:0/2671834693 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfc810c090 0x7fdfc8108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.722+0000 7fdfcd667640 1 -- 172.21.15.82:0/2671834693 >> 172.21.15.82:0/2671834693 conn(0x7fdfc806ca30 msgr2=0x7fdfc806ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.722+0000 7fdfcd667640 1 -- 172.21.15.82:0/2671834693 shutdown_connections 2024-03-27T07:38:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.722+0000 7fdfcd667640 1 -- 172.21.15.82:0/2671834693 wait complete. 2024-03-27T07:38:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.723+0000 7fdfcd667640 1 Processor -- start 2024-03-27T07:38:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.723+0000 7fdfcd667640 1 -- start start 2024-03-27T07:38:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.723+0000 7fdfcd667640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfc8109090 0x7fdfc810fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.724+0000 7fdfcd667640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfc810c090 0x7fdfc81101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.724+0000 7fdfc7fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfc8109090 0x7fdfc810fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.724+0000 7fdfc7fff640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfc8109090 0x7fdfc810fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:43494/0 (socket says 172.21.15.82:43494) 2024-03-27T07:38:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.724+0000 7fdfcd667640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc8116b50 0x7fdfc81a8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.724+0000 7fdfc7fff640 1 -- 172.21.15.82:0/32207625 learned_addr learned my addr 172.21.15.82:0/32207625 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.724+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc811c7c0 con 0x7fdfc810c090 2024-03-27T07:38:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.724+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc811c640 con 0x7fdfc8109090 2024-03-27T07:38:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.724+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc811c940 con 0x7fdfc8116b50 2024-03-27T07:38:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.725+0000 7fdfc77fe640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfc810c090 0x7fdfc81101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.726+0000 7fdfcce66640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc8116b50 0x7fdfc81a8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.727+0000 7fdfc7fff640 1 -- 172.21.15.82:0/32207625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc8116b50 msgr2=0x7fdfc81a8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.727+0000 7fdfc7fff640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc8116b50 0x7fdfc81a8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.727+0000 7fdfc7fff640 1 -- 172.21.15.82:0/32207625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfc810c090 msgr2=0x7fdfc81101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.727+0000 7fdfc7fff640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfc810c090 0x7fdfc81101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.727+0000 7fdfc7fff640 1 -- 172.21.15.82:0/32207625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc81a9400 con 0x7fdfc8109090 2024-03-27T07:38:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.727+0000 7fdfc7fff640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfc8109090 0x7fdfc810fc90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00e9f0 tx=0x7fdfbc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.727+0000 7fdfcce66640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc8116b50 0x7fdfc81a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T07:38:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.727+0000 7fdfc57fa640 1 -- 172.21.15.82:0/32207625 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc00cd80 con 0x7fdfc8109090 2024-03-27T07:38:14.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.728+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc81a96f0 con 0x7fdfc8109090 2024-03-27T07:38:14.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.728+0000 7fdfc57fa640 1 -- 172.21.15.82:0/32207625 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfbc010910 con 0x7fdfc8109090 2024-03-27T07:38:14.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.728+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc8115b80 con 0x7fdfc8109090 2024-03-27T07:38:14.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.728+0000 7fdfc57fa640 1 -- 172.21.15.82:0/32207625 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0187f0 con 0x7fdfc8109090 2024-03-27T07:38:14.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.729+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb4005290 con 0x7fdfc8109090 2024-03-27T07:38:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.731+0000 7fdfc57fa640 1 -- 172.21.15.82:0/32207625 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fdfbc010430 con 0x7fdfc8109090 2024-03-27T07:38:14.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.732+0000 7fdfc57fa640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fdfb00a3840 0x7fdfb00a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:14.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.732+0000 7fdfc57fa640 1 -- 172.21.15.82:0/32207625 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8528+0+0 (secure 0 0 0) 0x7fdfbc0d0430 con 0x7fdfc8109090 2024-03-27T07:38:14.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.733+0000 7fdfc77fe640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fdfb00a3840 0x7fdfb00a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:14.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.733+0000 7fdfc77fe640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fdfb00a3840 0x7fdfb00a5d00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdfc81aa300 tx=0x7fdfc00095c0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:14.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:14.741+0000 7fdfc57fa640 1 -- 172.21.15.82:0/32207625 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fdfbc09cc80 con 0x7fdfc8109090 2024-03-27T07:38:15.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.153+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfb4005850 con 0x7fdfc8109090 2024-03-27T07:38:15.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.154+0000 7fdfc57fa640 1 -- 172.21.15.82:0/32207625 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11871 (secure 0 0 0) 0x7fdfbc09c580 con 0x7fdfc8109090 2024-03-27T07:38:15.153 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:38:15.153 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/159427358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":159427358},{"type":"v1","addr":"172.21.15.82:6835","nonce":159427358}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/2302110902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2302110902},{"type":"v1","addr":"172.21.15.82:6837","nonce":2302110902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/908346783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":908346783},{"type":"v1","addr":"172.21.15.82:6839","nonce":908346783}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/31948189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":31948189},{"type":"v1","addr":"172.21.15.82:6841","nonce":31948189}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/193154371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":193154371},{"type":"v1","addr":"172.21.15.153:6833","nonce":193154371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.149:6833/51873872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6832","nonce":51873872},{"type":"v1","addr":"172.21.15.149:6833","nonce":51873872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T07:21:34.901653+0000","modified":"2024-03-27T07:37:52.886744+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24497,"mds_1":24484,"mds_2":24470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24446":{"gid":24446,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.149:6835/227197026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6834","nonce":227197026},{"type":"v1","addr":"172.21.15.149:6835","nonce":227197026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6835/1080332547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1080332547},{"type":"v1","addr":"172.21.15.153:6835","nonce":1080332547}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"h","rank":2,"incarnation":19,"state":"up:active","state_seq":108,"addr":"172.21.15.149:6837/4121570293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6836","nonce":4121570293},{"type":"v1","addr":"172.21.15.149:6837","nonce":4121570293}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":17,"state":"up:active","state_seq":108,"addr":"172.21.15.153:6839/1505538081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6838","nonce":1505538081},{"type":"v1","addr":"172.21.15.153:6839","nonce":1505538081}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.149:6839/3930771704","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6838","nonce":3930771704},{"type":"v1","addr":"172.21.15.149:6839","nonce":3930771704}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_27070":{"gid":27070,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.153:6837/1398740599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6836","nonce":1398740599},{"type":"v1","addr":"172.21.15.153:6837","nonce":1398740599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24484,24470]},"id":1}]} 2024-03-27T07:38:15.153 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 40 2024-03-27T07:38:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.157+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fdfb00a3840 msgr2=0x7fdfb00a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.157+0000 7fdfcd667640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fdfb00a3840 0x7fdfb00a5d00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdfc81aa300 tx=0x7fdfc00095c0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.157+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfc8109090 msgr2=0x7fdfc810fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.157+0000 7fdfcd667640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfc8109090 0x7fdfc810fc90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00e9f0 tx=0x7fdfbc00eeb0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.157+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 shutdown_connections 2024-03-27T07:38:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.157+0000 7fdfcd667640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fdfb00a3840 0x7fdfb00a5d00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.157+0000 7fdfcd667640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdfc810c090 0x7fdfc81101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.157+0000 7fdfcd667640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdfc8116b50 0x7fdfc81a8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.158+0000 7fdfcd667640 1 --2- 172.21.15.82:0/32207625 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fdfc8109090 0x7fdfc810fc90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.158+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 >> 172.21.15.82:0/32207625 conn(0x7fdfc806ca30 msgr2=0x7fdfc8116f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:15.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.158+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 shutdown_connections 2024-03-27T07:38:15.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.158+0000 7fdfcd667640 1 -- 172.21.15.82:0/32207625 wait complete. 2024-03-27T07:38:15.168 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:14 smithi082 ceph-mon[32178]: pgmap v461: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 127 B/s wr, 5 op/s 2024-03-27T07:38:15.168 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:14 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:38:15.168 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:14 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/3964284642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:38:15.170 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T07:38:15.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:14 smithi149 ceph-mon[36065]: pgmap v461: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 127 B/s wr, 5 op/s 2024-03-27T07:38:15.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:14 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:38:15.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:14 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/3964284642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:38:15.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:14 smithi153 ceph-mon[36179]: pgmap v461: 97 pgs: 14 active+clean+snaptrim, 24 active+clean+snaptrim_wait, 59 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 127 B/s wr, 5 op/s 2024-03-27T07:38:15.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:14 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T07:38:15.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:14 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/3964284642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:38:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.344+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1786746736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc868104920 msgr2=0x7fc868108960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.344+0000 7fc86fb3a640 1 --2- 172.21.15.82:0/1786746736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc868104920 0x7fc868108960 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc864009860 tx=0x7fc86402bbb0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.344+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1786746736 shutdown_connections 2024-03-27T07:38:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.344+0000 7fc86fb3a640 1 --2- 172.21.15.82:0/1786746736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc868109040 0x7fc868110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.344+0000 7fc86fb3a640 1 --2- 172.21.15.82:0/1786746736 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc868104920 0x7fc868108960 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.344+0000 7fc86fb3a640 1 --2- 172.21.15.82:0/1786746736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc868103f70 0x7fc868104350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.344+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1786746736 >> 172.21.15.82:0/1786746736 conn(0x7fc8680ff790 msgr2=0x7fc868101bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:15.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.345+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1786746736 shutdown_connections 2024-03-27T07:38:15.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.345+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1786746736 wait complete. 2024-03-27T07:38:15.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.345+0000 7fc86fb3a640 1 Processor -- start 2024-03-27T07:38:15.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.348+0000 7fc86fb3a640 1 -- start start 2024-03-27T07:38:15.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.349+0000 7fc86fb3a640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc868103f70 0x7fc8681a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:15.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.349+0000 7fc86fb3a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc868109040 0x7fc8681a4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:15.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.349+0000 7fc86fb3a640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc86810f720 0x7fc86810fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:15.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.349+0000 7fc86fb3a640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8680772b0 con 0x7fc86810f720 2024-03-27T07:38:15.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.349+0000 7fc86fb3a640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fc868077130 con 0x7fc868103f70 2024-03-27T07:38:15.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.349+0000 7fc86fb3a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc868077430 con 0x7fc868109040 2024-03-27T07:38:15.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.351+0000 7fc86d8d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc868103f70 0x7fc8681a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:15.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.351+0000 7fc86d8d6640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc868103f70 0x7fc8681a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:43512/0 (socket says 172.21.15.82:43512) 2024-03-27T07:38:15.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.351+0000 7fc86d8d6640 1 -- 172.21.15.82:0/1770697834 learned_addr learned my addr 172.21.15.82:0/1770697834 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:15.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.351+0000 7fc86d0d5640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc868109040 0x7fc8681a4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:15.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.351+0000 7fc86d8d6640 1 -- 172.21.15.82:0/1770697834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc868109040 msgr2=0x7fc8681a4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:15.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.351+0000 7fc86d8d6640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc868109040 0x7fc8681a4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.351+0000 7fc86d8d6640 1 -- 172.21.15.82:0/1770697834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc86810f720 msgr2=0x7fc86810fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:15.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.351+0000 7fc86d8d6640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc86810f720 0x7fc86810fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.351+0000 7fc86d8d6640 1 -- 172.21.15.82:0/1770697834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8681102d0 con 0x7fc868103f70 2024-03-27T07:38:15.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.352+0000 7fc86d8d6640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc868103f70 0x7fc8681a4770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc85800d950 tx=0x7fc85800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:15.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.352+0000 7fc85effd640 1 -- 172.21.15.82:0/1770697834 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858017030 con 0x7fc868103f70 2024-03-27T07:38:15.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.352+0000 7fc85effd640 1 -- 172.21.15.82:0/1770697834 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc858004020 con 0x7fc868103f70 2024-03-27T07:38:15.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.352+0000 7fc85effd640 1 -- 172.21.15.82:0/1770697834 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580047a0 con 0x7fc868103f70 2024-03-27T07:38:15.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.352+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1770697834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8681ab550 con 0x7fc868103f70 2024-03-27T07:38:15.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.352+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1770697834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8681ab900 con 0x7fc868103f70 2024-03-27T07:38:15.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.354+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1770697834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc868105440 con 0x7fc868103f70 2024-03-27T07:38:15.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.356+0000 7fc85effd640 1 -- 172.21.15.82:0/1770697834 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fc858004940 con 0x7fc868103f70 2024-03-27T07:38:15.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.357+0000 7fc85effd640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc8540a3880 0x7fc8540a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:15.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.357+0000 7fc85effd640 1 -- 172.21.15.82:0/1770697834 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8528+0+0 (secure 0 0 0) 0x7fc8580cfbd0 con 0x7fc868103f70 2024-03-27T07:38:15.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.360+0000 7fc86d0d5640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc8540a3880 0x7fc8540a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:15.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.363+0000 7fc86d0d5640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc8540a3880 0x7fc8540a5d40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc864034d00 tx=0x7fc864034c70 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:15.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.365+0000 7fc85effd640 1 -- 172.21.15.82:0/1770697834 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc85809d3f0 con 0x7fc868103f70 2024-03-27T07:38:15.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.705+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1770697834 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8681049b0 con 0x7fc868103f70 2024-03-27T07:38:15.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.708+0000 7fc85effd640 1 -- 172.21.15.82:0/1770697834 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+23042 (secure 0 0 0) 0x7fc85809ccf0 con 0x7fc868103f70 2024-03-27T07:38:15.707 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-03-27T07:38:15.707 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":108,"fsid":"604548c2-ec09-11ee-95d0-87774f69a715","created":"2024-03-27T07:13:23.455121+0000","modified":"2024-03-27T07:38:12.864291+0000","last_up_change":"2024-03-27T07:20:44.516727+0000","last_in_change":"2024-03-27T07:20:23.882276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T07:16:54.470723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T07:21:32.592597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T07:21:33.858606+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":25,"snap_epoch":107,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3843b5bc-e505-452f-8ce4-f4db52e6c7e8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6803","nonce":546346020}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6805","nonce":546346020}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6809","nonce":546346020}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":546346020},{"type":"v1","addr":"172.21.15.82:6807","nonce":546346020}]},"public_addr":"172.21.15.82:6803/546346020","cluster_addr":"172.21.15.82:6805/546346020","heartbeat_back_addr":"172.21.15.82:6809/546346020","heartbeat_front_addr":"172.21.15.82:6807/546346020","state":["exists","up"]},{"osd":1,"uuid":"0fb771fe-8d60-4f03-b108-3a94c2e8e6c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6800","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6801","nonce":828199566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6802","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6803","nonce":828199566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6806","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6807","nonce":828199566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6804","nonce":828199566},{"type":"v1","addr":"172.21.15.149:6805","nonce":828199566}]},"public_addr":"172.21.15.149:6801/828199566","cluster_addr":"172.21.15.149:6803/828199566","heartbeat_back_addr":"172.21.15.149:6807/828199566","heartbeat_front_addr":"172.21.15.149:6805/828199566","state":["exists","up"]},{"osd":2,"uuid":"91427a95-87e5-4e0f-b881-9886eea7cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6801","nonce":2925402990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6803","nonce":2925402990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6807","nonce":2925402990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2925402990},{"type":"v1","addr":"172.21.15.153:6805","nonce":2925402990}]},"public_addr":"172.21.15.153:6801/2925402990","cluster_addr":"172.21.15.153:6803/2925402990","heartbeat_back_addr":"172.21.15.153:6807/2925402990","heartbeat_front_addr":"172.21.15.153:6805/2925402990","state":["exists","up"]},{"osd":3,"uuid":"0fdaf48a-424a-48a1-b666-53dfd853d486","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6811","nonce":590021111}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6813","nonce":590021111}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6817","nonce":590021111}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":590021111},{"type":"v1","addr":"172.21.15.82:6815","nonce":590021111}]},"public_addr":"172.21.15.82:6811/590021111","cluster_addr":"172.21.15.82:6813/590021111","heartbeat_back_addr":"172.21.15.82:6817/590021111","heartbeat_front_addr":"172.21.15.82:6815/590021111","state":["exists","up"]},{"osd":4,"uuid":"ebc9ca5b-bfe9-4124-a145-964d792106b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6808","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6809","nonce":1568090772}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6810","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6811","nonce":1568090772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6814","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6815","nonce":1568090772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6812","nonce":1568090772},{"type":"v1","addr":"172.21.15.149:6813","nonce":1568090772}]},"public_addr":"172.21.15.149:6809/1568090772","cluster_addr":"172.21.15.149:6811/1568090772","heartbeat_back_addr":"172.21.15.149:6815/1568090772","heartbeat_front_addr":"172.21.15.149:6813/1568090772","state":["exists","up"]},{"osd":5,"uuid":"03acb116-175d-40b6-a569-3ecac8868d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6809","nonce":588711733}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6811","nonce":588711733}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6815","nonce":588711733}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":588711733},{"type":"v1","addr":"172.21.15.153:6813","nonce":588711733}]},"public_addr":"172.21.15.153:6809/588711733","cluster_addr":"172.21.15.153:6811/588711733","heartbeat_back_addr":"172.21.15.153:6815/588711733","heartbeat_front_addr":"172.21.15.153:6813/588711733","state":["exists","up"]},{"osd":6,"uuid":"5d6f76e0-ceb1-4064-a9a7-a0f42c4d36b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6819","nonce":2410451909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6821","nonce":2410451909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6825","nonce":2410451909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":2410451909},{"type":"v1","addr":"172.21.15.82:6823","nonce":2410451909}]},"public_addr":"172.21.15.82:6819/2410451909","cluster_addr":"172.21.15.82:6821/2410451909","heartbeat_back_addr":"172.21.15.82:6825/2410451909","heartbeat_front_addr":"172.21.15.82:6823/2410451909","state":["exists","up"]},{"osd":7,"uuid":"9a0a4fc5-d9ec-46ff-8052-1cb270698473","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6816","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6817","nonce":688070751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6818","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6819","nonce":688070751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6822","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6823","nonce":688070751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6820","nonce":688070751},{"type":"v1","addr":"172.21.15.149:6821","nonce":688070751}]},"public_addr":"172.21.15.149:6817/688070751","cluster_addr":"172.21.15.149:6819/688070751","heartbeat_back_addr":"172.21.15.149:6823/688070751","heartbeat_front_addr":"172.21.15.149:6821/688070751","state":["exists","up"]},{"osd":8,"uuid":"c1af4d31-3f29-41c3-8d02-605bad1858c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6817","nonce":3435360108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6819","nonce":3435360108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6823","nonce":3435360108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":3435360108},{"type":"v1","addr":"172.21.15.153:6821","nonce":3435360108}]},"public_addr":"172.21.15.153:6817/3435360108","cluster_addr":"172.21.15.153:6819/3435360108","heartbeat_back_addr":"172.21.15.153:6823/3435360108","heartbeat_front_addr":"172.21.15.153:6821/3435360108","state":["exists","up"]},{"osd":9,"uuid":"7905db5d-ad78-473a-b285-f1c4043865cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6827","nonce":1945187916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6829","nonce":1945187916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6833","nonce":1945187916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":1945187916},{"type":"v1","addr":"172.21.15.82:6831","nonce":1945187916}]},"public_addr":"172.21.15.82:6827/1945187916","cluster_addr":"172.21.15.82:6829/1945187916","heartbeat_back_addr":"172.21.15.82:6833/1945187916","heartbeat_front_addr":"172.21.15.82:6831/1945187916","state":["exists","up"]},{"osd":10,"uuid":"a76fdd45-339b-4cae-a342-d9b1bea0f85f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6824","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6825","nonce":42810131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6826","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6827","nonce":42810131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6830","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6831","nonce":42810131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.149:6828","nonce":42810131},{"type":"v1","addr":"172.21.15.149:6829","nonce":42810131}]},"public_addr":"172.21.15.149:6825/42810131","cluster_addr":"172.21.15.149:6827/42810131","heartbeat_back_addr":"172.21.15.149:6831/42810131","heartbeat_front_addr":"172.21.15.149:6829/42810131","state":["exists","up"]},{"osd":11,"uuid":"d520186c-b3fd-4979-8b42-634cd9b0c60b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6825","nonce":4155977568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6827","nonce":4155977568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6831","nonce":4155977568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":4155977568},{"type":"v1","addr":"172.21.15.153:6829","nonce":4155977568}]},"public_addr":"172.21.15.153:6825/4155977568","cluster_addr":"172.21.15.153:6827/4155977568","heartbeat_back_addr":"172.21.15.153:6831/4155977568","heartbeat_front_addr":"172.21.15.153:6829/4155977568","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:01.959776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:25.921104+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:16:50.452114+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:14.931834+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:17:39.969541+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:05.795902+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:31.132696+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:18:57.065457+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:23.451487+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:19:49.358343+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:15.413408+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T07:20:42.913660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/1643774131":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3910998089":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6801/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/3926741310":"2024-03-28T07:14:26.375934+0000","172.21.15.82:6801/3434341690":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/3359247901":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/832211049":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/1610502221":"2024-03-28T07:14:26.375934+0000","172.21.15.82:0/2722847802":"2024-03-28T07:13:59.895783+0000","172.21.15.82:0/2476913094":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/1969604742":"2024-03-28T07:23:34.941983+0000","172.21.15.82:6800/3599330107":"2024-03-28T07:23:34.941983+0000","172.21.15.82:0/2130588958":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6801/1919860944":"2024-03-28T07:13:59.895783+0000","172.21.15.82:6800/3434341690":"2024-03-28T07:14:26.375934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":12,"length":1},{"begin":25,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":10,"length":1},{"begin":23,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.714+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1770697834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc8540a3880 msgr2=0x7fc8540a5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.714+0000 7fc86fb3a640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc8540a3880 0x7fc8540a5d40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc864034d00 tx=0x7fc864034c70 comp rx=0 tx=0).stop 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.714+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1770697834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc868103f70 msgr2=0x7fc8681a4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.714+0000 7fc86fb3a640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc868103f70 0x7fc8681a4770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc85800d950 tx=0x7fc85800de10 comp rx=0 tx=0).stop 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.714+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1770697834 shutdown_connections 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.714+0000 7fc86fb3a640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fc8540a3880 0x7fc8540a5d40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.714+0000 7fc86fb3a640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc86810f720 0x7fc86810fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.714+0000 7fc86fb3a640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc868109040 0x7fc8681a4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.714+0000 7fc86fb3a640 1 --2- 172.21.15.82:0/1770697834 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fc868103f70 0x7fc8681a4770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.714+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1770697834 >> 172.21.15.82:0/1770697834 conn(0x7fc8680ff790 msgr2=0x7fc868100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.715+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1770697834 shutdown_connections 2024-03-27T07:38:15.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.715+0000 7fc86fb3a640 1 -- 172.21.15.82:0/1770697834 wait complete. 2024-03-27T07:38:15.732 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-27T07:38:15.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.922+0000 7f3105a81640 1 -- 172.21.15.82:0/3584713094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f310011b1f0 msgr2=0x7f310011d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.922+0000 7f3105a81640 1 --2- 172.21.15.82:0/3584713094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f310011b1f0 0x7f310011d5e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009900 tx=0x7f30f402bc80 comp rx=0 tx=0).stop 2024-03-27T07:38:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.922+0000 7f3105a81640 1 -- 172.21.15.82:0/3584713094 shutdown_connections 2024-03-27T07:38:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.922+0000 7f3105a81640 1 --2- 172.21.15.82:0/3584713094 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f310011b1f0 0x7f310011d5e0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.922+0000 7f3105a81640 1 --2- 172.21.15.82:0/3584713094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f310006de00 0x7f310011acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.922+0000 7f3105a81640 1 --2- 172.21.15.82:0/3584713094 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f310006d4e0 0x7f310006d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.922+0000 7f3105a81640 1 -- 172.21.15.82:0/3584713094 >> 172.21.15.82:0/3584713094 conn(0x7f310006cb50 msgr2=0x7f310010ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.922+0000 7f3105a81640 1 -- 172.21.15.82:0/3584713094 shutdown_connections 2024-03-27T07:38:15.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.922+0000 7f3105a81640 1 -- 172.21.15.82:0/3584713094 wait complete. 2024-03-27T07:38:15.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.923+0000 7f3105a81640 1 Processor -- start 2024-03-27T07:38:15.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.923+0000 7f3105a81640 1 -- start start 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f3105a81640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f310006d4e0 0x7f310011a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f3105a81640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f310006de00 0x7f310011aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f3105a81640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f310011b1f0 0x7f31001145a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f3105a81640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f310010ca70 con 0x7f310011b1f0 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f3105a81640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f310010c8f0 con 0x7f310006d4e0 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f3105a81640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f310010cbf0 con 0x7f310006de00 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f310006d4e0 0x7f310011a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f30fffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f310011b1f0 0x7f31001145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f30fffff640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f310011b1f0 0x7f31001145a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33866/0 (socket says 172.21.15.82:33866) 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f310006d4e0 0x7f310011a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:43528/0 (socket says 172.21.15.82:43528) 2024-03-27T07:38:15.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.924+0000 7f30fffff640 1 -- 172.21.15.82:0/74183962 learned_addr learned my addr 172.21.15.82:0/74183962 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.925+0000 7f30fffff640 1 -- 172.21.15.82:0/74183962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f310006de00 msgr2=0x7f310011aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.925+0000 7f30fffff640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f310006de00 0x7f310011aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.925+0000 7f30fffff640 1 -- 172.21.15.82:0/74183962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f310006d4e0 msgr2=0x7f310011a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.925+0000 7f30fffff640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f310006d4e0 0x7f310011a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.925+0000 7f30fffff640 1 -- 172.21.15.82:0/74183962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3100114e60 con 0x7f310011b1f0 2024-03-27T07:38:15.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.925+0000 7f30fffff640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f310011b1f0 0x7f31001145a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009850 tx=0x7f30f402ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.930+0000 7f30fcff9640 1 -- 172.21.15.82:0/74183962 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4043020 con 0x7f310011b1f0 2024-03-27T07:38:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.930+0000 7f30fcff9640 1 -- 172.21.15.82:0/74183962 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f30f40054e0 con 0x7f310011b1f0 2024-03-27T07:38:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.930+0000 7f30fcff9640 1 -- 172.21.15.82:0/74183962 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4003c70 con 0x7f310011b1f0 2024-03-27T07:38:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.931+0000 7f3105a81640 1 -- 172.21.15.82:0/74183962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31001150f0 con 0x7f310011b1f0 2024-03-27T07:38:15.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.931+0000 7f3105a81640 1 -- 172.21.15.82:0/74183962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31001bc4c0 con 0x7f310011b1f0 2024-03-27T07:38:15.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.933+0000 7f3105a81640 1 -- 172.21.15.82:0/74183962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310006ec20 con 0x7f310011b1f0 2024-03-27T07:38:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.937+0000 7f30fcff9640 1 -- 172.21.15.82:0/74183962 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f30f4046020 con 0x7f310011b1f0 2024-03-27T07:38:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.937+0000 7f30fcff9640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f30e80a3910 0x7f30e80a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:15.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.938+0000 7f30fcff9640 1 -- 172.21.15.82:0/74183962 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 8528+0+0 (secure 0 0 0) 0x7f30f40f22c0 con 0x7f310011b1f0 2024-03-27T07:38:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.942+0000 7f30ff7fe640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f30e80a3910 0x7f30e80a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:15.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.943+0000 7f30ff7fe640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f30e80a3910 0x7f30e80a5dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f30f8005c40 tx=0x7f30f800a780 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:15.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:15.946+0000 7f30fcff9640 1 -- 172.21.15.82:0/74183962 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f30f404d020 con 0x7f310011b1f0 2024-03-27T07:38:16.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:15 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/32207625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:38:16.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:15 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/1770697834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:38:16.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:15 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:38:16.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:15 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:38:16.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:15 smithi082 ceph-mon[32178]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:38:16.256 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:15 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/32207625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:38:16.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:15 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/1770697834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:38:16.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:15 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:38:16.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:15 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:38:16.257 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:15 smithi149 ceph-mon[36065]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:38:16.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:15 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/32207625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T07:38:16.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:15 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/1770697834' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T07:38:16.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:15 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T07:38:16.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:15 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T07:38:16.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:15 smithi153 ceph-mon[36179]: from='mgr.15273 ' entity='mgr.x' 2024-03-27T07:38:16.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.367+0000 7f3105a81640 1 -- 172.21.15.82:0/74183962 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f3100068940 con 0x7f310011b1f0 2024-03-27T07:38:16.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.372+0000 7f30fcff9640 1 -- 172.21.15.82:0/74183962 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7f30f40bec20 con 0x7f310011b1f0 2024-03-27T07:38:16.370 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-27T07:38:16.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.375+0000 7f3105a81640 1 -- 172.21.15.82:0/74183962 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f30e80a3910 msgr2=0x7f30e80a5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:16.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.375+0000 7f3105a81640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f30e80a3910 0x7f30e80a5dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f30f8005c40 tx=0x7f30f800a780 comp rx=0 tx=0).stop 2024-03-27T07:38:16.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.375+0000 7f3105a81640 1 -- 172.21.15.82:0/74183962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f310011b1f0 msgr2=0x7f31001145a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:16.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.375+0000 7f3105a81640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f310011b1f0 0x7f31001145a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009850 tx=0x7f30f402ce30 comp rx=0 tx=0).stop 2024-03-27T07:38:16.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.375+0000 7f3105a81640 1 -- 172.21.15.82:0/74183962 shutdown_connections 2024-03-27T07:38:16.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.375+0000 7f3105a81640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f30e80a3910 0x7f30e80a5dd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:16.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.375+0000 7f3105a81640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f310011b1f0 0x7f31001145a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:16.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.375+0000 7f3105a81640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f310006de00 0x7f310011aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:16.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.375+0000 7f3105a81640 1 --2- 172.21.15.82:0/74183962 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f310006d4e0 0x7f310011a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:16.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.375+0000 7f3105a81640 1 -- 172.21.15.82:0/74183962 >> 172.21.15.82:0/74183962 conn(0x7f310006cb50 msgr2=0x7f310011c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:16.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.376+0000 7f3105a81640 1 -- 172.21.15.82:0/74183962 shutdown_connections 2024-03-27T07:38:16.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.376+0000 7f3105a81640 1 -- 172.21.15.82:0/74183962 wait complete. 2024-03-27T07:38:16.390 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-27T07:38:16.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.557+0000 7f385d023640 1 -- 172.21.15.82:0/1966497526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385811b330 msgr2=0x7f385811d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:16.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.557+0000 7f385d023640 1 --2- 172.21.15.82:0/1966497526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385811b330 0x7f385811d720 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3850009ca0 tx=0x7f385002c120 comp rx=0 tx=0).stop 2024-03-27T07:38:16.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.557+0000 7f385d023640 1 -- 172.21.15.82:0/1966497526 shutdown_connections 2024-03-27T07:38:16.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.557+0000 7f385d023640 1 --2- 172.21.15.82:0/1966497526 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385811b330 0x7f385811d720 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:16.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.557+0000 7f385d023640 1 --2- 172.21.15.82:0/1966497526 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385810e3a0 0x7f385810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:16.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.557+0000 7f385d023640 1 --2- 172.21.15.82:0/1966497526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3858110370 0x7f385810de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:16.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.557+0000 7f385d023640 1 -- 172.21.15.82:0/1966497526 >> 172.21.15.82:0/1966497526 conn(0x7f385806cc30 msgr2=0x7f385806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:16.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.559+0000 7f385d023640 1 -- 172.21.15.82:0/1966497526 shutdown_connections 2024-03-27T07:38:16.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.562+0000 7f385d023640 1 -- 172.21.15.82:0/1966497526 wait complete. 2024-03-27T07:38:16.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.564+0000 7f385d023640 1 Processor -- start 2024-03-27T07:38:16.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f385d023640 1 -- start start 2024-03-27T07:38:16.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f385d023640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385810e3a0 0x7f38581a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:16.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f385d023640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3858110370 0x7f38581a7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:16.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f385d023640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385811b330 0x7f38581abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:16.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f385d023640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3858120cf0 con 0x7f3858110370 2024-03-27T07:38:16.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f385d023640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f3858120b70 con 0x7f385810e3a0 2024-03-27T07:38:16.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f385d023640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3858120e70 con 0x7f385811b330 2024-03-27T07:38:16.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f3856d9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385810e3a0 0x7f38581a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:16.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f385659c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3858110370 0x7f38581a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:16.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f3856d9d640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385810e3a0 0x7f38581a7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:43546/0 (socket says 172.21.15.82:43546) 2024-03-27T07:38:16.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.565+0000 7f3856d9d640 1 -- 172.21.15.82:0/896160361 learned_addr learned my addr 172.21.15.82:0/896160361 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:16.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.566+0000 7f3856d9d640 1 -- 172.21.15.82:0/896160361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385811b330 msgr2=0x7f38581abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:16.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.566+0000 7f3856d9d640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385811b330 0x7f38581abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:16.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.566+0000 7f3856d9d640 1 -- 172.21.15.82:0/896160361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3858110370 msgr2=0x7f38581a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:16.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.566+0000 7f3856d9d640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3858110370 0x7f38581a7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:16.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.566+0000 7f3856d9d640 1 -- 172.21.15.82:0/896160361 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38581ac220 con 0x7f385810e3a0 2024-03-27T07:38:16.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.566+0000 7f3856d9d640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385810e3a0 0x7f38581a7230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f384800b450 tx=0x7f384800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:16.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.567+0000 7f383ffff640 1 -- 172.21.15.82:0/896160361 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3848015020 con 0x7f385810e3a0 2024-03-27T07:38:16.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.567+0000 7f385d023640 1 -- 172.21.15.82:0/896160361 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38581ac510 con 0x7f385810e3a0 2024-03-27T07:38:16.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.567+0000 7f385d023640 1 -- 172.21.15.82:0/896160361 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38581b3da0 con 0x7f385810e3a0 2024-03-27T07:38:16.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.568+0000 7f383ffff640 1 -- 172.21.15.82:0/896160361 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3848011d70 con 0x7f385810e3a0 2024-03-27T07:38:16.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.568+0000 7f383ffff640 1 -- 172.21.15.82:0/896160361 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384800f340 con 0x7f385810e3a0 2024-03-27T07:38:16.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.570+0000 7f385d023640 1 -- 172.21.15.82:0/896160361 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3858068940 con 0x7f385810e3a0 2024-03-27T07:38:16.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.575+0000 7f383ffff640 1 -- 172.21.15.82:0/896160361 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f3848018020 con 0x7f385810e3a0 2024-03-27T07:38:16.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.576+0000 7f383ffff640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f38400a3950 0x7f38400a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:16.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.576+0000 7f383ffff640 1 -- 172.21.15.82:0/896160361 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 8742+0+0 (secure 0 0 0) 0x7f38480d0340 con 0x7f385810e3a0 2024-03-27T07:38:16.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.577+0000 7f385659c640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f38400a3950 0x7f38400a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:16.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.578+0000 7f385659c640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f38400a3950 0x7f38400a5e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f384c005fd0 tx=0x7f384c005850 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:16.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:16.583+0000 7f383ffff640 1 -- 172.21.15.82:0/896160361 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f384801f020 con 0x7f385810e3a0 2024-03-27T07:38:16.684 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:16 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[32174]: 2024-03-27T07:38:16.368+0000 7fbaf99ba700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-27T07:38:17.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-mon[36065]: pgmap v462: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s 2024-03-27T07:38:17.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/74183962' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-27T07:38:17.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-mon[36065]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-27T07:38:17.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-mon[36065]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-27T07:38:17.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-mon[36065]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-03-27T07:38:17.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/74183962' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-27T07:38:17.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-mon[36065]: osdmap e109: 12 total, 12 up, 12 in 2024-03-27T07:38:17.002 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-mon[36065]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-03-27T07:38:17.003 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: ignoring --setuser ceph since I am not root 2024-03-27T07:38:17.003 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: ignoring --setgroup ceph since I am not root 2024-03-27T07:38:17.003 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: starting mds.b at 2024-03-27T07:38:17.003 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: ignoring --setuser ceph since I am not root 2024-03-27T07:38:17.003 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: ignoring --setgroup ceph since I am not root 2024-03-27T07:38:17.003 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: starting mds.h at 2024-03-27T07:38:17.004 INFO:journalctl@ceph.mds.e.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-e[66362]: ignoring --setuser ceph since I am not root 2024-03-27T07:38:17.004 INFO:journalctl@ceph.mds.e.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-e[66362]: ignoring --setgroup ceph since I am not root 2024-03-27T07:38:17.004 INFO:journalctl@ceph.mds.e.smithi149.stdout:Mar 27 07:38:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-e[66362]: starting mds.e at 2024-03-27T07:38:17.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.009+0000 7f385d023640 1 -- 172.21.15.82:0/896160361 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f38581b4100 con 0x7f385810e3a0 2024-03-27T07:38:17.034 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[73328]: ignoring --setuser ceph since I am not root 2024-03-27T07:38:17.034 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[73328]: ignoring --setgroup ceph since I am not root 2024-03-27T07:38:17.034 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-mds[73333]: -- 172.21.15.153:0/2086763514 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55ad35d7e1a0 con 0x55ad35d54c00 2024-03-27T07:38:17.034 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[73328]: starting mds.c at 2024-03-27T07:38:17.035 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f[66871]: ignoring --setuser ceph since I am not root 2024-03-27T07:38:17.035 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f[66871]: ignoring --setgroup ceph since I am not root 2024-03-27T07:38:17.035 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-mds[66875]: -- 172.21.15.153:0/2397954708 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5629bd09da40 con 0x5629bd071000 2024-03-27T07:38:17.035 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f[66871]: starting mds.f at 2024-03-27T07:38:17.035 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: ignoring --setuser ceph since I am not root 2024-03-27T07:38:17.035 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: ignoring --setgroup ceph since I am not root 2024-03-27T07:38:17.035 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: starting mds.i at 2024-03-27T07:38:17.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-mon[36179]: pgmap v462: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s 2024-03-27T07:38:17.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/74183962' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-27T07:38:17.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-mon[36179]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-27T07:38:17.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-mon[36179]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-27T07:38:17.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-mon[36179]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-03-27T07:38:17.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/74183962' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-27T07:38:17.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-mon[36179]: osdmap e109: 12 total, 12 up, 12 in 2024-03-27T07:38:17.036 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:16 smithi153 ceph-mon[36179]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-03-27T07:38:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:16 smithi082 ceph-mon[32178]: pgmap v462: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 6 op/s 2024-03-27T07:38:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:16 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/74183962' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-27T07:38:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:16 smithi082 ceph-mon[32178]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-27T07:38:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:16 smithi082 ceph-mon[32178]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-27T07:38:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:16 smithi082 ceph-mon[32178]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-03-27T07:38:17.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:16 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/74183962' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-27T07:38:17.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:16 smithi082 ceph-mon[32178]: osdmap e109: 12 total, 12 up, 12 in 2024-03-27T07:38:17.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:16 smithi082 ceph-mon[32178]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-03-27T07:38:17.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.384+0000 7f383ffff640 1 -- 172.21.15.82:0/896160361 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7f384800d040 con 0x7f385810e3a0 2024-03-27T07:38:17.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 -- 172.21.15.82:0/896160361 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f38400a3950 msgr2=0x7f38400a5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:17.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f38400a3950 0x7f38400a5e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f384c005fd0 tx=0x7f384c005850 comp rx=0 tx=0).stop 2024-03-27T07:38:17.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 -- 172.21.15.82:0/896160361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385810e3a0 msgr2=0x7f38581a7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:17.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385810e3a0 0x7f38581a7230 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f384800b450 tx=0x7f384800b910 comp rx=0 tx=0).stop 2024-03-27T07:38:17.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 -- 172.21.15.82:0/896160361 shutdown_connections 2024-03-27T07:38:17.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f38400a3950 0x7f38400a5e10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:17.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3858110370 0x7f38581a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:17.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f385811b330 0x7f38581abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:17.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 --2- 172.21.15.82:0/896160361 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f385810e3a0 0x7f38581a7230 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:17.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 -- 172.21.15.82:0/896160361 >> 172.21.15.82:0/896160361 conn(0x7f385806cc30 msgr2=0x7f3858072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:17.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 -- 172.21.15.82:0/896160361 shutdown_connections 2024-03-27T07:38:17.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.387+0000 7f385d023640 1 -- 172.21.15.82:0/896160361 wait complete. 2024-03-27T07:38:17.402 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-27T07:38:17.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.582+0000 7fb82156c640 1 -- 172.21.15.82:0/4064692754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb81c10e680 msgr2=0x7fb81c10ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:17.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.582+0000 7fb82156c640 1 --2- 172.21.15.82:0/4064692754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb81c10e680 0x7fb81c10ea60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb814009890 tx=0x7fb81402bb90 comp rx=0 tx=0).stop 2024-03-27T07:38:17.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.583+0000 7fb82156c640 1 -- 172.21.15.82:0/4064692754 shutdown_connections 2024-03-27T07:38:17.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.583+0000 7fb82156c640 1 --2- 172.21.15.82:0/4064692754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81c109510 0x7fb81c115400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:17.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.583+0000 7fb82156c640 1 --2- 172.21.15.82:0/4064692754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb81c108b50 0x7fb81c108fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:17.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.583+0000 7fb82156c640 1 --2- 172.21.15.82:0/4064692754 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb81c10e680 0x7fb81c10ea60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:17.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.583+0000 7fb82156c640 1 -- 172.21.15.82:0/4064692754 >> 172.21.15.82:0/4064692754 conn(0x7fb81c06cc30 msgr2=0x7fb81c06d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:17.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.583+0000 7fb82156c640 1 -- 172.21.15.82:0/4064692754 shutdown_connections 2024-03-27T07:38:17.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.583+0000 7fb82156c640 1 -- 172.21.15.82:0/4064692754 wait complete. 2024-03-27T07:38:17.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb82156c640 1 Processor -- start 2024-03-27T07:38:17.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb82156c640 1 -- start start 2024-03-27T07:38:17.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb82156c640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81c108b50 0x7fb81c1a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:17.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb82156c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb81c109510 0x7fb81c1a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:17.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb82156c640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb81c10e680 0x7fb81c19e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:17.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb82156c640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1184d0 con 0x7fb81c108b50 2024-03-27T07:38:17.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb82156c640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c118350 con 0x7fb81c10e680 2024-03-27T07:38:17.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb82156c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c118650 con 0x7fb81c109510 2024-03-27T07:38:17.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb81b7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb81c10e680 0x7fb81c19e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:17.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb81b7fe640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb81c10e680 0x7fb81c19e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.149:3300/0 says I am v2:172.21.15.82:47726/0 (socket says 172.21.15.82:47726) 2024-03-27T07:38:17.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.584+0000 7fb81b7fe640 1 -- 172.21.15.82:0/4268264731 learned_addr learned my addr 172.21.15.82:0/4268264731 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:17.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.585+0000 7fb81a7fc640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb81c109510 0x7fb81c1a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:17.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.585+0000 7fb81b7fe640 1 -- 172.21.15.82:0/4268264731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb81c109510 msgr2=0x7fb81c1a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:17.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.585+0000 7fb81b7fe640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb81c109510 0x7fb81c1a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:17.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.585+0000 7fb81b7fe640 1 -- 172.21.15.82:0/4268264731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81c108b50 msgr2=0x7fb81c1a4700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T07:38:17.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.585+0000 7fb81b7fe640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81c108b50 0x7fb81c1a4700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:17.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.585+0000 7fb81b7fe640 1 -- 172.21.15.82:0/4268264731 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c19f030 con 0x7fb81c10e680 2024-03-27T07:38:17.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.586+0000 7fb81b7fe640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb81c10e680 0x7fb81c19e8b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb804005fd0 tx=0x7fb80400fe60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:17.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.588+0000 7fb813fff640 1 -- 172.21.15.82:0/4268264731 <== mon.2 v2:172.21.15.149:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80401a070 con 0x7fb81c10e680 2024-03-27T07:38:17.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.588+0000 7fb813fff640 1 -- 172.21.15.82:0/4268264731 <== mon.2 v2:172.21.15.149:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb804004220 con 0x7fb81c10e680 2024-03-27T07:38:17.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.588+0000 7fb813fff640 1 -- 172.21.15.82:0/4268264731 <== mon.2 v2:172.21.15.149:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8040035f0 con 0x7fb81c10e680 2024-03-27T07:38:17.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.588+0000 7fb82156c640 1 -- 172.21.15.82:0/4268264731 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c19f320 con 0x7fb81c10e680 2024-03-27T07:38:17.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.588+0000 7fb82156c640 1 -- 172.21.15.82:0/4268264731 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c1ab5c0 con 0x7fb81c10e680 2024-03-27T07:38:17.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.591+0000 7fb82156c640 1 -- 172.21.15.82:0/4268264731 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81c068940 con 0x7fb81c10e680 2024-03-27T07:38:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.593+0000 7fb813fff640 1 -- 172.21.15.82:0/4268264731 <== mon.2 v2:172.21.15.149:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7fb8040089c0 con 0x7fb81c10e680 2024-03-27T07:38:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.594+0000 7fb813fff640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8080a3980 0x7fb8080a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.594+0000 7fb813fff640 1 -- 172.21.15.82:0/4268264731 <== mon.2 v2:172.21.15.149:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 8742+0+0 (secure 0 0 0) 0x7fb8040d35d0 con 0x7fb81c10e680 2024-03-27T07:38:17.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.595+0000 7fb81affd640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8080a3980 0x7fb8080a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:17.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.596+0000 7fb81affd640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8080a3980 0x7fb8080a5e40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb814005b60 tx=0x7fb814000bc0 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:17.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.603+0000 7fb813fff640 1 -- 172.21.15.82:0/4268264731 <== mon.2 v2:172.21.15.149:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb80409fd20 con 0x7fb81c10e680 2024-03-27T07:38:17.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:17.946+0000 7fb82156c640 1 -- 172.21.15.82:0/4268264731 --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb81c02d370 con 0x7fb81c10e680 2024-03-27T07:38:18.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/896160361' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: Cluster is now healthy 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6836/2378161481,v1:172.21.15.153:6837/2378161481] up:boot 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.149:6834/1499108915,v1:172.21.15.149:6836/1499108915] up:boot 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6834/1733401135,v1:172.21.15.153:6835/1733401135] up:boot 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.153:6838/4065170538,v1:172.21.15.153:6839/4065170538] up:boot 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.149:6835/2271323530,v1:172.21.15.149:6837/2271323530] up:boot 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: mds.? [v2:172.21.15.149:6838/2799143027,v1:172.21.15.149:6839/2799143027] up:boot 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: fsmap 12 up:standby 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T07:38:18.185 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:38:18.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T07:38:18.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T07:38:18.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T07:38:18.186 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:17 smithi082 ceph-mon[32178]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/896160361' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: Cluster is now healthy 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6836/2378161481,v1:172.21.15.153:6837/2378161481] up:boot 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.149:6834/1499108915,v1:172.21.15.149:6836/1499108915] up:boot 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6834/1733401135,v1:172.21.15.153:6835/1733401135] up:boot 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.153:6838/4065170538,v1:172.21.15.153:6839/4065170538] up:boot 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.149:6835/2271323530,v1:172.21.15.149:6837/2271323530] up:boot 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: mds.? [v2:172.21.15.149:6838/2799143027,v1:172.21.15.149:6839/2799143027] up:boot 2024-03-27T07:38:18.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: fsmap 12 up:standby 2024-03-27T07:38:18.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T07:38:18.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:38:18.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T07:38:18.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T07:38:18.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T07:38:18.253 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:17 smithi149 ceph-mon[36065]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/896160361' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: Cluster is now healthy 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6836/2378161481,v1:172.21.15.153:6837/2378161481] up:boot 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.149:6834/1499108915,v1:172.21.15.149:6836/1499108915] up:boot 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6834/1733401135,v1:172.21.15.153:6835/1733401135] up:boot 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.153:6838/4065170538,v1:172.21.15.153:6839/4065170538] up:boot 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.149:6835/2271323530,v1:172.21.15.149:6837/2271323530] up:boot 2024-03-27T07:38:18.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: mds.? [v2:172.21.15.149:6838/2799143027,v1:172.21.15.149:6839/2799143027] up:boot 2024-03-27T07:38:18.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: fsmap 12 up:standby 2024-03-27T07:38:18.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T07:38:18.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T07:38:18.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T07:38:18.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T07:38:18.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T07:38:18.286 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:17 smithi153 ceph-mon[36179]: from='mgr.15273 172.21.15.82:0/750709691' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T07:38:18.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.912+0000 7fb813fff640 1 -- 172.21.15.82:0/4268264731 <== mon.2 v2:172.21.15.149:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v110) ==== 181+0+0 (secure 0 0 0) 0x7fb80409f620 con 0x7fb81c10e680 2024-03-27T07:38:18.911 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-03-27T07:38:18.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.915+0000 7fb82156c640 1 -- 172.21.15.82:0/4268264731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8080a3980 msgr2=0x7fb8080a5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:18.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.915+0000 7fb82156c640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8080a3980 0x7fb8080a5e40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb814005b60 tx=0x7fb814000bc0 comp rx=0 tx=0).stop 2024-03-27T07:38:18.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.915+0000 7fb82156c640 1 -- 172.21.15.82:0/4268264731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb81c10e680 msgr2=0x7fb81c19e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:18.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.915+0000 7fb82156c640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb81c10e680 0x7fb81c19e8b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb804005fd0 tx=0x7fb80400fe60 comp rx=0 tx=0).stop 2024-03-27T07:38:18.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.915+0000 7fb82156c640 1 -- 172.21.15.82:0/4268264731 shutdown_connections 2024-03-27T07:38:18.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.915+0000 7fb82156c640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7fb8080a3980 0x7fb8080a5e40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:18.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.915+0000 7fb82156c640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7fb81c10e680 0x7fb81c19e8b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:18.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.915+0000 7fb82156c640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb81c109510 0x7fb81c1a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:18.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.915+0000 7fb82156c640 1 --2- 172.21.15.82:0/4268264731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb81c108b50 0x7fb81c1a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.915+0000 7fb82156c640 1 -- 172.21.15.82:0/4268264731 >> 172.21.15.82:0/4268264731 conn(0x7fb81c06cc30 msgr2=0x7fb81c072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.916+0000 7fb82156c640 1 -- 172.21.15.82:0/4268264731 shutdown_connections 2024-03-27T07:38:18.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:18.916+0000 7fb82156c640 1 -- 172.21.15.82:0/4268264731 wait complete. 2024-03-27T07:38:18.932 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-27T07:38:19.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.130+0000 7f8cc0113640 1 -- 172.21.15.82:0/389974092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb80ffc20 msgr2=0x7f8cb8100000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:19.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.130+0000 7f8cc0113640 1 --2- 172.21.15.82:0/389974092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb80ffc20 0x7f8cb8100000 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8cb401a910 tx=0x7f8cb403cc90 comp rx=0 tx=0).stop 2024-03-27T07:38:19.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.132+0000 7f8cc0113640 1 -- 172.21.15.82:0/389974092 shutdown_connections 2024-03-27T07:38:19.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.132+0000 7f8cc0113640 1 --2- 172.21.15.82:0/389974092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cb8100540 0x7f8cb8112400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:19.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.132+0000 7f8cc0113640 1 --2- 172.21.15.82:0/389974092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cb8112940 0x7f8cb8114d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:19.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.132+0000 7f8cc0113640 1 --2- 172.21.15.82:0/389974092 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb80ffc20 0x7f8cb8100000 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:19.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.132+0000 7f8cc0113640 1 -- 172.21.15.82:0/389974092 >> 172.21.15.82:0/389974092 conn(0x7f8cb8076ba0 msgr2=0x7f8cb80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:19.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.135+0000 7f8cc0113640 1 -- 172.21.15.82:0/389974092 shutdown_connections 2024-03-27T07:38:19.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.136+0000 7f8cc0113640 1 -- 172.21.15.82:0/389974092 wait complete. 2024-03-27T07:38:19.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.136+0000 7f8cc0113640 1 Processor -- start 2024-03-27T07:38:19.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.136+0000 7f8cc0113640 1 -- start start 2024-03-27T07:38:19.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cc0113640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cb80ffc20 0x7f8cb8112070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:19.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cc0113640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cb8100540 0x7f8cb810e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:19.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cc0113640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb8112940 0x7f8cb810e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:19.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cc0113640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb810a620 con 0x7f8cb80ffc20 2024-03-27T07:38:19.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cc0113640 1 -- --> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb810a4a0 con 0x7f8cb8112940 2024-03-27T07:38:19.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cc0113640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb810a7a0 con 0x7f8cb8100540 2024-03-27T07:38:19.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cbd6ae640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cb8100540 0x7f8cb810e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:19.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cbdeaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cb80ffc20 0x7f8cb8112070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:19.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cbe6b0640 1 --2- >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb8112940 0x7f8cb810e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:19.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cbdeaf640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cb80ffc20 0x7f8cb8112070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36680/0 (socket says 172.21.15.82:36680) 2024-03-27T07:38:19.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.137+0000 7f8cbdeaf640 1 -- 172.21.15.82:0/4079668314 learned_addr learned my addr 172.21.15.82:0/4079668314 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-03-27T07:38:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.138+0000 7f8cbdeaf640 1 -- 172.21.15.82:0/4079668314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cb8100540 msgr2=0x7f8cb810e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.138+0000 7f8cbdeaf640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cb8100540 0x7f8cb810e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.138+0000 7f8cbdeaf640 1 -- 172.21.15.82:0/4079668314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb8112940 msgr2=0x7f8cb810e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:19.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.138+0000 7f8cbdeaf640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb8112940 0x7f8cb810e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.138+0000 7f8cbdeaf640 1 -- 172.21.15.82:0/4079668314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb810ed90 con 0x7f8cb80ffc20 2024-03-27T07:38:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.138+0000 7f8cbd6ae640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cb8100540 0x7f8cb810e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T07:38:19.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.138+0000 7f8cbdeaf640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cb80ffc20 0x7f8cb8112070 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8cb403d2a0 tx=0x7f8cb4005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.139+0000 7f8caeffd640 1 -- 172.21.15.82:0/4079668314 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4052020 con 0x7f8cb80ffc20 2024-03-27T07:38:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.139+0000 7f8cc0113640 1 -- 172.21.15.82:0/4079668314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb806b570 con 0x7f8cb80ffc20 2024-03-27T07:38:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.139+0000 7f8cc0113640 1 -- 172.21.15.82:0/4079668314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb806bb40 con 0x7f8cb80ffc20 2024-03-27T07:38:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.140+0000 7f8caeffd640 1 -- 172.21.15.82:0/4079668314 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8cb4004490 con 0x7f8cb80ffc20 2024-03-27T07:38:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.141+0000 7f8caeffd640 1 -- 172.21.15.82:0/4079668314 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb404e480 con 0x7f8cb80ffc20 2024-03-27T07:38:19.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.142+0000 7f8cc0113640 1 -- 172.21.15.82:0/4079668314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c9c005290 con 0x7f8cb80ffc20 2024-03-27T07:38:19.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.145+0000 7f8caeffd640 1 -- 172.21.15.82:0/4079668314 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) ==== 138501+0+0 (secure 0 0 0) 0x7f8cb4055020 con 0x7f8cb80ffc20 2024-03-27T07:38:19.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.146+0000 7f8caeffd640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8ca40a3860 0x7f8ca40a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T07:38:19.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.146+0000 7f8caeffd640 1 -- 172.21.15.82:0/4079668314 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 8188+0+0 (secure 0 0 0) 0x7f8cb4102cf0 con 0x7f8cb80ffc20 2024-03-27T07:38:19.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.147+0000 7f8cbd6ae640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8ca40a3860 0x7f8ca40a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T07:38:19.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.148+0000 7f8cbd6ae640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8ca40a3860 0x7f8ca40a5d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8cb810f8c0 tx=0x7f8ca8008040 comp rx=0 tx=0).ready entity=mgr.15273 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T07:38:19.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.155+0000 7f8caeffd640 1 -- 172.21.15.82:0/4079668314 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8cb405c020 con 0x7f8cb80ffc20 2024-03-27T07:38:19.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:18 smithi082 ceph-mon[32178]: pgmap v464: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-03-27T07:38:19.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:18 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4268264731' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-27T07:38:19.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:18 smithi082 ceph-mon[32178]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-27T07:38:19.251 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:18 smithi149 ceph-mon[36065]: pgmap v464: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-03-27T07:38:19.251 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:18 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4268264731' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-27T07:38:19.251 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:18 smithi149 ceph-mon[36065]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-27T07:38:19.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:18 smithi153 ceph-mon[36179]: pgmap v464: 97 pgs: 22 active+clean+snaptrim, 42 active+clean+snaptrim_wait, 33 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-03-27T07:38:19.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:18 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4268264731' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-27T07:38:19.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:18 smithi153 ceph-mon[36179]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-27T07:38:19.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.499+0000 7f8cc0113640 1 -- 172.21.15.82:0/4079668314 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8c9c005580 con 0x7f8cb80ffc20 2024-03-27T07:38:19.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.919+0000 7f8caeffd640 1 -- 172.21.15.82:0/4079668314 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v111) ==== 169+0+0 (secure 0 0 0) 0x7f8cb4004ff0 con 0x7f8cb80ffc20 2024-03-27T07:38:19.918 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-03-27T07:38:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 -- 172.21.15.82:0/4079668314 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8ca40a3860 msgr2=0x7f8ca40a5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8ca40a3860 0x7f8ca40a5d20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8cb810f8c0 tx=0x7f8ca8008040 comp rx=0 tx=0).stop 2024-03-27T07:38:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 -- 172.21.15.82:0/4079668314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cb80ffc20 msgr2=0x7f8cb8112070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T07:38:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cb80ffc20 0x7f8cb8112070 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f8cb403d2a0 tx=0x7f8cb4005770 comp rx=0 tx=0).stop 2024-03-27T07:38:19.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 -- 172.21.15.82:0/4079668314 shutdown_connections 2024-03-27T07:38:19.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.82:6800/573513718,v1:172.21.15.82:6801/573513718] conn(0x7f8ca40a3860 0x7f8ca40a5d20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:19.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.149:3300/0,v1:172.21.15.149:6789/0] conn(0x7f8cb8112940 0x7f8cb810e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:19.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8cb8100540 0x7f8cb810e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:19.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 --2- 172.21.15.82:0/4079668314 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8cb80ffc20 0x7f8cb8112070 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T07:38:19.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 -- 172.21.15.82:0/4079668314 >> 172.21.15.82:0/4079668314 conn(0x7f8cb8076ba0 msgr2=0x7f8cb8107110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T07:38:19.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 -- 172.21.15.82:0/4079668314 shutdown_connections 2024-03-27T07:38:19.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-03-27T07:38:19.923+0000 7f8cc0113640 1 -- 172.21.15.82:0/4079668314 wait complete. 2024-03-27T07:38:19.940 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T07:38:19.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T07:38:20.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T07:38:20.154 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-27T07:38:20.154 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-27T07:38:20.174 DEBUG:teuthology.orchestra.run.smithi149:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-27T07:38:20.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:19 smithi082 ceph-mon[32178]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-27T07:38:20.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:19 smithi082 ceph-mon[32178]: osdmap e110: 12 total, 12 up, 12 in 2024-03-27T07:38:20.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:19 smithi082 ceph-mon[32178]: from='client.? 172.21.15.82:0/4079668314' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-27T07:38:20.191 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-27T07:38:20.213 INFO:tasks.cephadm:Stopping all daemons... 2024-03-27T07:38:20.213 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-27T07:38:20.214 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.a 2024-03-27T07:38:20.251 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:19 smithi149 ceph-mon[36065]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-27T07:38:20.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:19 smithi149 ceph-mon[36065]: osdmap e110: 12 total, 12 up, 12 in 2024-03-27T07:38:20.252 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:19 smithi149 ceph-mon[36065]: from='client.? 172.21.15.82:0/4079668314' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-27T07:38:20.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:19 smithi153 ceph-mon[36179]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-03-27T07:38:20.284 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:19 smithi153 ceph-mon[36179]: osdmap e110: 12 total, 12 up, 12 in 2024-03-27T07:38:20.285 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:19 smithi153 ceph-mon[36179]: from='client.? 172.21.15.82:0/4079668314' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-03-27T07:38:20.619 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:20 smithi082 systemd[1]: Stopping Ceph mon.a for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:38:20.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[32174]: 2024-03-27T07:38:20.620+0000 7fbaff1c5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:38:20.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a[32174]: 2024-03-27T07:38:20.620+0000 7fbaff1c5700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-27T07:38:20.934 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:20 smithi082 podman[100506]: 2024-03-27 07:38:20.650116703 +0000 UTC m=+0.156457807 container died 08307e622ef7c77f8bf2bf7650cb34ae4cda8cccac45c8389970ad8f38076622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS) 2024-03-27T07:38:21.609 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:21 smithi082 podman[100506]: 2024-03-27 07:38:21.334679226 +0000 UTC m=+0.841020330 container cleanup 08307e622ef7c77f8bf2bf7650cb34ae4cda8cccac45c8389970ad8f38076622 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326) 2024-03-27T07:38:21.609 INFO:journalctl@ceph.mon.a.smithi082.stdout:Mar 27 07:38:21 smithi082 bash[100506]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-a 2024-03-27T07:38:21.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.a.service' 2024-03-27T07:38:21.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:38:21.829 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-27T07:38:21.829 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-03-27T07:38:21.829 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.b 2024-03-27T07:38:22.232 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:21 smithi149 systemd[1]: Stopping Ceph mon.b for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:38:22.501 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-b[36061]: 2024-03-27T07:38:22.233+0000 7fd9b5c86700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:38:22.502 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-b[36061]: 2024-03-27T07:38:22.233+0000 7fd9b5c86700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-27T07:38:22.502 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:22 smithi149 podman[73199]: 2024-03-27 07:38:22.45882712 +0000 UTC m=+0.356365441 container died 151efc33b67e94141ebcdd323b15baa6e02a2324dc6c49ae86ea7246cc6e9f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux ) 2024-03-27T07:38:23.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:22 smithi149 podman[73199]: 2024-03-27 07:38:22.847910604 +0000 UTC m=+0.745448918 container cleanup 151efc33b67e94141ebcdd323b15baa6e02a2324dc6c49ae86ea7246cc6e9f72 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T07:38:23.001 INFO:journalctl@ceph.mon.b.smithi149.stdout:Mar 27 07:38:22 smithi149 bash[73199]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-b 2024-03-27T07:38:23.266 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.b.service' 2024-03-27T07:38:23.321 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:38:23.321 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-03-27T07:38:23.321 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-03-27T07:38:23.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.c 2024-03-27T07:38:23.660 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:23 smithi153 systemd[1]: Stopping Ceph mon.c for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:38:23.975 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-c[36175]: 2024-03-27T07:38:23.660+0000 7f36d46dd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:38:23.975 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-c[36175]: 2024-03-27T07:38:23.660+0000 7f36d46dd700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-27T07:38:23.975 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:23 smithi153 podman[74684]: 2024-03-27 07:38:23.71268633 +0000 UTC m=+0.188770705 container died 67f5b30c380a0d36f2a08a450100bfcbb04765ec99f13bbebfd87ad28a0da5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-c, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True) 2024-03-27T07:38:24.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:24 smithi153 podman[74684]: 2024-03-27 07:38:24.23770192 +0000 UTC m=+0.713786322 container cleanup 67f5b30c380a0d36f2a08a450100bfcbb04765ec99f13bbebfd87ad28a0da5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-c, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:38:24.534 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:24 smithi153 bash[74684]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-c 2024-03-27T07:38:24.808 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.c.service' 2024-03-27T07:38:24.833 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:24 smithi153 podman[74698]: 2024-03-27 07:38:24.581151516 +0000 UTC m=+0.871496748 container remove 67f5b30c380a0d36f2a08a450100bfcbb04765ec99f13bbebfd87ad28a0da5ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mon-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-27T07:38:24.833 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:24 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.c.service: Deactivated successfully. 2024-03-27T07:38:24.833 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:24 smithi153 systemd[1]: Stopped Ceph mon.c for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:38:24.833 INFO:journalctl@ceph.mon.c.smithi153.stdout:Mar 27 07:38:24 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mon.c.service: Consumed 13.823s CPU time. 2024-03-27T07:38:24.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:38:24.869 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-03-27T07:38:24.869 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-27T07:38:24.870 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.x 2024-03-27T07:38:25.184 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:38:24 smithi082 systemd[1]: Stopping Ceph mgr.x for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:38:25.666 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:38:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:38:25.349+0000 7faa3403c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:38:25.666 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:38:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x[32407]: 2024-03-27T07:38:25.349+0000 7faa3403c700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-27T07:38:25.666 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:38:25 smithi082 podman[100625]: 2024-03-27 07:38:25.381454362 +0000 UTC m=+0.312000729 container died 80c360a9ab6e37db9bd960294010a5a961564d0880d6eaf62f9dc32094ef149e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD) 2024-03-27T07:38:25.934 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:38:25 smithi082 podman[100625]: 2024-03-27 07:38:25.76804251 +0000 UTC m=+0.698588923 container cleanup 80c360a9ab6e37db9bd960294010a5a961564d0880d6eaf62f9dc32094ef149e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-27T07:38:25.934 INFO:journalctl@ceph.mgr.x.smithi082.stdout:Mar 27 07:38:25 smithi082 bash[100625]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-x 2024-03-27T07:38:26.189 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.x.service' 2024-03-27T07:38:26.226 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:38:26.226 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-27T07:38:26.226 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-27T07:38:26.226 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.y 2024-03-27T07:38:26.562 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:38:26 smithi149 systemd[1]: Stopping Ceph mgr.y for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:38:26.978 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:38:26 smithi149 podman[73320]: 2024-03-27 07:38:26.565129907 +0000 UTC m=+0.150321500 container died da6bb59530ec836b57fa598686313b2c2de3569d9777d2eba903046a054acd6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:38:27.251 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:38:27 smithi149 podman[73320]: 2024-03-27 07:38:27.120664157 +0000 UTC m=+0.705855744 container cleanup da6bb59530ec836b57fa598686313b2c2de3569d9777d2eba903046a054acd6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-03-27T07:38:27.251 INFO:journalctl@ceph.mgr.y.smithi149.stdout:Mar 27 07:38:27 smithi149 bash[73320]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-y 2024-03-27T07:38:27.528 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.y.service' 2024-03-27T07:38:27.566 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:38:27.566 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-27T07:38:27.566 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-03-27T07:38:27.567 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.z 2024-03-27T07:38:27.927 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:38:27 smithi153 systemd[1]: Stopping Ceph mgr.z for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:38:28.250 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:38:27 smithi153 podman[74815]: 2024-03-27 07:38:27.930297017 +0000 UTC m=+0.170454904 container died 507ac8682273e4eca07609328f46b4a92ef60a45a23d81ef26eb17fa9bc7804b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, io.buildah.version=1.33.5) 2024-03-27T07:38:28.534 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:38:28 smithi153 podman[74815]: 2024-03-27 07:38:28.359862609 +0000 UTC m=+0.600020447 container cleanup 507ac8682273e4eca07609328f46b4a92ef60a45a23d81ef26eb17fa9bc7804b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T07:38:28.534 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:38:28 smithi153 bash[74815]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z 2024-03-27T07:38:28.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.z.service' 2024-03-27T07:38:28.859 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:38:28 smithi153 podman[74830]: 2024-03-27 07:38:28.611646942 +0000 UTC m=+0.672531773 container remove 507ac8682273e4eca07609328f46b4a92ef60a45a23d81ef26eb17fa9bc7804b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mgr-z, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-27T07:38:28.859 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:38:28 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-03-27T07:38:28.859 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:38:28 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.z.service: Failed with result 'exit-code'. 2024-03-27T07:38:28.859 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:38:28 smithi153 systemd[1]: Stopped Ceph mgr.z for 604548c2-ec09-11ee-95d0-87774f69a715. 2024-03-27T07:38:28.859 INFO:journalctl@ceph.mgr.z.smithi153.stdout:Mar 27 07:38:28 smithi153 systemd[1]: ceph-604548c2-ec09-11ee-95d0-87774f69a715@mgr.z.service: Consumed 20.777s CPU time. 2024-03-27T07:38:28.874 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:38:28.874 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-03-27T07:38:28.874 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-27T07:38:28.874 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.0 2024-03-27T07:38:29.184 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:28 smithi082 systemd[1]: Stopping Ceph osd.0 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:38:30.184 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0[47213]: 2024-03-27T07:38:29.797+0000 7fcd40937700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:38:30.184 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0[47213]: 2024-03-27T07:38:29.797+0000 7fcd40937700 -1 osd.0 111 *** Got signal Terminated *** 2024-03-27T07:38:30.184 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0[47213]: 2024-03-27T07:38:29.797+0000 7fcd40937700 -1 osd.0 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:38:35.679 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:35 smithi082 podman[100746]: 2024-03-27 07:38:35.325592895 +0000 UTC m=+6.260052708 container died 308d3b29d7d9996f631b65ad7b0f7bdf14041ce67a727fd416ab3b799314afdb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:38:35.934 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:35 smithi082 podman[100746]: 2024-03-27 07:38:35.773273836 +0000 UTC m=+6.707733648 container cleanup 308d3b29d7d9996f631b65ad7b0f7bdf14041ce67a727fd416ab3b799314afdb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:38:35.934 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:35 smithi082 bash[100746]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0 2024-03-27T07:38:36.434 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:35 smithi082 podman[100763]: 2024-03-27 07:38:35.991549958 +0000 UTC m=+0.658550835 container remove 308d3b29d7d9996f631b65ad7b0f7bdf14041ce67a727fd416ab3b799314afdb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-27T07:38:36.768 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:36 smithi082 podman[100857]: 2024-03-27 07:38:36.340333996 +0000 UTC m=+0.017594405 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:38:36.768 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:36 smithi082 podman[100857]: 2024-03-27 07:38:36.492440822 +0000 UTC m=+0.169701217 container create fe01d191d52420e6405a30cf0a8b7bd01babed7ebe7723ab5ee613351b64474f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-27T07:38:36.768 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:36 smithi082 podman[100857]: 2024-03-27 07:38:36.770311444 +0000 UTC m=+0.447571840 container init fe01d191d52420e6405a30cf0a8b7bd01babed7ebe7723ab5ee613351b64474f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-03-27T07:38:37.061 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:36 smithi082 podman[100857]: 2024-03-27 07:38:36.773660342 +0000 UTC m=+0.450920741 container start fe01d191d52420e6405a30cf0a8b7bd01babed7ebe7723ab5ee613351b64474f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326) 2024-03-27T07:38:37.061 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:36 smithi082 podman[100857]: 2024-03-27 07:38:36.870591643 +0000 UTC m=+0.547852059 container attach fe01d191d52420e6405a30cf0a8b7bd01babed7ebe7723ab5ee613351b64474f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True) 2024-03-27T07:38:37.350 INFO:journalctl@ceph.osd.0.smithi082.stdout:Mar 27 07:38:37 smithi082 podman[100857]: 2024-03-27 07:38:37.064715919 +0000 UTC m=+0.741976321 container died fe01d191d52420e6405a30cf0a8b7bd01babed7ebe7723ab5ee613351b64474f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-0-deactivate, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:38:37.813 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.0.service' 2024-03-27T07:38:37.854 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:38:37.854 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-27T07:38:37.854 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-27T07:38:37.854 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.1 2024-03-27T07:38:38.182 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:37 smithi149 systemd[1]: Stopping Ceph osd.1 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:38:38.501 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:38 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1[40661]: 2024-03-27T07:38:38.184+0000 7f35ceab0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:38:38.501 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:38 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1[40661]: 2024-03-27T07:38:38.184+0000 7f35ceab0700 -1 osd.1 111 *** Got signal Terminated *** 2024-03-27T07:38:38.501 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:38 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1[40661]: 2024-03-27T07:38:38.184+0000 7f35ceab0700 -1 osd.1 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:38:43.933 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:43 smithi149 podman[73443]: 2024-03-27 07:38:43.60780688 +0000 UTC m=+5.547323833 container died 942294ae74d090330e260640f49ef2f4861fe3e91c6522aa073af8d7e0b6fddf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-27T07:38:44.251 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:44 smithi149 podman[73443]: 2024-03-27 07:38:44.043763643 +0000 UTC m=+5.983280569 container cleanup 942294ae74d090330e260640f49ef2f4861fe3e91c6522aa073af8d7e0b6fddf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-03-27T07:38:44.251 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:44 smithi149 bash[73443]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1 2024-03-27T07:38:44.680 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:44 smithi149 podman[73460]: 2024-03-27 07:38:44.278401098 +0000 UTC m=+0.659142384 container remove 942294ae74d090330e260640f49ef2f4861fe3e91c6522aa073af8d7e0b6fddf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1, ceph=True, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T07:38:45.001 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:44 smithi149 podman[73551]: 2024-03-27 07:38:44.586341847 +0000 UTC m=+0.017912771 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:38:45.001 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:44 smithi149 podman[73551]: 2024-03-27 07:38:44.754661512 +0000 UTC m=+0.186232424 container create 730cdc90b01e3a59c170ed325f8301c3b0bfccf520512c6775b0f1f66cf3013a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-27T07:38:45.264 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:45 smithi149 podman[73551]: 2024-03-27 07:38:45.075117813 +0000 UTC m=+0.506688741 container init 730cdc90b01e3a59c170ed325f8301c3b0bfccf520512c6775b0f1f66cf3013a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_CLEAN=True) 2024-03-27T07:38:45.264 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:45 smithi149 podman[73551]: 2024-03-27 07:38:45.078674242 +0000 UTC m=+0.510245156 container start 730cdc90b01e3a59c170ed325f8301c3b0bfccf520512c6775b0f1f66cf3013a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240326) 2024-03-27T07:38:45.751 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:45 smithi149 podman[73551]: 2024-03-27 07:38:45.266943404 +0000 UTC m=+0.698514368 container attach 730cdc90b01e3a59c170ed325f8301c3b0bfccf520512c6775b0f1f66cf3013a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS) 2024-03-27T07:38:46.251 INFO:journalctl@ceph.osd.1.smithi149.stdout:Mar 27 07:38:45 smithi149 podman[73551]: 2024-03-27 07:38:45.990155605 +0000 UTC m=+1.421726519 container died 730cdc90b01e3a59c170ed325f8301c3b0bfccf520512c6775b0f1f66cf3013a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-1-deactivate, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-27T07:38:46.671 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.1.service' 2024-03-27T07:38:46.713 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:38:46.713 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-27T07:38:46.713 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-27T07:38:46.713 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.2 2024-03-27T07:38:47.034 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:46 smithi153 systemd[1]: Stopping Ceph osd.2 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:38:47.534 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:47 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2[41532]: 2024-03-27T07:38:47.063+0000 7f21909d7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:38:47.534 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:47 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2[41532]: 2024-03-27T07:38:47.063+0000 7f21909d7700 -1 osd.2 111 *** Got signal Terminated *** 2024-03-27T07:38:47.534 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:47 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2[41532]: 2024-03-27T07:38:47.063+0000 7f21909d7700 -1 osd.2 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:38:52.980 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:52 smithi153 podman[74939]: 2024-03-27 07:38:52.66411925 +0000 UTC m=+5.751558132 container died 788f0596478bfa1f60b985c5b497708b8f313451b7586f93caffa1f2646ce02a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-27T07:38:53.284 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:53 smithi153 podman[74939]: 2024-03-27 07:38:53.089147803 +0000 UTC m=+6.176586673 container cleanup 788f0596478bfa1f60b985c5b497708b8f313451b7586f93caffa1f2646ce02a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T07:38:53.284 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:53 smithi153 bash[74939]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2 2024-03-27T07:38:53.692 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:53 smithi153 podman[74956]: 2024-03-27 07:38:53.382686929 +0000 UTC m=+0.698925465 container remove 788f0596478bfa1f60b985c5b497708b8f313451b7586f93caffa1f2646ce02a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-27T07:38:53.992 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:53 smithi153 podman[75047]: 2024-03-27 07:38:53.598228268 +0000 UTC m=+0.018406079 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:38:53.992 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:53 smithi153 podman[75047]: 2024-03-27 07:38:53.741859938 +0000 UTC m=+0.162037768 container create 71829516684adcc96131514643d7c5389de4138f59b3ff6d735319cc20ad1363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=) 2024-03-27T07:38:53.992 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:53 smithi153 podman[75047]: 2024-03-27 07:38:53.994926984 +0000 UTC m=+0.415104801 container init 71829516684adcc96131514643d7c5389de4138f59b3ff6d735319cc20ad1363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-27T07:38:54.284 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:53 smithi153 podman[75047]: 2024-03-27 07:38:53.998196805 +0000 UTC m=+0.418374623 container start 71829516684adcc96131514643d7c5389de4138f59b3ff6d735319cc20ad1363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:38:54.284 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:54 smithi153 podman[75047]: 2024-03-27 07:38:54.171493322 +0000 UTC m=+0.591671138 container attach 71829516684adcc96131514643d7c5389de4138f59b3ff6d735319cc20ad1363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:38:54.919 INFO:journalctl@ceph.osd.2.smithi153.stdout:Mar 27 07:38:54 smithi153 podman[75047]: 2024-03-27 07:38:54.656142758 +0000 UTC m=+1.076320575 container died 71829516684adcc96131514643d7c5389de4138f59b3ff6d735319cc20ad1363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0) 2024-03-27T07:38:55.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.2.service' 2024-03-27T07:38:55.358 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:38:55.358 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-27T07:38:55.358 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-27T07:38:55.358 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.3 2024-03-27T07:38:55.684 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:38:55 smithi082 systemd[1]: Stopping Ceph osd.3 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:38:56.104 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:38:55 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3[54171]: 2024-03-27T07:38:55.712+0000 7f51aa7c8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:38:56.104 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:38:55 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3[54171]: 2024-03-27T07:38:55.712+0000 7f51aa7c8700 -1 osd.3 111 *** Got signal Terminated *** 2024-03-27T07:38:56.104 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:38:55 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3[54171]: 2024-03-27T07:38:55.712+0000 7f51aa7c8700 -1 osd.3 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:38:56.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:38:55 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:38:55.843+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:38:56.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:38:56 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:38:56.106+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:38:57.141 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:38:56 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3[54171]: 2024-03-27T07:38:56.872+0000 7f51a6dbc700 -1 osd.3 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:32.274093+0000 front 2024-03-27T07:38:32.274123+0000 (oldest deadline 2024-03-27T07:38:56.374246+0000) 2024-03-27T07:38:57.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:38:56 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:38:56.831+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:38:57.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:38:57 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:38:57.143+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:38:58.157 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:38:57 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3[54171]: 2024-03-27T07:38:57.842+0000 7f51a6dbc700 -1 osd.3 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:32.274093+0000 front 2024-03-27T07:38:32.274123+0000 (oldest deadline 2024-03-27T07:38:56.374246+0000) 2024-03-27T07:38:58.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:38:57 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:38:57.857+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:38:58.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:38:57 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:38:57.835+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:38:58.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:38:58 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:38:58.159+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:38:59.165 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:38:58 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3[54171]: 2024-03-27T07:38:58.794+0000 7f51a6dbc700 -1 osd.3 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:32.274093+0000 front 2024-03-27T07:38:32.274123+0000 (oldest deadline 2024-03-27T07:38:56.374246+0000) 2024-03-27T07:38:59.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:38:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:38:58.858+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:38:59.285 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:38:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:38:58.876+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:38:59.435 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:38:59 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:38:59.167+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:38:59.502 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:38:59 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:38:59.091+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:00.184 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:38:59 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3[54171]: 2024-03-27T07:38:59.804+0000 7f51a6dbc700 -1 osd.3 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:32.274093+0000 front 2024-03-27T07:38:32.274123+0000 (oldest deadline 2024-03-27T07:38:56.374246+0000) 2024-03-27T07:39:00.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:38:59 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:38:59.856+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:00.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:38:59 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:38:59.918+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:00.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:00 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:00.047+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:00.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:00 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:00.209+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:01.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:00.884+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:01.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:00.907+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:01.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:01 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:01.164+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:01.434 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:39:01 smithi082 podman[100974]: 2024-03-27 07:39:01.311478815 +0000 UTC m=+5.759342909 container died df840e210476b37a31134ca522902f9d38bd16a65acd5f2c67347e46e0a2d7a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-27T07:39:01.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:01 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:01.359+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:01.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:01 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:01.068+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:01.934 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:39:01 smithi082 podman[100974]: 2024-03-27 07:39:01.696080574 +0000 UTC m=+6.143944668 container cleanup df840e210476b37a31134ca522902f9d38bd16a65acd5f2c67347e46e0a2d7a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:39:01.934 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:39:01 smithi082 bash[100974]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3 2024-03-27T07:39:02.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:01 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:01.889+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:02.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:01 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:01.947+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:02.308 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:02 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:02.174+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:02.309 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:39:01 smithi082 podman[100991]: 2024-03-27 07:39:01.955569722 +0000 UTC m=+0.647736390 container remove df840e210476b37a31134ca522902f9d38bd16a65acd5f2c67347e46e0a2d7a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-03-27T07:39:02.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:02 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:02.078+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:02.589 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:02 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:02.373+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:02.590 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:39:02 smithi082 podman[101085]: 2024-03-27 07:39:02.215066364 +0000 UTC m=+0.019493262 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:39:02.590 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:39:02 smithi082 podman[101085]: 2024-03-27 07:39:02.340107425 +0000 UTC m=+0.144534313 container create b41e63a347350bd576f64d71e1b0aee51e5bac24307ad2a7fb7d8d33c7dbc9a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-03-27T07:39:02.590 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:39:02 smithi082 podman[101085]: 2024-03-27 07:39:02.592792415 +0000 UTC m=+0.397219302 container init b41e63a347350bd576f64d71e1b0aee51e5bac24307ad2a7fb7d8d33c7dbc9a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5) 2024-03-27T07:39:02.890 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:39:02 smithi082 podman[101085]: 2024-03-27 07:39:02.596337268 +0000 UTC m=+0.400764156 container start b41e63a347350bd576f64d71e1b0aee51e5bac24307ad2a7fb7d8d33c7dbc9a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326) 2024-03-27T07:39:02.890 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:39:02 smithi082 podman[101085]: 2024-03-27 07:39:02.701347178 +0000 UTC m=+0.505774082 container attach b41e63a347350bd576f64d71e1b0aee51e5bac24307ad2a7fb7d8d33c7dbc9a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-03-27T07:39:03.184 INFO:journalctl@ceph.osd.3.smithi082.stdout:Mar 27 07:39:02 smithi082 podman[101085]: 2024-03-27 07:39:02.893022641 +0000 UTC m=+0.697449534 container died b41e63a347350bd576f64d71e1b0aee51e5bac24307ad2a7fb7d8d33c7dbc9a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:39:03.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:02.859+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:03.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:02.943+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:03.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:03 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:03.124+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:03.544 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:03 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:03.394+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:03.544 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:03 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:03.213+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:03.565 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.3.service' 2024-03-27T07:39:03.607 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:39:03.607 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-27T07:39:03.607 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-27T07:39:03.608 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.4 2024-03-27T07:39:03.921 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:03 smithi149 systemd[1]: Stopping Ceph osd.4 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:39:04.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:04 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:04.112+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:04.252 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:03 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4[47648]: 2024-03-27T07:39:03.924+0000 7f1895b35700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:39:04.252 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:03 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4[47648]: 2024-03-27T07:39:03.924+0000 7f1895b35700 -1 osd.4 111 *** Got signal Terminated *** 2024-03-27T07:39:04.252 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:03 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4[47648]: 2024-03-27T07:39:03.924+0000 7f1895b35700 -1 osd.4 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:39:04.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:03 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:03.976+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:04.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:03 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:03.903+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:04.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:04.187+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:04.684 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:04 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:04.365+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:05.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:04 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:04.888+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:05.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:04 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:04.948+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:05.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:05 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:05.158+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:05.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:05 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:05.223+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:05.684 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:05 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:05.385+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:06.001 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:05 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4[47648]: 2024-03-27T07:39:05.901+0000 7f1892129700 -1 osd.4 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:39.976432+0000 front 2024-03-27T07:38:39.976455+0000 (oldest deadline 2024-03-27T07:39:05.276584+0000) 2024-03-27T07:39:06.001 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:05 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:05.662+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:06.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:05 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:05.979+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:06.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:05 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:05.848+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:06.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:05 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:05.848+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:06.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:06 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:06.156+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:06.585 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:06 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:06.406+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:06.585 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:06 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:06.406+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:06.586 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:06 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:06.238+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:06.586 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:06 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:06.238+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:06.874 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:06 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:06.625+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:07.251 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:06 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4[47648]: 2024-03-27T07:39:06.877+0000 7f1892129700 -1 osd.4 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:39.976432+0000 front 2024-03-27T07:38:39.976455+0000 (oldest deadline 2024-03-27T07:39:05.276584+0000) 2024-03-27T07:39:07.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:07 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:07.115+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:07.283 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:06 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:06.992+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:07.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:06 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:06.864+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:07.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:06 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:06.864+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:07.599 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:07 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:07.381+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:07.600 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:07 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:07.381+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:07.600 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:07 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:07.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:07.600 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:07 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:07.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:07.869 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:07 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4[47648]: 2024-03-27T07:39:07.856+0000 7f1892129700 -1 osd.4 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:39.976432+0000 front 2024-03-27T07:38:39.976455+0000 (oldest deadline 2024-03-27T07:39:05.276584+0000) 2024-03-27T07:39:07.870 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:07 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:07.612+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:08.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:08 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:08.110+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:08.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:08 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:08.110+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:08.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:07 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:07.913+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:08.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:07 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:07.913+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:08.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:07 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:07.944+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:08.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:07 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:07.944+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:08.684 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:08 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:08.413+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:08.684 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:08 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:08.413+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:08.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:08 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:08.251+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:08.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:08 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:08.251+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:08.873 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:08 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:08.625+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:09.135 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:08 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4[47648]: 2024-03-27T07:39:08.876+0000 7f1892129700 -1 osd.4 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:39.976432+0000 front 2024-03-27T07:38:39.976455+0000 (oldest deadline 2024-03-27T07:39:05.276584+0000) 2024-03-27T07:39:09.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:08 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:08.935+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:09.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:08 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:08.935+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:09.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:08 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:08.908+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:09.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:08 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:08.908+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:09.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:09 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:09.137+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:09.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:09 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:09.137+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:09.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:09 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:09.246+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:09.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:09 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:09.246+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:09.685 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:09 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:09.373+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:09.685 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:09 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:09.373+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:09.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:09 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:09.388+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:10.001 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:09 smithi149 podman[73673]: 2024-03-27 07:39:09.518316461 +0000 UTC m=+5.722605029 container died a99f2c6025a42f477546abf6234863eba4c4644a289be1c887b35654674215a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2) 2024-03-27T07:39:10.001 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:09 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:09.626+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:10.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:09 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:09.883+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:10.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:09 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:09.883+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:10.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:09 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:09.893+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:10.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:09 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:09.893+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:10.501 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:10 smithi149 podman[73673]: 2024-03-27 07:39:10.399828013 +0000 UTC m=+6.604116576 container cleanup a99f2c6025a42f477546abf6234863eba4c4644a289be1c887b35654674215a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-03-27T07:39:10.501 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:10 smithi149 bash[73673]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4 2024-03-27T07:39:10.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:10 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:10.167+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:10.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:10 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:10.167+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:10.687 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:10 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:10.234+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:10.688 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:10 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:10.234+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:10.688 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:10 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:10.337+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:10.688 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:10 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:10.337+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:10.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:10 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:10.368+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:11.001 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:10 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:10.659+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:11.001 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:10 smithi149 podman[73691]: 2024-03-27 07:39:10.676185307 +0000 UTC m=+1.155099792 container remove a99f2c6025a42f477546abf6234863eba4c4644a289be1c887b35654674215a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:39:11.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:10 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:10.873+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:11.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:10 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:10.873+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:11.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:10 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:10.853+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:11.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:10 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:10.853+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:11.285 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:11 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:11.167+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:11.285 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:11 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:11.167+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:11.285 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:11 smithi149 podman[73783]: 2024-03-27 07:39:10.914098552 +0000 UTC m=+0.018113174 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:39:11.285 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:11 smithi149 podman[73783]: 2024-03-27 07:39:11.052077405 +0000 UTC m=+0.156092026 container create 32c65532566e4fdee62b57d2887eb40e6d90931d0d37897d8b7f74e35c560df1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4-deactivate, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T07:39:11.583 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:11 smithi149 podman[73783]: 2024-03-27 07:39:11.288132917 +0000 UTC m=+0.392147553 container init 32c65532566e4fdee62b57d2887eb40e6d90931d0d37897d8b7f74e35c560df1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-27T07:39:11.584 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:11 smithi149 podman[73783]: 2024-03-27 07:39:11.291394888 +0000 UTC m=+0.395409512 container start 32c65532566e4fdee62b57d2887eb40e6d90931d0d37897d8b7f74e35c560df1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4-deactivate, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-03-27T07:39:11.584 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:11 smithi149 podman[73783]: 2024-03-27 07:39:11.396429635 +0000 UTC m=+0.500444266 container attach 32c65532566e4fdee62b57d2887eb40e6d90931d0d37897d8b7f74e35c560df1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_BRANCH=HEAD) 2024-03-27T07:39:11.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:11 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:11.249+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:11.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:11 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:11.249+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:11.684 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:11 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:11.338+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:11.684 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:11 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:11.338+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:11.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:11 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:11.331+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:11.938 INFO:journalctl@ceph.osd.4.smithi149.stdout:Mar 27 07:39:11 smithi149 podman[73783]: 2024-03-27 07:39:11.587213366 +0000 UTC m=+0.691228015 container died 32c65532566e4fdee62b57d2887eb40e6d90931d0d37897d8b7f74e35c560df1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-4-deactivate, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-27T07:39:11.938 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:11 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:11.688+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:12.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:12 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:12.156+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:12.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:12 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:12.156+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:12.276 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.4.service' 2024-03-27T07:39:12.283 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:11 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:11.825+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:12.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:11 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:11.825+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:12.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:11 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:11.855+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:12.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:11 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:11.855+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:12.317 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:39:12.317 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-27T07:39:12.317 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-27T07:39:12.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.5 2024-03-27T07:39:12.615 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:12 smithi153 systemd[1]: Stopping Ceph osd.5 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:39:12.616 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:12 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:12.355+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:12.683 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:12 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:12.289+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:12.684 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:12 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:12.289+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:12.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:12 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:12.290+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:12.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:12 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:12.290+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:12.889 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:12 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:12.617+0000 7f0702ce1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:39:12.889 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:12 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:12.617+0000 7f0702ce1700 -1 osd.5 111 *** Got signal Terminated *** 2024-03-27T07:39:12.889 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:12 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:12.617+0000 7f0702ce1700 -1 osd.5 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:39:12.889 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:12 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:12.836+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:12.889 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:12 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:12.836+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:13.001 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:12 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:12.728+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:13.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:12 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:12.891+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:13.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:12 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:12.891+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:13.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:13 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:13.113+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:13.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:13 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:13.113+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:13.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:13 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:13.272+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:13.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:13 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:13.272+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:13.684 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:13 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:13.264+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:13.684 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:13 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:13.264+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:13.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:13 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:13.381+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:14.150 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:13 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:13.764+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:14.150 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:13 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:13.764+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:14.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:13 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:13.839+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:14.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:13 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:13.839+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:14.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:13 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:13.887+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:14.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:13 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:13.887+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:14.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:13 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:13.887+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:14.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:14 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:14.153+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:14.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:14 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:14.153+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:14.683 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:14 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:14.219+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:14.684 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:14 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:14.219+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:14.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:14 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:14.300+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:14.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:14 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:14.300+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:14.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:14 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:14.300+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:14.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:14 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:14.381+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:14.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:14 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:14.381+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:15.137 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:14 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:14.807+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:15.138 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:14 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:14.807+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:15.283 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:14 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:14.877+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:15.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:14 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:14.877+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:15.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:14 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:14.877+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:15.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:14 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:14.805+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:15.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:14 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:14.805+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:15.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:14 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:14.805+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.448416+0000 front 2024-03-27T07:38:48.448372+0000 (oldest deadline 2024-03-27T07:39:14.348507+0000) 2024-03-27T07:39:15.433 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:15 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:15.170+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:15.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:15 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:15.170+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:15.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:15 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:15.261+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:15.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:15 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:15.261+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:15.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:15 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:15.261+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:15.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:15 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:15.140+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:15.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:15 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:15.140+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:15.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:15 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:15.424+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:15.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:15 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:15.424+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:16.116 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:15 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:15.830+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:16.116 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:15 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:15.830+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:16.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:15 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:15.833+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:16.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:15 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:15.833+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:16.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:15 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:15.833+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.448416+0000 front 2024-03-27T07:38:48.448372+0000 (oldest deadline 2024-03-27T07:39:14.348507+0000) 2024-03-27T07:39:16.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:15 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:15.829+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:16.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:15 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:15.829+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:16.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:15 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:15.829+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:16.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:16 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:16.148+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:16.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:16 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:16.148+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:16.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:16 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:16.267+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:16.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:16 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:16.267+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:16.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:16 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:16.267+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:16.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:16.118+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:16.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:16.118+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:16.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:16.118+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:16.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:16.437+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:16.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:16.437+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:17.132 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:16.834+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:17.132 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:16 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:16.834+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:17.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:16.859+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.044810+0000 front 2024-03-27T07:38:34.044940+0000 (oldest deadline 2024-03-27T07:38:57.544825+0000) 2024-03-27T07:39:17.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:16.859+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.647273+0000 front 2024-03-27T07:38:42.647224+0000 (oldest deadline 2024-03-27T07:39:05.547267+0000) 2024-03-27T07:39:17.284 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5[48067]: 2024-03-27T07:39:16.859+0000 7f06fb2cd700 -1 osd.5 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.448416+0000 front 2024-03-27T07:38:48.448372+0000 (oldest deadline 2024-03-27T07:39:14.348507+0000) 2024-03-27T07:39:17.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:16.843+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:17.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:16.843+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:17.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:16 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:16.843+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:17.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:17 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:17.148+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:17.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:17 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:17.148+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:17.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:17 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:17.220+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:17.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:17 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:17.220+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:17.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:17 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:17.220+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:17.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:17 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:17.134+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:17.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:17 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:17.134+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:17.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:17 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:17.134+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:17.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:17 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:17.437+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:17.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:17 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:17.437+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:18.180 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:17 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:17.808+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:18.180 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:17 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:17.808+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:18.283 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:18 smithi153 podman[75164]: 2024-03-27 07:39:18.061523811 +0000 UTC m=+5.559477958 container died d3e0ef2bd9ce05f7be8ce6190161d7d25af626b360a3a9a36597859bce8f3d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-27T07:39:18.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:17 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:17.828+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:18.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:17 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:17.828+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:18.284 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:17 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:17.828+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:18.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:18 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:18.256+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:18.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:18 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:18.256+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:18.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:18 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:18.256+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:18.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:18 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:18.179+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:18.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:18 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:18.179+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:18.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:18 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:18.179+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.328395+0000 front 2024-03-27T07:38:51.328446+0000 (oldest deadline 2024-03-27T07:39:17.228349+0000) 2024-03-27T07:39:18.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:18 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:18.182+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:18.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:18 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:18.182+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:18.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:18 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:18.182+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:18.750 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:18 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:18.447+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:18.750 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:18 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:18.447+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:18.750 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:18 smithi153 podman[75164]: 2024-03-27 07:39:18.485134545 +0000 UTC m=+5.983088675 container cleanup d3e0ef2bd9ce05f7be8ce6190161d7d25af626b360a3a9a36597859bce8f3d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-27T07:39:18.750 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:18 smithi153 bash[75164]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5 2024-03-27T07:39:19.033 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:18 smithi153 podman[75181]: 2024-03-27 07:39:18.753191855 +0000 UTC m=+0.685177131 container remove d3e0ef2bd9ce05f7be8ce6190161d7d25af626b360a3a9a36597859bce8f3d77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T07:39:19.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:18 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:18.789+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:19.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:18 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:18.789+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:19.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:18 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:18.789+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:19.162 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:18 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:18.772+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:19.162 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:18 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:18.772+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:19.404 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:19 smithi153 podman[75272]: 2024-03-27 07:39:19.053382725 +0000 UTC m=+0.017965794 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:39:19.404 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:19 smithi153 podman[75272]: 2024-03-27 07:39:19.162446011 +0000 UTC m=+0.127029057 container create d7c116c53c1808131fdd885aa8fe585c427b29e66877f341d3246e9a21bc52e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:39:19.433 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:19 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:19.147+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:19.433 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:19 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:19.147+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:19.433 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:19 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:19.147+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.328395+0000 front 2024-03-27T07:38:51.328446+0000 (oldest deadline 2024-03-27T07:39:17.228349+0000) 2024-03-27T07:39:19.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:19 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:19.285+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:19.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:19 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:19.285+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:19.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:19 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:19.285+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:19.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:19 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:19.163+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:19.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:19 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:19.163+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:19.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:19 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:19.163+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:19.695 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:19 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:19.483+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:19.695 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:19 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:19.483+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:19.695 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:19 smithi153 podman[75272]: 2024-03-27 07:39:19.406977608 +0000 UTC m=+0.371560666 container init d7c116c53c1808131fdd885aa8fe585c427b29e66877f341d3246e9a21bc52e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-03-27T07:39:19.695 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:19 smithi153 podman[75272]: 2024-03-27 07:39:19.410377528 +0000 UTC m=+0.374960573 container start d7c116c53c1808131fdd885aa8fe585c427b29e66877f341d3246e9a21bc52e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:39:19.695 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:19 smithi153 podman[75272]: 2024-03-27 07:39:19.523919317 +0000 UTC m=+0.488502384 container attach d7c116c53c1808131fdd885aa8fe585c427b29e66877f341d3246e9a21bc52e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-27T07:39:20.034 INFO:journalctl@ceph.osd.5.smithi153.stdout:Mar 27 07:39:19 smithi153 podman[75272]: 2024-03-27 07:39:19.698276151 +0000 UTC m=+0.662859215 container died d7c116c53c1808131fdd885aa8fe585c427b29e66877f341d3246e9a21bc52e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-03-27T07:39:20.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:19 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:19.750+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:20.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:19 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:19.750+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:20.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:19 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:19.750+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:20.143 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:19 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:19.793+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:20.143 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:19 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:19.793+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:20.407 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.5.service' 2024-03-27T07:39:20.433 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:20.132+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:20.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:20.132+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:20.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:20.132+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.328395+0000 front 2024-03-27T07:38:51.328446+0000 (oldest deadline 2024-03-27T07:39:17.228349+0000) 2024-03-27T07:39:20.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:20.326+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:20.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:20.326+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:20.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:20.326+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:20.448 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:39:20.448 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-27T07:39:20.448 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-27T07:39:20.449 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.6 2024-03-27T07:39:20.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:20 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:20.145+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:20.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:20 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:20.145+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:20.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:20 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:20.145+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:20.711 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:20.528+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:20.711 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:20.528+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:20.770 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:20 smithi082 systemd[1]: Stopping Ceph osd.6 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:39:21.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:20.712+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:21.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:20.712+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:21.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:20 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:20.712+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:21.094 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:20 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:20.834+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:21.094 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:20 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:20.834+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:21.116 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:20.773+0000 7fb5dd9a4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:39:21.116 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:20.773+0000 7fb5dd9a4700 -1 osd.6 111 *** Got signal Terminated *** 2024-03-27T07:39:21.117 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:20 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:20.773+0000 7fb5dd9a4700 -1 osd.6 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:39:21.117 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:21.119+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:21.117 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:21.119+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:21.117 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:21.119+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.328395+0000 front 2024-03-27T07:38:51.328446+0000 (oldest deadline 2024-03-27T07:39:17.228349+0000) 2024-03-27T07:39:21.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:21.355+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:21.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:21.355+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:21.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:21 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:21.355+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:21.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:21.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:21.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:21.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:21.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:21.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:21.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:21.486+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:21.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:21.486+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:21.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:21.702+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:21.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:21.702+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:21.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:21 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:21.702+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:22.125 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:21.871+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:22.125 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:21.871+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:22.125 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:21 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:21.871+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:22.395 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:22 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:22.133+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:22.395 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:22 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:22.133+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:22.395 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:22 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:22.133+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.328395+0000 front 2024-03-27T07:38:51.328446+0000 (oldest deadline 2024-03-27T07:39:17.228349+0000) 2024-03-27T07:39:22.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:22.126+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:22.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:22.126+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:22.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:22.126+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:22.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:22.127+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:22.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:22 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:22.398+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:22.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:22 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:22.398+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:22.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:22 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:22.398+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:22.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:22.450+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:22.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:22.450+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:22.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:22.671+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:22.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:22.671+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:22.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:22.671+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:22.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:22 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:22.671+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:23.106 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:22.838+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:23.107 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:22.838+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:23.107 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:22 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:22.838+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:23.413 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:23.113+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:23.413 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:23.113+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:23.413 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:23.113+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.328395+0000 front 2024-03-27T07:38:51.328446+0000 (oldest deadline 2024-03-27T07:39:17.228349+0000) 2024-03-27T07:39:23.413 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:23.113+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:59.529283+0000 front 2024-03-27T07:38:59.529325+0000 (oldest deadline 2024-03-27T07:39:23.029471+0000) 2024-03-27T07:39:23.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:23 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:23.109+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:23.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:23 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:23.109+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:23.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:23 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:23.109+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:23.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:23 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:23.109+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:23.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:23.414+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:23.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:23.414+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:23.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:23.414+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:23.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:23.414+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:23.685 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:23.435+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:23.685 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:23.435+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:23.685 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:23.680+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:23.685 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:23.680+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:23.685 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:23.680+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:23.685 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:23 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:23.680+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:24.130 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:23 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:23.816+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:24.131 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:23 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:23.816+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:24.131 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:23 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:23.816+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:24.394 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:24.105+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:24.394 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:24.105+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:24.394 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:24.105+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.328395+0000 front 2024-03-27T07:38:51.328446+0000 (oldest deadline 2024-03-27T07:39:17.228349+0000) 2024-03-27T07:39:24.394 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:24.105+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:59.529283+0000 front 2024-03-27T07:38:59.529325+0000 (oldest deadline 2024-03-27T07:39:23.029471+0000) 2024-03-27T07:39:24.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:24.132+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:24.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:24.132+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:24.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:24.132+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:24.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:24.132+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:24.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:24.396+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:24.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:24.396+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:24.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:24.396+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:24.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:24 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:24.396+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:24.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:24 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:24.430+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:24.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:24 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:24.430+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:24.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:24 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:24.659+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:24.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:24 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:24.659+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:24.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:24 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:24.659+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:24.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:24 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:24.659+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:25.134 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:24.823+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:25.134 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:24.823+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:25.134 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:24 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:24.823+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:25.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:25.372+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:25.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:25.372+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:25.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:25.372+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:25.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:25.372+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:25.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:25.127+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.425402+0000 front 2024-03-27T07:38:34.425435+0000 (oldest deadline 2024-03-27T07:39:00.826122+0000) 2024-03-27T07:39:25.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:25.127+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.826916+0000 front 2024-03-27T07:38:40.826883+0000 (oldest deadline 2024-03-27T07:39:05.526750+0000) 2024-03-27T07:39:25.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:25.127+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.328395+0000 front 2024-03-27T07:38:51.328446+0000 (oldest deadline 2024-03-27T07:39:17.228349+0000) 2024-03-27T07:39:25.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:25 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6[60849]: 2024-03-27T07:39:25.127+0000 7fb5d9f98700 -1 osd.6 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:59.529283+0000 front 2024-03-27T07:38:59.529325+0000 (oldest deadline 2024-03-27T07:39:23.029471+0000) 2024-03-27T07:39:25.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:25.136+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:25.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:25.136+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:25.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:25.136+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:25.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:25.136+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:25.674 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:25.406+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:25.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:25.406+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:25.675 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:25.406+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:26.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:25.677+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:26.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:25.677+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:26.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:25.677+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:26.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:25 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:25.677+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:26.155 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:25.853+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:26.155 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:25.853+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:26.155 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:25 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:25.853+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:26.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:26.157+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:26.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:26.157+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:26.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:26.157+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:26.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:26.157+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:26.529 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:26 smithi082 podman[101204]: 2024-03-27 07:39:26.221564827 +0000 UTC m=+5.573994683 container died fb8a5a8857eaea2cf10612da402ffe35e8120a674975683822d1d3d845012eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-27T07:39:26.529 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:26 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:26.364+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:26.529 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:26 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:26.364+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:26.529 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:26 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:26.364+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:26.529 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:26 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:26.364+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:26.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:26 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:26.399+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:26.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:26 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:26.399+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:26.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:26 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:26.399+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:26.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:26 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:26.634+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:26.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:26 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:26.634+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:26.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:26 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:26.634+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:26.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:26 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:26.634+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:26.854 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:26 smithi082 podman[101204]: 2024-03-27 07:39:26.614715597 +0000 UTC m=+5.967145519 container cleanup fb8a5a8857eaea2cf10612da402ffe35e8120a674975683822d1d3d845012eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0) 2024-03-27T07:39:26.854 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:26 smithi082 bash[101204]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6 2024-03-27T07:39:27.163 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:26 smithi082 podman[101219]: 2024-03-27 07:39:26.857617289 +0000 UTC m=+0.640481869 container remove fb8a5a8857eaea2cf10612da402ffe35e8120a674975683822d1d3d845012eba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:39:27.176 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:26.824+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:27.176 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:26.824+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:27.176 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:26 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:26.824+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:27.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:27 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:27.364+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:27.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:27 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:27.364+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:27.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:27 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:27.364+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:27.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:27 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:27.364+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:27.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:27 smithi082 podman[101313]: 2024-03-27 07:39:27.1666152 +0000 UTC m=+0.103057368 container create 12b344b313c09c666c847020e37108026cc8cabd04bf5377f88679ca8176c24f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:39:27.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:27 smithi082 podman[101313]: 2024-03-27 07:39:27.08099939 +0000 UTC m=+0.017441574 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:39:27.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:27 smithi082 podman[101313]: 2024-03-27 07:39:27.393899236 +0000 UTC m=+0.330341405 container init 12b344b313c09c666c847020e37108026cc8cabd04bf5377f88679ca8176c24f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6-deactivate, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:39:27.434 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:27 smithi082 podman[101313]: 2024-03-27 07:39:27.397017928 +0000 UTC m=+0.333460098 container start 12b344b313c09c666c847020e37108026cc8cabd04bf5377f88679ca8176c24f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6-deactivate, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_CLEAN=True) 2024-03-27T07:39:27.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:27.178+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:27.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:27.178+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:27.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:27.178+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:27.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:27.178+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:27.681 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:27 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:27.420+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:27.681 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:27 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:27.420+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:27.682 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:27 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:27.420+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:27.934 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:27 smithi082 podman[101313]: 2024-03-27 07:39:27.486114548 +0000 UTC m=+0.422556725 container attach 12b344b313c09c666c847020e37108026cc8cabd04bf5377f88679ca8176c24f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6-deactivate, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-27T07:39:27.934 INFO:journalctl@ceph.osd.6.smithi082.stdout:Mar 27 07:39:27 smithi082 podman[101313]: 2024-03-27 07:39:27.684113798 +0000 UTC m=+0.620555968 container died 12b344b313c09c666c847020e37108026cc8cabd04bf5377f88679ca8176c24f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-6-deactivate, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T07:39:28.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:27 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:27.684+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:28.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:27 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:27.684+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:28.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:27 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:27.684+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:28.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:27 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:27.684+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:28.182 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:27.839+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:28.183 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:27.839+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:28.183 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:27.839+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:28.296 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.6.service' 2024-03-27T07:39:28.338 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:39:28.338 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-27T07:39:28.338 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-27T07:39:28.338 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.7 2024-03-27T07:39:28.501 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:28 smithi149 systemd[1]: Stopping Ceph osd.7 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:39:28.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:28.185+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:28.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:28.185+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:28.502 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:28.185+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:28.502 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:28.185+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:28.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:28 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:28.325+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:28.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:28 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:28.325+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:28.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:28 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:28.325+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:28.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:28 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:28.325+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:28.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:28 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:28.425+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:28.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:28 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:28.425+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:28.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:28 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:28.425+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:28.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:28 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:28.667+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:28.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:28 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:28.667+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:28.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:28 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:28.667+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:28.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:28 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:28.667+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:29.001 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:28.651+0000 7fa0daf3f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:39:29.001 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:28.651+0000 7fa0daf3f700 -1 osd.7 111 *** Got signal Terminated *** 2024-03-27T07:39:29.001 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:28.651+0000 7fa0daf3f700 -1 osd.7 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:39:29.001 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:28.860+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:29.001 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:28.860+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:29.001 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:28 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:28.860+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:29.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:29.189+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:29.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:29.189+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:29.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:29.189+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:29.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:29.189+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:29.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:29.318+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:29.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:29.318+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:29.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:29.318+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:29.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:29 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:29.318+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:29.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:29.432+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:29.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:29.432+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:29.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:29.432+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:29.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:29.619+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:29.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:29.619+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:29.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:29.619+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:29.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:29 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:29.619+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:30.195 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:29.882+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:30.195 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:29.882+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:30.195 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:29.882+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:30.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:30 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:30.197+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:30.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:30 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:30.197+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:30.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:30 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:30.197+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:30.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:30 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:30.197+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:30.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:30 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:30.313+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:30.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:30 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:30.314+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:30.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:30 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:30.314+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:30.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:30 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:30.314+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:30.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:30 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:30.406+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:30.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:30 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:30.406+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:30.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:30 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:30.406+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:30.785 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:30 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:30.611+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:30.785 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:30 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:30.611+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:30.785 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:30 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:30.611+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:30.785 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:30 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:30.611+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:30.785 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:30 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:30.611+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:31.225 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:30 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:30.856+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:31.225 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:30 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:30.856+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:31.225 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:30 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:30.856+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:31.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:31 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:31.227+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:31.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:31 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:31.227+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:31.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:31 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:31.227+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:31.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:31 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:31.227+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:31.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:31 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:31.301+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:31.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:31 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:31.301+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:31.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:31 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:31.301+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:31.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:31 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:31.301+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:31.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:31 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:31.301+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:31.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:31.435+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:31.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:31.435+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:31.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:31.435+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:31.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:31.435+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:31.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:31.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:31.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:31.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:31.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:31.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:31.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:31.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:31.785 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:31 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:31.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:32.233 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:31 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:31.869+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:32.233 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:31 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:31.870+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:32.233 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:31 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:31.870+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:32.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:32.235+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:32.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:32.235+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:32.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:32.235+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:32.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:32.235+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:32.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:32.258+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:32.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:32.258+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:32.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:32.258+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:32.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:32.258+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:32.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:32 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:32.258+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:32.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:32.472+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:32.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:32.472+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:32.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:32.472+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:32.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:32.472+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:32.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:32.666+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:32.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:32.666+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:32.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:32.666+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:32.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:32.666+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:32.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:32 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:32.666+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:33.206 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:32.883+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.257185+0000 front 2024-03-27T07:38:42.257232+0000 (oldest deadline 2024-03-27T07:39:05.157271+0000) 2024-03-27T07:39:33.206 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:32.883+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:47.458459+0000 front 2024-03-27T07:38:47.458485+0000 (oldest deadline 2024-03-27T07:39:13.358401+0000) 2024-03-27T07:39:33.206 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:32 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7[54664]: 2024-03-27T07:39:32.883+0000 7fa0d352b700 -1 osd.7 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:39:00.360131+0000 front 2024-03-27T07:39:00.360021+0000 (oldest deadline 2024-03-27T07:39:21.459867+0000) 2024-03-27T07:39:33.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:33 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:33.206+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:33.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:33 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:33.206+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:33.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:33 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:33.206+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:33.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:33 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:33.206+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:33.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:33 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:33.206+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:33.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:33 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:33.226+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:33.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:33 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:33.226+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:33.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:33 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:33.226+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:33.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:33 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:33.226+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:33.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:33 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:33.226+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:33.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:33.467+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:33.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:33.467+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:33.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:33.467+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:33.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:33.467+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:33.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:33.623+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:33.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:33.623+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:33.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:33.623+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:33.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:33.623+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:33.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:33 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:33.623+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:34.501 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:34 smithi149 podman[73891]: 2024-03-27 07:39:34.237529114 +0000 UTC m=+5.706242352 container died 6404ac22b88336a9f1dbebf55c20d337d48a21a1409230140f6e8636003e9294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5) 2024-03-27T07:39:34.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:34 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:34.160+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:34.502 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:34 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:34.160+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:34.502 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:34 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:34.160+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:34.502 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:34 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:34.160+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:34.502 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:34 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:34.160+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:34.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:34 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:34.196+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:34.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:34 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:34.196+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:34.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:34 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:34.196+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:34.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:34 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:34.196+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:34.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:34 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:34.196+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:34.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:34.429+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:34.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:34.429+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:34.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:34.429+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:34.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:34.429+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:34.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:34.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:34.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:34.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:34.785 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:34.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:34.785 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:34.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:34.785 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:34 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:34.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:34.876 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:34 smithi149 podman[73891]: 2024-03-27 07:39:34.618950447 +0000 UTC m=+6.087663676 container cleanup 6404ac22b88336a9f1dbebf55c20d337d48a21a1409230140f6e8636003e9294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-27T07:39:34.876 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:34 smithi149 bash[73891]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7 2024-03-27T07:39:35.130 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:34 smithi149 podman[73908]: 2024-03-27 07:39:34.878896255 +0000 UTC m=+0.645013296 container remove 6404ac22b88336a9f1dbebf55c20d337d48a21a1409230140f6e8636003e9294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-27T07:39:35.398 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:35 smithi149 podman[73999]: 2024-03-27 07:39:35.125880932 +0000 UTC m=+0.017826399 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:39:35.399 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:35 smithi149 podman[73999]: 2024-03-27 07:39:35.271539919 +0000 UTC m=+0.163485375 container create 546e11c3dd6a8c85a19a69f1fca49a0dda454f0351031c46f472fb3405c62ddf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5) 2024-03-27T07:39:35.399 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:35 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:35.133+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:35.399 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:35 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:35.133+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:35.399 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:35 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:35.133+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:35.399 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:35 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:35.133+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:35.399 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:35 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:35.133+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:35.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:35.161+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:35.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:35.161+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:35.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:35.161+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:35.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:35.161+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:35.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:35 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:35.161+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:35.751 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:35 smithi149 podman[73999]: 2024-03-27 07:39:35.524458419 +0000 UTC m=+0.416403895 container init 546e11c3dd6a8c85a19a69f1fca49a0dda454f0351031c46f472fb3405c62ddf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-27T07:39:35.751 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:35 smithi149 podman[73999]: 2024-03-27 07:39:35.527715519 +0000 UTC m=+0.419660990 container start 546e11c3dd6a8c85a19a69f1fca49a0dda454f0351031c46f472fb3405c62ddf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-27T07:39:35.751 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:35 smithi149 podman[73999]: 2024-03-27 07:39:35.623977003 +0000 UTC m=+0.515922469 container attach 546e11c3dd6a8c85a19a69f1fca49a0dda454f0351031c46f472fb3405c62ddf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-27T07:39:35.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:35 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:35.464+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:35.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:35 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:35.464+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:35.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:35 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:35.464+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:35.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:35 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:35.464+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:35.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:35 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:35.679+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:35.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:35 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:35.679+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:35.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:35 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:35.679+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:35.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:35 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:35.679+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:35.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:35 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:35.679+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:36.166 INFO:journalctl@ceph.osd.7.smithi149.stdout:Mar 27 07:39:35 smithi149 podman[73999]: 2024-03-27 07:39:35.833640665 +0000 UTC m=+0.725586126 container died 546e11c3dd6a8c85a19a69f1fca49a0dda454f0351031c46f472fb3405c62ddf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:39:36.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:36 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:36.170+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:36.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:36 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:36.170+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:36.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:36 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:36.170+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:36.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:36 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:36.170+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:36.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:36 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:36.170+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:36.491 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:36 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:36.169+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:36.491 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:36 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:36.169+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:36.491 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:36 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:36.169+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:36.491 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:36 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:36.169+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:36.492 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:36 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:36.169+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:36.505 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.7.service' 2024-03-27T07:39:36.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:39:36.547 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-27T07:39:36.547 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-03-27T07:39:36.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.8 2024-03-27T07:39:36.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:36.513+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:36.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:36.513+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:36.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:36.513+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:36.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:36.513+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:36.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:36 smithi153 systemd[1]: Stopping Ceph osd.8 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:39:36.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:36.638+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:36.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:36.638+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:36.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:36.638+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:36.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:36.638+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:36.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:36.638+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:37.283 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:36.879+0000 7f341f22b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:39:37.283 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:36.879+0000 7f341f22b700 -1 osd.8 111 *** Got signal Terminated *** 2024-03-27T07:39:37.283 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:36 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:36.879+0000 7f341f22b700 -1 osd.8 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:39:37.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:37 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:37.128+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:37.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:37 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:37.128+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:37.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:37 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:37.128+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:37.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:37 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:37.128+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:37.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:37 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:37.128+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:37.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:37 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:37.190+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:37.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:37 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:37.190+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:37.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:37 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:37.190+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:37.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:37 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:37.190+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:37.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:37 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:37.190+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:37.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:37.481+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:37.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:37.481+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:37.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:37.481+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:37.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:37.481+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:37.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:37.689+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:37.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:37.689+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:37.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:37.689+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:37.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:37.689+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:37.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:37 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:37.689+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:38.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:38 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:38.144+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:38.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:38 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:38.144+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:38.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:38 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:38.144+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:38.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:38 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:38.144+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:38.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:38 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:38.144+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:38.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:38 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:38.180+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:38.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:38 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:38.180+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:38.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:38 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:38.180+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:38.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:38 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:38.180+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:38.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:38 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:38.180+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:38.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:38.516+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:38.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:38.516+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:38.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:38.516+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:38.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:38.516+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:38.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:38.666+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:38.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:38.666+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:38.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:38.666+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:38.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:38.666+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:38.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:38 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:38.666+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:39.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:39 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:39.131+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:39.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:39 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:39.131+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:39.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:39 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:39.131+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:39.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:39 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:39.131+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:39.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:39 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:39.131+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:39.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:39 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:39.135+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:39.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:39 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:39.135+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:39.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:39 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:39.135+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:39.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:39 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:39.135+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:39.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:39 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:39.135+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:39.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:39.533+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:39.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:39.533+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:39.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:39.533+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:39.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:39.533+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:39.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:39.533+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:16.387373+0000 front 2024-03-27T07:39:16.387392+0000 (oldest deadline 2024-03-27T07:39:38.687608+0000) 2024-03-27T07:39:39.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:39.647+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:39.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:39.647+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:39.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:39.647+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:39.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:39.647+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:39.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:39 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:39.647+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:40.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:40 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:40.124+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:40.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:40 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:40.124+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:40.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:40 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:40.124+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:40.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:40 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:40.124+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:40.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:40 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:40.124+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:40.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:40 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:40.133+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:40.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:40 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:40.133+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:40.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:40 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:40.133+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:40.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:40 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:40.133+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:40.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:40 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:40.133+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:40.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:40.522+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:40.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:40.522+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:40.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:40.522+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:40.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:40.522+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:40.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:40.522+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:16.387373+0000 front 2024-03-27T07:39:16.387392+0000 (oldest deadline 2024-03-27T07:39:38.687608+0000) 2024-03-27T07:39:40.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:40.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:40.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:40.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:40.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:40.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:40.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:40.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:40.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:40.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:40.785 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:40.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:41.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:41.116+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:41.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:41.116+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:41.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:41.116+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:41.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:41.116+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:41.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:41 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:41.116+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:41.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:41.104+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:41.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:41.104+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:41.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:41.104+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:41.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:41.104+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:41.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:41 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:41.104+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:41.783 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:41.514+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.482119+0000 front 2024-03-27T07:38:42.482093+0000 (oldest deadline 2024-03-27T07:39:08.382214+0000) 2024-03-27T07:39:41.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:41.514+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:48.382739+0000 front 2024-03-27T07:38:48.382753+0000 (oldest deadline 2024-03-27T07:39:13.583502+0000) 2024-03-27T07:39:41.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:41.514+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.884866+0000 front 2024-03-27T07:38:58.884949+0000 (oldest deadline 2024-03-27T07:39:24.784931+0000) 2024-03-27T07:39:41.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:41.514+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.085978+0000 front 2024-03-27T07:39:07.086081+0000 (oldest deadline 2024-03-27T07:39:30.585836+0000) 2024-03-27T07:39:41.784 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8[54642]: 2024-03-27T07:39:41.514+0000 7f341b81f700 -1 osd.8 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:16.387373+0000 front 2024-03-27T07:39:16.387392+0000 (oldest deadline 2024-03-27T07:39:38.687608+0000) 2024-03-27T07:39:41.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:41.626+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:41.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:41.626+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:41.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:41.626+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:41.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:41.626+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:41.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:41.626+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:41.784 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:41 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:41.626+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:42.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:42 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:42.158+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:42.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:42 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:42.158+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:42.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:42 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:42.158+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:42.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:42 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:42.158+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:42.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:42 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:42.158+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:42.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:42 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:42.087+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:42.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:42 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:42.087+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:42.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:42 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:42.087+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:42.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:42 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:42.087+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:42.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:42 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:42.087+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:42.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:42 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:42.087+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:42.708 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:42 smithi153 podman[75377]: 2024-03-27 07:39:42.415534655 +0000 UTC m=+5.672241670 container died 5491f8f33ed630f3cd745b61d42dd01593d24d4d1b65c0b12c92ab9cffd2122d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:39:42.708 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:42 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:42.614+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:42.708 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:42 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:42.614+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:42.708 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:42 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:42.614+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:42.708 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:42 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:42.614+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:42.708 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:42 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:42.614+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:42.708 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:42 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:42.614+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:43.033 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:42 smithi153 podman[75377]: 2024-03-27 07:39:42.796427053 +0000 UTC m=+6.053134070 container cleanup 5491f8f33ed630f3cd745b61d42dd01593d24d4d1b65c0b12c92ab9cffd2122d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:39:43.034 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:42 smithi153 bash[75377]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8 2024-03-27T07:39:43.403 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:43 smithi153 podman[75395]: 2024-03-27 07:39:43.080891863 +0000 UTC m=+0.658086378 container remove 5491f8f33ed630f3cd745b61d42dd01593d24d4d1b65c0b12c92ab9cffd2122d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:39:43.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:43 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:43.172+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:43.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:43 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:43.172+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:43.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:43 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:43.172+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:43.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:43 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:43.172+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:43.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:43 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:43.172+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:43.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:43 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:43.122+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:43.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:43 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:43.122+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:43.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:43 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:43.122+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:43.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:43 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:43.122+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:43.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:43 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:43.122+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:43.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:43 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:43.122+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:43.672 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:43 smithi153 podman[75487]: 2024-03-27 07:39:43.309775773 +0000 UTC m=+0.018038677 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:39:43.673 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:43 smithi153 podman[75487]: 2024-03-27 07:39:43.423299432 +0000 UTC m=+0.131562341 container create 6fed86d364237060d1fb0eb79fbbaa183b6dbb41239540a62b3fd4b606135318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:39:43.673 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:43.607+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:43.673 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:43.607+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:43.673 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:43.607+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:43.673 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:43.607+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:43.673 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:43.607+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:43.673 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:43 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:43.607+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:43.970 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:43 smithi153 podman[75487]: 2024-03-27 07:39:43.675847608 +0000 UTC m=+0.384110497 container init 6fed86d364237060d1fb0eb79fbbaa183b6dbb41239540a62b3fd4b606135318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8-deactivate, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-03-27T07:39:43.970 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:43 smithi153 podman[75487]: 2024-03-27 07:39:43.67929739 +0000 UTC m=+0.387560281 container start 6fed86d364237060d1fb0eb79fbbaa183b6dbb41239540a62b3fd4b606135318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0) 2024-03-27T07:39:43.970 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:43 smithi153 podman[75487]: 2024-03-27 07:39:43.767265947 +0000 UTC m=+0.475528855 container attach 6fed86d364237060d1fb0eb79fbbaa183b6dbb41239540a62b3fd4b606135318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8-deactivate, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:39:44.275 INFO:journalctl@ceph.osd.8.smithi153.stdout:Mar 27 07:39:43 smithi153 podman[75487]: 2024-03-27 07:39:43.973675124 +0000 UTC m=+0.681938022 container died 6fed86d364237060d1fb0eb79fbbaa183b6dbb41239540a62b3fd4b606135318 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:39:44.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:44 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:44.151+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:44.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:44 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:44.151+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:44.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:44 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:44.151+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:44.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:44 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:44.151+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:44.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:44 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:44.151+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:44.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:44 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:44.151+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:44.580 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.8.service' 2024-03-27T07:39:44.621 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:39:44.621 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-03-27T07:39:44.621 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-03-27T07:39:44.621 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.9 2024-03-27T07:39:44.651 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:44.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:44.651 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:44.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:44.652 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:44.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:44.652 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:44.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:44.652 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:44.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:44.830 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:44 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:44.644+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:44.831 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:44 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:44.644+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:44.831 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:44 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:44.644+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:44.831 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:44 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:44.644+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:44.831 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:44 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:44.644+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:44.831 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:44 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:44.644+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:44.913 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:44 smithi082 systemd[1]: Stopping Ceph osd.9 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:39:44.913 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:44.915+0000 7f7045752700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:39:44.913 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:44.915+0000 7f7045752700 -1 osd.9 111 *** Got signal Terminated *** 2024-03-27T07:39:44.913 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:44 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:44.915+0000 7f7045752700 -1 osd.9 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:39:45.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:45 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:45.126+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:45.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:45 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:45.126+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:45.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:45 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:45.126+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:45.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:45 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:45.126+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:45.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:45 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:45.126+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:45.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:45 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:45.126+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:45.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:45 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:45.211+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:45.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:45 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:45.211+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:45.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:45 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:45.211+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:45.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:45 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:45.211+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:45.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:45 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:45.211+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:46.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:45 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:45.643+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:46.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:45 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:45.643+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:46.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:45 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:45.643+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:46.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:45 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:45.643+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:46.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:45 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:45.643+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:46.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:45 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:45.643+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:46.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:46 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:46.091+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:46.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:46 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:46.091+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:46.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:46 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:46.091+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:46.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:46 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:46.091+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:46.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:46 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:46.091+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:46.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:46 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:46.091+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:46.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:46 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:46.187+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:46.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:46 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:46.187+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:46.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:46 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:46.187+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:46.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:46 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:46.187+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:46.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:46 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:46.187+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:47.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:46 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:46.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:47.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:46 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:46.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:47.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:46 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:46.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:47.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:46 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:46.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:47.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:46 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:46.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:47.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:46 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:46.622+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:47.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:47 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:47.046+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:47.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:47 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:47.046+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:47.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:47 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:47.046+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:47.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:47 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:47.046+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:47.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:47 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:47.046+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:47.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:47 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:47.046+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:47.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:47 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:47.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:47.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:47 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:47.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:47.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:47 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:47.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:47.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:47 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:47.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:47.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:47 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:47.202+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:48.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:47 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:47.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:48.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:47 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:47.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:48.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:47 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:47.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:48.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:47 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:47.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:48.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:47 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:47.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:48.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:47 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:47.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:48.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:48 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:48.235+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:48.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:48 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:48.235+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:48.433 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:48 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:48.235+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:48.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:48 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:48.235+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:48.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:48 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:48.235+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:48.434 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:48 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:48.235+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.694455+0000 front 2024-03-27T07:39:21.694502+0000 (oldest deadline 2024-03-27T07:39:47.594570+0000) 2024-03-27T07:39:48.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:48 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:48.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:48.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:48 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:48.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:48.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:48 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:48.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:48.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:48 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:48.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:48.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:48 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:48.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:48.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:48 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:48.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:48.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:48 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:48.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.954268+0000 front 2024-03-27T07:39:21.954292+0000 (oldest deadline 2024-03-27T07:39:47.854056+0000) 2024-03-27T07:39:49.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:48 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:48.571+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:49.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:48 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:48.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:49.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:48 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:48.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:49.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:48 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:48.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:49.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:48 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:48.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:49.035 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:48 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:48.572+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:49.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:49 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:49.082+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:49.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:49 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:49.082+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:49.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:49 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:49.082+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:49.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:49 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:49.082+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:49.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:49 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:49.082+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:49.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:49 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:49.082+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:49.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:49 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:49.082+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.954268+0000 front 2024-03-27T07:39:21.954292+0000 (oldest deadline 2024-03-27T07:39:47.854056+0000) 2024-03-27T07:39:49.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:49 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:49.259+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:34.283836+0000 front 2024-03-27T07:38:34.283774+0000 (oldest deadline 2024-03-27T07:38:55.983954+0000) 2024-03-27T07:39:49.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:49 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:49.259+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:40.685278+0000 front 2024-03-27T07:38:40.685427+0000 (oldest deadline 2024-03-27T07:39:05.985307+0000) 2024-03-27T07:39:49.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:49 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:49.259+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:51.787372+0000 front 2024-03-27T07:38:51.787379+0000 (oldest deadline 2024-03-27T07:39:14.087240+0000) 2024-03-27T07:39:49.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:49 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:49.259+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:57.488933+0000 front 2024-03-27T07:38:57.488952+0000 (oldest deadline 2024-03-27T07:39:23.389150+0000) 2024-03-27T07:39:49.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:49 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:49.259+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.390845+0000 front 2024-03-27T07:39:07.391085+0000 (oldest deadline 2024-03-27T07:39:30.890892+0000) 2024-03-27T07:39:49.684 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:49 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9[67458]: 2024-03-27T07:39:49.259+0000 7f703dd3e700 -1 osd.9 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.694455+0000 front 2024-03-27T07:39:21.694502+0000 (oldest deadline 2024-03-27T07:39:47.594570+0000) 2024-03-27T07:39:50.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:49 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:49.595+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:50.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:49 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:49.595+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:50.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:49 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:49.595+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:50.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:49 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:49.595+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:50.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:49 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:49.595+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:50.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:49 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:49.595+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:50.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:50 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:50.088+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:50.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:50 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:50.088+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:50.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:50 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:50.088+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:50.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:50 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:50.088+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:50.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:50 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:50.088+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:50.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:50 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:50.088+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:50.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:50 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:50.088+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.954268+0000 front 2024-03-27T07:39:21.954292+0000 (oldest deadline 2024-03-27T07:39:47.854056+0000) 2024-03-27T07:39:50.683 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:50 smithi082 podman[101431]: 2024-03-27 07:39:50.430352703 +0000 UTC m=+5.610050655 container died 4a298b9718b8ab0d83b415d9158c89394113a85105bb1ce814cb79623f222418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-03-27T07:39:51.029 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:50 smithi082 podman[101431]: 2024-03-27 07:39:50.773088339 +0000 UTC m=+5.952786296 container cleanup 4a298b9718b8ab0d83b415d9158c89394113a85105bb1ce814cb79623f222418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:39:51.029 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:50 smithi082 bash[101431]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9 2024-03-27T07:39:51.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:50 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:50.593+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:51.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:50 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:50.593+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:51.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:50 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:50.593+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:51.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:50 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:50.593+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:51.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:50 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:50.593+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:51.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:50 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:50.593+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:51.380 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:51 smithi082 podman[101449]: 2024-03-27 07:39:51.032695026 +0000 UTC m=+0.603115174 container remove 4a298b9718b8ab0d83b415d9158c89394113a85105bb1ce814cb79623f222418 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5) 2024-03-27T07:39:51.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:51 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:51.050+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:51.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:51 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:51.050+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:51.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:51 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:51.050+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:51.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:51 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:51.050+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:51.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:51 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:51.050+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:51.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:51 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:51.050+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:51.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:51 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:51.050+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.954268+0000 front 2024-03-27T07:39:21.954292+0000 (oldest deadline 2024-03-27T07:39:47.854056+0000) 2024-03-27T07:39:51.674 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:51 smithi082 podman[101541]: 2024-03-27 07:39:51.286004899 +0000 UTC m=+0.017715174 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:39:51.674 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:51 smithi082 podman[101541]: 2024-03-27 07:39:51.383534377 +0000 UTC m=+0.115244694 container create 2328944195b795d50af312a6481386482c60bc95e5864582d640a7cbaf873325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:39:51.674 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:51 smithi082 podman[101541]: 2024-03-27 07:39:51.602532304 +0000 UTC m=+0.334242576 container init 2328944195b795d50af312a6481386482c60bc95e5864582d640a7cbaf873325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9-deactivate, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:39:51.674 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:51 smithi082 podman[101541]: 2024-03-27 07:39:51.605681686 +0000 UTC m=+0.337391961 container start 2328944195b795d50af312a6481386482c60bc95e5864582d640a7cbaf873325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9-deactivate, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-27T07:39:51.674 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:51 smithi082 podman[101541]: 2024-03-27 07:39:51.677434242 +0000 UTC m=+0.409144528 container attach 2328944195b795d50af312a6481386482c60bc95e5864582d640a7cbaf873325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-03-27T07:39:51.933 INFO:journalctl@ceph.osd.9.smithi082.stdout:Mar 27 07:39:51 smithi082 podman[101541]: 2024-03-27 07:39:51.890041805 +0000 UTC m=+0.621752078 container died 2328944195b795d50af312a6481386482c60bc95e5864582d640a7cbaf873325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-9-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, ceph=True) 2024-03-27T07:39:52.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:51 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:51.627+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:52.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:51 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:51.627+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:52.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:51 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:51.627+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:52.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:51 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:51.627+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:52.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:51 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:51.627+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:52.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:51 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:51.627+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:52.497 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.9.service' 2024-03-27T07:39:52.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:52.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:52.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:52.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:52.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:52.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:52.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:52.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:52.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:52.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:52.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:52.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:52.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:52.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.954268+0000 front 2024-03-27T07:39:21.954292+0000 (oldest deadline 2024-03-27T07:39:47.854056+0000) 2024-03-27T07:39:52.579 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:39:52.579 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-03-27T07:39:52.579 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-03-27T07:39:52.579 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.10 2024-03-27T07:39:52.901 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 systemd[1]: Stopping Ceph osd.10 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:39:53.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:52 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:52.613+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:53.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:52 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:52.613+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:53.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:52 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:52.613+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:53.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:52 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:52.613+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:53.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:52 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:52.613+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:53.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:52 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:52.613+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:53.250 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:52.904+0000 7f9dc638f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:39:53.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:52.904+0000 7f9dc638f700 -1 osd.10 111 *** Got signal Terminated *** 2024-03-27T07:39:53.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:52 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:52.904+0000 7f9dc638f700 -1 osd.10 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:39:53.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:53 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:53.143+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:53.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:53 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:53.143+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:53.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:53 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:53.143+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:53.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:53 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:53.143+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:53.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:53 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:53.143+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:53.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:53 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:53.143+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:53.251 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:53 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:53.143+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.954268+0000 front 2024-03-27T07:39:21.954292+0000 (oldest deadline 2024-03-27T07:39:47.854056+0000) 2024-03-27T07:39:53.935 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:53 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:53.609+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:53.935 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:53 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:53.609+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:53.935 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:53 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:53.609+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:53.935 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:53 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:53.609+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:53.935 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:53 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:53.609+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:53.935 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:53 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:53.609+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:54.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:54 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:54.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:54.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:54 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:54.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:54.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:54 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:54.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:54.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:54 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:54.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:54.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:54 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:54.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:54.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:54 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:54.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:54.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:54 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:54.095+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.954268+0000 front 2024-03-27T07:39:21.954292+0000 (oldest deadline 2024-03-27T07:39:47.854056+0000) 2024-03-27T07:39:55.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:54 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:54.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:55.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:54 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:54.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:55.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:54 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:54.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:55.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:54 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:54.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:55.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:54 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:54.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:55.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:54 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:54.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:55.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:55 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:55.092+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:55.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:55 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:55.092+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:55.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:55 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:55.092+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:55.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:55 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:55.092+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:55.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:55 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:55.092+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:55.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:55 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:55.092+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:55.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:55 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:55.092+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.954268+0000 front 2024-03-27T07:39:21.954292+0000 (oldest deadline 2024-03-27T07:39:47.854056+0000) 2024-03-27T07:39:56.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:55 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:55.575+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:56.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:55 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:55.575+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:56.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:55 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:55.575+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:56.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:55 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:55.575+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:56.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:55 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:55.575+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:56.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:55 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:55.575+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:56.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:56 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:56.055+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:56.500 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:56 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:56.055+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:56.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:56 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:56.055+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:56.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:56 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:56.055+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:56.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:56 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:56.055+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:56.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:56 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:56.055+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:56.501 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:56 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:56.055+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.954268+0000 front 2024-03-27T07:39:21.954292+0000 (oldest deadline 2024-03-27T07:39:47.854056+0000) 2024-03-27T07:39:57.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:56 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:56.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:57.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:56 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:56.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:57.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:56 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:56.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:57.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:56 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:56.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:57.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:56 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:56.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:57.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:56 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:56.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:57.403 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:57 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:57.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.144714+0000 front 2024-03-27T07:38:30.144585+0000 (oldest deadline 2024-03-27T07:38:58.945422+0000) 2024-03-27T07:39:57.403 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:57 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:57.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:42.947405+0000 front 2024-03-27T07:38:42.947433+0000 (oldest deadline 2024-03-27T07:39:07.647637+0000) 2024-03-27T07:39:57.403 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:57 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:57.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:49.849636+0000 front 2024-03-27T07:38:49.849555+0000 (oldest deadline 2024-03-27T07:39:15.749454+0000) 2024-03-27T07:39:57.403 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:57 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:57.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:55.749921+0000 front 2024-03-27T07:38:55.750016+0000 (oldest deadline 2024-03-27T07:39:21.650104+0000) 2024-03-27T07:39:57.403 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:57 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:57.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.352156+0000 front 2024-03-27T07:39:07.352366+0000 (oldest deadline 2024-03-27T07:39:32.652309+0000) 2024-03-27T07:39:57.403 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:57 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:57.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:14.353522+0000 front 2024-03-27T07:39:14.353536+0000 (oldest deadline 2024-03-27T07:39:41.953655+0000) 2024-03-27T07:39:57.403 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:57 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10[61299]: 2024-03-27T07:39:57.096+0000 7f9dc2983700 -1 osd.10 111 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-03-27T07:39:21.954268+0000 front 2024-03-27T07:39:21.954292+0000 (oldest deadline 2024-03-27T07:39:47.854056+0000) 2024-03-27T07:39:58.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:57 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:57.592+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:58.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:57 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:57.592+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:58.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:57 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:57.592+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:58.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:57 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:57.592+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:58.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:57 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:57.592+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:58.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:57 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:57.592+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:58.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:57 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:57.592+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6820 osd.7 since back 2024-03-27T07:39:31.502137+0000 front 2024-03-27T07:39:31.502263+0000 (oldest deadline 2024-03-27T07:39:57.402020+0000) 2024-03-27T07:39:58.619 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:58 smithi149 podman[74105]: 2024-03-27 07:39:58.367240344 +0000 UTC m=+5.589922339 container died 43b161ae48572fd3b8fa92451d8ed91b7dd646e6060fdc9c058d573cf2f0f0ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-03-27T07:39:59.000 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:58 smithi149 podman[74105]: 2024-03-27 07:39:58.796269048 +0000 UTC m=+6.018951036 container cleanup 43b161ae48572fd3b8fa92451d8ed91b7dd646e6060fdc9c058d573cf2f0f0ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, ceph=True) 2024-03-27T07:39:59.000 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:58 smithi149 bash[74105]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10 2024-03-27T07:39:59.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:58.561+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:39:59.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:58.561+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:39:59.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:58.561+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:39:59.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:58.561+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:39:59.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:58.561+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:39:59.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:58.561+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:39:59.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:58 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:58.561+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6820 osd.7 since back 2024-03-27T07:39:31.502137+0000 front 2024-03-27T07:39:31.502263+0000 (oldest deadline 2024-03-27T07:39:57.402020+0000) 2024-03-27T07:39:59.413 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:59 smithi149 podman[74133]: 2024-03-27 07:39:59.014139643 +0000 UTC m=+0.638485768 container remove 43b161ae48572fd3b8fa92451d8ed91b7dd646e6060fdc9c058d573cf2f0f0ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-27T07:39:59.697 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:59 smithi149 podman[74226]: 2024-03-27 07:39:59.319566588 +0000 UTC m=+0.018182307 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:39:59.697 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:59 smithi149 podman[74226]: 2024-03-27 07:39:59.46496333 +0000 UTC m=+0.163579022 container create 498d63e3939b0283ab4226f8074644a58ea789fd08fb57892dbc05545fb2f102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10-deactivate, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:39:59.994 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:59 smithi149 podman[74226]: 2024-03-27 07:39:59.70107433 +0000 UTC m=+0.399690041 container init 498d63e3939b0283ab4226f8074644a58ea789fd08fb57892dbc05545fb2f102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-27T07:39:59.994 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:59 smithi149 podman[74226]: 2024-03-27 07:39:59.704684039 +0000 UTC m=+0.403299742 container start 498d63e3939b0283ab4226f8074644a58ea789fd08fb57892dbc05545fb2f102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:39:59.994 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:59 smithi149 podman[74226]: 2024-03-27 07:39:59.818030315 +0000 UTC m=+0.516646032 container attach 498d63e3939b0283ab4226f8074644a58ea789fd08fb57892dbc05545fb2f102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10-deactivate, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-27T07:40:00.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:59 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:59.602+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:40:00.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:59 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:59.602+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:40:00.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:59 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:59.602+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:40:00.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:59 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:59.602+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:40:00.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:59 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:59.602+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:40:00.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:59 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:59.602+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:40:00.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:39:59 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:39:59.602+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6820 osd.7 since back 2024-03-27T07:39:31.502137+0000 front 2024-03-27T07:39:31.502263+0000 (oldest deadline 2024-03-27T07:39:57.402020+0000) 2024-03-27T07:40:00.250 INFO:journalctl@ceph.osd.10.smithi149.stdout:Mar 27 07:39:59 smithi149 podman[74226]: 2024-03-27 07:39:59.997220481 +0000 UTC m=+0.695836192 container died 498d63e3939b0283ab4226f8074644a58ea789fd08fb57892dbc05545fb2f102 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:40:00.586 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.10.service' 2024-03-27T07:40:00.627 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:00.628 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-03-27T07:40:00.628 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-03-27T07:40:00.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.11 2024-03-27T07:40:00.946 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:00.624+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:40:00.946 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:00.624+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:40:00.946 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:00.624+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:40:00.946 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:00.624+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:40:00.947 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:00.624+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:40:00.947 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:00.624+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:40:00.947 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:00.624+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6820 osd.7 since back 2024-03-27T07:39:31.502137+0000 front 2024-03-27T07:39:31.502263+0000 (oldest deadline 2024-03-27T07:39:57.402020+0000) 2024-03-27T07:40:00.947 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 systemd[1]: Stopping Ceph osd.11 for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:00.947 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:00.948+0000 7f8ec17ba700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:00.947 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:00.948+0000 7f8ec17ba700 -1 osd.11 111 *** Got signal Terminated *** 2024-03-27T07:40:00.947 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:00 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:00.948+0000 7f8ec17ba700 -1 osd.11 111 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T07:40:02.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:01 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:01.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:40:02.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:01 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:01.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:40:02.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:01 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:01.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:40:02.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:01 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:01.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:40:02.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:01 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:01.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:40:02.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:01 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:01.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:40:02.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:01 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:01.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6820 osd.7 since back 2024-03-27T07:39:31.502137+0000 front 2024-03-27T07:39:31.502263+0000 (oldest deadline 2024-03-27T07:39:57.402020+0000) 2024-03-27T07:40:03.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:02.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:40:03.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:02.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:40:03.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:02.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:40:03.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:02.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:40:03.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:02.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:40:03.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:02.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:40:03.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:02 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:02.632+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6820 osd.7 since back 2024-03-27T07:39:31.502137+0000 front 2024-03-27T07:39:31.502263+0000 (oldest deadline 2024-03-27T07:39:57.402020+0000) 2024-03-27T07:40:03.997 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:03 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:03.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:40:03.997 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:03 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:03.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:40:03.997 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:03 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:03.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:40:03.997 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:03 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:03.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:40:03.997 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:03 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:03.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:40:03.997 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:03 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:03.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:40:03.997 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:03 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:03.621+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6820 osd.7 since back 2024-03-27T07:39:31.502137+0000 front 2024-03-27T07:39:31.502263+0000 (oldest deadline 2024-03-27T07:39:57.402020+0000) 2024-03-27T07:40:05.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:04 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:04.610+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:40:05.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:04 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:04.610+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:40:05.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:04 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:04.610+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:40:05.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:04 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:04.610+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:40:05.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:04 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:04.610+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:40:05.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:04 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:04.610+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:40:05.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:04 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:04.610+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6820 osd.7 since back 2024-03-27T07:39:31.502137+0000 front 2024-03-27T07:39:31.502263+0000 (oldest deadline 2024-03-27T07:39:57.402020+0000) 2024-03-27T07:40:06.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:05 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:05.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-03-27T07:38:30.793605+0000 front 2024-03-27T07:38:30.793486+0000 (oldest deadline 2024-03-27T07:38:55.493500+0000) 2024-03-27T07:40:06.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:05 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:05.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6804 osd.1 since back 2024-03-27T07:38:43.095100+0000 front 2024-03-27T07:38:43.095547+0000 (oldest deadline 2024-03-27T07:39:07.795214+0000) 2024-03-27T07:40:06.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:05 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:05.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6804 osd.2 since back 2024-03-27T07:38:50.096060+0000 front 2024-03-27T07:38:50.096095+0000 (oldest deadline 2024-03-27T07:39:13.596149+0000) 2024-03-27T07:40:06.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:05 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:05.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-03-27T07:38:58.296986+0000 front 2024-03-27T07:38:58.296968+0000 (oldest deadline 2024-03-27T07:39:21.796998+0000) 2024-03-27T07:40:06.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:05 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:05.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6812 osd.4 since back 2024-03-27T07:39:07.598958+0000 front 2024-03-27T07:39:07.598858+0000 (oldest deadline 2024-03-27T07:39:29.898832+0000) 2024-03-27T07:40:06.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:05 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:05.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.153:6812 osd.5 since back 2024-03-27T07:39:17.500156+0000 front 2024-03-27T07:39:17.500199+0000 (oldest deadline 2024-03-27T07:39:39.800228+0000) 2024-03-27T07:40:06.034 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:05 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11[61701]: 2024-03-27T07:40:05.606+0000 7f8ebddae700 -1 osd.11 111 heartbeat_check: no reply from 172.21.15.149:6820 osd.7 since back 2024-03-27T07:39:31.502137+0000 front 2024-03-27T07:39:31.502263+0000 (oldest deadline 2024-03-27T07:39:57.402020+0000) 2024-03-27T07:40:06.692 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:06 smithi153 podman[75604]: 2024-03-27 07:40:06.404262444 +0000 UTC m=+5.579365081 container died 454fa546132927ae07887509c210d409c55b64c5ded2b54f99c99bf5297925d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-27T07:40:07.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:06 smithi153 podman[75604]: 2024-03-27 07:40:06.856143574 +0000 UTC m=+6.031246174 container cleanup 454fa546132927ae07887509c210d409c55b64c5ded2b54f99c99bf5297925d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-27T07:40:07.033 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:06 smithi153 bash[75604]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11 2024-03-27T07:40:07.479 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:07 smithi153 podman[75621]: 2024-03-27 07:40:07.174295524 +0000 UTC m=+0.762537736 container remove 454fa546132927ae07887509c210d409c55b64c5ded2b54f99c99bf5297925d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-27T07:40:07.783 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:07 smithi153 podman[75711]: 2024-03-27 07:40:07.385976865 +0000 UTC m=+0.017546322 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T07:40:07.783 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:07 smithi153 podman[75711]: 2024-03-27 07:40:07.500038524 +0000 UTC m=+0.131607987 container create 06a8cd42172a2d1a92590d300a221192c1d5c14be972f3ef92472c35814b23be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-03-27T07:40:07.783 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:07 smithi153 podman[75711]: 2024-03-27 07:40:07.727184824 +0000 UTC m=+0.358754269 container init 06a8cd42172a2d1a92590d300a221192c1d5c14be972f3ef92472c35814b23be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2) 2024-03-27T07:40:07.783 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:07 smithi153 podman[75711]: 2024-03-27 07:40:07.730210784 +0000 UTC m=+0.361780220 container start 06a8cd42172a2d1a92590d300a221192c1d5c14be972f3ef92472c35814b23be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11-deactivate, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, io.buildah.version=1.33.5) 2024-03-27T07:40:08.283 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:07 smithi153 podman[75711]: 2024-03-27 07:40:07.822760145 +0000 UTC m=+0.454329609 container attach 06a8cd42172a2d1a92590d300a221192c1d5c14be972f3ef92472c35814b23be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:40:08.283 INFO:journalctl@ceph.osd.11.smithi153.stdout:Mar 27 07:40:08 smithi153 podman[75711]: 2024-03-27 07:40:08.023965282 +0000 UTC m=+0.655534732 container died 06a8cd42172a2d1a92590d300a221192c1d5c14be972f3ef92472c35814b23be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-osd-11-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:40:08.594 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@osd.11.service' 2024-03-27T07:40:08.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:08.636 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-03-27T07:40:08.636 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-03-27T07:40:08.636 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.a 2024-03-27T07:40:08.933 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 27 07:40:08 smithi082 systemd[1]: Stopping Ceph mds.a for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:09.433 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 27 07:40:08 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-a[73994]: 2024-03-27T07:40:08.975+0000 7f182a89f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:09.433 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 27 07:40:08 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-a[73994]: 2024-03-27T07:40:08.975+0000 7f182a89f700 -1 mds.a *** got signal Terminated *** 2024-03-27T07:40:13.253 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 27 07:40:12 smithi082 podman[101661]: 2024-03-27 07:40:12.987460578 +0000 UTC m=+4.132795180 container died eca28766cd3b404572a314b913d727df27c97d768385a26d61194c2cd7244133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-a, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:40:13.683 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 27 07:40:13 smithi082 podman[101661]: 2024-03-27 07:40:13.347665475 +0000 UTC m=+4.493000090 container cleanup eca28766cd3b404572a314b913d727df27c97d768385a26d61194c2cd7244133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-27T07:40:13.683 INFO:journalctl@ceph.mds.a.smithi082.stdout:Mar 27 07:40:13 smithi082 bash[101661]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-a 2024-03-27T07:40:13.830 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.a.service' 2024-03-27T07:40:13.870 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:13.870 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-03-27T07:40:13.870 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-03-27T07:40:13.870 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.d 2024-03-27T07:40:14.433 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:40:13 smithi082 systemd[1]: Stopping Ceph mds.d for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:14.433 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:40:14 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-d[73024]: 2024-03-27T07:40:14.193+0000 7fa017161700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:14.433 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:40:14 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-d[73024]: 2024-03-27T07:40:14.193+0000 7fa017161700 -1 mds.d *** got signal Terminated *** 2024-03-27T07:40:17.706 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:40:17 smithi082 podman[101791]: 2024-03-27 07:40:17.442307231 +0000 UTC m=+3.345103576 container died e702cb3f7c87b2e026c55d12a0b5a38f527fcea461ff5949f9cbba356d5a86f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-d, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-27T07:40:18.057 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:40:17 smithi082 podman[101791]: 2024-03-27 07:40:17.801117043 +0000 UTC m=+3.703913378 container cleanup e702cb3f7c87b2e026c55d12a0b5a38f527fcea461ff5949f9cbba356d5a86f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-d, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:40:18.057 INFO:journalctl@ceph.mds.d.smithi082.stdout:Mar 27 07:40:17 smithi082 bash[101791]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-d 2024-03-27T07:40:18.223 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.d.service' 2024-03-27T07:40:18.259 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:18.259 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-03-27T07:40:18.260 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-03-27T07:40:18.260 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.g 2024-03-27T07:40:18.576 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:40:18 smithi082 systemd[1]: Stopping Ceph mds.g for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:18.933 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:40:18 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-g[73638]: 2024-03-27T07:40:18.579+0000 7fc29a99f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:18.933 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:40:18 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-g[73638]: 2024-03-27T07:40:18.579+0000 7fc29a99f700 -1 mds.g *** got signal Terminated *** 2024-03-27T07:40:22.842 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:40:22 smithi082 podman[101913]: 2024-03-27 07:40:22.595119309 +0000 UTC m=+4.119765990 container died d9b53df302f37063d39591327bce0c25adaf7c632825e48599fb94005f3b8a7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2) 2024-03-27T07:40:23.110 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:40:22 smithi082 podman[101913]: 2024-03-27 07:40:22.937652793 +0000 UTC m=+4.462299473 container cleanup d9b53df302f37063d39591327bce0c25adaf7c632825e48599fb94005f3b8a7e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-g, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:40:23.110 INFO:journalctl@ceph.mds.g.smithi082.stdout:Mar 27 07:40:22 smithi082 bash[101913]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-g 2024-03-27T07:40:23.333 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.g.service' 2024-03-27T07:40:23.367 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:23.368 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-03-27T07:40:23.368 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-03-27T07:40:23.368 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.j 2024-03-27T07:40:23.683 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:40:23 smithi082 systemd[1]: Stopping Ceph mds.j for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:24.183 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:40:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-j[72634]: 2024-03-27T07:40:23.690+0000 7ff073501700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:24.183 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:40:23 smithi082 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-j[72634]: 2024-03-27T07:40:23.690+0000 7ff073501700 -1 mds.j *** got signal Terminated *** 2024-03-27T07:40:26.796 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:40:26 smithi082 podman[102033]: 2024-03-27 07:40:26.549144596 +0000 UTC m=+2.964457644 container died eff950a026493b49f4937b7301dcfbb88a76a6fd05ed3ab0e8a2da53c74963b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-j, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-03-27T07:40:27.138 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:40:26 smithi082 podman[102033]: 2024-03-27 07:40:26.891033834 +0000 UTC m=+3.306346880 container cleanup eff950a026493b49f4937b7301dcfbb88a76a6fd05ed3ab0e8a2da53c74963b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-j, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-27T07:40:27.138 INFO:journalctl@ceph.mds.j.smithi082.stdout:Mar 27 07:40:26 smithi082 bash[102033]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-j 2024-03-27T07:40:27.268 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.j.service' 2024-03-27T07:40:27.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:27.302 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-03-27T07:40:27.302 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-03-27T07:40:27.302 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.b 2024-03-27T07:40:27.610 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:40:27 smithi149 systemd[1]: Stopping Ceph mds.b for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:27.873 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:40:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: 2024-03-27T07:40:27.613+0000 7f973fcc4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:27.874 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:40:27 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b[66990]: 2024-03-27T07:40:27.613+0000 7f973fcc4700 -1 mds.b *** got signal Terminated *** 2024-03-27T07:40:29.000 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:40:28 smithi149 podman[74332]: 2024-03-27 07:40:28.750991614 +0000 UTC m=+1.253642227 container died 13f6608fa5bc6c5faced4f8da84d782fbed94a87100f94646e27e726d715a8c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T07:40:29.318 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:40:29 smithi149 podman[74332]: 2024-03-27 07:40:29.088115618 +0000 UTC m=+1.590766230 container cleanup 13f6608fa5bc6c5faced4f8da84d782fbed94a87100f94646e27e726d715a8c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-27T07:40:29.319 INFO:journalctl@ceph.mds.b.smithi149.stdout:Mar 27 07:40:29 smithi149 bash[74332]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-b 2024-03-27T07:40:29.445 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.b.service' 2024-03-27T07:40:29.483 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:29.484 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-03-27T07:40:29.484 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-03-27T07:40:29.484 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.e 2024-03-27T07:40:29.830 INFO:journalctl@ceph.mds.e.smithi149.stdout:Mar 27 07:40:29 smithi149 systemd[1]: Stopping Ceph mds.e for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:30.250 INFO:journalctl@ceph.mds.e.smithi149.stdout:Mar 27 07:40:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-e[66362]: 2024-03-27T07:40:29.833+0000 7f51ea717700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:30.250 INFO:journalctl@ceph.mds.e.smithi149.stdout:Mar 27 07:40:29 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-e[66362]: 2024-03-27T07:40:29.833+0000 7f51ea717700 -1 mds.e *** got signal Terminated *** 2024-03-27T07:40:33.000 INFO:journalctl@ceph.mds.e.smithi149.stdout:Mar 27 07:40:32 smithi149 podman[74464]: 2024-03-27 07:40:32.721211758 +0000 UTC m=+3.009783676 container died 7a1babf96f3c317f7c4b492914576720d6c56f8eefefc318949d99f29f95a4b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-e, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-03-27T07:40:33.380 INFO:journalctl@ceph.mds.e.smithi149.stdout:Mar 27 07:40:33 smithi149 podman[74464]: 2024-03-27 07:40:33.099785009 +0000 UTC m=+3.388356917 container cleanup 7a1babf96f3c317f7c4b492914576720d6c56f8eefefc318949d99f29f95a4b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-e, ceph=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T07:40:33.381 INFO:journalctl@ceph.mds.e.smithi149.stdout:Mar 27 07:40:33 smithi149 bash[74464]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-e 2024-03-27T07:40:33.514 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.e.service' 2024-03-27T07:40:33.549 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:33.550 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-03-27T07:40:33.550 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-03-27T07:40:33.550 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.h 2024-03-27T07:40:33.892 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:40:33 smithi149 systemd[1]: Stopping Ceph mds.h for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:34.250 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:40:33 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:40:33.895+0000 7f9d043c3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:34.250 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:40:33 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h[66678]: 2024-03-27T07:40:33.895+0000 7f9d043c3700 -1 mds.h *** got signal Terminated *** 2024-03-27T07:40:36.984 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:40:36 smithi149 podman[74586]: 2024-03-27 07:40:36.733079067 +0000 UTC m=+2.961150261 container died ba48746825b23c46c5d26889a96adf2cd4fa36051d923eda86972c67ee024aee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-03-27T07:40:37.250 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:40:37 smithi149 podman[74586]: 2024-03-27 07:40:37.070601103 +0000 UTC m=+3.298672340 container cleanup ba48746825b23c46c5d26889a96adf2cd4fa36051d923eda86972c67ee024aee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:40:37.250 INFO:journalctl@ceph.mds.h.smithi149.stdout:Mar 27 07:40:37 smithi149 bash[74586]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-h 2024-03-27T07:40:37.487 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.h.service' 2024-03-27T07:40:37.523 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:37.523 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-03-27T07:40:37.523 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-03-27T07:40:37.523 DEBUG:teuthology.orchestra.run.smithi149:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.k 2024-03-27T07:40:37.837 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:40:37 smithi149 systemd[1]: Stopping Ceph mds.k for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:38.250 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:40:37 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-k[66056]: 2024-03-27T07:40:37.840+0000 7efcb39fc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:38.250 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:40:37 smithi149 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-k[66056]: 2024-03-27T07:40:37.840+0000 7efcb39fc700 -1 mds.k *** got signal Terminated *** 2024-03-27T07:40:40.000 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:40:39 smithi149 podman[74709]: 2024-03-27 07:40:39.713978243 +0000 UTC m=+1.971531275 container died 65861988f4cb10cf9bb5be99d35d98d3a286452844f17aeb9377a73fe163a1b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-k, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-03-27T07:40:40.346 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:40:40 smithi149 podman[74709]: 2024-03-27 07:40:40.115673953 +0000 UTC m=+2.373226978 container cleanup 65861988f4cb10cf9bb5be99d35d98d3a286452844f17aeb9377a73fe163a1b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-k, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-27T07:40:40.346 INFO:journalctl@ceph.mds.k.smithi149.stdout:Mar 27 07:40:40 smithi149 bash[74709]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-k 2024-03-27T07:40:40.448 DEBUG:teuthology.orchestra.run.smithi149:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.k.service' 2024-03-27T07:40:40.483 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:40.483 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-03-27T07:40:40.483 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-03-27T07:40:40.483 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c 2024-03-27T07:40:40.783 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:40:40 smithi153 systemd[1]: Stopping Ceph mds.c for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:41.283 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:40:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[73328]: 2024-03-27T07:40:40.813+0000 7fee95602700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:41.283 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:40:40 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c[73328]: 2024-03-27T07:40:40.813+0000 7fee95602700 -1 mds.c *** got signal Terminated *** 2024-03-27T07:40:44.992 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:40:44 smithi153 podman[75816]: 2024-03-27 07:40:44.709507714 +0000 UTC m=+4.017231028 container died fd738c2b4d8108f6df9bcb5d78a6c57f9254796d74a09c93cc26b23c1713dbbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-27T07:40:45.267 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:40:45 smithi153 podman[75816]: 2024-03-27 07:40:45.078965121 +0000 UTC m=+4.386688373 container cleanup fd738c2b4d8108f6df9bcb5d78a6c57f9254796d74a09c93cc26b23c1713dbbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS) 2024-03-27T07:40:45.267 INFO:journalctl@ceph.mds.c.smithi153.stdout:Mar 27 07:40:45 smithi153 bash[75816]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-c 2024-03-27T07:40:45.479 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.c.service' 2024-03-27T07:40:45.518 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:45.518 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-03-27T07:40:45.518 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-03-27T07:40:45.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.f 2024-03-27T07:40:45.871 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:40:45 smithi153 systemd[1]: Stopping Ceph mds.f for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:46.283 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:40:45 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f[66871]: 2024-03-27T07:40:45.874+0000 7f4370144700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:46.283 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:40:45 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f[66871]: 2024-03-27T07:40:45.874+0000 7f4370144700 -1 mds.f *** got signal Terminated *** 2024-03-27T07:40:49.129 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:40:48 smithi153 podman[75947]: 2024-03-27 07:40:48.814057926 +0000 UTC m=+3.074877820 container died 2767a95d99155316e9fc251d04c8454eb1b840790be0febe936e8b04ad94a792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326) 2024-03-27T07:40:49.487 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:40:49 smithi153 podman[75947]: 2024-03-27 07:40:49.232049197 +0000 UTC m=+3.492869055 container cleanup 2767a95d99155316e9fc251d04c8454eb1b840790be0febe936e8b04ad94a792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-27T07:40:49.487 INFO:journalctl@ceph.mds.f.smithi153.stdout:Mar 27 07:40:49 smithi153 bash[75947]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-f 2024-03-27T07:40:49.710 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.f.service' 2024-03-27T07:40:49.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:49.746 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-03-27T07:40:49.746 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-03-27T07:40:49.746 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.i 2024-03-27T07:40:50.033 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:40:49 smithi153 systemd[1]: Stopping Ceph mds.i for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:50.533 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:40:50 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:40:50.093+0000 7f1f6cfa4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:50.533 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:40:50 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i[67489]: 2024-03-27T07:40:50.093+0000 7f1f6cfa4700 -1 mds.i *** got signal Terminated *** 2024-03-27T07:40:53.033 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:40:52 smithi153 podman[76068]: 2024-03-27 07:40:52.723666043 +0000 UTC m=+2.759900325 container died 3a4066c405da6c71de519e4762caea9e8fbc195d8666ef2143cbd94437b78127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T07:40:53.350 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:40:53 smithi153 podman[76068]: 2024-03-27 07:40:53.136088772 +0000 UTC m=+3.172323081 container cleanup 3a4066c405da6c71de519e4762caea9e8fbc195d8666ef2143cbd94437b78127 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326) 2024-03-27T07:40:53.350 INFO:journalctl@ceph.mds.i.smithi153.stdout:Mar 27 07:40:53 smithi153 bash[76068]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-i 2024-03-27T07:40:53.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.i.service' 2024-03-27T07:40:53.590 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:53.590 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-03-27T07:40:53.591 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-03-27T07:40:53.591 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.l 2024-03-27T07:40:53.910 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:40:53 smithi153 systemd[1]: Stopping Ceph mds.l for 604548c2-ec09-11ee-95d0-87774f69a715... 2024-03-27T07:40:54.283 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:40:53 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-l[66547]: 2024-03-27T07:40:53.913+0000 7f45af3f8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T07:40:54.283 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:40:53 smithi153 ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-l[66547]: 2024-03-27T07:40:53.913+0000 7f45af3f8700 -1 mds.l *** got signal Terminated *** 2024-03-27T07:40:57.124 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:40:56 smithi153 podman[76190]: 2024-03-27 07:40:56.836232103 +0000 UTC m=+3.025867026 container died a2996c7af0b615507e9bc7edcedc70773233aa7d152db8866391b45be5c6c3f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-l, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-27T07:40:57.469 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:40:57 smithi153 podman[76190]: 2024-03-27 07:40:57.205721716 +0000 UTC m=+3.395356635 container cleanup a2996c7af0b615507e9bc7edcedc70773233aa7d152db8866391b45be5c6c3f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-l, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-03-27T07:40:57.469 INFO:journalctl@ceph.mds.l.smithi153.stdout:Mar 27 07:40:57 smithi153 bash[76190]: ceph-604548c2-ec09-11ee-95d0-87774f69a715-mds-l 2024-03-27T07:40:57.599 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-604548c2-ec09-11ee-95d0-87774f69a715@mds.l.service' 2024-03-27T07:40:57.634 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T07:40:57.634 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-03-27T07:40:57.634 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 604548c2-ec09-11ee-95d0-87774f69a715 --force --keep-logs 2024-03-27T07:40:57.827 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:41:00.311 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 604548c2-ec09-11ee-95d0-87774f69a715 --force --keep-logs 2024-03-27T07:41:00.502 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:41:03.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 604548c2-ec09-11ee-95d0-87774f69a715 --force --keep-logs 2024-03-27T07:41:03.357 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T07:41:05.849 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T07:41:05.884 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T07:41:05.919 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T07:41:05.948 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-27T07:41:05.951 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/crash to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643/remote/smithi082/crash 2024-03-27T07:41:05.951 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/crash -- . 2024-03-27T07:41:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/crash: Cannot open: No such file or directory 2024-03-27T07:41:05.981 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-03-27T07:41:05.983 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/crash to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643/remote/smithi149/crash 2024-03-27T07:41:05.984 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/crash -- . 2024-03-27T07:41:06.025 INFO:teuthology.orchestra.run.smithi149.stderr:tar: /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/crash: Cannot open: No such file or directory 2024-03-27T07:41:06.025 INFO:teuthology.orchestra.run.smithi149.stderr:tar: Error is not recoverable: exiting now 2024-03-27T07:41:06.027 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/crash to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643/remote/smithi153/crash 2024-03-27T07:41:06.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/crash -- . 2024-03-27T07:41:06.067 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/604548c2-ec09-11ee-95d0-87774f69a715/crash: Cannot open: No such file or directory 2024-03-27T07:41:06.067 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now 2024-03-27T07:41:06.068 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-27T07:41:06.068 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-03-27T07:41:06.103 INFO:teuthology.orchestra.run.smithi082.stdout:2024-03-27T07:26:57.692566+0000 mds.i (mds.1) 8 : cluster [WRN] Scrub error on inode 0x20000001e50 (/volumes/qa/sv_1/1c32081e-6c02-49bb-a07b-4168376546c5/client.0/tmp/blogbench-1.0/src/blogtest_in/blog-53) see mds.i log and `damage ls` output for details 2024-03-27T07:41:06.107 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-27T07:41:06.107 INFO:tasks.cephadm:Compressing logs... 2024-03-27T07:41:06.107 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-27T07:41:06.150 DEBUG:teuthology.orchestra.run.smithi149:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-27T07:41:06.153 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-27T07:41:06.175 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-27T07:41:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:: No such file or directory 2024-03-27T07:41:06.176 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.6.log 2024-03-27T07:41:06.178 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5/var/log/ceph/cephadm.log: --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mon.a.log 2024-03-27T07:41:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-27T07:41:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.6.log: /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.g.log 2024-03-27T07:41:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.j.log 2024-03-27T07:41:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.3.log 2024-03-27T07:41:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mgr.x.log 2024-03-27T07:41:06.179 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.0.log 2024-03-27T07:41:06.181 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mgr.x.log: 90.2% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-27T07:41:06.181 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-27T07:41:06.183 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.0.log: 94.6% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.g.log.gz 2024-03-27T07:41:06.183 INFO:teuthology.orchestra.run.smithi082.stderr: 94.7% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.j.log.gz 2024-03-27T07:41:06.183 INFO:teuthology.orchestra.run.smithi082.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-27T07:41:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.log 2024-03-27T07:41:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-27T07:41:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.log: 83.4% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-27T07:41:06.191 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.9.log 2024-03-27T07:41:06.192 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.d.log 2024-03-27T07:41:06.203 INFO:teuthology.orchestra.run.smithi153.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-03-27T07:41:06.203 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-27T07:41:06.203 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.l.log 2024-03-27T07:41:06.204 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-27T07:41:06.204 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.i.log 2024-03-27T07:41:06.204 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.11.log 2024-03-27T07:41:06.206 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.a.log 2024-03-27T07:41:06.207 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.d.log: 92.3% 91.0% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-27T07:41:06.207 INFO:teuthology.orchestra.run.smithi082.stderr: -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-27T07:41:06.209 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mgr.z.log 2024-03-27T07:41:06.209 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.8.log 2024-03-27T07:41:06.209 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.5.log 2024-03-27T07:41:06.209 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.f.log 2024-03-27T07:41:06.209 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-27T07:41:06.209 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.log 2024-03-27T07:41:06.209 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.2.log 2024-03-27T07:41:06.209 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.c.log 2024-03-27T07:41:06.209 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-27T07:41:06.210 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mon.c.log 2024-03-27T07:41:06.210 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-volume.log: /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mon.c.log: 94.6% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.l.log.gz 2024-03-27T07:41:06.210 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.a.log: 94.6% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.d.log.gz 2024-03-27T07:41:06.211 INFO:teuthology.orchestra.run.smithi082.stderr: 94.5% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.a.log.gz 2024-03-27T07:41:06.211 INFO:teuthology.orchestra.run.smithi153.stderr: 92.1% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mgr.z.log.gz 2024-03-27T07:41:06.214 INFO:teuthology.orchestra.run.smithi149.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-03-27T07:41:06.214 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-27T07:41:06.214 INFO:teuthology.orchestra.run.smithi149.stderr:gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.10.log 2024-03-27T07:41:06.215 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-27T07:41:06.215 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.b.log 2024-03-27T07:41:06.215 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.4.log 2024-03-27T07:41:06.216 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.1.log 2024-03-27T07:41:06.216 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.k.log 2024-03-27T07:41:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.h.log 2024-03-27T07:41:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.7.log 2024-03-27T07:41:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.e.log 2024-03-27T07:41:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mgr.y.log 2024-03-27T07:41:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-27T07:41:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.log 2024-03-27T07:41:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-27T07:41:06.219 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mon.b.log 2024-03-27T07:41:06.220 INFO:teuthology.orchestra.run.smithi149.stderr:/var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-volume.log: /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mon.b.log: 94.5% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.k.log.gz 2024-03-27T07:41:06.224 INFO:teuthology.orchestra.run.smithi149.stderr: 92.0% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mgr.y.log.gz 2024-03-27T07:41:06.275 INFO:teuthology.orchestra.run.smithi149.stderr: 82.8% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-27T07:41:06.335 INFO:teuthology.orchestra.run.smithi153.stderr: 90.4% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-27T07:41:06.340 INFO:teuthology.orchestra.run.smithi153.stderr: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-27T07:41:06.402 INFO:teuthology.orchestra.run.smithi153.stderr: 90.9% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-27T07:41:06.424 INFO:teuthology.orchestra.run.smithi149.stderr: 90.9% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-27T07:41:06.428 INFO:teuthology.orchestra.run.smithi153.stderr: 92.3% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-27T07:41:06.507 INFO:teuthology.orchestra.run.smithi153.stderr: 82.7% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-27T07:41:06.570 INFO:teuthology.orchestra.run.smithi149.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-27T07:41:06.572 INFO:teuthology.orchestra.run.smithi149.stderr: 90.4% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-27T07:41:06.607 INFO:teuthology.orchestra.run.smithi082.stderr: 90.7% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mgr.x.log.gz 2024-03-27T07:41:06.783 INFO:teuthology.orchestra.run.smithi149.stderr: 92.3% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-27T07:41:07.277 INFO:teuthology.orchestra.run.smithi082.stderr: 90.5% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mon.a.log.gz 2024-03-27T07:41:10.197 INFO:teuthology.orchestra.run.smithi153.stderr: 92.0% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mon.c.log.gz 2024-03-27T07:41:16.882 INFO:teuthology.orchestra.run.smithi149.stderr: 92.0% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mon.b.log.gz 2024-03-27T07:41:35.330 INFO:teuthology.orchestra.run.smithi082.stderr: 91.4% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.9.log.gz 2024-03-27T07:41:40.186 INFO:teuthology.orchestra.run.smithi082.stderr: 91.4% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.6.log.gz 2024-03-27T07:41:47.965 INFO:teuthology.orchestra.run.smithi082.stderr: 91.4% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.0.log.gz 2024-03-27T07:41:51.619 INFO:teuthology.orchestra.run.smithi082.stderr: 91.3% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.3.log.gz 2024-03-27T07:41:51.621 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-03-27T07:41:51.622 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m45.459s 2024-03-27T07:41:51.622 INFO:teuthology.orchestra.run.smithi082.stderr:user 2m27.034s 2024-03-27T07:41:51.622 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m4.654s 2024-03-27T07:43:08.858 INFO:teuthology.orchestra.run.smithi153.stderr: 94.8% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.c.log.gz 2024-03-27T07:44:00.343 INFO:teuthology.orchestra.run.smithi153.stderr: 91.4% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.8.log.gz 2024-03-27T07:44:07.744 INFO:teuthology.orchestra.run.smithi153.stderr: 95.2% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.f.log.gz 2024-03-27T07:44:16.999 INFO:teuthology.orchestra.run.smithi153.stderr: 91.3% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.2.log.gz 2024-03-27T07:44:22.814 INFO:teuthology.orchestra.run.smithi149.stderr: 95.0% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.e.log.gz 2024-03-27T07:44:24.506 INFO:teuthology.orchestra.run.smithi153.stderr: 91.5% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.11.log.gz 2024-03-27T07:44:58.717 INFO:teuthology.orchestra.run.smithi153.stderr: 91.3% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.5.log.gz 2024-03-27T07:46:42.574 INFO:teuthology.orchestra.run.smithi149.stderr: 91.5% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.4.log.gz 2024-03-27T07:47:18.483 INFO:teuthology.orchestra.run.smithi149.stderr: 91.2% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.10.log.gz 2024-03-27T07:48:15.358 INFO:teuthology.orchestra.run.smithi153.stderr: 93.2% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.i.log.gz 2024-03-27T07:48:15.377 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-03-27T07:48:15.377 INFO:teuthology.orchestra.run.smithi153.stderr:real 7m9.196s 2024-03-27T07:48:15.377 INFO:teuthology.orchestra.run.smithi153.stderr:user 6m11.187s 2024-03-27T07:48:15.377 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m14.044s 2024-03-27T07:49:04.722 INFO:teuthology.orchestra.run.smithi149.stderr: 91.3% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.1.log.gz 2024-03-27T07:49:58.257 INFO:teuthology.orchestra.run.smithi149.stderr: 91.5% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-osd.7.log.gz 2024-03-27T08:00:03.919 INFO:teuthology.orchestra.run.smithi149.stderr: 93.6% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.h.log.gz 2024-03-27T08:00:09.563 INFO:teuthology.orchestra.run.smithi149.stderr: 93.5% -- replaced with /var/log/ceph/604548c2-ec09-11ee-95d0-87774f69a715/ceph-mds.b.log.gz 2024-03-27T08:00:09.585 INFO:teuthology.orchestra.run.smithi149.stderr: 2024-03-27T08:00:09.585 INFO:teuthology.orchestra.run.smithi149.stderr:real 19m3.419s 2024-03-27T08:00:09.585 INFO:teuthology.orchestra.run.smithi149.stderr:user 6m37.854s 2024-03-27T08:00:09.585 INFO:teuthology.orchestra.run.smithi149.stderr:sys 0m18.814s 2024-03-27T08:00:09.586 INFO:tasks.cephadm:Archiving logs... 2024-03-27T08:00:09.587 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643/remote/smithi082/log 2024-03-27T08:00:09.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-27T08:00:35.682 DEBUG:teuthology.misc:Transferring archived files from smithi149:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643/remote/smithi149/log 2024-03-27T08:00:35.684 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-27T08:01:38.888 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643/remote/smithi153/log 2024-03-27T08:01:38.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-27T08:02:41.505 INFO:tasks.cephadm:Removing cluster... 2024-03-27T08:02:41.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 604548c2-ec09-11ee-95d0-87774f69a715 --force 2024-03-27T08:02:41.699 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T08:02:42.204 DEBUG:teuthology.orchestra.run.smithi149:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 604548c2-ec09-11ee-95d0-87774f69a715 --force 2024-03-27T08:02:42.637 INFO:teuthology.orchestra.run.smithi149.stdout:Deleting cluster with fsid: 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T08:02:43.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 604548c2-ec09-11ee-95d0-87774f69a715 --force 2024-03-27T08:02:43.604 INFO:teuthology.orchestra.run.smithi153.stdout:Deleting cluster with fsid: 604548c2-ec09-11ee-95d0-87774f69a715 2024-03-27T08:02:44.297 INFO:tasks.cephadm:Removing cephadm ... 2024-03-27T08:02:44.297 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-27T08:02:44.316 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-27T08:02:44.334 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-27T08:02:44.350 INFO:tasks.cephadm:Teardown complete 2024-03-27T08:02:44.350 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-27T08:02:44.363 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-27T08:02:44.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-27T08:02:44.365 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-27T08:02:44.377 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-27T08:02:44.731 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-27T08:02:44.743 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-27T08:02:44.743 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T08:02:44.746 DEBUG:teuthology.orchestra.run.smithi149:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T08:02:44.749 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T08:02:44.760 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-03-27T08:02:44.762 INFO:teuthology.orchestra.run.smithi149.stderr:bash: line 1: ntpq: command not found 2024-03-27T08:02:44.763 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-03-27T08:02:44.765 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T08:02:44.765 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-03-27T08:02:44.765 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 17 -328us[ -328us] +/- 76ms 2024-03-27T08:02:44.765 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv02.front.sepia.ceph.com 3 6 377 22 -1110us[-1105us] +/- 72ms 2024-03-27T08:02:44.765 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 +1808us[+1813us] +/- 88ms 2024-03-27T08:02:44.765 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:02:44.839 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T08:02:44.840 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-03-27T08:02:44.840 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 17 -380us[ -380us] +/- 76ms 2024-03-27T08:02:44.840 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv02.front.sepia.ceph.com 3 6 377 18 -1126us[-1100us] +/- 72ms 2024-03-27T08:02:44.840 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +1783us[+1809us] +/- 88ms 2024-03-27T08:02:44.840 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:02:44.866 INFO:teuthology.orchestra.run.smithi149.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T08:02:44.867 INFO:teuthology.orchestra.run.smithi149.stdout:=============================================================================== 2024-03-27T08:02:44.867 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 -334us[ -356us] +/- 76ms 2024-03-27T08:02:44.867 INFO:teuthology.orchestra.run.smithi149.stdout:^* hv02.front.sepia.ceph.com 3 6 377 16 -1103us[-1124us] +/- 73ms 2024-03-27T08:02:44.867 INFO:teuthology.orchestra.run.smithi149.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +1823us[+1801us] +/- 88ms 2024-03-27T08:02:44.867 INFO:teuthology.orchestra.run.smithi149.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:02:44.869 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-27T08:02:44.879 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-27T08:02:44.880 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-27T08:02:44.890 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-27T08:02:44.978 DEBUG:teuthology.orchestra.run.smithi149:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-27T08:02:45.118 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-27T08:02:45.217 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T08:02:45.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:02:45.252 DEBUG:teuthology.orchestra.run.smithi149:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T08:02:45.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:02:45.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T08:02:45.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:02:45.317 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-27T08:02:45.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-27T08:02:45.344 INFO:teuthology.task.internal:Duration was 3422.416687 seconds 2024-03-27T08:02:45.344 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-27T08:02:45.355 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-27T08:02:45.355 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-27T08:02:45.358 DEBUG:teuthology.orchestra.run.smithi149:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-27T08:02:45.362 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-27T08:02:45.403 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T08:02:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T08:02:45.448 INFO:teuthology.orchestra.run.smithi149.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T08:02:45.809 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-27T08:02:45.809 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-03-27T08:02:45.809 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-27T08:02:45.830 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi149.front.sepia.ceph.com 2024-03-27T08:02:45.831 DEBUG:teuthology.orchestra.run.smithi149:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-27T08:02:45.855 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-03-27T08:02:45.855 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-27T08:02:45.888 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-27T08:02:45.888 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T08:02:45.891 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T08:02:45.897 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T08:02:45.957 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-27T08:02:45.957 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-27T08:02:45.961 DEBUG:teuthology.orchestra.run.smithi149:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-27T08:02:45.963 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-27T08:02:46.397 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-27T08:02:46.411 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-27T08:02:46.411 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-27T08:02:46.439 DEBUG:teuthology.orchestra.run.smithi149:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-27T08:02:46.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-27T08:02:46.510 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-27T08:02:46.522 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:02:46.525 DEBUG:teuthology.orchestra.run.smithi149:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:02:46.528 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:02:46.548 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-03-27T08:02:46.589 INFO:teuthology.orchestra.run.smithi149.stdout:kernel.core_pattern = core 2024-03-27T08:02:46.591 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-03-27T08:02:46.616 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:02:46.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:02:46.630 DEBUG:teuthology.orchestra.run.smithi149:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:02:46.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:02:46.645 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:02:46.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:02:46.669 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-27T08:02:46.681 INFO:teuthology.task.internal:Transferring archived files... 2024-03-27T08:02:46.683 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643/remote/smithi082 2024-03-27T08:02:46.683 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-27T08:02:46.732 DEBUG:teuthology.misc:Transferring archived files from smithi149:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643/remote/smithi149 2024-03-27T08:02:46.732 DEBUG:teuthology.orchestra.run.smithi149:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-27T08:02:46.774 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643/remote/smithi153 2024-03-27T08:02:46.774 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-27T08:02:46.816 INFO:teuthology.task.internal:Removing archive directory... 2024-03-27T08:02:46.816 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-27T08:02:46.819 DEBUG:teuthology.orchestra.run.smithi149:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-27T08:02:46.821 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-27T08:02:46.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-27T08:02:46.876 INFO:teuthology.task.internal:Not uploading archives. 2024-03-27T08:02:46.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-27T08:02:46.888 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-27T08:02:46.888 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-27T08:02:46.890 DEBUG:teuthology.orchestra.run.smithi149:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-27T08:02:46.893 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-27T08:02:46.902 INFO:teuthology.orchestra.run.smithi082.stdout: 265819 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 08:02 /home/ubuntu/cephtest 2024-03-27T08:02:46.904 INFO:teuthology.orchestra.run.smithi149.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 08:02 /home/ubuntu/cephtest 2024-03-27T08:02:46.918 INFO:teuthology.orchestra.run.smithi153.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 08:02 /home/ubuntu/cephtest 2024-03-27T08:02:46.919 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-27T08:02:46.933 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-27T08:02:46.962 INFO:teuthology.nuke:Checking targets against current locks 2024-03-27T08:02:46.989 DEBUG:teuthology.nuke:shortname: smithi082 2024-03-27T08:02:46.989 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T08:02:47.013 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 06:57:02.410070', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHyKlwU/8vvEDZtASdJ4Z26yxTjuFDOYQJM5ICIsrgU2p4lObqJHeUiTGw8f7134y4IxYMGRqlK6m/UGwlME0Y='} 2024-03-27T08:02:47.017 DEBUG:teuthology.nuke:shortname: smithi149 2024-03-27T08:02:47.017 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T08:02:47.041 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 06:57:02.407114', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwO3e74ntGnFJH7U6cLrL18uKEQunj4yHCQHZJkQMVaPL8jM8XqT7xHaYA1TU2YsLjO5XNm1pvbXxepJnKo0RU='} 2024-03-27T08:02:47.046 DEBUG:teuthology.nuke:shortname: smithi153 2024-03-27T08:02:47.047 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T08:02:47.075 INFO:teuthology.orchestra.console.smithi082:Power off 2024-03-27T08:02:47.075 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T08:02:47.088 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625643', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 06:57:02.408524', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAKuhnMdEzyYcOF9V83N/kvSsxbGZLUl1g72HhH6DSjVxQ01Zw6GmIJqxSQJfl9wIMAnNfloX/GKIpHmlkwz5OM='} 2024-03-27T08:02:47.100 DEBUG:teuthology.orchestra.console.smithi082:power off output: Chassis Power Control: Down/Off 2024-03-27T08:02:47.100 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:47.119 INFO:teuthology.orchestra.console.smithi149:Power off 2024-03-27T08:02:47.119 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T08:02:47.132 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-03-27T08:02:47.142 DEBUG:teuthology.orchestra.console.smithi149:power off output: Chassis Power Control: Down/Off 2024-03-27T08:02:47.142 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:47.160 INFO:teuthology.orchestra.console.smithi153:Power off 2024-03-27T08:02:47.160 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T08:02:47.171 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-27T08:02:47.184 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2024-03-27T08:02:47.184 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:47.208 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-27T08:02:51.133 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:51.172 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:51.209 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:51.247 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is on 2024-03-27T08:02:51.283 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-27T08:02:51.321 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-27T08:02:55.250 DEBUG:teuthology.orchestra.console.smithi082:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:55.284 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:55.322 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:55.362 DEBUG:teuthology.orchestra.console.smithi082:check power output: Chassis Power is off 2024-03-27T08:02:55.393 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is on 2024-03-27T08:02:55.436 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2024-03-27T08:02:55.464 INFO:teuthology.orchestra.console.smithi082:Power off completed 2024-03-27T08:02:59.394 DEBUG:teuthology.orchestra.console.smithi149:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:59.437 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:02:59.506 DEBUG:teuthology.orchestra.console.smithi149:check power output: Chassis Power is off 2024-03-27T08:02:59.548 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2024-03-27T08:02:59.607 INFO:teuthology.orchestra.console.smithi149:Power off completed 2024-03-27T08:02:59.649 INFO:teuthology.orchestra.console.smithi153:Power off completed 2024-03-27T08:02:59.755 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/blogbench}} duration: 3422.4166870117188 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_rishabh@teuthology status: fail success: false 2024-03-27T08:02:59.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T08:02:59.839 INFO:teuthology.run:FAIL